Success message
error message
warn message
Final Evaluation of Integrated Territorial Development 2 Project
Commissioning Unit: Kosovo
Evaluation Plan: 2016-2020
Evaluation Type: Project
Completion Date: 12/2019
Unit Responsible for providing Management Response: Kosovo
Documents Related to overall Management Response:  
1. Recommendation:

URGENT – For UNDP

Recommendation 1: Design and fund a bridge project at least until November 2020

The most vulnerable aspect of InTerDev 2 is the sustainability of several of its results due to how abrupt its closure could be. This type of abrupt closure could also have a negative impact on the reputation and on the trust that UNDP has built with its partners and beneficiaries in the three municipalities. It is therefore highly recommended that a bridge project be designed that maintains the essential elements of InTerDev at least until November 2020, when it is known what form the new ADA-funded intervention will take.

These essential aspects should include retaining the talent and experience of InTerDev's core team

Management Response: [Added: 2020/01/24] [Last Updated: 2020/11/08]

The senior management has initiated contacts and meetings with potential donors interested to fund and scale up the work of INTERDEV project.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Meet with potential donors to explore opportunities for partnerships to ensure sustainability and scaling up of the results, also considering the importance of retaining the capacity and experience of INTERDEV's core team.
[Added: 2020/02/03] [Last Updated: 2022/01/13]
Senior Management 2021/12 Completed All potential donors were contacted and the scale up and follow up project were discussed and considered. However the similar initiatives was funded and implemented through other parties. History
1.2 Programme team will organise a fair with INTERDEV producers/beneficiaries; with the aim to attract potential donors for a new project and create possibility for farmers to sell and promote their products. The videos and book stories as a result of the Inter-municipal initiatives, will be launched and delivered to the audience.
[Added: 2020/02/03] [Last Updated: 2022/01/13]
Programme Team 2021/12 No Longer Applicable [Justification: The recommendation was not possible to materialize as soon after the project completion and evaluation there happened the COVID-19 pandemics outbreak.]
History
2. Recommendation:

For UNDP

Recommendation 2: Design and fundraise for INTERDEV 3 beyond November 2020

Beyond the bridge project, it is recommended that UNDP continue building on the successes of the two phases of InTerDev and design a third phase incorporating improvements and learning. In this third phase, special care should be taken to establish synergies with other international actors present in the area, especially ADA (if applicable), to ensure that InTerDev's approach is complementary to the rest of the initiatives.

Management Response: [Added: 2020/02/03] [Last Updated: 2020/11/08]

The programme team will design the new project proposal to ensure follow up of INTERDEV 2 results and sustainability in the partner areas, building upon the already achieved results and focusing on the sectors as defied with potential donors (i.e. gender, long-term-unemployed, tourism, rural development etc.).

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Intensify meetings with potential donors and define the key areas and activities for the INTERDEV 3 approach.
[Added: 2020/02/03] [Last Updated: 2021/01/06]
Senior Management 2020/12 Completed Concept note for Recovery from COVID19 through rural development has been developed and submitted to EU for funding. EU is currently focusing on emergency projects due to COVID - 19, so during recovery period this idea shall be presented to other bilateral donors as a building back greener concept. History
The Programme team will take into consideration consolidated lessons learned from INTERDEV 2 and design actions of the new proposal with specific emphasis on the co-financing with the already partnering municipalities and their strong commitment and knowledge gained.
[Added: 2020/02/03] [Last Updated: 2020/10/13]
Programme team 2020/09 Completed The programme team designed the new proposal as a follow up of INTERDV 2, linked COVID-19 recovery period, with the principle Building Back Better/Greener. The proposal is submitted to EU Office in Kosovo. History
3. Recommendation:

For UNDP

Recommendation 3: Include an exit strategy and/or donor diversification strategy

In future projects, it is advisable to incorporate a specific exit strategy from the very design of the intervention. This strategy can also be complemented with a donor diversification plan. In this case, UNDP would have to ensure that it has the capacity (i.e. appropriate profiles) for resource mobilization, either within the project team or in the Prishtina/Priština office. Adopting a ToC approach complementary to the logical framework can help to update the objectives and concrete plans of a potential exit strategy.

Management Response: [Added: 2020/02/03] [Last Updated: 2020/11/08]

Programme team to coordinate and design the exit strategy and possible donor diversification strategy (i.e. UNKT, SIDA, ADA, Norway etc)

Key Actions:

Key Action Responsible DueDate Status Comments Documents
The programme team will actively dialogue with partners and disseminate INTEDEV 2 results, with the emphasis on marginalised communities, remote areas, gender, rural development, and unemployment.
[Added: 2020/02/03] [Last Updated: 2020/04/16]
Programme team 2020/03 Completed The results were disseminated with all partners and stakeholders. The results had a clear focus on marginalized communities, remote areas, gender, rural development dimensions. History
The programme team will make efforts that relevant donor plans/strategies have integrated the INTERDEV 2 approach and the INTERDEV 3 is in the project pipeline to be funded.
[Added: 2020/02/03] [Last Updated: 2020/04/16]
Programme team 2020/03 Completed The results, concepts and the approach was shared with the stakeholders and donors. the INTERDEV 3 project is prepared and submitted to EU for funding. History
4. Recommendation:

For UNDP

Recommendation 4: Incorporate a ToC approach complementing the logical framework

In future interventions use Theory of Change (ToC) as a complementary approach to the logical framework. The elements that a ToC should contain a description of the motivational horizon and the pathway to change, an update of the context in which the project operates, a description of the main stakeholders (change agents, partners, opposers, etc.), the preconditions to reach such changes, and the assumptions behind the occurrence (or not) of the desired transformations. The ToC is a dynamic tool that should be checked from time to time. It is also a tool that allows looking beyond the objectives that the project had set. For example, in the case of InTerDev 2, a review of the ToC could question not only if the project created employment but how to lay the groundwork for this employment to be of quality. 

Management Response: [Added: 2020/02/03] [Last Updated: 2020/11/08]

Together with external expertise where applicable the project/programme will explore the ToC approach in completing the logical framework for future similar projects.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
The ToC approach will be the basis for the future project, in line with UNDP’s corporate guidelines.
[Added: 2020/02/03] [Last Updated: 2021/01/06]
Programme team 2020/12 Completed The new concept note incorporated TOC approach History
5. Recommendation:

For UNDP

Recomendation 5: Improve design by adding new variables

The design was one of the highlights of InTerDev. However, several aspects could be improved. Firstly, it is recommended to incorporate qualitative indicators that favour impact monitoring. It is also advisable to incorporate information on how the concept of "time poverty" may affect men and women differently as a consequence of the project's actions.

Management Response: [Added: 2020/02/03] [Last Updated: 2020/11/08]

Several aspects are to be considered for the future that can further help to improve such as integration of qualitative indicators that help impact monitoring. Furthermore, it is also advisable to incorporate information on how the concept of "time poverty" may affect men and women differently as a consequence of the project's actions.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
The programme team to clearly define quality indicators that directly support the impact monitoring.
[Added: 2020/02/03] [Last Updated: 2021/01/06]
Programme team 2020/12 Completed New concept note embraced the recommendation History
Incorporation of information on how the concept of "time poverty" may affect men and women differently as a consequence of the project's actions will be taken into account when designing the project by the designated programme staff.
[Added: 2020/02/03] [Last Updated: 2021/01/06]
Programme team 2020/12 Completed New concept note embraced the recommendation History
6. Recommendation:

For UNDP

Recommendation 6: Incorporate impact monitoring to feed into project learning

The impact survey carried out by the project was an excellent attempt at impact monitoring. However, in the future it is recommended to simplify this data collection technique, using, for example, specialized monitoring software or other data generation tools, such as focus groups. This simplification would allow repeating the impact monitoring regularly during the project´s implementation so that it feeds into the ToC sessions. 

 

Management Response: [Added: 2020/02/03] [Last Updated: 2020/11/08]

UNDP programme/project has developed a new monitoring software/monitoring tool during the Q3, and it has been used for the final evaluation of the Interdev 2 project.However, the simplification of it, would easily feed into the ToC sessions.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
If funding can be secured, the Programme team will continue developing and simplifying the monitoring tool.
[Added: 2020/02/03] [Last Updated: 2022/01/13]
Programme team (and potential INTERDEV 3 team) 2021/12 No Longer Applicable [Justification: As the funding was not secured this is not applicable. However the monitoring process and procedures are simplified for other similar projects.]
History
7. Recommendation:

For UNDP

Recommendation 7: Revise the CVT component

Vocational training has borne some fruit, but the strategy was not cost-effective. It is recommended that in future phases of InTerDev either this component be cancelled or redesigned. In this sense, possibly the component could be more effective if accompanied by paid internships in local companies. 

Management Response: [Added: 2020/02/03] [Last Updated: 2020/11/08]

This recommendation is linked also with other UNDP projects and as well with the different international organizations and line Ministries operating in this field in Kosovo. UNDP will take a lead to work with the partners in planning the future interventions, closely connected with the INTERDEV 2 sector interventions.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
The programme team will carry out a comprehensive impact survey for similar interventions in the future in order to jointly with Agency for Employment enhance the certified vocational training in line with the needs in the territories. Under the ongoing UNDP interventions, UNDP will explore modalities for revision of CVT under the Active Labour Market Project.
[Added: 2020/02/03] [Last Updated: 2022/01/12]
Programme team 2021/12 Completed As the phase 3 of the project was not materialized UNDP through the ALMP2 project under OUTPUT 1: Human Resource capacities of MLSW, EARK and PES are improved for delivering of employment services by Employment offices, VTCs, and Labour market research and evidence has responded nees of the public employment service through following activities : - 20 trainers were engaged to provide support and expertise to the Vocational Training Centers TC to improve the provision of vocational training services - Labor Cost Survey (LCS) published - The project has supported the functionalization of tailoring training courses in the VTC Mitrovica, Prizren and Podujevo, through supplying new equipment and functionalizing existing ones. - Is conducted Research: Inclusion of marginalized groups in the labour market in Kosovo - The operational guidelines for implementation of active labour market measures are updated in line with identified needs of Employment offices and Vocational Training Centers by Employment Agency . - Feasibility study in order to ensure sustainability in the financing and implementation of active employment measures is finalized and submitted to government . Furthermore, the project has undertaken numerous measures in supporting the employment offices and VTC centres in the implementation of employment schemes. During the month of February 2019-2020, the project has organized coordination meetings, together with the Employment Agency, throughout all the employment offices and Vocational Centres . These meetings sought the identification of challenges and opportunities of the public employment services in implementing the active labour market measures, as well as providing advice in ensuring the provision of quality employment services. The meetings highlighted the need for better coordination between the local and regional level institutions, in easing the administrative procedures associated with the obtaining and provision of employment services. In addition , a recurrent issue with the employment offices is the lack of logistical capacities, namely, proper transportation means for the officers involved in implementing the employment measures; throughout the meetings, it has been agreed upon that the project shall support the employment offices in monitoring the beneficiaries via jointly arranged visits. History
8. Recommendation:

For ADA

Recommendation 8: Ensure any approach is leaving no one behind

For the forthcoming funding cycle on local economic development, ADA should ensure that the SDGs and the principle of ‘leaving no one behind’ targeting the most deprived and vulnerable people are sustained and prevail over the general economic growth approach. 

Management Response: [Added: 2020/11/03] [Last Updated: 2020/11/08]

Key Actions:

9. Recommendation:

For municipalities

Recommendation 9: Focus on water accumulation and irrigation systems

Step up the capital investments in the expansion of the water accumulation and irrigation systems, which have proven to be vital to the needs of farmers and in accelerating local economic growth. 

Management Response: [Added: 2020/11/03] [Last Updated: 2020/11/08]

Key Actions:

10. Recommendation:

For DR and ST municipalities

Recommendation 10: Promote a ‘Sharr/Šar region’ brand

Jointly engage in ‘Sharr/Šar region’ product branding and marketing regulation, establishing adequate quality assurance criteria and funding mechanisms that protect local ‘Sharr/Šar region’ products and producers/farmers.

Management Response: [Added: 2020/11/03] [Last Updated: 2020/11/08]

Key Actions:

11. Recommendation:

LESSONS LEARNED AND BEST PRACTICES

Looking beyond the limits of the project

Probably the most important lesson learned through InTerDev 2 is the need to look beyond the strict limits of the project. This means establishing spaces where strategic decisions are discussed and made beyond the progress of the implementation of the activities and their immediate results. These questions could include what can happen when the funds are exhausted (exit strategy) or what are the real changes the project is contributing to and what should happen in order to build on those changes (from generating jobs to generating taxpayers). These would also be spaces to challenge the assumptions underpinning the different project components. For example, to what extent it is realistic for a significant proportion of beneficiaries to access Ministry grants; or what would be the critical mass needed for changes to be considered collective. That is to say, spaces for reflection about the "what", the "so what?" and the "then what?". 

Involvement of municipalities

A best practice of InTerDev has been how it has involved the different partners and especially the municipalities. The fact that they have been involved in all aspects of the project has meant that there has been a huge increase in local ownership. Furthermore, this interaction has been the main tool for installing capabilities.

Relaying local expertise

The fact that the entire InTerDev 2 team was based in the project area has been one of the essential factors of its success and should be considered a best practice. It has not only meant that the project was able to benefit from their experience and knowledge, but it also contributed to the general efficiency of the project (in terms of its value for money). 

Management Response: [Added: 2020/11/03] [Last Updated: 2020/11/07]

Key Actions:

Latest Evaluations

Contact us

1 UN Plaza
DC1-20th Floor
New York, NY 10017
Tel. +1 646 781 4200
Fax. +1 646 781 4213
erc.support@undp.org