Evaluation of the Energy and Environment Portfolio

Report Cover Image
Evaluation Plan:
2016-2020, Kosovo
Evaluation Type:
Outcome
Planned End Date:
03/2017
Completion Date:
02/2017
Status:
Completed
Management Response:
Yes
Evaluation Budget(US $):
40,000

Share

Document Type Language Size Status Downloads
Download document TOR for Outcome Evaluation.pdf tor English 604.15 KB Posted 166
Download document UNDP Kosovo_Env_Outcome Evaluation Report_FINAL 1.pdf report English 984.74 KB Posted 64
Title Evaluation of the Energy and Environment Portfolio
Atlas Project Number: 00066266,00086486
Evaluation Plan: 2016-2020, Kosovo
Evaluation Type: Outcome
Status: Completed
Completion Date: 02/2017
Planned End Date: 03/2017
Management Response: Yes
Focus Area:
  • 1. Environment & Sustainable Development
  • 2. Others
Corporate Outcome and Output (UNDP Strategic Plan 2014-2017)
  • 1. Output 5.1. Mechanisms in place to assess natural and man-made risks at national and sub-national levels
  • 2. Output 5.2. Effective institutional, legislative and policy frameworks in place to enhance the implementation of disaster and climate risk management measures at national and sub-national levels
Evaluation Budget(US $): 40,000
Source of Funding: UNDP
Evaluation Expenditure(US $): 14,645
Joint Programme: No
Mandatory Evaluation: No
Joint Evaluation: No
Evaluation Team members:
Name Title Email Nationality
Ms. Magda Stepanyan Envermat Evaluator magdastepanyan@yahoo.com ARMENIA
GEF Evaluation: No
Key Stakeholders: UNDP, Ministry of Environment, NGO's, donors, and communities
Countries: KOSOVO
Lessons
1.

The report did not contain information on lessons learned and due to dissagreements between UNDP Kosovo and the evaluator on other sections of the report, the inputs regarding lessons were not made by the evaluator, hence ToRs requirements are not fully met by her.


Findings
1.

The report did not contain information on findings and conclusions and due to dissagreements between UNDP Kosovo and the evaluator on other sections of the report, the inputs regarding findings and conclusions were not made by the evaluator, hence ToRs requirements are not fully met by her.

In addition, as per UNDP Evaluation Policy, (articles, 9 – 12; High ethical standards and norms must be upheld), the evaluators must be sensitive to the beliefs, manners and customs of the social and cultural environments in which they work. In this regard the International Consultant for this evaluation, didn’t take in consideration our comments related to the limitation that UNDP Kosovo office have when it comes to access to GEF and other global funds. Also, the evidence UNDP Kosovo provided wasn’t taken in consideration, as per UNDP Evaluation Policy, (article-11; the evaluators must respect the right of institutions and individuals to provide information, while ensuring that individual evaluation findings are triangulated to avoid being based solely on one sours of information), our right as institution to provide additional information was not respected. UNDP Kosovo’s recommendation were not taken in to account by the consultant hence not reflected in the report by the consultant.

 


Recommendations
1

Continue advocating for the environmental issues at all levels in Kosovo. Importance of this work depends on UNDP’s capacities to create support

a) within the local civil society organizations, and

b) among the donor community

2

Raise an issue and advocate for creating a business environment that respects the environment. Engage IMF49 and WB in dialogue to find entry point(s) affordable for the current development priorities and needs. Became an advocate of such economic growth that is achieved hand-in-hand with efficient use of resources and sustainable environmental protection. Towards this end, show-case this approach first through UNDP’s interventions – partner up with relevant UNPD projects on local economic development to showcase environmentally sound development. Share lessons learned.

3

Continue exploring the nexus of development-health-environment in Kosovo potentially linking it with human security: building an evidence base on the linkages, advocating for immediate response when necessary, and creating capacities of national and local stakeholders to effectively address associated risks

4

Explore possibilities for targeted funding from the UN Trust Fund on Human security to address development-health-environment-human security nexus.

5

Explore innovative modalities in promoting energy efficiency measures at the local level - Green Municipality Model. Herewith, an indicative suggestion based on three recommendations:

1. Explore economic instruments for environmental protection also as suggested in the KES; and

2. Create a visible impact at the local level by generating ‘critical mass of intervention’ at the local level. This implies, moving away from piloting energy efficiency measures at the local level and investing in micro-projects on street lighting and ensuring the scale of investment

6

Explore non-traditional modalities in promoting environmentally sound business models: work with the young generation. Partner up with UNICEF to set up and replicate a ‘Young Environmental Entrepreneurs Academy’ whereby students would learn the basics of environment protection and would be able to practice those skills in small-scale interventions

7

Continue local level DRR interventions to address specific disaster risks (retrofitting of schools, retaining wall, etc.). This projects always creates necessary traction from the local community and local authorities stimulating follow-up measures. Ensure that the implementation of such interventions is being granted to the full charge and responsibility of the target municipalities and not UNDP staff to avoid creating parallel structures and strengthening public administration system at the local level.

8

Importantly, follow-up on Strategies developed within the programme (Climate Change Strategy and the DRR Strategy) through supporting their realization, monitoring, and regular review. To strengthen the ties with the neighborhood countries, initiate a peer-review process of the implementation of these Strategies with Macedonia, Albania, and other countries as deemed relevant and feasible. Peer review is a strong governance mechanism as well as a learning tool to strengthen the capacities of the parties engaged.

9

Invest in developing and updated (when relevant) the local level risk assessment and the local contingency plans. This can be a valuable source for the national level risk assessment and the national level contingency planning. Create at the local level the model how DRR can be mainstreamed in budget allocations for municipalities.

10

Continue developing capacities of local stakeholders in at least two ways:

1. While facilitating or funding any analytical work, organize it in such a way that it is a product of local experts working under the direction of international experts when relevant. This goes beyond simple consultations with national experts and required their engagement in data collection, analysis, and writing. In this way, the process itself will be highly valuable in terms of building capacities and creating necessary ownership. This could potentially facilitate the effective realization of the analytical recommendations when produced. This will also require adequate fund allocation for such work, whereby national experts get paid, and specific time allocated for such process.

2. Identify capacity gap for the effective implementation of the Strategies UNDP supported to design and follow up on bridging those gaps.

11

Introduce necessary flexibility in its programming to allow addressing emerging needs. Ensure non-ear-market budget allocations (at least through UNDP core funding) to explore new opportunities and ensure necessary responsiveness of the project or programme.

12

Further, strengthen gender equality and gender mainstreaming in Environment/DRR/CC programme through:

a) ensure gender-specific indicators are built into a programme and supporting projects design at the level of outcomes and outputs respectively. Partner up with UN Women to discuss how best this could be done taking into account the UN Women global flagship initiative on Gender Inequality of Risk;

b) building capacities of the national and local partners to mainstream gender in Environment/DRR/CC activities; c) engage actively the municipal Gender Focal points into the realization of the programme.

13

Process-wise, it is strongly recommended to carry out a relevance check of the ToC on regular basis (regularity should be decided by the programme team to fit the purpose).

1. Recommendation:

Continue advocating for the environmental issues at all levels in Kosovo. Importance of this work depends on UNDP’s capacities to create support

a) within the local civil society organizations, and

b) among the donor community

Management Response: [Added: 2018/10/12]

Agreed: In coordination with donor partners, UNDP will reach out to CSOs with various interventions to strengthen their capacities on issues of environment, awareness raising of financing opportunities and strengthen CSOs to become the advocate and the watchdog for implementation of the environmental strategies. 
Intensive communications with donor community as part of donor coordination mechanism as wells as bilaterally to influence their policies with more focus on the environment and make them astute of Kosovo’s challenges regarding vertical funds. 

 

Key Actions:

Key Action Responsible DueDate Status Comments Documents
With Luxemburg funding to engage CSOs on environment impact on health issues
[Added: 2018/10/12] [Last Updated: 2018/12/17]
Programme Team 2018/12 Completed A series of workshops for active public participation in decision making and lobbying and advocating were conducted focusing on air pollution and its impact on health. History
Increase capacities of CSOs to prepare for funds absorption from GEF SGP when available
[Added: 2018/10/12] [Last Updated: 2018/12/17]
Programme Team 2018/12 Completed Four modules of the training on main UN Conventions related to the GEF SGP were delivered to 21 local environmental CSOs. History
2. Recommendation:

Raise an issue and advocate for creating a business environment that respects the environment. Engage IMF49 and WB in dialogue to find entry point(s) affordable for the current development priorities and needs. Became an advocate of such economic growth that is achieved hand-in-hand with efficient use of resources and sustainable environmental protection. Towards this end, show-case this approach first through UNDP’s interventions – partner up with relevant UNPD projects on local economic development to showcase environmentally sound development. Share lessons learned.

Management Response: [Added: 2018/10/12] [Last Updated: 2018/10/12]

Partially agreed: UNDP will regularly communicate to IFIs to explore common areas of interest and work opportunities. Specifically, UNDP will promote organic farming for select municipalities through Austrian funding. Due to its mandate that limits UNDP to influence macro-level economic policy, we consider the recommendation to be overambitious.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Develop specific activities in an environmentally sound manner.
[Added: 2018/10/12]
Programme Team and Project Team 2017/12 Completed As part of a larger project financed by the Austrian government, InterDev 2, that focuses on local economic development, specific activities on organic farming were developed.
3. Recommendation:

Continue exploring the nexus of development-health-environment in Kosovo potentially linking it with human security: building an evidence base on the linkages, advocating for immediate response when necessary, and creating capacities of national and local stakeholders to effectively address associated risks

Management Response: [Added: 2018/10/12]

Agreed. This was an ongoing initiative at the time of evaluation. UNDP, WHO, and UNV will develop a joint initiative to address environmental impact on the health of the population, through a strengthening of intersectoral policy and coordination as well as monitoring, reporting, and awareness raising.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Design the project proposal
[Added: 2018/10/12]
Programme Team 2018/06 Completed Project proposal developed and submitted to the Government of Luxembourg for funding.
4. Recommendation:

Explore possibilities for targeted funding from the UN Trust Fund on Human security to address development-health-environment-human security nexus.

Management Response: [Added: 2018/10/12]

Agreed. We reached out a few times to UNHSF with strong project proposals. However, UNDP Kosovo was rejected with the justification that Kosovo already received 56 Mill $ from this fund, while in reality, UNDP was awarded 2 projects by HSTF with the total value of approximately 5 mills $. This can be explained through the fact that UNSTF considers all Japan government funds for Kosovo as UNSTF funds, given that Japan channeled their bilateral interventions in Kosovo through this fund.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
UNDP will develop a new proposal for UNSTF on health and environment
[Added: 2018/10/12]
Programme Team 2017/12 Completed
5. Recommendation:

Explore innovative modalities in promoting energy efficiency measures at the local level - Green Municipality Model. Herewith, an indicative suggestion based on three recommendations:

1. Explore economic instruments for environmental protection also as suggested in the KES; and

2. Create a visible impact at the local level by generating ‘critical mass of intervention’ at the local level. This implies, moving away from piloting energy efficiency measures at the local level and investing in micro-projects on street lighting and ensuring the scale of investment

Management Response: [Added: 2018/10/12]

Agreed: UNDP is interested to develop initiatives on Sustainable Cities – Urban NAMA

Key Actions:

Key Action Responsible DueDate Status Comments Documents
The Austrian government will be approached with the initiative for funding
[Added: 2018/10/12]
Senior Management 2018/08 Completed Austrian government expressed interest for UNDP concept on Urban NAMA
The proposal for Urban NAMA will be developed for their review and potential funding
[Added: 2018/10/12]
Programme Team 2019/06 Initiated The project proposal is being developed for the city of Prizren. Prizren Municipality confirmed in written their interest to co-finance the project.
6. Recommendation:

Explore non-traditional modalities in promoting environmentally sound business models: work with the young generation. Partner up with UNICEF to set up and replicate a ‘Young Environmental Entrepreneurs Academy’ whereby students would learn the basics of environment protection and would be able to practice those skills in small-scale interventions

Management Response: [Added: 2018/10/12]

Partially agreed: UNDP primary target group of beneficiaries is youth. We coordinate with UN agencies on regular bases and explore opportunities to target youth and students on health and environment related matters. However, due to limited opportunities for funding, UNDP cannot guarantee to replicate Young Environmental Entrepreneurs Academy. In addition, this specific recommendation was not discussed in advance with UNDP. 

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Future interventions to encompass direct engagement of youth in project interventions
[Added: 2018/10/12]
Programme Team 2020/12 Initiated The project on environment and health has a specific accent on youth engagement on its co-design concept for the hot spots municipalities; and #ecokosovo online awareness campaign.
7. Recommendation:

Continue local level DRR interventions to address specific disaster risks (retrofitting of schools, retaining wall, etc.). This projects always creates necessary traction from the local community and local authorities stimulating follow-up measures. Ensure that the implementation of such interventions is being granted to the full charge and responsibility of the target municipalities and not UNDP staff to avoid creating parallel structures and strengthening public administration system at the local level.

Management Response: [Added: 2018/10/12]

Agreed: UNDP is the main player in an area of DRR in Kosovo since 2010 and it developed great results to date. It will continue to target most vulnerable communities in the future for capacities for preparedness and prevention.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
UNDP Kosovo will approach BPPS to secure funding for continuation.
[Added: 2018/10/12]
Programme Team 2017/12 Completed UNDP Kosovo approached the “Funding Window” for the continuation of DRR project with the focus on conflict sensitivity issues
8. Recommendation:

Importantly, follow-up on Strategies developed within the programme (Climate Change Strategy and the DRR Strategy) through supporting their realization, monitoring, and regular review. To strengthen the ties with the neighborhood countries, initiate a peer-review process of the implementation of these Strategies with Macedonia, Albania, and other countries as deemed relevant and feasible. Peer review is a strong governance mechanism as well as a learning tool to strengthen the capacities of the parties engaged.

Management Response: [Added: 2018/10/12]

Agreed: UNDP is a champion of the development of the strategic framework in the area of Climate change and DRR. Best practice learning will continue to apply through our interventions within the sub-region to strengthen institutions for strategic implementation.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Exchange experience with counterparts in regional events
[Added: 2018/10/12]
Programme Team and Project Team 2020/12 Initiated The programme and project team are fully engaged and use every opportunity to send Kosovo officials in the regional and sub-regional CC and DRR events.
9. Recommendation:

Invest in developing and updated (when relevant) the local level risk assessment and the local contingency plans. This can be a valuable source for the national level risk assessment and the national level contingency planning. Create at the local level the model how DRR can be mainstreamed in budget allocations for municipalities.

Management Response: [Added: 2018/10/12]

Disagreed:  UNDP Kosovo engages in every opportunity to support institutions with local risk assessments and promote sufficient municipality finds allocations. However, Municipalities lack contingency plans, therefore, the recommendation cannot be implemented. 

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Explore opportunities with insurance companies to find models to include natural disasters on their insurance plans
[Added: 2018/10/12]
Programme Team and Project Team 2020/12 Initiated Close cooperation has been established with the “Insurance Association of Kosova” in order to support the Law that enables inclusion of natural disasters in insurance plans.
10. Recommendation:

Continue developing capacities of local stakeholders in at least two ways:

1. While facilitating or funding any analytical work, organize it in such a way that it is a product of local experts working under the direction of international experts when relevant. This goes beyond simple consultations with national experts and required their engagement in data collection, analysis, and writing. In this way, the process itself will be highly valuable in terms of building capacities and creating necessary ownership. This could potentially facilitate the effective realization of the analytical recommendations when produced. This will also require adequate fund allocation for such work, whereby national experts get paid, and specific time allocated for such process.

2. Identify capacity gap for the effective implementation of the Strategies UNDP supported to design and follow up on bridging those gaps.

Management Response: [Added: 2018/10/12]

Agreed: UNDP general practice in areas of specific expertise procures simultaneously international and local consultancies that work hand in hand on a specific task. It will continue in the same manner in the future

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Explore opportunities with insurance companies to find models to include natural disasters on their insurance plans
[Added: 2018/10/12]
Programme Team and Project Team 2020/12 Initiated Close cooperation has been established with the “Insurance Association of Kosova” in order to support the Law that enables inclusion of natural disasters in insurance plans.
11. Recommendation:

Introduce necessary flexibility in its programming to allow addressing emerging needs. Ensure non-ear-market budget allocations (at least through UNDP core funding) to explore new opportunities and ensure necessary responsiveness of the project or programme.

Management Response: [Added: 2018/10/12]

Partially agreed: UNDP has always used its limited amounts of core funds to position strategically and flexibly co-fund programmatic areas of interest to UNDP strategies and in line with emerging needs. Programmes are designed in the manner that allow for quick response to add-hock, however, we cannot ensure sufficient flexibility of the donor in all cases so the level of response can be limited at times. 

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Action to be taken if and when required
[Added: 2018/10/12]
Programme Team and Project Team 2020/12 Initiated
12. Recommendation:

Further, strengthen gender equality and gender mainstreaming in Environment/DRR/CC programme through:

a) ensure gender-specific indicators are built into a programme and supporting projects design at the level of outcomes and outputs respectively. Partner up with UN Women to discuss how best this could be done taking into account the UN Women global flagship initiative on Gender Inequality of Risk;

b) building capacities of the national and local partners to mainstream gender in Environment/DRR/CC activities; c) engage actively the municipal Gender Focal points into the realization of the programme.

Management Response: [Added: 2018/10/12]

Agreed: Gender mainstreaming is the key priority to all UNDP Programming and implementation. DRR and CCH UNDP interventions specifically have played a key policy role in strategies and policies gender-inclusive development.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Develop project a proposal on DRR with a strong gender focus.
[Added: 2018/10/12]
Programme Team 2018/08 Completed The project proposal on DRR with strong gender focus has been developed and submitted to “Funding Windows
13. Recommendation:

Process-wise, it is strongly recommended to carry out a relevance check of the ToC on regular basis (regularity should be decided by the programme team to fit the purpose).

Management Response: [Added: 2018/10/12]

Agreed: Review of ToC in all project is regularly carried out to determine the level of progress or assess bottlenecks on timely-manner to ensure the ToC is correct.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Review of TOC twice a year through the requirement of the mandatory QA
[Added: 2018/10/12]
Programme Team 2020/12 Not Initiated Based on UNDP rules and regulations on QA all projects must review ToC and harmonize it with Outcome ToC.

Latest Evaluations

Contact us

220 East 42nd Street
20th Floor
New York, NY 10017
Tel. +1 646 781 4200
Fax. +1 646 781 4213
erc.support@undp.org