Mid-Term Evaluation: Sustainable Energy Solutions for Rural Livelihoods in DPRK (SES)

Report Cover Image
Evaluation Plan:
2011-2019, DPR Korea
Evaluation Type:
Mid Term Project
Planned End Date:
09/2018
Completion Date:
08/2018
Status:
Completed
Management Response:
Yes
Evaluation Budget(US $):
12,000

Share

Document Type Language Size Status Downloads
Download document TOR_SES_CBDRM_Project_Final21Feb18.pdf tor English 488.26 KB Posted 185
Download document FinalMTRReport_SES_August 2018.pdf report English 1141.09 KB Posted 258
Download document FinalMTRReport_SES_Summary_August2018.docx summary English 1174.87 KB Posted 184
Title Mid-Term Evaluation: Sustainable Energy Solutions for Rural Livelihoods in DPRK (SES)
Atlas Project Number: 00090996
Evaluation Plan: 2011-2019, DPR Korea
Evaluation Type: Mid Term Project
Status: Completed
Completion Date: 08/2018
Planned End Date: 09/2018
Management Response: Yes
Focus Area:
  • 1. Environment & Sustainable Development
  • 2. Others
Corporate Outcome and Output (UNDP Strategic Plan 2014-2017)
  • 1. Output 1.5. Inclusive and sustainable solutions adopted to achieve increased energy efficiency and universal modern energy access (especially off-grid sources of renewable energy)
Evaluation Budget(US $): 12,000
Source of Funding: TRAC
Evaluation Expenditure(US $): 10,000
Joint Programme: No
Joint Evaluation: No
Evaluation Team members:
Name Title Email Nationality
Denika Blacklock Independant Evaluation Consultant djbkarim@gmail.com
GEF Evaluation: No
Key Stakeholders:
Countries: DPRK -DEMOCRATIC PEOPLE'S REPUBLIC OF KOREA
Comments:

The evaluation has been planned in the Project Document

Lessons
Findings
Recommendations
1

Contingency planning for RE activities

2

Data collection on users of public buildings

3

Improved qualitative data collection at the output level

4

Standardized monitoring tools

5

Communication of project results

6

Exit strategy

1. Recommendation:

Contingency planning for RE activities

Management Response: [Added: 2018/09/20] [Last Updated: 2018/10/03]

SES project is experiencing significant delays in procurement of RE and EE systems that need to be piloted. Therefore, the project shall develop a contingency plan to refocus on wider implementation of EE installations and consolidating knowledge gains among engineers and decision makers at the provincial and county level in order to prepare for (eventual) scale-up of the initiatives by the Government.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
1.1 Conduct in-country study tours (bringing together national partners) including NTDCs to discuss and share lessons and areas for intervention a) National consultants select most qualified experts at the NTDCs, Counties and Ris with the support of SES project team. b) Such visits could be expanded beyond the project and to the places such as Jangchon Co-operative farm, Pyongyang City and Natural Energy Institute under the State Academy of Science. c) Produce a report following in-country study tours and commitment received from its participants in scaling up of the EE interventions.
[Added: 2018/10/03] [Last Updated: 2019/09/25]
PA/SES Project team 2019/09 Completed Implemented History
1.1 Establish a regular communication with communities in the implementation of EE technologies with the ownership of MOEPI by sustaining momentum in activity implementation.
[Added: 2018/10/03] [Last Updated: 2019/09/25]
PA/SES Project team 2019/09 Completed Regular communication established with relevant parties History
2. Recommendation:

Data collection on users of public buildings

Management Response: [Added: 2018/10/03]

Project team works closely with county-level stakeholders (i.e.: managers of public buildings and national consultants) to improve their data collection on how many people (disaggregated by sex, age, disability) access services, and the impacts that the RE and EE improvements have had on particular humanitarian outcomes, particularly health.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
2.1 Firm up of the methodology of data collection from local stakeholders a) Rely on a good expertise of national consultants hired under SES b) Train them on the data collection on how many people (disaggregated by sex, age, disability) access public services.
[Added: 2018/10/03] [Last Updated: 2019/09/26]
PA/SES Project team 2019/09 Completed The project is continuing to reply on the expertise of national consultants in terms of data collection for the interventions completed as on Q1/2018. ROAR 2018 already reported sex disaggregated data, also by age and people with disabilities benefitting from those interventions. Updated information will be reported again in APR 2019 as well as in ROAR 2019. History
3. Recommendation:

Improved qualitative data collection at the output level

Management Response: [Added: 2018/10/03]

It is critical that the project team monitor results of capacity building at the output level, beyond demonstrating the successful implementation of capacity building activities. Below proposed output indicators, and targets, which aim to allow for the collection of data which can be used to analyze the meaningful change in capacity and quality effected by the project to date. These suggestions aim to identify possible entry points for the project, conscious of data access limitations.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
3.1 In consultation with MOEPI following indicators will be monitored by SES project. These will be reported in the QPRs: a. Extent to which County Energy Management Plans receive budgetary support for implementation from the county governments (Target: County Energy Management Plans receive at least 75% of necessary funding) b. Extent to which NTDCs are operational (Target: plans and budgets for 3 NTDCs approved) c. % change in improved attendance of 5-7-year-old children in target kindergartens between November-March (Target: at least a 50% increase)
[Added: 2018/10/03] [Last Updated: 2019/09/26]
PA/SES Project team 2019/09 Completed Suggested indicators are monitored and reported as below: a. UNDP included short term and immediate measures listed in the County Energy Management Plans (CEMPs) as part of its procurement plan in 2018. This procurement plan has been put on hold since early 2018 without any progress till date. As the project couldn’t showcase the implementation of CEMPs, counties refrained their budgetary support for CEMPs. b. Six NTDCs are operational across six counties. They are actively involved in the capacity building activities, mainly training. c. As the country office is functioning under cash conservation mode, no new activities can be commissioned under the project to initiate surveys for the assessment of children attendance in kindergartens. History
4. Recommendation:

Standardized monitoring tools

Management Response: [Added: 2018/10/03] [Last Updated: 2018/10/03]

It is recommended that instead of having joint reports following field visits, whether it is for implementation and/or monitoring purposes, team members should submit individual BTORs separately for project and programme

Key Actions:

Key Action Responsible DueDate Status Comments Documents
4.1 Projects and programme team will submit separate BTORs upon field missions.
[Added: 2018/10/03] [Last Updated: 2019/09/25]
SES Project team 2019/03 Completed Implemented History
4.2 Quarterly Progress Reports (QPRs) should be completed by the project team (lead by the Project Manager), with quality assurance of the data and analysis undertaken.
[Added: 2018/10/03] [Last Updated: 2019/09/25]
SES Project team/PA/M&E Specialist 2019/03 Completed Implemented History
4.3 Report qualitative changes of the projects in ROAR through captured qualitative results from projects.
[Added: 2018/10/03] [Last Updated: 2019/09/15]
SES Project team/PA/M&E Specialist 2019/09 Completed Since there is a deadlock in procurement, actual actions on ground were limited. Despite, the project captured qualitative changes on ground through its activities. These were reported in 2018 ROAR. History
5. Recommendation:

Communication of project results

Management Response: [Added: 2018/10/03]

With the inclusion of more qualitative indicators at the output level, it is hoped that more meaningful analysis of the humanitarian importance of the project will be captured, bearing in mind the sensitivities in sharing project results publicly due to the complex geopolitical context under which UNDP operates in DPRK. Following are some of the key actions that will be taken to improve the reporting of qualitative changes that the project is leading on the ground.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
5.1 SES project to share communication material (videos/brochures…) with relevant parties including BRH
[Added: 2018/10/03] [Last Updated: 2019/09/25]
SES Project team/PA/ UNDP DPRK CO Com. focal point 2019/09 Completed Project team prepared communication materials and will make public when condition allows History
6. Recommendation:

Exit strategy

Management Response: [Added: 2018/10/03]

As the SES project will end by December 2019 according to the ProDoc, it’s the right time to start deploying its exit strategy to meaningfully consolidate the results achieved till date and ensure the sustainability of the project activities and results

Key Actions:

Key Action Responsible DueDate Status Comments Documents
6.1 SES project shall organize a National Partners Meet to assess what was done better and what else need to be completed in fulfilling the needs of the communities. a) At this meet, SES project must encourage the local communities to make in-kind contributions in the absence of procurement activities. b) Consolidating SES project results till date
[Added: 2018/10/03] [Last Updated: 2019/09/15]
SES Project team/PA 2019/03 Completed Completed: National Partners Meet was conducted during 20-22 March. Follow up activities are being implemented in best possible way, despite of deadlock in procurement. History

Latest Evaluations

Contact us

1 UN Plaza
DC1-20th Floor
New York, NY 10017
Tel. +1 646 781 4200
Fax. +1 646 781 4213
erc.support@undp.org