Mid-term Evaluation of Energy Efficiency in Residential Buildings Project

Report Cover Image
Evaluation Plan:
2010-2015, Turkmenistan
Evaluation Type:
Mid Term Project
Planned End Date:
12/2014
Completion Date:
12/2014
Status:
Completed
Management Response:
Yes
Evaluation Budget(US $):
15,695

Share

Document Type Language Size Status Downloads
Download document TOR_for_MTR_EERB_Project.docx tor English 57.37 KB Posted 480
Download document Final MTE Report_EE Build_TM.docx report English 336.73 KB Posted 726
Download document Mngt Response EERB MTR April2015_eng.doc related-document English 85.50 KB Posted 316
Title Mid-term Evaluation of Energy Efficiency in Residential Buildings Project
Atlas Project Number: 00061181,00077395
Evaluation Plan: 2010-2015, Turkmenistan
Evaluation Type: Mid Term Project
Status: Completed
Completion Date: 12/2014
Planned End Date: 12/2014
Management Response: Yes
Focus Area:
  • 1. Others
Corporate Outcome and Output (UNDP Strategic Plan 2014-2017)
  • 1. Output 1.5. Inclusive and sustainable solutions adopted to achieve increased energy efficiency and universal modern energy access (especially off-grid sources of renewable energy)
Evaluation Budget(US $): 15,695
Source of Funding: UNDP
Evaluation Expenditure(US $): 15,695
Joint Programme: No
Joint Evaluation: No
Evaluation Team members:
Name Title Email Nationality
Andreas Karner Mr. andreas.karner@conplusultra.com
GEF Evaluation: Yes
GEF Project Title:
Evaluation Type:
Focal Area: Multifocal Areas
Project Type: EA
GEF Phase: GEF-4
GEF Project ID:
PIMS Number: 4134
Key Stakeholders: UNDP, GEF, national partners
Countries: TURKMENISTAN
Lessons
Findings
Recommendations
1 Legislation framework has been developing with the support of the Project, but focus is needed to achieve government adoptions of new Turkmen Building Code and linking it with an investment planning and new national strategy on energy efficiency in buildings.
2 Ensure that institutional bodies to take energy efficiency forward and market awareness is created in the longer term. There is a need for better basic information on energy use in buildings, not only for residential, but also public and commercial buildings
3 Monitoring of project results and GHG emission reductions to be followed-up and results visualised. Project outcomes in terms of avoided GHG emissions need to be continually monitored. There is a need for a detailed methodology for monitoring of energy consumption, energy savings, and associated emissions and emissions reductions. The minimum monitoring period should be one full year or more. In accordance with this, the project term could be extended. There is also a need for dissemination of evaluation results and benefits. Qualitative descriptions (?storytelling?) provide an effective way to help people to visualize best-practice examples in buildings. The project should organize information events for governmental stakeholders, building developers and residents to further attract attention to energy use in buildings.
4 Project needs to monitor results effectively with the given timeline and to keep track of possible risks that need to be managed. The project team should consider alternative activities that would create significant GHG reductions if certain activities (especially pilot projects on renovation) fail to materialize, with corresponding budget revisions in line with a project extension and revisions to activity.
5 Introduce a higher level of public outreach and institutionalise public awareness measures in the frame of the country?s policy framework. The project needs to consider hiring an outside marketing and communications expert to lead work in this area. The task will be to develop a marketing and communication strategy that is in line with the PR and communication means provided by and through Turkmengaz and the Ministry of Construction (and other national institutions, as deemed necessary), but should effectively address the relevance of the EE topic to national stakeholders and the general public. Elements of a marketing strategy have been developed by the International Chief Technical Advisor in early 2014, but haven?t been taken any further so far. The project website is not an effective means of communication because of low visibility.
1. Recommendation: Legislation framework has been developing with the support of the Project, but focus is needed to achieve government adoptions of new Turkmen Building Code and linking it with an investment planning and new national strategy on energy efficiency in buildings.
Management Response: [Added: 2015/04/29]

Maintain high-level involvement at governmental and prime ministers? level to force the project partners to attain the agreed outputs and follow closely the situation with the review of other EE building codes in the region in order to learn from best-practice implemented in other countries and share them with the TKM counterparts. Mobilize high level expertise to support in the development of the investment plans, the new strategy on EE and ensure linking with the Building Codes.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
1.1. Meeting with the Deputy Prime Ministers to raise the issues 1.2. Study visit to Croatia 1.3. Additional mission of the project experts on Building Codes
[Added: 2015/04/29] [Last Updated: 2015/10/22]
UNDP Turkmenistan, Government of Turkmenistan, EERB Project Management Unit (PMU) 2015/01 Completed
1.2. Study visit to Croatia
[Added: 2015/10/22]
UNDP Turkmenistan, Government of Turkmenistan, EERB Project Management Unit (PMU) 2015/06 Completed
1.3. Additional mission of the project experts on Building Codes
[Added: 2015/10/22]
UNDP Turkmenistan, Government of Turkmenistan, EERB Project Management Unit (PMU) 2015/09 Completed
2. Recommendation: Ensure that institutional bodies to take energy efficiency forward and market awareness is created in the longer term. There is a need for better basic information on energy use in buildings, not only for residential, but also public and commercial buildings
Management Response: [Added: 2015/04/29]

The recommendation is accepted. Some activities already directly focus on support for code implementation, including development of manuals and Energy Passports. Data quality is a major area of emphasis for UNDP in Turkmenistan on the whole, including this project. Completed work on energy audits addresses this issue in part; ongoing work on energy management in existing buildings and monitoring of pilot buildings will further enhance the stock of high-quality data available for policymakers, evaluators, and building designers. Furthermore, communication is to be intensified with the Government counterparts for the designation of the main responsible institution for EE, including through sharing other countries experiences, as well as enhance awareness raising activities in the project work plan

Key Actions:

Key Action Responsible DueDate Status Comments Documents
2.1Continue work on monitoring and data collection in pilot buildings, both for energy management and new construction
[Added: 2015/04/29] [Last Updated: 2017/09/18]
UNDP Country Office, Project Board, EERB Project Management Unit (PMU) 2017/06 Completed Reconstruction of buildings is completed in May, 2016. At least, one year is required for energy monitoring. Energy management system is established in October, 2016, at least a half-year is required to collect energy consumption data after the completion of the energy management system. History
2.2. Identify key agency involved with plan review and building inspection with regard to energy code compliance. Establish contact with this agency and develop action plan, using analogous strategy implemented under UNDP/GEF project in Uzbekistan;
[Added: 2015/10/22] [Last Updated: 2016/12/21]
UNDP Country Office, Project Board, EERB Project Management Unit (PMU) 2016/09 Completed The project supported Ministry of Construction to update the building code "Instruction for designing and construction" to be in line with the revised building codes. History
2.3. Identify key agency that would oversee the collection and management of data on building energy consumption. Establish contact with this agency and develop action plan.
[Added: 2015/10/22] [Last Updated: 2017/09/18]
UNDP Country Office, Project Board, EERB Project Management Unit (PMU) 2017/06 Completed The letter of agreement to provide support by the Ministry for energy monitoring in the pilot buildings for energy management is signed. History
2.4 Assess the possibility of developing software and catalog of building materials and their thermal performance characteristics, for use by building designers under revised codes. If budget constraints permit, open tender process and hire a company to develop this software and catalog
[Added: 2015/10/22] [Last Updated: 2016/12/21]
UNDP Country Office, Project Board, EERB Project Management Unit (PMU) 2016/12 Completed The catalog on thermal bridges in building joints is developed and will be prepared for printing in 2017. The software "Energy passport" is developed and tested. History
3. Recommendation: Monitoring of project results and GHG emission reductions to be followed-up and results visualised. Project outcomes in terms of avoided GHG emissions need to be continually monitored. There is a need for a detailed methodology for monitoring of energy consumption, energy savings, and associated emissions and emissions reductions. The minimum monitoring period should be one full year or more. In accordance with this, the project term could be extended. There is also a need for dissemination of evaluation results and benefits. Qualitative descriptions (?storytelling?) provide an effective way to help people to visualize best-practice examples in buildings. The project should organize information events for governmental stakeholders, building developers and residents to further attract attention to energy use in buildings.
Management Response: [Added: 2015/04/29]

The recommendation is accepted. Methodologies already established for assessment of energy savings and avoided emissions from building codes and demonstration projects, with ongoing detailed assessment of potential energy savings and emission reductions from existing building stock. Communication plan will be developed to highlight results and benefits. Furthermore, GHG emission indicator will be included as key indicator in the new country programme document and will be monitored continuously outside of the project scope. New projects will be also contributing to the CPD outcome focused on low-emission development. As far as this project is concerned, the work plan includes already activities related to the energy consumption monitoring methodologies.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
3.1Continue work on monitoring and assessment of energy savings and emissions reductions according to developed methodologies, with adjustments as needed. An International Consultant will be engaged to examine methodologies to ensure their sufficiency for final stages of project.
[Added: 2015/04/29] [Last Updated: 2017/09/18]
UNDP Country Office, EERB Project Management Unit (PMU) 2017/06 Completed Supporting by International Consultant, the methodology for energy monitoring was revised. Energy monitoring in all pilot buildings completed. History
3.2 Arrange for coverage of project in mass media and in professional channels in building design community, according to established communications plan, including site visits to demonstration sites
[Added: 2015/10/22]
UNDP Country Office, EERB Project Management Unit (PMU) 2015/06 Completed
3.3 File for no-cost extension of project to allow for full year of monitoring of completed demonstration projects
[Added: 2015/10/22] [Last Updated: 2016/12/21]
UNDP Country Office, EERB Project Management Unit (PMU) 2016/06 Completed Justifications for no-cost extension is prepared. The project terms are extended for 1.5 years. History
4. Recommendation: Project needs to monitor results effectively with the given timeline and to keep track of possible risks that need to be managed. The project team should consider alternative activities that would create significant GHG reductions if certain activities (especially pilot projects on renovation) fail to materialize, with corresponding budget revisions in line with a project extension and revisions to activity.
Management Response: [Added: 2015/04/29]

The recommendation is accepted. 2015 Annual Work Plan will include very detailed sequencing of all activities month by month, as well as elaboration of risks and alternative scenarios and timetables for determining when alternative paths should be chosen.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Develop a detailed 2015 and 2016 Annual Work Plans with month-by-month sequencing of activities and elaboration of risks and alternative scenarios, including timetables and budget adjustments
[Added: 2015/04/29] [Last Updated: 2016/12/21]
UNDP Country Office, EERB Project Management Unit (PMU) 2016/01 Completed Detailed AWP is prepared. There were no risks in 2016. History
5. Recommendation: Introduce a higher level of public outreach and institutionalise public awareness measures in the frame of the country?s policy framework. The project needs to consider hiring an outside marketing and communications expert to lead work in this area. The task will be to develop a marketing and communication strategy that is in line with the PR and communication means provided by and through Turkmengaz and the Ministry of Construction (and other national institutions, as deemed necessary), but should effectively address the relevance of the EE topic to national stakeholders and the general public. Elements of a marketing strategy have been developed by the International Chief Technical Advisor in early 2014, but haven?t been taken any further so far. The project website is not an effective means of communication because of low visibility.
Management Response: [Added: 2015/04/29]

The recommendation is partially accepted. Project considers existing communications plan sufficient but needs to implement it more aggressively. We note, however, that media coverage in Turkmenistan is different from coverage in many other countries. There is a need to go through existing channels of public information, which have their own strict criteria and priorities. Still, as this project is consistent with national goals and has very positive stories to tell, we think that there is a chance for effectively expanding outreach.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
5.1.Assess whether the project budget will permit the hiring of a media consultant. If affirmative, development of Terms of Reference and opening of tender to take place.
[Added: 2015/04/29] [Last Updated: 2015/10/22]
UNDP Country Office, EERB Project Management Unit (PMU) 2015/09 Completed
5.2. Ensure monitoring of fulfillment of communications plan
[Added: 2015/10/22] [Last Updated: 2017/09/18]
UNDP Country Office, EERB Project Management Unit (PMU) 2017/06 Completed The communication plan prepared in 2016 for 2 years (2016-2017) was updated, its implementation was completed in 2017. History

Latest Evaluations

Contact us

1 UN Plaza
DC1-20th Floor
New York, NY 10017
Tel. +1 646 781 4200
Fax. +1 646 781 4213
erc.support@undp.org