Project Terminal Evaluation MEER/GEF/UNDP

Report Cover Image
Evaluation Plan:
2015-2018, Ecuador
Evaluation Type:
Final Project
Planned End Date:
09/2017
Completion Date:
09/2017
Status:
Completed
Management Response:
Yes
Evaluation Budget(US $):
20,000

Share

Document Type Language Size Status Downloads
Download document TERMINAL EVALUATION TERMS OF REFERENCE.pdf tor English 919.32 KB Posted 336
Download document Terminal Evaluation -SECURE.pdf report English 1514.96 KB Posted 386
Title Project Terminal Evaluation MEER/GEF/UNDP
Atlas Project Number: 00079790
Evaluation Plan: 2015-2018, Ecuador
Evaluation Type: Final Project
Status: Completed
Completion Date: 09/2017
Planned End Date: 09/2017
Management Response: Yes
Focus Area:
  • 1. Environment & Sustainable Development
  • 2. Others
Corporate Outcome and Output (UNDP Strategic Plan 2014-2017)
  • 1. Output 1.5. Inclusive and sustainable solutions adopted to achieve increased energy efficiency and universal modern energy access (especially off-grid sources of renewable energy)
SDG Goal
  • Goal 13. Take urgent action to combat climate change and its impacts
  • Goal 7. Ensure access to affordable, reliable, sustainable and modern energy for all
SDG Target
  • 13.2 Integrate climate change measures into national policies, strategies and planning
  • 7.1 By 2030, ensure universal access to affordable, reliable and modern energy services
Evaluation Budget(US $): 20,000
Source of Funding: GEF
Evaluation Expenditure(US $): 12,500
Joint Programme: No
Joint Evaluation: No
Evaluation Team members:
Name Title Email Nationality
Sandra Cesilini International consultant sandracesilini@yahoo.com ARGENTINA
GEF Evaluation: Yes
GEF Project Title: Securing Energy efficency in the Ecuadorian Residential and Public sectors (SECURE)
Evaluation Type: Terminal Evaluation
Focal Area: Climate Change
Project Type: MSP
GEF Phase: GEF-5
GEF Project ID: 5114
PIMS Number: 5150
Key Stakeholders: Ministry of Electricity and Renewable Energy
Countries: ECUADOR
Lessons
Findings
Recommendations
1

The Maximum Energy Efficency Label (DMEE) has to be promoted through communication campaigns.

2

It is recommended that the MEER through the support of UNDP CO, follows up with the Ministry of Environment (MAE) on the approval of the NAMA. Additionally, a road map has to be prepared in order to apply for international funding  to implement this initiative.

3

It is recommended that the Ministry of Environment, through the Climate Change Undersecretariat supports the MEER technically in order to integrate SECURE Project’s outcomes into new GEF initiatives as part of the Climate Change Framework  based on the National Energy Efficiency Plan (PLANEE).

4

Systematize the experience in the develpment of the DMEE and disseminate it at a national and regional levels.

5

Continue to provide technical training in Energy Efficiency (EE) standards to other Government entities that have a key role at implementing EE policies.

6

One (1) project specialist continues to work for the MEER (according to indicator 2.3 - (b) of the PRODOC) - Continuity to the outcomes of the project, with special  emphasis at keeping the DMEE Technical Operative Commitee (CTO) on track.

7

It is recommended to implement the National Laboratories Network and, if neccesary, prepare a funding proposal for international donors.

8

It is recommended to develop a strategy of gender approach, to be applied in social communication campaigns and to highlight the achievements of the women scientists involved in the Project . Also it is important to perform an analysis of the participation of women in the implemented training sessions at the level of the National Secretariat for Public Administration, and the role of women engineers and technicians in laboratories and companies.

9

Continue with the awareness-campaigns in The Galapagos Islands.

10

It is recommended to asses the changes on the consumers´ behaviour and the  demand of household appliances awarded with the DMEE, and also establish a baseline in terms of the consumption of electrical energy since the implementation of the DMEE and thereby assess the impact and benefits of such an initiative.

11

It is recommended that the RENOVA Program implements during its second phase the plans and improvement tools designed during the SECURE Project implementation.

12

Continue to provide technical support to electric companies to  ensure adequate implementation of programs to replace electrical appliances.

13

Share and disseminate the road map for the accreditation of national laboratories, that was prepared by the Project team.

14

It is recommended to apply the Government by Results (GPR) tool updating it to the third year of project execution at the end of the Project in 2017, to achieve an integral implementation of the tool throughout the Project´s cycle and to complete the  M & E Plan.

15

It is recommended to systematize the experience of the SECURE Project and share it with other countries in the region (such as Mexico and Brazil), for example, through a Regional Workshop where other experiences are also involved, emphasizing South-South cooperation.

1. Recommendation:

The Maximum Energy Efficency Label (DMEE) has to be promoted through communication campaigns.

Management Response: [Added: 2017/12/18] [Last Updated: 2017/12/19]

The Ministry of Electricity and Renewable Energy (MEER) should continue to implement awareness campaigns aimed to the general public, in order to promote the benefits of the use of low energy-consuming appliances, with special emphasis on the electrical appliances awarded with DMEE.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
The MEER is currently implementing a communication campaign of brand positioning, with the support of the electric companies.
[Added: 2017/12/18] [Last Updated: 2018/11/23]
Direction of Policy and Planning for Energy Efficiency (DPPEE) - Ministry of Electricity and Renewable Energy (MEER) Unversecretary of Energy Efficiency (SEFE) - MEER 2018/06 Completed By March 2018, it is expected to distribute 1 million flyers of the DMEE with the electrical bill. By June 2018, the target is 500.000 flyers. History
2. Recommendation:

It is recommended that the MEER through the support of UNDP CO, follows up with the Ministry of Environment (MAE) on the approval of the NAMA. Additionally, a road map has to be prepared in order to apply for international funding  to implement this initiative.

Management Response: [Added: 2017/12/19]

The NAMA has been one of the major outcomes of the SECURE project and it should have the opportunity to be presented to international funding entities. The NAMA proposal has high funding-potential since it promotes several policies considered as priorities by the National Government.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
MEER needs UNDP support in order for MAE to consider the NAMA as a climate change priority initiative in the residencial sector.
[Added: 2017/12/19] [Last Updated: 2018/11/23]
Project Officer - UNDP country Office Ministry of Environment Ministry of Electricity and Renewable Energy 2018/03 Completed This actions are being supported to the NDC program implemented also by UNDP. History
3. Recommendation:

It is recommended that the Ministry of Environment, through the Climate Change Undersecretariat supports the MEER technically in order to integrate SECURE Project’s outcomes into new GEF initiatives as part of the Climate Change Framework  based on the National Energy Efficiency Plan (PLANEE).

Management Response: [Added: 2017/12/19]

The MEER has a key role in  the definition of new energy efficiency initiatives to mitigate climate change. It is important to structure a road map that will suppor both entities (MEER, MAE) to develp new project proposals aligned with GEF and other international donors' priorities.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
MAE should support MEER's initiatives in order to get international funding for energy efficiency projects.
[Added: 2017/12/19] [Last Updated: 2018/11/23]
Project Officer - UNDP CO Ministry of Environment Ministry of Electricty and Renewable Energy 2018/03 Completed It is recommended that the Ministry of Environment, through the Climate Change Undersecretariat supports the MEER technically in order to integrate SECURE Project’s outcomes into new GEF initiatives as part of the Climate Change Framework based on the National Energy Efficiency Plan (PLANEE). History
4. Recommendation:

Systematize the experience in the develpment of the DMEE and disseminate it at a national and regional levels.

Management Response: [Added: 2017/12/19] [Last Updated: 2017/12/19]

The dissemination of the main project outcomes is key to ensure knowledge management at a local and international level, and this will streghten and promote new public policies in line with the aforementioned outcomes.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
The MEER is sharing the DMEE experience at international forums and local events. The DMEE road map will be also shared with other interested parties.
[Added: 2017/12/19] [Last Updated: 2018/11/23]
Direction of Policy and Planning for Energy Efficiency (DPPEE) - MEER 2018/12 Completed History
5. Recommendation:

Continue to provide technical training in Energy Efficiency (EE) standards to other Government entities that have a key role at implementing EE policies.

Management Response: [Added: 2017/12/19]

It is very important to expand the training program to other Government entities, and promote the "Guide for the Efficient Use of the Electric Power in Ecuador" as a policy manual for public officials.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
This is part of the policies and actions of the PLANEE.
[Added: 2017/12/19] [Last Updated: 2018/11/23]
Undersecretary of Energy Efficiency - MEER 2018/12 Completed The Ministry of MEER foresees to continue the implementation of new training sessions during 2018 based on the Energy Efficiency Guide developed by the project. History
6. Recommendation:

One (1) project specialist continues to work for the MEER (according to indicator 2.3 - (b) of the PRODOC) - Continuity to the outcomes of the project, with special  emphasis at keeping the DMEE Technical Operative Commitee (CTO) on track.

Management Response: [Added: 2017/12/19] [Last Updated: 2017/12/19]

The project specialist will lead the CTO, support the review process of new DMEE applications, and liase with producers of  household appliances on the monitoring of results of the implementation of the DMEE, etc.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
The support of a project specialist is very important for MEER, even though MEER currently does not have enough funds to hire a person.
[Added: 2017/12/19] [Last Updated: 2018/11/23]
Undersecretary of Energy Efficiency - MEER 2018/01 Completed Depending upon availability of resources History
7. Recommendation:

It is recommended to implement the National Laboratories Network and, if neccesary, prepare a funding proposal for international donors.

Management Response: [Added: 2017/12/19]

The National Laboratory Network was designed to optimize the services between laboratories, promote knowledge management, and improve the national infraestructure of the Quality System. Through the implementation of this initiative, the Project´s impacts will be much  greater and it will ensure the sustainability of its main outcomes.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
MEER will take contact with the Ecuadorian Acreditation Service (SAE) in order to develop the National Laboratory Network.
[Added: 2017/12/19] [Last Updated: 2018/11/23]
Direction of Policy and Planning for Energy Efficiency - MEER 2018/06 Completed History
8. Recommendation:

It is recommended to develop a strategy of gender approach, to be applied in social communication campaigns and to highlight the achievements of the women scientists involved in the Project . Also it is important to perform an analysis of the participation of women in the implemented training sessions at the level of the National Secretariat for Public Administration, and the role of women engineers and technicians in laboratories and companies.

Management Response: [Added: 2017/12/19] [Last Updated: 2017/12/19]

Women´s participation in the training sessions were carried out in the National Secretariat for Public Administration, as well as the engineers and technicians´ role in laboratories and companies are analyzed.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
The project had a gender approach during the training sessions. In addition, the communications campaign of the DMEE is currently being structured based on agender approach; and MEER will continue to ensure women´s strenghtening in ongoing and future initiatives.
[Added: 2017/12/19] [Last Updated: 2018/11/23]
Ministry fo Electricity and Renewable Energy 2018/12 Completed Gender approach was mainstreamed in training sesins and comunication approach. History
9. Recommendation:

Continue with the awareness-campaigns in The Galapagos Islands.

Management Response: [Added: 2017/12/19]

There is a high level of interest by the Galapagos Public Institutions to continue with the implementation of new training sessions of energy management systems and workshops aimed at promoting EE practices in schools for adolescents.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Continue with the awareness-raising campaigns on energy efficiency and the use of low energy-consuming appliance that were started as part of the project activities.
[Added: 2017/12/19] [Last Updated: 2018/11/23]
Ministry of Electricity and Renewable Energy 2018/12 Completed History
10. Recommendation:

It is recommended to asses the changes on the consumers´ behaviour and the  demand of household appliances awarded with the DMEE, and also establish a baseline in terms of the consumption of electrical energy since the implementation of the DMEE and thereby assess the impact and benefits of such an initiative.

Management Response: [Added: 2017/12/19]

A methodology to measure the impact of the DMEE on the market has to be designed in order to measure the potential co-benefits, such as: savings in electrical energy consumption, reduction of associated emissions, improvement of the quality of the electrical products by the Ecuadorian Industry, etc.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Having a study of the impact of DMEE in the market is an important feedback for MEER, however MEER does not have a budget for this activity at the moment.
[Added: 2017/12/19] [Last Updated: 2019/06/14]
Ministry of Electricity and Renewable Energy 2018/12 Completed Project was financially closed. Project was financially closed. No action expected from UNDP. National contrepart is currently looking for funds in order to carry out the activity. History
11. Recommendation:

It is recommended that the RENOVA Program implements during its second phase the plans and improvement tools designed during the SECURE Project implementation.

Management Response: [Added: 2017/12/19]

The training session outcomes, the improvement plan of the recycling process, and the communication plan are major SECURE outcomes, and they should be implemented.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
The RENOVA program will implement the outputs prepared by the SECURE project, during its second phrase starting January 2018.
[Added: 2017/12/19] [Last Updated: 2018/11/23]
Renova Project Management - MEER 2018/12 Completed Lessons learn were shared with MEER. History
12. Recommendation:

Continue to provide technical support to electric companies to  ensure adequate implementation of programs to replace electrical appliances.

Management Response: [Added: 2017/12/19]

The SECURE Project implemented a training sessions aimed at strenghthening the capacities of the electric companies' staff, that are in charge of the RENOVA Program.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
This will be consider as part of the activities during the implementation of the new energy efficiency projects.
[Added: 2017/12/19] [Last Updated: 2019/06/14]
Ministry fo Electricity and Renewable Energy 2018/12 Completed Project was financially closed. No action expected from UNDP. National contrepart is currently looking for funds in order to carry out the activity. History
13. Recommendation:

Share and disseminate the road map for the accreditation of national laboratories, that was prepared by the Project team.

Management Response: [Added: 2017/12/19]

It is important to disseminate the outcomes of the accreditation process and the lessons learned.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
The MEER will share the road map for the accreditation process through the Lessons Learned Document to be published on January 2018.
[Added: 2017/12/19] [Last Updated: 2018/11/23]
Direction of Policy and Planning for Energy Efficiency - MEER 2018/01 Completed History
14. Recommendation:

It is recommended to apply the Government by Results (GPR) tool updating it to the third year of project execution at the end of the Project in 2017, to achieve an integral implementation of the tool throughout the Project´s cycle and to complete the  M & E Plan.

Management Response: [Added: 2017/12/19]

GPR tool has to be implemented throughout the whole Project´s cycle.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
The GPR tool will be used until the project clousure date.
[Added: 2017/12/19] [Last Updated: 2018/11/23]
Direction fo Policy and Planning for Energy Efficiency - MEERD 2017/12 Completed History
15. Recommendation:

It is recommended to systematize the experience of the SECURE Project and share it with other countries in the region (such as Mexico and Brazil), for example, through a Regional Workshop where other experiences are also involved, emphasizing South-South cooperation.

Management Response: [Added: 2017/12/19]

The systematization of the project is key to ensure that the process and the results are communicated, the lessons learned are shared, and the potential for replication of activites is evaluated.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
MEER will share the publication of the Leason Learned document with all its partners and interested parties.
[Added: 2017/12/19] [Last Updated: 2018/11/23]
Ministry of Electricity and Renewable Energy - MEER UNDP Country Office 2018/01 Completed History

Latest Evaluations

Contact us

1 UN Plaza
DC1-20th Floor
New York, NY 10017
Tel. +1 646 781 4200
Fax. +1 646 781 4213
erc.support@undp.org