Terminal Evaluation of the project: Promotion and up-scaling of climate-resilient, resource efficient technologies in a Tropical Island Context (Resource Efficiency)

Report Cover Image
Evaluation Plan:
2017-2020, Seychelles
Evaluation Type:
Final Project
Planned End Date:
11/2019
Completion Date:
12/2019
Status:
Completed
Management Response:
Yes
Evaluation Budget(US $):
20,000

Share

Document Type Language Size Status Downloads
Download document UNDP-GEF-TE-TOR RE Updated 6.3.2019.doc tor English 284.00 KB Posted 44
Download document Executive Summary TE for RE Project.docx summary English 20.74 KB Posted 60
Download document Terminal Evaluation report - Final report (final version).pdf report English 1596.55 KB Posted 71
Title Terminal Evaluation of the project: Promotion and up-scaling of climate-resilient, resource efficient technologies in a Tropical Island Context (Resource Efficiency)
Atlas Project Number: 00079923
Evaluation Plan: 2017-2020, Seychelles
Evaluation Type: Final Project
Status: Completed
Completion Date: 12/2019
Planned End Date: 11/2019
Management Response: Yes
Focus Area:
  • 1. Environment & Sustainable Development
  • 2. Others
Corporate Outcome and Output (UNDP Strategic Plan 2014-2017)
  • 1. Output 1.4. Scaled up action on climate change adaptation and mitigation across sectors which is funded and implemented
SDG Goal
  • Goal 13. Take urgent action to combat climate change and its impacts
  • Goal 14. Conserve and sustainably use the oceans, seas and marine resources for sustainable development
SDG Target
  • 13.2 Integrate climate change measures into national policies, strategies and planning
  • 14.5 By 2020, conserve at least 10 per cent of coastal and marine areas, consistent with national and international law and based on the best available scientific information
Evaluation Budget(US $): 20,000
Source of Funding: GEF
Evaluation Expenditure(US $): 20,990
Joint Programme: No
Joint Evaluation: No
Evaluation Team members:
Name Title Email Nationality
Frank Klickenberg Consultant frank@klickenberg.com
GEF Evaluation: Yes
GEF Project Title: Terminal Evaluation of the project: Promotion and up-scaling of climate-resilient, resource efficient technologies in a Tropical Island Context (Resource Efficiency)
Evaluation Type: Terminal Evaluation
Focal Area: Climate Change
Project Type: MSP
GEF Phase: GEF-5
GEF Project ID: 5316
PIMS Number: 4913
Key Stakeholders: MEECC, Seychelles Energy Commission, Public Utilities Corporation, UNDP, PCU
Countries: SEYCHELLES
Lessons
Findings
Recommendations
1

Terminal Evaluation recommendation 1. The Government of the Seychelles is recommended to continue, the development of framework legislation for energy efficiency and once a strategy has been agreed and a collaboration with an experienced partner established, to move speedily to develop and implement appliance MEPS and labels.  The VAT exemption mechanism, now used independently, can then be used to smoothen the introduction of MEPS. 

Recommendation to: MEECC & SEC.

2

Terminal Evaluation recommendation 2. Project designs need better reviews, including checks on internal consistency and whether baseline information is complete and has been adequately addressed in the project’s strategy.  This should also include a check on the project’s strategy and whether this is aligned with the experience and capacity of a country’s government and market parties. 

Recommendation to: UNDP, MEECC and others 

3

Terminal Evaluation recommendation 3.   For the Seychelles, the policy approach would need to include a response to its situation as a small island nation, with limited government capacity, a small, relatively unorganised market and complicated trade relationships.  Support of international expert groups might be needed to develop a suitable approach for such situations.

Recommendation to: MEECC & SEC.

4

Terminal Evaluation recommendation 4. It might be useful to explore whether the Seychelles can develop a collaboration with an established standards and labels programme in a country it has trade relations with.  That might make it easier to continue its approach without having to build up the extensive technical knowledge needed to do so independently.

Recommendation to: MEECC & SEC.

5

Terminal Evaluation recommendation 5: Results of the project in communication and through its VAT mechanism need to be measured, through household surveys or similar means and through completion of the VAT exemption database. 

Recommendation to: MEECC & SEC.

6

Terminal Evaluation recommendation 6. It would be useful to explore extending the “Switch to LED” exchange campaign, to more lamps and/or to other appliances also. Such approaches are beneficial in particular to low-income households, can offer specific national benefits when electricity tariffs are subsidised and may have a role in tariff restructuring.  

Recommendation to: MEECC, SEC and others

7

Terminal Evaluation recommendation 7. Future policy or regulatory projects for resource efficiency are not recommended at this point, given that several more years may be needed to reach the objectives of this project and the experience gained with that would be needed for new projects.

Recommendation to: MEECC, SEC and others.

8

Terminal Evaluation recommendation 8: Staff levels at the Renewable energy and energy management unit of the Seychelles Energy Commission urgently need to be brought up to planned levels, so that there is capacity to carry out the regulatory, communication and training activities planned, but not completed, under this project.

Recommendation to: SEC

1. Recommendation:

Terminal Evaluation recommendation 1. The Government of the Seychelles is recommended to continue, the development of framework legislation for energy efficiency and once a strategy has been agreed and a collaboration with an experienced partner established, to move speedily to develop and implement appliance MEPS and labels.  The VAT exemption mechanism, now used independently, can then be used to smoothen the introduction of MEPS. 

Recommendation to: MEECC & SEC.

Management Response: [Added: 2020/02/03]

Management response: Management concurs with the recommendation. A consultancy for development of legislation for EE is currently on-going and final report to be submitted to SEC by latter half of 2019. SEC will then proceed with the necessary procedures for enactment. Subsidiary legislation such regulation for MEPS and labels will be developed in due course- but that will fall outside the scope and timeline of the project. It is hoped that the project created the necessary platform for Seychelles to realize its intended ambitions for a renewable energy future.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
1.1 Consultant to finalized Energy Legislation report
[Added: 2020/02/03]
SEC, MEECC 2019/09 Overdue-Initiated At the time of management response it was expected that the Energy Legislation report would be finalized by September 2019
1.2 SEC to submit to Attorney General Office
[Added: 2020/02/03]
SEC 2019/12 Overdue-Not Initiated At the time of management response it was expected that the finalized Energy legislation would be submitted to the Attorney General's office for further action.
1.3 Attorney General Office develop the White paper/ Green paper legislation
[Added: 2020/02/03]
Attorney General's Office, MEECC, SEC 2020/04 Overdue-Not Initiated The AGs office will only publish the White paper once due processes are complete (Cabinet endorsement). It is unlikely that this will be published in 2020.
2. Recommendation:

Terminal Evaluation recommendation 2. Project designs need better reviews, including checks on internal consistency and whether baseline information is complete and has been adequately addressed in the project’s strategy.  This should also include a check on the project’s strategy and whether this is aligned with the experience and capacity of a country’s government and market parties. 

Recommendation to: UNDP, MEECC and others 

Management Response: [Added: 2020/02/03]

Management response:  Management does not fully concur with this recommendation. While UNDP can support with the reviewing project design and ensuring it passes the robustness checks,  the overall  scope of project design and logframe are often suited to reflect the requirements of national stakeholders within the scope of the donor’s requirements. Government is also encouraged to ensure that sufficient institutional capacity exists or will be built during project life cycle. This recommendation also needs to be brought to the attention of GEF, to ensure that project designs are fit-for-purpose within national contexts.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
2.1 Flag inconsistencies in CC project design to GEF and limitations of Seychelles as a SIDS
[Added: 2020/02/03]
UNDP 2020/04 Overdue-Not Initiated UNDP will highlight the issues in project design with the relevant UNDP-GEF RTA. One issue that keeps repeating itself is the time lag between project design and project implementation - as contexts often change from the time the PIF is formulated to the time the budgets are released.
2.2 Ensure UNDPs new CPD cycle has a robust M&E framework to review progress of project outcomes
[Added: 2020/02/03]
UNDP 2020/12 Not Initiated As UNDP gears itself for the next programming cycle, relevant recommendations will be taken on board to ensure that the M&E framework is better equipped to tackle inconsistencies in project design and support project implementation to achieve intended outcomes in an evolving context.
3. Recommendation:

Terminal Evaluation recommendation 3.   For the Seychelles, the policy approach would need to include a response to its situation as a small island nation, with limited government capacity, a small, relatively unorganised market and complicated trade relationships.  Support of international expert groups might be needed to develop a suitable approach for such situations.

Recommendation to: MEECC & SEC.

Management Response: [Added: 2020/02/03]

Management response: Management is aware of the limitations of Seychelles capacity and is already working with international organisations such as IRENA/ SADC/ IOC /CCI with ongoing bilateral cooperation with other countries. More emphasis, will be placed on getting support for Energy Efficiency and Climate Change Mitigation related programmes in future discussions to continue the work started under the RE project.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
3.1 Review existing partnerships and agreements with International Partners.
[Added: 2020/02/03]
SEC, MEECC 2019/12 Overdue-Not Initiated This will depend on the capacity and political will of the agency to move forward with a holistic approach in collaborating with international partners and donors
3.2 Engage with the department of Foreign Affairs to ensure that EE remains part of bilateral discussions with select countries
[Added: 2020/02/03]
SEC, MEECC, DFA 2019/12 Overdue-Not Initiated SEC needs to engage with the DFA either through MEECC or directly to ensure that EE and CCM are tabled in bilateral discussions to assist Seychelles achieve its INDCs
4. Recommendation:

Terminal Evaluation recommendation 4. It might be useful to explore whether the Seychelles can develop a collaboration with an established standards and labels programme in a country it has trade relations with.  That might make it easier to continue its approach without having to build up the extensive technical knowledge needed to do so independently.

Recommendation to: MEECC & SEC.

Management Response: [Added: 2020/02/03]

Management response: Management will look into the feasibility of this recommendation in line with recommendation 3,and whilst reviewing international partnerships and agreements.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
4.1 Same as key action 3.1 and 3.2
[Added: 2020/02/03]
SEC 2020/12 Initiated
5. Recommendation:

Terminal Evaluation recommendation 5: Results of the project in communication and through its VAT mechanism need to be measured, through household surveys or similar means and through completion of the VAT exemption database. 

Recommendation to: MEECC & SEC.

Management Response: [Added: 2020/02/03]

Management response: While management concurs with the recommendation, no further communications with regards to the project will be ongoing. However, the product registry database (NOT VAT EXEMPTION DATABASE) is operational and is being managed by the staff of the SEC. An IT consultant will be supporting the work until end of 2019 supported by project funds.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
5.1 IT consultant hired to maintain database
[Added: 2020/02/03]
SEC 2019/11 Completed An IT consultant recruited under the project was able to support the SEC until November 2019 to populate the database.
5.2 Reporting of key results from the database
[Added: 2020/02/03]
SEC, MEECC 2020/12 Not Initiated This depends on the political will of the agencies to track and provide key results that may help in tracking and monitoring effectiveness of policies and contributions towards the SDGs.
6. Recommendation:

Terminal Evaluation recommendation 6. It would be useful to explore extending the “Switch to LED” exchange campaign, to more lamps and/or to other appliances also. Such approaches are beneficial in particular to low-income households, can offer specific national benefits when electricity tariffs are subsidised and may have a role in tariff restructuring.  

Recommendation to: MEECC, SEC and others

Management Response: [Added: 2020/02/03]

Management response: Management concurs with this recommendation and SEC with project partners to explore ways to further improve on the “Switch to LED” exchange programme and consider other similar campaigns, depending on available funding.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
6.1 Report on the uptake of the “Switch to LED”
[Added: 2020/02/03]
PUC, SEC 2019/12 Completed PUC was collecting data on households that had participated in the SWITCH to LED programme. This information is available on request from PUC.
6.2. Identify ways to improve on the “Switch to LED” exchange programme
[Added: 2020/02/03]
SEC, PUC, MEECC 2020/12 Not Initiated It is expected that the SEC, PUC and partners will continue to support the drive up deman for Energy efficient appliances in Seychelles. This activity however fall outside the scope and remit of the project cycle.
6.3 Evaluate innovative financing opportunities to promote EE for low income households
[Added: 2020/02/03]
SEC, PUC and others 2020/12 Not Initiated As part of the Governments strategy towards a Renewable Energy future, mechanisms to provide incentives for low income households are being discussed at a sector strategic level. However these decisions are government led and fall outside the scope of the project to know if and when such mechanisms may be rolled out.
7. Recommendation:

Terminal Evaluation recommendation 7. Future policy or regulatory projects for resource efficiency are not recommended at this point, given that several more years may be needed to reach the objectives of this project and the experience gained with that would be needed for new projects.

Recommendation to: MEECC, SEC and others.

Management Response: [Added: 2020/02/03]

Management response: Management does not wholly concur with the recommendation particularly the SEC disagrees with the recommendation from the Terminal evaluator. SEC feels it is imperative to build upon the lessons learned from the UNDP-GEF RE project. The Government will address new opportunities to help ensure the sustainability of Energy Efficiency in the future. This may be in collaboration with other funding partners such as GCF.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
7.1. SEC to identify next steps in addressing gaps and challenges
[Added: 2020/02/03]
SEC 2020/12 Not Initiated
7.2 SEC to continue collaborating with partners for support
[Added: 2020/02/03]
SEC, MEECC, PUC 2020/12 Not Initiated
8. Recommendation:

Terminal Evaluation recommendation 8: Staff levels at the Renewable energy and energy management unit of the Seychelles Energy Commission urgently need to be brought up to planned levels, so that there is capacity to carry out the regulatory, communication and training activities planned, but not completed, under this project.

Recommendation to: SEC

Management Response: [Added: 2020/02/03]

Management response: Management agrees that the SEC needs additional staff to build institutional capacity and to execute planned activities relating to EE- but this remains outside the scope of the project. This would need further discussions between MEECC, SEC, the Ministry of Finance, Department of Public Administration and Public Utilities Corporation as the roles of SEC and PUC need to be re-defined and job descriptions clarified.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
8.1 SEC to initiate discussions to increase its staffing capacity with relevant authorities.
[Added: 2020/02/03]
SEC 2020/12 Not Initiated

Latest Evaluations

Contact us

1 UN Plaza
DC1-20th Floor
New York, NY 10017
Tel. +1 646 781 4200
Fax. +1 646 781 4213
erc.support@undp.org