00075809 Third National Communication to the United Nations Framework Convention on Climate Change (TNC) GEF Terminal Evaluation

Report Cover Image
Evaluation Plan:
2016-2020, Indonesia
Evaluation Type:
Final Project
Planned End Date:
06/2018
Completion Date:
01/2018
Status:
Completed
Management Response:
Yes
Evaluation Budget(US $):
40,000

Share

Document Type Language Size Status Downloads
Download document Senior Specialist for TNC Terminal Evaluation - TOR (revised).docx tor English 70.17 KB Posted 278
Download document Support Specialist for TNC Terminal Evaluation - TOR (revised).docx tor English 68.92 KB Posted 268
Download document Terminal Evaluation 00075809 TNC.docx report English 3776.39 KB Posted 285
Title 00075809 Third National Communication to the United Nations Framework Convention on Climate Change (TNC) GEF Terminal Evaluation
Atlas Project Number: 00075809
Evaluation Plan: 2016-2020, Indonesia
Evaluation Type: Final Project
Status: Completed
Completion Date: 01/2018
Planned End Date: 06/2018
Management Response: Yes
UNDP Signature Solution:
  • 1. Sustainable
Corporate Outcome and Output (UNDP Strategic Plan 2018-2021)
  • 1. Output 2.3.1 Data and risk-informed development policies, plans, systems and financing incorporate integrated and gender-responsive solutions to reduce disaster risks, enable climate change adaptation and mitigation, and prevent risk of conflict
SDG Goal
  • Goal 12. Ensure sustainable consumption and production patterns
SDG Target
  • 12.4 By 2020, achieve the environmentally sound management of chemicals and all wastes throughout their life cycle, in accordance with agreed international frameworks, and significantly reduce their release to air, water and soil in order to minimize their adverse impacts on human health and the environment
Evaluation Budget(US $): 40,000
Source of Funding: TNC Project
Evaluation Expenditure(US $): 35,000
Joint Programme: No
Joint Evaluation: Yes
  • Joint with Ministry of Environment and Forestry
Evaluation Team members:
Name Title Email Nationality
Juan Luis Larrabure j_larrabure@hotmail.com COLOMBIA
Ari Wijanarko Adipratomo ari.adipratomo@gmail.com
GEF Evaluation: Yes
GEF Project Title: Third National Communication to the United Nations Framework Convention on Climate Change (TNC)
Evaluation Type: Terminal Evaluation
Focal Area: Climate Change
Project Type: FSP
GEF Phase: GEF-5
GEF Project ID: 4933
PIMS Number: 5019
Key Stakeholders:
Countries: INDONESIA
Lessons
Findings
1.

The Evaluation Mission believes the project to have been, is now and will continue to be very relevant. It is directly related to the Government of Indonesia’s international obligations under the framework of the UNFCC, it falls directly under one of the GEF’s Focal Areas (Climate Change), it is relevant to Output 5 of the UNPAF for Indonesia (2011-2015) which states “In alignment with the Government’s plans, UN agencies will work with the central government to guide policies and actions on climate change, environmental security, and disaster management, while promoting the South-South cooperation modality.” It also relates directly to Outcome 2.3 of the UNDP/GoI Country Programme Action Plan (CPAP) for the period 2011-2015 which states what the CPAP expects to achieve as “National institutions and other key stakeholders are coherently and effectively addressing Climate Change (CC) adaptation and mitigation and ozone layer” and more specifically to Output 2.3.3 of the CPAP which states “Policy and guidelines to integrate climate change adaptation associated with DRR at decentralized level developed with appropriate capacity and resources” as well as Output 2.3.4 which states as a desired output for the project a “Coordinated and harmonized financing for ODS phase out and climate change, including MLF, GEF, AF, SCCF, private sector sources”.


Tag: Climate Change Adaptation Disaster risk management Environmental impact assessment Relevance Global Environment Facility fund Private Sector Financing Special Climate Change Fund Programme Synergy UN Agencies Crisis prevention South-South Cooperation

2.

On Effectiveness: The TE Mission was glad to note that for all practical effects, the 35 expected outputs have been produced and all the 11 expected outcomes have been achieved as planned. Most importantly, the GoI has submitted the Third National Communication to the UNFCC which was the ultimate objective of this project. The TE Mission therefore considers this project highly successful, as can be seen in “Table 8: Evaluation of the project situation as per the logframe up to January 2018” and the ratings given inTable 9: TE Rating for Project Performance” below.


Tag: Effectiveness

3.

ON EFFICIENCY: The TE Mission had opportunity to discuss at length with the National Project Director and staff of the Implementing Agency and the staff of the Executing Agency. The TE Missions was also glad to note that over 98% of the cash budget has been spent. Moreover, in all the major components expenditures were well over 90% of the original budget and in no component did expenditures exceed the amount budgeted, The in kind contributions of UNDP, GIZ and JICA materialized at 100%. The TE Mission was not able to obtain a detailed accounting on the in kind contribution of the GoI, however given that they have produced the TNC document, the Mission believes it is clear that they contributed all the required manpower and equipment that allowed this achievement. The project financial records have not been subject to an audit process. The Mission noted that in the course of the phase of implementation, two incumbents in the post of Head of the Project Management Unit (Project Manager) had resigned both for personal reasons. An attempt to recruit a Project Manager for a third time failed for lack of a viable candidate. This forced the UNDP Office Environment Unit to have to take on themselves many of those tasks. This did not result in any adverse effects to project implementation. The TE Mission wishes to record its appreciation to the dedication of the UNDP staff involved.


Tag: Efficiency Human and Financial resources Operational Efficiency Country Government UNDP Management UNDP management

4.

ON IMPACT: The TE Mission had an opportunity to talk with an array of stakeholders and there was unanimity amongst them that this project had been crucial in providing the training and support required to allow the GoI to draft a Third National Communication document. There was also the unanimous view that the lessons internalized as a consequence of this exercise will go beyond just allowing the GoI to meet this goal, as in the process of doing so, the understanding and commitment to GHG emissions diminishment has taken strong roots in many instances throughout government and academia. It was generally felt that the knowledge acquired, as well as the commitment that this effort has generated widely within government and academia, will contribute to the future refinement of climate friendly policies. 


Tag: Emission Reduction Impact Ownership Civil Societies and NGOs Country Government Policy Advisory

5.

If the TE Mission were to pint out one aspect of the design of this project which could have received greater attention it would be that no particular indicators for this aspect, to which the GEF and UNDP pay great attention, were built in. The TE Mission agrees fully with the MTR report which when referring to the project design states “The indicator of the project does not specify gender wise disaggregated results…”. The TE Mission was however glad to note that in the 10 detailed studies conducted on vulnerability, climate change impact and adaptation at local level, this aspect was taken into account. As can be seen, the TE includes as one of its recommendations that in any future follow up project “it is highly important to involve within the various technical working groups all stakeholders, including Civil Society actors (the women’s groups, Private Sect., select NGOs, local community representatives, etc).


Tag: Climate Change Adaptation Vulnerable Global Environment Facility fund Gender Equality Gender Mainstreaming Gender Parity Gender transformation Programme/Project Design Results-Based Management UNDP Management UNDP management

6.

In the opinion of the TE Mission, the project had a sound M& E Plan, that was executed in its entirety and in a timely manner in terms of project advancement. The roles and responsibilities of each partner were established in advance, were clear and were adhered to. The logframe was realistic in the resources required although somewhat optimistic in the time frame required and accurate in the way the logic behind it was built. It contained clear for the most part S.M.A.R.T baseline and end of project success indicators and agreed commonly understood means of verification. This clarity undoubtedly contributed to the successful attainment of the project’s overall objective. The TE Mission fully agrees with the MTR report which states “The design of M&E was of a standard much advanced over that normal for the design period, with a fully itemised and costed Plan included in the Project Document…”  


Tag: Monitoring and Evaluation Programme/Project Design Results-Based Management

7.

The National Project Director and the PMU coordinated well with the UNDP-CO keeping it informed on the project’s progress. The UNDP-CO received quarterly progress reports providing updates on the status of planned activities, the status of the overall project schedule, the outputs completed, and an outline of the activities planned for the following quarter. The major findings contained in these reports were incorporated into annual reports (PIRs) covering the project period July to June. These were shared with the UNDP/GEF Regional Coordination Unit, and UNDP HQ for review and comments. All key reports were presented to the NSC members ahead of their half-yearly meetings thus, the key national ministries were kept abreast of the project’s progress. The National Project Director and the UNDP-CO ensured that there was a fluid and constant exchange of information and a dialogue between all parties.


Tag: Global Environment Facility fund Communication Project and Programme management Country Government UNDP Independent Offices UNDP Regional Bureaux

8.

Considering the results achieved under each of the outcomes, and the progress toward the overall objective, the project effectiveness is rated Highly Satisfactory. The TNC project generated numerous significant achievements that resulted in the publication and submission of The Third National Communication to United Nations Convention on Climate Change, which was the project’s overall objective.


Tag: Effectiveness

9.

The project was an initiative of the GoI as a follow-up to a previous UNDP/GEF financed project. It was designed and drafted with the participation of GoI technical staff, and as stated above, it responds to existing GoI policy documents as well as the UNDAF and UNDP CPAP which are UN documents drafted jointly in response to and within the framework of GoI priorities and plans.


Tag: Ownership Programme Synergy Programme/Project Design Country Government UN Agencies

10.

The TE Evaluation Mission believes that the impact of the project is most likely to be sustainable beyond the project life and therefore rates the overall sustainability as LIKELY.  


Tag: Sustainability Sustainability

11.
  • Financial SUSTAINABILITY:

As stated above, the GoI is fully committed to the reduction of GHG emissions and to this end has not only complied with its treaty obligations but has gone further. One sign of this commitment has been the extensive amount of time and resources that it has invested in this project (U$ 14 million). Furthermore, in discussions with the TE Mission, they have stated their interest in continuing this level of commitment and of requesting additional funding from the UNDP/GEF for the production of a Fourth National Communication. The TE Mission was pleased to note that the UNDP/GEF also manifested their interest in considering additional funding for this purpose, subject of course to achieving the necessary level of replenishment in the forthcoming GEF replenishment exercise. On this point, the TE Mission gives a rating of LIKELY.


Tag: Emission Reduction Sustainability Global Environment Facility fund Government Cost-sharing Resource mobilization Ownership Sustainability Country Government

12.
  • SOCIO-ECONOMIC SUSTAINABILITY:

Undoubtedly, the TE Mission was able to ascertain, in all people they interviewed, that there is great awareness of the possible effects of CC on a country with the profile of Indonesia and there is a commitment to the reduction of GHG emissions and to taking the necessary adaptation measures to deal with the effects that are already and will continue to be felt. Time permit the TE Mission interviewing stakeholders only at the national level, but based on what we heard, this commitment also exists other levels within the country (national, regional, local and community). This was also the opinion expressed in the MTR. Therefore, on this point, the TE Mission also gives a rating of LIKELY.

 


Tag: Climate Change Adaptation Emission Reduction Sustainability Civic Engagement Local Governance Ownership Sustainability

13.
  • INSTITUTIONAL SUSTAINABILITY:

The MoEF has taken a clear leadership role on CC issues. It is obviously well manned by knowleagable technical staff and excellent managers. It has managed to bring around the table most other concerned Ministries which have participated in the four working groups. However, as noted, in the future, if there is support for a Fourth National Communication based on a Tier 3 methodological approach, they will need to put more emphasis on providing a greater role for other GoI institutions and ensure the adequate level of their participation. On this point the TE Mission once again gives a rating of LIKELY


Tag: Climate Change Adaptation Sustainability Public administration reform Sustainability Country Government Coordination

Recommendations
1

1. The logframe didn’t have Mid-term level target indicator. Midterm level targets should be included in the log-frame in future project documents, so that it will be easier for project staff to plan their work (and monitor activities).

2

2. The project team should have prepared a Project Inception Workshop report. The Ministry of Environment and Forestry and the UNDP should make sure that in the future projects, all mandatory reports are produced by the project team.

3

3. The focal Ministry i.e. Ministry of Environment and Forestry needs to put more effort to strengthen the coordination between relevant ministries to continue national communications and BUR development process in the future.

1. Recommendation:

1. The logframe didn’t have Mid-term level target indicator. Midterm level targets should be included in the log-frame in future project documents, so that it will be easier for project staff to plan their work (and monitor activities).

Management Response: [Added: 2018/11/09] [Last Updated: 2020/12/02]

The Ministry of Environment and UNDP accepted the recommendation for future similar initiative.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
The Ministry of Environment and Forestry and UNDP Indonesia accepted the recommendation for the next the National Communication project preparation and implementation.
[Added: 2018/11/09]
PMU 2018/01 Completed
2. Recommendation:

2. The project team should have prepared a Project Inception Workshop report. The Ministry of Environment and Forestry and the UNDP should make sure that in the future projects, all mandatory reports are produced by the project team.

Management Response: [Added: 2018/11/09] [Last Updated: 2020/12/02]

It is a lesson learned for other projects to make sure the project places a Note Taker in order to assure the report is available after the Project Inception Workshop is conducted.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
The Ministry of Environment and Forestry and UNDP Indonesia accepted the recommendation for the next the National Communication project preparation and implementation.
[Added: 2018/11/09]
PMU 2018/01 Completed The Project Inception Workshop was conducted but the report was not well documented. The National Project Coordinator left the project at the end of the 1st year project implementation before the project was reviewed.
3. Recommendation:

3. The focal Ministry i.e. Ministry of Environment and Forestry needs to put more effort to strengthen the coordination between relevant ministries to continue national communications and BUR development process in the future.

Management Response: [Added: 2018/11/09] [Last Updated: 2020/12/02]

The Ministry of Environment and UNDP accepted the recommendation for future similar initiative.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
The Ministry of Environment and Forestry and UNDP Indonesia accepted the recommendation for the next the National Communication project preparation and implementation.
[Added: 2018/11/09]
PMU 2018/01 Completed

Latest Evaluations

Contact us

1 UN Plaza
DC1-20th Floor
New York, NY 10017
Tel. +1 646 781 4200
Fax. +1 646 781 4213
erc.support@undp.org