00090780 Capacity Development for Implementing Rio Conventions through Enhancing Incentive Mechanisms for Sustainable Watershed/Land Management GEF Mid-Term Evaluation

Report Cover Image
Evaluation Plan:
2016-2020, Indonesia
Evaluation Type:
Mid Term Project
Planned End Date:
03/2020
Completion Date:
10/2019
Status:
Completed
Management Response:
Yes
Evaluation Budget(US $):
30,000

Share

Document Type Language Size Status Downloads
Download document ToR MTR CCCD 2019.pdf tor English 1173.13 KB Posted 80
Download document 5224 Indonesia MTR Report December 2019 final (002).pdf report English 19041.95 KB Posted 56
Title 00090780 Capacity Development for Implementing Rio Conventions through Enhancing Incentive Mechanisms for Sustainable Watershed/Land Management GEF Mid-Term Evaluation
Atlas Project Number: 00090780
Evaluation Plan: 2016-2020, Indonesia
Evaluation Type: Mid Term Project
Status: Completed
Completion Date: 10/2019
Planned End Date: 03/2020
Management Response: Yes
UNDP Signature Solution:
  • 1. Resilience
Corporate Outcome and Output (UNDP Strategic Plan 2018-2021)
  • 1. Output 1.4.1 Solutions scaled up for sustainable management of natural resources, including sustainable commodities and green and inclusive value chains
SDG Goal
  • Goal 12. Ensure sustainable consumption and production patterns
SDG Target
  • 12.2 By 2030, achieve the sustainable management and efficient use of natural resources
Evaluation Budget(US $): 30,000
Source of Funding: Capacity Development Project
Evaluation Expenditure(US $): 16,000
Joint Programme: No
Joint Evaluation: Yes
  • Joint with Ministry of Environment and Forestry
Evaluation Team members:
Name Title Email Nationality
Giacommo Morelli External Evaluator
Muhammad Anggri Setiawan External Evaluator
GEF Evaluation: Yes
GEF Project Title: GEF Mid Term Evaluation: Capacity Development for Implementing Rio Conventions through Enhancing Incentive Mechanisms for Sustainable Watershed/Land Management
Evaluation Type: Mid-term Review
Focal Area: Multifocal Areas
Project Type: MSP
GEF Phase: GEF-5
GEF Project ID: 5848
PIMS Number: 5224
Key Stakeholders:
Countries: INDONESIA
Lessons
1.

The project suffered a delay of more than one year following the merge of two existing ministries (Ministry of Environment and Forestry) into one to become the MoEF, which is the project's Executing Agency. The merge affected the operational of the newly established ministry, which ultimately contributed to the delay. 

Assesing the project's achievement towards higher level aims is challenging. The evaluation was conducted throughout Result Framework and recommends 13 actions. 

MTR rating was applied to project strategy , progress towards results, project implementation and adaptive management, sustainability. Stakeholders were engaged in collecting information and reviews. MTR also assess the current management process and mechanism to support project implementation, including communication between project's  management and implementing partner and beneficiaries. Project sustainability was examined through looking at financial risks management, socio economic risk management, institutional and governance framework and environmental risk mitigation. 

 


Findings
1.

Highlights from evaluation findings as follow; 

1. Project design ; Stakeholders confirmed the lack of condusive policy framework and coordinationg amongst relevant national, provincial, and district authorities as main barriers for quality implementation of the conventions  and more broadly for the promotion of sustainable natural resources management . However, the project has clearly on track towards achiviement of the targets. 

2. Progress towards result. It scanned the progress of indicators which most are at satisfactory benchmark. Only few of indicators progress are unsatisfactory.  

3. Project Implementation and adaptive management are clear in implementation and straighforward towards results target. 

4. Sustainability . It assessed financial risks, socio-economic, institutional framework and governance and environmental risks.


Recommendations
1

UNDP-CO should adjust the project budget in order to reduce the IN-KIND contributions to more realistic levels. PMU: organize relevant trainings on M&E for local authorities at district level to effectively monitor the implementation of the grants by the working groups and document the empirical evidences, which may be used for scaling up the project approach by the Government of Indonesia. (Activities, Outcome 2)

2

organize relevant intensive trainings for community working groups to support the implementation of the grants. (Activities, Outcome 2)

3

Conduct two workshops per watershed with representatives from all working groups to share knowledge and skills accrued through grants’ implementation and develop best practice to feed into scale up efforts. The workshops should include the participation of all concerned local stakeholders and officers from the three Directorates of the MoEF in Jakarta. (Activities, Outcome 2)

4

Not to implement activities related to Output 3.3 “Public service announcements on environmentally friendly behaviour”, as there are no means to evaluate the awareness raising effects of the PSAs on large audiences such as those of television and radio. (Activities, Outcome 3)

5

To implement the activities related to Output 3.4 “Improved educational content and youth engagement” with the support of an additional staff, i.e. a specialist in Youth Engagement to be hired, in order for the current staff to be able to work on the remaining project outputs and to allow an effective accompaniment of a substantive achievement of project outputs. (Activities, Outcome 3)

6

speed up, through the hiring of a Youth Engagement specialist, the activities for the formulation of the “education module for institutions on Rio Conventions” (indicator 3.4.1) and for “environmental awareness module for secondary schools” and apply both modules in at least one secondary school in each project district, Lampung and Malang. (Activities, Outcome 3)

7

To negotiate with local authorities at the district level for additional budget allocations to support follow up and monitoring of the grants’ implementation, and of the watershed management plans. This budget allocation may be done in September-December 2020, i.e. when the districts officially revise their budgets. (Activities, Outcome 2)

8

To include as a target “26 pilot grants implemented and documented” in the Results Framework as a replacement for the wording of indicator 2.2.2 which currently reads “Selected exercises piloted at project sites” in order to enhance project accountability. (Outcome 2)

9

To define realistic, in terms of budget and time, target values for the indicators 3.4.3 “Tree planting in the selected watershed” and 3.4.4 “High school and youth field visit and study tour” in order to enhance project accountability. (Activities, Outcome 3)

10

To negotiate a more effective and less bureaucratic mechanism of communication with the district authorities in Malang District, East Java Province. (Activities, Outcome 2)

11

To organize exchange visits between working groups within the same village to promote an integrated approach with them, i.e. synergising learning and reinforcing project messaging. (Activities, Outcome 2).

12

UNDP/MoEF/PMU: request at least a six-month no-cost extension to recover the initial delay in overall project implementation. (All Outcomes)

13

To accompany the no-cost extension with an overall budget revision that considers the financial requirements of the all other recommendations. (All Outcomes)

1. Recommendation:

UNDP-CO should adjust the project budget in order to reduce the IN-KIND contributions to more realistic levels. PMU: organize relevant trainings on M&E for local authorities at district level to effectively monitor the implementation of the grants by the working groups and document the empirical evidences, which may be used for scaling up the project approach by the Government of Indonesia. (Activities, Outcome 2)

Management Response: [Added: 2020/04/23]

grant monitoring has been carried out with a number of local governments using the monitoring and evaluation tools that have been made. The base of the monitoring is the Micro Watershed Management Plan 2019-2023 and Rio Convention Mandates, as the evidence of each activities by working groups are documented on Monitoring and Evaluation Report.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
UNDP CO make a clarification meeting with MoEF on the actual IN KIND contribution
[Added: 2020/04/23]
UNDP Co and NPD 2019/09 Completed
PMU to organize relevant training M&E for local authorities for district level: Pesawaran and Malang
[Added: 2020/04/23]
Directorate of Watershed Planning and Evaluation, Watershed Management Agency Way Seputih Way Sekampung, Watershed Management Agency Brantas Sampean, PMU, SCU Lampung and SCU Jawa Timur 2019/09 Completed
2. Recommendation:

organize relevant intensive trainings for community working groups to support the implementation of the grants. (Activities, Outcome 2)

Management Response: [Added: 2020/04/23]

Trainings has been carried out regarding to local groups need on elevating the skills to support the groups’ activities. Trainings carried out by CCCD and local governments, includes administrative and reporting training.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
PMU to organize relevant intensive trainings for community working groups in Lampung and Malang to support the implementation of the grants.
[Added: 2020/04/23]
PMU SCU Lampung SCU Jawa Timur 2019/12 Completed
3. Recommendation:

Conduct two workshops per watershed with representatives from all working groups to share knowledge and skills accrued through grants’ implementation and develop best practice to feed into scale up efforts. The workshops should include the participation of all concerned local stakeholders and officers from the three Directorates of the MoEF in Jakarta. (Activities, Outcome 2)

Management Response: [Added: 2020/04/23]

The workshops has been done throughout meeting with the Watershed managemement forums to report the progress and share updates regarding best practices for activities of the local groups

Key Actions:

Key Action Responsible DueDate Status Comments Documents
PMU to conduct two workshops per watershed with representatives from all working groups to share knowledge and skills accrued through grants’ implementation and develop best practice to feed into scale up efforts.
[Added: 2020/04/23]
PMU SCU Watershed Management Agency Way Seputih Way Sekampung Watershed Management Agency Brantas Sampean 2019/09 Completed
4. Recommendation:

Not to implement activities related to Output 3.3 “Public service announcements on environmentally friendly behaviour”, as there are no means to evaluate the awareness raising effects of the PSAs on large audiences such as those of television and radio. (Activities, Outcome 3)

Management Response: [Added: 2020/04/23]

As for awareness raising conducted on annual events and social media. Games and quizzes are conducted on annual events as part of the awareness raising. Survey for local groups will be conducted on Q3 2020 regarding the COVID-19 Pandemi limits the activities on field.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
PMU and SCU to conduct the awareness survey to the local communities
[Added: 2020/04/23] [Last Updated: 2020/10/01]
PMU SCU 2021/01 Initiated The activity is on going. Propose to change due date to December 2020. The awareness survey requires in person meeting with local community at project sites. Local communities in Malang can be reach by phone or online meeting while local communities in Pesawaran can’t be reach by phone and online meeting. The situation occurs due to COVID19 pandemic History
4.1 PSA already conduct on 2017, furthermore PMU will switch communication strategy to awareness raising such as social media, exhibition
[Added: 2020/04/23]
PMU SCU 2020/04 Completed Activities conducted as follow: - World Day on Combating Desertification - Malang Expo Exhibition - National Conservation Day - Climate Festival Social Media documentation: https://cccd.id/ https://web.facebook.com/cccdproject/?ref=br_rs https://www.instagram.com/cccdproject/ https://twitter.com/CccdProject https://www.youtube.com/channel/ UCVKEIMwKyw3lrXPpNj3ytnA
5. Recommendation:

To implement the activities related to Output 3.4 “Improved educational content and youth engagement” with the support of an additional staff, i.e. a specialist in Youth Engagement to be hired, in order for the current staff to be able to work on the remaining project outputs and to allow an effective accompaniment of a substantive achievement of project outputs. (Activities, Outcome 3)

Management Response: [Added: 2020/04/23]

Community Engagement Consultant has been hired and on monitor local groups activities regularly with Field Assistant. The Local Content Learning will be conducted on Q3 as per April 2020 the condition of COVID-19 Pandemic hasn’t been better.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
PMU to conduct Local Content Learning in Secondary School in 3 Villages (1 in Lampung and 2 in Malang)
[Added: 2020/04/23] [Last Updated: 2020/10/01]
PMU SCU Lampung SCU Jawa Timur 2021/01 Initiated Local content learning in Malang will be conducted on 15-16 Sept 2020 and local content learning in Pesawaran will be conducted in November 2020 since currently the consultant still establishing the module. History
SCU Lampung and Jawa Timur will hire Community Engagement Consultant
[Added: 2020/04/23]
PMU SCU Lampung 2020/03 Completed
6. Recommendation:

speed up, through the hiring of a Youth Engagement specialist, the activities for the formulation of the “education module for institutions on Rio Conventions” (indicator 3.4.1) and for “environmental awareness module for secondary schools” and apply both modules in at least one secondary school in each project district, Lampung and Malang. (Activities, Outcome 3)

Management Response: [Added: 2020/04/23]

Community Engagement Consultant for SCU Lampung has been hired, Local Content Modules will be drafted on Q2 and Q3 2020.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Community engagement consultant to establish modules for Local Content Learning
[Added: 2020/04/23]
PMU SCU Lampung SCU Jawa Timur 2020/10 Overdue-Initiated
Community engagement consultant to deliver the Local Content to Secondary School
[Added: 2020/04/23]
PMU SCU Lampung SCU Jawa Timur 2020/10 Overdue-Initiated
SCU Lampung will hire Community Engagement Consultant
[Added: 2020/04/23]
PMU SCU Lampung 2020/03 Completed Directorate of Watershed Planning and Evaluation as Implementing partner agreed to implement the recruitment process of mentioned position. History
7. Recommendation:

To negotiate with local authorities at the district level for additional budget allocations to support follow up and monitoring of the grants’ implementation, and of the watershed management plans. This budget allocation may be done in September-December 2020, i.e. when the districts officially revise their budgets. (Activities, Outcome 2)

Management Response: [Added: 2020/04/23]

Watershed management forum and local governments has negotiated for the exit strategy of the Project following the Micro Watershed Management Plan 2019-2023. They already included activities written in the document for 2020 and plan for 2021.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Negotiation meeting with Head of Pesawaran District and Head of Malang District to ensure the commitment and budget revision in Micro Watershed Management Plan 2019-2023 Way Khilau and Micro Watershed Sumberbulu 2019-2023
[Added: 2020/04/23]
PMU SCU Lampung SCU Jawa Timur 2020/03 Completed
8. Recommendation:

To include as a target “26 pilot grants implemented and documented” in the Results Framework as a replacement for the wording of indicator 2.2.2 which currently reads “Selected exercises piloted at project sites” in order to enhance project accountability. (Outcome 2)

Management Response: [Added: 2020/04/23]

Acknowledged on Project Board and to be documented as success strory for integrated land management for future activities.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
To put the target into the Project Result Framework
[Added: 2020/04/23]
PMU 2019/12 Completed
9. Recommendation:

To define realistic, in terms of budget and time, target values for the indicators 3.4.3 “Tree planting in the selected watershed” and 3.4.4 “High school and youth field visit and study tour” in order to enhance project accountability. (Activities, Outcome 3)

Management Response: [Added: 2020/04/23]

Tree planting has been done in end of Q4 2019. Field fisit and study tour will be  conducted on Q3 2020 along with the Local Content Learning.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
indicator 3.4.4: high school and youth field visit and study tour still on track based on annual work plan
[Added: 2020/04/23]
PMU SCU Management Agency Way Seputih Way Sekampung Management Agency Brantas Sampean 2020/10 Overdue-Initiated
indicator 3.4.3: Project support annual tree planting conducted by Watershed Management Agency Way Seputih Way Sekampung and Brantas Sampean
[Added: 2020/04/23]
PMU SCU Watershed Management Agency Way Seputih Way Sekampung Management Agency Brantas Sampean 2019/12 Completed
10. Recommendation:

To negotiate a more effective and less bureaucratic mechanism of communication with the district authorities in Malang District, East Java Province. (Activities, Outcome 2)

Management Response: [Added: 2020/04/23]

SCU Jatim coordinate with local government using door to door method and maximizing social media, resulting in better communication and coordination. As part of Malang District “Musrenbang”, local governments discuss with Micro Watershed Management Forum activities regarding the field activities and Micro Watershed Management Plan 2019-2023.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
SCU Jawa Timur to intensify communication with communication strategy approach
[Added: 2020/04/23]
PMU SCU Jawa Timur 2019/12 Completed
Coordination Meeting with Sumberbulu Micro Watershed Management Forum
[Added: 2020/04/23]
PMU SCU Jawa Timur 2020/03 Completed
11. Recommendation:

To organize exchange visits between working groups within the same village to promote an integrated approach with them, i.e. synergising learning and reinforcing project messaging. (Activities, Outcome 2).

Management Response: [Added: 2020/04/23]

Monthly meeting by Field Assistant and local groups for synergizing best practices among the groups and raising awareness of Rio Convention Mandates

Key Actions:

Key Action Responsible DueDate Status Comments Documents
PMU to organize exchange visit between working groups in Micro Watershed Way Khilau and Micro Watershed Sumberbulu
[Added: 2020/04/23]
PMU SCU 2020/03 Completed
12. Recommendation:

UNDP/MoEF/PMU: request at least a six-month no-cost extension to recover the initial delay in overall project implementation. (All Outcomes)

Management Response: [Added: 2020/04/23]

Has been discussed on 4th Project Board on 7th July 2020 for the extention to March 2021. Documents needed for the extention prepared by PMU and Implementing Agency.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
UNDP CO to communicate the result of AWP 2020 to GEF secretariat
[Added: 2020/04/23]
UNDP Country Office 2020/10 Overdue-Initiated
Project Board Meeting decided extension with some notes
[Added: 2020/04/23]
PMU UNDP SCU Lampung SCU Jawa Timur 2019/12 Completed
Annual Meeting decided to extend up into December 2020
[Added: 2020/04/23]
PMU UNDP SCU Lampung SCU Jawa Timur 2019/12 Completed
PMU to submit result of Annual Work Plan 2020 to UNDP CO
[Added: 2020/04/23]
PMU 2020/01 Completed
13. Recommendation:

To accompany the no-cost extension with an overall budget revision that considers the financial requirements of the all other recommendations. (All Outcomes)

Management Response: [Added: 2020/04/23]

Budget Revision as one of the document needed for extention has been prepared and waiting for approval to be attached to the extention letter

Key Actions:

Key Action Responsible DueDate Status Comments Documents
to discuss the no cost extension in Annual Meeting CCCD Project 2019
[Added: 2020/04/23]
PMU MoEF UNDP 2019/12 Completed
to process budget revision 2020
[Added: 2020/04/23]
PMU MoEF UNDP 2019/12 Completed

Latest Evaluations

Contact us

1 UN Plaza
DC1-20th Floor
New York, NY 10017
Tel. +1 646 781 4200
Fax. +1 646 781 4213
erc.support@undp.org