Mid term Evaluation: Strengthening Sustainability of Protected Area Management in Myanmar

Report Cover Image
Evaluation Plan:
2018-2022, Myanmar
Evaluation Type:
Mid Term Project
Planned End Date:
12/2018
Completion Date:
12/2018
Status:
Completed
Management Response:
Yes
Evaluation Budget(US $):
40,000

Share

Document Type Language Size Status Downloads
Download document Protected area mgt_GEF -5 PA Project_Document_Signed.pdf related-document English 2249.63 KB Posted 44
Download document GEF Project Inception Report_Final_14JUL2016.pdf related-document English 2089.25 KB Posted 48
Download document TOR MTR PA Managemetn Int Consultant.pdf tor English 287.68 KB Posted 43
Download document TOR- MTR PA management Team Member National Consultant.pdf tor English 692.03 KB Posted 35
Download document PA Management - MTR Report FINAL.pdf report English 6330.99 KB Posted 40
Download document MTR Report Annex 1 - MTR Terms of Reference.pdf related-document English 6472.55 KB Posted 25
Download document MTR Report Annex 2 - Evaluative Matrix Final.pdf related-document English 385.49 KB Posted 39
Download document MTR Report Annex 3 - Rating Scales.pdf related-document English 57.04 KB Posted 35
Download document MTR Report Annex 4 - MTR Mission Itinerary 02-03 2018.pdf related-document English 142.90 KB Posted 30
Download document MTR Report Annex 5 - Interviewees Final.pdf related-document English 60.06 KB Posted 46
Download document MTR Report Annex 6 - List of documents reviewed.pdf related-document English 64.95 KB Posted 35
Download document MTR Report Annex 7 - Results Framework Analysis.pdf related-document English 163.27 KB Posted 33
Download document MTR Report Annex 9 - Financial Capacity Scorecard.xlsx related-document English 66.48 KB Posted 33
Download document MTR Report Annex 10 - MTR_CD Scorecards_2013&2017_FINAL.xlsx related-document English 40.45 KB Posted 33
Download document MTR Report Annex 11 - MTR_METT_2013 & 2018_FINAL.xlsx related-document English 110.74 KB Posted 31
Download document MTR Report ANNEX 12 - Signed UNEG Code of Conduct.pdf related-document English 168.52 KB Posted 29
Download document MTR Report Annex 13 - Audit Trail Final.pdf related-document English 162.57 KB Posted 34
Download document MTR Report Annex 14 - Photos Final-compressed.pdf related-document English 1717.84 KB Posted 29
Download document Annex 8 Progress Towards Results Matrix Final.pdf related-document English 317.85 KB Posted 23
Title Mid term Evaluation: Strengthening Sustainability of Protected Area Management in Myanmar
Atlas Project Number: 00083188
Evaluation Plan: 2018-2022, Myanmar
Evaluation Type: Mid Term Project
Status: Completed
Completion Date: 12/2018
Planned End Date: 12/2018
Management Response: Yes
Corporate Outcome and Output (UNDP Strategic Plan 2018-2021)
  • 1. Output 1.4.1 Solutions scaled up for sustainable management of natural resources, including sustainable commodities and green and inclusive value chains
Evaluation Budget(US $): 40,000
Source of Funding: Project Budgets
Evaluation Expenditure(US $): 41,270
Joint Programme: No
Joint Evaluation: No
Evaluation Team members:
Name Title Email Nationality
GEF Evaluation: Yes
GEF Project Title: Strengthening Sustainability of protected Area Mgt in Myanmar
Evaluation Type: Mid-term Review
Focal Area: Biodiversity
Project Type: FSP
GEF Phase: GEF-5
GEF Project ID: 5159
PIMS Number: 5162
Key Stakeholders: Ministry of Environmental Conservation and Forestry (MONREC) Environmental Conservation Department, Natural Resources Conservation and EIA Division, Forest Department, Nature and Wildlife Conservation Division, Training and Research Development Division, University of Forestry, Myanmar Forest School, Planning and Statistics Division, Ministry of National Planning and Economic Development, Ministry of Finance, National Environmental Conservation Committee (NECC), Forest Research Institute, State and Region Governments, Wildlife Conservation Society (WCS), Police, Local communities, CBOs, Private businesses
Countries: MYANMAR
Lessons
Findings
Recommendations
1

Recommendation 1 (R1): Undertake a comprehensive, participatory and strategic review of the project design and Results Framework in order to adapt the project to changes in the implementation context, including: (1) reducing the overall scope of work (2) prioritizing interventions that are likely to have greatest sustainable impact by the end of the project; (3) ensuring that project progress and impacts can be measured systematically; (4) updating project risks and assumptions; and (5) systematically recording all major changes to the original project design in the Project
 

2

Recommendation 2 (R2): Prioritize policy-related interventions that are critical to both scale up and sustainability of project impacts and achievable within the available project timeframe, capacity and other resources

3

Recommendation 3 (R3): Consolidate and streamline capacity development activities and assess their relative impact and cost-effectiveness

4

Recommendation 4 (R4): Prioritize work on strengthening financial sustainability of the PA system and of the demonstration PAs

5

Recommendation 5 (R5): Strengthen the sustainability of key project strategies to improve management effectiveness of demonstration PAs
 

6

Recommendation 6 (R6): Strengthen and expand community engagement on PA management

7

Recommendation 7 (R7): Strengthen project ownership across key stakeholder groups at different levels, particularly at subnational level

8

Recommendation 8 (R8): Clarify and strengthen project governance and implementation arrangements, including the ability of the Project Board to provide adequate strategic and technical oversight to the project.

9

Recommendation 9 (R9): Strengthen project adaptive management and staff capacities, particularly with respect to gender mainstreaming, M&E, technical reporting and communication to different stakeholder groups

10

Recommendation 10 (R10): Strengthen replication and scale-up of project results

1. Recommendation:

Recommendation 1 (R1): Undertake a comprehensive, participatory and strategic review of the project design and Results Framework in order to adapt the project to changes in the implementation context, including: (1) reducing the overall scope of work (2) prioritizing interventions that are likely to have greatest sustainable impact by the end of the project; (3) ensuring that project progress and impacts can be measured systematically; (4) updating project risks and assumptions; and (5) systematically recording all major changes to the original project design in the Project
 

Management Response: [Added: 2019/01/02] [Last Updated: 2019/01/02]

Relevant to: Project Strategy, Implementation & Adaptive Management, Outcomes 1 & 2, Sustainability 

Responsible entities: Project Team (PT)/WCS, UNDP, FD

Key Actions:

Key Action Responsible DueDate Status Comments Documents
R1.1: Review, clarify and/or revise objective and outcome level indicators, baselines and targets and ensure these are sufficiently specific, measurable, achievable, relevant and time-bound (i.e. SMART) and that baselines, risk and assumptions are accurate and up to date. This includes the following: (1) Revise all Objective Indicators, baselines & targets; (2) Revise Outcome Indicators 1.1, 1.3, 1.4, 2.1, 2.2, and 2.4 and associated baselines & targets; and (3) Develop a Theory of Change for the project (if time and resources permit) as a capacity development exercise for the Project Team & partners and translating the Results Framework into the Myanmar language
[Added: 2019/01/02]
1. PT / WCS 2. UNDP 2019/06 Not Initiated
R1.2: Reduce scope of Outcome 1 by formally dropping planned work on national land use planning (Indicator 1.1a) and coastal governance (Indicator 1.1d)
[Added: 2019/01/02]
1. PT / WCS 2. UNDP 3. FD 4. Project Board 2019/12 Not Initiated History
R1.3: Add specific indicators for Output 1.4 (a PA system sustainable financing strategy) and Output 2.1 (strengthened management of demonstration PAs through business plans) to ensure progress on these are monitored systematically through the PIRs
[Added: 2019/01/02]
1. PT / WCS 2. Project Board 2019/06 Not Initiated
R1.4: Consider undertaking a socio-economic mapping of terrestrial ecosystems as an input to PA systems planning to integrate with the ecological gap analysis undertaken under Output 1.6 if time and resources permit
[Added: 2019/01/02]
1. NPM 2. NPD 3. UNDP 2019/06 Not Initiated History
R1.5: Update the Environmental and Social Screening undertaken at the time of project approval using the more recent UNDP Social and Environment Screening Procedure (SESP) and ensure that risks reporting including mitigation and management strategies, is harmonized across different processes such as the PIR, QRs and UNDP Risk and Issues Log.
[Added: 2019/01/02]
1. PT/WCS 2. UNDP 2019/06 Not Initiated
R1.6 Exclude Hukaung Valley WS from further mandatory monitoring and reporting against Results Framework indicators and targets with approval from the Project Board.Note: Cost-effectiveness of project activities in Hukaung Valley should continue to be monitored by WCS, UNDP and the Project Board
[Added: 2019/01/02]
1. WCS 2. FD 3. UNDP 4. Project Board 2019/06 Not Initiated
R1.7: Given delays and other implementation challenges outside the project’s control, request a one-year no-cost extension from the GEF via UNDP
[Added: 2019/01/02]
1. WCS 2. FD 3. UNDP 4. Project Board 2019/06 Not Initiated
2. Recommendation:

Recommendation 2 (R2): Prioritize policy-related interventions that are critical to both scale up and sustainability of project impacts and achievable within the available project timeframe, capacity and other resources

Management Response: [Added: 2019/01/02] [Last Updated: 2019/01/02]

Relevant to: Outcome 1, Sustainability

Responsible entities: Project Team/WCS, NWCD, FD

Key Actions:

Key Action Responsible DueDate Status Comments Documents
R2.1: Provide inputs to the rules and regulations that will be developed by the FD to guide the implementation of the new law on Biodiversity & Conservation of PAs to ensure these address key project targets under Outcome 1 (Output 1.1a, 1.1c and 1.1e in particular).
[Added: 2019/01/02]
1. PT /WCS 2. NPD 2019/06 Not Initiated
R2.2: Develop a Forest Department Standard Operating Procedure (SOP) and/or instruction on PA buffer zone management and use
[Added: 2019/01/02]
1. PT 2. NWCD 3. FD 2019/12 Not Initiated
R2.3: Use project knowledge, experience and tools such as the Village Consultation Process (VCP), the Village Use Zoning Process (VUZP) and the Participatory Land Use Plan (PLUP) to develop a Forest Department SOP and/or instruction on best practices for assessing, recording and managing customary uses and rights in relation to PAs.
[Added: 2019/01/02]
1. PT 2. NWCD 3. FD 2019/12 Not Initiated
R2.4: Building on the existing 2016 FD instruction on Community Forests, develop an SOP on effective stakeholder engagement to establish Community Forests in PA buffer zones
[Added: 2019/01/02]
1. PT 2. NWCD 3. FD 2019/12 Not Initiated
R2.5: Consider developing an SOP or best practice guidelines for establishing and managing a community PA under the forthcoming new law on Biodiversity and Conservation of PAs
[Added: 2019/01/02]
1. PT 2. NWCD/FD 2021/06 Not Initiated History
3. Recommendation:

Recommendation 3 (R3): Consolidate and streamline capacity development activities and assess their relative impact and cost-effectiveness

Management Response: [Added: 2019/01/02] [Last Updated: 2019/01/02]

Relevant to: Outcome 1, Sustainability

Responsible entities: UNDP, FD, WCS

Key Actions:

Key Action Responsible DueDate Status Comments Documents
R3.1: Review and finalize draft capacity development strategy and roadmap for NWCD and present to Project Board for approval
[Added: 2019/01/02]
1. PT / WCS 2. NWCD / FD 2019/12 Not Initiated History
R3.2: Assess the relative value and costeffectiveness of different types of capacity development activities under Output 1.3, particularly the delivery of one-off trainings, the development of new training courses and the institutionalization of new training courses.
[Added: 2019/01/02]
1. PT / WCS 2. UNDP 3. FD 2019/12 Not Initiated History
R3.3: Obtain feedback on the new certificate and non-certificate training courses and curricula developed by the project from the key government counterparts involved (CFTDC, NWCD, PA staff, MFS, UoFES,)
[Added: 2019/01/02]
1. UNDP 2. PB 2019/12 Not Initiated History
R3.4: Ensure complementarity between the proposed Myanmar Wildlife College and the new training courses developed by the project that will be delivered through existing institutions
[Added: 2019/01/02]
1. NWCD/FD 2. PB 2019/12 Not Initiated History
4. Recommendation:

Recommendation 4 (R4): Prioritize work on strengthening financial sustainability of the PA system and of the demonstration PAs

Management Response: [Added: 2019/01/02] [Last Updated: 2019/01/02]

Relevant to: Outcome 1 & 2, Sustainability
Responsible entities: Project Team / FD

Key Actions:

Key Action Responsible DueDate Status Comments Documents
R4.1: Prepare the draft sustainable financing strategy for the PA system, building on the considerable secondary information on PA financing needs that exists already and integrate with the development of MONREC’s broader environmental financing strategy through GRSP
[Added: 2019/01/02]
1. PT / WCS 2. UNDP 2019/06 Not Initiated
R4.2: Integrate business plans for demonstration PAs into the system-wide sustainable financing strategy developed through the project (R4.1)
[Added: 2019/01/02]
PT / WCS 2019/12 Not Initiated
R4.3: Finalize and produce a report of the comprehensive scoping undertaken for the Myanmar Biodiversity Conservation Fund, building on scoping work undertaken for the Environmental Management Fund.
[Added: 2019/01/02]
PT / WCS 2019/06 Not Initiated
R4.4: With support from UNDP and potentially the PAMCCs, explore options for sustaining promising community engagement models such as CF applications in Htamanthi, Village Use Zoning and Land Use Planning, including microfinance schemes or funding available through other government departments
[Added: 2019/01/02]
1. PT 2. UNDP 3. FD 2019/12 Not Initiated
5. Recommendation:

Recommendation 5 (R5): Strengthen the sustainability of key project strategies to improve management effectiveness of demonstration PAs
 

Management Response: [Added: 2019/01/02] [Last Updated: 2019/01/02]

Relevant to: PT, FD, NWCD

Key Actions:

Key Action Responsible DueDate Status Comments Documents
R5.1: Increase project investment in community participation models (Output 2.3) which is currently very low relative to investment in SMART patrolling.
[Added: 2019/01/02]
1. NPM 2. NPD 3. UNDP 4. PB 2019/12 Not Initiated
R5.2 Develop and implement strategies to overcome current problems in Hkakaborazi related to the World Heritage nomination through stakeholder engagement and trust-building activities
[Added: 2019/01/02]
1. FD 2. WCS 3. UNDP 4. PB 2019/06 Not Initiated
R5.3: Complete business plans for demonstration PAs and link to system-wide PA financing strategy. Note: Ecotourism plan for Hkakaborazi should be integrated in the PA’s business plan.
[Added: 2019/01/02]
1. PT/WCS 2. FD 2019/12 Not Initiated History
R5.4: Identify and implement strategies to improve the quality, analysis and use of SMART patrolling data to monitor threat reduction and other parameters relevant to PA management effectiveness
[Added: 2019/01/02]
1. PT/WCS 2. FD 2019/06 Not Initiated
6. Recommendation:

Recommendation 6 (R6): Strengthen and expand community engagement on PA management

Management Response: [Added: 2019/01/02] [Last Updated: 2019/01/02]

Relevant to: Outcome 2, Sustainability
Responsible entities: Project Team, WCS, NWCD, FD, UNDP

Key Actions:

Key Action Responsible DueDate Status Comments Documents
R6.1: Update the original Community Participation Strategy to reflect the needs of ethnic minorities and other marginalized or disadvantaged groups as well as the gender dimension, and adapt to the site-specific conditions in each project demonstration site.
[Added: 2019/01/02]
1. PT/WCS 2. UNDP 2019/12 Not Initiated History
R6.2: Identify strategies to include community representatives in the PAMCCs and ensure their effective participation in PAMCC meetings at different levels starting with the township PAMCCs
[Added: 2019/01/02]
1. PT 2. UNDP 3. FD 2019/06 Not Initiated
R6.3: Build on lessons from Hukaung Valley and Htamanthi to develop and initiate Community Guards and Guardians schemes for Hponkanrazi and Hkakaborazi.
[Added: 2019/01/02]
1. PT / WCS 2. FD 2019/06 Not Initiated
R6.4: Manage community expectations in Htamanthi by determining how many more CF applications can realistically be submitted before the project ends and how support to the CF User Groups will be sustained once the project ends.
[Added: 2019/01/02]
PT /WCS 2019/12 Not Initiated History
R6.5: Explore practical options for monitoring the impacts of community participation models piloted by the project on PA management effectiveness
[Added: 2019/01/02]
PT / WCS 2019/12 Not Initiated History
R6.6: Strengthen integration of gender considerations into activities related to community engagement under Output 2.3 with support from UNDP
[Added: 2019/01/02]
1. PT / WCS 2. UNDP 2019/12 Not Initiated History
7. Recommendation:

Recommendation 7 (R7): Strengthen project ownership across key stakeholder groups at different levels, particularly at subnational level

Management Response: [Added: 2019/01/02] [Last Updated: 2019/01/02]

Relevant to: Outcomes 1 & 2, Implementation & Adaptive Management, Sustainability
Responsible entities: WCS, UNDP, FD

Key Actions:

Key Action Responsible DueDate Status Comments Documents
R7.1: Update original project Stakeholder Involvement Plan.
[Added: 2019/01/02]
PT 2019/12 Not Initiated
R7.2: Develop a simple project Communication Strategy that identifies appropriate messaging for key target audiences to enhance project ownership and sustainability, including ways to effectively communicate the ‘business case’ for PAs and conservation i.e. the relevance of PAs and conservation to wider development objectives
[Added: 2019/01/02]
PT with guidance from UNDP 2019/12 Not Initiated History
R7.3: Use PAMCC meetings and similar events to communicate project objectives and business case for conservation and PAs to non-FD government stakeholders in ways that will resonate with them.
[Added: 2019/01/02]
PT with support from UNDP 2019/12 Not Initiated History
R7.4: Make the Community Guardians and Guards programmes a ‘two-way’ process by also sharing feedback on how the biological survey data and SMART patrolling data they collect are being used and incorporating their comments on how to make biological surveys and SMART patrolling more effective.
[Added: 2019/01/02]
PT / WCS 2019/12 Not Initiated
R7.5: Leverage UNDP co-financing (e.g. through GRSP) and the UNDP Area Offices in Myitkyina and Mandalay to strengthen synergies between UNDP programmes and the project and to facilitate and strengthen wider subnational government engagement and support for the project
[Added: 2019/01/02]
UNDP 2019/12 Not Initiated
8. Recommendation:

Recommendation 8 (R8): Clarify and strengthen project governance and implementation arrangements, including the ability of the Project Board to provide adequate strategic and technical oversight to the project.

Management Response: [Added: 2019/01/02] [Last Updated: 2019/01/02]

Relevant to: Project implementation & adaptive management, Sustainability

Key Actions:

Key Action Responsible DueDate Status Comments Documents
R8.1: Ensure the PB meets at least twice a year and more often if needed so that key project decisions are discussed and formally approved and recorded
[Added: 2019/01/02]
NPM § NPD § UNDP 2019/12 Not Initiated
R8.2: Increase emphasis of project planning, monitoring and reporting on delivery of higherlevel results and sustainable impacts
[Added: 2019/01/02]
1. PT/WCS, 2. UNDP 3. PB 2019/12 Not Initiated
R8.3: Clarify role and functions of the PMC including its relationship to the PB.
[Added: 2019/01/02]
1. NPM 2. NPD 3. UNDP 4. PB 2019/12 Not Initiated
R8.4: Clarify and document how TAGPA’s role and functions as intended in the original project design are to be met. (These functions are to serve as a mechanism for providing technical support on PAs to the project and thereafter to NWCD and to update national stakeholders about project progress and sharing lessons.) This includes: § Reviewing membership of TAGPA to identify and fill any gaps in expertise relevant to PA planning, establishment and management § Increasing efficiency by only involving a subset of relevant experts from TAGPA in technical consultations and events as needed on a case by case basis
[Added: 2019/01/02]
1. PT 2. NPD 3. FD 4. UNDP 2019/12 Not Initiated
R8.5: Ensure continuity in oversight of the project by UNDP and that the UNDP project focal point has the necessary technical and management skills to support the project effectively and to coordinate with government and other stakeholders.
[Added: 2019/01/02]
1. UNDP 2. PB 2019/06 Not Initiated
R8.6: Ensure all key strategic and adaptive management decisions regarding the project are formally approved and recorded at PB meetings (e.g the decision to scale back work at Hukaung Valley and Hkakaborazi.)
[Added: 2019/01/02]
1. WCS 2. UNDP 3. FD 4. PB 2019/06 Not Initiated
9. Recommendation:

Recommendation 9 (R9): Strengthen project adaptive management and staff capacities, particularly with respect to gender mainstreaming, M&E, technical reporting and communication to different stakeholder groups

Management Response: [Added: 2019/01/02] [Last Updated: 2019/01/02]

Relevant to: Project implementation & adaptive management, Outcomes 1 & 2, Sustainability
Responsible entities: NPM and other PT senior staff /WCS, UNDP

Key Actions:

Key Action Responsible DueDate Status Comments Documents
R9.1: Increase staff capacity for monitoring, critical analysis and reporting on higher-level results and impacts rather than activities.
[Added: 2019/01/02]
1. PT/WCS, 2. UNDP 3. PB 2019/06 Not Initiated
R9.2: Provide additional training to senior project staff on the different reporting requirements, formats and processes (PIRs, QRs, tracking tools, scorecards, risk monitoring, etc.) to increase their understanding and ownership of these processes
[Added: 2019/01/02]
1. PT / WCS 2. UNDP 2019/06 Not Initiated
R9.3: Strengthen project staff capacity to integrate gender considerations into project and to monitor and report on the impacts of this going beyond numbers of men and women participants at events.
[Added: 2019/01/02]
UNDP 2019/06 Not Initiated
R9.4: Develop a simple project M&E strategy based on the Results Framework for the remainder of the project and ensure that there is periodic monitoring and reporting against this by key project team members (the Landscape and Site and Assistant Site Coordinators and Thematic Team Leaders)
[Added: 2019/01/02]
1. NPM / WCS 2. NPD 3. UNDP 2019/06 Not Initiated
R9.5: Harmonize monitoring and reporting across different tools and processes including the PIRs, QRs, Risk Logs and Tracking Tools (i.e. the Capacity Development Scorecard, the Financial Sustainability Scorecard and the Management Effectiveness Tracking Tool)
[Added: 2019/01/02]
1. PT 2. UNDP 2019/06 Not Initiated
R9.6: Document lessons learned, best practices and develop some specific knowledge products based on project experiences in both English and Myanmar language.
[Added: 2019/01/02]
1. PT/WCS 2. UNDP 2020/12 Not Initiated
R9.7: Clarify roles and TORs of NPM and CTA in the project going forward, given changes in the circumstances of both
[Added: 2019/01/02]
1. WCS 2. UNDP 2019/06 Not Initiated
10. Recommendation:

Recommendation 10 (R10): Strengthen replication and scale-up of project results

Management Response: [Added: 2019/01/02] [Last Updated: 2019/01/02]

Relevant to: Sustainability
Responsible entities: PT/WCS, UNDP, FD

Key Actions:

Key Action Responsible DueDate Status Comments Documents
R10.1: Identify the socio-economic and political barriers to further expansion of the terrestrial PA system as well as potential strategies to overcome these, as well as new approaches and opportunities for PA establishment and management
[Added: 2019/01/02]
1. PT / WCS 2. NWCD / FD 3. NDP 2019/12 Not Initiated
R10.2 Identify mechanisms to integrate socioeconomic considerations alongside ecological criteria into PA planning, management and further expansion of the terrestrial PA system
[Added: 2019/01/02]
1. PT / WCS 2. NWCD / FD 3. UNDP 2019/12 Not Initiated
R10.3: Develop a project exit strategy that identifies options for continuing and scaling up key project results (e.g. on PA financing, SMART patrolling, Community Guards, Community Guardians, Community Forestry) at project demonstration sites and replicating successful strategies in other PAs.
[Added: 2019/01/02]
1. PT / WCS 2. UNDP 2019/12 Not Initiated

Latest Evaluations

Contact us

220 East 42nd Street
20th Floor
New York, NY 10017
Tel. +1 646 781 4200
Fax. +1 646 781 4213
erc.support@undp.org