Midterm Evaluation of Climate Change Adaptation and Mitigation Project

Report Cover Image
Evaluation Plan:
2018-2022, Pakistan
Evaluation Type:
Mid Term Project
Planned End Date:
11/2021
Completion Date:
12/2021
Status:
Completed
Management Response:
Yes
Evaluation Budget(US $):
10,000

Share

Document Type Language Size Status Downloads
Download document CCAM-Evaluation TOR QA Checklist- Final.docx.pdf related-document English 674.48 KB Posted 522
Download document Approved-UNDP-MTR-TORs-CCAM-II.docx tor English 92.06 KB Posted 528
Download document CCAM-II MTR - Final Report - SG 01 Dec 2021-2.pdf report English 3564.64 KB Posted 516
Title Midterm Evaluation of Climate Change Adaptation and Mitigation Project
Atlas Project Number: 00075411
Evaluation Plan: 2018-2022, Pakistan
Evaluation Type: Mid Term Project
Status: Completed
Completion Date: 12/2021
Planned End Date: 11/2021
Management Response: Yes
Focus Area:
  • 1. Sustainable
  • 2. Others
Corporate Outcome and Output (UNDP Strategic Plan 2018-2021)
  • 1. Output 1.4.1 Solutions scaled up for sustainable management of natural resources, including sustainable commodities and green and inclusive value chains
  • 2. Output 2.4.1 Gender-responsive legal and regulatory frameworks, policies and institutions strengthened, and solutions adopted, to address conservation, sustainable use and equitable benefit sharing of natural resources, in line with international conventions and national legislation
SDG Goal
  • Goal 1. End poverty in all its forms everywhere
  • Goal 12. Ensure sustainable consumption and production patterns
  • Goal 13. Take urgent action to combat climate change and its impacts
  • Goal 15. Protect, restore and promote sustainable use of terrestrial ecosystems, sustainably manage forests, combat desertification, and halt and reverse land degradation and halt biodiversity loss
SDG Target
  • 1.5 By 2030, build the resilience of the poor and those in vulnerable situations and reduce their exposure and vulnerability to climate-related extreme events and other economic, social and environmental shocks and disasters
  • 12.2 By 2030, achieve the sustainable management and efficient use of natural resources
  • 12.4 By 2020, achieve the environmentally sound management of chemicals and all wastes throughout their life cycle, in accordance with agreed international frameworks, and significantly reduce their release to air, water and soil in order to minimize their adverse impacts on human health and the environment
  • 13.1 Strengthen resilience and adaptive capacity to climate-related hazards and natural disasters in all countries
  • 13.2 Integrate climate change measures into national policies, strategies and planning
  • 15.2 By 2020, promote the implementation of sustainable management of all types of forests, halt deforestation, restore degraded forests and substantially increase afforestation and reforestation globally
Evaluation Budget(US $): 10,000
Source of Funding:
Evaluation Expenditure(US $): 9,104
Joint Programme: No
Joint Evaluation: No
Evaluation Team members:
Name Title Email Nationality
Shirin Gul Mis sgulsadozai@gmail.com PAKISTAN
GEF Evaluation: No
Key Stakeholders:
Countries: PAKISTAN
Lessons
Findings
Recommendations
1

Review the project TOC, particularly change pathways, to clarify the results chain and outcomes sought. Refine indicators to remove duplication and clarify the difference between outcomes and outputs. Ensure alignment between the TOC and RF for more clarity on the project strategy and the manner in which outcomes sought are to be monitored, tracked and achieved

2

Develop a work plan narrative to tie together thematic threads and activity level details, and to capture synergies from different workstreams, project partners and responsible parties. This will help to re-centre the work plan as the driver for implementation.

3

Develop a comprehensive value-added MEL plan incorporating the following elements: (i) direct beneficiary feedback tools, (ii) systems and tools to collect information and data on outcome level indicators (i.e., not restricting regular reporting to activities and outputs), and (iii) explicitly integrating learning into M&E.

4

Conduct climate and disaster vulnerability risk assessments related to gender, vulnerable groups, and youth (see Finding 23 on gender-disaggregated data)

5

Continue support provided under CCAM-II to fill critical gaps identified by project stakeholders. This support will be essential to consolidate the gains of the project in the current phase and help UNDP position itself better as the emphasis on climate resilience increases in Pakistan

6

Refine the criteria for selection of thematic areas to focus on fewer, more strategic workstreams so as not to dilute the project’s impact in adaptation and resilience related work, particularly if UNDP seeks to emerge as a key player and thought leader on climate resilience in Pakistan.

7

7-Define clearly in the project strategy the way in which different workstreams are expected to interact to bring about outcome level change. This should also be reflected in TOC causal relationships. RF indicators should capture the intermediate level of change to better document output results and contribution to outcome level change.

8

8-Expand the scope of activities supported for strengthening community level climate resilience, moving towards climate proofing of community infrastructure (e.g., sea walls) and the protection of local livelihoods and assets (e.g., social protection, disaster insurance).

Management Response Documents
1. Recommendation:

Review the project TOC, particularly change pathways, to clarify the results chain and outcomes sought. Refine indicators to remove duplication and clarify the difference between outcomes and outputs. Ensure alignment between the TOC and RF for more clarity on the project strategy and the manner in which outcomes sought are to be monitored, tracked and achieved

Management Response: [Added: 2022/01/20]

TOC has already been modified after inclusion of construction activities under Tsunami component. However, it will further be modified to be more aligned with the outcomes and indicators. Additionally, alignment with UNDP SP 2022-25 will be ensured.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
1.1 Review the project TOC particularly change pathways, to clarify the results chain and outcomes sought
[Added: 2022/01/20] [Last Updated: 2022/04/03]
PMU UNDP 2022/05 Initiated The action has been initiated. Will submit the evidence by May 15, 2022 History
1.2 Alignment of indicators with UNDP SP 2022-25/CPD 2022-2027 for more clarity on the project strategy and the manner in which outcomes sought are to be monitored, tracked and achieved
[Added: 2022/01/20] [Last Updated: 2022/04/03]
PMU-UNDP 2022/05 Initiated The action has been initiated and will be finalized by May 15, 2022 History
2. Recommendation:

Develop a work plan narrative to tie together thematic threads and activity level details, and to capture synergies from different workstreams, project partners and responsible parties. This will help to re-centre the work plan as the driver for implementation.

Management Response: [Added: 2022/01/20]

Action has already been initiated in the work plan (Action 1.1.3c) on jointly carrying out thematic area interventions in collaboration with partners. In addition, the project will develop a narrative demonstrating the engagement of partners in different thematic interventions and linking activities in various geographic areas.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
2.1 Develop a comprehensive narrative, reviewing the ongoing engagements and planned interventions of other development partners which are as per the mandate of the govt and have the potential for govt ownership
[Added: 2022/01/20] [Last Updated: 2022/04/03]
PMU-UNDP 2022/05 Initiated the task has been initiated and will be finalized by mid May History
3. Recommendation:

Develop a comprehensive value-added MEL plan incorporating the following elements: (i) direct beneficiary feedback tools, (ii) systems and tools to collect information and data on outcome level indicators (i.e., not restricting regular reporting to activities and outputs), and (iii) explicitly integrating learning into M&E.

Management Response: [Added: 2022/01/20]

Outcome level reporting is done annually in the project’s APR. This data is reported by the CO in ROAR (Result Oriented Action Report). However, to further address the recommendation, the project will ensure that all learning emanating from field visits and direct beneficiary tracking is in monitoring reports, and success stories are developed biannually and disseminated through relevant communication channels

Key Actions:

Key Action Responsible DueDate Status Comments Documents
3.1 Develop success stories of project interventions biannually
[Added: 2022/01/20]
PMU-UNDP 2022/06 Not Initiated
3.2 Develop a tracking system to track and record beneficiary data as and when required
[Added: 2022/01/20]
PMU-UNDP 2022/06 Not Initiated
4. Recommendation:

Conduct climate and disaster vulnerability risk assessments related to gender, vulnerable groups, and youth (see Finding 23 on gender-disaggregated data)

Management Response: [Added: 2022/01/20]

A risk assessment has already been conducted in Q1 of 2020 in the target districts using the specified eight tools for data collection related to hazards, vulnerability, and the coping capacities of communities. Based on the findings, targeted interventions will be carried out in areas most vulnerable to address the identified gaps.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
4.1 Conduct Climate and Disaster Vulnerability Risk Assessment
[Added: 2022/01/20]
PMU 2021/12 Completed Target areas were Malir and Keamari in Sindh and Gwadar in Balochistan. The report is attached as evidence
4.2 Carry out targeted interventions in identified areas (i.e. installation of early warning systems, capacity building of target population, develop a DRM plans) based on assessment findings. This is contingent upon the availability of funds. In case of no funds, the activities will be earmarked for compliance in 2023.
[Added: 2022/01/20]
PMU-UNDP 2022/07 Not Initiated
5. Recommendation:

Continue support provided under CCAM-II to fill critical gaps identified by project stakeholders. This support will be essential to consolidate the gains of the project in the current phase and help UNDP position itself better as the emphasis on climate resilience increases in Pakistan

Management Response: [Added: 2022/01/20]

Since the recommendation is to continue the institutional support to the government for another 1-3 years therefore the project will revise its strategy and align the work plans for the next 3 years with the new CPD

Key Actions:

Key Action Responsible DueDate Status Comments Documents
5.2 Process extension of CCAM-II project for another three years and align it with SP 2022-2025
[Added: 2022/01/20] [Last Updated: 2022/05/08]
PMU-UNDP 2022/04 Completed the new phase of the project has just started as CCAM-III which is aligned to the new SP 2022-2025 History
5.1 Finalize strategy for the next phase of the project with a focused scope, in line with the new CPD
[Added: 2022/01/20]
PMU-UNDP 2022/07 Not Initiated
6. Recommendation:

Refine the criteria for selection of thematic areas to focus on fewer, more strategic workstreams so as not to dilute the project’s impact in adaptation and resilience related work, particularly if UNDP seeks to emerge as a key player and thought leader on climate resilience in Pakistan.

Management Response: [Added: 2022/01/20]

This recommendation will be taken into consideration when designing the next phase of the project. The strategy document to be prepared at that stage will also outline a refined criterion for the selection of themes. Action against this recommendation will therefore be the same as Action 5.1 (see above). No separate action will be undertaken to address this recommendation.

Key Actions:

7. Recommendation:

7-Define clearly in the project strategy the way in which different workstreams are expected to interact to bring about outcome level change. This should also be reflected in TOC causal relationships. RF indicators should capture the intermediate level of change to better document output results and contribution to outcome level change.

Management Response: [Added: 2022/01/20]

The TOC will be revised in the prodoc to reflect the causal relationship between the workstreams and outcomes.  Therefore, the indicators cannot be changed at this point but the recommendation will be addressed more holistically in the strategy development process for the next phase.

Key actions emanating from this recommendation are the same as 1.1 and 5.1. No new actions will be undertaken to address the recommendation

Key Actions:

8. Recommendation:

8-Expand the scope of activities supported for strengthening community level climate resilience, moving towards climate proofing of community infrastructure (e.g., sea walls) and the protection of local livelihoods and assets (e.g., social protection, disaster insurance).

Management Response: [Added: 2022/01/20]

Currently, the scope of project is limited in terms of tsunami initiatives, however there is a potential to scale up the nature and scope of activities in the next phase. For example, under CCAM-II’s blue economy initiative, feasibility studies will be conducted to explore the need, potential and impact of advanced climate resilience interventions in disaster risk areas. The action step will therefore be the same as 5.1 and thus no need to develop another action; the recommendation will be considered while designing the strategy for the next phase of the project.

Key Actions:

Latest Evaluations

Contact us

1 UN Plaza
DC1-20th Floor
New York, NY 10017
Tel. +1 646 781 4200
Fax. +1 646 781 4213
erc.support@undp.org