Mid term evaluation for the 'Building Adaptive Capacity and resilience to climate change in water sector' project

Report Cover Image
Evaluation Plan:
2012-2017, Cape Verde
Evaluation Type:
Mid Term Project
Planned End Date:
09/2013
Completion Date:
09/2013
Status:
Completed
Management Response:
Yes
Evaluation Budget(US $):
20,000

Share

Document Type Language Size Status Downloads
Download document MidTerm_Review_NAPA_final.pdf tor English 623.25 KB Posted 745
Download document FINAL report - CV LDCF water sector MTR_130913-AC.pdf report English 3158.39 KB Posted 804
Title Mid term evaluation for the 'Building Adaptive Capacity and resilience to climate change in water sector' project
Atlas Project Number: 00058253
Evaluation Plan: 2012-2017, Cape Verde
Evaluation Type: Mid Term Project
Status: Completed
Completion Date: 09/2013
Planned End Date: 09/2013
Management Response: Yes
Focus Area:
  • 1. Environment & Sustainable Development
Corporate Outcome and Output (UNDP Strategic Plan 2014-2017)
  • 1. Development plans and programmes integrate environmentally sustainable solutions in a manner that promotes poverty reduction, MDG achievement and low-emission climate-resilient development
  • 2. National and local governments and communities have the capacities to adapt to climate change and make inclusive and sustainable environment & energy decisions benefitting in particular under-served populations
Evaluation Budget(US $): 20,000
Source of Funding: GEF
Joint Programme: No
Joint Evaluation: No
Evaluation Team members:
Name Title Email Nationality
Juliane Zeidler Team leader j.zeidler@iecn-namibia.com
Carlos Monteriro carlos.monteiro@mdr.gov.cv
GEF Evaluation: Yes
Evaluation Type:
Focal Area: Climate Change
Project Type: EA
GEF Phase: GEF-4
PIMS Number: 4091
Key Stakeholders:
Countries: CAPE VERDE
Lessons
Findings
Recommendations
1 Focus remaining project time and resources on leveraging maximum impacts towards the project objective Key Actions recommended: Carry out re-planning asap with entire project team Develop work plans for each team member remaining project period, taking into account the MTR recommendations on documenting and synthesizing project learning Finalize low-hanging fruits ? drop others Reallocate remaining funding as possible
2 Adjust SRF and LFA (specific indicators and output change); disaggregate indicators for outcome 2 further; include gender dimension Key Actions recommended: Update SRF and LFA a proposed Develop data inputs for TE (see below accordingly)
3 Document and synthesize adaptation learning, best practices and policy relevant messaging from project intervention Key actions recommended: For all outcomes document the key learning in detail and for appropriate target groups Synthesis results should inform the commencing CIDA climate change project intervention, Sort all relevant project documentation for Knowledge Management purposes and post on website, possible have a ?intra? and an ?internet? option to it Document more ALM stories in line with key best practices identified
4 Process project learning and esp. the INIDA report and the technical consultancies into relevant information packages for specific target groups, i.e. technical staff of various Ministries and Municipalities, outreach personnel, local communities Key actions recommended:  Identify key target groups in need of further support (materials) for adaptation learning from project Develop strategy for material and approach development Specifically develop materials and approach for further up-scaling and replication especially by INGRH, MAHOT and MDR Suggested target groups include: technical staff at key ministries, local communities
5 Support the Aloe Vera commercialization opportunity Key actions recommended: Compile a briefing on the commercialization opportunities and barriers Set out a plan of action for furthering this approach and opportunity Share understanding with LCs and communities that have been involved with Aloe Vera planting
6 Develop strategy for integrating key project learning into opportune policy processes Key actions recommended: Systematically identify key messages for policy level intervention, stemming from project learning Identify key policy opportunities e.g. PEDA review 2013; PRSP/DEPRP 2016, PENAS ? at draft stage up to 2030, new proposed institutional set up in water sector, ongoing Municipal and regional level plans, amongst other Prepare specific briefings for each on relevant messages from project learning
7 Convene another final high-level decision-makers event during which the key learning and policy messages stemming from the project learning are being shared. Make a splash! Key actions recommended: Based on content analysis develop compelling briefing programme and event Convene event
8 Invest into website and develop as Knowledge Management hub from project Key actions recommended: Develop website concept as Knowledge Management opportunity Integrate learning documented from all the above actions Develop ?archive? of project documents mostly for ?internal? use No need to brand the site as ?project?, but rather as adaptation learning forum e.g. linked to INGRH website (even if the institutions will likely be restructured) ; look or other opportunities Develop ?sustainability? strategy for website management after project end
9 Verify VRA methodology, design and conduct final VRA Key actions recommended: Review the two VRAs that were already undertaken Develop one integrated methodology for final replication before TE Design and conduct final VRA
10 Prepare for Terminal Evaluation Key actions recommended: From an early stage start preparing for TE Prepare the documentation and make available for evaluation team in the most professional manner prior to country assessment
1. Recommendation: Focus remaining project time and resources on leveraging maximum impacts towards the project objective Key Actions recommended: Carry out re-planning asap with entire project team Develop work plans for each team member remaining project period, taking into account the MTR recommendations on documenting and synthesizing project learning Finalize low-hanging fruits ? drop others Reallocate remaining funding as possible
Management Response: [Added: 2014/08/14]

This recommendation has been accepted. Under leadership of the new project coordinator a more detailed team member work plan has been carried out and will be continued for the remaining phase of the project. Additionally, revision on activity and budget planning was carried out to capitalize on lessons learnt and reconsider pending activities against remaining duration and available technical capacities. Some activities were postponed or transferred to a second phase of the project that will be completed with CIDA ( Canadian international development agency) funds; others were withdraw considering recommendations to refocus on some type of interventions to avoid dispersion and increase impact After budget and activity revision, community demo projects to optimize adaptation impacts according to project expected outcomes has been received and appraised against criteria previously agreed by Technical committee. Selection criteria were made explicit with technical committee inputs to allow for a more transparent beneficiary selection that continues to integrate local advisory committees? recommendations and expert?s technical opinion.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
? Complete work planning for finalization phase ? Document criteria application and evaluation results for community demo projects selection ? Ensure monitoring of activities and impacts of demo projects approved.
[Added: 2014/08/14]
PCU, especially national and regional coordinators. 2014/01 No Longer Applicable Completed
2. Recommendation: Adjust SRF and LFA (specific indicators and output change); disaggregate indicators for outcome 2 further; include gender dimension Key Actions recommended: Update SRF and LFA a proposed Develop data inputs for TE (see below accordingly)
Management Response: [Added: 2014/08/14]

This recommendation has been accepted. New indicator proposed and reformulations on output redaction have been accepted since is considered they bring additional clarity to the monitoring framework without creating additional difficulties in measurement. Baseline values for the new indicator proposed for outcome 3 are of qualitative nature and are known for the project inception. Data inputs started to be systematized to allow for adequate measurement of indicators. A final survey is planned to collect data on water use efficiency indicators.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
? Update SRF on project monitoring tools ? Complete survey and organize data from inception and final survey on water use efficiency
[Added: 2014/08/14]
UNDP CO PCU 2014/01 Completed
3. Recommendation: Document and synthesize adaptation learning, best practices and policy relevant messaging from project intervention Key actions recommended: For all outcomes document the key learning in detail and for appropriate target groups Synthesis results should inform the commencing CIDA climate change project intervention, Sort all relevant project documentation for Knowledge Management purposes and post on website, possible have a ?intra? and an ?internet? option to it Document more ALM stories in line with key best practices identified
Management Response: [Added: 2014/08/14]

This recommendation has been adopted. The communication and knowledge management specialist has been instructed to work on a spatial database, using GIS, to capture project intervention and community impacts of them in order to prepare for systematization on lessons learned and best practices.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
? Complete database on project interventions to better capitalize and systematize lessons learned and best practices.
[Added: 2014/08/14]
PCU 2014/01 Completed
4. Recommendation: Process project learning and esp. the INIDA report and the technical consultancies into relevant information packages for specific target groups, i.e. technical staff of various Ministries and Municipalities, outreach personnel, local communities Key actions recommended:  Identify key target groups in need of further support (materials) for adaptation learning from project Develop strategy for material and approach development Specifically develop materials and approach for further up-scaling and replication especially by INGRH, MAHOT and MDR Suggested target groups include: technical staff at key ministries, local communities
Management Response: [Added: 2014/08/14]

This recommendation is judged critical and has been adopted. Great emphasis has been put with INIDA to involve all their technical experts in reviewing the technological packages before dissemination. Technical packages compile best practices and give concrete orientations to rural extension workers and farmers. Some key actions recommended, to package information in a more relevant and applicable way for policy and decision makers have been specially considered for the second phase of the project (CIDA funded project) considering time limitations under this phase framework. The information and tools will be adapted to specific planning mechanism, process and timelines and feedback from planners will be pursued to ensure they respond to their needs and competencies.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
? Complete edition of technical package, review and test with rural extension workers before printing. ? Test usability and acceptability by planners and decisions makers on drafted guidelines for climate change risks mainstreaming on planning, budgeting and monitoring. ? Maintain and enrich technical committee for CIDA-funded project phase to ensure policy knowledge and instruments relevant for each sector are developed.
[Added: 2014/08/14]
PCU INIDA Technical Committee MDR 2014/01 Completed
5. Recommendation: Support the Aloe Vera commercialization opportunity Key actions recommended: Compile a briefing on the commercialization opportunities and barriers Set out a plan of action for furthering this approach and opportunity Share understanding with LCs and communities that have been involved with Aloe Vera planting
Management Response: [Added: 2014/08/14]

This recommendation is considered, but due to time restrictions cannot be fully adopted. Some contacts were established with private partners interested in aloe vera transformation opportunities. However, the study on ?Gender and varieties potentials analysis and field tests? planned to support market analysis and business plan for commercialization opportunities was postponed due to time and technical staff limitations to conduct. However, it will be considered within the research program planned for the second phase of the project with INIDA. This research component has been designed with the MTR recommendation in mind to strengthen evidence base adaptation planning.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
? Include aloe vera research questions on the CIDA project research component
[Added: 2014/08/14]
UNDP CO and INIDA 2014/01 Completed
6. Recommendation: Develop strategy for integrating key project learning into opportune policy processes Key actions recommended: Systematically identify key messages for policy level intervention, stemming from project learning Identify key policy opportunities e.g. PEDA review 2013; PRSP/DEPRP 2016, PENAS ? at draft stage up to 2030, new proposed institutional set up in water sector, ongoing Municipal and regional level plans, amongst other Prepare specific briefings for each on relevant messages from project learning
Management Response: [Added: 2014/08/14]

This recommendation is considered and has been partially adopted. Planning orientations, on the form of Municipal development plans addenda, have been prepared and shared with municipal planners and land use planning department for consideration. Technical orientations for planners and decisions makers on climate change risk and opportunities mainstreaming have been drafted to be used as a basis for a ministerial Directive Acknowledging the fact that mainstreaming guidelines remain still difficult to be utilized by planners, due to high turnover rate and capacity gaps, technical assistance for capacity reinforcement on developing concrete tools and applying them for different planning levels, budgeting and plans and programs monitoring has been considered on the strategy for the second phase of the project. Project technical staff, due to capacity gaps, had some difficulties on developing relevant policy briefing for some sectors. Considering time and capacity limitations it was considered within the second phase strategy to mobilize specific technical assistance and expertise to provide support for sector planners to identify relevant information needs and tools required for their planning, budgeting, monitoring and evaluation activities.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
? Conclude with juridical services and advisor of the Environment Ministry the Ministerial Directive
[Added: 2014/08/14]
PCU & MAHOT 2014/01 Completed
7. Recommendation: Convene another final high-level decision-makers event during which the key learning and policy messages stemming from the project learning are being shared. Make a splash! Key actions recommended: Based on content analysis develop compelling briefing programme and event Convene event
Management Response: [Added: 2014/08/14]

A final event with decision makers on mainstreaming climate change risks and opportunities in planning documents and policies is planned for the final phase of the project.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
? Plan event and prepare robust briefing and relevant materials to be disseminated
[Added: 2014/08/14]
PCU 2014/01 Completed
8. Recommendation: Invest into website and develop as Knowledge Management hub from project Key actions recommended: Develop website concept as Knowledge Management opportunity Integrate learning documented from all the above actions Develop ?archive? of project documents mostly for ?internal? use No need to brand the site as ?project?, but rather as adaptation learning forum e.g. linked to INGRH website (even if the institutions will likely be restructured) ; look or other opportunities Develop ?sustainability? strategy for website management after project end
Management Response: [Added: 2014/08/14]

This recommendation was adopted by the technical committee and a project website was developed. Additionally, a great emphasis has been placed on knowledge dissemination and communication, through the preparation of trimester news bulletin, collection and systematization on data on project interventions and press notes sent to local media. Project information was updated on the UNDP ALM (Adaptation Learning Mechanism) and news and updates shared with communications specialist at UNDP CO and Ministry of Environment.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
? Finalize maps and database on project impact ? Systematize lessons learned; including as well aspects that could be improved with an analysis on the reasons why some approaches did not work or how could have been done better. ? Sustainability strategy for website management, as an adaptation content management system linked to the national environmental information system to be completed.
[Added: 2014/08/14]
PCU MAHOT & UNDP CO 2014/01 Completed
9. Recommendation: Verify VRA methodology, design and conduct final VRA Key actions recommended: Review the two VRAs that were already undertaken Develop one integrated methodology for final replication before TE Design and conduct final VRA
Management Response: [Added: 2014/08/14]

The recommendation was discussed at committee meetings and adopted. It was clarified that VRA application within the framework of SGP/GEF project had another target group and was intended to capture vulnerability perception of landowners. For comparability reasons, same target group (farmers and residents) was used for the second application.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
? Clarify methodology applied for all VRA exercises and how index was calculated and comparability with previous VRA exercise
[Added: 2014/08/14]
PCU, specials Capacity Development and Policy technical assistant 2014/01 Completed
10. Recommendation: Prepare for Terminal Evaluation Key actions recommended: From an early stage start preparing for TE Prepare the documentation and make available for evaluation team in the most professional manner prior to country assessment
Management Response: [Added: 2014/08/14]

This recommendation is agreed. In order to allow time for some activities finalization and appropriate preparation for Terminal Evaluation a project extension of 3 months (January to March 2014) has been granted to the originally planned project duration. Steering committee has to confirm staff that will be maintained until the end of this extension to receive and guide external evaluators. Considering the limited time spam between midterm and final evaluation Country office has resolved to include in the terms of reference for Final evaluation some additional responsibilities regarding the initial review of Logical Framework, strategy and activity plan for the 2nd phase ( CIDA-financed ) of the project

Key Actions:

Key Action Responsible DueDate Status Comments Documents
? Finalize and share with Committee members and technical staff terms of Reference for terminal evaluation Considering the project co-financed some community base adaptation projects sponsored by the SGP-UNDP/GEF program, the appraisal of the impact of these interventions will be also included for final evaluation revision.
[Added: 2014/08/14]
PCU& UNDP CO 2014/01 Completed

Latest Evaluations

Contact us

1 UN Plaza
DC1-20th Floor
New York, NY 10017
Tel. +1 646 781 4200
Fax. +1 646 781 4213
erc.support@undp.org