Final Evaluation of the Strengthening climate information and early warning systems in Eastern and Southern Africa for climate resilient development and adaptation to climate change Zambia project

Report Cover Image
Evaluation Plan:
2016-2021, Zambia
Evaluation Type:
Final Project
Planned End Date:
03/2018
Completion Date:
11/2019
Status:
Completed
Management Response:
Yes
Evaluation Budget(US $):
60,000

Project Summary Table

This is a report for the UNDP-GEF Terminal Evaluation of the project “Strengthening climate information and early warning systems in Eastern and Southern Africa for climate resilient development and adaptation to climate change – Zambia (PIMS 5091). Project information is presented in Table 1-1.

Table 1-1 Project Information

 

Project Information

Project Title: Strengthening climate information and early warning systems in Eastern and Southern Africa for climate resilient development and adaptation to climate change – Zambia

Country

Zambia

Management Arrangement

NIM (National Implementation)

Executing Entity/Implementing Partner

Ministry of Transport and Communication (Zambia Meteorological Department)

Implementing Entity/Responsible Partners

Disaster Management and Mitigation Unit (DMMU), Department of Water Affairs (DWA)/Water Resource Management Authority (WRMA), Ministry of Agriculture and Livestock (MAL), Ministry of Health (MoH), Central Statistics Office (CSO), and Interim National Climate Change Secretariat (INCCS

GEF Focal Area: Climate Change

LDCF

Project Start Date (actual)

26 February 2014  

Project Start Date (planned)

September 2013

Project Closing Date

17 November 2017

PAC Meeting Date

31 July 2013

Atlas Award ID: 00074216 

Project ID: 00086729   

 

PIMS

 5901

GEF ID

 

Total Allocated Resources:  

US$ 17,131,947

 

 

GEF/LDCF                    US$   3,600,000

Government (In Kind)   US$   3,746,947

UNDP (Grant)               US$      600,000

UNDP (Cash)                US$      400,000

Other                             US$     8,785

Share

Document Type Language Size Status Downloads
Download document UNDP-GEF-Terminal-Evaluation-Terms-of-Reference-Template-2018.docx tor English 57.66 KB Posted 235
Download document Zambia UNDP-GEF PIMS5901 CIEWS Project Terminal Evaluation Draft Report 22.2.2019.docx summary English 3287.58 KB Posted 129
Download document PIMS5901_CIEWS_TE_Final_Report.pdf report English 2095.46 KB Posted 139
Title Final Evaluation of the Strengthening climate information and early warning systems in Eastern and Southern Africa for climate resilient development and adaptation to climate change Zambia project
Atlas Project Number: 00074216
Evaluation Plan: 2016-2021, Zambia
Evaluation Type: Final Project
Status: Completed
Completion Date: 11/2019
Planned End Date: 03/2018
Management Response: Yes
Focus Area:
  • 1. Environment & Sustainable Development
  • 2. Others
Corporate Outcome and Output (UNDP Strategic Plan 2014-2017)
  • 1. Output 1.4. Scaled up action on climate change adaptation and mitigation across sectors which is funded and implemented
SDG Goal
  • Goal 13. Take urgent action to combat climate change and its impacts
SDG Target
  • 13.2 Integrate climate change measures into national policies, strategies and planning
Evaluation Budget(US $): 60,000
Source of Funding: Project Budget, Donor
Evaluation Expenditure(US $): 23,780
Joint Programme: No
Joint Evaluation: No
Evaluation Team members:
Name Title Email Nationality
Nelson Gapare Mr
GEF Evaluation: Yes
GEF Project Title: Strengthening climate information and early warning systems in Eastern and Southern Africa for climate resilient development and adaptation to climate change Zambia project
Evaluation Type: Terminal Evaluation
Focal Area: Climate Change
Project Type: FSP
GEF Phase: GEF-5
GEF Project ID: 4995
PIMS Number: 5091
Key Stakeholders: Global Environmental Facility (GEF), Ministry of Lands, Natural Resources and Environmental Protection (MLNREP), Ministry of Agriculture (MoA), Priority Line Ministries, Civil Society organizations, Private Sector, and Other Cooperating Partners
Countries: ZAMBIA
Comments:

The project requested for a no-cost extension after the Mid-Term Evaluation which was conducted in 2016. The project is going to continue up to March 2018. Draft ToRs have been developed and have been circulated to stakeholders for review.

Lessons
Findings
Recommendations
1

 Data access and tailoring - it is noted that data is being shared through the daily and 10-day forecasts through radio, TV, and website and this is encouraged and should continue. In response to repeated feedback from stakeholders and partners, it is highly recommended that:  a. There is clarity in the form of clear guidelines or data access policies and procedures, including any applicable costs to enable institutions to include such costs in annual budgets.   b. Recognize the varying sectoral data needs and that some institutions may wish to undertake their own analysis. It is, therefore, highly recommended that ZMD works with the different sectors to establish clear user needs, types of data, frequency and establish suitable tailored data access and packaging

2

Maintenance and replacement of Automatic Weather stations: The support and investment provided under the CIEWS project will likely require substantial ongoing maintenance. The project intended to influence the government to increase the ZMD annual budget by almost 50%, but only achieved 28% after the four years of the project. Therefore, funding for the department remains inadequate. It is noted that the cost recovery model will enable ZMD to cover some of the operational costs. It is necessary to understand the full annual operating, maintenance, and replacement costs of the weather stations. The weather stations established under the project face the risk of rapidly deteriorating in functionality if not adequately maintained. It is highly recommended that:  a. A full assessment be undertaken to determine the annual operating, maintenance and replacement costs (where necessary) of the weather stations, at least for an initial period of 5 to 7 years.  b. From the assessment, identify funding shortfalls and prepare a funding strategy to address any shortfall. 

3

3. Capacity building- Staff at the district level raised the need for additional and ongoing capacity to continue engaging with local communities beyond the project life.  It is highly recommended that ZMD efforts continue to increase and enhance the critical mass to enable wider extension services and sectoral support to different sectors. The current efforts to seek cabinet office approval to establish high positions for those who have been trained and those to graduate should continue.  It is noted that the government human resource regulations states that staff members who are provided training are bonded to the department for the period of two years. However, additional efforts should be made to ensure that staff stay with the department beyond the two-year bonding period. Management 

4

 4: Sharing of lessons learned on good practice project approaches - This evaluation commended the baseline self-capacity assessment conducted during the project preparation phase, which guided the identification and prioritization of stakeholder needs. Equipment and capacity-building investments were selected based on identified priorities, as well as the available budget and focal areas of the CIEWS project. This is good practice and should be an important lesson to be shared with other institutions for formulation of future projects.  This evaluation highly recommends that:  a. In addition to the social media videos produced about the results and impact of the project, preparation of information briefs in good practice project implementation should be shared with all project partners.  

5

 5. Monitoring and Evaluation - The current methods of collecting M&E data are weak and inconsistent to enable longitudinal assessment of development support impact. As a systematic and long-term process, monitoring should continually gather information regarding the progress made by an implemented project. While evaluation is time specific and it is performed to judge whether a project has reached its goals and delivered what is expected according to its original plan.  M&E are also relevant to development partners and donors, who need to assess the reliability of partnerships and accountability upon which further collaborations could be established. This evaluation highly recommends that: - In future, develop an M&E system and reporting for planning and building a knowledge management and database. This can be linked, integrated, and interfaced with the existing government M&E system. This will enhance both management and institutional memory through proper reporting, record keeping and archiving at all central and local government levels, to allow for streamlined integrated database management as a pillar for effective Results-Based Monitoring & Evaluation/Management. 

Management Response Documents
1. Recommendation:

 Data access and tailoring - it is noted that data is being shared through the daily and 10-day forecasts through radio, TV, and website and this is encouraged and should continue. In response to repeated feedback from stakeholders and partners, it is highly recommended that:  a. There is clarity in the form of clear guidelines or data access policies and procedures, including any applicable costs to enable institutions to include such costs in annual budgets.   b. Recognize the varying sectoral data needs and that some institutions may wish to undertake their own analysis. It is, therefore, highly recommended that ZMD works with the different sectors to establish clear user needs, types of data, frequency and establish suitable tailored data access and packaging

Management Response: [Added: 2020/06/17]

The recommendation is in line with the required procedure of data access and tailoring 

Key Actions:

Key Action Responsible DueDate Status Comments Documents
1.1 Include access costs of information by stakeholders
[Added: 2020/06/17]
ZMD 2020/06 Completed There is a bill to transform the Zambia Meteorological Department (ZMD) into an Authority. The bill allows the Authority to provide cost recovery mechanisms for specialised information and services. The bill will be tabled in parliament for enactment in 2020
1.2 Develop sector specific information
[Added: 2020/06/17]
ZMD 2020/06 Completed ZMD started preparing sector specific information for agriculture in 2019. In 2020, they will include the water sector.
2. Recommendation:

Maintenance and replacement of Automatic Weather stations: The support and investment provided under the CIEWS project will likely require substantial ongoing maintenance. The project intended to influence the government to increase the ZMD annual budget by almost 50%, but only achieved 28% after the four years of the project. Therefore, funding for the department remains inadequate. It is noted that the cost recovery model will enable ZMD to cover some of the operational costs. It is necessary to understand the full annual operating, maintenance, and replacement costs of the weather stations. The weather stations established under the project face the risk of rapidly deteriorating in functionality if not adequately maintained. It is highly recommended that:  a. A full assessment be undertaken to determine the annual operating, maintenance and replacement costs (where necessary) of the weather stations, at least for an initial period of 5 to 7 years.  b. From the assessment, identify funding shortfalls and prepare a funding strategy to address any shortfall. 

Management Response: [Added: 2020/06/17]

Agreed - the recommendation is relevant as it will serve to enhance the sustainability and continuation of the generation of information in Zambia 

Key Actions:

Key Action Responsible DueDate Status Comments Documents
.1 conduct assessment to determine cost of operationalization, maintenance and replacement AWSs and prepare funding strategy.
[Added: 2020/06/17]
ZMD 2020/06 Completed Operations and maintenance strategy were developed as part of the formulation of the GCF project and implementation of the same has started
3. Recommendation:

3. Capacity building- Staff at the district level raised the need for additional and ongoing capacity to continue engaging with local communities beyond the project life.  It is highly recommended that ZMD efforts continue to increase and enhance the critical mass to enable wider extension services and sectoral support to different sectors. The current efforts to seek cabinet office approval to establish high positions for those who have been trained and those to graduate should continue.  It is noted that the government human resource regulations states that staff members who are provided training are bonded to the department for the period of two years. However, additional efforts should be made to ensure that staff stay with the department beyond the two-year bonding period. Management 

Management Response: [Added: 2020/06/17]

We agree with the recommendation to ensure long term investment in the sector 

Key Actions:

Key Action Responsible DueDate Status Comments Documents
3.1 Seek cabinet approval to unfreeze positions to be occupied by trained graduates.
[Added: 2020/06/17]
ZMD 2020/07 Completed As part of the restructuring, ZMD as indicated in 1.1 above, the bill in parliament would approve the structures needed for smooth operations of ZMD
3.2 Increase staff bondage to the department after training
[Added: 2020/06/17] [Last Updated: 2020/10/01]
ZMD 2020/12 Completed ZMD operates under the Human Resource Development (HRD) guidelines of the Government of the Republic of Zambia in which all sponsored staff are bonded for two years after training. This is done three months before staff proceed on study leave. History
4. Recommendation:

 4: Sharing of lessons learned on good practice project approaches - This evaluation commended the baseline self-capacity assessment conducted during the project preparation phase, which guided the identification and prioritization of stakeholder needs. Equipment and capacity-building investments were selected based on identified priorities, as well as the available budget and focal areas of the CIEWS project. This is good practice and should be an important lesson to be shared with other institutions for formulation of future projects.  This evaluation highly recommends that:  a. In addition to the social media videos produced about the results and impact of the project, preparation of information briefs in good practice project implementation should be shared with all project partners.  

Management Response: [Added: 2020/06/17]

During the project and with the current GCF successor project information briefs and good practices will be shared through the project publications   

Key Actions:

Key Action Responsible DueDate Status Comments Documents
4.1 Preparation of information briefs to be shared with project partners
[Added: 2020/06/17]
UNDP, ZMD 2020/06 Completed Project briefs were prepared and used to design the GCF project which is under implementation and shared to all stakeholders
5. Recommendation:

 5. Monitoring and Evaluation - The current methods of collecting M&E data are weak and inconsistent to enable longitudinal assessment of development support impact. As a systematic and long-term process, monitoring should continually gather information regarding the progress made by an implemented project. While evaluation is time specific and it is performed to judge whether a project has reached its goals and delivered what is expected according to its original plan.  M&E are also relevant to development partners and donors, who need to assess the reliability of partnerships and accountability upon which further collaborations could be established. This evaluation highly recommends that: - In future, develop an M&E system and reporting for planning and building a knowledge management and database. This can be linked, integrated, and interfaced with the existing government M&E system. This will enhance both management and institutional memory through proper reporting, record keeping and archiving at all central and local government levels, to allow for streamlined integrated database management as a pillar for effective Results-Based Monitoring & Evaluation/Management. 

Management Response: [Added: 2020/06/17] [Last Updated: 2020/06/17]

We are agree with the recommendation

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Develop M & E system
[Added: 2020/06/17]
UNDP, ZMD 2020/12 Completed The M&E system has been developed as part of the GCF project

Latest Evaluations

Contact us

1 UN Plaza
DC1-20th Floor
New York, NY 10017
Tel. +1 646 781 4200
Fax. +1 646 781 4213
erc.support@undp.org