Solomon Islands Water Sector Adaptation Project Mid-Term Evaluation

Report Cover Image
Evaluation Plan:
2013-2017, Fiji
Evaluation Type:
Mid Term Project
Planned End Date:
12/2017
Completion Date:
10/2017
Status:
Completed
Management Response:
Yes
Evaluation Budget(US $):
50,000

Share

Document Type Language Size Status Downloads
Download document 4568_SIWSAP MTR_report_15May2017_finalR.pdf report English 2256.68 KB Posted 598
Download document SIWSAP TOR Final Evaluation.pdf tor English 801.11 KB Posted 292
Title Solomon Islands Water Sector Adaptation Project Mid-Term Evaluation
Atlas Project Number: 00088631
Evaluation Plan: 2013-2017, Fiji
Evaluation Type: Mid Term Project
Status: Completed
Completion Date: 10/2017
Planned End Date: 12/2017
Management Response: Yes
Focus Area:
  • 1. Environment & Sustainable Development
  • 2. Others
Corporate Outcome and Output (UNDP Strategic Plan 2014-2017)
  • 1. Output 1.1. National and sub-national systems and institutions enabled to achieve structural transformation of productive capacities that are sustainable and employment - and livelihoods- intensive
  • 2. Output 1.4. Scaled up action on climate change adaptation and mitigation across sectors which is funded and implemented
Evaluation Budget(US $): 50,000
Source of Funding: GEF Financing
Evaluation Expenditure(US $): 45,734
Joint Programme: No
Joint Evaluation: No
Evaluation Team members:
Name Title Email Nationality
James Lenoci Team leader/ International Consultant
Linda Vaike National Consultant
GEF Evaluation: Yes
GEF Project Title: Solomon Islands Water Sector Adaptation Project
Evaluation Type: Mid-term Review
Focal Area: Climate Change
Project Type: FSP
GEF Phase: GEF-5
GEF Project ID: 4725
PIMS Number: 4568
Key Stakeholders: EMinistry of Mines, Energy and Rural Electrification- Water Resources Division, Ministry of Environment, Climate Change Disaster management and Meteorology, Ministry of Health and Medical Services-Environmental Health Division, Ministry of Development Planning and Aid Coordination
Countries: FIJI
Lessons
Findings
Recommendations
1

Define and communicate adaptation benefits generated by the project 

2

Clarify project organisation and reporting procedures, and improve collaboration with government and non-government partners. 

3

Articulate a justification for a time extension

4

Recruit technical Advisory Support

5

Develop an adaptive management approach for engaging provincial level adaptation planning processes 

6

Incorporate integrated water resource management (IWRM) into adaptation plans

7

Implement a thematic based procurement strategy, starting with interventions that are most prepared 

8

Advocate implementation of improved sanitation demonstrations  at relevant project sites

9

Arrange trial installation and operation of two of the desalination units. 

10

Address broader human security issues in project interventions

11

Strengthen project monitoring &evaluation and management systems

1. Recommendation:

Define and communicate adaptation benefits generated by the project 

Management Response: [Added: 2018/09/16] [Last Updated: 2018/09/19]

The project has Agreed.The project has taken necessary steps to further strengthen the development of communication tools with MECDM’s CCA communication officer (The officer has been away for in 2016 and has recently resume duties in year 2017).

Key Actions:

Key Action Responsible DueDate Status Comments Documents
An integrated approach strengthens resilience. Most of the project interventions are closely linked; including increased and diversified water supply, improved sanitation, improved waste management, early warning systems and response, etc.
[Added: 2018/09/19] [Last Updated: 2020/06/08]
PMU, MECDM, MMERE, MHMS-EHD, MDPAC 2020/02 Completed Completed in terms of increasing and diversified water supply in all sites, improved sanitation for one of the site and improved waste management in one site. History
Broadened dialogue and coordination across sections and between sub-national and national administrative levels results in more safeguards in place.
[Added: 2018/09/19] [Last Updated: 2020/06/08]
PMU, MECDM, MMERE, MHMS-EHD, MDPAC 2020/02 Completed Dialogue and coordination broadened across sections between sub national and national administrative levels resulting in more safeguards in place. This is in terms of broadening dialogues between provincial governments and national governments to generate more safeguards to achieving resilience to water resources. History
Increased public access to information also strengthens resilience.
[Added: 2018/09/19] [Last Updated: 2020/06/08]
PMU, MECDM, MMERE, MHMS-EHD, MDPAC 2020/02 Completed Public access to information in the pilot and replicate sites which strengthens resilience to water resources. History
Reduced risk of potential loss and damage associated with the adverse effects of climate change, through expansion.
[Added: 2018/09/19] [Last Updated: 2020/06/08]
PMU, MECDM, MMERE, MHMS-EHD, MDPAC, SINU 2020/02 Completed Reduced risk of potential loss and damage associated with the adverse effects of climate change through expansion achieved. History
2. Recommendation:

Clarify project organisation and reporting procedures, and improve collaboration with government and non-government partners. 

Management Response: [Added: 2018/09/16] [Last Updated: 2018/09/19]

The project agree but noting synergies with projects were identified during the inception workshop and ongoing one to one consultation with ongoing similar projects (CRISP,RDP, Red Cross, ADRA, World Vision, Caritas, Water Aid etc)

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Define roles and responsibilities of Responsible Parties in one or more letter of agreement.
[Added: 2018/09/19] [Last Updated: 2020/06/08]
PMU, MMERE, MHMS-EHD, MDPAC, Provincial Governments, UNDP 2020/02 Completed Roles and responsibilities of responsible parties defined in a revised letter of agreement. History
Organize a workshop with other projects and programmes, identifying synergies and development specific partnership arrangements
[Added: 2018/09/19] [Last Updated: 2020/06/08]
PMU, MMERE, MHMS-EHD, MDPAC, Provincial Governments, UNDP 2020/02 Completed Workshops organised which involves identifying synergies and development of partnerships arrangements for delivering resilience water adaptation measures to pilot and replicate sites. History
Strengthen existing governance structures, including the National Climate Change Working Group (CCWG) and the National Inter-sectoral Water Coordination Committee (NIWCC).
[Added: 2018/09/19] [Last Updated: 2020/06/08]
PMU, MMERE, MHMS-EHD, MDPAC, Provincial Governments, UNDP 2020/02 Completed SIWSAP worked with existing governance structures including the CCWG,NIWCC and others such as the RWASH stakeholders group to improve coordination with both government and non-government partners. History
3. Recommendation:

Articulate a justification for a time extension

Management Response: [Added: 2018/09/19]

Noted, the request of the no-cost extension will be tabled at the board meeting in July 2017 based on the recommendations of the MTR.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Based upon progress towards results achieved by midterm, it is highly unlikely that the envisaged end of project results will be realized within the allocated implementation time frame. In the opinion of the MTR team, a 12-month no-cost extension would be required to fulfil the activities slated for the second half of the project, including implementing the recommendations set forth in this MTR report. Justification for a possible time extension should be articulated accordingly. Generating adaptation benefits takes time, and the original 4-year timeframe was insufficient to adequately build up the requisite enabling conditions. Also, there is a high risk of operational failure of certain systems without sufficient monitoring and evaluation oversight in the early phases of implementation.
[Added: 2018/09/19] [Last Updated: 2020/06/08]
PMU, UNDP, MMERE, Project Board 2020/02 Completed A no-cost extension for the project was granted, and the project end date was 30 June 2019. History
4. Recommendation:

Recruit technical Advisory Support

Management Response: [Added: 2018/09/19]

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Overseeing integrated water resource management planning
[Added: 2018/09/19] [Last Updated: 2020/06/08]
PMU, UNDP, MMERE 2020/02 Completed Integrated water resource management planning were included in the vulnerability assessments conducted for the targeted sites. History
Reviewing engineering feasibility and cost-benefit analyses;
[Added: 2018/09/19] [Last Updated: 2020/06/08]
PMU, UNDP, MMERE 2020/02 Completed Engineering feasibility and cost-benefit analysis reviewed in the construction of water infrastructures in the targeted sites. History
Supporting start-up operation of desalination
[Added: 2018/09/19] [Last Updated: 2020/06/08]
PMU, UNDP, MMERE 2020/02 Completed Supported start-up of desalination units installed in targeted sites. History
Supporting construction management of field interventions.
[Added: 2018/09/19] [Last Updated: 2020/06/08]
PMU, UNDP, MMERE 2020/02 Completed Supported construction of field interventions in the pilot and replica sites. History
Enhancing CCA response plans, developing provincial strategies, and integrating with provincial development plans
[Added: 2018/09/19] [Last Updated: 2020/06/08]
PMU, UNDP, MMERE 2020/02 No Longer Applicable [Justification: This was not achieved during the project implementation.]
History
5. Recommendation:

Develop an adaptive management approach for engaging provincial level adaptation planning processes 

Management Response: [Added: 2018/09/19]

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Work with provincial planning personnel on developing a water sector climate change adaptation strategy.
[Added: 2018/09/19] [Last Updated: 2020/06/08]
PMU, UNDP, MMERE 2020/02 Completed This is not completed during the project implementation. History
Enhance site-level adaptation priorities into procurement ready activities that could be taken up in the medium term development plans.
[Added: 2018/09/19] [Last Updated: 2020/06/08]
PMU, UNDP, MMERE 2020/02 Completed This was not achieved during project implementation. History
Issue a Request for Expression of Interest for replication sites in the provinces.
[Added: 2018/09/19] [Last Updated: 2019/03/03]
PMU, UNDP, MMERE 2019/06 Completed Actioned and completed: EOI was launched for five Provinces (excluding Choisuel which was already identified during the PPG phase) and closed on 11th May 2018. A review panel comprised of key stakeholders (WRD/CCD/EHD/RSD/SIWSAP) met to review the applications on 1st June 2018 and the final decision for the successful six replica sites was fully approved by the panel on 6th June 2018. History
Work with the provincial authorities in water sector adaptation planning for the replication sites.
[Added: 2018/09/19] [Last Updated: 2019/03/03]
PMU, UNDP, MMERE 2019/06 Completed Actioned and completed: Provincial technical officers were involved in the IVA/WSCCARP site assessments for replica sites. RWASH Officers acted as facilitators in Malaita (Kwai), RenBell (Lavagu) and joined assessments in Poroporo (Choiseul) and Vonunu (Western). Government officials from Premier to technical levels were involved in WSCCARP workshops in both Lata and Kirakira. History
Leverage support from the UNDP project “Supporting peaceful and inclusive transition in Solomon Islands”, financed by the Peace Building Fund (PBF).
[Added: 2018/09/19] [Last Updated: 2020/06/08]
PMU, UNDP, MMERE 2020/02 Completed Support leveraged from UNDP. History
6. Recommendation:

Incorporate integrated water resource management (IWRM) into adaptation plans

Management Response: [Added: 2018/09/19] [Last Updated: 2018/09/19]

The project Agrees

Key Actions:

Key Action Responsible DueDate Status Comments Documents
The water sector adaptation response plans should be strengthened by incorporating IWRM principles; the project sites could be entry points for adopting an IWRM approach on a provincial scale.
[Added: 2018/09/19] [Last Updated: 2020/06/10]
PMU, MMERE 2020/02 Completed IWRM principles were integrated into WSCCR plans the 13 targeted sites. History
7. Recommendation:

Implement a thematic based procurement strategy, starting with interventions that are most prepared 

Management Response: [Added: 2018/09/19]

While we agree, please see previous comment of logistic costs relating to splitting this into thematic areas.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Design uncertainties preclude a consolidated procurement strategy for the field interventions planned in the second half of the project. For example, the source of the piped system in Gizo has not yet been agreed upon, and potential partnership arrangements have not been fully assessed. Moreover, plans for groundwater development should be based upon results of hydrogeologic assessments and field trials – which have not yet been completed. A thematic based procurement strategy would allow progress on interventions that have a higher level of preparedness, such as rainwater harvesting, and provide sufficient time to sort out design uncertainties, negotiate partnership arrangements, and carry out water resource assessments.
[Added: 2018/09/19] [Last Updated: 2019/03/03]
PMU, MHMS-EHD 2019/06 Completed Actioned and completed: For Pilot sites, an Invitation to Bid (ITB) was launched and concluded in Q4 2017 for only those more straightforward lower risk projects that the project were ready and capacitated to implement with limited external support required (i.e. rainwater harvesting, hand dug wells and small scale reticulated pipeline). The more complex Gizo water supply rehabilitation project was launched in a separate subsequent tender in Q4 2018, following extensive assessments, consultations and partnership discussions throughout 2017, primarily with RWASH. The result is that the project is proceeding, following the signing of a tripartite MoU between WRD/RWASH/SIWSAP that is allowing the work on the South Coast rural communities to proceed, thus, clearing the way for the work on the main pipeline to proceed. History
8. Recommendation:

Advocate implementation of improved sanitation demonstrations  at relevant project sites

Management Response: [Added: 2018/09/19]

Agree-Please see previous comment on this in terms of the project progress.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
There has been limited progress made with respect to improved sanitation activities. This seems partly due to a government policy that limits subsidies for rural sanitation interventions was issued after project approval. In the opinion of the MTR team, implementing an unsubsidized community led total sanitation (CLTS) process in the rural communities within the available time would be difficult to achieve. Certain demonstrations are required for building trust and confidence with the local communities. Funding improved sanitation technologies deemed favorable with respect to water sector climate change adaptation criteria, is consistent with the variance to the no-subsidy policy of the government.
[Added: 2018/09/19] [Last Updated: 2020/06/10]
PMU, MHMS-EHD 2020/03 No Longer Applicable [Justification: The sanitation aspect of the project was not completed during the project implementation period.]
The sanitation aspect was not achieved during project implementation. History
9. Recommendation:

Arrange trial installation and operation of two of the desalination units. 

Management Response: [Added: 2018/09/19]

Due to timeframe and characteristics of different sites this may not be feasible based on discussion with government counterparts. For example, by piloting this in Ferafalu, if the outcome of this is not favourable does not necessary mean it would not work for Tuwo as it depends on community governance systems and ownership. However we agree on points a-noting justifications to some of these points earlier on.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Decide upon the water source(s) with the support of the planned assessments of hydrogeologic conditions, and characterize baseline conditions
[Added: 2018/09/19] [Last Updated: 2019/03/03]
PMU, MMERE, MHMS-EHD 2019/06 Completed Actioned and completed: Water sources selected in five pilot sites during engineering feasibility assessments including establishing physical chemical water quality baseline. Groundwater pump tests on the shallow wells were subsequently undertaken by WRD/SIWSAP History
Ensure appropriate social and environmental safeguards are in place, e.g., securing property access rights, management of backwash water, etc
[Added: 2018/09/19] [Last Updated: 2020/06/08]
PMU, MMERE, MHMS-EHD 2020/02 Completed Not achieved during project implementation. History
Secure a laboratory partnership
[Added: 2018/09/19] [Last Updated: 2020/06/10]
PMU, MMERE, MHMS-EHD 2020/02 Completed An partnership arrangement was arranged between the WRD and National Public health to test teh quality of the water from the desalination plant in Gizo. History
Develop an operation, maintenance, and monitoring plan
[Added: 2018/09/19] [Last Updated: 2019/03/03]
PMU, MMERE, MHMS-EHD 2019/06 Completed Actioned and completed: Monitoring plan with associated log is established and operational at local/site level for routine basic operational/maintenance checks History
Train local, provincial, and national operational staff;
[Added: 2018/09/19] [Last Updated: 2020/06/10]
PMU, MMERE, MHMS-EHD 2020/03 Completed A number of trainings were conducted at the community level and provincial level, especially for operating the desalination plants. History
Run the system(s) for 3 months
[Added: 2018/09/19] [Last Updated: 2019/03/03]
PMU, MMERE, MHMS-EHD 2019/06 Completed Actioned and completed: All five installed systems operational for over one year, primarily operated by trained community/government operatives based onsite, with blended remote and field support from national level from SIWSAP/WRD/Energy Division (MMERE) History
Monitor and evaluate performance
[Added: 2018/09/19] [Last Updated: 2020/06/10]
PMU, MMERE, MHMS-EHD 2020/03 Completed Numerous missions were made to monitor the desalination plants in Santa Catalima, Gizo, Tuwo, Taro,Fiu and Tingoa. This allowed the project to further assist some machine parts that need maintenance during the project implementation. History
Evaluate operation cost and demands (e.g., time);
[Added: 2018/09/19] [Last Updated: 2020/06/10]
PMU, MMERE, MHMS-EHD 2020/02 Completed Operational cost and demands of the desalination plants were evaluated and information obtained were translated to an MOU for the sustainability of the systems. History
Evaluate communication needs and methods
[Added: 2018/09/19] [Last Updated: 2020/06/10]
PMU, MMERE, MHMS-EHD 2020/03 Completed Communication needs and methods were evaluated. History
Consolidate lessons learned, and complete plans and installations of the other sites.
[Added: 2018/09/19] [Last Updated: 2020/06/10]
PMU, MMERE, MHMS-EHD 2020/03 Completed Lessons learned were consolidated which had informed lessons to replication sites. History
Develop a contingency plan, including for addressing lower than expected water demand
[Added: 2018/09/19] [Last Updated: 2020/06/10]
PMU, MMERE, MHMS-EHD 2020/02 No Longer Applicable [Justification: This was not achieved and completed during the project implementation.]
Not completed. History
10. Recommendation:

Address broader human security issues in project interventions

Management Response: [Added: 2018/09/19]

Key Actions:

Key Action Responsible DueDate Status Comments Documents
In Santa Catalina, using one or more church buildings for water catchment might be sufficient to support community gardens (to be established near the churches) during the dry season;
[Added: 2018/09/19] [Last Updated: 2020/06/25]
PMU, UNDP, MMERE, MHMS-EHD 2020/03 Completed A number of church buildings were used to install water tanks that support community people and their gardens. History
Also in Santa Catalina, procure rainwater harvesting tanks at the highland area where the community evacuates in cases of disasters
[Added: 2018/09/19] [Last Updated: 2019/03/03]
PMU, UNDP, MMERE, MHMS-EHD 2019/06 Completed Actioned and completed: standalone rainwater harvesting tank installed on higher ground at the community evacuation point and at another uphill location History
Design and install simple life safety measures for public building water systems.
[Added: 2018/09/19] [Last Updated: 2020/06/25]
PMU, UNDP, MMERE, MHMS-EHD 2020/03 Completed Completed: Soft safety measures such as public notices and awareness raising was placed close to project inventions such as the desalination water tap stands in the targeted communities. History
11. Recommendation:

Strengthen project monitoring &evaluation and management systems

Management Response: [Added: 2018/09/19]

This is noted by management and also agreed

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Streamline the project results framework. A few suggested modifications to the results framework are outlined in Annex 6 of this MTR report.
[Added: 2018/09/19] [Last Updated: 2019/03/03]
PMU, UNDP, Project Board 2019/06 Completed Actioned and completed: PMU worked closely with RTA to streamline the PRF, taking into consideration the suggested modifications in Annex 6 of the MTR report. The revised proposed PRF was presented to the Project Board on 23/08/17 and approved in principle with some minor formatting changes required. Changes were made and shared with the Board and endorsed on 13/10/17. History
Implement critical path work planning, and integrate performance targets into the work plans.
[Added: 2018/09/19] [Last Updated: 2020/06/25]
PMU, UNDP, Project Board 2020/03 Completed Key performance targets were integrated into project work plans for in 2019 in aiming to complete all critical activities by project end. History
Increase frequency of project board meetings to twice per year.
[Added: 2018/09/19] [Last Updated: 2020/06/25]
PMU, UNDP, Project Board 2020/03 Completed Completed: project board meetings were increased from one to two towards the end of the project. History
Regularly track cofinancing contributions, with input from cofinancing partners and support from the MDPAC. The cofinancing table in this MTR report could be used as a template.
[Added: 2018/09/19] [Last Updated: 2020/06/25]
PMU, UNDP, Project Board 2020/03 Completed Completed: Co financing from project partners tracked , with some assistance from MNPDC( formerly MDPAC). And co-financing in MTR report used as a template for tracking co-financing. History

Latest Evaluations

Contact us

1 UN Plaza
DC1-20th Floor
New York, NY 10017
Tel. +1 646 781 4200
Fax. +1 646 781 4213
erc.support@undp.org