- Evaluation Plan:
- 2019-2022, Yemen
- Evaluation Type:
- Final Project
- Planned End Date:
- 06/2021
- Completion Date:
- 06/2021
- Status:
- Completed
- Management Response:
- Yes
- Evaluation Budget(US $):
- 60,000
Final Evaluation of the Social Protection for Community Resilience Project
| Document | Type | Language | Size | Status | Downloads |
|---|---|---|---|---|---|
 ToRs_Final Evaluation of the Social Protection for Community Resilience Project.pdf |
tor | English | 242.31 KB | Posted | 1026 |
| Final Evaluation of the UNDP Yemen Social Protection for Community Resilience Project.pdf |
report | English | 2730.22 KB | Posted | 1025 |
| Title | Final Evaluation of the Social Protection for Community Resilience Project | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Atlas Project Number: | 00099750 | |||||||||
| Evaluation Plan: | 2019-2022, Yemen | |||||||||
| Evaluation Type: | Final Project | |||||||||
| Status: | Completed | |||||||||
| Completion Date: | 06/2021 | |||||||||
| Planned End Date: | 06/2021 | |||||||||
| Management Response: | Yes | |||||||||
| Focus Area: |
|
|||||||||
| Corporate Outcome and Output (UNDP Strategic Plan 2018-2021) |
|
|||||||||
| SDG Goal |
|
|||||||||
| SDG Target |
|
|||||||||
| Evaluation Budget(US $): | 60,000 | |||||||||
| Source of Funding: | European Union | |||||||||
| Evaluation Expenditure(US $): | 32,000 | |||||||||
| Joint Programme: | No | |||||||||
| Joint Evaluation: | No | |||||||||
| Evaluation Team members: |
|
|||||||||
| GEF Evaluation: | No | |||||||||
| Key Stakeholders: | ||||||||||
| Countries: | YEMEN |
| Lessons | |
|---|---|
| 1. | Comprehensive projects such as the SPCRP, contribute to smooth consumption and improve livelihoods of the most vulnerable people. In the medium and longer term, it helps to improve access to essential social services and guarantees the fundamental rights of most vulnerable population. |
| 2. | The involvement of the main implementers (and key stakeholders) at initial stages (design phase) of the project, is essential for its success. |
| 3. | The use of different targeting methods has been a success, but it is important to go beyond towards an integrated information system that contributes to laying the foundations for medium- and longer-term social protection interventions. |
| 4. | Cash for work. Result Area 1: It is important to highlight innovative practices in the use of mobile banking and electronic payments, but the lack of personal identity cards and cultural issues hinder the success of this intervention. Health Facilities. Result Area 2: The need for a more comprehensive approach is identified in order to generate the expected multiplier effects on human development on this type of interventions and a more effective coordination. Psychosocial support.Result Area 3: The importance of adapting this component to the conflict context and incorporating aspects for its sustainability is highlighted, as well as the need to strengthen the technical capacity and necessary resources in order to expand its coverage and effective service delivery. The capacity building component: Result Area 4 is essential in all development projects as it contributes to improve project-cycle management and service delivery, but also ownership and sustainability of the projects. |
| 5. | Focusing interventions on specific groups such as women contributes not only to their advancement and empowerment but also to the achievement of community development goals. |
| Findings | |
| 1. | Relevance
|
| 2. | Coherence Substantive effort has been made in addressing synergies and linkages between other interventions and within its institution. SFD has also established links at the local level that have contributed to its effective coordination and implementation. |
| 3. | Effectiveness
|
| 4. | Efficiency
|
| 5. | Impact
|
| 6. | Sustainability
|
| 7. | Gender Equality and Women Empowerment
Other cross-cutting issues
|
| Recommendations | |
|---|---|
| 1 | In light of the experience and results of this type of projects, it is recommended to move towards the conceptualization of social protection (as an integrated system) in Yemen, based on a broad and inclusive social dialogue taking into account the conflict context and a period of transition and recovery (medium-long term vision). This will require joint work and knowledge generation between academia, national and international development partners, implementing agencies such SFD, civil society organizations –including those representing the most vulnerable and marginalized populations–, among others. In light of the experience and results of this type of projects, it is recommended to move towards the conceptualization of social protection (as an integrated system) in Yemen, based on a broad and inclusive social dialogue taking into account the conflict context and a period of transition and recovery (medium-long term vision). This will require joint work and knowledge generation between academia, national and international development partners, implementing agencies such SFD, civil society organizations –including those representing the most vulnerable and marginalized populations–, among others. |
| 2 | It is important to establish more systematic or integrated frameworks to ensure harmonization, not only within a particular system but between different ones (i.e., within the health cluster and between the health cluster and social protection). This will contribute to more consistent interventions with added value as opposed to the duplication of efforts. However, an in-depth analysis is required in this regard to be able to assess more specifically the limitations faced (including its synergies and trade-offs between policy areas), particularly in conflict-setting, humanitarian response and its financing. |
| 3 | It is recommended to strengthen the decision-making and managerial structures of the project, and to have a gender specialist to support this effort and ensure the achievement of gender specific targets, as well as gender ear marked resources. |
| 4 | In the current situation of political and economic instability, the prices and costs of construction supplies are subjected to a lot of variability. This situation needs to be foreseen and taken into account in future projects since it could undermine the established targets. For this, it is recommended to strengthen the technical capacities of the national implementing institutions through the development (or strengthening) of an updated system of supplies/input costs for the construction/ rehabilitation of basic social infrastructure. Regarding the health facilities infrastructure, it is suggested that assistance, or other funding mechanism to carried out technical needs’ assessment (for infrastructure and equipment) of all prioritized facilities (by the Health cluster partners) should be considered. This will help reduce time (and avoid delays) in the early implementation phases of future projects. |
| 5 | A more in-depth and inclusive initial assessment is needed in order to address not only the economic, social and political context, but also the institutional one. In the latter case, the development of an institutional mapping (from a recovery and social protection approach) and due diligence (and capacity needs assessment) of the national implementing institution or institutions, are recommended. In regard to this initial assessment, it is essential to emphasize human rights and gender equality HR&GE from an intersectional and life cycle approach to identify specific individual and social risks; and consider the most vulnerable and marginalized people –including old age and disabled, as well as women, youth, internally displaced and returnees, among others. As established in the Lessons learned report: "Future project design should seek to achieve wage parity and the specific accommodation of women's needs". In this sense, it is important to identify the capacity needs (and risks) at the institutional level related not only to the management and operation of the project, but also to the technical capacity, in terms of specialized human resources, operating rules and policy tools that are appropriate to the context in the short and medium term of social protection. These policy tools include targeting mechanisms (according to agreed parameters HR&GE perspective and intersectional and life cycle approaches), and a single registry of (potential) participants (of the different social protection interventions) as well as integrated information systems that include monitoring and evaluation and effective grievance systems. This in order to clearly identify the technical and capacity areas (human, physical-technological resources) that need to be strengthened. |
1. Recommendation:
In light of the experience and results of this type of projects, it is recommended to move towards the conceptualization of social protection (as an integrated system) in Yemen, based on a broad and inclusive social dialogue taking into account the conflict context and a period of transition and recovery (medium-long term vision). This will require joint work and knowledge generation between academia, national and international development partners, implementing agencies such SFD, civil society organizations –including those representing the most vulnerable and marginalized populations–, among others. In light of the experience and results of this type of projects, it is recommended to move towards the conceptualization of social protection (as an integrated system) in Yemen, based on a broad and inclusive social dialogue taking into account the conflict context and a period of transition and recovery (medium-long term vision). This will require joint work and knowledge generation between academia, national and international development partners, implementing agencies such SFD, civil society organizations –including those representing the most vulnerable and marginalized populations–, among others.
Management Response: [Added: 2021/07/29]
Agree with the recommendation
Key Actions:
| Key Action | Responsible | DueDate | Status | Comments | Documents |
|---|---|---|---|---|---|
| UNDP has initiated bilateral discussions with other UN Agencies, notably UNICEF, for the design of a comprehensive joint programme document that will address this recommendation in a sustainable manner. The programme document has been conceptualized to include broad-based dialogues across all sectors relevant for social protection programming in Yemen. The final output of this process is expected to be a National Programming and Financing Document for Social Protection in Yemen.
[Added: 2021/07/29] [Last Updated: 2022/06/28] |
Social Protection Project Manager | 2022/12 | Initiated | The detailed Joint Programme Document is still under technical review at UNICEF & UNDP. When the technical review is completed, a presentation will be made to the UNCT in the coming months as more UN Agencies have indicated interest in the initiative. We expect to finally roll out the JPD by end of 2022. History |
2. Recommendation:
It is important to establish more systematic or integrated frameworks to ensure harmonization, not only within a particular system but between different ones (i.e., within the health cluster and between the health cluster and social protection). This will contribute to more consistent interventions with added value as opposed to the duplication of efforts. However, an in-depth analysis is required in this regard to be able to assess more specifically the limitations faced (including its synergies and trade-offs between policy areas), particularly in conflict-setting, humanitarian response and its financing.
Management Response: [Added: 2021/07/29]
Agree with the recommendation
Key Actions:
| Key Action | Responsible | DueDate | Status | Comments | Documents |
|---|---|---|---|---|---|
| UNDP is now a key member of an umbrella coordination body known as the Social Protection Coordination Committee (SPCC) which was initiated by UNICEF. One of the key activities of the SPCC in the north and south of Yemen is the formulation of a National Strategic Framework for Social Protection under the leadership of the relevant authorities i.e. Ministry of Social Affairs and Labour.
[Added: 2021/07/29] |
Social protection projet manager | 2021/06 | Completed |
3. Recommendation:
It is recommended to strengthen the decision-making and managerial structures of the project, and to have a gender specialist to support this effort and ensure the achievement of gender specific targets, as well as gender ear marked resources.
Management Response: [Added: 2021/07/29] [Last Updated: 2021/11/24]
Agree with the recommendation
Key Actions:
| Key Action | Responsible | DueDate | Status | Comments | Documents |
|---|---|---|---|---|---|
| UNDP has a Gender Analyst resident in the Management Support Unit. The Gender Analyst support gender programming for all UNDP projects in Yemen, including Social Protection project
[Added: 2021/07/29] [Last Updated: 2021/08/01] |
CO senior management | 2021/07 | Completed | The CO Gender Analyst support all project in gender programming. History |
4. Recommendation:
In the current situation of political and economic instability, the prices and costs of construction supplies are subjected to a lot of variability. This situation needs to be foreseen and taken into account in future projects since it could undermine the established targets. For this, it is recommended to strengthen the technical capacities of the national implementing institutions through the development (or strengthening) of an updated system of supplies/input costs for the construction/ rehabilitation of basic social infrastructure. Regarding the health facilities infrastructure, it is suggested that assistance, or other funding mechanism to carried out technical needs’ assessment (for infrastructure and equipment) of all prioritized facilities (by the Health cluster partners) should be considered. This will help reduce time (and avoid delays) in the early implementation phases of future projects.
Management Response: [Added: 2021/11/24] [Last Updated: 2021/11/24]
Disagree with the recommendation
Key Actions:
| Key Action | Responsible | DueDate | Status | Comments | Documents |
|---|---|---|---|---|---|
| UNDP disburses funds to SFD in USD, which helps maintain the value on the face of local price flacuations. SFD's procurement procedures were assessed and found to be aligned to UNDP's procedures. Subsequent assurance activities had no issues on procurement. Any delays suffered are due to the constraining context, a little on the partner's capacity. All infrastructures rehabilitated were selected and prioritised with communities and relevant cluster partners
[Added: 2021/11/24] |
N/A | 2021/08 | Completed |
5. Recommendation:
A more in-depth and inclusive initial assessment is needed in order to address not only the economic, social and political context, but also the institutional one. In the latter case, the development of an institutional mapping (from a recovery and social protection approach) and due diligence (and capacity needs assessment) of the national implementing institution or institutions, are recommended.
In regard to this initial assessment, it is essential to emphasize human rights and gender equality HR&GE from an intersectional and life cycle approach to identify specific individual and social risks; and consider the most vulnerable and marginalized people –including old age and disabled, as well as women, youth, internally displaced and returnees, among others. As established in the Lessons learned report: "Future project design should seek to achieve wage parity and the specific accommodation of women's needs".
In this sense, it is important to identify the capacity needs (and risks) at the institutional level related not only to the management and operation of the project, but also to the technical capacity, in terms of specialized human resources, operating rules and policy tools that are appropriate to the context in the short and medium term of social protection. These policy tools include targeting mechanisms (according to agreed parameters HR&GE perspective and intersectional and life cycle approaches), and a single registry of (potential) participants (of the different social protection interventions) as well as integrated information systems that include monitoring and evaluation and effective grievance systems. This in order to clearly identify the technical and capacity areas (human, physical-technological resources) that need to be strengthened.
Management Response: [Added: 2021/11/24] [Last Updated: 2021/11/24]
Do not agree with the recommendation
Key Actions:
| Key Action | Responsible | DueDate | Status | Comments | Documents |
|---|---|---|---|---|---|
| Capacity assessments were undertaken before SFD was engaged. During the course of the project, the partner was subjected to spotchecks, programme visits and audits which continously assessed performance and capacity of the responsible party
[Added: 2021/11/24] |
N/A | 2021/08 | Completed | Recommended actions were already undertaken |