Assessment of Development Results: Ethiopia

Report Cover Image
Evaluation Plan:
2014-2017, Independent Evaluation Office
Evaluation Type:
ADR
Planned End Date:
12/2015
Completion Date:
12/2015
Status:
Completed
Management Response:
Yes
Evaluation Budget(US $):
160,000

The IEO of UNDP conducted a country-level evaluation in Ethiopia in 2015. The evaluation has two main components: (i) the analysis of UNDP’s contribution to development results (specifically, against the outcomes contained in the Country Programme Document); and (ii) analysis of the strategies UNDP has adopted to enhance contribution to development results in Ethiopia. It also attempted to assess the role and contribution of United Nations Volunteers (UNV) and United Nations Capital Development Fund (UNCDF) in relation to joint work with UNDP. The ADR covers the period 2012 through June 2015 while also taking into account some longer-term activities that have continued from the previous programme cycle.

Share

Document Type Language Size Status Downloads
Download document ADR Ethiopia TOR.pdf tor English 546.66 KB Posted 444
Download document ADR_Ethiopia_EN.pdf report English 1664.00 KB Posted 1004
Download document ADR_Ethiopia_Executive_Summary_EN.pdf summary English 107.66 KB Posted 172
Title Assessment of Development Results: Ethiopia
Atlas Project Number:
Evaluation Plan: 2014-2017, Independent Evaluation Office
Evaluation Type: ADR
Status:Completed
Completion Date:12/2015
Planned End Date: 12/2015
Management Response:Yes
Corporate Outcomes (UNDP Strategic Plan 2008-20013)
Evaluation Budget(US $): 160,000
Source of Funding:
Joint Programme:No
Mandatory Evaluation:No
Joint Evaluation: No
Evaluation Team members:
Name Title Email Nationality
GEF Evaluation:No
Key Stakeholders:
Location of Evaluation:Country Level
Countries: ETHIOPIA
Lessons
Findings
Recommendations
1 By building on its track record, and taking account of GoE priorities in GTP II, UNDP should continue to support institutional building and capacity development, particularly in sustainable economic growth, democratic governance and climate-sensitive and -resilient development. At the same time, continued attention to the private sector and community level development will be necessary to support expected development outcomes. An explicit focus on resilience should be included.
2 UNDP should maintain and use its strong relationship with government to engage in policy dialogue, but strengthen its sustainable human development perspectives. These are critical to meeting the needs of Ethiopiaâ??s people and consistent with the UNDP Strategic Plan priorities and engagement principles, including participation and citizens empowerment
3 To enhance sustainability, UNDP should incorporate well-defined exit strategies into all its programmes and projects, as well as explicit learning and scale-up strategies for pilot projects. This should be complemented by building synergies horizontally across programming units as well as vertically through clear articulation of macro-micro linkages between local projects and upstream policy and institutional reform where relevant.
4 UNDP should ensure the clear articulation and ownership of theories of change at the time of programme design by engaging key stakeholders. This should be complemented by appropriate outcomes indicators and baselines as part of a systematic and more institutionalized approach to M&E. While UNDP should continue to strengthen its RBM approach, it will have to be prepared to deal with natural hazard and socioeconomic shocks and stresses. This will require flexibility and adaptive management.
5 More systematic participatory assessments of community assets and needs are required to better align UNDP?s projects to specific community priorities and at the same time ensure greater ownership and sustainability at that level and to nurture bottom-up processes of self-empowerment. Supporting bottom-up self-empowering engagement processes with communities will also increase communities? voice and participation.
6 UNDP should prioritize gender mainstreaming in the next country programme. The 2014 Gender Equality Strategy (GES) must be accompanied by an operational implementation framework with dedicated staff to ensure that necessary systems and structures are in place to contribute to gender transformative results.
1. Recommendation: By building on its track record, and taking account of GoE priorities in GTP II, UNDP should continue to support institutional building and capacity development, particularly in sustainable economic growth, democratic governance and climate-sensitive and -resilient development. At the same time, continued attention to the private sector and community level development will be necessary to support expected development outcomes. An explicit focus on resilience should be included.
Management Response:

The recommendations raised are well aligned with the COâ??s current thinking on what will constitute our programme priorities over the next CPD, and we agree that more resources and support to GoE should be sustained to ensure that the whole realm of public governance continues to be strengthened to safeguard current democratic dividends, while ensuring that the country stays on a path of rapid democratization and development. On the later aspect of ensuring sustainable development, the CO agrees that building a programme to enhance capacities to deliver economic rights and freedoms is important in promoting inclusive development in general and private sector development in particular. We also agree to take up a greater leadership and coordination role on resilience and early recovery within the UNCT system and with development partners, and to deepen our downstream interventions in communities that are most vulnerable to droughts and climate hazards, with targeted responses for women, youth and children, and marginalized groups.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Development of the Country Programme Document (2016-2020) Senior Management (UNDP Resident Representative and Country Director) 2016/06 Completed Finalized the development of CPD document (2016-2020) and implementation commenced in July 2016
Development of a comprehensive Governance Programme that aims to support democratic governance initiatives Country Director 2017/07 Initiated Project document for the Governance programme developed and currently awaiting endorsement from the national counterparts
Development of the Local Economic Governance programme to address economic issues Country Director 2017/07 Initiated UNDP is following up on the signature of the project document in 2017 by the national counterparts
Engage with government to set up the early recovery cluster. UNDP is leading UNCT coordination on resilience and supporting the the comprehensive study on resilience. UNDP Country Director 2017/12 Initiated Early recovery cluster established in 2017 by the Disaster Risk Management Commission. UNDP has set aside $ 350,000 for a comprehensive resilience study to be conducted in 2017. The Study has two phases; the theoretical part (draft has been received and commented on) and Modeling Scenario phasing is expected to be started in June 2017
Development of downstream intervention projects. UNDP Ethiopia has developed a $98M GCF proposal on Adaptation in drought-prone areas of Ethiopia Country Director 2017/12 Initiated Development of downstream interventions is currently ongoing with projects being developed for Gambella region. The GCF proposal is currently awaiting endorsement by the GCF board in April 2017
Support national peace architecture through inclusive dialogue, national cohesion and peace building activities Country Director and Prog Team Leaders 2017/01 Completed CO supported the Inter-Religious Council Conference, religious leaders, joined by representatives from the youth, women, private sector and civil society, were brought together by Ethiopia’s Inter-Religious Council for the Conference held from 10-11 January 2017 in the UN Conference Centre
2. Recommendation: UNDP should maintain and use its strong relationship with government to engage in policy dialogue, but strengthen its sustainable human development perspectives. These are critical to meeting the needs of Ethiopiaâ??s people and consistent with the UNDP Strategic Plan priorities and engagement principles, including participation and citizens empowerment
Management Response:

UNDP management recognizes its privileged position as Ethiopiaâ??s trusted partner. Goodwill that has been built over years of repeated interaction with the senior GoE leadership. This goodwill and trust will be leveraged by UNDP (and the UN Resident Coordinatorâ??s Office) to enhance strategic dialogue with the government especially on politically strategic issues where such levels of trust as now exist are important in brokering dialogue with government. UNDP will, however, remain astute and careful in its engagement with government so as to maintain and deepen the trust and respect it has earned, and to ensure that this privileged position is sustained in the coming years

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Development of a multi-donor governance programme to support policy dialogue, citizen engagement, participation and empowerment. Country Director 2017/06 Initiated Governance programme has been developed and is currently awaiting government endorsement
Support interventions to sustain peace and enhance constructive engagement (Civil Society Forum, Inter-religious, media and political parties dialogues) Country Director 2017/01 Completed UNDP supported Ethiopia’s Inter-Religious Council Conference held from 10-11 January 2017 at the UN Conference Centre. The Ethiopian Media Council was formally established at a conference held in the UN Economic Commission for Africa in January 2016 and supported by UNDP
Support establishment of the Civil Society Forum to enhance citizen engagement and participation Country Director 2017/12 Initiated The activity will be supported under the Governance project currently waiting endorsement
3. Recommendation: To enhance sustainability, UNDP should incorporate well-defined exit strategies into all its programmes and projects, as well as explicit learning and scale-up strategies for pilot projects. This should be complemented by building synergies horizontally across programming units as well as vertically through clear articulation of macro-micro linkages between local projects and upstream policy and institutional reform where relevant.
Management Response:

UNDP programming in Ethiopia is executed through the NIM and upstream and downstream interventions are designed and implemented through and within existing government structures. This approach has an in-built sustainability mechanism that will need to be strengthened further by making exit strategies and other sustainability benchmarks more explicit in our programme documents and work-plans as we move forward to implement the upcoming CPD. We also welcome the recommendation to strengthen and leverage upstream interventions to support greater impact of our downstream interventions. We think that as Ethiopia is a DaO country, further efforts will be made to coordinate UNDP interventions with other UN agencies to foster synergies in downstream and upstream interventions across the UN system wherever possible, and thereby enhance the impacts and sustainability of results at project and outcome level. We will also be looking into entry-points to harness macro-micro linkages to strengthen programme delivery and impacts at project and outcome level

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Ensure project quality and assurance criteria Country Director and PMSU 2017/01 Completed The CO has established criteria for project quality and assurance undertaken by the Partnerships and Management Support Unit (PMSU) prior to the approval of the project
Ensure each project has up-stream and down-stream interventions as part of quality assurance Country Director and PMSU 2017/01 Completed As a standard operating procedure at the CO, PMSU ensures that each project has down-stream and up-stream interventions as part of quality assurance
Support to enhance coordination across the UN system Resident Representative and RCO 2017/06 Initiated UNDP is supporting cordination interventions including leading in the resilience study, leading in Governance and Human Rights working groups under the UNDAF structure. The Livestock project is currently being developed in partnership with ILRI and FAO UNDP is leading development of the Agro-industry project in partnership with UNIDO, FAO, ILO and UNOPS UNDP CO is supporting the cross-border project together with UNDP Kenya being coordinated by Resident Coordinators Office
4. Recommendation: UNDP should ensure the clear articulation and ownership of theories of change at the time of programme design by engaging key stakeholders. This should be complemented by appropriate outcomes indicators and baselines as part of a systematic and more institutionalized approach to M&E. While UNDP should continue to strengthen its RBM approach, it will have to be prepared to deal with natural hazard and socioeconomic shocks and stresses. This will require flexibility and adaptive management.
Management Response:

The CO will continue to improve programme design and content and ensure more clarity on the theory of change that underpins our programme rationale and its relevance to results and outcomes. As part of this initiative, UNDP will also provide training to its implementing partners to ensure that the implementation process is also in line with the programme document and M&E framework for the projectâ??s SMART indicators.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Results-based Management Training for Programme staff Country Director and PMSU 2017/06 Initiated Plans are underway to conduct a RBM and M&E Training for all the programme staff at the CO
Undertake quality assurance process leveraging RSC and BPPS services Country Director and Unit Team Leaders 2017/01 Completed In development of the GCF proposal the CO leveraged on services from the regional service centre to ensure development of high quality and responsive GCF proposal
Recruit M&E Specialist to improve programme design, monitoring and reporting Country Director 2016/12 Completed CO employed M&E and Reporting Specialist
5. Recommendation: More systematic participatory assessments of community assets and needs are required to better align UNDP?s projects to specific community priorities and at the same time ensure greater ownership and sustainability at that level and to nurture bottom-up processes of self-empowerment. Supporting bottom-up self-empowering engagement processes with communities will also increase communities? voice and participation.
Management Response:

UNDP utilizes various approaches to engage with local communities in programme formulation and implementation, and ensures that all locally-implemented projects and programmes are endorsed by the community and local government structures. Local government representatives are also called in to participate in the local appraisal committees that approve beneficiary selection and, subsequently, the project document before it is submitted to government for signature. More efforts will, however, be made to enhance documentation of this process in future projects. Moving forward, we will take on this recommendation to strengthen collection and documentation of baseline information at the community and project levels, including on household and community assets to support future programming, progress evaluation and impact monitoring. Local authorities, CSOs and other representation groups/associations will also be supported to enhance their skills for effective engagement and participation in project formulation and monitoring, decision-making, policy engagement, and also to enhance their skills to demand for greater participation and voice as may be necessary and relevant to the project and local context.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Establish a database for all projects to ensure baseline data is available for evaluations M&E Specialist 2017/06 Initiated CO is currently establishing a database for all projects
Community consultation for all project formulation Country Director 2016/09 Completed All project formulation require field consultation e.g. GCF proposal was proposal was endorsed at community level with signatures from community members as part of the community endorsement of the project proposal
Enforce safety and environmental standards as part of the project development Country Director and PMSU 2017/01 Completed The CO through PMSU ensures that all projects adhere to safety and environmental standards as part of the project assurance criteria
Ensure local engagement and appraisal of all projects through the Local Project Appraisal Committee. National partners including bureaus at regional level, local authorities, civil societies and community leaders are actively engaged in the project appraisal, implementation and evaluation Country Director and unit team leaders 2017/01 Completed All projects have to undergo LPAC and CO ensures documentation of LPAC minutes
6. Recommendation: UNDP should prioritize gender mainstreaming in the next country programme. The 2014 Gender Equality Strategy (GES) must be accompanied by an operational implementation framework with dedicated staff to ensure that necessary systems and structures are in place to contribute to gender transformative results.
Management Response:

The CO agrees with this recommendation. Efforts will be undertaken to strengthen the gender dimension in the new CP, and to increasingly target women as beneficiaries and actors of change. The office will continue to support the mainstreaming of gender across programme components, as outlined in the UNDP GES, and will monitor progress using the gender marker and Gender Equality Seal. To that intent, the office will develop an operational implementation framework that accompanies the GES in the next programme cycle. The M&E system will be strengthened to include more explicit reporting of gender results throughout the CPD period.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Train all programme staff on gender mainstreaming in projects Country Director 2017/08 Initiated The CO has plans to undertake a training for all programme staff on gender mainstreaming
Track, monitor and report project output using Gender Marker Country Director, Programme Team Leaders and PMSU/M&E 2016/12 Completed The CO continues to monitor progress of project outputs using the Gender Marker
Strengthen M&E systems by ensuring gender specific indicators for projects PMSU/M&E 2017/03 Completed M&E Framework requires gender indicators and PMSU is ensuring that projects have gender indicators

Latest Evaluations

Contact us

220 East 42nd Street
20th Floor
New York, NY 10017
Tel. +1 646 781 4200
Fax. +1 646 781 4213
erc.support@undp.org