TERMINAL EVALUATION OF DRS - UN JOINT PROGRAMME

Report Cover Image
Evaluation Plan:
2017-2020, Ethiopia
Evaluation Type:
Final Project
Planned End Date:
09/2017
Completion Date:
09/2017
Status:
Completed
Management Response:
Yes
Evaluation Budget(US $):
37,391

Share

Document Type Language Size Status Downloads
Download document DRS JP-Terminal Evaluation-Final -Final Report.dox.pdf report English 2150.54 KB Posted 388
Download document TOR- DRS_JP TE.pdf tor English 431.12 KB Posted 210
Title TERMINAL EVALUATION OF DRS - UN JOINT PROGRAMME
Atlas Project Number: 00059740
Evaluation Plan: 2017-2020, Ethiopia
Evaluation Type: Final Project
Status: Completed
Completion Date: 09/2017
Planned End Date: 09/2017
Management Response: Yes
Focus Area:
  • 1. Democratic Governance
  • 2. Others
Corporate Outcome and Output (UNDP Strategic Plan 2014-2017)
  • 1. Output 1.1. National and sub-national systems and institutions enabled to achieve structural transformation of productive capacities that are sustainable and employment - and livelihoods- intensive
  • 2. Output 3.5 Communities empowered and security sector institutions enabled for increased citizen safety and reduced levels of armed violence
Evaluation Budget(US $): 37,391
Source of Funding: Joint
Evaluation Expenditure(US $): 37,391
Joint Programme: Yes
Joint Evaluation: No
Evaluation Team members:
Name Title Email Nationality
Dr. Desalegn Amsalu ETHIOPIA
Ms. Tirsit Sahledingil ETHIOPIA
Mr. Demissie Gudisa ETHIOPIA
GEF Evaluation: No
Key Stakeholders: UNCDF, UNICEF, Ministry of Finance and Economic Development, Ministry of Federal Affairs, Bureaux of Finance and Economic Development
Countries: ETHIOPIA
Lessons
1.

1. Measurable indicators presence and the existence of appropriate baseline values that could help as
Benchmark to measure the Programme progress/ expected results, outputs and outcomes against the established baseline values. Government and community ownership of the Programme across regions is highly appreciated. It goes without saying that any similar local development Programme applies similar approaches of designing, implementations, monitoring and review of results. 3.
The full engagement of the government in design, implementation and management of the JP ensures commitment of government counterparts at all levels and strengthens ownership and sustainability of the processes and results of the Joint Programme.
An integrated approach of the three components being implemented for the same communities encourages a holistic approach and the different components reinforce each other to strengthen the impact on the beneficiaries.
The success of the Programme is partially the result of strong leadership and technical guidance from
Steering Committees and Technical Working Groups. This depends not only on technical expertise, but also on its strategic level support and the enabling environment availed at all levels. Among others, strengthening of Federal level steering committee is a must in creating not only the anticipated supportive environment but also Programme harmony and national ownership. The presence of the steering committee is very important and necessary to provide oversight and strategic guidance for the Joint Programme at a higher and strategic decision making level. Lessons learned for future adaptation similar programmes include:Government and community ownership of the Programme across regions is highly appreciated. It goes without saying that any similar local development Programme applies similar approaches of designing, implementations, monitoring and review of results;
2. The full engagement of Implementing Partners (IPs) in designing, implementation and management of development Programmes ensures ownership, commitment by government counterparts at all levels and guarantees sustainability of development processes and results;
3. An integrated development approach avoids silos and increase impacts of various components implemented jointly encouraging beneficiaries to use holistic approach in development;
4. The success of the Programme is partially the result of strong leadership and technical guidance from Steering Committees and Technical Working Groups;
5. As an extension of the philosophy of the JP and Delivering as One, the DRS-UN JP benefited from joint field monitoring aimed at gathering facts from the ground through meeting with local authorities and community members and share lessons to all stakeholders.


Findings
Recommendations
1

Evaluation Recommendation or Issue 1: UN agencies should hold further discussions with government stakeholders to redefine a more consultative relationship about strategically prioritizing resources and identifying and selecting Programme themes and beneficiaries;

2

Evaluation Recommendation or Issue 2: Steering Committees, especially at Federal level, should take a more proactive oversight and paly strategic role for better follow-up, policy advise and impacts. Mutual accountability and information sharing between the regions and Steering Committee at various levels and Technical Working groups should be reinvigorate;

3

Evaluation Recommendation or Issue 3: More cross-cutting issues other than gender that go beyond traditional portfolio boundaries should be included. This includes disaster risk reduction, conflict sensitive development.  Additional priorities can be taken from the ongoing UNDAF and CPDs, strategic documents with prioritization of issues and Programme themes;

4

Evaluation Recommendation or Issue 4:    UN agencies and Government counterparts should make further efforts to effectively document and disseminate successful experiences and lessons learned in Programme approaches and initiatives, particularly on implementation of the background philosophy of UN JP and Delivering as One. Attempts should be made to apply diverse communications, public outreach and strengthened knowledge management to test, and prove, what works and what can then be scale up;

5

Evaluation Recommendation or Issue 5:    UN agencies should further capitalize on the opportunities offered by national and regional initiatives to leverage synergies with interrelated development issues with a conscious technical and value-for-money strategy;

6

Evaluation Recommendation or Issue 6:    The DRS-UN JP is an innovative and successful Programme approach providing basis for scaling-up. Hence, expanding lessons learnt to other Non-DRS-JP woredas of the emerging regional states is foreseeable through prioritizing new initiatives that will added value;

7

Evaluation Recommendation or Issue 7:    Developing Regional Sates are prone to local conflict, drought, climatic shocks and to disasters. Hence, UN’s future engagements in these regions as development partners should explore how to further integrate and mainstream these issues;

8

Evaluation Recommendation or Issue 8:    As a UN JP Results Based Management and monitoring and evaluation of the Programme at the outcome level, and working with coherent and comprehensive theories of change to map assumptions and ensure complex contexts and the multifaceted nature of development agreeably contribute to development, behavioural and transformational changes;

9

Evaluation Recommendation or Issue 9:  UN agencies should adopt common Funding Authorization Certificate of Expenditures forms for all UN agencies to ensure alignment and harmonization of operational procedures;

1. Recommendation:

Evaluation Recommendation or Issue 1: UN agencies should hold further discussions with government stakeholders to redefine a more consultative relationship about strategically prioritizing resources and identifying and selecting Programme themes and beneficiaries;

Management Response: [Added: 2017/12/13]

Agreed

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Description activities, then specifics as needed UN agencies through the UNCT discussed and agreed to continue internal discussions on how to support the DRS regions.
[Added: 2017/12/13] [Last Updated: 2018/08/20]
RCO + UNCT 2018/02 Completed completed History
2. Recommendation:

Evaluation Recommendation or Issue 2: Steering Committees, especially at Federal level, should take a more proactive oversight and paly strategic role for better follow-up, policy advise and impacts. Mutual accountability and information sharing between the regions and Steering Committee at various levels and Technical Working groups should be reinvigorate;

Management Response: [Added: 2017/12/13]

Noted as a lesson 

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Description activities, then specifics as needed This is a lesson for a successor programme and the functionality of the steering committee will be ensured throughout the implementation period if a successor programme is to be materialized
[Added: 2017/12/13] [Last Updated: 2018/08/20]
RCO + UNCT 2018/01 No Longer Applicable [Justification: No successor program is designed yet]
No longer applicable History
3. Recommendation:

Evaluation Recommendation or Issue 3: More cross-cutting issues other than gender that go beyond traditional portfolio boundaries should be included. This includes disaster risk reduction, conflict sensitive development.  Additional priorities can be taken from the ongoing UNDAF and CPDs, strategic documents with prioritization of issues and Programme themes;

Management Response: [Added: 2017/12/13]

Agreed

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Description activities, then specifics as needed This is well taken as a lesson in the development and implementation of UNDP projects to consider disaster risk reduction, conflict sensitive development
[Added: 2017/12/13] [Last Updated: 2018/08/20]
RCO + UNCT + UNDP 2018/01 Completed Completed History
4. Recommendation:

Evaluation Recommendation or Issue 4:    UN agencies and Government counterparts should make further efforts to effectively document and disseminate successful experiences and lessons learned in Programme approaches and initiatives, particularly on implementation of the background philosophy of UN JP and Delivering as One. Attempts should be made to apply diverse communications, public outreach and strengthened knowledge management to test, and prove, what works and what can then be scale up;

Management Response: [Added: 2017/12/14]

Agreed and completed

Key Actions:

Key Action Responsible DueDate Status Comments Documents
A documentary film has been produced and disseminated to share successful experiences and lessons learned from the Programme in terms of approaches of the philosophy of UN JP and Delivering as One
[Added: 2017/12/14]
UNDP + UNICEF + RCO 2017/06 Completed Completed
5. Recommendation:

Evaluation Recommendation or Issue 5:    UN agencies should further capitalize on the opportunities offered by national and regional initiatives to leverage synergies with interrelated development issues with a conscious technical and value-for-money strategy;

Management Response: [Added: 2017/12/14]

Noted as a lesson 

Key Actions:

Key Action Responsible DueDate Status Comments Documents
This lesson is well taken and agencies particularity UNDP should further look in to synergies between its development projects/programmes and other national and regional initiatives as well as between and among its projects/programmes.
[Added: 2017/12/14] [Last Updated: 2018/08/20]
UNDP 2018/01 Completed Completed History
6. Recommendation:

Evaluation Recommendation or Issue 6:    The DRS-UN JP is an innovative and successful Programme approach providing basis for scaling-up. Hence, expanding lessons learnt to other Non-DRS-JP woredas of the emerging regional states is foreseeable through prioritizing new initiatives that will added value;

Management Response: [Added: 2017/12/14]

Noted as a lesson

Key Actions:

Key Action Responsible DueDate Status Comments Documents
The lessons and best practices are agreed to be replicated to other Non-DRS-JP regions and woredas as this is one of the added value of the programme. This will be done through a successor programme be it DRS or any other similar initiative.
[Added: 2017/12/14] [Last Updated: 2018/08/20]
UNDP 2018/01 Completed Completed History
7. Recommendation:

Evaluation Recommendation or Issue 7:    Developing Regional Sates are prone to local conflict, drought, climatic shocks and to disasters. Hence, UN’s future engagements in these regions as development partners should explore how to further integrate and mainstream these issues;

Management Response: [Added: 2017/12/14]

Agreed to take as a lesson

Key Actions:

Key Action Responsible DueDate Status Comments Documents
This lesson is well taken and agencies particularity UNDP should further look in to synergies between its development projects/programmes and other national and regional initiatives as well as between and among its projects/programmes
[Added: 2017/12/14] [Last Updated: 2018/08/20]
UNDP 2018/01 Completed Completed History
8. Recommendation:

Evaluation Recommendation or Issue 8:    As a UN JP Results Based Management and monitoring and evaluation of the Programme at the outcome level, and working with coherent and comprehensive theories of change to map assumptions and ensure complex contexts and the multifaceted nature of development agreeably contribute to development, behavioural and transformational changes;

Management Response: [Added: 2017/12/14]

Agreed to consider for future projects

Key Actions:

Key Action Responsible DueDate Status Comments Documents
The programme lacks M&E + Results Framework and clear theory of change. This is well taken and all other future programmes will have these components as part of the ProDoc.
[Added: 2017/12/14] [Last Updated: 2018/08/20]
UNDP 2018/01 Completed Completed History
9. Recommendation:

Evaluation Recommendation or Issue 9:  UN agencies should adopt common Funding Authorization Certificate of Expenditures forms for all UN agencies to ensure alignment and harmonization of operational procedures;

Management Response: [Added: 2017/12/14]

Agreed

Key Actions:

Key Action Responsible DueDate Status Comments Documents
This requires UN agencies to come together and agree on synergy and complementary. It also requires RCO led joint strategy. UNDP will work internally to apply mechanism to joint operations and outreach mechanisms.
[Added: 2017/12/14] [Last Updated: 2018/08/20]
UNDP 2018/01 No Longer Applicable [Justification: No joint program is initiated]
No longer applicable History

Latest Evaluations

Contact us

1 UN Plaza
DC1-20th Floor
New York, NY 10017
Tel. +1 646 781 4200
Fax. +1 646 781 4213
erc.support@undp.org