Assessment of UNDP Libya results on resilience phase one

Report Cover Image
Evaluation Plan:
2019-2020, Libya
Evaluation Type:
Final Project
Planned End Date:
12/2019
Completion Date:
11/2019
Status:
Completed
Management Response:
Yes
Evaluation Budget(US $):
30,000

Share

Document Type Language Size Status Downloads
Download document TOR Independent Evaluation of SLCRR Project.pdf tor English 325.95 KB Posted 87
Download document final report SLCRR .pdf report English 730.81 KB Posted 197
Title Assessment of UNDP Libya results on resilience phase one
Atlas Project Number: 00104158
Evaluation Plan: 2019-2020, Libya
Evaluation Type: Final Project
Status: Completed
Completion Date: 11/2019
Planned End Date: 12/2019
Management Response: Yes
Corporate Outcome and Output (UNDP Strategic Plan 2018-2021)
  • 1. Output 3.1.1 Core government functions and inclusive basic services4 restored post-crisis for stabilisation, durable solutions to displacement and return to sustainable development pathways within the framework of national policies and priorities
SDG Goal
  • Goal 1. End poverty in all its forms everywhere
SDG Target
  • 1.4 By 2030, ensure that all men and women, in particular the poor and the vulnerable, have equal rights to economic resources, as well as access to basic services, ownership and control over land and other forms of property, inheritance, natural resources, appropriate new technology and financial services, including microfinance
Evaluation Budget(US $): 30,000
Source of Funding: Project budget
Evaluation Expenditure(US $): 3,000
Joint Programme: No
Joint Evaluation: No
Evaluation Team members:
Name Title Email Nationality
GEF Evaluation: No
Key Stakeholders: European Union, project team as per the second phase
Countries: LIBYA
Comments:

By May 2019, this evaluation is reopening the call for applications to hire the international lead consultant.This, as per the previously selected candidate declined the offer for not been suitable to his agenda. The assumption is that the International and National evaluators will coordinate even if the international lead evaluator cannot be deployed to the ground . 

The CO will keep updating RBAS, in case there is a need to extend the evaluation due date. 

 

 

Lessons
Findings
Recommendations
1

Recruit a peace and conflict advisor to ensure conflict analysis and sensitivity is streamlined across the project and not as a separate component of one of the outputs, and closely guide and supervise the work of the PCI in line with UNDP conflict related guidance and DAC guidance. 

2

 Request support from the Regional Peace and Conflict advisor in Amman to review and improve the phase 3 design in line with the need to better integrate conflict and improve risk management

3

 Draw experience from other UNDP risk mapping tools and risk management strategies (such as in Lebanon), and consider developing a dynamic conflict mapping in Libya 

4

 Consider training all the UNDP staff (and EU staff if willing) on RBM and the development of RBM results hierarchies, in order to develop a joint vision at the higher level of the project outcome and the relevant indicators to measure the effects generated by the project (beyond output level)

5

 Improve the reporting capacity of the outcome level results (higher level results) and identify the relevant approaches (including satisfaction survey, perception surveys, etc.) for the intangible elements of the project 

6

Discuss at senior management the bottlenecks in the procurement process in order to facilitate delivery and results

7

It would be preferable for future evaluations to have all the relevant documents placed in a shared drive for the evaluation team to have access to the complete documentation at the onset of the evaluation

1. Recommendation:

Recruit a peace and conflict advisor to ensure conflict analysis and sensitivity is streamlined across the project and not as a separate component of one of the outputs, and closely guide and supervise the work of the PCI in line with UNDP conflict related guidance and DAC guidance. 

Management Response: [Added: 2019/11/25] [Last Updated: 2019/12/02]

  • UNDP Libya is in the process of recruiting a Conflict and Strategy Advisor for the office to provide a continuous conflict analysis of the regions in Libya and advise management with a view to identifying appropriate ‘entry points’ and recommending appropriate strategic responses for UNDP. This function would serve all UNDP Libya projects, including the Resilience project.
  • In relation to the work of PCI, The Project Team lead by the PM ensures close supervision of the work undertaken by PCI in compliance with UNDP rules and regulations.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Complete and finalize recruitment process
[Added: 2019/12/02] [Last Updated: 2020/08/25]
Management and Service Center, supported by Resilience Project Teams 2020/06 Completed The project liased with RBAS to get special advisory for conflict analysis from experts at the Bureau. History
2. Recommendation:

 Request support from the Regional Peace and Conflict advisor in Amman to review and improve the phase 3 design in line with the need to better integrate conflict and improve risk management

Management Response: [Added: 2019/11/25] [Last Updated: 2019/12/02]

The phase 3 documents, including the description of action, have been shared with the Regional Peace and Conflict Advisor to provide guidance and comments that would help to further strengthen the conflict sensitivity approaches. 

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Seek support from Regional Office in Amman and integrate inputs in the final phase 3 Description of Action
[Added: 2019/12/02] [Last Updated: 2020/08/25]
Resilience Project Manager, and Project Specialist 2020/06 Completed The project liased with RBAS to get special advisory for conflict analysis from experts at the Bureau. There was an expert on Conflict managemet and reconciliation advisoring the project during March 2020. Further advisory could be needed after the covid crisis. Still TBC though. History
3. Recommendation:

 Draw experience from other UNDP risk mapping tools and risk management strategies (such as in Lebanon), and consider developing a dynamic conflict mapping in Libya 

Management Response: [Added: 2019/11/25] [Last Updated: 2019/12/02]

The example of Lebanon was received, and it was internally shared with relevant UNDP Libya PMs and Officers. It will be further discussed and assessed if it could fit the Libya situation, involving both the CO’s SM/relevant teams as well as other UNDP partners and actors in Libya.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Sharing highlighting the ‘Monthly Tension Update’ example of Lebanon during UNDP CO and other existing coordination meetings.
[Added: 2019/12/10] [Last Updated: 2020/02/04]
Project Manager, and Project Specialist 2020/01 Completed the team shared the mentioned document History
4. Recommendation:

 Consider training all the UNDP staff (and EU staff if willing) on RBM and the development of RBM results hierarchies, in order to develop a joint vision at the higher level of the project outcome and the relevant indicators to measure the effects generated by the project (beyond output level)

Management Response: [Added: 2019/11/25] [Last Updated: 2019/12/02]

The CO  M&E Specialist jointly worked with the project team to streamline the RBM approach in the project document. As a result of thiscollaboration, the project's  new phase includes RBM features such as triple tier indicators (impact, outcome, output) with identified baselines , targets and corresponding verification means. This log frame and indicators set were also aligned with the European Union  macro, outcome and output indicators accounting for their strategic planning documents.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Review the project log frame and indicators set to address the evaluation recommendations.
[Added: 2019/12/02]
Project Management and CO M&E Specialist. 2019/12 Completed
5. Recommendation:

 Improve the reporting capacity of the outcome level results (higher level results) and identify the relevant approaches (including satisfaction survey, perception surveys, etc.) for the intangible elements of the project 

Management Response: [Added: 2019/11/25] [Last Updated: 2019/12/10]

the project manager will ensure, with the support from the CO M&E Specialist, as well as the project’s national M&E officer and IUNV reporting specialist (yet to be recruited), to strengthen monitoring mechanisms as well as impact reporting. Important to highlight that improvements were already done with the review of the log frame and corresponding indicatos, as well as on the foreseen increase of project team’s capacity (M&E and Reporting)

Key Actions:

Key Action Responsible DueDate Status Comments Documents
review of indicators set for phase 3
[Added: 2019/12/10]
project managemnet and CO M&E Specialist 2019/12 Completed new log frame available History
recruitment of project’s national M&E officer and IUNV reporting specialist
[Added: 2019/12/10] [Last Updated: 2020/05/08]
Project Manager, and Project Specialist with CO M&E specialist technical advice on the recuritment 2020/11 Not Initiated History
6. Recommendation:

Discuss at senior management the bottlenecks in the procurement process in order to facilitate delivery and results

Management Response: [Added: 2019/11/25] [Last Updated: 2019/12/10]

Discussions are ongoing with management about related issues. The newly inaugurated CO Service Center Unit willl have a better staffing to speed up the procurement processes.   

Key Actions:

Key Action Responsible DueDate Status Comments Documents
update procurement rpocess knowledge and corresponding SOPs
[Added: 2019/12/10]
service center unit together with the program and operations teams 2020/12 Initiated
7. Recommendation:

It would be preferable for future evaluations to have all the relevant documents placed in a shared drive for the evaluation team to have access to the complete documentation at the onset of the evaluation

Management Response: [Added: 2019/11/25] [Last Updated: 2019/12/10]

Will be considered in future evaluation processes

Key Actions:

Key Action Responsible DueDate Status Comments Documents
the project will create an open library where every team member will post relevant information for reporting, montioring and evaluation processes.
[Added: 2019/12/10]
programa manager and team members 2020/12 Not Initiated

Latest Evaluations

Contact us

1 UN Plaza
DC1-20th Floor
New York, NY 10017
Tel. +1 646 781 4200
Fax. +1 646 781 4213
erc.support@undp.org