Terminal evaluation of the Project ?Promote Sustainable Livelihoods and Responsible Attitude to Environment?

Report Cover Image
Evaluation Plan:
2011-2015, Georgia
Evaluation Type:
Final Project
Planned End Date:
12/2015
Completion Date:
10/2015
Status:
Completed
Management Response:
Yes
Evaluation Budget(US $):
20,000

Share

Document Type Language Size Status Downloads
Download document TOR-Evaluation - Borjomi Terminal-Nov2015.doc tor English 87.50 KB Posted 295
Download document Evaluation report-Borjomi Terminal-Nov2015.docx report English 279.11 KB Posted 551
Title Terminal evaluation of the Project ?Promote Sustainable Livelihoods and Responsible Attitude to Environment?
Atlas Project Number: 00075622
Evaluation Plan: 2011-2015, Georgia
Evaluation Type: Final Project
Status: Completed
Completion Date: 10/2015
Planned End Date: 12/2015
Management Response: Yes
Focus Area:
  • 1. Others
Corporate Outcome and Output (UNDP Strategic Plan 2014-2017)
  • 1. Output 1.4. Scaled up action on climate change adaptation and mitigation across sectors which is funded and implemented
Evaluation Budget(US $): 20,000
Source of Funding: project
Joint Programme: No
Joint Evaluation: No
Evaluation Team members:
Name Title Email Nationality
Nana Gibradze Independent Consultant GEORGIA, REPUBLIC OF
Kate Skhireli Independent Consultant GEORGIA, REPUBLIC OF
GEF Evaluation: No
Key Stakeholders:
Countries: GEORGIA, REPUBLIC OF
Lessons
Findings
Recommendations
1

UNDP Georgia can further increase the relevance of its interventions by testing and promoting innovative approaches that can have high social and economic impact. Given the strategic directions of the UNDP Strategic Plan 2014-2017 and the advances made by the Project, UNDP Georgia has a significant opportunity to pursue comprehensive multi-sectorial projects, which encompass some of the essential aspects of sustainable human development, identified in the Quadrennial Comprehensive Policy Review: resilience, poverty, women’s empowerment and gender equality and sustainable development.

2

To increase the effectiveness and sustainability of similar interventions, the Evaluation strongly suggests including policy components to contribute to the improvement of the enabling environment and to increase the odds of sustainability of the results. The Evaluation strongly recommends fostering stronger ties with the Ministry of Finance, Agriculture, Regional Development and Justice, to name a few, by engaging them in the design of the intervention and of the exit and sustainability strategies. The Evaluation also suggests further enhancing the visibility of the key national stakeholders, such as the Ministry of Environment Protection and Ministry of Education, to promote the national ownership of the Project and secure their unwavering support and participation. 

Likewise, the Evaluation recommends the inclusion of capacity development and awareness raising activities for national stakeholders, such as line ministries and departments and municipal authorities. The Evaluation also considers it essential to include media in capacity development activities, providing specialized training for involved media outlets, including analysts, reporters and camera operators.

3

For increased effectiveness of  interventions related to agriculture, the Evaluation recommends to continue providing technical assistance to link the beneficiaries with relevant national structures and potential financial sources, including donor agencies (e.g. ENPARD) and banks. Likewise, the Evaluation recommends continuing the successful practice of strengthening organizational capacities, including legal registration of organizations. To the extent possible, the Evaluation suggests exploring the possibility of legally registering the entities at the early stage of project implementation to allow longer time for developing organizational structures and links. The Evaluation highly recommends continuing the provision, where possible, of technical assistance and legal advice on issues related to land ownership, title rights, and insurance of land and equipment.

4

As a measure of future efficiency and sustainability, the Evaluation recommends using the trained beneficiaries as the human resource base for multidisciplinary programmes and projects of regional scope. Thus, the Rural Farmers’ Association Green Valley can be used as a base for targeting local communities in the areas of disaster risk reduction, local area development, business incubators, and the like. Trained farmers and guesthouse owners, as well as eco-club members and school representatives, can be used as trainers and educators, for replicating the project model in other regions

5

To increase the efficiency and effectiveness of future similar interventions, the Evaluation recommends increasing the involvement of the United Nations Country Team (UNCT) in comprehensive multi-disciplinary interventions of this type. This will foster the interagency cooperation and add value to UNDP work by complementing it with agency-specific competencies and strengths. The Evaluation considers that participation of such agencies as United Nations Children’s Fund (UNICEF) and Food and Agriculture Organization (FAO) in the design and implementation of such initiatives can add value to DRR, education, and agricultural components, while the engagement of UNWOMEN would be particularly valuable for enhancing the gender equality component. To the extent possible, participation of specialized branches of UNEP, such as REDD and Poverty and Environment would be an additional asset for the environmental projects

6

Monitoring and Evaluation is essential for the effectiveness, efficiency and sustainability of interventions. While the Evaluation considers that the Project Management Unit carried out highly satisfactory monitoring of the Project, it is essential to carry out annual ex-post monitoring in the next 3-5 years to assess the real sustainability of the results and their impact. In the absence of the full-time Monitoring and Evaluation Officer in the Country Office to carry out ex-post monitoring of the results, the Evaluation recommends considering the inclusion of Project in the review of Environment and Energy Portfolio as part of the CPAP review (if carried out) or through monitoring of other projects of the Environment and Energy Team

7

As a way of fostering the relevance and effectiveness of UNDP work, the Evaluation highly recommends systematization of the successful experiences and vast technical and methodological knowledge generated by the Project. As a unique experimental intervention with the significant rate of success and potential impact and thorough scientific approach, the Project can serve as a reference for UNDP, donor community and national stakeholders and highly reduce transaction costs of similar endeavors in the future. The experience has generated sufficient knowledge that can be consolidated in a form of a guide-book or a case study for dissemination to stakeholders and bemused for future resource mobilization and replication

8

To improve the effectiveness of its work, the Evaluation recommends that UNDP improve the quality of project baselines, indicators and targets for more effective monitoring and measurement of change towards the results. The Evaluation does not recommend any particular type of indicators (qualitative, quantitative or proxy), however, the Team suggests that they follow the SMART criteria. The Evaluation also suggests using diverse sources for obtaining necessary baselines and targets, such as opinion surveys, statistical data, own assessments and reports (e.g. Rapid Rural Assessment), and the like.

1. Recommendation:

UNDP Georgia can further increase the relevance of its interventions by testing and promoting innovative approaches that can have high social and economic impact. Given the strategic directions of the UNDP Strategic Plan 2014-2017 and the advances made by the Project, UNDP Georgia has a significant opportunity to pursue comprehensive multi-sectorial projects, which encompass some of the essential aspects of sustainable human development, identified in the Quadrennial Comprehensive Policy Review: resilience, poverty, women’s empowerment and gender equality and sustainable development.

Management Response: [Added: 2017/01/26]

Agree

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Considering the experience gained and lessons learned from this project is indeed a good demonstrations for the relevance of such innovative interventions. This recommendation will be considered for future designs of UNDP interventions
[Added: 2017/01/26]
UNDP Georgia 2020/12 Not Initiated Since this project ended and at present there is no indication to secure funding for similar intervention from the same donor; this recommendation is considered for any other UNDP interventions, including in the area of rural/economic development, regional development or other livelihood programming in EE portfolio
2. Recommendation:

To increase the effectiveness and sustainability of similar interventions, the Evaluation strongly suggests including policy components to contribute to the improvement of the enabling environment and to increase the odds of sustainability of the results. The Evaluation strongly recommends fostering stronger ties with the Ministry of Finance, Agriculture, Regional Development and Justice, to name a few, by engaging them in the design of the intervention and of the exit and sustainability strategies. The Evaluation also suggests further enhancing the visibility of the key national stakeholders, such as the Ministry of Environment Protection and Ministry of Education, to promote the national ownership of the Project and secure their unwavering support and participation. 

Likewise, the Evaluation recommends the inclusion of capacity development and awareness raising activities for national stakeholders, such as line ministries and departments and municipal authorities. The Evaluation also considers it essential to include media in capacity development activities, providing specialized training for involved media outlets, including analysts, reporters and camera operators.

Management Response: [Added: 2017/01/26]

Agree

Key Actions:

Key Action Responsible DueDate Status Comments Documents
This recommendation is certainly valid and is being considered for the projects currently designed
[Added: 2017/01/26] [Last Updated: 2018/07/19]
UNDP Georgia 2017/12 Completed These suggestions were fully considered during the design of the big-scale project preparation for the Green Climate Fund on multi-hazard early warning systems; it diversifies partnership with various state agencies and has engaged them in consultations for the project design. The project also includes an extensive public awareness and capacity building component for media and relevant state authorities History
3. Recommendation:

For increased effectiveness of  interventions related to agriculture, the Evaluation recommends to continue providing technical assistance to link the beneficiaries with relevant national structures and potential financial sources, including donor agencies (e.g. ENPARD) and banks. Likewise, the Evaluation recommends continuing the successful practice of strengthening organizational capacities, including legal registration of organizations. To the extent possible, the Evaluation suggests exploring the possibility of legally registering the entities at the early stage of project implementation to allow longer time for developing organizational structures and links. The Evaluation highly recommends continuing the provision, where possible, of technical assistance and legal advice on issues related to land ownership, title rights, and insurance of land and equipment.

Management Response: [Added: 2017/01/26]

Agree

Key Actions:

Key Action Responsible DueDate Status Comments Documents
This recommendation is certainly valid and is being considered for the projects currently designed
[Added: 2017/01/26]
UNDP Georgia 2020/12 Not Initiated Since this project ended and at present there is no indication to secure funding for similar intervention from the same donor; this recommendation is considered for any other UNDP interventions, including in the area of rural/economic development, regional development or other livelihood programming in EE portfolio
4. Recommendation:

As a measure of future efficiency and sustainability, the Evaluation recommends using the trained beneficiaries as the human resource base for multidisciplinary programmes and projects of regional scope. Thus, the Rural Farmers’ Association Green Valley can be used as a base for targeting local communities in the areas of disaster risk reduction, local area development, business incubators, and the like. Trained farmers and guesthouse owners, as well as eco-club members and school representatives, can be used as trainers and educators, for replicating the project model in other regions

Management Response: [Added: 2017/01/26]

Agree

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Very useful recommendation that will indeed develop capacities of these individuals or organizations while at the same time enable usage of skills developed with earlier UNDP investments
[Added: 2017/01/26]
UNDP Georgia 2020/12 Not Initiated Since this project ended and at present there is no indication to secure funding for similar intervention from the same donor; this recommendation is considered for any other UNDP interventions, including in the area of rural/economic development, regional development or other livelihood programming in EE portfolio
5. Recommendation:

To increase the efficiency and effectiveness of future similar interventions, the Evaluation recommends increasing the involvement of the United Nations Country Team (UNCT) in comprehensive multi-disciplinary interventions of this type. This will foster the interagency cooperation and add value to UNDP work by complementing it with agency-specific competencies and strengths. The Evaluation considers that participation of such agencies as United Nations Children’s Fund (UNICEF) and Food and Agriculture Organization (FAO) in the design and implementation of such initiatives can add value to DRR, education, and agricultural components, while the engagement of UNWOMEN would be particularly valuable for enhancing the gender equality component. To the extent possible, participation of specialized branches of UNEP, such as REDD and Poverty and Environment would be an additional asset for the environmental projects

Management Response: [Added: 2017/01/26]

Agree

Key Actions:

Key Action Responsible DueDate Status Comments Documents
UNDP will ensure related consultations with the UNCT members depending on the scale, nature and type of joint interventions. These works are part of the UNPSD joint work planning
[Added: 2017/01/26]
UNDP Georgia /UNCT 2020/12 Initiated UNDP chairs all thematic task forces under the UNPSD 2016-2020; the TF develop joint annual work plans where possible joint interventions are agreed and implemented History
6. Recommendation:

Monitoring and Evaluation is essential for the effectiveness, efficiency and sustainability of interventions. While the Evaluation considers that the Project Management Unit carried out highly satisfactory monitoring of the Project, it is essential to carry out annual ex-post monitoring in the next 3-5 years to assess the real sustainability of the results and their impact. In the absence of the full-time Monitoring and Evaluation Officer in the Country Office to carry out ex-post monitoring of the results, the Evaluation recommends considering the inclusion of Project in the review of Environment and Energy Portfolio as part of the CPAP review (if carried out) or through monitoring of other projects of the Environment and Energy Team

Management Response: [Added: 2017/01/26]

Agree

Key Actions:

Key Action Responsible DueDate Status Comments Documents
UNDP considers this recomendation of crucial importance; since mid-2016 UNDP has full-time M&E Specialist who can undertake annual ex-post monitoring in 2017-2020
[Added: 2017/01/26]
UNDP Georgia 2020/12 Not Initiated If availability of resources permits, the CO may consider evaluation of the project impact and results towards end of the current programming cycle
7. Recommendation:

As a way of fostering the relevance and effectiveness of UNDP work, the Evaluation highly recommends systematization of the successful experiences and vast technical and methodological knowledge generated by the Project. As a unique experimental intervention with the significant rate of success and potential impact and thorough scientific approach, the Project can serve as a reference for UNDP, donor community and national stakeholders and highly reduce transaction costs of similar endeavors in the future. The experience has generated sufficient knowledge that can be consolidated in a form of a guide-book or a case study for dissemination to stakeholders and bemused for future resource mobilization and replication

Management Response: [Added: 2017/01/26]

Agree

Key Actions:

Key Action Responsible DueDate Status Comments Documents
UNDP CO will consider preparing such a guidebook or case study pending the funding availability
[Added: 2017/01/26]
UNDP Georgia 2020/12 Not Initiated This is indeed very useful suggestion; however due to the unavailability of funds to prepare such material, it cannot be initiated
8. Recommendation:

To improve the effectiveness of its work, the Evaluation recommends that UNDP improve the quality of project baselines, indicators and targets for more effective monitoring and measurement of change towards the results. The Evaluation does not recommend any particular type of indicators (qualitative, quantitative or proxy), however, the Team suggests that they follow the SMART criteria. The Evaluation also suggests using diverse sources for obtaining necessary baselines and targets, such as opinion surveys, statistical data, own assessments and reports (e.g. Rapid Rural Assessment), and the like.

Management Response: [Added: 2017/01/26]

Agreed

Key Actions:

Key Action Responsible DueDate Status Comments Documents
UNDP has hired full time M&E specialist since mid2016 who is tasked to ensure project logframes – outputs, baselines, indicators, targets are in line with the RBM principles
[Added: 2017/01/26] [Last Updated: 2018/07/19]
UNDP Georgia 2017/12 Completed UNDP has hired full time M&E specialist since beginning of 2018. History
UNDP has planned RBM training for its program staff in 2017 exactly to improve this area
[Added: 2017/01/26] [Last Updated: 2018/07/19]
UNDP Georgia 2017/12 No Longer Applicable [Justification: Due to priority changes currently the RBM training is not part of the workplan.]
Due to priority changes currently the RBM training is not part of the workplan. History

Latest Evaluations

Contact us

1 UN Plaza
DC1-20th Floor
New York, NY 10017
Tel. +1 646 781 4200
Fax. +1 646 781 4213
erc.support@undp.org