Final evaluation of the project "Initial implementation of accelerated HCFC Phase Out in the CEIT Region" PIMS 4309 FSP

Report Cover Image
Evaluation Plan:
2016-2020, Tajikistan
Evaluation Type:
Final Project
Planned End Date:
10/2018
Completion Date:
09/2018
Status:
Completed
Management Response:
Yes
Evaluation Budget(US $):
85,000

Share

Title Final evaluation of the project "Initial implementation of accelerated HCFC Phase Out in the CEIT Region" PIMS 4309 FSP
Atlas Project Number: 00066625
Evaluation Plan: 2016-2020, Tajikistan
Evaluation Type: Final Project
Status: Completed
Completion Date: 09/2018
Planned End Date: 10/2018
Management Response: Yes
Corporate Outcome and Output (UNDP Strategic Plan 2018-2021)
  • 1. Output 1.4.1 Solutions scaled up for sustainable management of natural resources, including sustainable commodities and green and inclusive value chains
Evaluation Budget(US $): 85,000
Source of Funding: GEF
Evaluation Expenditure(US $): 18,000
Joint Programme: No
Joint Evaluation: No
Evaluation Team members:
Name Title Email Nationality
Dalybor Kysela Evaluator
GEF Evaluation: Yes
GEF Project Title: HCFC Phase Out in the CEIT Region" PIMS 4309 FSP
Evaluation Type: Terminal Evaluation
Focal Area: Ozone Depleting Substances
Project Type: FSP
GEF Phase: GEF-4
GEF Project ID: 4102
PIMS Number: 4309
Key Stakeholders: UNDP, GEF
Countries: TAJIKISTAN
Lessons
Findings
Recommendations
1

Recommendation #1: UNDP should ensure that standards of frequently used ODS are provided to the countries implementing ODS reduction projects to enable both qualitative and quantitative analysis of refrigerants and refrigerant mixtures. In case internationally certified standards ca­n’t be imported to the project countries, support should be provided for development and local certification of ODS proxy standards using imported virgin refrigerants of declared purity

2

Recommendation #2: UNDP should consider provision of sufficient number of refillable refrigerant containers to the already established as well as new refrigerant reclaiming centers

3

Recommendation #3: UNDP should ensure that international advice on good practices in refrigerant reclamation industry, including advice on elaboration of technical and business plans, is provided to the countries implementing ODS reduction projects in order to improve operations of their national reclamation schemes

4

Recommendation #4: UNDP in cooperation with countries implementing ODS reduction projects should develop outreach activities aiming at the end-users of RAC equipment to explain risks and disadvantages of engagements with the informal servicing sub-sector. The end-user outreach programmes should in particular advocate that cheaper immediate options tend to lead to greater costs in the long term and as well as a worse environmental impact. 

5

Recommendation#5: UNDP together with the countries implementing ODS reduction projects should monitor developments under the UNIDO regional demonstration project on ODS disposal and ensure that national reporting systems are developed and functional for inventories of unwanted ODS and that information on the stock of ODS waste is readily available once a viable solution is proposed by the UNIDO project

6

Recommendation#6: UNDP should consider conducting an analysis of economic benefits of good practices in refrigeration servicing and retirement of ODS-based equipment for inclusion in public outreach programmes directed on SMEs and residential segment of the end users.

7

Recommendation#7: UNDP should ensure enlarged participation of qualified national trainers in future ODS-related train-the-trainers programmes and to the extent possible organize T-o-T events with the established refrigerant training centers in the ECA region in order to improve cost-effectiveness and overcome the language barrier.

8

Recommendation#8: UNDP should ensure that national counterparts from the countries implementing ODS reduction projects learn from the experience with the use of CO2 as refrigerant in the region. E-courses, study tours and train-the trainers programmes could be organized with the Training Centre on use of CO2 as refrigerant that was established at the NORD O.O.O. company in Moscow

9

Recommendation#9: UNDP should ensure that indicators in the results framework are attached to a time frame and state when they will be measured. The timely dimension of the indicators will allow for prioritization of actions in the project implementation plans

10

Recommendation#10: For procurement of portable refrigerant identifiers and RAC service tool kits, UNDP should consider either to conclude own LTAs or use LTAs already in place at sister organizations of the UN system that have acquired experience with procurement of equipment items for MP projects (e.g. UNIDO)

11

Recommendation#11: UNDP should ensure that Terms of Reference for procurement of major equipment items contain clear definition of related services to be guaranteed by the equipment suppliers, in particular that the supplier’s after sale service agents are operational in the recipient country or at least in the neighboring country. Provision of the after-sale services should be one of the criteria for commercial evaluation of bids submitted under the procurement event.

12

Recommendation#12: UNDP should ensure that national project implementation teams establish on-going operational monitoring on actually provided co-financing for the projects

1. Recommendation:

Recommendation #1: UNDP should ensure that standards of frequently used ODS are provided to the countries implementing ODS reduction projects to enable both qualitative and quantitative analysis of refrigerants and refrigerant mixtures. In case internationally certified standards ca­n’t be imported to the project countries, support should be provided for development and local certification of ODS proxy standards using imported virgin refrigerants of declared purity

Management Response: [Added: 2019/03/05]

Fully agree

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Organization discussions on the possibility to import virgin ODS standards to enable both qualitative and quantitative analysis of refrigerants and refrigerant mixtures with the national partners during the development of new GEF/UNDP project
[Added: 2019/03/05]
UNDP Sustainable Development Cluster 2020/11 Not Initiated Activities on close cooperation with the Committee of Environmental Protection, Agency of Standardization, metrology and certification (Tajikstandart), and the Customs Committee on improvement import/export control of ODS, including provision customs laboratories with virgin ODS standards included in the proposed project document of new UNDP/GEF MSP
2. Recommendation:

Recommendation #2: UNDP should consider provision of sufficient number of refillable refrigerant containers to the already established as well as new refrigerant reclaiming centers

Management Response: [Added: 2019/03/05]

Fully agree

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Provision of the information on re-equipping/ upgrading of refrigerant reclaiming centers with additional refillable refrigerant equipment during new GEF/UNDP project
[Added: 2019/03/05]
UNDP Sustainable Development Cluster 2020/12 Not Initiated Within new MSP established RR centers will be provided with additional refillable refrigerant equipment (pro-identifiers)
3. Recommendation:

Recommendation #3: UNDP should ensure that international advice on good practices in refrigerant reclamation industry, including advice on elaboration of technical and business plans, is provided to the countries implementing ODS reduction projects in order to improve operations of their national reclamation schemes

Management Response: [Added: 2019/03/05]

Fully agree

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Exchange of the best practices and knowledge gained with other countries in the region implementing ODS reduction projects
[Added: 2019/03/05]
UNDP Sustainable Development Cluster 2018/07 Completed The best practices, knowledge and lessons learnt have been presented during ECA networks and meetings in Vienna and Tashkent
4. Recommendation:

Recommendation #4: UNDP in cooperation with countries implementing ODS reduction projects should develop outreach activities aiming at the end-users of RAC equipment to explain risks and disadvantages of engagements with the informal servicing sub-sector. The end-user outreach programmes should in particular advocate that cheaper immediate options tend to lead to greater costs in the long term and as well as a worse environmental impact. 

Management Response: [Added: 2019/03/05]

Fully agree

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Development and inclusion to the Project Document of the new UNDP/GEF Project outreach activities with explanation risks and disadvantages of engagements with the informal servicing sub-sector
[Added: 2019/03/05]
UNDP Sustainable Development Cluster 2020/12 Initiated The proposed Project Document of new UNDP/GEF Project has separate component on Outreach and activities aiming at awareness raising of the end-users of RAC equipment to explain risks and disadvantages of engagements with the informal servicing sub-sector
5. Recommendation:

Recommendation#5: UNDP together with the countries implementing ODS reduction projects should monitor developments under the UNIDO regional demonstration project on ODS disposal and ensure that national reporting systems are developed and functional for inventories of unwanted ODS and that information on the stock of ODS waste is readily available once a viable solution is proposed by the UNIDO project

Management Response: [Added: 2019/03/05]

Fully agree

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Inclusion into the work plan of the new UNDP/GEF project activities for studying developments of UNIDO regional demonstration projects on ODS disposal and preparation proposal(s)
[Added: 2019/03/05]
UNDP Sustainable Development Cluster 2020/09 No Longer Applicable [Justification: Comment is very relevant, no change is needed; UNIDO regional demonstration center is no longer applicable, as the UNDP project will explore foreign study in Russian speaking countries]
Activities on networking improvement with international organizations and study advanced experience of foreign countries and development institutions included into the workplan of new UNDP/GEF MSP
Establishment of centralized storage house of ODS waste for further disposal and elimination
[Added: 2019/03/05]
UNDP Sustainable Development Cluster 2021/03 Not Initiated Within the new UNDP/GEF MSP, UNDP envisages modernization / renovation of specialized storage house of ODS wastes/ alternative ODS unless the Government of Tajikistan will not take decision on its disposal and elimination
6. Recommendation:

Recommendation#6: UNDP should consider conducting an analysis of economic benefits of good practices in refrigeration servicing and retirement of ODS-based equipment for inclusion in public outreach programmes directed on SMEs and residential segment of the end users.

Management Response: [Added: 2019/03/05]

Fully agree

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Consideration, within new projects, conducting analysis of economic benefits of good practices in refrigeration servicing and retirement of ODS-based equipment and inclusion into work plan of new projects a public outreach programmes directed on SMEs and residential segment of the end users.
[Added: 2019/03/05]
UNDP Sustainable Development Cluster 2021/12 Not Initiated Activities on conducting analysis of economic benefits of good practices in refrigeration servicing and retirement of ODS-based equipment included into the workplan of new UNDP/GEF MSP
7. Recommendation:

Recommendation#7: UNDP should ensure enlarged participation of qualified national trainers in future ODS-related train-the-trainers programmes and to the extent possible organize T-o-T events with the established refrigerant training centers in the ECA region in order to improve cost-effectiveness and overcome the language barrier.

Management Response: [Added: 2019/03/05]

Fully agree

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Planning involvement of qualified national trainers in future international ODS-related train-the-trainers programmes in the training activities of new UNDP/GEF projects;
[Added: 2019/03/05]
UNDP Sustainable Development Cluster 2020/09 Not Initiated Organization and conducting training programme (ToTs, site and online trainings) for refrigeration technicians with involvement of local trainers planned within the proposed ProDoc of new UNDP/GEF MSP
8. Recommendation:

Recommendation#8: UNDP should ensure that national counterparts from the countries implementing ODS reduction projects learn from the experience with the use of CO2 as refrigerant in the region. E-courses, study tours and train-the trainers programmes could be organized with the Training Centre on use of CO2 as refrigerant that was established at the NORD O.O.O. company in Moscow

Management Response: [Added: 2019/03/05]

Fully agree

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Planning organization of international/ national study tours and educational train-the trainers programmes on application of CO2 and other natural refrigerants within new UNDP/GEF projects
[Added: 2019/03/05]
UNDP Sustainable Development Cluster 2021/09 Not Initiated Within new UNDP/GEF MSP, UNDP and related national partners/ beneficiaries will organize study the experience on application of natural refrigerants in cooling/air condition, including CO2
Planning organization of study-tours and educational training courses for RAC-technicians in remote areas of Tajikistan
[Added: 2019/03/05]
UNDP Sustainable Development Cluster 2021/12 Not Initiated Within new UNDP/GEF MSP, UNDP will organize study-tours, trainings, exchange of experiences and best practices amongst RAC-technicians in remote areas of Tajikistan by applying mobile education facilities and means
9. Recommendation:

Recommendation#9: UNDP should ensure that indicators in the results framework are attached to a time frame and state when they will be measured. The timely dimension of the indicators will allow for prioritization of actions in the project implementation plans

Management Response: [Added: 2019/03/05]

Fully agree

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Development of Project Results Framework of new GEF MSP on Complete HCFC Phase-out with measurable indicators tailored to the time-frame for prioritization of actions in the project implementation plans
[Added: 2019/03/05]
UNDP Sustainable Development Cluster 2018/11 Completed Project Results Framework of new GEF MSP on Complete HCFC Phase-out contains measurable indicators tailored to the time-frame for prioritization of actions in the project implementation plans. Project is approved by GEF in 2018
10. Recommendation:

Recommendation#10: For procurement of portable refrigerant identifiers and RAC service tool kits, UNDP should consider either to conclude own LTAs or use LTAs already in place at sister organizations of the UN system that have acquired experience with procurement of equipment items for MP projects (e.g. UNIDO)

Management Response: [Added: 2019/03/05]

Fully agree

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Review UNDP Tajikistan procurement rules and procedures on existence of recommended criteria for provision after-sale services
[Added: 2019/03/05]
UNDP Sustainable Development Cluster 2018/11 No Longer Applicable [Justification: UNDP has reviewed procurement rules and procedures and identified that the provision of after-sale services is one of the vendors selection criteria ]
11. Recommendation:

Recommendation#11: UNDP should ensure that Terms of Reference for procurement of major equipment items contain clear definition of related services to be guaranteed by the equipment suppliers, in particular that the supplier’s after sale service agents are operational in the recipient country or at least in the neighboring country. Provision of the after-sale services should be one of the criteria for commercial evaluation of bids submitted under the procurement event.

Management Response: [Added: 2019/03/05]

Fully agree

Key Actions:

Key Action Responsible DueDate Status Comments Documents
no longer applicable; as above; it is by default that supplier will ensure post-delivery guarantee payment on goods and services;
[Added: 2019/03/05]
no longer applicable; as above; it is by default that supplier will ensure post-delivery guarantee payment on goods and services; 2018/11 No Longer Applicable [Justification: no longer applicable; as above; it is by default that supplier will ensure post-delivery guarantee payment on goods and services; ]
12. Recommendation:

Recommendation#12: UNDP should ensure that national project implementation teams establish on-going operational monitoring on actually provided co-financing for the projects

Management Response: [Added: 2019/03/05]

Fully agree

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Inclusion into M&E plans of future projects operational monitoring on factually provided co-financing for the projects
[Added: 2019/03/05]
UNDP Sustainable Development Cluster 2020/05 Not Initiated Ongoing operational monitoring on factually provided co-financing for the projects by project beneficiaries included into the M&E plans of new UNDP/GEF MSP on Complete HCFC Phase-out

Latest Evaluations

Contact us

220 East 42nd Street
20th Floor
New York, NY 10017
Tel. +1 646 781 4200
Fax. +1 646 781 4213
erc.support@undp.org