Terminal Evaluation; Environmentally Sound Management and Destruction of PCBs

Report Cover Image
Evaluation Plan:
2014-2019, Mexico
Evaluation Type:
Final Project
Planned End Date:
07/2015
Completion Date:
09/2015
Status:
Completed
Management Response:
Yes
Evaluation Budget(US $):
14,795

Share

Document Type Language Size Status Downloads
Download document evaluacion BPC agosto 2015 final.pdf report Spanish 3010.71 KB Posted 326
Download document TORsevalucion bifenilos.docx tor Spanish 587.39 KB Posted 241
Title Terminal Evaluation; Environmentally Sound Management and Destruction of PCBs
Atlas Project Number: 59701
Evaluation Plan: 2014-2019, Mexico
Evaluation Type: Final Project
Status: Completed
Completion Date: 09/2015
Planned End Date: 07/2015
Management Response: Yes
Focus Area:
  • 1. Others
Corporate Outcome and Output (UNDP Strategic Plan 2014-2017)
  • 1. Output 1.3. Solutions developed at national and sub-national levels for sustainable management of natural resources, ecosystem services, chemicals and waste
Evaluation Budget(US $): 14,795
Source of Funding: GEF
Joint Programme: No
Mandatory Evaluation: No
Joint Evaluation: No
Evaluation Team members:
Name Title Email Nationality
Cristóbal Vignal Senior International Consultant
GEF Evaluation: Yes
GEF Project Title:
Evaluation Type: Terminal Evaluation
Focal Area: Persistent Organic Pollutants
Project Type: FSP
GEF Phase: GEF-3
GEF Project ID: 3270
PIMS Number: 3692
Key Stakeholders:
Countries: MEXICO
Lessons
Findings
Recommendations
1 UNDP should consider, when carrying out evaluation of FSPs, contracting a team of two evaluators, one international and one national, in a timely manner. These should be provided with sufficient time to carry out the evaluation and mission (visiting a representative sample of activities on the ground such as pilot sites) and to ensure that close linkages are established with both the UNDP Country Office Evaluation Unit, as well as with the GEF evaluation staff.
2 Active participation of all key Federal and state level stakeholders should continue to be encouraged after the project ends to ensure, in particular that the momentum gained be maintained and/or supported during the transition period between projects
3 Active participation of the private sector (hospitals, sensitive sectors, etc.) should continue to be encouraged and/or supported during the transition period between projects
4 Mechanisms should be put in place to facilitate the transfer and/or internalization of capacities built by the project management unit; as the projects progress in time, and in particular, well before they come to an end the risk always exists that this institutional memory and established network of contacts will fade and/or loose interest
5 UNDP should also actively explore opportunities to integrate the results achieved by this project into other cross cutting activities both in Mexico and regionally/internationally as it seeks to lay the foundation for future Stockholm Convention related interventions for all POPs
6 Identify, amongst those having benefitted from the awareness and capacity building activities, a set of ?ambassadors? to further disseminate results and engage stakeholders at all levels. Incentives to pursue these actions could take the form of diplomas or stipends (per diems) to cover participation at selected events and forums.
7 Awareness raising activities should - with a certain sense of urgency - be expanded to the general population. This would help to avoid situations where from a lack of knowledge/information, the owner of equipment/oils suspected of containing PCB could be tempted to dispose of these in an unsound manner, rather than facing perceived/real consequences and/or ?sanctions?. This was unfortunately already reported to the evaluator as having taken place in several instances in the only State visited during the field visits (Chiapas).
8 Promoting the use of the mechanisms recently approved by the country for the establishment of private-public partnerships (PPP - Alianza Publico Privada) for suppliers (Laboratories, Workshops, Destruction facilities) could facilitate the strengthening of capacity and should actively be supported in future phases of implementation of the Stockholm Convention in Mexico.
1. Recommendation: UNDP should consider, when carrying out evaluation of FSPs, contracting a team of two evaluators, one international and one national, in a timely manner. These should be provided with sufficient time to carry out the evaluation and mission (visiting a representative sample of activities on the ground such as pilot sites) and to ensure that close linkages are established with both the UNDP Country Office Evaluation Unit, as well as with the GEF evaluation staff.
Management Response: [Added: 2015/10/13]

The integration of a consulting team is recognized as a good practice to seek complementarities of approaches to assessment. However it is not stipulated as mandatory in POPPS of the organization. The timing associated to carrying out the evaluation complicated the search for an additional consultant. Therefore, in agreement with the counterpart and the Regional Technical Advisor, the project choose to advance with a single consultant For future evaluations in other projects, the integration of a consulting team will be prioritized to guarantee a balanced evaluation with the international and the national perspectives. Following evaluations will be carried out with more time to guarantee the availability of consultants for the preparation phases.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
For future evaluations in other projects, the integration of a consulting team will be prioritized to guarantee a balanced evaluation with the international and the national perspectives. Following evaluations will be carried out with more time to guarantee the availability of consultants for the preparation phases.
[Added: 2015/10/13] [Last Updated: 2015/12/17]
UNDP area 2015/08 Completed
2. Recommendation: Active participation of all key Federal and state level stakeholders should continue to be encouraged after the project ends to ensure, in particular that the momentum gained be maintained and/or supported during the transition period between projects
Management Response: [Added: 2015/10/13]

This is a direct responsibility of SEMARNAT. The Government would take advantage of the working group supported by the project to continue the actualization of its National Implementation Plan. Future initiatives related to the strengthening of national capacities for waste management will refer directly to the process that the project started. This would highlight the importance of the stakeholders involvement in the implementation of any activity related to this topic.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Promote the involvement of the stakeholders that supported the project in the actualization of the National implementation Plan for the Stockholm Convention. Promote a multi stakeholders participation strategy in future initiates implemented by UNDP related to the Stockholm convention
[Added: 2015/10/13] [Last Updated: 2015/12/17]
undp area 2015/08 No Longer Applicable
3. Recommendation: Active participation of the private sector (hospitals, sensitive sectors, etc.) should continue to be encouraged and/or supported during the transition period between projects
Management Response: [Added: 2015/10/13]

This is a direct responsibility of SEMARNAT. The Government would take advantage of the working group supported by the project to continue the actualization of its National Implementation Plan. Future initiatives related to the strengthening of national capacities for waste management will refer directly to the process that the project started. This would highlight the importance of the stakeholders involvement in the implementation of any activity related to this topic Promote the involvement of stakeholders that supported the project in the actualization of the National implementation Plan for the Stockholm Convention. Promote a multi stakeholder participation strategy in future initiates implemented by UNDP related to the Stockholm convention

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Promote the involvement of stakeholders that supported the project in the actualization of the National implementation Plan for the Stockholm Convention. Promote a multi stakeholder participation strategy in future initiates implemented by UNDP related to the Stockholm convention
[Added: 2015/10/13] [Last Updated: 2015/12/17]
undp area 2015/08 No Longer Applicable
4. Recommendation: Mechanisms should be put in place to facilitate the transfer and/or internalization of capacities built by the project management unit; as the projects progress in time, and in particular, well before they come to an end the risk always exists that this institutional memory and established network of contacts will fade and/or loose interest
Management Response: [Added: 2015/10/13]

SEMARNAT institutionalized the main project outputs (the Norm modification, national inventory, the Integrated Management system, among others). The Project Unit worked very closely to SEMARNAT´s officers and other stakeholders. Nevertheless, the rotation in SEMARNAT´s staff is a risk that affect the institutional capacities. Exit strategy should be put into place from the very beginning of the project. This was intended by the project and partially since the main outputs had already been institutionalized (NOM, Integrated Management Systems, National Inventory, maintenance enterprises certified. Etc. For future projects it will be necessary to prevent staff rotation in the national institutions to prevent possible gaps in the institutional strengthening processes.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Exit strategy should be put into place from the very beginning of the project. This was intended by the project and partially since the main outputs had already been institutionalized (NOM, Integrated Management Systems, National Inventory, maintenance enterprises certified. Etc. For future projects it will be necessary to prevent staff rotation in the national institutions to prevent possible gaps in the institutional strengthening processes.
[Added: 2015/10/13] [Last Updated: 2015/12/17]
undp area 2015/08 No Longer Applicable
5. Recommendation: UNDP should also actively explore opportunities to integrate the results achieved by this project into other cross cutting activities both in Mexico and regionally/internationally as it seeks to lay the foundation for future Stockholm Convention related interventions for all POPs
Management Response: [Added: 2015/10/13]

An entire portfolio of projects related with POPs is been developed by CO. Recently, a new project aimed to strengthen the national capacities for Sound Management of POPs Containing Waste in Mexico was approved, two new initiatives are being formulated: one related to PCBs and another one to strengthen the management of plastics used in the agro sector that may contain pesticides. The experience and lessons learned, as well as the tools developed in the PBBs project would be fully used in the implementation of the new presented a new phase for the adequate management of BPCs Reference the project outputs in future initiatives and use the tools developed that has proved its effectiveness. Future initiatives should also continue strengthening coordination spaces created by the PCBs project such as the Technical Advisory Committees, etc.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Reference the project outputs in future initiatives and use the tools developed that has proved its effectiveness. Future initiatives should also continue strengthening coordination spaces created by the PCBs project such as the Technical Advisory Committees, etc.
[Added: 2015/10/13] [Last Updated: 2015/12/17]
undp area 2015/08 Completed
6. Recommendation: Identify, amongst those having benefitted from the awareness and capacity building activities, a set of ?ambassadors? to further disseminate results and engage stakeholders at all levels. Incentives to pursue these actions could take the form of diplomas or stipends (per diems) to cover participation at selected events and forums.
Management Response: [Added: 2015/10/13]

The most important partners in addressing this challenge have been identified. These actors may be included in future initiatives related to the Stockholm Convention and the National Implementation Plan. For UNDP Projects, they will be considered as part of the Technical Steering Committee to strength the exchange of information, improve the awareness raising and the synergies development. Future initiatives should continue the strengthening of coordination spaces created by the PCBs project such as the Technical Advisory Committees, etc.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Future initiatives should continue the strengthening of coordination spaces created by the PCBs project such as the Technical Advisory Committees, etc.
[Added: 2015/10/13] [Last Updated: 2015/12/17]
undp area 2015/08 No Longer Applicable
7. Recommendation: Awareness raising activities should - with a certain sense of urgency - be expanded to the general population. This would help to avoid situations where from a lack of knowledge/information, the owner of equipment/oils suspected of containing PCB could be tempted to dispose of these in an unsound manner, rather than facing perceived/real consequences and/or ?sanctions?. This was unfortunately already reported to the evaluator as having taken place in several instances in the only State visited during the field visits (Chiapas).
Management Response: [Added: 2015/10/13]

The project implemented a very successful awareness raising campaign, articulating efforts and promoting trust between stakeholders (authorities, enterprises and technicians). The recommendation focuses on outreach to a wider audience, which is beyond the means of the project because it is a sensitive issue. Future project should include a dissemination campaign to a wider audience.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Future project should include a dissemination campaign to a wider audience.
[Added: 2015/10/13] [Last Updated: 2015/12/17]
undp area 2015/08 No Longer Applicable
8. Recommendation: Promoting the use of the mechanisms recently approved by the country for the establishment of private-public partnerships (PPP - Alianza Publico Privada) for suppliers (Laboratories, Workshops, Destruction facilities) could facilitate the strengthening of capacity and should actively be supported in future phases of implementation of the Stockholm Convention in Mexico.
Management Response: [Added: 2015/10/13]

In this context, a new initiative is under construction as a second phase to help the country meet its goals of destruction and where the role of private initiative will be key. The project strengthened the national capacities and policies that should now be used to fulfil the goals. Similarly, the project generated a space of trust with the private sector, particularly companies of equipment maintainer and insurance scheme provider should be strengthened to give options to the other companies, states and municipalities to avoid cross-contamination in the equipment.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Future initiatives should continue the strengthening of coordination with the private sector
[Added: 2015/10/13] [Last Updated: 2015/12/17]
undp area 2015/08 Completed

Latest Evaluations

Contact us

220 East 42nd Street
20th Floor
New York, NY 10017
Tel. +1 646 781 4200
Fax. +1 646 781 4213
erc.support@undp.org