BRA/16/G76 Mid-term Evaluation Report - Brazilian HCFC Phase Out Management Plan (Stage II)

Report Cover Image
Evaluation Plan:
2017-2022, Brazil
Evaluation Type:
Final Project
Planned End Date:
09/2021
Completion Date:
08/2021
Status:
Completed
Management Response:
Yes
Evaluation Budget(US $):
25,000

Share

Document Type Language Size Status Downloads
Download document TOR-Av. Meio Termo_vf.docx tor Portuguese 5214.42 KB Posted 920
Download document 16G76 HCFC Phase Out Management Plan (Stage II) ENG FINAL.pdf report English 893.45 KB Posted 910
Title BRA/16/G76 Mid-term Evaluation Report - Brazilian HCFC Phase Out Management Plan (Stage II)
Atlas Project Number: 00091839
Evaluation Plan: 2017-2022, Brazil
Evaluation Type: Final Project
Status: Completed
Completion Date: 08/2021
Planned End Date: 09/2021
Management Response: Yes
Focus Area:
  • 1. Energy
  • 2. Others
Corporate Outcome and Output (UNDP Strategic Plan 2018-2021)
  • 1. Output 2.5.1 Solutions developed, financed and applied at scale for energy efficiency and transformation to clean energy and zero-carbon development, for poverty eradication and structural transformation
SDG Goal
  • Goal 7. Ensure access to affordable, reliable, sustainable and modern energy for all
  • Goal 9. Build resilient infrastructure, promote inclusive and sustainable industrialization and foster innovation
SDG Target
  • 7.1 By 2030, ensure universal access to affordable, reliable and modern energy services
  • 7.2 By 2030, increase substantially the share of renewable energy in the global energy mix
  • 9.4 By 2030, upgrade infrastructure and retrofit industries to make them sustainable, with increased resource-use efficiency and greater adoption of clean and environmentally sound technologies and industrial processes, with all countries taking action in accordance with their respective capabilities
Evaluation Budget(US $): 25,000
Source of Funding: Multilateral Fund Montreal Protocol
Evaluation Expenditure(US $): 2,000
Joint Programme: No
Joint Evaluation: Yes
  • Joint with Donors
Evaluation Team members:
Name Title Nationality
Guilherme M de Macedo MSC BRAZIL
GEF Evaluation: No
Key Stakeholders: Ministry of Environment, Montreal Protocol
Countries: BRAZIL
Lessons
Findings
Recommendations
1

A substantive revision of the Project is suggested to be carried out in the next two months to adjust the implementation time and budget funds for an extended execution period until 2024, and to confirm the list of enterprises to be technologically converted until the conclusion of the Project.

2


It is recommended to extend the execution period without harming the funds allocated and scheduled for disbursement to achieve the expected targets and indicators, allowing to make up for the delays caused by the two years of pandemic and the replacement of the contract model for a more suitable LTA type.

3

It is suggested to insist with the National Congress and specific Commissions on the importance to ratify of the Kigali Amendment to the Montreal Protocol.

4

It is recommended to hire more national consultants to support SHs, speed up the technological conversion of end-users, and update the list of the enterprises that still adhere to the Project.

5

It is proposed the elaboration of two half-yearly progress reports considering the time cycles required for the conversion of the SHs, Individual enterprises and End Users.

6

It is suggested to hire a consultant to sustain and update the information flow through the website, brochures, videos and seminars to improve the communication with enterprises, public officials, NGOs, business associations, and the general public.

7

It is recommended the elaboration of a document (manual) containing the systematization of the procedures carried out in conversion projects of different kinds, good practices and lessons learned during the different phases of implementation.

8

It is recommended to include in the substantive review a column in the section referring to "Assumptions", i.e., prerequisites to be obtained for the achievement of Outputs and Outcomes, and their corresponding risk assessment rating if obtained within the proposed timeframe.

1. Recommendation:

A substantive revision of the Project is suggested to be carried out in the next two months to adjust the implementation time and budget funds for an extended execution period until 2024, and to confirm the list of enterprises to be technologically converted until the conclusion of the Project.

Management Response: [Added: 2021/11/11]

A substantive revision of the project requesting additional extension from 31 December 2021 to 31 December 2024 was submitted to the Project Board Committee composed by UNDP, Ministry of Environment and Brazilian Cooperation Agency on May 2021. The request has been approved and signatures by the parties on the final document is in progress.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Substantive revision of the Project BRA/16/G76 in progress
[Added: 2021/11/11] [Last Updated: 2022/01/24]
UNDP 2021/11 Completed Substantive revision of the Project BRA/16/G76 finalized. History
2. Recommendation:


It is recommended to extend the execution period without harming the funds allocated and scheduled for disbursement to achieve the expected targets and indicators, allowing to make up for the delays caused by the two years of pandemic and the replacement of the contract model for a more suitable LTA type.

Management Response: [Added: 2021/11/11]

Substantive revision of the project requesting additional extension from 31 December 2021 to 31 December 2024 was submitted to the Project Board Committee composed by UNDP, Ministry of Environment and Brazilian Cooperation Agency on May 2021.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Substantive revision of the Project BRA/16/G76 in progress.
[Added: 2021/11/11] [Last Updated: 2022/01/24]
UNDP 2021/11 Completed Substantive revision of the Project BRA/16/G76 finalized. History
3. Recommendation:

It is suggested to insist with the National Congress and specific Commissions on the importance to ratify of the Kigali Amendment to the Montreal Protocol.

Management Response: [Added: 2021/11/11]

The Government through MMA and the Ministry of Foreign Affairs is doing its utmost to have the Kigali Amendment approved by the Congress.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Continue to give all the support for the Kigali Amendment ratification.
[Added: 2021/11/11]
MMA 2022/12 Initiated
4. Recommendation:

It is recommended to hire more national consultants to support SHs, speed up the technological conversion of end-users, and update the list of the enterprises that still adhere to the Project.

Management Response: [Added: 2021/11/11]

A pilot phase is ongoing when technical consultant with great experience in the PU market was hired to support a system house in clarifying doubts and convincing their end users through virtual meetings. Although the offer was made to the nine (9) system houses engaged on the Long-Term Agreement with UNDP in 2021, but only one of them accepted the offer. The others preferred to wait for the preliminary results of this pilot phase to decide to join this initiative.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Evaluate pilot phase results and replicate the mechanism to other system houses, if applicable.
[Added: 2021/11/11]
UNDP 2022/12 Initiated
5. Recommendation:

It is proposed the elaboration of two half-yearly progress reports considering the time cycles required for the conversion of the SHs, Individual enterprises and End Users.

Management Response: [Added: 2021/11/11]

The project count with a continuously monitoring and evaluation process carried out throughout its execution, ensuring the availability of management information through Progress Reports for all stakeholders, in addition to meeting criteria defined by the FML regarding the presentation of Progress Reports and Action Plans that supported the preparation of Substantive Reviews, submitted for approval of the Project Board Committee , according to financial contribution needs for the implementation of investment projects.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Continue carrying out project monitoring.
[Added: 2021/11/11]
UNDP 2022/12 Initiated
6. Recommendation:

It is suggested to hire a consultant to sustain and update the information flow through the website, brochures, videos and seminars to improve the communication with enterprises, public officials, NGOs, business associations, and the general public.

Management Response: [Added: 2021/11/11]

The consultant will be hired through project BRA/21/G71 - Institutional Strengthening. The professional will support the Brazilian HCFC Phase out Management Plan (HPMP) and its projects implemented by UNDP, UNIDO and GIZ agencies

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Support the Ministry of Environment to draw the Terms of Reference.
[Added: 2021/11/11]
MMA 2022/12 Not Initiated
7. Recommendation:

It is recommended the elaboration of a document (manual) containing the systematization of the procedures carried out in conversion projects of different kinds, good practices and lessons learned during the different phases of implementation.

Management Response: [Added: 2021/11/11]

A Guide named “Use of Flammable Blowing Agents in the Preparation of Completely Formulated Polyols and of Foams for the Polyurethane Production Chain” was developed to support the enterprises in terms of the required safety parameters for those which opted for flammable technological options, with good practices and lessons learned during the investment projects implementation and is being edited for further electronic publication. Furthermore, a final report good practices and lessons learned during the different phases of implementation will be prepared.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Carry out awareness-raising and training activities when possible. Although diffusion of technology occurs relatively quickly, changes in awareness and behavior of technicians in their work routines may take years.
[Added: 2021/11/11]
UNDP 2024/12 Initiated
8. Recommendation:

It is recommended to include in the substantive review a column in the section referring to "Assumptions", i.e., prerequisites to be obtained for the achievement of Outputs and Outcomes, and their corresponding risk assessment rating if obtained within the proposed timeframe.

Management Response: [Added: 2021/11/11]

When the substantive review of the project was submitted to the Project Evaluation Committee in May 2021, the consultant responsible for the mid-term evaluation had not completed its evaluation due delays on the contract execution (June 2021). Therefore, there was not enough time to include the recommendation in the final document.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
The recommendation will be adopted if the project undergoes another substantive review
[Added: 2021/11/11]
UNDP 2024/12 Not Initiated

Latest Evaluations

Contact us

1 UN Plaza
DC1-20th Floor
New York, NY 10017
Tel. +1 646 781 4200
Fax. +1 646 781 4213
erc.support@undp.org