Final Evaluation: Promoting Energy Efficiency in Commercial Building

Report Cover Image
Evaluation Plan:
2017-2021, Thailand
Evaluation Type:
Final Project
Planned End Date:
06/2018
Completion Date:
08/2018
Status:
Completed
Management Response:
Yes
Evaluation Budget(US $):
42,000

Share

Document Type Language Size Status Downloads
Download document PIMS3937_78576_UNDP-GEF TERMINAL EVALUTION TOR_INT_22 NOV 17.pdf tor English 566.26 KB Posted 142
Download document 180828R PEECB TE Report Final - Clean Version.pdf report English 1727.58 KB Posted 139
Title Final Evaluation: Promoting Energy Efficiency in Commercial Building
Atlas Project Number: 00061807
Evaluation Plan: 2017-2021, Thailand
Evaluation Type: Final Project
Status: Completed
Completion Date: 08/2018
Planned End Date: 06/2018
Management Response: Yes
UNDP Signature Solution:
  • 1. Resilience
Corporate Outcome and Output (UNDP Strategic Plan 2018-2021)
  • 1. Output 2.1.1 Low emission and climate resilient objectives addressed in national, sub-national and sectoral development plans and policies to promote economic diversification and green growth
SDG Goal
  • Goal 17. Strengthen the means of implementation and revitalize the Global Partnership for Sustainable Development
  • Goal 7. Ensure access to affordable, reliable, sustainable and modern energy for all
  • Goal 9. Build resilient infrastructure, promote inclusive and sustainable industrialization and foster innovation
SDG Target
  • 17.14 Enhance policy coherence for sustainable development
  • 7.3 By 2030, double the global rate of improvement in energy efficiency
  • 9.4 By 2030, upgrade infrastructure and retrofit industries to make them sustainable, with increased resource-use efficiency and greater adoption of clean and environmentally sound technologies and industrial processes, with all countries taking action in accordance with their respective capabilities
Evaluation Budget(US $): 42,000
Source of Funding: GEF
Evaluation Expenditure(US $): 35,000
Joint Programme: No
Joint Evaluation: No
Evaluation Team members:
Name Title Email Nationality
Roland Wong International Consultant rolandwong@shaw.ca
Walaitat Worakul National Consultant walaitat@hotmail.com THAILAND
GEF Evaluation: Yes
GEF Project Title: Promoting Energy Efficiency in Commercial Building in Thailand
Evaluation Type: Terminal Evaluation
Focal Area: Climate Change
Project Type: FSP
GEF Phase: GEF-4
GEF Project ID: 4165
PIMS Number: 3937
Key Stakeholders:
Countries: THAILAND
Lessons
Findings
Recommendations
1

Action 1: Preparation of a Project Planning Matrix (PPM) needs to strengthened with a Theory of Change (ToC) analysis and a Review of Outcomes to Impacts (ROtI) to ensure there is a reasonable likelihood that the outcomes will result in the desired impacts.  Notwithstanding that the PEECB Project was well executed resulting in the desired outcomes, this recommendation is intended to emphasize the importance of a well-prepared PPM that is clear to the implementers of the Project of the development progress to be made. During preparation stages of a project, the activities of the project should have clear linkages to global benefits (in the case of PEECB, a linkage to GHG emission reductions) through a ToC analysis.  A draft PPM should be prepared and reviewed through an iterative ROtI process which forces the designer to review how the project will reach the desired impacts from the designed project outcomes.  Project designers will need to review the pathways to achieve a desired impact that include intermediate states in between the outcomes and impacts. With an acceptable development pathway from outcomes to impacts, the designers should then review the PPM to ensure it reflects pathway to desired impacts.

2

Action 2: Continue strengthening linkages with other partners to increase the profile of PEECB outputs including the Bangkok Metropolitan Authority (BMA), and the Engineers and Architects of Thailand (EAT).  Strengthened linkages with BMA, EAT and other municipal-level partners can be leveraged to increase the familiarity and utility of these outputs amongst a wider spectrum of beneficiary stakeholders:

additional exposure of BEC and the efforts of DEDE on determination of EnPI values that 

  • will increase public confidence in SEC values for various building categories;

M&V guidelines developed under PEECB could be expanded or updated for new equipment with contributions from other stakeholders.  This could also include M&V guidelines linked and harmonized with MRV protocols being developed under ONEP.UNDP will endeavor to continue supporting DEDE in transferring expertise on EE for commercial buildings at the sub-national level (e.g., provinces, municipalities, towns) through Thailand smart cities initiative.

3

Action 3: Raise the prominence of the Building Disclosure Program to building owners (both owners who are participating and those who are not) and building tenants.  This may increase the awareness of participating building disclosure owners on the environmental reasons for disclosing their energy consumption that includes climate change mitigation, reduced imported fuels, and encouragement to other building owners to follow their specific example of implementing EE measures.

4

Action 4: Continue to improve the energy performance of new buildings through ongoing policy improvements. This would include continued support for:

  • the ongoing STEP-BEC programme to incentivize building owners to maximize energy savings;
  • analysing reports from over 3,000 designated buildings for baseline energy use, all of which are designed to determine EnPIs for various building categories, and to upgrade SEC values to be specified under a new Ministerial Regulation;

continued consultations with the Comptroller’s Office (Ministry of Finance) to develop a concrete proposal for e-Procurement for the public sector noting that the Comptroller’s Office is familiar with life-cycle analysis of equipment.  The next opportunity for these consultations is at the concluding PB meeting for PEECB sometime during the second quarter of 2018.

5

Action 5: Raise profile of energy efficiency in commercial buildings by developing a pilot “smart city zoning scheme” in close collaboration with the Bangkok Metropolitan Authority (BMA) to be located within a high density area (such as in the CBD or the Rama IV area).  This recommendation is consistent with one vision and 2 objectives of the BMA’s “Bangkok Comprehensive Plan 2013”[1] including Vision #5 of “a healthy metropolis that promote conservation of natural environment, Objective #10 on “conserving environment and natural resources by promoting conservation, maintenance and restoration”, Objective #12 on “promoting solution against global warming by expanding green areas in order to reduce greenhouse gases”, and Case #5 that “encourages a green building 

construction concept”.  Elements of this pilot scheme would include:

  • promoting the development and implementing energy efficiency and renewable energy measures and other low carbon measures for various building types (i.e. shopping centers, public buildings) within the designated zone;
  • integration of building databases of DEDE and BMA that would streamline approvals for BEC-compliant buildings as well as enforcement of energy conservation standards in designated buildings;
  • streamlining reporting from building managers on compliance to energy conservation standards through the development of an on-line system for reporting.  Such a system would reduce errors and encourage building owners to submit these reports which would add to the existing building databases; 
  • M&V for buildings in a smart zone and using this information to determine their EnPIs and improving their SEC values;
  • programme to strengthen and expand building inspectors pool in BMA that will improve their ability to inspect EE performance in buildings to comply with BEC and existing energy conservation standards, and their knowledge on tools (such as BESM and M&V guidelines) to execute their enforcement duties; and 
  • formulation of laws and regulations relevant to smart or green city development in the pilot area followed by the joint issuance of these laws and regulations by DEDE and BMA.

 


[1] http://cpd.bangkok.go.th:90/web2/NEWCPD2556/The%20Bangkok%20Comprehensive%20Plan%202013_a4_pdf.pdf

6

Action 6 (to DEDE): Strengthen linkages between TGO and demo buildings with an aim to incentivize building owners to invest in the energy efficiency through the generation and sale of Voluntary Emission Reductions (VERs).  This would require:

raising awareness of EECB owners through conducting seminars and workshops to present proposals and mechanisms from which VERs can be generated from energy efficiency investments in buildings (that can be commercial, 

  • residential, public or industrial) and sold to various clients in Thailand or abroad;
  • development of MRV protocols specific to energy efficiency in buildings to provide consistent and confident estimates of GHG emission reductions from EE measures in these buildings;
  • formalizing reporting protocols between demo buildings, ONEP, DEDE and TGO.  This may involve the integration of building databases of DEDE and BMA as mentioned in Action 6;

ensuring there is sufficient technical consulting capacity to support the needs of building owners to prepare GHG emission reduction amounts consistent with approved MRV protocols.

7

Action 7 (to DEDE): Expand an energy efficiency programme for all buildings leveraging the leadership provided by owners of the demonstration commercial buildings.  This would include:

efforts by DEDE to encourage owners of demo buildings in Bangkok who have commercial 

  • building assets in other cities to undertake a leadership role for EECBs in other cities.  This may involve a closer working relationship with these building owners (possibly through the Building Disclosure Programme) and encouraging them to share their experiences on implementing EE measures on their other buildings with other building owners in Thailand;
  • DEDE promotion of EE in buildings in other secondary cities in Thailand by sector including the hotel sector which could sell “green rooms” through a hotel association;
  • DEDE promotion of EE in public and residential buildings, with an initial focus within the boundaries of a pilot smart city (see Action 5).  Promotion of EE investments in residential buildings is expected to be more difficult due to the difficulties of demonstrating clear savings on energy costs that can help residents decide on such an investment; 
  • Encouragement of retrofits with incentives of VERs or CERs (see Action 6).
1. Recommendation:

Action 1: Preparation of a Project Planning Matrix (PPM) needs to strengthened with a Theory of Change (ToC) analysis and a Review of Outcomes to Impacts (ROtI) to ensure there is a reasonable likelihood that the outcomes will result in the desired impacts.  Notwithstanding that the PEECB Project was well executed resulting in the desired outcomes, this recommendation is intended to emphasize the importance of a well-prepared PPM that is clear to the implementers of the Project of the development progress to be made. During preparation stages of a project, the activities of the project should have clear linkages to global benefits (in the case of PEECB, a linkage to GHG emission reductions) through a ToC analysis.  A draft PPM should be prepared and reviewed through an iterative ROtI process which forces the designer to review how the project will reach the desired impacts from the designed project outcomes.  Project designers will need to review the pathways to achieve a desired impact that include intermediate states in between the outcomes and impacts. With an acceptable development pathway from outcomes to impacts, the designers should then review the PPM to ensure it reflects pathway to desired impacts.

Management Response: [Added: 2018/09/07]

The designers followed the ToC in accordance with UNDP standard. However, this project was designed prior to 2010. The success indicators were slightly adjusted during the implementation phase due to the change of project circumstance such as national energy efficiency (EE) target, GHG national reduction target, EE investment incentive offered by DEDE, EE technology update,

Remark: Project Planning Matrix (defined project goal, objective, outcomes, outputs and activities, including success indicators, as well as delineation of responsibilities among the stakeholders); concluded project implementation arrangements

Key Actions:

Key Action Responsible DueDate Status Comments Documents
For GEF 7, the current project design team will follow the UNDP guideline in consultation with stakeholders. The project will foresee 3-4 years circumstance in EE work at national and sub-national level as per Thailand NDC Roadmap.
[Added: 2018/09/07]
UNDP 2019/01 Overdue-Not Initiated Timeframe: During the start of each project design process.
2. Recommendation:

Action 2: Continue strengthening linkages with other partners to increase the profile of PEECB outputs including the Bangkok Metropolitan Authority (BMA), and the Engineers and Architects of Thailand (EAT).  Strengthened linkages with BMA, EAT and other municipal-level partners can be leveraged to increase the familiarity and utility of these outputs amongst a wider spectrum of beneficiary stakeholders:

additional exposure of BEC and the efforts of DEDE on determination of EnPI values that 

  • will increase public confidence in SEC values for various building categories;

M&V guidelines developed under PEECB could be expanded or updated for new equipment with contributions from other stakeholders.  This could also include M&V guidelines linked and harmonized with MRV protocols being developed under ONEP.UNDP will endeavor to continue supporting DEDE in transferring expertise on EE for commercial buildings at the sub-national level (e.g., provinces, municipalities, towns) through Thailand smart cities initiative.

Management Response: [Added: 2018/09/07]

DEDE is planning to continue strengthening linkages with other partners through follow on projects on BEC implementation and also EnPI.

UNDP will endeavor to continue supporting DEDE in transferring expertise on EE for commercial buildings at the sub-national level (e.g., provinces, municipalities, towns) through Thailand smart cities initiative.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Development of follow-up projects that also covers: 1. Implementation of BEC 2. Implementation on EnPI 3. Training programme development on M&V UNDP will explore funding opportunity from GEF-7, UK FCO, and the private sector.
[Added: 2018/09/07]
UNDP and DEDE 2019/12 Not Initiated
3. Recommendation:

Action 3: Raise the prominence of the Building Disclosure Program to building owners (both owners who are participating and those who are not) and building tenants.  This may increase the awareness of participating building disclosure owners on the environmental reasons for disclosing their energy consumption that includes climate change mitigation, reduced imported fuels, and encouragement to other building owners to follow their specific example of implementing EE measures.

Management Response: [Added: 2018/09/07]

DEDE is planning to further implement the Building Disclosure Program to around 50 buildings in different sectors including hotel, hospital and shopping center.

 

The 4 pilot cities of the ongoing UNDP-GEF “Low Carbon Growth Cities” can be potential cities for the implementation of the Building Disclosure Programme. 

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Development of a project for the implementation of the Building Disclosure Program. UNDP will assist the DEDE (if requested) in the development of such project.
[Added: 2018/09/07]
UNDP and DEDE 2019/12 Not Initiated
4. Recommendation:

Action 4: Continue to improve the energy performance of new buildings through ongoing policy improvements. This would include continued support for:

  • the ongoing STEP-BEC programme to incentivize building owners to maximize energy savings;
  • analysing reports from over 3,000 designated buildings for baseline energy use, all of which are designed to determine EnPIs for various building categories, and to upgrade SEC values to be specified under a new Ministerial Regulation;

continued consultations with the Comptroller’s Office (Ministry of Finance) to develop a concrete proposal for e-Procurement for the public sector noting that the Comptroller’s Office is familiar with life-cycle analysis of equipment.  The next opportunity for these consultations is at the concluding PB meeting for PEECB sometime during the second quarter of 2018.

Management Response: [Added: 2018/09/07]

After the completion of PEECB project, the results from each activity will continuously be carried out by the specific bureaus under DEDE to ensure the continuous implementation and improvement

  • STEP-BEC and EnPIs by Bureau of Energy Regulation and Conservation (BERC)

EE-Procurement by Bureau of Energy Efficiency Promotion (BEEP)

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Follow on activities by the relevant bureaus (BERC and BEEP) in DEDE.
[Added: 2018/09/07]
DEDE 2019/12 Not Initiated
5. Recommendation:

Action 5: Raise profile of energy efficiency in commercial buildings by developing a pilot “smart city zoning scheme” in close collaboration with the Bangkok Metropolitan Authority (BMA) to be located within a high density area (such as in the CBD or the Rama IV area).  This recommendation is consistent with one vision and 2 objectives of the BMA’s “Bangkok Comprehensive Plan 2013”[1] including Vision #5 of “a healthy metropolis that promote conservation of natural environment, Objective #10 on “conserving environment and natural resources by promoting conservation, maintenance and restoration”, Objective #12 on “promoting solution against global warming by expanding green areas in order to reduce greenhouse gases”, and Case #5 that “encourages a green building 

construction concept”.  Elements of this pilot scheme would include:

  • promoting the development and implementing energy efficiency and renewable energy measures and other low carbon measures for various building types (i.e. shopping centers, public buildings) within the designated zone;
  • integration of building databases of DEDE and BMA that would streamline approvals for BEC-compliant buildings as well as enforcement of energy conservation standards in designated buildings;
  • streamlining reporting from building managers on compliance to energy conservation standards through the development of an on-line system for reporting.  Such a system would reduce errors and encourage building owners to submit these reports which would add to the existing building databases; 
  • M&V for buildings in a smart zone and using this information to determine their EnPIs and improving their SEC values;
  • programme to strengthen and expand building inspectors pool in BMA that will improve their ability to inspect EE performance in buildings to comply with BEC and existing energy conservation standards, and their knowledge on tools (such as BESM and M&V guidelines) to execute their enforcement duties; and 
  • formulation of laws and regulations relevant to smart or green city development in the pilot area followed by the joint issuance of these laws and regulations by DEDE and BMA.

 


[1] http://cpd.bangkok.go.th:90/web2/NEWCPD2556/The%20Bangkok%20Comprehensive%20Plan%202013_a4_pdf.pdf

Management Response: [Added: 2018/09/07]

DEDE will collaborate with BMA to study the opportunity in developing the recommended pilot project.

If requested by DEDE, or BMA or preferably by other cities, UNDP can assist in the development of a more appropriate “smart city” project concept.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Discuss with DEDE and interested city governments on potential collaboration in the development and implementation of a project on sustainable cities or sustainable urban development.
[Added: 2018/09/07]
DEDE 2019/12 Not Initiated
6. Recommendation:

Action 6 (to DEDE): Strengthen linkages between TGO and demo buildings with an aim to incentivize building owners to invest in the energy efficiency through the generation and sale of Voluntary Emission Reductions (VERs).  This would require:

raising awareness of EECB owners through conducting seminars and workshops to present proposals and mechanisms from which VERs can be generated from energy efficiency investments in buildings (that can be commercial, 

  • residential, public or industrial) and sold to various clients in Thailand or abroad;
  • development of MRV protocols specific to energy efficiency in buildings to provide consistent and confident estimates of GHG emission reductions from EE measures in these buildings;
  • formalizing reporting protocols between demo buildings, ONEP, DEDE and TGO.  This may involve the integration of building databases of DEDE and BMA as mentioned in Action 6;

ensuring there is sufficient technical consulting capacity to support the needs of building owners to prepare GHG emission reduction amounts consistent with approved MRV protocols.

Management Response: [Added: 2018/09/07]

DEDE will collaborate with TGO to study the opportunity in developing of a pilot project as advise.

Key Actions:

7. Recommendation:

Action 7 (to DEDE): Expand an energy efficiency programme for all buildings leveraging the leadership provided by owners of the demonstration commercial buildings.  This would include:

efforts by DEDE to encourage owners of demo buildings in Bangkok who have commercial 

  • building assets in other cities to undertake a leadership role for EECBs in other cities.  This may involve a closer working relationship with these building owners (possibly through the Building Disclosure Programme) and encouraging them to share their experiences on implementing EE measures on their other buildings with other building owners in Thailand;
  • DEDE promotion of EE in buildings in other secondary cities in Thailand by sector including the hotel sector which could sell “green rooms” through a hotel association;
  • DEDE promotion of EE in public and residential buildings, with an initial focus within the boundaries of a pilot smart city (see Action 5).  Promotion of EE investments in residential buildings is expected to be more difficult due to the difficulties of demonstrating clear savings on energy costs that can help residents decide on such an investment; 
  • Encouragement of retrofits with incentives of VERs or CERs (see Action 6).
Management Response: [Added: 2018/09/07]

DEDE will implement the various projects to support the implementation of energy efficiency programme for building sector including both technical assistance and financial assistance projects.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Conceptualization and formulation of new projects that support the implementation of energy efficiency in buildings.
[Added: 2018/09/07]
DEDE 2019/12 Not Initiated Continuously implement

Latest Evaluations

Contact us

1 UN Plaza
DC1-20th Floor
New York, NY 10017
Tel. +1 646 781 4200
Fax. +1 646 781 4213
erc.support@undp.org