Mid-Term Review for the Project Mainstreaming Green Environmental Development

Report Cover Image
Evaluation Plan:
2015-2019, Bosnia and Hercegovina
Evaluation Type:
Mid Term Project
Planned End Date:
11/2017
Completion Date:
11/2017
Status:
Completed
Management Response:
Yes
Evaluation Budget(US $):
41,727

Share

Document Type Language Size Status Downloads
Download document Annex 4 ToR.pdf tor English 472.00 KB Posted 123
Download document BIH-RFP-024-17 GED Midterm Project Evaluation.pdf tor English 659.11 KB Posted 103
Download document BiH GED MTR FINAL.pdf report English 2183.69 KB Posted 291
Title Mid-Term Review for the Project Mainstreaming Green Environmental Development
Atlas Project Number: 00048025
Evaluation Plan: 2015-2019, Bosnia and Hercegovina
Evaluation Type: Mid Term Project
Status: Completed
Completion Date: 11/2017
Planned End Date: 11/2017
Management Response: Yes
Focus Area:
  • 1. Environment & Sustainable Development
  • 2. Others
Corporate Outcome and Output (UNDP Strategic Plan 2014-2017)
  • 1. Output 1.5. Inclusive and sustainable solutions adopted to achieve increased energy efficiency and universal modern energy access (especially off-grid sources of renewable energy)
Evaluation Budget(US $): 41,727
Source of Funding: Project budget/donor resources
Evaluation Expenditure(US $): 41,727
Joint Programme: No
Joint Evaluation: No
Evaluation Team members:
Name Title Email Nationality
Avantgarde Energy Company
GEF Evaluation: Yes
GEF Project Title: Mainstreaming Green Environmental Development (GED) Project
Evaluation Type: Mid-term Review
Focal Area: Biodiversity
Project Type: FSP
GEF Phase: GEF-1
GEF Project ID: 00048025
PIMS Number: 0000
Key Stakeholders: Environmental Fund of the Federation of Bosnia and Herzegovina Environmental Protection and Energy Efficiency Fund of RS; Ministry of Foreign Trade and Economic Relations of BiH; Swedish International Cooperation Development Agency (SIDA)
Countries: BOSNIA AND HERCEGOVINA
Lessons
1.

Due to limited and therefore relatively slow state-level planning processes, the complexity of state-entity interactions and the country’s administrative divisions and responsibilities, this situation analysis argues that further enforcement of energy efficiency / renewable energy in BiH should focus on a bottom-up (local-ministries/canton/entity-state) rather than top-down (state-ministries/canton/entity-local) approach while creating MVR, market and financial EE / RES mechanisms in Bosnia and Herzegovina. This would contribute to faster the creation of an environment attractive for EE /RES investments in the public and residential sector, generation of new employment and would result in the creation of clear energy monitoring and target achieving mechanisms within the country.


2.

The elements of the project level monitoring are based mostly om EMIS which contains records of public buildings, and track the results of implemented retrofit projects. While EMIS is an extremely effective and powerful tool to monitor key project results, such as real energy and cost savings, as well as associated GHG emission reduction, its functionality to track other socio-economic impacts is rather limited. For now it only provides data on the building end-users, without further disaggregation by gender and/or other socio-economic factors. Additional efforts are needed to systematically collect such information for pilot projects.  


3.

One UNDP sub-contractor was not aware on the project’s visibility requirements and placed a plaque on the project sites which was not complaint with the rules. It is therefore important that not only GED project staff, but its sub-contractors as well were briefed and relevant provisions included in the contracts mandating suppliers to comply with project visibility policies and requirements. 


Findings
1.

Overall impressions of project results achieved so far based on the documentary review, interviews with project stakeholders and site visits are positive. Project team is well structured and effective, the project interventions covered all geographical areas of BiH, the quality of work on visited site is good, and building users are satisfied with the improvements achieved, comfort levels increased and energy costs reduced.


2.

Project has achieved or surpassed all targets which in itself is a reason for high ratings, but what is also important to emphasize is that the project’s counterparts in Federation, RS and Kantons are also satisfied with joint work on the projects which they are co-financing.


3.

 Kanton Sarajevo and Municipality of Teslic are already making plans to expand their activities beyond the scope of jointly financed project. This is an important result for the Project in changing perception of local authorities toward EE in public buildings and it is a cornerstone for project sustainability.

 


4.

Ministry of Spatial planning in Federation sees the project as the key support and enabler for achieving commitments toward transpositions of EU - EPDB requirements. Of particular importance for the Ministry is the building stock register as being established within EMIS. Soon all the public buildings in Federation will be included in EMIS and this will present powerful tool for EE policy making for building sector.


5.

EE Fund in Federation sees the project support as essential in enabling them to move from grant financing to loan based financing. They value particularly support for preparation of necessary acts, and EMIS as a logistic support for selecting projects for financing and for monitoring results of implemented projects.


6.

The Ministry of Spatial planning and EE fund in RS share the views of their counterparts in the Federation. They are considering various options for IT support for overall EE program implementation, i.e. not only in buildings, but as of building sector EMIS is the key tool for their program implementation.


7.

Project has established good cooperation with the related World Bank EE projects, particularly in the RS. There is also good cooperation with USAID project EIA, and with GIZ. The UNDP and GIZ activities have a number of common points, but apparently there is an agreement on division of work in order to avoid overlaps.


8.

GED Project has also collaborated well with UNDP-implemented Biomass Market Promotion project (funded by the Czech Development Agency). Through this collaboration a number of investments featuring both EE and RE/fuel switch (biomass) measures in public buildings have been supported demonstrating practical benefits of “low-energy” buildings, as well as environmental, social and economic feasibility of integrated EE-RE solutions.

 


9.

Project conducted extensive communication and outreach campaign regarding energy efficiency targeting a wide range of stakeholders.

 


Recommendations
1

Universal acceptance: Project should aim to achieve universal acceptance of EIMS as a tool for fostering energy efficiency in public buildings across both entities and all cantons, as well as on the state level

2

Extending coverage: In line with universal acceptance, Project should aim to spread retrofit project across all entities and cantons.

3

Enlarging scope of retrofit projects: In line with the EU EPBD directive which requires that every new public building from the year 2018 has to be of Net Zero Energy Building Standard (NZEB), retrofit project should include appropriate RES measures and integrate them with EE measure aiming at achieve nearly NZEB standard.

4

Upgrading EMIS: EMIS platform is already of a mature age and requires face lifting both in terms of user-friendliness and functionality. The graphical user interface has to be upgrade in line with current similar products standards (GIS aspects, google map, satellite images of cites and buildings, interactive dashboard, etc.). In terms of functionally, an building energy intensity mapping feature should be added. Once all public buildings are entered in the data base, this feature will allow immediate colour coded insight into energy efficiency of individual buildings. Another additional function should be for monitoring, verification and reporting of savings achieved in support for performance based granting and ESCO business model.

5

Adding street lightning: Street lighting efficiency improvement is very important for municipalities because public lighting accounts for significant part of municipal budgets, but also because efficient lighting is critical for creating safe and comfortable public space and living environment for the citizens. Therefore street light module should be added to EMIS.

6

Supporting Energy performance certificates (EPC): EPC are gaining acceptance and certification process is going to expand. In order to provide support for relevant Ministries for monitoring the process and assuring quality of accredited certification work, EMIS should be extended with a module which supports related co-locations for preparation EPC in an objective, transparent and comparable manner.

7

Contributing to SDGs: develop and implement monitoring framework to regularly monitor and assess SDG-related benefits of the project interventions, at the level of individual investment sub-projects and broadly for the whole project.

8

Mainstreaming Gender: Gender analysis: to understand the specific aspects of gender inequality, if exist, in the context of buildings energy (in)efficiency is concerned, and the social, economic and political factors underlying such inequalities, as well as the potential contributions of women and men to societal changes required to promote investment in energy efficiency;
• Gendered actions: identify and incorporate in the project design specific methods and tools to promote greater gender equality and reduce gender disparities in GED project activities.
• Gender-sensitive M&E: propose and measure the outcomes and impacts of project activities on women and men’s through gender- responsive M&E. It is suggested that all Project Components of the GED project to include at least one gender-related indicator, as elaborated in Table .

9

Strenghten Communications: Integrate in the scope of communication strategy and plan impact monitoring, in terms of improved awareness and behavioural changes among various targeted categories. In particular, the focus on monitoring changes in awareness and motivation among investment decision-makers could be additionally assessed and monitored
• Put more emphasis on communicating sustainable development impacts of EE investment (i.e. those which go beyond budgetary and energy saving), in particular such aspects as improved comfort and occupancy conditions for building users, health and education impacts of such investment, as well as gender dimension (see also recommendations from the gender section)
• Prepare and make publicly available information about investment projects in the form of simple fact sheets containing key information about achieved results, as well as visual (like “before and after” pictures)
• Every retrofit project upon completion should be described in simple fact sheet as a particular case study.

10

Donor’s visibility: Project should take care that on all project documents – intermediary and final – donor visibility requirements are properly observed. Also, it is important to make sure that all sub-contractors are duly informed about project’s visibility requirements and relevant provisions are incorporated in the TORs and sub-contracts. Nominate dedicated GED project staff member to regular monitor compliance of sub-contractors with such requirements.

1. Recommendation:

Universal acceptance: Project should aim to achieve universal acceptance of EIMS as a tool for fostering energy efficiency in public buildings across both entities and all cantons, as well as on the state level

Management Response: [Added: 2017/11/20] [Last Updated: 2017/12/07]

The reccmmendation is vald and accepted.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
1.1. Institutionalization of energy monitoring and reporting (EMIS) a. Incorporating EMIS into rulebooks for energy monitoring and reporting on entity level b. Further strengthening of entity funds for using EMIS as main tool for energy reporting and monitoring of savings in Public sector c. Introduction and acceptance of EMIS on state level government (MoFTER)
[Added: 2017/11/20] [Last Updated: 2018/09/20]
Energy and Environment Sector and Green Economic Development Project 2020/12 Initiated Both entity funds accepted EMIS as main tool for energy monitoring. Signed MoU with MOFTER for institutionalization of energy management. 20.09. 2018 Environmental funds of two entities continued using EMIS for energy consumption monitoring of public buildings registered so far. History
2. Recommendation:

Extending coverage: In line with universal acceptance, Project should aim to spread retrofit project across all entities and cantons.

Management Response: [Added: 2017/11/20] [Last Updated: 2017/12/07]

The recommendation is valid and accepted.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
2.1. Fundraising and expanding project activities throughout the country a. The sector and the project prepared and submitted new funding proposal for project extension and scaling up with intention to add minimum 54 new public buildings for retrofit. b. Project aim is to strengthen current and establish new partnerships with key local stakeholders (new cantons, municipalities, cities, institutions…) c. New activities will be added (renewable energy sources to remote areas off-grid, renewable energy sources installations into public sector buildings and public lighting)
[Added: 2017/11/20] [Last Updated: 2018/09/20]
Energy Environment Sector and Green Economic Development Project 2020/12 Initiated Project proposal submitted to SIDA. 20.09.2018: SIDA approved new phase of the project with additional funding in the value of 4 MEuro for the period of three years. History
3. Recommendation:

Enlarging scope of retrofit projects: In line with the EU EPBD directive which requires that every new public building from the year 2018 has to be of Net Zero Energy Building Standard (NZEB), retrofit project should include appropriate RES measures and integrate them with EE measure aiming at achieve nearly NZEB standard.

Management Response: [Added: 2017/11/20] [Last Updated: 2017/12/07]

The recommendation is valid and accepted.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
3.1 Implement additional energy efficiency measures in public sector buildings a. The project aims to perform “deep retrofit” in public sector buildings by installation of energy efficiency/ renewable energy source equipment and therefore promote country’s move towards NZEBS (net zero energy building standard) b. Develop Policy for Nearly Zero Energy Building Standard
[Added: 2017/11/20] [Last Updated: 2018/09/20]
Energy Environment Sector and Green Economic Development Project 2020/12 Initiated Project proposal submitted to SIDA. Project plans to implement this activity at minimum 18 public buildings. 20.09.2018: Project identified public buildings to be retrofitted starting in 2018. Final figure is still to be defined, depending on the interests of local communities. History
4. Recommendation:

Upgrading EMIS: EMIS platform is already of a mature age and requires face lifting both in terms of user-friendliness and functionality. The graphical user interface has to be upgrade in line with current similar products standards (GIS aspects, google map, satellite images of cites and buildings, interactive dashboard, etc.). In terms of functionally, an building energy intensity mapping feature should be added. Once all public buildings are entered in the data base, this feature will allow immediate colour coded insight into energy efficiency of individual buildings. Another additional function should be for monitoring, verification and reporting of savings achieved in support for performance based granting and ESCO business model.

Management Response: [Added: 2017/11/20] [Last Updated: 2017/12/07]

The recommendation is valid and accepted.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
4.1 In line with MTR, project integrated into new project proposal the development of Energy intensity mapping application
[Added: 2017/11/20] [Last Updated: 2018/09/20]
Energy Environment Sector and Green Economic Development Project 2019/12 Initiated Project proposal submitted to SIDA. 20.09.2018: The new project phase II includes activity development of Energy intensity mapping application. History
5. Recommendation:

Adding street lightning: Street lighting efficiency improvement is very important for municipalities because public lighting accounts for significant part of municipal budgets, but also because efficient lighting is critical for creating safe and comfortable public space and living environment for the citizens. Therefore street light module should be added to EMIS.

Management Response: [Added: 2017/11/20] [Last Updated: 2017/12/07]

The recommendation is valid and accepted.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
5.1 The sector and the project prepared and submitted new funding proposal for project extension and scaling up with intention to add minimum 54 new public buildings/ infrastructure for retrofit, out of which 6 are intended for public lighting.
[Added: 2017/11/20] [Last Updated: 2018/09/20]
Energy Environment Sector and Green Economic Development Project 2020/12 Initiated Project proposal submitted to SIDA. 20.09.2018: The project phase II includes a separate activity related to energy efficient public lightning. Currently, the locations are being identified. History
6. Recommendation:

Supporting Energy performance certificates (EPC): EPC are gaining acceptance and certification process is going to expand. In order to provide support for relevant Ministries for monitoring the process and assuring quality of accredited certification work, EMIS should be extended with a module which supports related co-locations for preparation EPC in an objective, transparent and comparable manner.

Management Response: [Added: 2017/11/20] [Last Updated: 2017/12/07]

The recommendation is valid and accepted. 

Key Actions:

Key Action Responsible DueDate Status Comments Documents
6.1 Development of Measurement and verification (M&V) module within EMIS Supporting Energy Performance Certificates
[Added: 2017/11/20] [Last Updated: 2018/09/20]
Energy Environment Sector and Green Economic Development Project 2020/12 Initiated Project proposal submitted to SIDA. 20.09.2018: The project team is developing ToR for EMIS maintenance company to assess the current possibilities and eventual cost implications. History
7. Recommendation:

Contributing to SDGs: develop and implement monitoring framework to regularly monitor and assess SDG-related benefits of the project interventions, at the level of individual investment sub-projects and broadly for the whole project.

Management Response: [Added: 2017/11/20] [Last Updated: 2017/12/07]

The recommendation is valid and accepted. 

Key Actions:

Key Action Responsible DueDate Status Comments Documents
7.1 The project will work towards development and implementation of monitoring framework for regular monitoring and assessment of SDG-related benefits of the project interventions, at the level of individual investment sub-projects and broadly for the whole project.
[Added: 2017/11/20] [Last Updated: 2019/01/02]
Energy Environment Sector and Green Economic Development Project 2018/12 Completed 20.09.2018: The project actions related to SDGs monitoring and promotion fits in to the CO overall efforts related to SDGs. History
8. Recommendation:

Mainstreaming Gender: Gender analysis: to understand the specific aspects of gender inequality, if exist, in the context of buildings energy (in)efficiency is concerned, and the social, economic and political factors underlying such inequalities, as well as the potential contributions of women and men to societal changes required to promote investment in energy efficiency;
• Gendered actions: identify and incorporate in the project design specific methods and tools to promote greater gender equality and reduce gender disparities in GED project activities.
• Gender-sensitive M&E: propose and measure the outcomes and impacts of project activities on women and men’s through gender- responsive M&E. It is suggested that all Project Components of the GED project to include at least one gender-related indicator, as elaborated in Table .

Management Response: [Added: 2017/11/20] [Last Updated: 2017/12/07]

The recommendation is valid and accepted. 

Key Actions:

Key Action Responsible DueDate Status Comments Documents
8.1 Development of “Study on human development benefits and gender mainstreaming”
[Added: 2017/11/20] [Last Updated: 2018/08/10]
Energy and Environment Sector and Green Economic Development Project 2018/05 Completed Under development. Findings of the Study will contribute to better understanding of GED project impact, both on human development and gender mainstreaming, which will be further taken into account in next projects. History
9. Recommendation:

Strenghten Communications: Integrate in the scope of communication strategy and plan impact monitoring, in terms of improved awareness and behavioural changes among various targeted categories. In particular, the focus on monitoring changes in awareness and motivation among investment decision-makers could be additionally assessed and monitored
• Put more emphasis on communicating sustainable development impacts of EE investment (i.e. those which go beyond budgetary and energy saving), in particular such aspects as improved comfort and occupancy conditions for building users, health and education impacts of such investment, as well as gender dimension (see also recommendations from the gender section)
• Prepare and make publicly available information about investment projects in the form of simple fact sheets containing key information about achieved results, as well as visual (like “before and after” pictures)
• Every retrofit project upon completion should be described in simple fact sheet as a particular case study.

Management Response: [Added: 2017/11/20] [Last Updated: 2017/12/07]

The recomenadtion is valid and accepted. 

Key Actions:

Key Action Responsible DueDate Status Comments Documents
9.1 Upgrade and further develop communication strategy
[Added: 2017/11/20] [Last Updated: 2018/09/20]
Energy and Environment Sector and Green Economic 2020/12 Initiated Projects communication strategy developed in 2017. Needs upgrading and further development. The Project developed new ToR for 2018 Media Campaign better responding to the donor expectations and targeting wider beneficiary groups such as end users of public buildings, ministerial officials, etc. History
10. Recommendation:

Donor’s visibility: Project should take care that on all project documents – intermediary and final – donor visibility requirements are properly observed. Also, it is important to make sure that all sub-contractors are duly informed about project’s visibility requirements and relevant provisions are incorporated in the TORs and sub-contracts. Nominate dedicated GED project staff member to regular monitor compliance of sub-contractors with such requirements.

Management Response: [Added: 2017/11/20] [Last Updated: 2017/12/07]

The recommendation is valid and accepted. 

Key Actions:

Key Action Responsible DueDate Status Comments Documents
10.1 Within communication strategy, integrate donor’s visibility
[Added: 2017/11/20] [Last Updated: 2019/01/02]
Energy and Environment Sector and Green Economic Development Project 2018/12 Completed 20.09.2018. The Project increased efforts to increase donor visibility throughout the whole year within the new media campaign but also joint events with the Donor and main project partners. History

Latest Evaluations

Contact us

220 East 42nd Street
20th Floor
New York, NY 10017
Tel. +1 646 781 4200
Fax. +1 646 781 4213
erc.support@undp.org