- Evaluation Plan:
- 2018-2022, Moldova
- Evaluation Type:
- Mid Term Project
- Planned End Date:
- 11/2020
- Completion Date:
- 11/2020
- Status:
- Completed
- Management Response:
- Yes
- Evaluation Budget(US $):
- 20,000
Moldova Sustainable Green Cities - Mid-Term Evaluation
| Document | Type | Language | Size | Status | Downloads |
|---|---|---|---|---|---|
 UNDP_MOL_SGC_MTR_final.docx |
report | English | 1890.17 KB | Posted | 1173 |
| Title | Moldova Sustainable Green Cities - Mid-Term Evaluation | ||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Atlas Project Number: | 97704 | ||||||||||||||
| Evaluation Plan: | 2018-2022, Moldova | ||||||||||||||
| Evaluation Type: | Mid Term Project | ||||||||||||||
| Status: | Completed | ||||||||||||||
| Completion Date: | 11/2020 | ||||||||||||||
| Planned End Date: | 11/2020 | ||||||||||||||
| Management Response: | Yes | ||||||||||||||
| Focus Area: |
|
||||||||||||||
| Corporate Outcome and Output (UNDP Strategic Plan 2018-2021) |
|
||||||||||||||
| Evaluation Budget(US $): | 20,000 | ||||||||||||||
| Source of Funding: | Project (donor) funds / GEF | ||||||||||||||
| Evaluation Expenditure(US $): | 18,750 | ||||||||||||||
| Joint Programme: | No | ||||||||||||||
| Joint Evaluation: | No | ||||||||||||||
| Evaluation Team members: |
|
||||||||||||||
| GEF Evaluation: | Yes
|
||||||||||||||
| Key Stakeholders: | Ministry of Agriculture, Regional Development and Environment | ||||||||||||||
| Countries: | MOLDOVA, REPUBLIC OF |
| Lessons | |
|---|---|
| Findings | |
| 1. | With respect to relevance, the project is considered relevant / satisfactory.
Project efficiency is rated satisfactory.
The project’s effectiveness is rated as moderately satisfactory.
Project results / achievement of overall outcomes is rated moderately satisfactory. The project is likely to achieve 6 of the 12 project results indicator targets, while 6 targets are partially achieved and/or achievement is uncertain. The most important project result, the successful and financially sustainable establishment of the Green City Lab, is not yet achieved, and achievement is uncertain, although there has been significant positive progress toward establishment of the Green City Lab. Sustainability is one of the five main evaluation criteria, as well as being considered one of the GEF operational principles. Based on GEF evaluation policies and procedures, the overall rating for sustainability cannot be higher than the lowest rating for any of the four individual sub-components of sustainability. Therefore, the overall sustainability rating for the Moldova SGC project is moderately likely, as this is the rating for three of the four sub-components of sustainability.
|
| Recommendations | |
|---|---|
| 1 | Expand the PB membership to include additional diverse stakeholders from civil society, academia (e.g. representatives from technology or engineering departments of university), and private sector (e.g. representative from business association, chamber of commerce, or other similar representative organization for the private sector). The goal of expanding the PB membership is to increase the project’s linkages with other relevant initiatives in the country, to increase creative inputs and guidance for the strategic direction of project activities, and to amplify the dissemination and awareness raising related to the project’s results. |
| 2 | Results framework should be revised to improve relevance of some indicators, and rationalization of key targets. |
| 3 | Increase attention on Component 3, and clarify in reporting how the MRV envisioned in the Prodoc relates to what is currently being implemented. |
| 4 | Increase attention and effort on communication and knowledge management mechanisms, as foreseen under Component 3, to clarify the strategic approach (also relates to recommendation on communication strategy for Green City Lab). |
| 5 | Increase focus on scaling-up and replicability (by increasing adoption of new technologies, identifying new client municipalities, etc.) of demonstration projects (including by potentially increasing the project’s planned budget for the Fast Track Challenge Programme), to increase the potential for the catalytic effect of the project. |
| 6 | Ensure legal establishment of the Green City Lab and hiring of Director as rapidly as possible, taking into consideration that the new Law on the establishment of NGOs is in effect starting September 1st, 2020. |
| 7 | The Green City Lab should articulate as quickly and clearly as possible what the role for the private sector is vis-à-vis the Green City Lab, now that the private sector has stepped up as founding members. The private sector is not required to contribute financially, at least not in the near term, so their role needs to be clearly defined. The Green City Lab is focused on serving Chisinau and other municipalities, so there is a need to identify the role and involvement of the private sector. There should also be a transparent discussion with the founding members on the role of subsequent Green City Lab members. In addition, there should be a transparent discussion to ensure clarity on how all stakeholders involved can avoid any perceptions of conflicts of interest between the work of the Green City Lab and the roles of the private sector. Rules and procedures for dealing with conflict of interest should be prepared and agreed. |
| 8 | The project should develop a draft communications and stakeholder engagement strategy for the Green City Lab immediately (even before the Green City Lab is operational), which can provide direction for building and ensuring engagement and buy-in by Chisinau Municipality and the private sector partners once the Green City Lab is operational. |
| 9 | Ensure all of the necessary operational documents for the Green City Lab (bylaws, internal guidelines, operational manual, etc.) are finalized as quickly as possible, with full transparency and appropriate stakeholder input. In conjunction, convene the Green City Lab board as soon as possible. |
| 10 | As soon as Green City Lab Director is in place, review and update the business plan financial figures in terms of the revenue required for financial sustainability of the Green City Lab – financial projection scenarios over time, based on required revenues based on various staffing and expense levels. This may be done with the input of an international Technical Advisor, who can support the project and the operationalization of the Green City Lab on multiple aspects. This should include revising the annual budget and financial sustainability plan to cover administrative and operational costs and identify income sources. This can be achieved by diversification of activities: serving as PMU for grants, loans, governmental funds as well as providing paid services. The Prodoc provides an estimated required revenue figure of $200K/year (dating back to the 2016-2017 project development timeframe), and this has been simply echoed in all corresponding documents since this time, including the most recent business plan, but this figure can be much more realistically updated once the Green City Lab is established. |
| 11 | The project team, Green City Lab, and UNDP should conduct discussions with bilateral and multilateral donor agencies and international financial institutions (possibly in the context of the Chisinau Municipality donor roundtable established in summer 2020) to determine the financial feasibility of the Green City Lab acting as a PIU for Chisinau. This could be done under the umbrella of the Green City Action Plan. This could be organized as a donor roundtable for the Green City Action Plan. (Building on the experience of national donor coordination on water management). |
| 12 | UNDP and the Project Team should try to ensure that all key Green City Lab initial support staff are hired in parallel with the Director, so that the Director is able to move rapidly ahead with substantive issues in the first 6 months of the Green City Lab’s operation, rather than dealing with administrative requirements. |
1. Recommendation:
Expand the PB membership to include additional diverse stakeholders from civil society, academia (e.g. representatives from technology or engineering departments of university), and private sector (e.g. representative from business association, chamber of commerce, or other similar representative organization for the private sector). The goal of expanding the PB membership is to increase the project’s linkages with other relevant initiatives in the country, to increase creative inputs and guidance for the strategic direction of project activities, and to amplify the dissemination and awareness raising related to the project’s results.
Management Response: [Added: 2020/12/03]
By practice and rule, UNDP undertakes a solid stakeholders’ analysis during project design and building on the identified roles and functions, clarifies their contribution towards successful implementation of the project. As a response to the recommendation the project team and UNDP CO will perform an analysis of the existing Project board composition in light of the establishment of the Green City Lab in order to avoid overlapping and ensure the best representation in project and GCL decision bodies
Key Actions:
| Key Action | Responsible | DueDate | Status | Comments | Documents |
|---|---|---|---|---|---|
| 1.1. Re-assessment of project board composition, identification of missing relevant stakeholders in project board and provision of invitation to join
[Added: 2020/12/03] [Last Updated: 2021/08/13] |
UNDP Moldova Country Office / Project Management Team | 2021/07 | Completed | The additional 2 members were designated by European Business Association and National agency for research and development. History |
2. Recommendation:
Results framework should be revised to improve relevance of some indicators, and rationalization of key targets.
Management Response: [Added: 2020/12/03]
UNDP CO and project team will update the project result framework on the basis of in-depth analysis of existing socio-economic situation, pandemic impact and updated management plan for the Green City Lab/GCL.
Key Actions:
| Key Action | Responsible | DueDate | Status | Comments | Documents |
|---|---|---|---|---|---|
| 2.2 Approval of the updated Results framework by PB with prior approval by UNDP and RTA in accordance with GEF and UNDP rules and regulations.
[Added: 2020/12/03] [Last Updated: 2022/04/14] |
Project board with support from UNDP CO and IRH | 2022/09 | Initiated | Due to the numerous crises in MD (energy, economic, refugee) the revenue stream described in the GCL Business plan will be slightly updated in upcoming months, which will provide realistic inputs for the Results Framework end project targets. History | |
| 2.1. Update of the existing GCL business plan with the support of GCL team, international and national experts.
[Added: 2020/12/03] [Last Updated: 2021/11/10] |
GCL team, Project Management Team, with support from UNDP CO | 2021/10 | Completed | The updated Business plan was finalized and will be presented to the GCL board meeting on 15 November 2021. History |
3. Recommendation:
Increase attention on Component 3, and clarify in reporting how the MRV envisioned in the Prodoc relates to what is currently being implemented.
Management Response: [Added: 2020/12/03]
While the project team has developed a simplified tool for MRV to capture data about the GHG emission reductions resulting from the pilot/demonstration projects (including Fast Track Challenge projects) actions will be undertaken to improve it.
Key Actions:
| Key Action | Responsible | DueDate | Status | Comments | Documents |
|---|---|---|---|---|---|
| 3.1. Re-assessment of the existing MRV tool and its improvement with the support of the MRV expert and Project team
[Added: 2020/12/03] [Last Updated: 2021/12/06] |
Project Management Team and UNDP CO | 2021/12 | Completed | The MRV tool was improved and reflects all the data related to CO2 emissions reduction from demo projects activities. History |
4. Recommendation:
Increase attention and effort on communication and knowledge management mechanisms, as foreseen under Component 3, to clarify the strategic approach (also relates to recommendation on communication strategy for Green City Lab).
Management Response: [Added: 2020/12/03] [Last Updated: 2020/12/03]
The recommendation is well noted and will be effectively followed-up. It will be taken into account for both Green City Lab and Green city project communication strategies for strengthening communication and knowledge management mechanisms.
Key Actions:
| Key Action | Responsible | DueDate | Status | Comments | Documents |
|---|---|---|---|---|---|
| 4.1 Update the Green city project communication strategy by strengthening communication and knowledge management mechanisms.
[Added: 2020/12/03] [Last Updated: 2021/08/13] |
Project Management Team and UNDP CO | 2021/04 | Completed | The activity has been carried out as part of the UNDP CO internal exercise. History |
5. Recommendation:
Increase focus on scaling-up and replicability (by increasing adoption of new technologies, identifying new client municipalities, etc.) of demonstration projects (including by potentially increasing the project’s planned budget for the Fast Track Challenge Programme), to increase the potential for the catalytic effect of the project.
Management Response: [Added: 2020/12/03]
Well noted. UNDP CO will make respective budget revision in line with GEF and UNDP rules and regulations
Key Actions:
| Key Action | Responsible | DueDate | Status | Comments | Documents |
|---|---|---|---|---|---|
| 5.1. Make a budget revision by increasing the project’s planned budget for the Fast Track Challenge Programme
[Added: 2020/12/03] [Last Updated: 2021/05/05] |
Project Management Team and UNDP CO, UNDP IRH | 2021/03 | Completed | The increase in allocated budget for Fast Track Challenge Programme was reflected in December 2020 budget revision History | |
| 5.2 Scale-up and replicate best demonstration projects by Green City Lab with support of GC project team (including in new client municipalities)
[Added: 2020/12/03] |
Green City Lab and Project Management Team | 2022/12 | Not Initiated |
6. Recommendation:
Ensure legal establishment of the Green City Lab and hiring of Director as rapidly as possible, taking into consideration that the new Law on the establishment of NGOs is in effect starting September 1st, 2020.
Management Response: [Added: 2020/12/03]
Well noted. The process was initiated.
Key Actions:
| Key Action | Responsible | DueDate | Status | Comments | Documents |
|---|---|---|---|---|---|
| 6.1 Support Green City Lab legal establishment and director hiring, including necessary board approvals
[Added: 2020/12/03] [Last Updated: 2021/05/05] |
Project Management Team and UNDP CO | 2021/03 | Completed | The GCL director was selected and GCL was officially registered in March 2021 History |
7. Recommendation:
The Green City Lab should articulate as quickly and clearly as possible what the role for the private sector is vis-à-vis the Green City Lab, now that the private sector has stepped up as founding members. The private sector is not required to contribute financially, at least not in the near term, so their role needs to be clearly defined. The Green City Lab is focused on serving Chisinau and other municipalities, so there is a need to identify the role and involvement of the private sector. There should also be a transparent discussion with the founding members on the role of subsequent Green City Lab members. In addition, there should be a transparent discussion to ensure clarity on how all stakeholders involved can avoid any perceptions of conflicts of interest between the work of the Green City Lab and the roles of the private sector. Rules and procedures for dealing with conflict of interest should be prepared and agreed.
Management Response: [Added: 2020/12/03]
Well noted. The process was initiated. The role of each founding member in the NGO activity is regulated by the national legislation to avoid conflict of interests. However, an open discussion with each GCL member during the operationalization and business planning process will be undertaken to identify the role and contribution to GCL sustainability.
Key Actions:
| Key Action | Responsible | DueDate | Status | Comments | Documents |
|---|---|---|---|---|---|
| 7.1 Identification of the role of each founding member in GCL sustainable functioning
[Added: 2020/12/03] [Last Updated: 2021/08/13] |
Project Management Team and UNDP CO | 2021/07 | Completed | The role of each founding member in GCL was clarified in statutory documentation. History | |
| 7.2 Participation of the GCL founding members at the GCL business planning process
[Added: 2020/12/03] [Last Updated: 2021/11/10] |
GCL team and Project Management Team | 2021/10 | Completed | The GCL founding members participated in GCL Business planning process, being part in different meetings and also having the possibility to comment on draft document. The final document will be presented to the GCL board meeting on 15 November 2021. History | |
| 7.3 Developing internal set of rules and procedures for dealing with conflict of interest within the GCL
[Added: 2020/12/03] [Last Updated: 2021/08/13] |
GCL team and Project Management Team | 2021/06 | Completed | The documents were developed and Declarations are being signed by each new staff member upon employment. History |
8. Recommendation:
The project should develop a draft communications and stakeholder engagement strategy for the Green City Lab immediately (even before the Green City Lab is operational), which can provide direction for building and ensuring engagement and buy-in by Chisinau Municipality and the private sector partners once the Green City Lab is operational.
Management Response: [Added: 2020/12/03]
The recommendation will be broadly shared with the communication specialist for effective follow-up. Recommendation will be taken into account when developing Green City Lab communication strategy and updated business plan.
Key Actions:
| Key Action | Responsible | DueDate | Status | Comments | Documents |
|---|---|---|---|---|---|
| 8.1 Develop the communications and stakeholder engagement strategy for the Green City Lab for building and ensuring engagement and buy-in by Chisinau Municipality, and the private sector partners
[Added: 2020/12/03] [Last Updated: 2022/04/14] |
GCL team, Project Management Team and UNDP CO | 2022/02 | Completed | The stakeholder engagement and communication strategy were incorporated as annex to the GCL business plan which was approved in November 2021. History |
9. Recommendation:
Ensure all of the necessary operational documents for the Green City Lab (bylaws, internal guidelines, operational manual, etc.) are finalized as quickly as possible, with full transparency and appropriate stakeholder input. In conjunction, convene the Green City Lab board as soon as possible.
Management Response: [Added: 2020/12/03]
Well noted. The process was initiated. Draft operational documents were developed according to national legislation and awaiting be approved by the GCL founding members after executive director process finalize.
Key Actions:
| Key Action | Responsible | DueDate | Status | Comments | Documents |
|---|---|---|---|---|---|
| Finalize and approve all of the necessary operational documents for the Green City Lab (by laws, internal guidelines, operational manual, etc.) by Green City Lab board.
[Added: 2020/12/03] [Last Updated: 2021/08/13] |
GCL team, Project Management Team and UNDP CO | 2021/07 | Completed | The set of internal regulations was developed and provided to GCL. History |
10. Recommendation:
As soon as Green City Lab Director is in place, review and update the business plan financial figures in terms of the revenue required for financial sustainability of the Green City Lab – financial projection scenarios over time, based on required revenues based on various staffing and expense levels. This may be done with the input of an international Technical Advisor, who can support the project and the operationalization of the Green City Lab on multiple aspects. This should include revising the annual budget and financial sustainability plan to cover administrative and operational costs and identify income sources. This can be achieved by diversification of activities: serving as PMU for grants, loans, governmental funds as well as providing paid services. The Prodoc provides an estimated required revenue figure of $200K/year (dating back to the 2016-2017 project development timeframe), and this has been simply echoed in all corresponding documents since this time, including the most recent business plan, but this figure can be much more realistically updated once the Green City Lab is established.
Management Response: [Added: 2020/12/03]
Well noted. UNDP CO will provide overall support to the GCL team in business plan update and pay attention to a more realistic revenue target to ensure self-sustainability of GCL.
Key Actions:
| Key Action | Responsible | DueDate | Status | Comments | Documents |
|---|---|---|---|---|---|
| Update the existing GCL business plan with support from the GCL team and international and national experts
[Added: 2020/12/03] [Last Updated: 2021/11/10] |
Green City Lab, Project Management Team, UNDP CO | 2021/10 | Completed | The updated Business plan was finalized and will be presented to the GCL board meeting on 15 November 2021. History |
11. Recommendation:
The project team, Green City Lab, and UNDP should conduct discussions with bilateral and multilateral donor agencies and international financial institutions (possibly in the context of the Chisinau Municipality donor roundtable established in summer 2020) to determine the financial feasibility of the Green City Lab acting as a PIU for Chisinau. This could be done under the umbrella of the Green City Action Plan. This could be organized as a donor roundtable for the Green City Action Plan. (Building on the experience of national donor coordination on water management).
Management Response: [Added: 2020/12/03]
Well noted. UNDP will follow up on this recommendation and enter into separate discussions with Chisinau municipality and potential donors agencies and IFIs to ensure financial feasibility and sustainability of the GCL.
Key Actions:
| Key Action | Responsible | DueDate | Status | Comments | Documents |
|---|---|---|---|---|---|
| 11.1 GCL team with support of project team and CO will do the donor mapping and organize a donor meetings/forum to present the pipeline of initiatives.
[Added: 2020/12/03] [Last Updated: 2021/12/06] |
Green City Lab, Project Management Team, UNDP CO | 2022/05 | Initiated | The donor mapping is part of the GCL business plan. However, the Donor forum could not be organized in November as planned due to COVID 19 meetings restrictions. As virtual meetings do not provide expected results, it was decided to postpone the event to spring time, when the epidemiological situation will be better. History |
12. Recommendation:
UNDP and the Project Team should try to ensure that all key Green City Lab initial support staff are hired in parallel with the Director, so that the Director is able to move rapidly ahead with substantive issues in the first 6 months of the Green City Lab’s operation, rather than dealing with administrative requirements.
Management Response: [Added: 2020/12/03]
Well noted. According to the developed Business Plan, the existing GC project officer responsible for demo projects implementation should migrate to GCL as a development/technical expert. An additional procurement/financial assistant will be hired once GCL will operationalized.
Key Actions:
| Key Action | Responsible | DueDate | Status | Comments | Documents |
|---|---|---|---|---|---|
| Transfer of the GC project officer responsible for demo projects implementation to GCL as a development/technical expert. Selection and recruitment of the procurement/financial assistant
[Added: 2020/12/03] [Last Updated: 2021/08/13] |
Project Management Team, UNDP | 2021/06 | Completed | Transfer of the GC project officer responsible for demo projects implementation to GCL as a development/technical expert was not relevant any more as the person left the project. Recruitment of the procurement/financial assistant for the GCL was done. History |