- Evaluation Plan:
- 2016-2020, Turkey
- Evaluation Type:
- Outcome
- Planned End Date:
- 12/2018
- Completion Date:
- 12/2018
- Status:
- Completed
- Management Response:
- Yes
- Evaluation Budget(US $):
- 50,000
OUTCOME EVALUATION OF INCLUSIVE AND SUSTAINABLE GROWTH PORTFOLIO FINAL EVALUATION REPORT
| Document | Type | Language | Size | Status | Downloads |
|---|---|---|---|---|---|
 TOR for ISG Evaluation.pdf |
tor | English | 979.86 KB | Posted | 1068 |
| Outcome_Evaluation Report_Draft_ISGP.docx.pdf |
report | English | 847.59 KB | Posted | 1147 |
| Final_Evaluation Report_ISG Outcome.pdf |
report | English | 857.45 KB | Posted | 1193 |
| Title | OUTCOME EVALUATION OF INCLUSIVE AND SUSTAINABLE GROWTH PORTFOLIO FINAL EVALUATION REPORT | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Atlas Project Number: | 96623,100165,96620,71721,82486,61072,94576,89747 | |||||||||
| Evaluation Plan: | 2016-2020, Turkey | |||||||||
| Evaluation Type: | Outcome | |||||||||
| Status: | Completed | |||||||||
| Completion Date: | 12/2018 | |||||||||
| Planned End Date: | 12/2018 | |||||||||
| Management Response: | Yes | |||||||||
| Focus Area: |
|
|||||||||
| Corporate Outcome and Output (UNDP Strategic Plan 2018-2021) |
|
|||||||||
| Evaluation Budget(US $): | 50,000 | |||||||||
| Source of Funding: | Budgets of projects under the ISG Portfolio | |||||||||
| Evaluation Expenditure(US $): | 12,500 | |||||||||
| Joint Programme: | No | |||||||||
| Joint Evaluation: | No | |||||||||
| Evaluation Team members: |
|
|||||||||
| GEF Evaluation: | No | |||||||||
| Key Stakeholders: | ||||||||||
| Countries: | TURKEY |
| Lessons | |
|---|---|
| Findings |
| Recommendations | |
|---|---|
| 1 | Even though the portfolio has an annual reporting and contributes to the country programme’s monitoring system through ROAR, there is not a separate monitoring platform of ISG Portfolio. It is important and essential to develop monitoring mechanisms and systems for such large and important programmes. |
| 2 | ISG portfolio has contributed 11 Sustainable Development Goals indicators out of 17 in Turkey. Overall, there are a lot of evidences to mention that ISG portfolio contributed to the inclusive and sustainable growth in Turkey. However, ISG Portfolio does not have a separate log frame indicator. It is essential and important to create measurable indicators to monitor the ISG Portfolio achievements. |
| 3 | It is very visible that ISG Portfolio contributed to socio-economic development of the regions where implemented. However, there is no clear calculation of economic value add of ISG Portfolio has created. Furthermore, there is no impact analysis of the entire programme has been done yet. Therefore, it is suggested that ISG Portfolio to conduct a full impact analysis and value add of the programme to the social and economic life in the regions where implemented. Furthermore, UNDP may consider to develop and implement a social cohesion index to monitor impact of ISG Portfolio where implemented |
| 4 | ISG Portfolio conducts several activities and communication tools. Yet it is highly suggested ISGP to provide more information through info graphics or visual materials on ISG portfolio outcomes through UNDP Turkey web page and also develop communication and awareness tools and platforms. |
| 5 | Overall, it is safe to mention that ISG portfolio has high evaluation score for each of the Evaluation Criteria (UN and OECD DAC); Relevance, Effectiveness, Efficiency, Impact and Sustainability. However, there is a very high potential for extension and expansion of ISG portfolio in Turkey. In order to keep the current momentum especially built up in Eastern and South Eastern part of Turkey, it is highly suggested UNDP Turkey to continue and expand the ISG portfolio beyond 2020 as well. |
| 6 | It is important to create further synergy between ISG and other portfolio of UNDP, especially with “Climate Change and Environment” and “Syria Crises Response and Resilience “. These three programmes has several common areas and can develop joint projects. By this way, UNDP can increase the efficiency of the resources. |
| 7 | It is very important that UNDP Turkey could manage to bring external funding sources, given that Turkish economy may go through a difficult period in 2019 and 2020 |
1. Recommendation:
Even though the portfolio has an annual reporting and contributes to the country programme’s monitoring system through ROAR, there is not a separate monitoring platform of ISG Portfolio. It is important and essential to develop monitoring mechanisms and systems for such large and important programmes.
Management Response: [Added: 2019/01/30]
This recommendation refers to the corporate management system. The suggested activity will be discussed with the senior management and a decision will be made on the issue.
For the next CPD Period the recommended action will be suggested to be included.
Key Actions:
| Key Action | Responsible | DueDate | Status | Comments | Documents |
|---|---|---|---|---|---|
| -The suggestion will be shared with the management.
-After the discussion a decision will be made.
-It will be recommended to the Senior Management in the preparation phase of next CPD.
[Added: 2019/01/30] [Last Updated: 2020/08/21] |
UNDP Senior Management and ISGP | 2020/08 | Completed | UNDP CO has an M&E Analyst since May 2019 whose one of the first tasks has been to set up a corporate M&E system to track portfolio contributions to current CPD outputs. Likewise, CPD for the next term (2021-2025) has been prepared in the same fashion. Since multiple portfolios contribute to each CPD output, it is against the logic of cross-fertilization and synergies to keep portfolio achievements separate from each other. Hence, the current shape of the system seems more conducive to both reap collective benefits and to document them. Having said that, an M&E associate is going to be hired in the coming months and if need be, M&E Analyst and M&E Associate of ISG portfolio can work together to craft such a separate M&E system. In the current state however, this is not very much needed. History |
2. Recommendation:
ISG portfolio has contributed 11 Sustainable Development Goals indicators out of 17 in Turkey. Overall, there are a lot of evidences to mention that ISG portfolio contributed to the inclusive and sustainable growth in Turkey. However, ISG Portfolio does not have a separate log frame indicator. It is essential and important to create measurable indicators to monitor the ISG Portfolio achievements.
Management Response: [Added: 2019/01/30]
This recommendation refers to the corporate management system. The suggested activity will be discussed with the senior management and a decision will be made on the issue. For the next CPD Period the recommended action will be suggested to be included
Key Actions:
| Key Action | Responsible | DueDate | Status | Comments | Documents |
|---|---|---|---|---|---|
| -The suggestion will be shared with the management.
-After the discussion a decision will be made.
-It will be recommended to the Senior Management in the preparation phase of next CPD.
[Added: 2019/01/30] [Last Updated: 2020/08/21] |
UNDP Senior Management and ISGP | 2020/05 | Completed | The M&E Analyst has prepared a tracking tool to show the contribution of each project to SDGs and SDG targets classified not according to portfolios but according to CPD outputs. The tracking tool has been in use since May 2020 History |
3. Recommendation:
It is very visible that ISG Portfolio contributed to socio-economic development of the regions where implemented. However, there is no clear calculation of economic value add of ISG Portfolio has created. Furthermore, there is no impact analysis of the entire programme has been done yet. Therefore, it is suggested that ISG Portfolio to conduct a full impact analysis and value add of the programme to the social and economic life in the regions where implemented. Furthermore, UNDP may consider to develop and implement a social cohesion index to monitor impact of ISG Portfolio where implemented
Management Response: [Added: 2019/01/30]
In the projects under the ISG Portfolio baseline analysis and monitoring and evaluation process conducted. And also annually audit is implemented for the projects. However a budget for impact assessment is not stated in the projects. This recommendation refers to the corporate management system. The suggested activity will be discussed with the senior management and a decision will be made on the issue. For the next CPD Period the recommended action will be suggested to be included.
Key Actions:
| Key Action | Responsible | DueDate | Status | Comments | Documents |
|---|---|---|---|---|---|
| -The suggestion will be shared with the management.
-After the discussion a decision will be made.
-It will be recommended to the Senior Management in the preparation phase of next CPD.
[Added: 2019/01/30] [Last Updated: 2020/08/21] |
UNDP Senior Management and ISGP | 2019/12 | No Longer Applicable |
[Justification: ISG portfolio projects operate in regions and issue areas where many actors work jointly to bring developmental results. Hence it is very hard to disentangle the contributions of other actors to make a proper impact assessment at the portfolio level. So a portfolio level impact assessment will certainly not be rigorous enough. Having said that, provided there are allocated resources for it, some projects carry out their own impact assessments since they operate in a controlled environment where developmental impacts are easier to deduce. This is valid for all IFAD projects where impact assessments are carried out to discern poverty and income generation impacts. So instead of a portfolio level impact assessment study, project level impact assessments where applicable will be sought.] History |
4. Recommendation:
ISG Portfolio conducts several activities and communication tools. Yet it is highly suggested ISGP to provide more information through info graphics or visual materials on ISG portfolio outcomes through UNDP Turkey web page and also develop communication and awareness tools and platforms.
Management Response: [Added: 2019/01/30] [Last Updated: 2019/01/30]
This process has already been initiated through meetings with the portfolio managers. The ISG portfolio communication advisor will prepare a strategy accordingly.
Key Actions:
| Key Action | Responsible | DueDate | Status | Comments | Documents |
|---|---|---|---|---|---|
| -A strategy plan will be developed.
-Accordingly and activity plan will be prepared and implemented.
- Other tools and platforms will be developed according to the strategy.
[Added: 2019/01/30] [Last Updated: 2020/08/21] |
UNDP ISGP | 2020/06 | Completed | There were staff turnover in ISG portfolio and a new communications team member is mobilised. She is currently working on a broader visibility strategy for ISG portfolio in general. In line with ISG strategy and new CPD this will be operational in 2021. History |
5. Recommendation:
Overall, it is safe to mention that ISG portfolio has high evaluation score for each of the Evaluation Criteria (UN and OECD DAC); Relevance, Effectiveness, Efficiency, Impact and Sustainability. However, there is a very high potential for extension and expansion of ISG portfolio in Turkey. In order to keep the current momentum especially built up in Eastern and South Eastern part of Turkey, it is highly suggested UNDP Turkey to continue and expand the ISG portfolio beyond 2020 as well.
Management Response: [Added: 2019/01/30]
This recommendation refers to the corporate management system. The suggested activity will be discussed with the senior management and a decision will be made on the issue. The recommendation will be suggested to reflect the CPD evaluation.
Key Actions:
| Key Action | Responsible | DueDate | Status | Comments | Documents |
|---|---|---|---|---|---|
| -The suggestion will be shared with the management.
-After the discussion a decision will be made.
[Added: 2019/01/30] [Last Updated: 2020/08/21] |
UNDP Senior Management and ISGP | 2020/08 | Completed | Number of projects under ISG portfolio was 12 as of Dec 2018. As of August 2020, this number is 17. Given the context of Covid-19 and the 11th NDP giving priority to topics such as skill formation, productivity and innovation this expansion is likely to continue in the future as well. History |
6. Recommendation:
It is important to create further synergy between ISG and other portfolio of UNDP, especially with “Climate Change and Environment” and “Syria Crises Response and Resilience “. These three programmes has several common areas and can develop joint projects. By this way, UNDP can increase the efficiency of the resources.
Management Response: [Added: 2019/01/30]
This recommendation refers to the corporate management system. The suggested activity will be discussed with the senior management and a decision will be made on the issue.
Key Actions:
| Key Action | Responsible | DueDate | Status | Comments | Documents |
|---|---|---|---|---|---|
| The suggestion will be shared with the management.
-After the discussion a decision will be made.
[Added: 2019/01/30] [Last Updated: 2020/08/21] |
UNDP Senior Management and ISGP and other portfolios. | 2020/08 | Completed | New CPD incorporates the collective contributions of different portfolios to outcomes and outputs rather than presenting them in silos. This is at the strategic management level. At the operational level, there is a lot of give and take between ISG and other portfolios. Especially in the area of Covid19, projects are headed by ISG but different components of these projects are managed by different portfolios. Additionally, there is continuous cross fertilization between projects to generate new ideas. For instance, ISG’s current project funded by EBRD is operationalizing Adana Vocational Training Center operated by Adana Chamber of Commerce on the basis of the good results achieved by Syria Crisis Response Portfolio’s Gaziantep model. History |
7. Recommendation:
It is very important that UNDP Turkey could manage to bring external funding sources, given that Turkish economy may go through a difficult period in 2019 and 2020
Management Response: [Added: 2019/01/30] [Last Updated: 2019/01/30]
This recommendation refers to the corporate management system. The suggested activity will be discussed with the senior management and a decision will be made on the issue. ISG Team with the Senior Management already working for fund raising. This efforts and the process closely will be followed by the team.
Key Actions:
| Key Action | Responsible | DueDate | Status | Comments | Documents |
|---|---|---|---|---|---|
| -The suggestion will be shared with the management.
[Added: 2019/01/30] [Last Updated: 2020/08/21] |
UNDP Senior Management and ISGP and other portfolios. | 2020/08 | Completed | UNDP CO has been mobilising very wide range of resources from different funding partners. This is an ongoing effort for all initiatives. Even in crises period such as Covid19, CO mobilised additional resources from donors such as Japan. A joint IFAD initiative has been launched and new donors have been attracted such as EBRD. History |