Success message
error message
warn message
Final Evaluation Report- "Towards Creating a Centre of Excellence for Sustainable Development of Small Island Developing States (SIDS) in Aruba
Commissioning Unit: Trinidad and Tobago
Evaluation Plan: 2017-2021
Evaluation Type: Project
Completion Date: 02/2019
Unit Responsible for providing Management Response: Trinidad and Tobago
Documents Related to overall Management Response:
 
1. Recommendation:

Based on Conclusions 2, 3 and 9

For UNDP future projects should take special care with the design phase for greater relevance, the logic ofintervention and achievement of impacts. Projects must have a Theory of Change from the beginning, which identifies the chain of specific results, roles and responsibilities.

  • Future intervention designs need to identify the expected outputs and outcomes and to elaborate a Theory of Change that describes the path from inputs to results (outputs and outcomes). The Theory of Change should include assumptions and be linked with a risk log.
Management Response: [Added: 2019/06/24] [Last Updated: 2019/07/26]

Management notes the recommendation made by the evaluator regarding the development of a detailed theory of change (ToC) and linking this to the project results and risks of future projects.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
The Country Office has noted this finding and has actioned this recommendation. The M&E capacity of the programme staff was enhanced through M&E training conducted in the period July-August of 2019. All future project documents will include a clearly defined Theory of Change (ToC) that will be linked to project results as well as the risks determined.
[Added: 2019/07/26] [Last Updated: 2020/02/07]
UNDP TTO Programme 2019/12 Completed The Country Office has noted this finding and has actioned this recommendation. The M&E capacity of the programme staff was enhanced through M&E training conducted in the period July-August of 2019. All future project documents will include a clearly defined Theory of Change (ToC) that will be linked to project results as well as the risks determined. History
2. Recommendation:

Based on Conclusion 2 and 4

For UNDP, and Government of Aruba: For the next phases, reduce the number of topics to choose from and have an agenda already from the onset (the supply):

  • Sustainable Tourism (high dependency SIDS)
  • Sustainable Energy
  • Water management
  • Coastal protections
  • Waste management
Management Response: [Added: 2019/06/24] [Last Updated: 2019/07/26]

The UNDP TTO does not agree with the above-mentioned recommendation. While at project design stage there was a clearly defined agenda for the missions, the adjustments to the objectives of the missions reflected the needs of the countries and allowed the missions to maximize relevance.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
None required
[Added: 2019/07/26]
Not Applicable 2019/07 No Longer Applicable [Justification: The UNDP TTO does not agree with the above-mentioned recommendation. While at project design stage there was a clearly defined agenda for the missions, the adjustments to the objectives of the missions reflected the needs of the countries and allowed the missions to maximize relevance.]
The UNDP TTO does not agree with the above-mentioned recommendation. While at project design stage there was a clearly defined agenda for the missions, the adjustments to the objectives of the missions reflected the needs of the countries and allowed the missions to maximize relevance.
3. Recommendation:

Based on Conclusions 3, 4 and 5

For UNDP: A success factor for projects is a monitoring and evaluation system, based on specific and verifiable result indicators, which allows greater control over processes and results.

  • All projects should go beyond the results framework and should elaborate a Monitoring and Evaluation system with a clear framework on progress and result indicators, sources of information and verification, roles and responsibilities (data upload and analysis), reporting procedures, etc.
  • Ideally, this monitoring and evaluation system should be online for all stakeholders to see the project's evolution and results in a dashboard.
  • All indicators need to have a baseline to analyze evolution and change.
Management Response: [Added: 2019/06/24] [Last Updated: 2019/07/26]

For future project iterations the monitoring and evaluation systems will be developed specifically to measure those indicators and targets as determined in the results and resources framework (RRF).

Although the CO agrees with the development of an online monitoring and evaluation system this will be constrained by the availability of resources and is not essential to the successful implementation of the project and accomplishment of objectives.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
The Programme Unit of the Country Office is currently undergoing training in monitoring and evaluation that will assist the unit in developing customized monitoring and evaluation plans for future projects that will specifically measure indicators and targets as identified in the projects results and resources framework.
[Added: 2019/07/26] [Last Updated: 2020/02/07]
UNDP TTO Programme Unit 2019/12 Completed Monitoring and evaluation training was conducted in the period July to August of 2019. This strengthened the M&E capacity of the programme staff. It is anticipated that with this improved understanding of M&E will allow the CO programme officers to develop customized M&E plans for their future programme initiatives. History
4. Recommendation:

Based on Conclusions 6 and 9

For UNDP: The design of projects for capacity building must be meticulous and must take into account the participants profile, topics, the methodology, the study load, the time available to achieve the desired results, and the evaluation. Future interventions need to take into account the fact that capacity building is a sustained in time process, that needs follow-up.

Management Response: [Added: 2019/06/24] [Last Updated: 2019/07/26]

While we agree in principle that cpacity building should ideally be sustained in time,  the design of this initiative was constained by certain key factors which precluded a medium to long-term time span for intervention. This included  a funding ceiling resulting in time limitations. However, in an attempt to ensure that sustainability of the outputs was addressed the transitioning of the knowledge base to a national research and learning institution was embedded in the project design.

 

Key Actions:

Key Action Responsible DueDate Status Comments Documents
None required
[Added: 2019/07/26]
Not Applicable 2019/07 No Longer Applicable [Justification: While we agree in principle that capacity building should ideally be sustained in time, the design of this initiative was constrained by certain key factors which precluded a medium to long-term time span for intervention. This included a funding ceiling resulting in time limitations. However, in an attempt to ensure that sustainability of the outputs was addressed the transitioning of the knowledge base to a national research and learning institution was embedded in the project design.]
5. Recommendation:

Based on Conclusion 7

For UNDP and Government of Aruba: Pilot projects need to have a replication strategy to share and scale-up lessons learned and best practicies amongst countries.

  • The online platform can move from an online information repository to a live community of practice.
  • This knowledge management strategy should include dedicated staff to do a follow-up, facilitate discussions, create and update expert directories worldwide (by topic), elaborate new case studies, etc. 
Management Response: [Added: 2019/06/24] [Last Updated: 2019/07/26]

The online platform has been transitioned to a national learning and research institution (University of Aruba) which is staffed with appropriate personnel who can be dedicated to maintaing an interactive knowledge management approach.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Not Applicable- As control of the online platform has transitioned to the University of Aruba the UNDP TTO cannot exert any influence as to how the platform is ultimately utilized.
[Added: 2019/07/26]
The University of Aruba 2019/07 No Longer Applicable [Justification: Control of the online platform has transitioned to the University of Aruba the UNDP TTO cannot exert any influence as to how the platform is ultimately utilized. ]
6. Recommendation:

Based on Conclusion 9

For UNDP,  Government of Aruba and University of Aruba: The project needs a sustained in time intervention to be able to scale-up its benefits. Therefore, funding and technical support are vital.

  • The transition process from the project to the University of Aruba needs to start from presenting the Centre of Excellence results, a roadmap for sustainability (exit strategy) with a detailed timeline, specific roles, and a budget.
Management Response: [Added: 2019/06/24] [Last Updated: 2019/07/26]

The UNDP CO agrees in principle that the project requires an additional intervention to ensure the sustainability of current results. However, this is largely determined by the availability of funding.

The UNDP CO agrees that an exit strategy is essential and wishes to note here that an exit strategy/transition plan was developed which addressed the specific aspects mentioned in the recommendation. This exit strategy/ transition plan was presented to the evaluator.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
None required
[Added: 2019/07/26]
Not Applicable 2019/07 No Longer Applicable [Justification: The UNDP CO agrees in principle that the project requires an additional intervention to ensure the sustainability of current results. However, this is largely determined by the availability of funding. The UNDP CO agrees that an exit strategy is essential and wishes to note here that an exit strategy/transition plan was developed which addressed the specific aspects mentioned in the recommendation. This exit strategy/ transition plan was presented to the evaluator.]

Latest Evaluations

Contact us

1 UN Plaza
DC1-20th Floor
New York, NY 10017
Tel. +1 646 781 4200
Fax. +1 646 781 4213
erc.support@undp.org