Success message
error message
warn message
Final Evaluation for ZEESM project
Commissioning Unit: Timor-Leste
Evaluation Plan: 2021-2025
Evaluation Type: Project
Completion Date: 03/2022
Unit Responsible for providing Management Response: Timor-Leste
Documents Related to overall Management Response:
 
1. Recommendation:

Revisit the overall scope and related Results Framework of the project third phase. Clear, concise, and focused Results Framework with less ambitious and more realistic outputs, indicators and targets should be developed. Clearly defined sequential and focused priorities, objectives and policy guidelines of the Regional Strategic Plan should be considered as benchmark for the programme design

Management Response: [Added: 2022/05/08]

Agreed. The current Project ends in May 2022. UNDP has been working closely with the regional Government of Oé-Cusse Ambeno (RAEOA) to develop the upcoming phase (third phase) of the Project. Clear and concise results framework has been drafted.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Finalize the results framework and get it approved by local project advisory committee (LPAC).
[Added: 2022/05/08] [Last Updated: 2022/07/04]
Democratic Governance Unit 2022/06 Completed The results framework has been finalized and the LPAC is conducted. History
2. Recommendation:

Clearly defined sequential and focused priorities, objectives and policy guidelines of the Regional Strategic Plan should be considered as benchmark for the programme design, instead of taking bits and pieces from the list. For instance, Regional Strategic Plan has set up policy direction to ensure fundamental backbone of tourism sector in the region that includes developing and strengthening tourism related infrastructure and sectors, formation of tourism authority, transportation etc. Without addressing these fundamentals, activities of Community Based Tourism and promotion would not be as effective.

Management Response: [Added: 2022/05/08]

Agreed Draft ProDoc of the new project has taken the Regional Strategic Plan as benchmark in many areas including tourism.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Finalize the ProDoc while taking the Regional Strategic Plan’s priorities, objectives, and policy guidelines as benchmark.
[Added: 2022/05/08] [Last Updated: 2022/06/13]
Democratic Governance Unit 2022/05 Completed Project Document is finalized History
3. Recommendation:

UNDP should revisit, reassess, and strengthen its role, modality, and scope of its contribution, based on its widely acknowledged areas of core competencies that are for instance in Governance (Transparency, accountability, service delivery) and innovation (OBI) and comparatively more strategic and refined contribution, for instance in the tourism sector and agri-business sectors. It may also include exploring and including more sectors in project (if required) to address issues of multi-dimensional poverty in the region such as Cash for Work, micro and SMEs development etc. It is worth mentioning that despite sharing 6.5% of population share, Oé-Cusse region has the highest Multidimensional Poverty Index (MPI) in the country that is 0.34. The high priority dimensions of MPI for the Oé-Cusse region includes nutrition, housing, sanitation, and cooking fuel etc.

Management Response: [Added: 2022/05/08]

Agreed. This recommendation has been taken into consideration while preparing the project document of new phase of the Project, for example, Governance has been defined as one of the components of the new Project.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Finalize the ProDoc in consultations with the Regional Government’s relevant departments
[Added: 2022/05/08] [Last Updated: 2022/06/13]
Democratic Governance Unit 2022/05 Completed A series of consultations sessions were conducted in February and March to develop the Project Document History
4. Recommendation:

A clear, coherent, and comprehensive sustainability/exit strategy should be developed covering political, socio economic, institutional, and financial components of the project sustainability. The sustainability strategy should be complemented by a well-planned and targeted ‘resource mobilization strategy’ to ensure timely financial sustainability of the programme.

Management Response: [Added: 2022/05/08]

The third phase is meant to be a project phase out where a clear exit strategy to ensure sustainability will be integrated.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Develop an exit strategy including a resource mobilization strategy together with the Regional Government to ensure sustainability during the implementation of the third phase.
[Added: 2022/05/08]
Democratic Governance Unit 2023/05 Not Initiated A resources mobilization will be also defined to supplement the exit strategy efforts.
5. Recommendation:

The internal coherence and integration between the components of project should be ensured whereby common synergies can be drawn between support provided to business development, community-based tourism, and agribusiness development support. For instance, both agribusiness and tourism sector can be categorized as high priority sectors for the OBI support.

Management Response: [Added: 2022/05/08]

Agreed. This recommendation is being addressed while preparing the project document of the new phase.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
A problem analysis and theory of change was conducted and the interrelationship between the components identified was emphasized and the TOC schematic diagram drawn up to reflect the synergies. No further action required.
[Added: 2022/05/08]
Democratic Governance Unit 2021/04 Completed
6. Recommendation:

Apart from providing technical support, only to the procurement department and deputing technical assistance in thematic areas of tourism and agribusiness support, UNDP should refocus on providing its core area of technical expertise in the defined areas of regional strategic plan such as e-government including the Public Administration Online Management System, effective, efficient, transparent, and accountable regional financial management system, automatic asset tracking system and capacity building of RAEOA – ZEESM TL government staff in public service content including planning, administration, ITC, leadership, financial management and conflict resolution, office management, and other training

Management Response: [Added: 2022/05/08]

Partially agreed because UNDP’s offer will have to be developed based on the request that the RAEOA government makes to UNDP during the design of the third phase. Hence, some of the elements are addressed under the governance component but not all.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
The governance component has been developed based on Government’s request. Finalize the ProDoc with governance as separate component.
[Added: 2022/05/08] [Last Updated: 2022/06/13]
Democratic Governance Unit 2022/05 Completed The Prodoc has included one separate component and output for governance named Effective and accountable Governance History
7. Recommendation:

The community-based programme should be revisited and redesigned by adding more refined and clear focus on building the fundamental and integrated foundation of the tourism sector in the region as defined by the Regional Strategic Plan.

Management Response: [Added: 2022/05/08]

Partially agreed. Tourism has been agreed as one of the priorities of the Project but in line with the government request, it has been defined as sub-component under business development.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Finalize the ProDoC in consultation with Government regarding Tourism sector priorities.
[Added: 2022/05/08] [Last Updated: 2022/06/13]
Democratic Governance Unit 2022/05 Completed Tourism sector priorities were identified and captured in the ProDoc History
8. Recommendation:

A regional tourism board should be formed (including representatives from the private sector, CSOs, development partners and government)

Management Response: [Added: 2022/05/08]

Partially agreed as this is up to the government to decide. However, UNDP will provide technical support once there is a decision to set up the board and if it is within the scope of the third phase project.

Key Actions:

9. Recommendation:

Public-Private partnership should be added to the community-based tourism (CBT) as a mode and mechanism to promote and implement tourism activities.

Management Response: [Added: 2022/05/08]

Agreed. However, depending on the focus and scope of the third phase project and the kind of support that the government would ask UNDP, this feature will be added.   

Key Actions:

10. Recommendation:

Faced with the transportation and logistical challenges, networks, and partnerships with relevant government departments and/or tour operators/promoters in capital Dilli and other cities should be developed. It will enable in creating awareness about the tourism in Oé-Cusse region at national and international levels as well as facilitate logistical arrangements as well. Alternatively, Tourism Department of Oé-Cusse region can establish its own presence in the capital to serve the purpose.

Management Response: [Added: 2022/05/08]

Agreed. This will be addressed during the implementation

Key Actions:

11. Recommendation:

Apart from the well-designed website, Oé-Cusse’s tourism prospects should be regularly marketed in regional and global tourism and marketing forums such as Dubai expo etc, to attract international tourists.

Management Response: [Added: 2022/05/08]

Agreed. However, this kind of work should be led by the Government and the Project will provide technical support, as required.

Key Actions:

12. Recommendation:

For the Community Tourism Development Support, continuous follow up with the community members and trainees should be ensured to create awareness about the Community Based Tourism benefits and incentivizing them to sustain their interest and commitment.

Management Response: [Added: 2022/05/08]

Agreed. This will be taken into account during the implementation of the new phase of the Project if this is approved in the final ProDoc.

Key Actions:

13. Recommendation:

To conduct a baseline for the Development of Entrepreneurship Ecosystem

Management Response: [Added: 2022/05/08] [Last Updated: 2022/05/08]

Partially agreed. CO has done a stocktaking of the entrepreneurship ecosystem in the national context when developing another project on Youth Entrepreneurship and Employment Support (YEES) in 2021 and it is still a valid one.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
The analysis conducted for the YEES project formulation will be reviewed and drawn upon when developing the new phase
[Added: 2022/05/08] [Last Updated: 2022/06/13]
Democratic Governance Unit 2022/05 Completed The Analysis conducted, YES project document is under finalization History
14. Recommendation:

Selection of Entrepreneurs for OBI- Mainstreaming successful applicants/entrepreneurs of the OBI competition with start-up ideas should be followed by dedicated training on full cycle of entrepreneurship as per the existing OBI training manuals as well as any updated material based (if required) on the baseline study.

Management Response: [Added: 2022/05/08]

Agreed. This will be taken into account during the implementation of the new phase of the Project.

Key Actions:

15. Recommendation:

To establish an OBI venue to provide cohering space for entrepreneurs. The selected entrepreneurs with good ideas must be brought in OBI venue for continuous start up, mentoring & acceleration services

Management Response: [Added: 2022/05/08]

Agreed. This will be taken into account during the implementation of the new phase of the Project.

Key Actions:

16. Recommendation:

Linking Entrepreneurs with the Oé-Cusse digital marketplace. With features like access to financial information, angel funds, investors, mentoring and coaching services, sharing knowledge platforms as well as marketing of products etc. Agribusiness products can also be integrated here.

Management Response: [Added: 2022/05/08] [Last Updated: 2022/05/08]

Agreed. This will be taken into account during the implementation of the new phase of the Project.

Key Actions:

17. Recommendation:

Continued engagement, change management and support to the beneficiaries and farmers should be ensured as any transformative change from traditional practices to new innovative technology-based solutions poses challenge for the farmers to adapt.

Management Response: [Added: 2022/05/08]

Agreed. However, but this is already being practiced by the Project.

Key Actions:

18. Recommendation:

More value chains should be established to further strengthen the economic development of the agribusiness sector in the region.

Management Response: [Added: 2022/05/08]

Agreed. New value chains will be introduced after doing technical and market analysis during the implementation of the new phase of the Project.

Key Actions:

19. Recommendation:

Continued engagement, change management and support to the beneficiaries and farmers should be ensured as any transformative change from traditional practices to new innovative technology-based solutions poses challenge for the farmers to adapt.

Management Response: [Added: 2022/05/08]

Agreed, but repetition of action 17 above

Key Actions:

20. Recommendation:

To replicate cooperative of Coffee sector, technical and resource support to develop similar cooperative in other sectors to promote and enhance model of community-owned enterprises and development of the private sector.

Management Response: [Added: 2022/05/08]

Agreed. This is being taken care of by the new ProDoc.

Key Actions:

21. Recommendation:

Well-designed interventions should be ensured to develop off-farm water resources and on-farm water harvesting tools and techniques to sustain the benefits of new technology adopted and established value chain.

Management Response: [Added: 2022/05/08]

Agreed. This will be taken into account during the implementation of the new phase of the Project.

Key Actions:

22. Recommendation:

Water provisioning and conservation should remain in current status, that is both as a separate output as well as its cross-cutting linkages with the agri-business development component. However adequate allocation of financial and human resources should be ensured in the next phase of the project, considering the issue of water scarcity has direct and indirect impact on other components of the project as well as overall socio-economic development of the Oé-Cusse region.

Management Response: [Added: 2022/05/08]

This has been addressed by the new phase of the Project.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Finalize the ProDoC with water as a separate output.
[Added: 2022/05/08] [Last Updated: 2022/06/13]
Democratic Governance Unit 2022/05 Completed The ProDoc included a separate output (Output 4) named Clean and Safe Water and Forest Management History
23. Recommendation:

Project Management Unit for ZEESM TL project should be strengthened with both technical experts (for envisaged technical assistance) as well as more local support staff with knowledge of local language and context and dedicated M&E staff (with specialty in RBM) to support project manager.

Management Response: [Added: 2022/05/08] [Last Updated: 2022/05/08]

Agreed.  ProDoc of the new phase has addressed this recommendation.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Finalize the ProDoC with more local support staff and technical experts.
[Added: 2022/05/08] [Last Updated: 2022/06/13]
Democratic Governance Unit 2022/05 Completed The ProDoc proposes both local and international technical experts at rate of 1-3 (International and National) across all Project outputs. The Project will count with a full time M&E officer to support the project manager. History
24. Recommendation:

A more robust ‘Results Based’ monitoring and reporting mechanism should be developed whereby the AWPs, progress reports/templates are clearly aligned with the Results Framework.

Management Response: [Added: 2022/05/08]

Agreed.  The draft ProDoc  has  paid special attention to develop a more robust “Result Based” monitoring and reporting mechanism. AWPs and progress reports will be aligned with the Results Framework during the project implementation.

Key Actions:

25. Recommendation:

Keeping in view the range of stakeholders involved covering many sectors and scattered geographical locations, the project progress and activity data should be available on a digital platform that provides real time snapshot of all project activities, statistics, and maps.

Management Response: [Added: 2022/05/08]

Agreed. The Project currently manages an online Stakeholders data base; locations map and statists and it is currently working on launch more interactive data base. The current ongoing platform will be also utilized for the Project third phase.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Migrate the current online – static data base to a platform in which allows interactive and iteration in real time. (eg. Power BI)
[Added: 2022/05/08] [Last Updated: 2022/06/13]
Democratic Governance Unit 2022/05 Completed An interactive data base was created using Power BI tool. History
26. Recommendation:

A clear and concise risk mitigation strategy should be devised to mitigate any further risk caused by Covid-19 pandemic and/or its post pandemic impacts as well as other risks.

Management Response: [Added: 2022/05/08]

Agreed. As per UNDP’s requirement, each project develops a risk log every year and updates it periodically based on the context analysis taking into account the existing risks. The new project document will also develop a risk log which includes risk mitigation strategy.   

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Develop a risk log with mitigation measures for the next phase.
[Added: 2022/05/08] [Last Updated: 2022/06/13]
Democratic Governance Unit 2022/05 Completed A Risk log was developed in the Prodoc History
27. Recommendation:

Keeping in view the evolving role of UNDP in the project, involvement of the communities as a major stakeholder of the project as well as high priority needs identified in the Regional Strategic Plan for the regional government. The overall partnership strategy needs to be revisited and/or strengthened. It should be focused on more enhanced and increased partnership with the CSOs/NGOs as well as inclusion of private sector (Particularly for agribusiness development and business development support.

Management Response: [Added: 2022/05/08]

Agreed.  Draft ProDoc will have a partnership strategy included into it.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Finalize the ProDoc with partnership strategy.
[Added: 2022/05/08] [Last Updated: 2022/06/13]
Democratic Governance Unit 2022/05 Completed Project Document is finalized History
28. Recommendation:

Cleary identify what will be the value proposition that each partner will bring in throughout the project cycle for each outcome and related outputs. E.g. UNDP for Governance Vis-a-Vis CSOs in CBT etc.

Management Response: [Added: 2022/05/08]

Agreed. The Project is currently working on the stakeholders mapping. This will identify the value proposition to be had from each of partners.

Key Actions:

29. Recommendation:

The partnership strategy with refined roles and responsibilities should be linked and tied up with the resource mobilization strategy, discussed in the next sector.

Management Response: [Added: 2022/05/08]

Partially agreed.  Many of the partners are at the local level and they do not have any potential for resource mobilization. Depending upon the Project resource gap, UNDP will reach out to potential partners for mobilizing the resources.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
UNDP to reach to potential donors for resource mobilization.
[Added: 2022/05/08]
Democratic Governance Unit 2023/05 Not Initiated
30. Recommendation:

The partnership strategy should also include roles and responsibility matrix for each partner for accountability and transparency purposed.

Management Response: [Added: 2022/05/08]

Agreed. The stakeholder mapping will have roles and responsibilities of each partner.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
The Project to finalize stakeholder mapping.
[Added: 2022/05/08] [Last Updated: 2022/06/13]
Democratic Governance Unit 2022/05 Completed Each Project Output has identified key stakeholders History
31. Recommendation:

A clear, coherent, and comprehensive sustainability/exit strategy should be developed covering political, socio economic, institutional, and financial components of the project sustainability. The sustainability strategy should be complemented by a well-planned and targeted ‘resource mobilization strategy’ to ensure timely financial sustainability of the programme.

Management Response: [Added: 2022/05/08] [Last Updated: 2022/05/08]

Agreed. In line with response to recommendation 4. A sustainability/exit strategy will be developed during the Project implementation No action required now.

Key Actions:

32. Recommendation:

It is vital that sustainability dimension of the project, particularly related to the built capacities of the government departments should be aligned with the exit strategy, monitored through well-defined KPIs, and validated through a thorough assessment.

Management Response: [Added: 2022/05/08]

Agreed however Project intervention related to the capacity building of the regional government is limited to a few areas. Project will develop exit strategy in the areas where the new phase Project will work in capacity building.  The

Key Actions:

33. Recommendation:

Well-designed interventions should be ensured to develop off-farm water resources and on-farm water harvesting tools and techniques to sustain the benefits of new technology adopted and established value chain.

Management Response: [Added: 2022/05/08]

Agreed. This will be taken into account during the implementation of the new phase of the Project.

Key Actions:

Latest Evaluations

Contact us

1 UN Plaza
DC1-20th Floor
New York, NY 10017
Tel. +1 646 781 4200
Fax. +1 646 781 4213
erc.support@undp.org