Independent Country Programme Evaluation: Timor Leste

Report Cover Image
Evaluation Plan:
2018-2021, Independent Evaluation Office
Evaluation Type:
ICPE/ADR
Planned End Date:
12/2018
Completion Date:
12/2018
Status:
Completed
Management Response:
Yes
Evaluation Budget(US $):
68,000

Share

Document Type Language Size Status Downloads
Download document ICPE Timor-Leste Annexes.pdf related-document English 894.47 KB Posted 206
Download document ICPE Timor-Leste ToR.pdf tor English 717.46 KB Posted 112
Download document ICPE_Timor-Leste_2018.pdf report English 7635.51 KB Posted 166
Download document ICPE_Timor-Leste_EvalBrief_2018.pdf summary English 222.48 KB Posted 110
Title Independent Country Programme Evaluation: Timor Leste
Atlas Project Number:
Evaluation Plan: 2018-2021, Independent Evaluation Office
Evaluation Type: ICPE/ADR
Status: Completed
Completion Date: 12/2018
Planned End Date: 12/2018
Management Response: Yes
Focus Area:
  • 1. Others
Corporate Outcome and Output (UNDP Strategic Plan 2014-2017)
  • 1. Output 1.3. Solutions developed at national and sub-national levels for sustainable management of natural resources, ecosystem services, chemicals and waste
  • 2. Output 1.4. Scaled up action on climate change adaptation and mitigation across sectors which is funded and implemented
Evaluation Budget(US $): 68,000
Source of Funding:
Evaluation Expenditure(US $): 67,500
Joint Programme: No
Joint Evaluation: No
Evaluation Team members:
Name Title Email Nationality
Deqa Musa Evaluation Specialist SOMALIA
GEF Evaluation: No
Key Stakeholders:
Countries: Timor-Leste
Lessons
Findings
1.

Finding 1. While the intended output results focused on community-level infrastructure and land stabilization have been delivered satisfactorily, the upstream results of interventions are unlikely to be delivered within the three- or four-year duration of UNDP projects. 


Tag: Agriculture Fishery Climate Change Adaptation Disaster Risk Reduction Effectiveness Impact Global Environment Facility fund Local Governance Monitoring and Evaluation UNDP Regional Bureaux Peace Building Resilience Social cohesion

2.

Finding 2. UNDP supported the Government with advocacy, evidence and advice in improving the enabling environment for economic diversification and in enhancing the entrepreneurship capacities of youth, fostering the development of social business and improving financial inclusion. Overall, much more needs to be done nationally in terms of systematization of vocational training for youth, certification, support for business creation and financial support. 


Tag: Rural development Effectiveness Innovation Country Government Private Sector Jobs and Livelihoods Poverty Reduction Youth Advocacy Policy Advisory

3.

Finding 3. Although the UNDP support has made a major contribution to enabling the SDGs to become nationally defined and scoped, the Government is looking to UNDP for continued support, particularly provision of tools, sharing of experiences from elsewhere and information technology (IT) support, particularly in terms of innovation. 


Tag: Effectiveness Efficiency Gender Equality Women's Empowerment Innovation Technology Technical Support Mainstreaming, Acceleration and Policy Support (MAPS) SDG Integration

4.

Finding 4. UNDP support to improved access to clean bioenergy did not fully achieve planned targets. Aside from project implementation delays and constraints, interest in renewable energy has been seriously compromised by increased conventional power generation capacity and subsidized electricity provision to consumers. However, the modest results attained will contribute to the overallgoal of reducing greenhouse gas emissions over the medium to long term.


Tag: Clean Energy Global Environment Facility fund Country Government UN Agencies Technical Support Agenda 2030

5.

Finding 5. Progress on mangrove protection and rehabilitation has been marginal due to several contextual constraints. The limited experience and capacities of community-based implementing bodies, limited budgets and experience of local authorities and the weak legal framework for mangrove protection hindered project implementation. 


Tag: Effectiveness Efficiency Global Environment Facility fund Gender Mainstreaming Local Governance Country Government Capacity Building Technical Support

6.

Finding 6. UNDP has progressively contributed to developing the capacity of the justice sector including the police, in the effective administration of justice. This has been made possible through the adoption, utilization and implementation of improved systems, management practices and institutionalized capacity development and training for the judiciary and the police. 


Tag: Effectiveness Impact Gender Equality Gender Mainstreaming Justice system Rule of law Capacity Building Technical Support

7.

Finding 7. Through the programme’s support to the mobile courts and provision of free legal aid (access to justice clinic), UNDP has contributed to strengthening citizens’ awareness of the formal justice system and legal aid services, and improved access to justice for people and communities. This process has contributed to deepening the rule of law and addressing GBV, given the significant proportion of gender-related cases brought before the mobile clinic and the Public Defender’s Office. However, while these programmes have had some very positive feedback from communities, the Government needs to assume responsibility for institutionalizing these initiatives and provide adequate budget support to enable their continuity and regularize them as part of the ongoing justice programme.


Tag: Effectiveness Efficiency Impact Sustainability Gender-Based Violence Women's Empowerment Human rights Justice system Rule of law Civil Societies and NGOs Country Government Technical Support

8.

Finding 8. Building on early initiatives implemented since 1999 by UNMIT, UNDP support has helped to build the capacity of the country’s electoral management bodies, enabling them to effectively lead and manage national and local elections. The effective conduct and management of the electoral process has contributed to the consolidation and deepening of democracy in the country. The high voter turnout and generally uncontested results of the elections in 2017 and 2018, and the high proportion of women represented in Parliament (above 35 percent), have given strong credibility and legitimacy to the country’s democratic process. This has created a more stable political environment as evidenced by the peaceful transfer of power between governments. 


Tag: Election Gender Equality Gender Parity Project and Programme management Effectiveness Impact Technical Support

9.

Finding 9. UNDP played an important role in developing capacities and an enabling framework to support decentralization and local governance. UNDP can build on its earlier work as well as ongoing initiatives at the subnational level to demonstrate alternative options for implementing decentralized governance. 


Tag: Capacity Building Inclusive economic growth Local Governance Gender Equality Women's Empowerment Partnership Effectiveness Efficiency Impact Technical Support

10.

Finding 10. This initiative is still at the start-up stage pending the appointment of the new Commissioner for the Anti-Corruption Commission by the new Government. Given the well-recognized challenges of fighting corruption, it is important that UNDP take a nuanced and pragmatic approach informed by a political economy analysis of context. 


Tag: Anti-corruption Knowledge management Effectiveness Relevance Policy Advisory

11.

Finding 11. UNDP has been able to leverage support from its various governance projects to strengthen engagement and partnership with CSOs and address issues of gender inequality and youth participation in the governance process. This result is encouraging and could lead to greater civil society engagement, if reinforced through concerted support by development partners. 


Tag: Youth Civic Engagement Rule of law Gender Equality Programme Synergy Effectiveness Technical Support

12.

Finding 12. A review of the governance programme monitoring framework indicates that the indicators used by the various governance projects are related to institutional performance. This is an accepted practice. However, in the context of Timor-Leste where most of the current support to governance is through legacy projects with a relatively long history of technical assistance, and because TimorLeste is in the process of transition from conflict/ post-conflict to development, the current indicators do not provide adequate measures for assessing the extent to which the various institutions have become more stable.


Tag: Monitoring and Evaluation Post Conflict Effectiveness Impact Sustainability Technical Support

13.

Finding 13. The country programme results are considered as gender-targeted since most UNDP supported interventions focused on ensuring women’s participation as beneficiaries of interventions. 


Tag: Gender Equality Gender Mainstreaming Gender Parity Gender-Based Violence Effectiveness Technical Support

14.

Finding 14. The sustainability prospects of the UNDP contributions are mixed. Except for the mobile court component, the governance programme interventions have fostered capacity development and national ownership and have more potential to be sustainable. On the other hand, inadequate financial and human resources, weak national and community-level capacities and the lack of critical mass are some of the factors limiting the continuity and sustainability prospects of the resilience and sustainable development portfolios. 


Tag: Justice system Resilience Efficiency Sustainability Technical Support

15.

Finding 15. The country programme has partially implemented the recommendations of its last independent evaluation and change management plan. As a result, the programme reflects a project approach despite the integrated and multidimensional issues it seeks to address. 


Tag: Donor relations Integration Programme Synergy Global Environment Facility fund Effectiveness Efficiency Technical Support

16.

Finding 16. There has been limited collaboration between UNDP and other United Nations agencies despite UNDP activities and interests having substantial overlap with those of several agencies. 


Tag: Gender Equality Coherence Effectiveness UN Agencies Technical Support

Recommendations
1

Recommendation 1. The next UNDP country programme should have one outcome area, focused on contributing to sustainable development through support to decentralized and area-based local governance. This would concentrate limited resources around a programme with limited and attainable objectives that make a clear contribution to national development. The outcome should incorporate critical elements of existing projects to ensure long-term sustainability. In governance and institutional strengthening, these include improving access to justice at the local level, strengthening integrity and accountability of local public administration and strengthening the institutional capacity of Oecusse Special Administrative Region.

2

Recommendation 2. The programme should align its objectives to resources which can be realized. The practice of inflating objectives and targets on the basis of “aspirational” funding from unknown sources and completely unrealistic GEF co-funding estimates should be halted. Future country programmes should be realistic, with clearly identified contributions to nationally-owned development policies and programmes.

3

Recommendation 3. Future country programmes should be built around a specific capacity building strategy with clear objectives, realizable targets and concrete plans for increased national ownership and management. While government bodies recognize their capacity limitations, they also feel that these could be overcome more quickly through a more consistent and effective approach to capacity-building from UNDP. Enhanced technical and operational capacities of the Government and private sector are essential for the phased transfer from direct to national implementation. UNDP approaches to capacity-building need to become more targeted and results-oriented so that progress can be measured and the transition to national implementation can begin as soon as possible.

4

Recommendation 4. In the context of the integrator role defined in the Strategic Plan, 2018- 2021 and of United Nations system reform, UNDP should systematically consider and map the best opportunities for enhanced results through improved UNCT collaboration and work with the Resident Coordinator to bring these to fruition. National stakeholders have observed a lack of complementarity and coordination among United Nations bodies. Given overlapping interests and expertise across United Nations agencies, joint programmes or other focused collaboration can strengthen the quality of technical support and maximize use of limited resources.

1. Recommendation:

Recommendation 1. The next UNDP country programme should have one outcome area, focused on contributing to sustainable development through support to decentralized and area-based local governance. This would concentrate limited resources around a programme with limited and attainable objectives that make a clear contribution to national development. The outcome should incorporate critical elements of existing projects to ensure long-term sustainability. In governance and institutional strengthening, these include improving access to justice at the local level, strengthening integrity and accountability of local public administration and strengthening the institutional capacity of Oecusse Special Administrative Region.

Management Response: [Added: 2019/09/12] [Last Updated: 2020/06/11]

UNDP is committed to reduce the dispersion in the programme; the MCT has already aligned the office resources around a portfolio approach already merging two areas (sustainable dev and resilience-building) in 2017. The office will start the new UNDAF and CPD formulation in 2019 using the new Strategic Plan and integrator role. The environment portfolio is expected to remain an important component of the programme with the potential approval of the GCF which goes beyond governance issues.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
SDG acceleration units
[Added: 2019/11/22] [Last Updated: 2020/02/13]
RR/DRR 2019/12 Completed New CPD has been drafted using the new Strategic Plan and integrator role, will be submitted in March History
Decentralization Project
[Added: 2020/02/13]
Governance/RR/DRR 2020/01 Completed The Decentralization project is start implementing in January 2018 and will be end by April 2020.
2. Recommendation:

Recommendation 2. The programme should align its objectives to resources which can be realized. The practice of inflating objectives and targets on the basis of “aspirational” funding from unknown sources and completely unrealistic GEF co-funding estimates should be halted. Future country programmes should be realistic, with clearly identified contributions to nationally-owned development policies and programmes.

Management Response: [Added: 2019/09/12] [Last Updated: 2020/06/11]

Agreed. Implemented since January 2016.

Key Actions:

3. Recommendation:

Recommendation 3. Future country programmes should be built around a specific capacity building strategy with clear objectives, realizable targets and concrete plans for increased national ownership and management. While government bodies recognize their capacity limitations, they also feel that these could be overcome more quickly through a more consistent and effective approach to capacity-building from UNDP. Enhanced technical and operational capacities of the Government and private sector are essential for the phased transfer from direct to national implementation. UNDP approaches to capacity-building need to become more targeted and results-oriented so that progress can be measured and the transition to national implementation can begin as soon as possible.

Management Response: [Added: 2019/09/12] [Last Updated: 2020/06/11]

Agreed and improvements already under implementation.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
SDG delivery unit
[Added: 2019/11/22] [Last Updated: 2020/02/13]
RR/DRR 2019/12 Completed Monitoring and Evaluation and HACT training was provided to the counterpart (Government and Civil Society) as well as UN Staff. History
4. Recommendation:

Recommendation 4. In the context of the integrator role defined in the Strategic Plan, 2018- 2021 and of United Nations system reform, UNDP should systematically consider and map the best opportunities for enhanced results through improved UNCT collaboration and work with the Resident Coordinator to bring these to fruition. National stakeholders have observed a lack of complementarity and coordination among United Nations bodies. Given overlapping interests and expertise across United Nations agencies, joint programmes or other focused collaboration can strengthen the quality of technical support and maximize use of limited resources.

Management Response: [Added: 2019/09/12] [Last Updated: 2020/06/11]

UNDP is committed to United Nations reform and to its integrator role. Alignment and coordination depend not only from UNDP commitment but also from the Resident Coordinator and the United Nations agencies. UNDP is witness to constant forces driving United Nations agencies to compete for resources with little capacity and sometimes questionable commitment to joint initiatives. There are some promising leads such the work on youth (with UNFPA, UNICEF), Parliament (UN-Women) and also the Unique ID (UNICEF). In addition, we have submitted two proposals focusing on gender-based violence with UN-Women, UNFPA, the International Organization for Migration and UNICEF, and have jointly organized all international United Nations days.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
International United Nations days
[Added: 2019/11/22] [Last Updated: 2020/02/13]
RR/DRR 2019/12 Completed Joint Celebration of UN Day in October, lead by UNDP. History
GBV proposal
[Added: 2019/11/22] [Last Updated: 2020/02/13]
RR/DRR 2019/12 Completed - GBV proposal is submitted to KOICA, second verification mission will be held in March - May 2020. This proposal concerned with the UNDP, UNFPA, UN WOMEN and IOM. - Other Joint efforts with other UN Agency and RCO is spotlight Initiatives which the implementation is starting this year. History

Latest Evaluations

Contact us

1 UN Plaza
DC1-20th Floor
New York, NY 10017
Tel. +1 646 781 4200
Fax. +1 646 781 4213
erc.support@undp.org