Mid-Term evaluation of "Skills Development for Employment" (SD4E) programme

Report Cover Image
Evaluation Plan:
2017-2021, Albania
Evaluation Type:
Mid Term Project
Planned End Date:
07/2017
Completion Date:
07/2017
Status:
Completed
Management Response:
Yes
Evaluation Budget(US $):
20,000

Share

Document Type Language Size Status Downloads
Download document TORs - International Consultant - SD4E Midterm Evaluation.doc tor English 149.00 KB Posted 105
Download document Final Mid-Term Evaluation Report SD4E.pdf report English 1103.22 KB Posted 121
Title Mid-Term evaluation of "Skills Development for Employment" (SD4E) programme
Atlas Project Number: 00081242
Evaluation Plan: 2017-2021, Albania
Evaluation Type: Mid Term Project
Status: Completed
Completion Date: 07/2017
Planned End Date: 07/2017
Management Response: Yes
Focus Area:
  • 1. Democratic Governance
  • 2. Others
Corporate Outcome and Output (UNDP Strategic Plan 2014-2017)
  • 1. Output 1.1. National and sub-national systems and institutions enabled to achieve structural transformation of productive capacities that are sustainable and employment - and livelihoods- intensive
Evaluation Budget(US $): 20,000
Source of Funding: Project Budget
Evaluation Expenditure(US $): 16,000
Joint Programme: No
Mandatory Evaluation: No
Joint Evaluation: No
Evaluation Team members:
Name Title Email Nationality
Dr. Dietmar Aigner
Sabina Ymeri
GEF Evaluation: No
Key Stakeholders: Ministry of Social Welfare and Youth
Countries: ALBANIA
Lessons
Findings
Recommendations
1

Considering the still scattered initiatives for building up institutions and capacities for VET in Albania, there is an urgent need for developing a clear institutional roadmap with the sequencing of decisions and steps to be made to realise a full-fledged VET reform at central level. The PSC should consider requesting such guidance document from the SD4E Programme. UNDP in collaboration with other key partners such as the EU-IPA project operating also at policy level, should be entrusted to prepare such document.

2

Based on such roadmap, adequate in-house capacities for policy making, implementation and monitoring should be revised and strengthened both, at the level of the MoSWY and its subordinated agencies (NES, NAVETQ). A coherent effort for capacity building involving the MoSWY as the lead sector institution, SDC, UNDP, EU and possibly other donors should be developed and implemented, with a time horizon possibly exceeding the current timeline of the SD4E Programme.

3

Considering programme sustainability, the Programme Steering Committee should increase the dialogue about urgent steps needed for ensuring proper sustainability of outputs. Urgent government actions such as a formal adoption and dissemination of programme outputs, political and administrative decisions to be taken indispensable for the sustainability and impact of certain programme outputs, etc. should be identified, agreed and closely monitored by the Programme Steering Committee.

4

Indicators given in the log frame matrix should be reviewed and where needed revised to allow a realistic appreciation of the SD4E outcomes and outputs and their actual achievement.

5

Lessons learned need to be more formally documented as part of progress reporting. In addition, the next workplan could include a section, detailing which particular lessons have been identified/ applied for preparing the work plan.

1. Recommendation:

Considering the still scattered initiatives for building up institutions and capacities for VET in Albania, there is an urgent need for developing a clear institutional roadmap with the sequencing of decisions and steps to be made to realise a full-fledged VET reform at central level. The PSC should consider requesting such guidance document from the SD4E Programme. UNDP in collaboration with other key partners such as the EU-IPA project operating also at policy level, should be entrusted to prepare such document.

Management Response: [Added: 2018/09/25]

In the very outset of the SD4E programme, UNDP was entrusted by the Ministry of Social Welfare and Youth to develop a roadmap on the reform of the VET system. This document was submitted to the Ministry already by December 2015. Following this and other programme actions, the SD4E programme has continuously and closely supported MoSWY to advance the legislative and institutional framework development and implementation of the VET reform. Provided the tedious process of the new VET Law adoption and subsequently delays in the reform implementation, the programme supported MOSWY to improve the management of the VET system within the given structures, as well as to promote and increase VET attractiveness.

Following the most recent developments, UNDP is proactive to once again support the VET reform process, under the lead of the responsible Ministry, and in close cooperation with other donor and EU projects acting at the policy level.  

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Elaboration of a roadmap in close cooperation with other projects acting at policy level to support capacity and institutional building in the frame of the VET reform.
[Added: 2018/09/25] [Last Updated: 2019/01/09]
UNDP 2018/12 Completed History
2. Recommendation:

Based on such roadmap, adequate in-house capacities for policy making, implementation and monitoring should be revised and strengthened both, at the level of the MoSWY and its subordinated agencies (NES, NAVETQ). A coherent effort for capacity building involving the MoSWY as the lead sector institution, SDC, UNDP, EU and possibly other donors should be developed and implemented, with a time horizon possibly exceeding the current timeline of the SD4E Programme.

Management Response: [Added: 2018/09/25]

This is a valid point. Following the government restructuring and emerging capacity building needs at the Ministry of Finance and Economy, UNDP is committed to undertake a functional review of the institutions at central level responsible for Employment and Skills Development. This functional review will aim at identifying capacities of main responsible institutions (MoFE, NES and NAVETQ) to account for the implementation of the National Employment and Skills Strategy 2014-2020 and the government priority on employment. This functional review and other actions – based on needs articulated by the Ministry and subordinated Agencies – will be integrated in the work plan for the remaining timeframe of the current programme phase. These actions will be consulted with SDC, EU and other donors.

In addition, UNDP will seriously take up this recommendation in the development of the consolidation phase of the SD4E programme, which will primarily aim at building up and consolidating the achievements of the current phase, consolidate the revised structures and contribute to full-fledged VET reform. 

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Revise the work plan of the current phase to address capacity building needs emerging from the reshuffling of the government and new responsible structures for Employment and VET
[Added: 2018/09/25] [Last Updated: 2019/01/09]
UNDP, PSC 2018/12 Completed History
Carry out a functional review at the central level, including the responsible department at the Ministry of Finance and Economy, NES and NAVETQ
[Added: 2018/09/25]
SD4E, UNDP, PSC 2018/01 Completed
Include conclusions and recommendations on capacity building for the sake of the VET reform in the development of the consolidation phase of the programme
[Added: 2018/09/25] [Last Updated: 2019/01/09]
UNDP, SDC, PSC 2018/12 Completed History
3. Recommendation:

Considering programme sustainability, the Programme Steering Committee should increase the dialogue about urgent steps needed for ensuring proper sustainability of outputs. Urgent government actions such as a formal adoption and dissemination of programme outputs, political and administrative decisions to be taken indispensable for the sustainability and impact of certain programme outputs, etc. should be identified, agreed and closely monitored by the Programme Steering Committee.

Management Response: [Added: 2018/09/25]

Ensuring sustainability of programme outputs and outcomes has been a permanent concern and effort of UNDP. Its approach focused on developing sustainable and systemic solutions and avoid application of pilot models. UNDP’s support to the Ministry, NES and NAVETQ based on the agreement that needs, processes and results should always be articulated and developed under the leadership of the responsible institution(s). Nevertheless, the results were not the one expected for reasons UNDP could not influence. While some of the results are yet in development or adoption process (package of VET bylaws), specific results, such as improved employment promotion programmes and the newly revised National List of Occupations were adopted and formalized.

The concern about sustainability of results was raised in PSC meetings, but more specifically in the meetings of the technical groups and the Technical Committee meetings.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Include a specific topic programme sustainability in the agenda of the upcoming PSC meeting in consultation with SDC.
[Added: 2018/09/25] [Last Updated: 2019/01/09]
Government, UNDP, SDC 2018/12 Completed History
Enhance cooperation and coordination with the Ministry to advance and accelerate – where possible – the formalization of programme outputs.
[Added: 2018/09/25] [Last Updated: 2019/01/09]
UNDP 2018/12 Completed History
4. Recommendation:

Indicators given in the log frame matrix should be reviewed and where needed revised to allow a realistic appreciation of the SD4E outcomes and outputs and their actual achievement.

Management Response: [Added: 2018/09/25]

The log frame matrix was developed in a participatory process with all relevant stakeholders and included outcomes, outputs and indicators elaborated based on the vision and goal of MoSWY to achieve a systemic reform of the employment and skills development system in Albania. Changes in the political decision- making level at MoSWY influenced deceleration in the achievement of these ambitious, yet relevant outcomes. Taking this recommendation into account, UNDP carefully work on the revision of indicators, include the revised log frame in the annual work plan for 2018 and present it to the upcoming PSC for endorsement.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Revise the log frame indicators and submit for approval at the upcoming PSC meeting
[Added: 2018/09/25]
UNDP, PSC 2018/07 Completed
Implement the revised work plan and report against the revised log frame indicators
[Added: 2018/09/25] [Last Updated: 2019/01/09]
UNDP 2018/12 Completed History
5. Recommendation:

Lessons learned need to be more formally documented as part of progress reporting. In addition, the next workplan could include a section, detailing which particular lessons have been identified/ applied for preparing the work plan.

Management Response: [Added: 2018/09/25]

This is a valid point. The upcoming progress report document will include a section, describing particular lessons learnt during the entire programme implementation and especially in the light of the mid-term review conclusions.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Include a dedicated session on lessons learnt in the upcoming progress report document
[Added: 2018/09/25] [Last Updated: 2019/01/09]
UNDP 2018/12 Completed History

Latest Evaluations

Contact us

220 East 42nd Street
20th Floor
New York, NY 10017
Tel. +1 646 781 4200
Fax. +1 646 781 4213
erc.support@undp.org