Promoting Mainstream Policies and Services for People with Disabilities in Ukraine (2nd Phase)

Report Cover Image
Evaluation Plan:
2018-2022, Ukraine
Evaluation Type:
Final Project
Planned End Date:
02/2019
Completion Date:
03/2019
Status:
Completed
Management Response:
Yes
Evaluation Budget(US $):
3,000

Share

Document Type Language Size Status Downloads
Download document ToR_UDD Project Final Evaluation_final.docx tor English 61.25 KB Posted 371
Download document PwD II Final Evaluation report.pdf report English 1502.10 KB Posted 380
Title Promoting Mainstream Policies and Services for People with Disabilities in Ukraine (2nd Phase)
Atlas Project Number: 00105623
Evaluation Plan: 2018-2022, Ukraine
Evaluation Type: Final Project
Status: Completed
Completion Date: 03/2019
Planned End Date: 02/2019
Management Response: Yes
UNDP Signature Solution:
  • 1. Governance
Corporate Outcome and Output (UNDP Strategic Plan 2018-2021)
  • 1. Output 1.1.2 Marginalised groups, particularly the poor, women, people with disabilities and displaced are empowered to gain universal access to basic services and financial and non-financial assets to build productive capacities and benefit from sustainable livelihoods and jobs
SDG Goal
  • Goal 10. Reduce inequality within and among countries
SDG Target
  • 10.2 By 2030, empower and promote the social, economic and political inclusion of all, irrespective of age, sex, disability, race, ethnicity, origin, religion or economic or other status
  • 10.3 Ensure equal opportunity and reduce inequalities of outcome, including by eliminating discriminatory laws, policies and practices and promoting appropriate legislation, policies and action in this regard
Evaluation Budget(US $): 3,000
Source of Funding: Project budget; donor
Evaluation Expenditure(US $): 2,400
Joint Programme: No
Joint Evaluation: No
Evaluation Team members:
Name Title Email Nationality
Ilova Yeleneva UKRAINE
GEF Evaluation: No
Key Stakeholders:
Countries: UKRAINE
Lessons
1.

1. The UD concept is still new to Ukrainian stakeholders. It is well accepted by local authorities and people with disabilities, however, local stakeholders remain unaware and reluctant to apply the UD principles due to the budget limitations. Low awareness among the stakeholders about the UD principles, might be the reason for the low involvement of the Ministry of Health and Ministry of Social Policies in promoting it nationwide. The Project mostly focused its awareness-raising efforts at professionals and people with disabilities by creating a specilized website. To increase awareness among the general public about UD, a wider awareness-raising campaign is needed, involving more mass media outlets.

 


Findings
1.

DATA ANALYSIS AND KEY FINDINGS OF THE EVALUATION

RELEVANCE 

The project is consistent with SDGs and the priority needs of people with disabilities as expressed in the national priorities and in both UNDP Country Programme Document/UN Partnership Framework 2018 - 2022 and UNDP Strategic Plan 2018 - 2022.  

The Project is in line with the Country Programme Document (CPD) outcome “By 2022, women and men, girls and boys participate in decision-making and enjoy human rights, gender equality, effective, transparent and non-discriminatory public services”. The expected project’s output contributed into CPD output 1.1. “Regional and local authorities have scaled up knowledge and skills to engage communities in planning, coordination, delivery and monitoring of public services provision” and output 1.2. “National institutions, systems, laws and policies advance the equitable realization of human rights, especially among vulnerable groups”. The Project outcomes directly contribute into United Nations Partnership Framework activity 3.1.3.15 Awareness among national authorities, community associations, business, employers, services providers, educational institutions and wider public on disability, accessibility and universal design principles raised at the national level and knowledge on accessibility and universal design institutionalized.


Tag: Relevance Gender Equality Women's Empowerment Human rights Communication Knowledge management Monitoring and Evaluation Ownership Policies & Procedures Service delivery Disabilities Social Protection Advocacy SDG Integration

2.

RELEVANCE (continuation)

The outcomes of the Project remained relevant throughout the period of its implementation. The Project activities were relevant to reach the outcomes, and the contribution of activities to the results outlined in the project document. In particular, Outcome 1 “The local authorities, organizations, services providers and employers in Ukraine apply accessibility and universal design principles” and Outcome 2 “Awareness among national authorities, community associations, business, employers, services providers, educational institutions and wider public on disability, accessibility and universal design principles raised at the national level and knowledge on accessibility and universal design institutionalized.” Both outcomes were reached and even exceeded by implementation of relevant activities. See Effectiveness section for detailed indicator achievement report per indicators planned. Mini-grants were disbursed over Phase 2 of the Project to support local initiatives over 2018. As per interviews with grantees, as well as NADU consultant supporting the implementation of the mini grants, all respondents assess this initiative as highly relevant. 

The UD School training for teachers of universities and for young professionals and students initiated within the Project, have become a solid platform not only for knowledge distribution on UD, but also for experience exchange, thus proving the relevance of this activity towards the needs of the target group. The online questionnaire of the participants of the both Schools and grantees proved the activities were relevant for respondents: all 29 respondents acknowledged that the experience they got from participation in the Project was useful for them (including 22 respondents claiming “very useful”). Furthermore, 20 out of 29 respondents claimed they had already applied UD principles in their work, as a result of the capacity building activities of the Project. Four more reported they planned to do so in the nearest future.


Tag: Relevance Project and Programme management Results-Based Management Theory of Change Coordination

3.

RELEVANCE (continuation)

MEDIA MONITORING REPORT

The web publications and content related to the promotion of universal design and accessibility principles has been studies for the period January 2011 - January 2019 to assess the Project immediate impact in raising public awareness. The phrase Universal design in Ukrainian was used as the key words for the web content analysis using Google web-search engine. The first 30 resources presented by Google. The number of relevant publications out of the first 30 publications presented in google web search engine per each year is growing gradually throughout all evaluated years from 3 in 2011 to 24 in January 2019, proving the increase in web coverage of the Universal design. The wider audience reach can also be evidenced by the increase of online mass media sources from zero in (2011 – 2012) to ten (2018), expanding beyond the narrow circle of project publications, partners and professionals working in the areas of Universal design, accessibility and social inclusion. 

Analysis per different

Project periods: Before 2012 (prior to the beginning of Phase 1 of the Project) just a few publications at the http://naiu.org.ua (no longer accessible, unfortunately) as well as references to the law of Ukraine, with no publications at Mass media and other partners’ websites. Thus, we may conclude that before the beginning of the first phase of the Project, web media in Ukraine didn’t covered Universal design. 


Tag: Relevance Human rights Communication Knowledge management Monitoring and Evaluation Policies & Procedures Disabilities Advocacy

4.

EFFECTIVENESS 

The Project has delivered planned output-level results in all four areas of the programme activities, namely: I. Enhanced access to mainstream employment for persons with disabilities with a focus on equal access for men and women with disabilities; II. Improved access to healthcare services for persons with disabilities with a focus on women and children with disabilities; III. Eliminated barriers to services for people with disabilities by supporting local initiatives for universal design in goods, services, infrastructure and information; IV. Conducted awareness raising campaign on disability, accessibility and universal design among key stakeholders and broader public. 

The Project achieved the qualitative and quantitative indicators as defined in the project document. Some of the indicators were exceeded. See Table 2 for further details on the baseline, targets and achieved results. The results achieved have been confirmed through field visits, desk assessment and interviews with stakeholders. 


Tag: Effectiveness Gender Equality Women's Empowerment Local Governance Health Sector Communication Integration Knowledge management Partnership Results-Based Management Service delivery Country Government Disabilities Jobs and Livelihoods Social Protection Advocacy Capacity Building

5.

EFFICIENCY

The assessment of efficiency looked at the extent to which the various activities of the project transformed the available resources into the intended results, in terms of quantity, quality, and timeliness, and the extent to which the desired effects were achieved with the available resources. 

Cost-effectiveness

All activities of the Project were implemented according to the planned budget. Services have been procured by UNDP according to UNDP rules ensuring the ‘best value for money’ approach. Taking into account the small scale of the budget provided, the Project succeeded in attracting about a half of its budget on top of Project budget, which helped to increase project outputs and its impact. 


Tag: Efficiency Human and Financial resources Monitoring and Evaluation Operational Efficiency Policies & Procedures Project and Programme management Strategic Positioning

6.

IMPACT AND SUSTAINABILITY

With targeted project interventions, 7,225 people with disabilities were reportedly reached. Unfortunately, disaggregation by sex was available only for several grantee reports. The given methodology of the survey did not provide an opportunity to specify the disaggregation of the data collected at this stage. It is recommended for future project sub-grants to provide detailed guidelines on disaggregation by sex. Over 25,000 people with limited mobility were reported to enjoy enhanced participation and access to services, as a result of the ten sub-grants supported within Phase II of the Project. One of the ways employed to evaluate the Project’s impact was to calculate the number of people with disabilities, that accessed a service after the Project intervention (i.e. in the form of mini-grants). The inclusion of all members of targeted communities, where UD principles were applied (in the form of modification of a local health facility, playground for kids or theatre plays of into the calculations), into the calculations can partially explain such a significant number of people reached. 

Sustainability

An overview of Project's quarterly reports and interviews revealed a highly successful and demanded initiative. The following findings are expected to have contributed to the Project’s sustainability:  

Supported employment for people with disabilities. Two hundred thirty-one people with low mobility (133 women and 98 men) applied for employment services at the Employment centre in Kharkiv after the end of grant support from the Project. Prior to this in summer 2018, only 28 persons with limited mobility applied for employment service (in January-February 2018). Over the grant period implementation (August-October 2018), 347 persons with low mobility were reached by the service (190 women and 157 men). The interview with Director of the State rehabilitation enterprise “Centre for people with disabilities comprehensive rehabilitation “Podillya”, under the Ministry of Social Policy of Ukraine, proved the high demand for the model of support for people with disabilities over employment process and at the workplace piloted within the project. The grant project envisioned a service package for people with disabilities, based on the national standards of social services for supportive employment. Though the standards have been approved by the Ministry of Social Policy of Ukraine earlier, the services for supportive employment have never been provided to people with disabilities at the rehabilitation centres before the pilot took place and focused, rather, at the education rather than employment process assistance. 

The Project also identified key gaps preventing people with disabilities from seeking employment. Ukrainian employers do not employ persons with disabilities due to specific stereotypes and fear of bearing the costs, related to the reorganization of the workplace. This, in turn, causes people withdisabilities to doubt the success of seeking the employment, as they are unsure about being welcomed at the workplace. The sustainable impact of the Project was also demonstrated, when the Rehabilitation Centre “Podillya” created a new position – a job coach – who deals with supporting the employers after the project’s completion. The job coach can facilitate the dialogue between an employer and an employed person with disability. Out of 20 persons employed in the course of the project implementation, 80% continued the employment. All of them reported significant improvements to their quality of life due to the stable income, ability to contribute to the economy, self-actualize, grow professionally and socialize. Following this example, the Ministry of Social Policy of Ukraine is supporting the idea to promote this model further. The Ministry plans to focus on the legislation framework with regards to the implementation of the recommendations provided by the Project. 


Tag: Challenges Impact Sustainability Gender Equality Women's Empowerment Human rights Health Sector Policies & Procedures Disabilities Education Jobs and Livelihoods Advocacy

7.

NETWORK AND LINKAGES

The Project mainstreamed disability-related activities and initiatives in other UNDP projects and programmes and involved a wide range of national and sub-national level stakeholders to spread and apply UD principles. In particular, the Project jointly with UNDP Recovery and Peacebuilding Programme (RPP) – a programme aimed at the restoration of the conflict-affected regions of Ukraine - facilitated workshops for RPP staff to equip them with the knowledge to apply UD principles in infrastructure rehabilitation and restoration of services in the region. 

Jointly with UNDP Democratic Governance Programme – a programme aimed at promoting democratic reforms in the country - the universal design concept was presented at the training for regional SDG coordinators to promote and apply UD principles in local communities in all 24 regions. WHO supported the training on UD in health sector for managers of clinics and representatives of Ukrainian medical universities, thus providing their input into the joint Project. UNDP Procurement Support Services to the Ministry of Health of Ukraine provided an international expert and Health Programme Intern to develop the manual on UD in healthcare. This cooperation resulted in the development of a study on the international best practices of UD application in clinics. At the same time, not all of the examples turned out to be applicable in the Ukrainian context and were not included in the final publication. 


Tag: Civic Engagement Human rights Integration Partnership Programme Synergy Civil Societies and NGOs Country Government UN Agencies Capacity Building Disabilities Coordination

8.

(Continuation from Finding 1)

The direct beneficiaries (National Assembly of people with disabilities of Ukraine (NADU) and their members) have expressed full ownership of the Project, report being involved in the design and implementation of the Project and considered it as highly relevant to their priority needs.  According to NADU and the representatives interviewed, pointed out to meet their needs for the following reasons:  

 


Tag: Relevance Sustainability Ownership Programme/Project Design Project and Programme management Service delivery Disabilities Awareness raising

9.

EFFECTIVENESS (Continuation from Finding 4)

The Project addressed gender considerations by actively engaging and empowering women with disabilities and local female leaders. The Project also supported an initiative in adapting local OB/GYN examination room for women with disabilities in Manevichy medical facility, therefore making women health service more accessible. Further, data disaggregated by sex is available for most of the project activities. However, it is worth noting, that some grantees failed to collect sex-disaggregated data. The same issue applies to the use of national statistics to access outcome-level results – currently Ukrainian National Statistical Agency does not collect and report sex-disaggregated data, particularly on the number of social services provided or the number of women and men with disabilities and types of disabilities they have. 


Tag: Effectiveness Gender Equality Women's Empowerment Reproductive Health Project and Programme management Service delivery Disabilities Social Protection Data and Statistics

Recommendations
1

Recommendations

The universal design principles should be implemented across all UNDP projects and activities since they directly correlate with SDG achievement and UNDP strategic goals. As a result of the Evaluation, the following recommendations were proposed: 

Introduction of disaggregated data collection methods related to people with disabilities and people with limited mobility, both at the national and local levels. Given that it is impossible to assess in some instances whether the Project fully met the specific needs of women and men with disabilities, due to the lack of sex-disaggregated data, it is essential to ensure that the PwDcentered gender-sensitive approach is in place. In this regard, proper advocacy activities should be planned for future actions.  

2

Collect and present the UD principles and the best cases of their application. Cases focusing on the promotion of the UD principles and their application should, when possible, be of a Ukrainian origin and presented by local opinion leaders and people with disabilities. Story-telling might be a good choice, attracting the attention of the local media outlets and promote UD concept at the local level   

3

Greater involvement and capacity building of people with disabilities.  Involvement and capacity building of people with disabilities to act as agents of change should ultimately lead to their empowerment and amplification of their voices. In its turn, this would allow to strengthen the advocacy efforts for better access to services and a higher number of universally designed infrastructure.

4

Intensification of cooperation with the relevant ministries. Closer cooperation with the relevant ministries will contribute to a broader distribution of lessons learned and will help to better understand the changing political environment, ensuring flexibility of activities. However, low interest in the UD principles on the side of the Ministry of Health of Ukraine and Ministry of Social Policy of Ukraine may impede its roll-out across the country. To this end, the universal design principles should be implemented, as a part of the current decentralisation reform, building on the present reform impetus. For instance, this may include the support of the Ministry of Social Policy efforts to establish integrated social services at the community level. The awareness-raising activities and the capacity building of local level decision-makers are required to ensure proper implementation of the universal design principles at the community level including planning, budgeting and implementation.

5

Development of a comprehensive roadmap to ensure implementation of the Universal Design principles at all levels (both national and local) and across many sectors (labour and social policy, health, architecture and so on).  For instance, to ensure that job coaching services are in place, combined efforts of many stakeholders (e.g. employment centres, rehabilitation centres, local service providers, employment services, and employers) should be utilised in the development of such a roadmap;

1. Recommendation:

Recommendations

The universal design principles should be implemented across all UNDP projects and activities since they directly correlate with SDG achievement and UNDP strategic goals. As a result of the Evaluation, the following recommendations were proposed: 

Introduction of disaggregated data collection methods related to people with disabilities and people with limited mobility, both at the national and local levels. Given that it is impossible to assess in some instances whether the Project fully met the specific needs of women and men with disabilities, due to the lack of sex-disaggregated data, it is essential to ensure that the PwDcentered gender-sensitive approach is in place. In this regard, proper advocacy activities should be planned for future actions.  

Management Response: [Added: 2019/04/15] [Last Updated: 2020/12/14]

Recommendation is partially accepted. Currently UNDP does not have a project that targets strengthening the capacities of State Statistical Services or Ministry of Social Policy. Given the scope of the evaluated projects, as well as its budget and implementaiton timeline, the project did not have a capacity to address systematic issues with data collection on people with disabilities and other types of vulnerabilities.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
To consider recommendation as a part of future interventions, related to social protection and/or strengthening Statistical Services of Ukraine
[Added: 2019/05/06]
BD&I unit, DG portfolio 2023/12 Not Initiated
2. Recommendation:

Collect and present the UD principles and the best cases of their application. Cases focusing on the promotion of the UD principles and their application should, when possible, be of a Ukrainian origin and presented by local opinion leaders and people with disabilities. Story-telling might be a good choice, attracting the attention of the local media outlets and promote UD concept at the local level   

Management Response: [Added: 2019/04/15] [Last Updated: 2020/12/14]

Recommendation is accepted. Even though the evaluated project is closed, UNDP will continue to integrate tand mainstream he needs of people with disabilities into other interventions, where applicable. Particularly, to continue to increase the awareness of Ukrainian women and men on the issue, UNDP will deploy Tolerance Envoys (including the regional network) to dissiminate best practice cases with the relevant stakeholders at the national, local and regional levels). 

Key Actions:

Key Action Responsible DueDate Status Comments Documents
To promote UD principles through UNDP Tolerance Campaign.
[Added: 2019/05/06] [Last Updated: 2021/02/12]
Communications unit 2020/12 Completed UNDP has partnered with Ukrainian key opinion leaders and influencers (UNDP Tolerance Envoys) to promote human rights under its RespectUA communication campaign (implemented from September 2017 until December 2020). In 2018, UNDP partnered with the famous social activist, athlete, blogger, and co-founder of the "Dostupno.UA" initiative Dmytro Shchebetyuk to promote UD (Universal Design) principles and the right of persons with disabilities in Ukraine. Shchebetyuk, together with other UNDP Tolerance Envoys, participated in various events to promote UD principles, in particular in the leisure and restaurant sectors, e.g. the No Waste Race by “Gonka.UA” in Vyshhorod, Kyiv Oblast, UNDP’s nationwide Weekend of Unlimited Opportunities (the goal of the initiative was to draw attention to the rights of persons with disabilities, which are violated every day due to the inaccessibility of services and infrastructure facilities, and to raise people’s awareness of the urgency of this issue) and the Inclusion Forum by Dostupno.UA, supported by UNDP Ukraine. The audience reached during the mentioned events is up to 3,000 people. UNDP tolerance envoys – the Ukrainian writer Lyubko Deresh and the Ukrainian musician and eco-activist Pavlo Vyshebaba – released a music video called “I am part of the world”, which advocates for the rights of people with disabilities (the video had at least 7,500 views). UNDP Tolerance Envoy Dmytro Shchebetyuk has 15k subscribers, Lyubko Deresh has 14k subscribers, and Pavlo Vyshebaba has 8k subscribers. History
3. Recommendation:

Greater involvement and capacity building of people with disabilities.  Involvement and capacity building of people with disabilities to act as agents of change should ultimately lead to their empowerment and amplification of their voices. In its turn, this would allow to strengthen the advocacy efforts for better access to services and a higher number of universally designed infrastructure.

Management Response: [Added: 2019/04/15] [Last Updated: 2020/12/14]

Recommendation is partially accepted. UNDP will work with civil society organizations, that address the needs of people with disabilities to include women and men with disabilities in human rights related capacity building activities at regional and local levels. UNDP will consult with such associations to identify the best way to meet the priority needs of people with disabilities to empower and give the voice to this vulnerable group of population.  

Key Actions:

Key Action Responsible DueDate Status Comments Documents
To support CSOs of PwD in analyzing current situation and to propose actions on capacity building of people with disabilities to act as agents of change.
[Added: 2019/05/06] [Last Updated: 2020/08/07]
'Civil Society for enhanced democracy and human rights in Ukraine' project team 2020/07 Completed CSDR project team supports CSOs that advocate for the rights of people with disabilities. In 2017 UNDP supported development of the web-checker – a platform that comprehensively analyzes e-democracy platforms and services for their adaptation for PwD. The project completed in 2018. Youth project “Wings online” encourages young people with disabilities to participate in performing arts. The project is ongoing by the end of August 2020. In 2019 UNDP also facilitated the joint submission of list of issues prior to reporting to the CRPD Committee by All-Ukrainian coalition of people with disabilities, which is comprised of more than 100 CSOs. To ensure the capacity building of PwD to act as agents of change UNDP is preparing to support a new project in Chernivtsi oblast on “Inclusive workplaces”. The project aims to create good working conditions for PwD by reducing barriers of employment of PwD. The project duration: August 5, 2020 – February 5, 2021. History
4. Recommendation:

Intensification of cooperation with the relevant ministries. Closer cooperation with the relevant ministries will contribute to a broader distribution of lessons learned and will help to better understand the changing political environment, ensuring flexibility of activities. However, low interest in the UD principles on the side of the Ministry of Health of Ukraine and Ministry of Social Policy of Ukraine may impede its roll-out across the country. To this end, the universal design principles should be implemented, as a part of the current decentralisation reform, building on the present reform impetus. For instance, this may include the support of the Ministry of Social Policy efforts to establish integrated social services at the community level. The awareness-raising activities and the capacity building of local level decision-makers are required to ensure proper implementation of the universal design principles at the community level including planning, budgeting and implementation.

Management Response: [Added: 2019/04/15] [Last Updated: 2020/12/14]

Recommendation is partially accepted, as UNDP does not have ongoing interventions, related to universal design principles. Should UNDP Ukraine engage with the Ministry of Health and/or Ministry of Social Policy to promote universal design principles and accessbility, the recommendation would be integrated in the project design from the onset and the committment from the central government would be the prerequisite for any technical assistance to the abovementioned ministries. 

Key Actions:

Key Action Responsible DueDate Status Comments Documents
To integrate this recommendation in future interventions, related to social protection of people with disabilities.
[Added: 2019/05/06]
BD&I unit, Democratic Governance and SDG portfolios 2023/12 Not Initiated
5. Recommendation:

Development of a comprehensive roadmap to ensure implementation of the Universal Design principles at all levels (both national and local) and across many sectors (labour and social policy, health, architecture and so on).  For instance, to ensure that job coaching services are in place, combined efforts of many stakeholders (e.g. employment centres, rehabilitation centres, local service providers, employment services, and employers) should be utilised in the development of such a roadmap;

Management Response: [Added: 2019/05/06] [Last Updated: 2020/12/14]

Recommendation is partially accepted

Key Actions:

Key Action Responsible DueDate Status Comments Documents
To provide recommendations to OO on implementation of social and economic rights of PwD
[Added: 2019/05/06] [Last Updated: 2020/08/07]
"Human Rights for Ukraine'' project team 2019/12 Completed The relevant support to Ombudsperson’s Office was provided. As a result: - OO submitted its Alternative Report on Ukraine's Implementation of the UN Convention on the Rights of Persons with Disabilities (in February 2020) - the methodology for monitoring of social and economic rights at the local level was developed and included tools for monitoring of the social and economic rights of PwD. The piloting of the OO monitoring is scheduled in September 2020. History

Latest Evaluations

Contact us

1 UN Plaza
DC1-20th Floor
New York, NY 10017
Tel. +1 646 781 4200
Fax. +1 646 781 4213
erc.support@undp.org