Integrated Area-based Development in Osh province, Kyrgyzstan

Report Cover Image
Evaluation Plan:
2018-2022, Kyrgyzstan
Evaluation Type:
Mid Term Project
Planned End Date:
02/2019
Completion Date:
03/2019
Status:
Completed
Management Response:
Yes
Evaluation Budget(US $):
5,000

“Integrated Area-Based Development of Osh Province in the Kyrgyz Republic”, funded by the Trust Fund of the Russian Federation.

The “Integrated Area-Based Development of Osh Province” Programme aims to assist the Government of the Kyrgyz Republic in creating conditions for the prevention of violent conflicts and ensuring sustainable human development in three pilot districts of Osh province, KR. The Programme helps to create various opportunities for target population groups in order to reduce their vulnerability in the short- and long-term perspective by supporting economic activities, improving access to water, environmental safety, creating new jobs and rehabilitating social and economic infrastructure. The implementation of the Programme started in September 2016 and will end in December 2019. The Programme is being implemented in 30 pilot villages of 17 municipalities of Kara-Kulzha, Nookat, and Uzgen districts in Osh province.

Share

Document Type Language Size Status Downloads
Download document TOR Expert_Interim evaluation_Osh ABD_ENG.docx tor English 55.05 KB Posted 170
Download document Evaluation Report_Osh ABD_rus.docx report English 241.84 KB Posted 254
Download document Interim Evaluation Report_ENG_2019_OshABD.docx report English 273.89 KB Posted 148
Title Integrated Area-based Development in Osh province, Kyrgyzstan
Atlas Project Number: 00095779
Evaluation Plan: 2018-2022, Kyrgyzstan
Evaluation Type: Mid Term Project
Status: Completed
Completion Date: 03/2019
Planned End Date: 02/2019
Management Response: Yes
Corporate Outcome and Output (UNDP Strategic Plan 2018-2021)
  • 1. Output 1.1.1 Capacities developed across the whole of government to integrate the 2030 Agenda, the Paris Agreement and other international agreements in development plans and budgets, and to analyse progress towards the SDGs, using innovative and data-driven solutions
  • 2. Output 1.1.2 Marginalised groups, particularly the poor, women, people with disabilities and displaced are empowered to gain universal access to basic services and financial and non-financial assets to build productive capacities and benefit from sustainable livelihoods and jobs
Evaluation Budget(US $): 5,000
Source of Funding: RF
Evaluation Expenditure(US $): 4,905
Joint Programme: No
Joint Evaluation: No
Evaluation Team members:
Name Title Email Nationality
Zaure Beisenbievna Sydykova
GEF Evaluation: No
Key Stakeholders: Osh Oblast Administration
Countries: KYRGYZSTAN
Lessons
Findings
Recommendations
1

Establish monitoring and evaluation system to achieve the target results of the Programme (impact and sustainability indicators).

2

Strengthen the interaction between the activities of the Programme components for the synergy of UNDP nested interventions and the creation of impact chains.

3

Not to start new projects, but to direct all measures to the completion of ongoing projects, achieve sustainability of the implemented projects, disseminate the gained experience as demonstration models to other non-pilot villages, municipalities and districts of Osh oblast, give priority to finance the cross-cutting integrated ideas or expansion of the impact of the results.

4

Conduct an analysis of all studies conducted by the Programme and summarize systemic problems into one document that prevented the quality provision of public, market and state / municipal services at the local level and required changes in the regulatory environment related to the competence of state bodies at the republican level. To initiate a final event to present the results of the report and it is possible to initiate public discussions inviting interested parties to solve the identified problems at the systematic level.

5

The Program is recommended to more accurately identify target groups for each component (direct / indirect beneficiaries, including people living in poverty) and their areas of activity for which the measures taken will be aimed at reducing their vulnerability. It is recommended that in 2019 the main focus of the Programme will be on reducing the vulnerability of target groups.

6

The Programme needs to define a uniform policy in the statistical accounting of the Programme beneficiaries.

7

It is necessary to create a system for assessing the impact of educational and informational measures in the Programme in order to have evidence of the impact of the training provided.

8

In order to increase the capacity of local self-government bodies and state bodies to improve the area development management process, it is recommended to develop and implement a training programme that includes issues of budgeting, attracting investments and developing investment projects, efficient use of municipal property, new development methodology of the Strategic Economical Development Programme (Order of the Ministry of Economy of the Kyrgyz Republic), because this will lead to an increase in the quality of governance at the local level and an increase in public confidence in local government.

9

Take measures to translate into a more "practical plane" the activities carried out by the Program with different research institutes of the Russian Federation.

10

Based on the successful results of the Programme’s activities and the implemented demonstration schemes / models, it is recommended to prepare methodological manuals that summarize the experience and lessons learned, and also describe all mechanisms and tools for dissemination (Service Centers, RES, experience involving migrant workers, risk profiles and etc.).

11

Take steps to secure the social responsibility of business enterprises to local communities.

12

Regularly distribute information about the activities of the Programme and hold general briefings with all key partners of the Programme.

1. Recommendation:

Establish monitoring and evaluation system to achieve the target results of the Programme (impact and sustainability indicators).

Management Response: [Added: 2019/05/16]

Recommendation is accepted. The Programme has begun to analyze the current monitoring and evaluation system of the Programme, as well as the logical framework, the results of the Baseline Survey and the interim evaluation of the Programme in order to streamline the system of monitoring and evaluating the effectiveness of the Programme results. The strengthened model of the monitoring system will be applied within the framework of the current monitoring and evaluation system of the Programme, measurable indicators will be more effectively integrated into the results of the Programme framework and other documents on the Programme management.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Modernization of data collection in the Programme monitoring and evaluation system through the introduction of additional measurable indicators of impact and sustainability, tools for measuring target results.
[Added: 2019/05/17] [Last Updated: 2020/01/02]
UNDP 2019/12 Completed The system for monitoring and evaluating the effectiveness of Project results, the implementation of the necessary additional indicators, tools for measuring target results (indicators of impact and sustainability) is streamlined History
Strengthening the monitoring and evaluation plans of the Programme for an effective monitoring and evaluation process.
[Added: 2019/05/17] [Last Updated: 2020/01/02]
UNDP 2019/12 Completed Monitoring and evaluation plan of the Programme for an effective monitoring and evaluation process is developed and strengthened. History
Capacity building of the Programme staff on the use of measurement tools of impact and sustainability indicators and streamlined data collection.
[Added: 2019/05/17] [Last Updated: 2020/01/02]
UNDP 2019/12 Completed The data was collected and the household assessment was completed as a results of the training conducted for the project staff. History
2. Recommendation:

Strengthen the interaction between the activities of the Programme components for the synergy of UNDP nested interventions and the creation of impact chains.

Management Response: [Added: 2019/05/16]

Recommendation is accepted. The Programme will firstly analyze the current management system in the Programme, the results of which will decide on the possibility within the framework of the TOR for program specialists to deviate from the component-based management of results-oriented management in the component to the geographic approach. Relevant specialists will be responsible for achieving the results of all components for a specific pilot area. Programme specialists will need to conduct a general analysis of all district projects and develop ideas that have the potential for synergy and multiplier effect.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Analysis of activities from the time perspective, how much each event requires the presence of a programme specialist and whether the programme specialists can take responsibility for additional functions.
[Added: 2019/05/17] [Last Updated: 2020/01/02]
UNDP 2019/12 No Longer Applicable [Justification: The recommendation is not longer applicable. ]
History
Analysis of the current management system in the Programme.
[Added: 2019/05/17] [Last Updated: 2020/01/02]
UNDP 2019/12 Completed The current system is more effective than the recommended History
3. Recommendation:

Not to start new projects, but to direct all measures to the completion of ongoing projects, achieve sustainability of the implemented projects, disseminate the gained experience as demonstration models to other non-pilot villages, municipalities and districts of Osh oblast, give priority to finance the cross-cutting integrated ideas or expansion of the impact of the results.

Management Response: [Added: 2019/05/16]

Recommendation is accepted. The Programme revised the annual work plan for 2019 to achieve the sustainability of all implemented projects, which integrate measures aimed at improving the sustainability of all projects supported by the Programme as well as at developing coaching. Such measures include replicating the successful experience of the Programme in building infrastructure for the provision of municipal services by local authorities on the "single window» principle, etc.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Developing additional plans for the sustainability of business projects aimed at promoting the development of their business through mentorship of beneficiary entrepreneurs.
[Added: 2019/05/17] [Last Updated: 2020/01/02]
UNDP 2019/12 Completed An assessment of the sustainability of business projects was carried out, monitoring of the received grant funds for businesses was strengthened. History
Dissemination of experience in the development of hazard profiles, risk maps in co-operation with the MES by including the mitigation projects into the Local Sustainable Development plans at the level of three districts to non-pilot municipalities.
[Added: 2019/05/17] [Last Updated: 2020/01/02]
UNDP 2019/12 Completed The reports were handed over to the other UNDP Projects for replication and implementation. History
Strengthening the capacity of pilot vocational schools through supporting the development of strategic development plans with the participation of local authorities and employers to ensure the growth of employment of graduates of professional lyceums and expanding the coverage of participants in vocational training programs in partnership with IOM, UNICEF and other UN agencies.
[Added: 2019/05/17] [Last Updated: 2020/01/02]
UNDP 2019/12 Completed Pilot vocational schools received the expertise of a consultant on the development of strategic development plans History
4. Recommendation:

Conduct an analysis of all studies conducted by the Programme and summarize systemic problems into one document that prevented the quality provision of public, market and state / municipal services at the local level and required changes in the regulatory environment related to the competence of state bodies at the republican level. To initiate a final event to present the results of the report and it is possible to initiate public discussions inviting interested parties to solve the identified problems at the systematic level.

Management Response: [Added: 2019/05/16]

Recommendation is accepted. The Programme has begun an analysis of the research conducted in order to generalize the problems of a systemic nature that hampered the quality provision at the local level and required changes in the regulatory environment related to the competence of state bodies at the country level. The Programme has planned to organize a broad discussion among national partners and the public to discuss the identified systematic problems, the results of which will be the recording of calls and the development of specific targeted recommendations to the Government of the Kyrgyz Republic.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Actual systematic problems of water supply after discussing them at the regional level will be brought to the national level in the form of an explanatory note (change in regulations, delegation of functions with the budget, etc.)
[Added: 2019/05/17] [Last Updated: 2020/01/02]
UNDP 2019/12 Completed The recommendation will be reconsidered during the next project stage History
Participation of the Ministry of Education, the Agency of the Primary Professional Education, employers, local self-government bodies to develop an action plan to discuss mechanisms for turning lyceums into Service provision centers for the adult population through strengthening links with local authorities and to provide funding for the most necessary measures.
[Added: 2019/05/17] [Last Updated: 2020/01/02]
UNDP 2019/12 Completed The recommendations was discussed with the Agency for Primary Vocational Education (APVE). APVE will follow up. History
Participation of the Ministry of Culture, Information and Tourism, tour operators, local self-government bodies in the work of the Council for the Development of Tourism in Osh province, the development of a concept for the development of the tourism industry in Osh oblast.
[Added: 2019/05/17] [Last Updated: 2020/01/02]
UNDP 2019/12 Completed The work of the Tourism Council is underway. The concept of tourism development in Osh requires more time. Territory branding is developed. History
Analyzing the activities of pasture committees of pilot municipalities and developing guidelines for the pasture management as well as developing model documents / reports, grazing plans in the form of Regulations or the described Business process for distribution to non-pilot municipalities.
[Added: 2019/05/17] [Last Updated: 2020/01/02]
UNDP 2019/12 Completed Replication experience through Mass Media History
5. Recommendation:

The Program is recommended to more accurately identify target groups for each component (direct / indirect beneficiaries, including people living in poverty) and their areas of activity for which the measures taken will be aimed at reducing their vulnerability. It is recommended that in 2019 the main focus of the Programme will be on reducing the vulnerability of target groups.

Management Response: [Added: 2019/05/16]

Recommendation is accepted. The Programme will present the characteristics of direct beneficiaries and target groups to which the Programme will be directed. The identification of the target groups in the context of each of the components will be revised, achievable indicators will be presented, which are commensurate with the definitions of the target groups and will help pinpoint the direct beneficiaries. They will be described in terms of their real needs, how the Programme has supported them, their relevance for the purposes of the Programme, the criteria that underlay their selection. Along with the target groups and direct beneficiaries, the Programme will give a description of indirect beneficiaries who have not received direct attention of the Programme during its implementation, but that can benefit from the benefits and results of the Programme. The Programme will use a combination of methods to achieve targets for reducing the vulnerability of target groups.  

Key Actions:

Key Action Responsible DueDate Status Comments Documents
The analysis of the context of each the components, the type of problem, the reasons for the group's vulnerability and the needs of different groups in order to present the characteristics of the direct beneficiaries and target groups to which the programs' actions were and will be directed.
[Added: 2019/05/17] [Last Updated: 2020/01/02]
UNDP 2019/12 Completed The necessary additional indicators, tools for measuring target results (indicators of impact and sustainability) have been introduced. History
Revision of the target groups in the context of each component of the Programme and identification of indirect beneficiaries who can take advantage of the benefits and results of the Programme in the long term.
[Added: 2019/05/17] [Last Updated: 2020/01/02]
UNDP 2019/12 Completed Household assessment conducted to determine project impact and sustainability History
Implementation of additional measures to reduce the vulnerability of the population and systematization of work on the results in the reports of the Programme.
[Added: 2019/05/17] [Last Updated: 2020/01/02]
UNDP 2019/12 Completed Project database had been streamlined History
6. Recommendation:

The Programme needs to define a uniform policy in the statistical accounting of the Programme beneficiaries.

Management Response: [Added: 2019/05/16] [Last Updated: 2019/05/17]

Recommendation is accepted. The Programme will take measures to improve the accounting system for beneficiaries, data collection and monitoring. The Programme will revise the criteria, criteria of definition and calculation schemes of beneficiaries for each component of the Programme, take measures to change the design of statistical accounting of beneficiaries and develop guidelines for the principles, scope, frequency and methods of data collection.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Revision of criteria, methods of determination and calculation of direct beneficiaries for each component of the Programme.
[Added: 2019/05/17] [Last Updated: 2020/01/02]
UNDP 2019/12 Completed The necessary additional indicators, tools for measuring target results (indicators of impact and sustainability) have been introduced. History
Development of a manual on the principles, scope, frequency and methods of statistical accounting of the number of the Programme beneficiaries.
[Added: 2019/05/17] [Last Updated: 2020/01/02]
UNDP 2019/12 Completed Project database had been streamlined History
Monitoring the implementation of a unified policy in the statistical accounting of the number Programme beneficiaries.
[Added: 2019/05/17] [Last Updated: 2020/01/02]
UNDP 2019/12 Completed The project monitoring and evaluation system has been streamlined History
7. Recommendation:

It is necessary to create a system for assessing the impact of educational and informational measures in the Programme in order to have evidence of the impact of the training provided.

Management Response: [Added: 2019/05/16]

Recommendation is accepted. The Programme for assessing the effectiveness of training will analyze different models in order to study the advantages and disadvantages of the system for assessing the impact of educational measures. The choice of one model or another will entirely depend on the goals set for this or the direction of the Programme. The Programme will select a specific algorithm for assessing the impact of educational and informational measures in the Programme in order to have evidence of the impact of the training provided. Measurable indicators will be more effectively integrated into the results framework of training and information measures.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Analysis of various models for studying the advantages and disadvantages of the system of assessing the impact of educational measures in order to select a specific algorithm to evaluate the impact of Programme educational and informational measures to have evidence of the impact of the training provided.
[Added: 2019/05/17] [Last Updated: 2020/01/02]
UNDP 2019/12 Completed Models of coaching and mentoring had been implemented. A model of attracting Russian experts for coaching and mentoring had been actively used History
Revision of training plans for the introduction of survey methods of participants after a certain period after training, observation of behavior at the workplace, action plans, performance monitoring.
[Added: 2019/05/17] [Last Updated: 2020/01/02]
UNDP 2019/12 Completed The assessment of the households had been conducted through survey elements to determine project impact and sustainability History
Using mentoring and coaching as an additional method of influencing the results of the Programme will be integrated into the planned training and information activities.
[Added: 2019/05/17] [Last Updated: 2020/01/02]
UNDP 2019/12 Completed Business projects had been supported by a mentoring consultant for entrepreneurs History
8. Recommendation:

In order to increase the capacity of local self-government bodies and state bodies to improve the area development management process, it is recommended to develop and implement a training programme that includes issues of budgeting, attracting investments and developing investment projects, efficient use of municipal property, new development methodology of the Strategic Economical Development Programme (Order of the Ministry of Economy of the Kyrgyz Republic), because this will lead to an increase in the quality of governance at the local level and an increase in public confidence in local government.

Management Response: [Added: 2019/05/16]

Recommendation is accepted. The Programme will develop an action plan for further enhancing the capacity of local self-government bodies in terms of the qualitative provision of state and municipal services to the population at the local level and will hold events to discuss the problems identified at the system level.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Monitoring the implementation of strategic plans for the development of municipalities with the involvement of civil society organizations at the local level and providing municipalities with a new normative document on the development of the Strategic Plan of the Sustainable Development.
[Added: 2019/05/17] [Last Updated: 2020/01/02]
UNDP 2019/12 Completed the recommendation is accepted and implemented accordingly History
Implementing measures to improve the quality of services and disseminate the experience of Centers for the provision of services to the population in municipalities, develop methodological guidelines for organizing Service Centers for replicating the applied mechanisms.
[Added: 2019/05/17] [Last Updated: 2020/01/02]
UNDP 2019/12 Completed A methodological guide (manual) on the organization of a Single-Window Centers for providing municipal services for replication of applied mechanisms has been developed. Document had been handed over to GAMSUMO ( State Agency for Local Government Affairs and Interethnic Relations). History
Carrying out the final event inviting non-pilot municipalities, GAMSUMO and government agencies, the Ministry of Economy of the Kyrgyz Republic, donor organizations, the media to present effective measures for their dissemination at the country level.
[Added: 2019/05/17] [Last Updated: 2020/01/02]
UNDP 2019/12 Completed The demonstration of the tested model of the Single-Window Centers for providing municipal services to the population on the basis of a “one-stop-shop” principle in Osh Oblast attracted a great interest from GAMSUMO ( State Agency for Local Government Affairs and Interethnic Relations). History
9. Recommendation:

Take measures to translate into a more "practical plane" the activities carried out by the Program with different research institutes of the Russian Federation.

Management Response: [Added: 2019/05/16]

Recommendation is accepted. The Programme will develop an action plan to further establishment of permanent and stable channels of interaction of local farmers with various research institutes of the Russian Federation by increasing the capacity of local self-government bodies and farmers in effective partnerships and cooperation in the use of agricultural achievements, conservation and reproduction of soil fertility, rational use of water resources, and rainfed productivity and irrigated land improving disaster medicine.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Creating conditions for partnership and cooperation of specific legal entities / individuals with the Research Institute of the Russian Federation for further independent cooperation.
[Added: 2019/05/17] [Last Updated: 2020/01/02]
UNDP 2019/12 Completed done History
Expanding the interaction of specialists from research institutes and companies of the Russian Federation with local authorities and farmers in Osh oblast through practical demonstration of the use of fine-dispersed plants and drip irrigation system in Osh oblast in irrigation.
[Added: 2019/05/17] [Last Updated: 2020/01/02]
UNDP 2019/12 Completed Experts Turapin S. and Mishchenko N. from the All-Russian Research Institute of Irrigation and Agricultural Water Supply Systems conducted research on the irrigated and rainfed lands of the pilot municipalities of Osh oblast and made recommendations on the introduction of highly efficient irrigation technologies - fine irrigation systems. The basic field study of the pilot municipalities has an assessment of local conditions, a list of the most suitable irrigation technologies, taking into account the specific conditions of each section of the pilot field. Developments by Russian experts are presented to interested parties during working meetings, Field Day, and economic forums. History
Bringing the Russian expertise to develop the Concept, methodology, scheme of cooperation and interaction of the mobile medical aid center service to enhance disaster medicine with fire and rescue units, the crisis management center (CMC), the uniform duty and dispatch service 112 (EDDS 112) together with MES and MoH KR.
[Added: 2019/05/17] [Last Updated: 2020/01/02]
UNDP 2019/12 Completed Recommendations from an expert from the Russian Federation have been received. Employees of ROSO EMERCOM of the Kyrgyz Republic received skills and knowledge in the field of effective organization of medical care for victims of emergency from the Honored Doctor of the Russian Federation from the Federal State Institution "Centrospas" EMERCOM of Russia RF Popov Alexander. History
10. Recommendation:

Based on the successful results of the Programme’s activities and the implemented demonstration schemes / models, it is recommended to prepare methodological manuals that summarize the experience and lessons learned, and also describe all mechanisms and tools for dissemination (Service Centers, RES, experience involving migrant workers, risk profiles and etc.).

Management Response: [Added: 2019/05/16]

Recommendation is accepted. The Programme will develop criteria, procedures for selecting best practices of the Programme and a format for describing best practices and will also prepare a collection of cases for publication.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Development and implementation of a communication plan to promote the collection of best practices at the regional and national levels and sharing best practices of the Programme “Integrated Development of Osh oblast in the Kyrgyz Republic”.
[Added: 2019/05/17] [Last Updated: 2020/01/02]
UNDP 2019/12 Completed Used by the media, created a video History
11. Recommendation:

Take steps to secure the social responsibility of business enterprises to local communities.

Management Response: [Added: 2019/05/16]

Recommendation is accepted. The Programme will strengthen the monitoring of the activities of existing entrepreneurs who have received support from the Programme and will conclude tripartite agreements between LSGs and business. The agreement will consolidate social obligations of the business to the community (purchase of raw materials from the population at sustainable prices, provision of social infrastructure with enterprise products, provision of jobs, repair of facilities, vocational training in the workplace, etc.).

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Conclusion of an agreement between local self-government bodies and business enterprises for securing social obligations of business to the community.
[Added: 2019/05/16] [Last Updated: 2020/01/02]
UNDP 2019/12 Completed Bilateral agreements were concluded between local government bodies and business, and social obligations of business to the community were agreed History
12. Recommendation:

Regularly distribute information about the activities of the Programme and hold general briefings with all key partners of the Programme.

Management Response: [Added: 2019/05/16]

Recommendation is accepted. The Programme will continue on a regular basis product development and publications to publicize national partners, information on the achievements and major activities of the Programme.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Covering information on the achievements and major activities of the Programme on the corporate website of UNDP, as well as through all social networks.
[Added: 2019/05/16] [Last Updated: 2020/01/02]
UNDP 2019/12 Completed Done accordingly History
Developing video on the activities of the Programme and replicating the infographics on the results of the Programme for 2018 in English, Russian and Kyrgyz languages.
[Added: 2019/05/16] [Last Updated: 2020/01/02]
UNDP 2019/12 Completed The information publications (a brochure and inphographic) is developed and published History
Organization and holding of 3 photo exhibitions at various events.
[Added: 2019/05/16] [Last Updated: 2020/01/02]
UNDP 2019/12 Completed Implemented accordingly History
Organization field press tours with the participation of leading local mass media to cover Programmes activities and impact.
[Added: 2019/05/16] [Last Updated: 2020/01/02]
UNDP 2019/12 Completed Completed by the Communications team History

Latest Evaluations

Contact us

1 UN Plaza
DC1-20th Floor
New York, NY 10017
Tel. +1 646 781 4200
Fax. +1 646 781 4213
erc.support@undp.org