Evaluation of the initiative 'Knowledge and Innovation in the Europe and CIS region 2012/2013"

Report Cover Image
Evaluation Plan:
2014-2017, RBEC
Evaluation Type:
Thematic
Planned End Date:
01/2015
Completion Date:
12/2014
Status:
Completed
Management Response:
Yes
Evaluation Budget(US $):
20,000

Share

Document Type Language Size Status Downloads
Download document ToR_KI_Evaluation_Thematic.docx tor English 22.25 KB Posted 252
Download document FINAL_Evaluation of the Knowledgde and Innovation in the Europe and CIS Region 2012 2013_report with annexes included.pdf report English 20577.34 KB Posted 101
Title Evaluation of the initiative 'Knowledge and Innovation in the Europe and CIS region 2012/2013"
Atlas Project Number:
Evaluation Plan: 2014-2017, RBEC
Evaluation Type: Thematic
Status: Completed
Completion Date: 12/2014
Planned End Date: 01/2015
Management Response: Yes
Corporate Outcome and Output (UNDP Strategic Plan 2014-2017)
  • 1. Output 7.6. Innovations enabled for development solutions, partnerships and other collaborative arrangements
Evaluation Budget(US $): 20,000
Source of Funding:
Joint Programme: No
Mandatory Evaluation: No
Joint Evaluation: No
Evaluation Team members:
Name Title Email Nationality
MindLab www.mind-lab.dk
GEF Evaluation: No
Key Stakeholders: UNDP
Lessons
Findings
Recommendations
1 Support COs to apply latest methods for rigorous performance management for prototypes (in line with the thinking that data is a first line of defense (http://www.nesta.org.uk/) for governments in experimenting with new services).
2 Continue the 20% scheme, whereby the K&I benefits from having 4 CO colleagues on part-time basis responding to the regional demand in a series of new fields (eg. behavioral science, design thinking).
3 Maintain support to COs in using digital communications for project management (from horizon scanning and market intelligence to partnership referral, feedback mechanism, and profile for CO work).
4 Explore opportunities to move from experimenting to mainstreaming innovation in day to day work of COs with the national partners (also building on the recently published i-teams report that looked at what makes the world?s top governments innovation teams successful)
5 Tailor K&I support to bring new COs on board with innovation
1. Recommendation: Support COs to apply latest methods for rigorous performance management for prototypes (in line with the thinking that data is a first line of defense (http://www.nesta.org.uk/) for governments in experimenting with new services).
Management Response: [Added: 2015/02/27] [Last Updated: 2015/03/02]

UNDP accepts this recommendation. Support at least 1 CO in testing out a new method for conducting rapid M&E in the context of running prototypes is planned.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Identify and work with a CO willing to test out a new method of rigorous performance management for prototypes
[Added: 2015/02/27] [Last Updated: 2016/08/15]
IRH Knowledge and Innovation Team 2016/06 Completed First Update with due date April 2015: 1 CO is working with the gender team on possibly extending the work to another 2 CO teams. Second Update: Various methods for evaluation of prototypes initiated with Country Offices in both ECIS and RBAS region including I) application of human centred design and ethnography (http://www.codesignwithyouthinkosovo.com/) in Kosovo for evaluating various strategies and prototypes of youth engagement where the process of identifying insights and testing various initiatives have been documented on the hyperlinked web address, ii) using big and other sources of data for evaluating effect of various interventions (http://europeandcis.undp.org/blog/2015/09/23/big-data-for-development-what-were-doing-today/) ranging from disaster risk reduction, anti corruption, community safety (the proof of concept for various initiatives will be completed by December); iii) rolling out the use of micro narratives as a method for real-time evaluation (http://europeandcis.undp.org/blog/2015/05/14/fragments-of-impact-joint-undp-cognitive-edge-initiative-launched/) of various initiatives ranging from green economy and resilience. The action is completed and further the team continues testing new ways of doing M&E on the action.
2. Recommendation: Continue the 20% scheme, whereby the K&I benefits from having 4 CO colleagues on part-time basis responding to the regional demand in a series of new fields (eg. behavioral science, design thinking).
Management Response: [Added: 2015/02/27]

UNDP accepts this recommendation. Scheme to be continued

Key Actions:

Key Action Responsible DueDate Status Comments Documents
The four colleagues remain a part of the extended K&I team, and K&I team looks out for opportunities to connect other CO colleagues to a rising demand for a new services.
[Added: 2015/02/27] [Last Updated: 2015/03/02]
K&I team 2015/01 Completed
3. Recommendation: Maintain support to COs in using digital communications for project management (from horizon scanning and market intelligence to partnership referral, feedback mechanism, and profile for CO work).
Management Response: [Added: 2015/02/27]

UNDP accepts this recommendation and will work on strengthening the Regional Hub?s digital communications capacities.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Explore possibilities to institutionalize digital communications capacities (currently IC contract)
[Added: 2015/02/27] [Last Updated: 2015/03/02]
K&I team and senior management of the Regional Hub 2015/06 No Longer Applicable This position has been dislocated from the K&I team and into the communications team as a result of the senior management decision
4. Recommendation: Explore opportunities to move from experimenting to mainstreaming innovation in day to day work of COs with the national partners (also building on the recently published i-teams report that looked at what makes the world?s top governments innovation teams successful)
Management Response: [Added: 2015/02/27]

UNDP accepts this recommendation. Convene senior managers from COs in RBEC with external resource persons to discuss how to move from experimenting to mainstreaming innovation in day to day work of COs.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Organize a 2 day discussion with senior managers and external resources on mainstreaming innovation in UNDP work
[Added: 2015/02/27] [Last Updated: 2016/08/15]
K&I team and senior management of the Regional Hub 2016/06 Completed First Update with due date Oct 2015: Discussion with Nesta, the innovation charity, underway to discuss possibility to apply innovation to POPP in an effort to mainstream innovation work. Second Update: Nesta?s contracted to find entry points for innovation within UNDP project management business processes and the work with 4 Country Offices has already began. Third update: The action has been completed intending to bringing innovation closer to the center of the organization at the end of April 2016 (relevant documents attached). The team is planning to have a training event for RBEC staff (possibly global) to do capacity building on how to use the tools in the package.
5. Recommendation: Tailor K&I support to bring new COs on board with innovation
Management Response: [Added: 2015/02/27]

UNDP accepts this recommendation. Portfolio screening exercise to be conducted specifically on new COs

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Focus on bringing on board new COs, support COs currently building up the innovation portfolios to expand and mainstream their innovation efforts
[Added: 2015/02/27] [Last Updated: 2015/10/01]
K&I team and other teams of the Regional Hub, as appropriate 2015/10 Completed First Update with due date August 2015: Mission to Kyrgyzstan planned for March to conduct CO portfolio screening; mission to Uzbekistan to introduce social innovation in Aid for Trade program planned for March. Support to CO Belarus in mainstreaming innovation in programming (remote support) Completed Oct 2015:Portfolio screening and a number of initiatives began with new Co teams including: I) Belarus, ii) Kyrgyzstan, iii) Tajikistan. Belarus: social innovation challenge for tourism in Brest region (http://europeandcis.undp.org/blog/2015/08/17/beyond-the-blintz-belarus-hacks-the-tourist-trade/), partnership with the UK?s behavioural insights team on applying behavioural insights to shadow economy (together with UNDP Moldova and UNDP Kazakhstan), and using gaming and crowdsourcing for waste collection (http://europeandcis.undp.org/blog/2015/04/02/a-new-kind-of-map-meet-grandpa-trofim-and-his-pal-re-robot/) Kyrgyzstan: innovation and agriculture (running a joint challenge with a start up accelerator from Bishkek); narratives for understanding youth unemployment and coping strategies of youth dealing with unemployment, Kyrgyzstan CO was one of the semi finalist teams here (http://europeandcis.undp.org/blog/2015/02/18/build-it-yourself-welcome-to-the-tech-for-citizen-engagement-challenge/) Tajikistan: Story on using micro narratives to better understand leverage points to get more women into agriculture (http://europeandcis.undp.org/blog/2015/07/22/tajikistan-can-re-inventing-the-wheel-be-innovative/)

Latest Evaluations

Contact us

220 East 42nd Street
20th Floor
New York, NY 10017
Tel. +1 646 781 4200
Fax. +1 646 781 4213
erc.support@undp.org