Success message
error message
warn message
Final Evaluation of Partnership for a Tolerant, Inclusive Bangladesh (PTIB) project
Commissioning Unit: Bangladesh
Evaluation Plan: 2017-2021
Evaluation Type: Project
Completion Date: 10/2020
Unit Responsible for providing Management Response: Bangladesh
Documents Related to overall Management Response:
 
1. Recommendation:

MANAGEMENT: Better Monitoring, Evaluation, Research, and Learning (MERL)

PTIB has been and should continue to be a learning project. Global evidence shows that development programmes are more effective if they conduct applied analysis, learning, and rapid-cycle evaluation during project implementation. These processes reduce the risk of program failure by ensuring that activities can adjust and choose the most likely path to achieving the goals.

In its next phase, PTIB should devote more effort to monitoring, evaluation, and research and learning (MERL) systems to improve its existing adaptative management culture and the project’s effectiveness.

This could include the following sub-recommendations:

  • Developing a new Theory of Change (ToC) that tells a compelling story of how PTIB is a learning project finding relevant ways to promote inclusivity and tolerance and adapt to changes in the context.
  • The ToC should emphasize that PTIB’s role is to develop a greater understanding through research. PTIB then applies this knowledge to its activities to build a new generation of media, messengers, and messages that counter hate speech, intolerance, and disinformation. In this way, PTIB contributes to preventing extremism and violence in Bangladesh.
  • Exploring how the knowledge products of PTIB’s research components cross-fertilize and inform the work of its citizen and government engagement components. Given the sensitivities and time involved in approving and distributing written documents, this may include using more discussion-based techniques to share knowledge more widely.
  • Using various knowledge management tools, such as short case studies, action reports, and practice notes, to better document how PTIB has learned lessons and applied them to the project.
  • Using the market and public opinion research tools, such as focus groups, to measure the effectiveness of messages developed for its citizen engagement component and to continually sharpen its communications and effectiveness with beneficiaries.
  • Developing new measures to better engage its audience before and after activities, such as quick quizzes, to better measure and understand attitudinal shifts and the potential for behavioral change.
  • Drawing on the growing data sets of PTIB’s research components, such as BPO and CARU, to conduct more empirical studies and secondary analysis to increase general understanding of the challenges of countering violence in Bangladesh and guiding future programming.
  • Engaging a MERL specialist to work with PTIB to advise on how to improve its internal knowledge management and information sharing between sub-components.
Management Response: [Added: 2020/11/03]

Agreed. For the next phase of PTIB, the ToC will be rewritten, following the evaluation recommendations. PTIB will put more emphasis on producing knowledge products within the current phase. Especially, PTIB response to the COVID crisis provides good opportunities to explain how research components have cross-fertilized citizens and government engagement components. Knowledge products and research will draw on the project  databases. Within the current phase, PTIB will start to measure its effectiveness of messaging and begin with a review and improvement of the existing M&E framework with innovative measures like quick quizzes and use of social media analysis software. For the next phase's design, PTIB will involve a MERL specialist to ensure MERL is integrated into the program design. The design will include a review of organizational development and will ensure MERL responsibilities are allocated effectively.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Drafting of a new prodoc, including improvement of ToC
[Added: 2020/11/03] [Last Updated: 2021/05/04]
PTIB 2021/06 Initiated The draft ProDoc was shared in LPAC meeting held on 11 March 2021. The project team is working on the final edits to address the comments from LPAC members. History
Knowledge product on PTIB COVID response
[Added: 2020/11/03] [Last Updated: 2021/03/31]
PTIB 2021/03 Completed Knowledge product was developed. The consultant has submitted the final report in March 2021. History
Study on trends and impact of COVID disinformation in Bangladesh
[Added: 2020/11/03] [Last Updated: 2021/03/03]
PTIB 2021/03 Completed UNDP has received and accepted the final report. History
Procurement of Crowdtangle, analysis software of social media in support of M&E
[Added: 2020/11/03]
PTIB 2020/10 Completed PTIB has procured Crowdtangle to 4 PTIB staff as users. This software will support improved analysis of social media campaigns of PTIB and its partners.
MERL integrated in the prodoc design
[Added: 2020/11/03] [Last Updated: 2021/03/03]
PTIB 2021/03 Completed MERL is properly integrated in the prodoc, reviewd and cleared by UNDP M&E lead. History
2. Recommendation:

CAPACITY BUILDING: Improved capacity and diversity of local partners

The sustainability of the ideas and practices that PTIB has introduced depends on the capacities of partners and supported groups. Therefore local partners, implementers, and participants require training for an activity, then carry it out and receive feedback afterward. Moreover, they need expert coaching over a sustained period.

PTIB could increase the diversity of local partners and plan to sustain support to them with an ongoing emphasis on improving research, organizing, and communication to sustain changes in attitudes and behavior among target groups.

This could include the following sub-recommendations:

  • Updating the 2019 BPO evaluation with another periodic external review to measure progress and identify new needs of capacity development after a year of more intensive support from the data scientist in residence.
  • Continuing support to BPO to improve its research capabilities and written analytical products and gather more information about how its data is being used and who is using it.
  • Extending the focus on working with non-traditional partners among marginalized and vulnerable communities, especially those without reliable internet access and distant from Dhaka.
  • Understanding that all capacity building requires long-term support, technical advice, mentoring, and coaching and planning in the next phase for sustained interventions of these types.
Management Response: [Added: 2020/11/03]

Agreed. The next phase will be designed to ensure capacity building and measuring its impact will become more prominent. Long-term capacity development support will be provided. PTIB plans an external BPO review to measure progress from the 2019 review and inform BPO support in the next phase. The Diversity for Peace initiative will be expanded in the next phase with priority on non-traditional partners with limited access to the internet.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Drafting of prodoc, including long-term capacity building efforts
[Added: 2020/11/03] [Last Updated: 2021/03/03]
PTIB 2021/03 Completed The draft prodoc included the long term capacity building of local partners. History
BPO review
[Added: 2020/11/03]
PTIB 2021/05 Not Initiated
3. Recommendation:

COMMUNICATIONS: Better project communications and expanded outreach

Communicating with its complete circle of stakeholders and a growing number of beneficiaries requires significant efforts by key project staff

In its next phase, PTIB could improve its internal processes and practices to better explain to key stakeholders, especially the GoB, what the project is working on, and why and how it is to be done.

This could include the following sub-recommendations:

  • Finding new and regular channels, such as small group events, as venues to discuss project’s more sensitive work on violence and social media monitoring to help key stakeholders, especially decision makers, explore how this research could be better used for policymaking and planning.
  • Making social media monitoring information and analysis more widely available to a larger group of stakeholders through workshops, webinars, and other such discussion-based interactions. PTIB has used such techniques but could do this more regularly and build on its newly created youth panel model.
  • Better documenting and analyzing the interactions its research components have with government and international officials to show how these interactions' seniority or frequency create relationships that can contribute to policy processes.
  • Initiating discussions with the Advisory Board about the shape of its Phase Two and how it would build on those activities in Phase One that have been effective or having potential.
  • Engaging partners in the Digital Peace Movement to discuss what a new phase of their work might look like, including how to keep up momentum and networks if there were a funding gap or disruption in funding.
Management Response: [Added: 2020/11/03] [Last Updated: 2020/11/03]

Agreed. PTIB, during the remaining of its current phase, will organize different events to present and discuss findings of monitoring and research to key stakeholders, including policy makers. PTIB will expand its youth empowerment initiative and will form a second youth platform. In addition to the orientation training and quarterly discussions on VE online narratives, PTIB will inform the platforms on broader issues related to hate speech and disinformation. PTIB has surveyed the PTIB COVID brief recipients on their feedback on the information provided to explain how the information has been used, among survey participants are government and international officials. The Project Advisory Board and participants of the digital peace movement will be consulted during the prodoc design.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Presentation of knowledge product on PTIB COVID response
[Added: 2020/11/03] [Last Updated: 2021/05/04]
PTIB 2021/06 Initiated Instead of presentation meeting, the report will be shared widely. History
Presentation of trends and impact of COVID disinformation
[Added: 2020/11/03] [Last Updated: 2021/03/31]
PTIB 2021/03 Completed The study was presented in a UNDP weninar held on 3rd March 2021. History
Presentation of VE online messaging in 2020
[Added: 2020/11/03] [Last Updated: 2021/03/31]
PTIB 2021/03 Completed Presented in a webinar organized by UNDP on 3rd March 2021. History
User survey among recipients of PTIB COVID briefs
[Added: 2020/11/03]
PTIB 2020/10 Completed PTIB has conducted a survey through survey monkey to seek feedback and have a better understanding about how information in the briefs are used. History
Involve project advisory board and digital peace movement participants in consultations
[Added: 2020/11/03] [Last Updated: 2020/12/20]
PTIB 2020/12 Completed PTIB has consulted with project advisory board members and digital peace movement participants on the prodoc design. Consultations brought important recommendations to inform the activities and strategies of phase 2. History
4. Recommendation:

LEAVE NO ONE BEHIND (LNOB): Gender, youth, vulnerable, and marginalized groups

There are significant al and political challenges to creating an inclusive project in Bangladesh that must be recognized and continuously addressed. PTIB acknowledges these barriers, and many of its component activities are specifically designed to address them. They will remain a challenge in the second phase of the project and will need to be more systematically addressed.

Based on its experience in the first phase, PTIB could improve its strategy and conduct more thorough planning to addresses cultural biases to ensure its future programming is more inclusive.

This could include the following sub-recommendations:

  • Formalizing its gender strategy in future project documents and creating gender marker data to address and measure the response to the known gender biases against women in its project activities, including access to the internet and overnight mentoring boot camps.
  • Including the challenges to the inclusion of women in project activities in the revised project’s Theory of Change for the next phase.
  • Developing more specific strategies and plans about addressing gender, marginalized and vulnerable groups challenges, especially those living outside of Dhaka.
  • Developing more advanced M&E tools to analyze and track women’s participation in PTIB activities.
  • Discussing and strategizing with all partners how to counter known biases in using digital space, including gender and geography. Design additional activities and explore new themes to mitigate these entrenched biases.
  • Commissioning more research on gender-specific issues to stimulate more discussion about women's role and maximize women’s participation, agency, and voice.
  • Building on and documenting the experience of DKC to explore how to expand women’s participation through changing rules, evaluation criteria, and adapting mentorship programs.
  • Adding a component to increase women's participation in digital literacy at the core of PTIB’s objectives.
Management Response: [Added: 2020/11/03]

Agreed. PTIB will include a gender strategy in the new prodoc. The challenges of women's inclusion will be well reflected in the theory of change and the M&E framework. In the next phase, PTIB will conduct a series of research on women's inclusion issues, including gender biases in the digital space. PTIB will equally include women's voices in the consultation while desiging the next phase of the project.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Gender and women issues well reflected in drafting of the new prodoc
[Added: 2020/11/03] [Last Updated: 2021/03/03]
PTIB 2021/03 Completed Gender and women issues are well reflected in draft prodoc. History
Ensure equal women participation in consultations part of the prodoc design
[Added: 2020/11/03] [Last Updated: 2020/12/20]
PTIB 2020/12 Completed Prodoc consultation ensured equal participation of women. PTIB arranged separate group discussions for male and female of the same programme segment to ensure women's voice is not lost in male dominance. History

Latest Evaluations

Contact us

1 UN Plaza
DC1-20th Floor
New York, NY 10017
Tel. +1 646 781 4200
Fax. +1 646 781 4213
erc.support@undp.org