Formative Evaluation of the Ann Ale Pilot Project

Report Cover Image
Evaluation Plan:
2013-2016, Haiti
Evaluation Type:
Project
Planned End Date:
04/2015
Completion Date:
04/2015
Status:
Completed
Management Response:
Yes
Evaluation Budget(US $):
20,000

Share

Document Type Language Size Status Downloads
Download document HTI_Evaluation_Formative_Ann_Alé_Rapport April 2015.pdf report English 2087.23 KB Posted 569
Download document HTI_Evaluation_Formative_Ann_Alé_TOR April 2015.pdf tor French 427.35 KB Posted 238
Title Formative Evaluation of the Ann Ale Pilot Project
Atlas Project Number: 00050968
Evaluation Plan: 2013-2016, Haiti
Evaluation Type: Project
Status: Completed
Completion Date: 04/2015
Planned End Date: 04/2015
Management Response: Yes
Focus Area:
  • 1. Others
Corporate Outcome and Output (UNDP Strategic Plan 2014-2017)
  • 1. Output 1.1. National and sub-national systems and institutions enabled to achieve structural transformation of productive capacities that are sustainable and employment - and livelihoods- intensive
Evaluation Budget(US $): 20,000
Source of Funding: Project
Joint Programme: No
Joint Evaluation: No
Evaluation Team members:
Name Title Email Nationality
Jackie Yiptong Avila
GEF Evaluation: No
Key Stakeholders:
Countries: HAITI
Comments: Ann Ale is part of the 16/6 project. The objective of the evaluation is to measure to what extent the project contributed to improve the small businesses productivity, identify good practices and lessons learned with a view to replicate the project. The evaluation is completed. The CO request the evaluation to be registered in the Evaluation Plan 2013-2016 with a completion date of April 2015.
Lessons
Findings
Recommendations
1 It appears that the training was beneficial to all participants regardless of level of education and experience in running a business. It is recommended that training is given to homogeneous groups although there are merits in having a mix of people with different level of experience as learning from peers is constructive. The instructors may be able to adjust the content of the courses to satisfy the knowledge needs of the participants when groups are homogeneous members. However, this "segregation" prevents interaction between different socio-economic groups who can learn from each other's business reality and experience. QMG has taught similar programs for other organizations. Different approach for adult training should be reviewed and experimented as required.
2 Program such as Ann Ale should promote the gain in skills and take away the focus on daily snacks or other material 'rewards'.
3 It is suggested that where classrooms are available such as in community centers, these should be used for the training sessions. However given the transport facility it provides; the truck can still be used for small groups made of no more than 5-6 persons for training sessions which do not last more than 3 hours. Participants should be made aware that toilets will not be available.
4 The program and its objectives have to be well explained to the business owners before they are registered so that people do not come to the program with unrealistic or irrelevant expectations. It should be made very clear that there is no hand-out of money or microcredits in this program.
5 The (Cahier De Suivi) does not appear to be a good tool. It will be preferable to provide a ledger that can be easily purchased to keep record of the business transactions.
6 : It is strongly recommended that the target population of Ann Ale be defined and that the criteria for the selection of beneficiaries be explicitly be established. It is recommended that the program reaches out to business that is in line with the UNDP objective for environmentally friendly and sustainable development.
7 It is strongly recommended that the Graphic Design Initiative be reviewed since there is no provide store signs if the business cannot pay the related municipal fees. In fact, this evaluation found that the signs can be a hindrance to the entrepreneurs until they are legally allowed to have a store front sign.
8 This evaluation recommends that UNDP continues to establish partnership with the community associations in future implementation of Ann Ale.
9 This evaluation has found that Ann Ale has made positive impacts on the beneficiaries and their business. It recommends that UNDP continues its implementation. Ann Ale may wish to encourage that good practices are adopted by having follow-ups with the beneficiaries. This evaluation recommends that Ann Ale includes a coaching and mentoring initiative.
10 Lack of funds limit the growth of their operations, however; efficient money management is essential for business improvement and growth. The participants of the Anne Ale Pilot appear to be hard-working people and many have the entrepreneur spirit, ambition and drive. UNDP should look into supporting them further to reinforce the skills so far acquired. UNDP can also enable access to loans and microcredit by establishing partnerships with micro-credit agencies for business owners who show readiness, commitment and enthusiasm for growth.
11 The census data should be of utmost quality as it serves as baseline data for monitoring and evaluation and for the selection of beneficiaries for Ann Alé. Hence it is recommended that the data collection methodology as well as the data needs be reviewed to reflect the objectives of this data collection. The census data collection tools should be redesigned to follow best practices in questionnaire design. The data files should be created and organized to permit user-friendly data extraction and analysis.
1. Recommendation: It appears that the training was beneficial to all participants regardless of level of education and experience in running a business. It is recommended that training is given to homogeneous groups although there are merits in having a mix of people with different level of experience as learning from peers is constructive. The instructors may be able to adjust the content of the courses to satisfy the knowledge needs of the participants when groups are homogeneous members. However, this "segregation" prevents interaction between different socio-economic groups who can learn from each other's business reality and experience. QMG has taught similar programs for other organizations. Different approach for adult training should be reviewed and experimented as required.
Management Response: [Added: 2016/01/08] [Last Updated: 2016/03/17]

When UNDP Haiti has replicated the Ann Ale approach in Cite de Soleil, through a CVR initiative, this has been taken into consideration to replicate the approach.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
1.1.Enterpreneurs du Monde, NGOs that has been contracted by UNDP to work on training in Cite de Soleil, has considered this worked in the area of Cite Soleil for the training, took this recommendation into consideration
[Added: 2016/03/17]
Poverty Reduction 2015/12 Completed History
2. Recommendation: Program such as Ann Ale should promote the gain in skills and take away the focus on daily snacks or other material 'rewards'.
Management Response: [Added: 2016/01/08] [Last Updated: 2016/03/17]

Snacks have been removed from the training

Key Actions:

Key Action Responsible DueDate Status Comments Documents
2.1. During the replication of the approach, during the trainings, snacks were not included
[Added: 2016/03/17]
Poverty Reduction 2015/12 Completed History
3. Recommendation: It is suggested that where classrooms are available such as in community centers, these should be used for the training sessions. However given the transport facility it provides; the truck can still be used for small groups made of no more than 5-6 persons for training sessions which do not last more than 3 hours. Participants should be made aware that toilets will not be available.
Management Response: [Added: 2016/01/08] [Last Updated: 2016/03/17]

The bus has not been used anymore

Key Actions:

Key Action Responsible DueDate Status Comments Documents
3.1 During the replication in Cite de Soleil, the project has used the space offered by the municipality for the training session.
[Added: 2016/03/17]
Poverty Reduction 2015/12 Completed History
4. Recommendation: The program and its objectives have to be well explained to the business owners before they are registered so that people do not come to the program with unrealistic or irrelevant expectations. It should be made very clear that there is no hand-out of money or microcredits in this program.
Management Response: [Added: 2016/01/08] [Last Updated: 2016/03/17]

Advocacy sessions have been organized to explain the process and the contents of the training

Key Actions:

Key Action Responsible DueDate Status Comments Documents
4.1 During the replication in Cite de Soleil, and also with the Bus LIDE, advocacy sessions have been organized with the different beneficiaries in order to better explain the process
[Added: 2016/03/17]
Poverty Reduction 2015/12 Completed History
5. Recommendation: The (Cahier De Suivi) does not appear to be a good tool. It will be preferable to provide a ledger that can be easily purchased to keep record of the business transactions.
Management Response: [Added: 2016/01/08] [Last Updated: 2016/03/17]

A Cahier Caisse has replaced the Cahier de Suivi to keep record of the business transactions in the CVR program. Innovative tools have been develop to insure the follow up of business transaction (tablet application) for LIDE

Key Actions:

Key Action Responsible DueDate Status Comments Documents
5.1 For CVR the Cahier de Suivi was replace by a more simple version : the Cahier de Caisse
[Added: 2016/03/17]
Poverty Reduction 2015/12 Completed History
5.2 For LIDE, innovative solutions have been implemented. An application on a tablet was designed to help the monitoring of transactions
[Added: 2016/03/17]
Poverty Reduction 2015/12 Completed
6. Recommendation: : It is strongly recommended that the target population of Ann Ale be defined and that the criteria for the selection of beneficiaries be explicitly be established. It is recommended that the program reaches out to business that is in line with the UNDP objective for environmentally friendly and sustainable development.
Management Response: [Added: 2016/01/08] [Last Updated: 2016/03/17]

For the replication of the approach in Cite de Soleil, criteria were very well identified

Key Actions:

Key Action Responsible DueDate Status Comments Documents
6.1 The criteria were identified already in the prodoc.
[Added: 2016/03/17]
Poverty Reduction 2015/12 Completed History
7. Recommendation: It is strongly recommended that the Graphic Design Initiative be reviewed since there is no provide store signs if the business cannot pay the related municipal fees. In fact, this evaluation found that the signs can be a hindrance to the entrepreneurs until they are legally allowed to have a store front sign.
Management Response: [Added: 2016/01/08] [Last Updated: 2016/03/17]

The Graphical Design initiative has been removed

Key Actions:

Key Action Responsible DueDate Status Comments Documents
7.1 Removal of the Graphical Design component from the program
[Added: 2016/03/17]
Poverty Reduction 2015/12 Completed History
8. Recommendation: This evaluation recommends that UNDP continues to establish partnership with the community associations in future implementation of Ann Ale.
Management Response: [Added: 2016/01/08] [Last Updated: 2016/03/17]

This is an approach that UNDP has always adopted

Key Actions:

Key Action Responsible DueDate Status Comments Documents
8.1 UNDP has continued to establish partnership with the community associations to duplicate the Ann Ale approach in Cite de Soleil
[Added: 2016/03/17]
Poverty Reduction 2015/12 Completed History
9. Recommendation: This evaluation has found that Ann Ale has made positive impacts on the beneficiaries and their business. It recommends that UNDP continues its implementation. Ann Ale may wish to encourage that good practices are adopted by having follow-ups with the beneficiaries. This evaluation recommends that Ann Ale includes a coaching and mentoring initiative.
Management Response: [Added: 2016/01/08] [Last Updated: 2016/03/17]

The methodology has been replicated

Key Actions:

Key Action Responsible DueDate Status Comments Documents
9.1 Through CVR funds it has been possible to replicate and adapt Ann Ale in Cite de Soleil.
[Added: 2016/03/17] [Last Updated: 2019/01/31]
Poverty Reduction 2015/12 Completed Replicated in Jeremie in 2017-2018 History
10. Recommendation: Lack of funds limit the growth of their operations, however; efficient money management is essential for business improvement and growth. The participants of the Anne Ale Pilot appear to be hard-working people and many have the entrepreneur spirit, ambition and drive. UNDP should look into supporting them further to reinforce the skills so far acquired. UNDP can also enable access to loans and microcredit by establishing partnerships with micro-credit agencies for business owners who show readiness, commitment and enthusiasm for growth.
Management Response: [Added: 2016/01/08] [Last Updated: 2016/03/17]

After the evaluation, UNDP Haiti has tried to improve the methodology with through the actions described below

Key Actions:

Key Action Responsible DueDate Status Comments Documents
10.1 BUS LIDE: each one of the 40 participants has access to a grant
[Added: 2016/03/17]
Poverty reduction 2016/03 Completed History
10.2 CVR- Ann Ale - Cite de Soleil: each of the participant will benefit of a 500 USD in kind voucher. Beneficiaries will be supported to organize themselves in platforms to buy materials of goods in larger quantities, at a lower price, from selected suppliers
[Added: 2016/03/17] [Last Updated: 2019/01/31]
Poverty Reduction 2016/03 Completed History
10.3 A data base that contains beneficiaries from Ann Ale 16/6, Ann Ale Fort National and Ann Ale Cite Soleil will be shared with the micro credit agency De Jardins but micro credit in Haiti still remains a big challenge due to the extremely high rates.
[Added: 2016/03/17] [Last Updated: 2019/01/31]
Poverty reduction 2016/03 No Longer Applicable [Justification: This first option as a continuity of the Ann Ale beneficiaries has been put in place but the partnership with the micro-credit agency “De Jardins” never worked out]
History
10.4 A partnership with UNILEVER has been created in order to give to Ann Ale beneficiaries the possibility to have Unilever products at a lower price as a continuity and exit strategy of the implementation of Ann Ale.
[Added: 2016/03/17] [Last Updated: 2019/01/31]
Poverty Reduction 2016/01 No Longer Applicable [Justification: This second option as a continuity of the Ann Ale beneficiaries has been put in place but it did not work out for all the beneficiaries because of their different needs in terms of products]
History
11. Recommendation: The census data should be of utmost quality as it serves as baseline data for monitoring and evaluation and for the selection of beneficiaries for Ann Alé. Hence it is recommended that the data collection methodology as well as the data needs be reviewed to reflect the objectives of this data collection. The census data collection tools should be redesigned to follow best practices in questionnaire design. The data files should be created and organized to permit user-friendly data extraction and analysis.
Management Response: [Added: 2016/01/08] [Last Updated: 2016/03/17]

The data base has been reviewed and improved.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
11.1 The data base has been reviewed and improved, and it will be shared soon with different partners
[Added: 2016/03/17]
Poverty Reduction 2016/03 Completed
11.2 The experience has been systematized in order to improve the overall process.
[Added: 2016/03/17]
Poverty Reduction 2015/06 Completed

Latest Evaluations

Contact us

1 UN Plaza
DC1-20th Floor
New York, NY 10017
Tel. +1 646 781 4200
Fax. +1 646 781 4213
erc.support@undp.org