Midterm Evaluation for Kaidi biomass sustainable development project

Report Cover Image
Evaluation Plan:
2016-2020, China
Evaluation Type:
Mid Term Project
Planned End Date:
12/2018
Completion Date:
12/2018
Status:
Completed
Management Response:
Yes
Evaluation Budget(US $):
20,000

Share

Title Midterm Evaluation for Kaidi biomass sustainable development project
Atlas Project Number: 79825
Evaluation Plan: 2016-2020, China
Evaluation Type: Mid Term Project
Status: Completed
Completion Date: 12/2018
Planned End Date: 12/2018
Management Response: Yes
Corporate Outcome and Output (UNDP Strategic Plan 2018-2021)
  • 1. Output 1.5.1 Solutions adopted to achieve universal access to clean, affordable and sustainable energy
Evaluation Budget(US $): 20,000
Source of Funding: Project budget
Evaluation Expenditure(US $): 7,073
Joint Programme: No
Joint Evaluation: No
Evaluation Team members:
Name Title Email Nationality
Ling Lin Independent Consultant 573522740@qq.com
GEF Evaluation: No
Key Stakeholders: Ministry of Environment
Countries: CHINA, PEOPLE'S REPUBLIC
Lessons
Findings
Recommendations
1

For Pre-conditional Feasibility Study:  A community development expert has been invited to work with PMO going through key pilot area selection process. Based on the pilot area selection, the management team could review and revise the framework of resources table. The key is to define what is biomass energy development model and it should be demonstrated in an integrated "full industry Chain" in selected areas in typical geographic locations. The review of logical framework should be conducted thus to avoid misleading information. The Chinese translation for the original English ProDoc should be done completely.

2

For Output 1.1: Compilation of Chongzuo’s Comprehensive Plan for Promoting Modern and Environment-Friendly Agriculture, Forestry, Husbandry Development (2015-2025) - During interview with local stakeholders, they showed great interests in reports and information from analysis. Report should be delivered to stakeholders.

3

For Output 1.2: Compilation of Comprehensive Development Plan for Non-Grain Biomass Energy Industry of Chongzuo, Guangxi (2015-2025) - The plan could be an information base for selecting key pilot areas.

4

For Output 1.3 Completion of Design and Plan for Sustainable Industry Chain of Using agro/forestry Biomass Resources in key pilot areas - The industry Chain in key pilot areas may be formulated as different models:
energy company + community;
energy company + corporations + community;
bioenergy consumption for community + individuals sugar cane grower.
Demonstration of those models in key pilot areas is a core value of this project

5

For Output 2.1: Establishment of Modern Agricultural Training Centre for providing technical training to farmers on Sugarcane production - The centre should provide trainings to farmers in the key pilot areas.

6

For Output 2.2:  Support to establish Farmers’ Field School to provide technical trainings to farmers on high-yield crop farming, production management and pest management, etc. - FFS should be setup for the community learning process in selected pilot areas, the approach should be done as below:
 • FFS is field based and should be working during full cropping seasons.
• The primary learning material at a FFS should be the sugarcane/cassava/energy grass/energy forest management.
• The FFS meeting place should be close to the learning plots.
• FFS educational methods should be experiential, participatory, and learner-concerned.
• Each FFS meeting should include at least three activities: the agro-ecosystem analysis, a “special topic”, and a group dynamics activity.
• In every FFS, participants should conduct a study comparing new with traditional plots.
• A FFS often includes several additional field studies depending on local situations.
•The number of participants should be controlled between 25 and 30 in a FFS. Participants learn together in small groups of five to maximize participation.
• All FFSs should design a Field Day, in which farmers make presentations about the results of their studies.
• A pre- and post-test is conducted as part of Field School for diagnostic purposes and for determining follow-up activities.
• The facilitators of FFS’s undergo intensive season-long residential training to prepare them for organizing and conducting Field Schools.
• Preparation meetings precede an FFS to determine needs, recruit participants, and develop a learning contract.
• Final meetings of the FFS often include planning for follow-up activities.

7

For Output 3.1 Standardization of sugarcane mechanized operation - The standardizations may be developed for sugarcane mechanized operations in different geographic locations and it should cover both small scale and large scale operations for typical areas

8

For Output 3.2 Promotion of mechanized farming operation services - Review current partners who are doing farming operation services and then make plan for further promotion activities.

9

For Output 3.3 feasibility study on combining harvesting and juicing operations - PMO may need a detailed report on explaining the current technique issues.

10

For Output 4.1   Partnership formulated and feasibility study completed for upgrading existing off-grid CHP plants within sugar mills - It is recommended that the national grid operators, sugarcane mills and NDRC authority can discuss CHP issues through a workshop organized by PMO.

11

For Output 4.2 Feasibility study on developing and demonstrating raw juice cooling and storage facilities by using exhaust heat from sugar plants as cooling energy source  - It has been changed as below. The project leading group made this change considering that Kaidi's new powerplant was not constructed as planned.

12

For Output 4.2 To establish Guangxi biomass energy collection and storage mechanism and compile Research Report of Establishment on Guangxi Biomass Energy Collection and Storage Mechanism - The research could be adjusted for other options if pilot areas is selected. No comment.

13

For Output 4.3 Demonstration of environment-friendly recycling technologies in the sugar milling process - Demonstration in the company at certain selected pilot areas is highly suggested

14

For Output 5.1 Pilot and establish eucalyptus demonstration plantations as sustainable forest biomass sources - This Pilot is also suggested to be established in key pilot areas. The sustainable management guideline for grass planting should be one of output based on actual practices in pilot areas. Final check should be carried out by the end of the project

15

For Output 5.2 Pilot energy grass-planting models by use of marginal lands - This Pilot is also suggested to be established in key pilot areas. The sustainable management guideline for grass planting should be one of output based on actual practices in pilot areas. Final check should be carried out by the end of the project

16

For Output 5.3 Pilot high-yield cassava farming - This pilot has been stopped after a consultation with staff from agriculture department.

17

For Output 6.1 Project Management - Review the results framework with some necessary outputs, indicators and activities since situation and assumption changed dramatically in last few years and should get an official approve from UNDP, CICETE and Provincial MPO.
The PMO should start to develop a phase out plan for this project to make sure knowledge gained from this project can be transferred to stakeholder and partners in developing biomass energy.

18

For Output6.2 Advocacy and  Communications - The team need to formulate an overall communication and advocacy strategy plan for this demonstration project.

19

For Output 6.3 M&E including mid-term and final evaluations - Review and refine the M&E plan after the result framework is reviewed. The final evaluation should base on the revised results framework.

20

For Output 6.4 UNV support - UNV's support is still needed. It would be better to organise trainings on TOC for UNV and local staff.

21

For Output 6.5 Auditing - PMO already has a plan.

1. Recommendation:

For Pre-conditional Feasibility Study:  A community development expert has been invited to work with PMO going through key pilot area selection process. Based on the pilot area selection, the management team could review and revise the framework of resources table. The key is to define what is biomass energy development model and it should be demonstrated in an integrated "full industry Chain" in selected areas in typical geographic locations. The review of logical framework should be conducted thus to avoid misleading information. The Chinese translation for the original English ProDoc should be done completely.

Management Response: [Added: 2019/01/05]

The PMO will review and refine the result and resources framework to improve the relevance of the activities and implementation effectiveness.

The revised activities will focus on selecting demonstration sites, establishing a replicable and sustainable biomass energy development model, and promoting the demonstration and promotion of the comprehensive utilization model of biomass energy in the whole industry chain.

The PMO will revise the Chinese translation for the product to clear out any discrepancy.

Key Actions:

2. Recommendation:

For Output 1.1: Compilation of Chongzuo’s Comprehensive Plan for Promoting Modern and Environment-Friendly Agriculture, Forestry, Husbandry Development (2015-2025) - During interview with local stakeholders, they showed great interests in reports and information from analysis. Report should be delivered to stakeholders.

Management Response: [Added: 2019/01/05]

The PMO will share with stakeholders and competent authorities the report which could not only serve as a source of reference in order to promote modern and environment-friendly agriculture, forestry, husbandry development, but also lay a solid foundation for sustainable biomass energy development.

Key Actions:

3. Recommendation:

For Output 1.2: Compilation of Comprehensive Development Plan for Non-Grain Biomass Energy Industry of Chongzuo, Guangxi (2015-2025) - The plan could be an information base for selecting key pilot areas.

Management Response: [Added: 2019/01/05]

The PMO will further study the report, and share it with stakeholders and competent authorities, as an information base for selecting key pilot areas.

Key Actions:

4. Recommendation:

For Output 1.3 Completion of Design and Plan for Sustainable Industry Chain of Using agro/forestry Biomass Resources in key pilot areas - The industry Chain in key pilot areas may be formulated as different models:
energy company + community;
energy company + corporations + community;
bioenergy consumption for community + individuals sugar cane grower.
Demonstration of those models in key pilot areas is a core value of this project

Management Response: [Added: 2019/01/05]

In the future, the project will focus on selecting demonstration sites, establishing a replicable and sustainable biomass energy development model, and promoting the demonstration and promotion of the comprehensive utilization model of biomass energy in the whole industry chain.

Key Actions:

5. Recommendation:

For Output 2.1: Establishment of Modern Agricultural Training Centre for providing technical training to farmers on Sugarcane production - The centre should provide trainings to farmers in the key pilot areas.

Management Response: [Added: 2019/01/05] [Last Updated: 2019/01/05]

Going forward, the project will improve the targeting of training activities, give play to the training and driving role of farmers' field schools, and promote the establishment of project demonstration sites and sustainable biomass energy development models.

Key Actions:

6. Recommendation:

For Output 2.2:  Support to establish Farmers’ Field School to provide technical trainings to farmers on high-yield crop farming, production management and pest management, etc. - FFS should be setup for the community learning process in selected pilot areas, the approach should be done as below:
 • FFS is field based and should be working during full cropping seasons.
• The primary learning material at a FFS should be the sugarcane/cassava/energy grass/energy forest management.
• The FFS meeting place should be close to the learning plots.
• FFS educational methods should be experiential, participatory, and learner-concerned.
• Each FFS meeting should include at least three activities: the agro-ecosystem analysis, a “special topic”, and a group dynamics activity.
• In every FFS, participants should conduct a study comparing new with traditional plots.
• A FFS often includes several additional field studies depending on local situations.
•The number of participants should be controlled between 25 and 30 in a FFS. Participants learn together in small groups of five to maximize participation.
• All FFSs should design a Field Day, in which farmers make presentations about the results of their studies.
• A pre- and post-test is conducted as part of Field School for diagnostic purposes and for determining follow-up activities.
• The facilitators of FFS’s undergo intensive season-long residential training to prepare them for organizing and conducting Field Schools.
• Preparation meetings precede an FFS to determine needs, recruit participants, and develop a learning contract.
• Final meetings of the FFS often include planning for follow-up activities.

Management Response: [Added: 2019/01/05]

Going forward, the project will improve the targeting of training activities, give play to the training and driving role of farmers' field schools, and promote the establishment of project demonstration sites and sustainable biomass energy development models.

Key Actions:

7. Recommendation:

For Output 3.1 Standardization of sugarcane mechanized operation - The standardizations may be developed for sugarcane mechanized operations in different geographic locations and it should cover both small scale and large scale operations for typical areas

Management Response: [Added: 2019/01/05]

The project shall enhance a better mix for the demonstration and put more emphasis on diversifying the land scale types.

Key Actions:

8. Recommendation:

For Output 3.2 Promotion of mechanized farming operation services - Review current partners who are doing farming operation services and then make plan for further promotion activities.

Management Response: [Added: 2019/01/05]

The PMO will enhance the communication with current partners and arrange further activities that promotes mechanisation operations and encourage investment into upscaling the application of agriculture machinery.

Key Actions:

9. Recommendation:

For Output 3.3 feasibility study on combining harvesting and juicing operations - PMO may need a detailed report on explaining the current technique issues.

Management Response: [Added: 2019/01/05]

The PMO shall liaise with the current partners and gather more information on the current technique issues.

Key Actions:

10. Recommendation:

For Output 4.1   Partnership formulated and feasibility study completed for upgrading existing off-grid CHP plants within sugar mills - It is recommended that the national grid operators, sugarcane mills and NDRC authority can discuss CHP issues through a workshop organized by PMO.

Management Response: [Added: 2019/01/05]

The PMO will continue to strengthen ties with local government departments, companies, farmers, and communities, share project results and project information, and promote local government departments to incorporate project results into planning and decision-making. Improve the cohesiveness of stakeholders and promote project implementation to benefit all stakeholders.

Key Actions:

11. Recommendation:

For Output 4.2 Feasibility study on developing and demonstrating raw juice cooling and storage facilities by using exhaust heat from sugar plants as cooling energy source  - It has been changed as below. The project leading group made this change considering that Kaidi's new powerplant was not constructed as planned.

Management Response: [Added: 2019/01/05]

N/A

Key Actions:

12. Recommendation:

For Output 4.2 To establish Guangxi biomass energy collection and storage mechanism and compile Research Report of Establishment on Guangxi Biomass Energy Collection and Storage Mechanism - The research could be adjusted for other options if pilot areas is selected. No comment.

Management Response: [Added: 2019/01/05]

N/A

Key Actions:

13. Recommendation:

For Output 4.3 Demonstration of environment-friendly recycling technologies in the sugar milling process - Demonstration in the company at certain selected pilot areas is highly suggested

Management Response: [Added: 2019/01/05]

The PMO will consider companies at certain selected pilot areas as well as other options.

Key Actions:

14. Recommendation:

For Output 5.1 Pilot and establish eucalyptus demonstration plantations as sustainable forest biomass sources - This Pilot is also suggested to be established in key pilot areas. The sustainable management guideline for grass planting should be one of output based on actual practices in pilot areas. Final check should be carried out by the end of the project

Management Response: [Added: 2019/01/05] [Last Updated: 2019/01/05]

By the end of the project or the subcontract, the PMO shall conduct a final check on the implementation of the activity as well as the reports as required by the contract/TOR.

Key Actions:

15. Recommendation:

For Output 5.2 Pilot energy grass-planting models by use of marginal lands - This Pilot is also suggested to be established in key pilot areas. The sustainable management guideline for grass planting should be one of output based on actual practices in pilot areas. Final check should be carried out by the end of the project

Management Response: [Added: 2019/01/05]

By the end of the project or the subcontract, the PMO shall conduct a final check on the implementation of the activity as well as the reports as required by the contract/TOR.

In the future, the project will put emphasis on on establishing a replicable and sustainable biomass energy development model, and promoting the demonstration and promotion of the comprehensive utilization model of biomass energy in the whole industry chain.

Key Actions:

16. Recommendation:

For Output 5.3 Pilot high-yield cassava farming - This pilot has been stopped after a consultation with staff from agriculture department.

Management Response: [Added: 2019/01/05]

Based on the consultation with the Department of Agriculture of Chongzuo, this particular activity is not suitable to be carried out hence cancelled. The pilot currently focusses on energy grass and energy forests.

Key Actions:

17. Recommendation:

For Output 6.1 Project Management - Review the results framework with some necessary outputs, indicators and activities since situation and assumption changed dramatically in last few years and should get an official approve from UNDP, CICETE and Provincial MPO.
The PMO should start to develop a phase out plan for this project to make sure knowledge gained from this project can be transferred to stakeholder and partners in developing biomass energy.

Management Response: [Added: 2019/01/05]

The PMO will review the result and resources framework and formulate the project exit strategy and try to ensure sustainability of the project result

Key Actions:

18. Recommendation:

For Output6.2 Advocacy and  Communications - The team need to formulate an overall communication and advocacy strategy plan for this demonstration project.

Management Response: [Added: 2019/01/05]

The PMO will formulate an overall publicity policy to expand the impact of the project on a multi-faceted and multi-channel basis in response to the needs of different audiences. Promote project implementation with project promotion.

Key Actions:

19. Recommendation:

For Output 6.3 M&E including mid-term and final evaluations - Review and refine the M&E plan after the result framework is reviewed. The final evaluation should base on the revised results framework.

Management Response: [Added: 2019/01/05]

The PMO will review and refine the result and resources framework as well as the ME plan, to improve the relevance of the activities and implementation effectiveness.

The revised activities will focus on selecting demonstration sites, establishing a replicable and sustainable biomass energy development model, and promoting the demonstration and promotion of the comprehensive utilization model of biomass energy in the whole industry chain.

According to different industrial chains and biomass energy utilization chains, relying on rural communities to establish a biomass energy storage and transportation system. Strive to "establish a type of utilization chain, form a storage model, and promote a utilization experience."

Key Actions:

20. Recommendation:

For Output 6.4 UNV support - UNV's support is still needed. It would be better to organise trainings on TOC for UNV and local staff.

Management Response: [Added: 2019/01/05]

UNVs are well positioned to assist the local staff in applying the ToC tool and relevant training materials have already been provided. In the future, if possible, UNDP will try to provide ME training to local based UNV(s).

Key Actions:

21. Recommendation:

For Output 6.5 Auditing - PMO already has a plan.

Management Response: [Added: 2019/01/05]

N/A

Key Actions:

Latest Evaluations

Contact us

220 East 42nd Street
20th Floor
New York, NY 10017
Tel. +1 646 781 4200
Fax. +1 646 781 4213
erc.support@undp.org