Mid-term evaluation: Strengthening Protected Area Network

Report Cover Image
Evaluation Plan:
2012-2016, Mongolia
Evaluation Type:
Mid Term Project
Planned End Date:
06/2013
Completion Date:
06/2013
Status:
Completed
Management Response:
Yes
Evaluation Budget(US $):
16,500

Share

Document Type Language Size Status Downloads
Download document MTE Report FINAL 130728 (2).pdf report English 789.92 KB Posted 462
Download document SPAN MTR TOR 15 Feb 2013_final 10 may.docx tor English 71.29 KB Posted 458
Download document Management response to MTE SPAN.pdf related-document English 1861.41 KB Posted 278
Title Mid-term evaluation: Strengthening Protected Area Network
Atlas Project Number: 00074214
Evaluation Plan: 2012-2016, Mongolia
Evaluation Type: Mid Term Project
Status: Completed
Completion Date: 06/2013
Planned End Date: 06/2013
Management Response: Yes
Focus Area:
  • 1. Others
Corporate Outcome and Output (UNDP Strategic Plan 2014-2017)
  • 1. Output 1.3. Solutions developed at national and sub-national levels for sustainable management of natural resources, ecosystem services, chemicals and waste
Evaluation Budget(US $): 16,500
Source of Funding: Gef
Joint Programme: No
Joint Evaluation: No
Evaluation Team members:
Name Title Email Nationality
Mike Moser Dr. mike-moser@supanet.com
Orgiltuya D. Ms. dorgiltuya@yahoo.com
GEF Evaluation: Yes
Evaluation Type:
Focal Area: Biodiversity
Project Type: EA
GEF Phase: GEF-1
PIMS Number: 4180
Key Stakeholders: Ministry of Environment and Green Development, GEF, UNDP, Argali Research Centre, Denver Zoological Society, WWF Mongolia
Countries: MONGOLIA
Lessons
Findings
Recommendations
1 Increase the frequency of Project Board meetings to a minimum of 2 per annum, to strengthen engagement of key partners, maintain focus on delivery against the project plan and avoid dissipation onto other activities, and ensure synergy with related projects. Also invite the Directors of OVNP and INNR as observers.
2 Strengthen planning/reporting between NPD and PC through establishing a joint SPAN/MEGD work plan with regular weekly meetings to address short-term priorities and a longer meeting each quarter to set medium-term priorities. NPD to visit the project sites at the earliest convenience.
3 Activate the Policy/Advisory Group to take stock of project progress and advise on priorities at this mid-term point, based on the conclusions and recommendations of the MTE. Hold annual meetings thereafter to advise on work plan and NGO partner support.
4 Strengthen attention on indicators and progress against targets as an adaptive management tool, and assess progress every 6 months using traffic light system initiated by the MTE. Consider appointment of a joint M&E officer with the new UNDP/GEF project
5 Strengthen alignment and reporting of co-financing through annual meetings with co-financing partners and establishing a formal tracking system.
6 Strengthen communications through appointment of a Communications Officer (jointly with new GEF project), to support information dissemination (monthly e-newsletter) advocacy and knowledge management so as to capitalize on the good results.
7 Add a new risk on dissipation of MEGD?s attention and resources to PAs and develop mitigatory actions including building on the results of the planned Valuation of PA Ecosystem Services study.
8 Address all MTE comments on the METT, Financial Sustainability and Capacity Scorecards, and prepare finalized versions (also of the BD Tracking Tool)
9 Strengthen working arrangements between the Local Coordinator at OVNP and the Director of the OVNP Administration in order to maximize benefits of project support.
10 More attention should be given to cross-project learning and knowledge exchange, particularly with GEF projects that have similar objectives in the region
11 Urgently finalize the revenue generation proposals, with a clear vision and recommendations, so that they are adequately addressed in the new legislation. Include a strong incentive for retention of PA-generated revenue through a proposal in law of a 60-80% range for retention to be decided annually by the Ministry of Finance.
12 Establish, by end September 2013, a communications and advocacy plan to ensure Parliament approval for the revised PA and Buffer zone laws, including NGO support and an information workshop and possible field visits for Parliamentarians (and the Minister).
13 Establish across the PA system, by end 2013, those key revenue streams (entry fee revision, airport tax, land use fee and fee from use of natural resources) that can be achieved without legislative change but only require inter-agency agreements.
14 Further strengthen PAAD through capacity building and development of a convincing proposal to the Minister based on MTE recommendations emphasizing the need for additional Finance (budgeting and Revenue generation) and M&E roles. Follow project plan to integrate 2 project staff (Financing and M&E) into PAAD, and for government to assume these posts by end of project.
15 Finalize integrated training curriculum and agree mechanism for delivery with universities and NGO partners, plus mechanism for certification with the Ministry of Education.
16 Review the objective level target for financing of the PA system. Disaggregate the increased financing available to PAAD, to separate out inflation, salaries, expansion of new PAs and show that real improvements are being made.
17 Prepare and implement from end 2013 a ?SPAN sustainability and exit plan? for both national and demonstration site activities that will ensure adequate capacity of PAAD and the 2 PA Administrations to take on the new approaches developed by the end of the project. Include the nomination of focal points.
18 Support PAAD to complete a comprehensive, strategic and costed 5 year plan for the whole PA system from 2014 as part of the new plan for the National Programme on Protected Areas. This should include a high level Vision and guidance for the development of co-management approaches and sustainable financing including new revenue sources ? to justify increased government funding. The Plan should include a prioritized list of urgent actions for additional investment (co-financing) by government in the remaining 2 years of the project.
19 Institutionalize the ?Annual PA Forum? to foster inter-agency engagement, innovation and adaptive management of the national PA system.
20 Alongside the PA Forum, establish a PA Partners Board to bring together key donors and delivery partners (UNDP/GEF, bi-laterals, NGOs) in an annual meeting to support strategic partnerships and integrated delivery of the National Programme for PAs, cost effective project synergies, planning and knowledge-sharing.
1. Recommendation: Increase the frequency of Project Board meetings to a minimum of 2 per annum, to strengthen engagement of key partners, maintain focus on delivery against the project plan and avoid dissipation onto other activities, and ensure synergy with related projects. Also invite the Directors of OVNP and INNR as observers.
Management Response: [Added: 2014/10/26]

The project will organize 2 meetings within remaining period: 1.In late July or early August to discuss 1st half year AWP performance and MTE recommendations 2. In early December to discuss 2nd half year?s performance and next year?s AWP

Key Actions:

Key Action Responsible DueDate Status Comments Documents
1. 3d PB meeting organized on 29th August 2013, assessed 1st half of year performance and approved activities for 2nd half of year, provided recommendations 2.On Dec 20th planned 4th PB meeting discuss 2nd half year?s performance and next year?s AWP for both SPAN and MRPA projects
[Added: 2014/10/26]
PIU 2013/08 Completed
2. Recommendation: Strengthen planning/reporting between NPD and PC through establishing a joint SPAN/MEGD work plan with regular weekly meetings to address short-term priorities and a longer meeting each quarter to set medium-term priorities. NPD to visit the project sites at the earliest convenience.
Management Response: [Added: 2014/10/26]

Develop and approve the work plan with timeframe and responsible parties Organize meeting with PAAD staff, assist in planning and reporting. NPD will take visit to Ikh Nart (Dornogobi aimag, 2 target soums and Ikh Nart) between 4-6 July NPD will visit OVNP in late June before PB meeting.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Developed and approved the joint work plan which is going to be assessed by 25 December. SPAN team is regularly participating in weekly meeting at PAAD to incorporate actions Senior Finance Officer of SPAN spends one working day at PAAD to assist in budgeting, business and overall finance planning. In July NPD paid visit to both sites and provided recommendations to increase efficiency of project efforts.
[Added: 2014/10/26]
NPC, NDP 2013/07 Completed
3. Recommendation: Activate the Policy/Advisory Group to take stock of project progress and advise on priorities at this mid-term point, based on the conclusions and recommendations of the MTE. Hold annual meetings thereafter to advise on work plan and NGO partner support.
Management Response: [Added: 2014/10/26]

The project will establish the Advisory Group by approval of the Minister Will be held 1st meeting of the Group to discuss technical outputs produced so far and get advice on ongoing studies and activities

Key Actions:

Key Action Responsible DueDate Status Comments Documents
The Advisory Board has been officially established, rules developed and approved by NPD 1st meeting is scheduled on 24 Dec 2013.
[Added: 2014/10/26]
NPC 2013/07 Completed
4. Recommendation: Strengthen attention on indicators and progress against targets as an adaptive management tool, and assess progress every 6 months using traffic light system initiated by the MTE. Consider appointment of a joint M&E officer with the new UNDP/GEF project
Management Response: [Added: 2014/10/26]

Assess indicators and progress against targets using traffic light system for 2nd half of 2013 and further Agree with CO to hire a joint M&E officer, develop ToR and recruit

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Traffic light system utilized to assess indicators and progress against targets (for 1st and 2nd half of 2013 done) Full-time M&E officer is recruited since 20 Nov 2013
[Added: 2014/10/26]
NPC, UNDP CO 2013/08 Completed
5. Recommendation: Strengthen alignment and reporting of co-financing through annual meetings with co-financing partners and establishing a formal tracking system.
Management Response: [Added: 2014/10/26]

Agree with and develop co-financing table Hold meeting with co-financing partners and agree on establishing formal tracking system

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Developed co-financing table per MTE comments Received co-financing report for the period of Jan 2011- June 2013 .
[Added: 2014/10/26]
NPC, UNDP CO 2013/10 Completed
6. Recommendation: Strengthen communications through appointment of a Communications Officer (jointly with new GEF project), to support information dissemination (monthly e-newsletter) advocacy and knowledge management so as to capitalize on the good results.
Management Response: [Added: 2014/10/26]

Develop communication and advocacy policy and work plan jointly with PAAD and WWF

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Tasks of communication and advocacy are included under responsibility of M&E officer Communication and advocacy policy at PA site-level drafted jointly with WWF
[Added: 2014/10/26] [Last Updated: 2018/11/05]
NPC, NDP 2013/10 Completed History
7. Recommendation: Add a new risk on dissipation of MEGD?s attention and resources to PAs and develop mitigatory actions including building on the results of the planned Valuation of PA Ecosystem Services study.
Management Response: [Added: 2014/10/26]

Assist PAAD to submit a reasonable budget for 2014 with substantial budget increase Develop mitigatory actions following up the results of the Economic Valuation of PA Ecosystem Services study once completed.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Assisted PAAD in the reasonable budget planning for 2014 by integrating compiled data from the newly introduced accounting system supported by the project Senior Finance Officer of SPAN spends one working day at PAAD to assist in budgeting, business and overall finance planning. SPAN key Officers and NPC pays regular visit to weekly meetings of PAAD to enable joint planning and budgeting Due to lack of appropriate candidates selection of IC delayed and thus the study has started late (October 2013), hence results are not ready yet
[Added: 2014/10/26]
NPC, PB 2013/10 Completed
8. Recommendation: Address all MTE comments on the METT, Financial Sustainability and Capacity Scorecards, and prepare finalized versions (also of the BD Tracking Tool)
Management Response: [Added: 2014/10/26]

METT, Financial Sustainability and Capacity Scorecards are updated and sent to Mid-term Evaluator

Key Actions:

Key Action Responsible DueDate Status Comments Documents
METT for project pilot sites, Financial Sustainability and Capacity Scorecards are updated and included in MTE report
[Added: 2014/10/26]
NPC 2013/07 Completed
9. Recommendation: Strengthen working arrangements between the Local Coordinator at OVNP and the Director of the OVNP Administration in order to maximize benefits of project support.
Management Response: [Added: 2014/10/26]

NPD and NPC will take visit to OVNP to discuss challenges and give a strong guidance to streamline working partnership

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Both NPD and NPC visited OVNP, had separate discussions on the subject and provided strong recommendations to both parties and results will be reviewed on a regular basis.
[Added: 2014/10/26]
NPC, NDP 2013/07 Completed
10. Recommendation: More attention should be given to cross-project learning and knowledge exchange, particularly with GEF projects that have similar objectives in the region
Management Response: [Added: 2014/10/26]

Explore GEF projects with similar objectives in the region Conduct study tour to selected country

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Explored WWF projects in the region Developed tentative agenda, ToR, tour routes for selected 2 regions, contacted respective persons Study tour shifted to 2014 AWP
[Added: 2014/10/26]
NPC,UNDP CO 2013/10 Completed
11. Recommendation: Urgently finalize the revenue generation proposals, with a clear vision and recommendations, so that they are adequately addressed in the new legislation. Include a strong incentive for retention of PA-generated revenue through a proposal in law of a 60-80% range for retention to be decided annually by the Ministry of Finance.
Management Response: [Added: 2014/10/26]

Receive draft report of consultancy and provide feedback jointly with PAAD. Receive final report and recommendations and submit to PAAD and WG on law revision.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Recommendations of the MTE advocated to the government, along with the actions to be undertaken to utilize the most potential mechanisms of PA revenue generation; Reflected in the revised law relevant provisions on revenue generation including increased entrance fee tariff. Draft ?Joint decree? of MEGD and Finance Ministers on the official introduction of the new PA entrance fee tariff submitted to PAAD; Separate meetings held with MoF respective officers and heads of departments.
[Added: 2014/10/26]
NPC 2013/07 Completed
12. Recommendation: Establish, by end September 2013, a communications and advocacy plan to ensure Parliament approval for the revised PA and Buffer zone laws, including NGO support and an information workshop and possible field visits for Parliamentarians (and the Minister).
Management Response: [Added: 2014/10/26]

Develop communication and advocacy plan jointly with WWF. Organize workshop at one of the PA ensuring participation of high-level decision makers.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Communication and advocacy policy at PA site-level drafted jointly with WWF Field visit and site-level discussion organized at Uvs SPA involving officials from MoF, MoJ, MoUC, MEGD.
[Added: 2014/10/26]
NPC 2013/09 Completed
13. Recommendation: Establish across the PA system, by end 2013, those key revenue streams (entry fee revision, airport tax, land use fee and fee from use of natural resources) that can be achieved without legislative change but only require inter-agency agreements.
Management Response: [Added: 2014/10/26]

Submit to PAAD the recommendations and Action plan to utilize possible key revenue streams Assist PAAD to draft joint Ministerial agreements

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Recommendations of the MTE advocated to the government, along with the actions to be undertaken to utilize the most potential mechanisms of PA revenue generation; submitted to PAAD
[Added: 2014/10/26] [Last Updated: 2018/11/05]
NPC 2013/10 Completed History
14. Recommendation: Further strengthen PAAD through capacity building and development of a convincing proposal to the Minister based on MTE recommendations emphasizing the need for additional Finance (budgeting and Revenue generation) and M&E roles. Follow project plan to integrate 2 project staff (Financing and M&E) into PAAD, and for government to assume these posts by end of project.
Management Response: [Added: 2014/10/26]

Present reports and recommendations of international and national consultants on PA financing to newly appointed PAAD staff Assist PAAD to submit a reasonable budget for 2014 with substantial budget increase. Raise the issue of integration of 2 project staff into PAAD structure at PB meeting. Develop and submit proposal for the Minister based on the MTE and Economic valuation study results and recommendations.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Reports and recommendations are handed over to PAAD staff and other staff at MEGD Assisted PAAD in the reasonable budget planning for 2014 by integrating compiled data from the newly introduced accounting system supported by the project The issue is raised at 3d PB meeting in August, State Secretary stated that he will take all possible actions to integrate current 2 staff into PAAD structure Due to lack of appropriate candidates selection of IC delayed and thus the study has started late (October 2013), hence results are not ready yet.
[Added: 2014/10/26]
NPD, NPC 2013/10 Completed
15. Recommendation: Finalize integrated training curriculum and agree mechanism for delivery with universities and NGO partners, plus mechanism for certification with the Ministry of Education.
Management Response: [Added: 2014/10/26]

Jointly with other donors develop and submit to PAAD an Integrated Training programme for PAAD staff Agree with PAAD mechanism for delivery of the training and ensure certification.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Competency-based Integrated Training Programme is under development, will be submitted by end of December 2013 Reasonable amount of budget set into PAAD 2014 AWP
[Added: 2014/10/26]
NPC, NDP 2013/08 Completed
16. Recommendation: Review the objective level target for financing of the PA system. Disaggregate the increased financing available to PAAD, to separate out inflation, salaries, expansion of new PAs and show that real improvements are being made.
Management Response: [Added: 2014/10/26]

Conduct analysis on financing as recommended by MTE and define further actions jointly with PAAD

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Conducted analysis at certain extent jointly with PAAD and MoF; further actions included in draft AWP for both PAAD and SPAN
[Added: 2014/10/26]
NPC, PB 2013/10 Completed
Conducted analysis at certain extent jointly with PAAD and MoF; further actions included in draft AWP for both PAAD and SPAN
[Added: 2014/10/26]
NPC, PB 2013/10 Completed
17. Recommendation: Prepare and implement from end 2013 a ?SPAN sustainability and exit plan? for both national and demonstration site activities that will ensure adequate capacity of PAAD and the 2 PA Administrations to take on the new approaches developed by the end of the project. Include the nomination of focal points.
Management Response: [Added: 2014/10/26]

Develop draft SPAN sustainability and exit plan? as advised by MTE.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Development of exit plan is at very early stage
[Added: 2014/10/26]
NPC, NDP, PB 2013/12 Completed
18. Recommendation: Support PAAD to complete a comprehensive, strategic and costed 5 year plan for the whole PA system from 2014 as part of the new plan for the National Programme on Protected Areas. This should include a high level Vision and guidance for the development of co-management approaches and sustainable financing including new revenue sources ? to justify increased government funding. The Plan should include a prioritized list of urgent actions for additional investment (co-financing) by government in the remaining 2 years of the project.
Management Response: [Added: 2014/10/26]

Assist PAAD to have a 5 year plan as recommended by MTE

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Assisted PAAD to have a system level PA strategy; Conducted assessment of the National Programme on PA and recommendations for revision
[Added: 2014/10/26]
NPC, NDP 2014/03 Completed
19. Recommendation: Institutionalize the ?Annual PA Forum? to foster inter-agency engagement, innovation and adaptive management of the national PA system.
Management Response: [Added: 2014/10/26]

Organize PA Forum annually jointly with MEGD

Key Actions:

Key Action Responsible DueDate Status Comments Documents
2nd National Forum on PA held in November 1 with the topic: ?Monitoring and law enforcement in protected areas for improvement of management effectiveness?.
[Added: 2014/10/26]
NPD 2013/10 Completed
20. Recommendation: Alongside the PA Forum, establish a PA Partners Board to bring together key donors and delivery partners (UNDP/GEF, bi-laterals, NGOs) in an annual meeting to support strategic partnerships and integrated delivery of the National Programme for PAs, cost effective project synergies, planning and knowledge-sharing.
Management Response: [Added: 2014/10/26] [Last Updated: 2014/10/26]

Establish PA Partners Board and conduct meeting with members.

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Board hasn?t been established yet but the key partners and donors participates are brought together in the annual PA Forum; Key partners and donors are represented at PB, Advisory group and WG on Sustainable PA Financing
[Added: 2014/10/26]
NPD 2013/11 Completed

Latest Evaluations

Contact us

1 UN Plaza
DC1-20th Floor
New York, NY 10017
Tel. +1 646 781 4200
Fax. +1 646 781 4213
erc.support@undp.org