PELMATP Mid Term Review

Report Cover Image
Evaluation Plan:
2005-2011, Philippines
Evaluation Type:
Project
Planned End Date:
11/2008
Completion Date:
02/2009
Status:
Completed
Management Response:
Yes
Evaluation Budget(US $):
5,000

Share

Document Type Language Size Status Downloads
Download document Terms of Reference.pdf tor English 1085.07 KB Posted 855
Download document PELMATP_MTR_Evaluation_Report_v4PMO10Mar09_Cleaned.pdf report English 904.79 KB Posted 2527
Title PELMATP Mid Term Review
Atlas Project Number:
Evaluation Plan: 2005-2011, Philippines
Evaluation Type: Project
Status: Completed
Completion Date: 02/2009
Planned End Date: 11/2008
Management Response: Yes
Corporate Outcome and Output (UNDP Strategic Plan 2014-2017)
Evaluation Budget(US $): 5,000
Source of Funding: GEF
Joint Programme: No
Joint Evaluation: No
Evaluation Team members:
Name Title Email Nationality
Mr. Jan van den Akker Team Leader
GEF Evaluation: Yes
Evaluation Type:
Focal Area:
Project Type:
GEF Phase: GEF-null
PIMS Number:
Key Stakeholders:
Countries: PHILIPPINES
Lessons
Findings
Recommendations
1 1. Some posts in the Project Management Office or PMO (such as the policy and environmental management task specialist or the IT specialist) are difficult to fill; high turnover rates in project personnel
2 2. Monitoring and evaluation: this is more measuring direct impacts, but also indirect impacts. Up to now the methodology used for measuring direct impacts, let alone impacts, is not clear
3 3. Sustainability
4 3: Components
5 5: Replicability
1. Recommendation: 1. Some posts in the Project Management Office or PMO (such as the policy and environmental management task specialist or the IT specialist) are difficult to fill; high turnover rates in project personnel
Management Response: [Added: 2010/05/24]

1.1 Look critically at salary offered to staff and fees to consultants

Key Actions:

Key Action Responsible DueDate Status Comments Documents
1.1 Look critically at salary offered to staff and fees to consultants
[Added: 2010/05/24]
2010/05 Completed This has already been done but the PMO is constrained to giving much higher salaries than what are stipulated in the ProDoc. In fact, the salary for the IT specialist has already been adjusted and yet there were no takers.
1.2 Some flexibility can be shown in contracting; it may be easier to find a qualified person on a part-time basis as a 'consultant' rather than asking a senior person to give up a job for a temporary 2-3 year position with PELMATP
[Added: 2010/05/24]
2010/05 Completed 1) For the development of the LATL database, a task that was supposedly by the IT Specialist, a subocntractor under an SSA was commissioned to the work on it from 27 May 2009 to 31 December 2009; 2) In June 2009 and August 2009, junior staff (Science Research Specialist or SRS) were hired to fill-up the vacant positions for Policy and Environmental Management and Capacity Building and Financing, respectively (vacated 16 February 2007 and 30 May 2009); 3) Other knowledge management materials (under Component 3 or IEC) were similarly contracted out: brochures/poster designs (29 October to 31 December 2009); coffeetable book (2 March 2010 to 31 May 2010), and 10-minute video clip (4 March 2010 to 31 May 2010. These were resorted to following the MTR recommendations.
1.3 Hire a more junior person (lower job requirements and hire specialized consultants for the more advanced tasks
[Added: 2010/05/24]
2010/05 Completed 1) For the development of the LATL database, a task that was supposedly by the IT Specialist, a subocntractor under an SSA was commissioned to the work on it from 27 May 2009 to 31 December 2009; 2) In June 2009 and August 2009, junior staff (Science Research Specialist or SRS) were hired to fill-up the vacant positions for Policy and Environmental Management and Capacity Building and Financing, respectively (vacated 16 February 2007 and 30 May 2009); 3) Other knowledge management materials (under Component 3 or IEC) were similarly contracted out: brochures/poster designs (29 October to 31 December 2009); coffeetable book (2 March 2010 to 31 May 2010), and 10-minute video clip (4 March 2010 to 31 May 2010. These were resorted to following the MTR recommendations.
2. Recommendation: 2. Monitoring and evaluation: this is more measuring direct impacts, but also indirect impacts. Up to now the methodology used for measuring direct impacts, let alone impacts, is not clear
Management Response: [Added: 2010/05/24]

2.1 The international Technical advisor (ISTA), Mr. Shahab Qureshi, of the Vietnam Efficient Lighting Project (VEEPL) is developing a M&E framework for that project. He could provide input into PELMATP's impact monitoring as well

Key Actions:

Key Action Responsible DueDate Status Comments Documents
2.1 The international Technical advisor (ISTA), Mr. Shahab Qureshi, of the Vietnam Efficient Lighting Project (VEEPL) is developing a M&E framework for that project. He could provide input into PELMATP's impact monitoring as well
[Added: 2010/05/24]
PMO; IIEE 2010/07 Overdue-Initiated Attempts were made to contact Mr. Qureshi, to no avail. The PMO subsequently worked with IIEE to gather the necessary pieces of information, including project impacts.
2.2 Consultants should be hired to review and quantify progress and impact indicators (logframe), right now and again at the end of the project.
[Added: 2010/05/24]
PMO; IIEE 2010/06 Overdue-Initiated PMO tapped the services of IIEE to conduct the survey on the impact of the project in R, C, and I as well as institutional sectors
3. Recommendation: 3. Sustainability
Management Response: [Added: 2010/05/24]

3.1 An exit strategy needs to be formulated for the continuation of activities after the end of 2009 (when PELMATP will end)

Key Actions:

Key Action Responsible DueDate Status Comments Documents
3.1 An exit strategy needs to be formulated for the continuation of activities after the end of 2009 (when PELMATP will end), - who of the government and private stakeholders will do what in EEL promotion and implementation (an organizationl assessment and development study is recommended)
[Added: 2010/05/24]
PMO, LATL, EECD, CWPO, EPIMB, ITMS, EPPB 2010/12 Overdue-Initiated The PMO drafted the exit plan as early as 2007. The draft which included the sustainability plan was presented in January 18, 2009 during the DOE-partners meeting. The same exercise was again made on May 28, 2009 during the mid-year Partners Meeting. Final sustainability plan was submitted to DOE concerned units (LATL, EECD, CWPO, EPIMB, ITMS, EPPB, among others) on 17 Jun 2009. At the same time, DOE entities which are likely and logically to take on the activities presently under PELMATP's various components have been aggressively involved since year 1 of the project (LATL, EECD, CWPO, ITMS). Database maintenance shall be by LATL; website shall be under ITMS, among others. On the Philippine Energy Efficiency Project (PEEP) which is supported by the ADB, it actually builds upon and scales up the successes of and addresses the gaps identified by PELMATP.
- Integration of PELMATP within DOE
[Added: 2010/05/24]
PMO, LATL, EECD, CWPO, EPIMB, ITMS, EPPB 2010/12 Overdue-Initiated The PMO drafted the exit plan as early as 2007. The draft which included the sustainability plan was presented in January 18, 2009 during the DOE-partners meeting. The same exercise was again made on May 28, 2009 during the mid-year Partners Meeting. Final sustainability plan was submitted to DOE concerned units (LATL, EECD, CWPO, EPIMB, ITMS, EPPB, among others) on 17 Jun 2009. At the same time, DOE entities which are likely and logically to take on the activities presently under PELMATP's various components have been aggressively involved since year 1 of the project (LATL, EECD, CWPO, ITMS). Database maintenance shall be by LATL; website shall be under ITMS, among others. On the Philippine Energy Efficiency Project (PEEP) which is supported by the ADB, it actually builds upon and scales up the successes of and addresses the gaps identified by PELMATP.
- Database and website maintenance
[Added: 2010/05/24]
PMO, LATL, EECD, CWPO, EPIMB, ITMS, EPPB 2010/12 Overdue-Initiated The PMO drafted the exit plan as early as 2007. The draft which included the sustainability plan was presented in January 18, 2009 during the DOE-partners meeting. The same exercise was again made on May 28, 2009 during the mid-year Partners Meeting. Final sustainability plan was submitted to DOE concerned units (LATL, EECD, CWPO, EPIMB, ITMS, EPPB, among others) on 17 Jun 2009. At the same time, DOE entities which are likely and logically to take on the activities presently under PELMATP's various components have been aggressively involved since year 1 of the project (LATL, EECD, CWPO, ITMS). Database maintenance shall be by LATL; website shall be under ITMS, among others. On the Philippine Energy Efficiency Project (PEEP) which is supported by the ADB, it actually builds upon and scales up the successes of and addresses the gaps identified by PELMATP.
- Linking of current activities with future activities, such as the ADB-supported energy efficiency project
[Added: 2010/05/24]
PMO, LATL, EECD, CWPO, EPIMB, ITMS, EPPB 2010/12 Overdue-Initiated The PMO drafted the exit plan as early as 2007. The draft which included the sustainability plan was presented in January 18, 2009 during the DOE-partners meeting. The same exercise was again made on May 28, 2009 during the mid-year Partners Meeting. Final sustainability plan was submitted to DOE concerned units (LATL, EECD, CWPO, EPIMB, ITMS, EPPB, among others) on 17 Jun 2009. At the same time, DOE entities which are likely and logically to take on the activities presently under PELMATP's various components have been aggressively involved since year 1 of the project (LATL, EECD, CWPO, ITMS). Database maintenance shall be by LATL; website shall be under ITMS, among others. On the Philippine Energy Efficiency Project (PEEP) which is supported by the ADB, it actually builds upon and scales up the successes of and addresses the gaps identified by PELMATP.
- Updating of project materials (such as guidelines, manuals)
[Added: 2010/05/24]
PMO, LATL, EECD, CWPO, EPIMB, ITMS, EPPB 2010/12 Overdue-Initiated The PMO drafted the exit plan as early as 2007. The draft which included the sustainability plan was presented in January 18, 2009 during the DOE-partners meeting. The same exercise was again made on May 28, 2009 during the mid-year Partners Meeting. Final sustainability plan was submitted to DOE concerned units (LATL, EECD, CWPO, EPIMB, ITMS, EPPB, among others) on 17 Jun 2009. At the same time, DOE entities which are likely and logically to take on the activities presently under PELMATP's various components have been aggressively involved since year 1 of the project (LATL, EECD, CWPO, ITMS). Database maintenance shall be by LATL; website shall be under ITMS, among others. On the Philippine Energy Efficiency Project (PEEP) which is supported by the ADB, it actually builds upon and scales up the successes of and addresses the gaps identified by PELMATP.
4. Recommendation: 3: Components
Management Response: [Added: 2010/05/24]

Component 1 - Explore possibilities with DTI and Bureau of Investment (BOI) to give tax or other incentives to producers of certified EEL products

Key Actions:

Key Action Responsible DueDate Status Comments Documents
- Explore possibilities with DTI and Bureau of Investment (BOI) to give tax or other incentives to producers of certified EEL products
[Added: 2010/05/24]
DOE, DTI-BO 2010/12 Overdue-Initiated Through the PMO, DOE has succesfully lobbied the inclusion of energy efficient lighting systems (EELs) manufacturing as among those that can be given incentives in the 2009 Investment Priorites Plan of the BOI signed by the President and subsequently published on 13 May and 21 May 2009, respectively. Included in the 2009 Investments Priorities Plan (IPP). Energy efficiency, particularly energy efficient lighting, should be included in the IPP every year.
- Review testing procedures and lifetime test standards
[Added: 2010/05/24]
DOE-LATL; PICTS 2010/05 Completed The ongoing sub-contract activity by PICTS on R & D will address the testing procedures as well as the lifetime test standards and the number of test samples needed per model tested.
COMPONENT 2 - While the public building/office can indicate budget needs, not always the best for more EE appliances may be provided. PELMATP could follow-up guidelines of EE in public buildings (developed under component 1) are implemented in practice. Maybe PELMATP can facilitate fee rationalization by entities concerned to follow full cost recovery schemes and create revolving fund that could be directly used for maintenance and repair insted of reverting back to National Treasury through DBM
[Added: 2010/05/24]
DOE; PMO 2010/05 Completed The A0183 drafted under PELMATP signed by the President on 7June2007 mandated the use of EELs government building. Compliance, however, was not 100%. For one, while the existing T12s (linear lamps) were replaced with the slim tubes, the magnetic ballasts used were not replaced because of the cost involved. Recognizing that budget constraints hamper the full implementation of the AO by the government agencies/offices, under the PEEP, the top 42 offices will be retrofitted to EELs, including the replacement of the magnetic to electronic ballasts. In a related development, PMO worked with EECD such that the IRR of the Government Energy Management Program (GEMP) included savings due to the switch to the use of EELs by government buildings/office would qualify as and be contributory to the energy conservation opportunities (ECOs) that can be given incentives, i.e., reduced monthly energy by at least ten percent (10%).
COMPONENT 3 - A workplan should be drafted for the outreach activities of Component 3 detailing how to reach the various target groups (government officials, building owners, households, etc.) an to explore means of implementing using practical approaches and resourcefulness in view of limited funds
[Added: 2010/05/24]
DOE; PMO 2010/05 Completed PELMATP, aside from the regular IEC activities which are planned, has since year 1 of the project been working with various target markets (residential, commercial, industrial, institutional, others) to promote the project. Thus, expenses are maximized since the outreach activities are normally hosted by the said target audiences. In addition, the DOE partners are engaged in almost all activities by the project so that all other efficiency activities of the DOE are communicated across all sectors.
COMPONENT 4 - Try to address EEL and lighting activities in the wider context of EE, also as input in the upcoming ADB EE Project
[Added: 2010/05/24]
DOE; PMO 2010/05 Completed Component 4 basically talks about microfinancing (through consumer coops) EEL Leasing (by electric distributions) promotion of EPC (to commercial and industrial clients and FIs). In all, PELMATP initiated IEC activity across all 5 components, other EE topics (e.g., A/C, motors, boilers) are almost always included and EECD and CWPO are involved in order to drive across the seizing of the full potential of energy efficiency in an enterprise (or household) - of which lighting is only one component.
COMPONENT 5 - PELMATP could devote some funds to look into the issue of CFL collection at household level (e.g. rebate for CFL returned). The CFL reycling issue can be linked with warranty issue and be part of the CFL distribution scheme with consumer organizations and cooperatives
[Added: 2010/05/24]
DOE; PMO; LGUs; DENR 2010/05 Completed As far as PELMATP is concerned, the activities only include Policy Study on Lamp Waste Disposal/Management in the country (completed in year 2), and the helping in the implementation/installation of a lamp waste management firm in the country. Implementation of the proper disposal/management of lamp waste is by the local government units in compliance to the EMP policy on the disposal of hazardous waste. In all IEC activities of PELMATP, talks about the proper disposal/ management of lamp wastes are always an integral part of the activity catering to the various sectors. Among those implementing microfinancing of CFLs in cooperatives and bulk procurement in big commercial and industrial facilities, the recovery of lamp waste after end-of-life was encouraged by the project. Under the PEEP, procurement of total lamp waste disposal/management facility is one of the activites as well as the implementation of the collection system - identified by PELMATP as among those needing follow through.
COMPONENT 5 - Awareness to dispose properly with the help of the LGU and the barangay level at designated disposal areas.
[Added: 2010/05/24]
2010/05 Completed
- Incorporate in eco-labeling. The awareness on hazards if spent EEL lamps are not properly disposed.
[Added: 2010/05/24]
2010/05 Overdue-Initiated Ecolabeling standards include a criteria on the quantity of mercury. As regards management disposal of mercury-containing lamp wastes, the PMO came-out with a new set of IEC materials (i.e., brochure and poster) to increase the level of awareness of consumers on the proper disposal of lamp wastes.
5. Recommendation: 5: Replicability
Management Response: [Added: 2010/05/24]

Assess impact of schemes with consumer organizations and cooperatives/ utilities as well as EEL activities in buildings as part of the monitoring and evaluation and feed results and lessons learned into the ADB supported Energy Efficiency Project

Key Actions:

Key Action Responsible DueDate Status Comments Documents
Assess impact of schemes with consumer organizations and cooperatives/ utilities as well as EEL activities in buildings as part of the monitoring and evaluation and feed results and lessons learned into the ADB supported Energy Efficiency Project
[Added: 2010/05/24]
DOE, PMO 2010/12 Overdue-Initiated The project continuously documents success stories and lessons learned and these are disseminated in the various fora. This supplements and reinforces the structural reforms that have been instituted by the project which include the AO 183, new PNS including MEPS, lamp warranty etc, updating of the new Guidelines on Energy Conserving Design of Buildings, Manual of Practice on Efficient Lighting, and Roadway Lighting Guidelines. PEEP is building upon the short wins/ successes as well as the gaps identified by PELMATP and will actually scale up and expand what have been started under PELMATP.

Latest Evaluations

Contact us

1 UN Plaza
DC1-20th Floor
New York, NY 10017
Tel. +1 646 781 4200
Fax. +1 646 781 4213
erc.support@undp.org