Republic of the Philippines - Engineering and Science Education Project

 ICRR 10280 Report Number : ICRR10280 ICR Review Operations Evaluation Department 1. Project Data : OEDID : OEDID: L3435 Project ID : P004591 Project Name : Engineering and Science Education Project Country : Republic of the Philippines Sector : Higher Education L/C Number : L3435 Partners involved : Japan Prepared by : Angela Ransom, OEDST Reviewed by : Linda Ankrah Dove Group Manager : Gregory Ingram Date Posted : 04/29/1999 2. Project Objectives, Financing, Costs and Components : Goals Support technological development for industrialization in the Philippines Improve the relevance, efficiency, and quality of science and engineering education Increase the supply of well-trained science and technology (S&T) manpower Objective Expand and adjust the enrollment structure of science and engineering education in priority fields at selected institutions to respond to S&T manpower needs Improve the relevance of science and engineering education curricula through the expansion of university/industry linkages Improve science and mathematics education at selected secondary schools Strengthened the Department of Education and Science's (DOST) capacity to plan, coordinate, manage, and monitor S&T manpower development programs Components (a) Improve institutional capacities for resource utilization, laboratory operation and maintenance, and income generation (b) Upgrade the quality of science and engineering education through improvements in faculty, laboratories, and libraries (c) Improve science and math education at selected secondary schools and the capacity of selected teacher training institutions to provide inservice teacher training in these subjects (d)Strengthen environmental education and introduce technology management programs (e) Strengthen DOST's capacity to plan, coordinate, manage, and monitor and evaluate S&T manpower development programs Finance Appraisal Estimate: Govt.: US$29.80M; Private Universities: 15.90M; IBRD: 85.00M Actual/Latests: Govt.: US$29.84M: Private Universities: 15.83M; IBRD 56.33M; Japan/OECF: 23.72M Costs Appraisal Estimate: Local: US$60.80M; Foreign: 70.10M; Total: 130.70M Actual/Latest: Local: US$45.67M; Foreign: 80.05M; Total: 125.72M 3. Achievement of Relevant Objectives : (a) The project's efficiency objectives for science and engineering education and research were largely achieved : Graduate enrollments have almost doubled in priority fields in the project -supported institutions. Undergraduate enrollments have increased in priority science and engineering fields and were within the target rate of overall increase in undergraduate enrollments . Staff/student ratios decreased from 1/11 in 1990 to 1/20 in 1997 in project-supported science education institutions. The issue of financing laboratory operation and maintenance was resolved by introducing laboratory tuition and user fees. (b) The project's institutional objectives were largely achieved : Science and Engineering Education and Research The number of faculty increased and the percentage with graduate degrees rose in line with appraisal targets . Teaching facilities were upgraded and modern laboratory equipment was supplied . Libraries at seven science and three engineering colleges were improved through the provision of reference books, journal subscriptions, computer systems and networks, and staff training in information technology as planned With the help of a program of research grants, the ICR concluded that the volume and quality of scientific research is increasing Secondary School Science and Math Science labs (physics, chemistry, and biology ) at 110 S&T-oriented secondary schools improved as planned through construction and rehabilitation of science blocks and labs and provision of equipment . At project closing these new or upgraded facilities were operational . An inservice training program was conducted for secondary school science and math teachers resulting in 1,077 diplomas and certificates versus 837 planned (35% over SAR target). Management of Technology (MOT) Graduate programs and short-term courses in technology management have been introduced as options in three flagship institutions as planned . Forty elective and seminar courses supported by case studies, reference materials, books, and journals have been developed. Fellowships for graduate-level training in MOT specializations have been awarded to five staff . S&T Manpower Planning and Monitoring DOST's MIS system was strengthened through the acquisition of computer equipment, staff training, and software development. MIS networks have been set up and data collection and encoding are underway . 4. Significant Achievements : (a) According to the ICR, there is indication of significant short -term institutional results: Measures to improve institutional efficiency and performance (rationalizing teaching loads and class sizes, improving facility utilization) are being implemented. Class size has increased; faculty /student ratios have decreased; laboratory user fees have been introduced to cover operation and maintenance costs . Average drop out rates for science and engineering education have declined Monitoring mechanisms for science and engineering programs have been set up --a graduate information system and a scholarship monitoring system among others . The ICR indicates a definite shift toward applied sciences, information technology, and environmental sciences as envisaged. Collaboration with employers, trade associations, and other professional bodies has been strengthened . Thirteen of the 19 project-supported engineering and science institutions have established links with industry; the remainder are in the process of setting up linkages . According to the ICR, preliminary results indicate a marked improvement in examination results for mathematics and sciences in the project -supported secondary schools . (b) Some qualitative results are expected : Scientific research is expected to expand through better linkages with industry and increased research funds . Access to scientific information for teaching and research is expected through the greater availability of reference materials, scientific journals, and access to the Internet . 5. Significant Shortcomings : (a) Some project relevance and external efficiency objectives had mixed outcomes : Although undergraduate enrollments in priority fields (biology, chemistry, physics, mathematics, earth science, and computer sciences) in the 10 project-supported science colleges have more than doubled, there has been no discernable shift in the proportion of enrollments toward the newer disciplines of earth sciences and computer science. The length of time to finish Masters and Doctoral programs in science and engineering remain higher than required although it has declined by one year for Masters programs . Teacher/student ratios in secondary school science and math remain lower than planned . (b)Private sector participation/development objectives were only partially met : Participation of employers in developing, delivering, and financing S&T education and research remains insufficient (although participation of private universities in project finance was substantial ). (c) Weaknesses in project design and management undermined the achievement of project objectives : Inadequate budgetary allocations for the first two years of the project, which caused a one -year delay in  project completion, called into question the Government's commitment and the quality of project preparation and design. Accounting and financial management received inadequate attention during project implementation . The MIS was only fully installed just before project completion . Due to the delay, DOST was not able to use the MIS as a planning and monitoring tool during project implementation . The medium term results expected and long -term impact indicators were not built into project design . 6. Ratings : ICR OED Review Reason for Disagreement /Comments Outcome : Satisfactory Satisfactory Institutional Dev .: Substantial Substantial Sustainability : Likely Likely Bank Performance : Satisfactory Satisfactory Borrower Perf .: Satisfactory Satisfactory Quality of ICR : Satisfactory 7. Lessons of Broad Applicability : ICR The role of the private sector in S&T development needs to be promoted and expanded in any future Bank-assisted operation Accounting and financial management require more attention during project implementation . The Resident Mission should play a larger role in supporting this area, in addition to procurement, disbursement, and contract administration. The project focussed on inputs and processes . This made it difficult to assess the project's impact on the actual quality of science and engineering education and the management and utilizaiton of limited sector resources. A separate impact evaluation and graduate tracer studies would provide useful additional information. OED In future at appraisal, project performance indicators should include short -term output indicators, the medium term results/outcomes expected, as well as long -term impact. In general more attentions should be paid to designing appropriate M&E systems during project preparation . 8. Audit Recommended? Yes No 9. Comments on Quality of ICR : The ICR for the most part used only SAR performance targets to assess achievement of project objectives . The borrower's contribution to the ICR contained more analysis of outcomes -oriented performance indicators such as dropout rates, number of years taken to complete Masters and Doctoral programs, and institutional linkages with the industrial sector . The ICR did not contain a summary of project costs by category of expenditure . The ICR did not contain a project operational plan to describe Government's strategy for project management following completion. There was no mention of carrying successful institutional strengthening measures to national scale (for example improvement of secondary school science and math facilities and instruction ).