Mexico - Science and Technology Infrastructure Project

Document of The World Bank FOR OFFICIAL USE ONLY Report No: 18763 IMPLEMENTATION COMPLETION REPORT MEXICO SCIENCE AND TECHNOLOGY INFRASTRUCTURE PROJECT (LOAN 3475-ME) December 30, 1998 Finance, Infrastructure and Private Sector Management Unit Mexico Country Management Unit Latin America and the Caribbean Regional Office This document has a restricted distribution and may be used by recipients only in the performance of their official duties. Its contents may not otherwise be disclosed without World Bank authorization.  (Exchange Rate Effective October 1, 1998) Currency Unit = Mex$ Mex$10.16= US$1 FISCAL YEAR July I - June 30 ABBREVIATIONS AND ACRONYMS CAS Country Assistance Strategy CCC President's Science Advisory Council - Consejo Consultivo de Ciencias CENAM National Center for Metrology - Centro Nacional de Metrologia CONACYT National Science and Technology Council - Consejo Nacional de Ciencia y Tecnologia DGN Director General of Standards - Direcci6n General de Normas FY Fiscal Year GDP Gross Domestic Product GFCYT Federal Expenditure on Science and Technology - Gasto Federal en Ciencia y Tecnologia GOM Government of Mexico IACyT Scientific and Technologic Activity Indicators 1996 - Indicadores de Actividades Cientificasy Tecnol6gicas 1996, Mexico, CONACYT, 1997 IBRD Intemational Bank for Reconstruction and Development ICR Implementation Completion Report IADB Inter-American Development Bank IMPI Mexican Institute for Industrial Property - Instituto Mexicano de la Propiedad Industrial INEGI National Institute of Statistics, Geography, and Informatics - Instituto Nacional de Estadistica, Geografia e Informatica IPR Intellectual Property Rights ISI Institute for Scientific Information KIP Knowledge and Innovation Project - Proyecto de Conocimiento e Innovaci6n MSTQ Metrology, Standards, Testing and Quality NAFIN Nacional Financiera, S.N.C. NAFTA North American Free Trade Agreement NIST National Institute of Standards and Technology NPSTM National Plan for Science and Technology Modernization (of Mexico) NSF National Science Foundation OECD Organization for Economic Cooperation and Development PACIME Support Program for Science in Mexico - Programa de Apoyo a la Ciencia en Me'xico R&D Research and Development SAR Staff Appraisal Report S&T Science and Technology SECOFI Ministry of Commerce and Industrial Development - Secretaria de Comercio y Fomento Industrial SECODAM Ministry of the Comptroller General SEP Ministry of Education - Secretaria de Educacion Puiblica SHCP Ministry of Finance and Public Credit - Secretaria de Hacienda y Credito Publico SNI National System of Researchers - Sistema Nacional de Investigadores STIP Science and Technology Infrastructure Project WIPO World Intellectual Property Organization Vice President: Shahid Javed Burki Country Management Unit Director: Olivier Lafourcade Sector Management Unit Director: Danny M. Leipziger Task Team Leader: Daniel Crisafulli  FOR OFFICIAL USE ONLY CONENTS PREFACE ..........V EVALUATION SUMMARY ................... vi PART I: PROJECT IMPLEMENTATION ASSESSMENT .............................................................1 I A. PROJECT OBJECTIVES AND DESCRIPTION ...................... ....................................... I B. ACHIEVEMENT OF PROJECT OBJECTIVES ..................... ........................................ 2 C. IMPLEMENTATION RECORD AND MAJOR FACTORS AFFECTING THE PROJECT ............ ..............7 D. PROJECT SUSTAINABILITY ............................................................. 9 E. BANK PERFORMANCE ............................................................. 10 F. BORROWER PERFORMANCE ............................................................. 11 G. ASSESSMENT OF OUTCOME ............................................................. 11 H. FUTURE OPERATION ..............................................................11 I. KEY LESSONS LEARNED ............................................................. 12 PART II: STATISTICAL TABLES ............................................................. 14 TABLE 1: SUMMARY OF ASSESSMENTS ............................................................. 14 TABLE 2: RELATED BANK LOANS ............................................................. 15 TABLE 3: PROJECT TIMETABLE ............................................................. 16 TABLE 4: LOAN DISBURSEMENTS: CUMULATIVE ESTIMATED AND ACTUAL ............. ................ 16 TABLE 5: KEY INDICATORS FOR PROJECT IMPLEMENTATION ...................................................... 1 7 TABLE 6: KEY INTDICATORS FOR PROJECT OPERATION ............................................................. 1 7 TABLE 7: STUDIES INCLUDED IN PROJECT ............................................................. 1 8 TABLE 8A: PROJECT COSTS ............................................................. 19 TABLE 8B: PROJECT FINANCING ............................................................. 20 TABLE 9: FINANCIAL AND ECONOMIC COSTS AND BENEFITS ....................................................... 21 TABLE 10: STATUS OF LEGAL COVENANTS ............................................................. 21 TABLE 1 1: COMPLIANCE WITH OPERATIONAL MANUAL STATEMENTS ................... .................... 22 TABLE 12: BANK RESOURCES: STAFF INPUTS ............................................................. 22 TABLE 13: BANK RESOURCES: MISSIONS .................................. 23 Annex 1: ICR Mission Aide Memoire ................................... 24 Annex 2: Operation Plan for the Project ................................... 27 Annex 3: Borrower's Contribution to the ICR ................................... 33 This document has a restricted distribution and may be used by recipients only in the performance of their official duties. Its contents may not, otherwise be disclosed without World Bank authorization.   IMPLEMENTATION COMPLETION REPORT MEXICO SCIENCE AND TECHNOLOGY INRASTRUCTURE PROJECT (LOAN 3475-ME) PREFACE This is the Implementation Completion Report (ICR) for the Mexico Science and Technology Infrastructure Project, for which Loan 3475-ME in the amount of $189 million was approved on May 26, 1992, and made effective on 15 October, 1992. The loan was closed on June 30, 1998. A final supplemental disbursement of US$1487.00 took place on September 3, 1998. The ICR was prepared by Daniel Crisafulli, Task Manager, Private Sector Development Department and John Daly, Science and Technology Policy Specialist. The report was reviewed by Fernando Montes-Negret, Sector Leader of Finance, Private Sector Development and Infrastructure Department and Maria Victoria Lister, Quality Assurance Officer, Latin America and the Caribbean Region. The Borrower provided inputs to the ICR that are reflected in Part I and II of the ICR as well as in Annex 3. The Government, Borrower and Beneficiaries contributed to the preparation of the ICR by exchanging views on all parts and phases of the Project including policy aspects, preparation, procurement, implementation experience and related issues and by preparing its own contribution to this ICR. v  MEXCO SCIENCE AND TECHNOLOGY INFRASTRUCTURE PROJECT (LOAN 3475-ME) Evaluation Summary Introduction 1. The project was conceived during the implementation of the broad program of structural adjustment undertaken by Mexico during 1986-1991 with support from the Bank. As Mexico emerged from a period of high inflation and macroeconomic instability, it became clear that strengthening of the basic science and technology infrastructure of the country would prove critical in meeting the challenges posed by the newly opening economy. Negotiated in the same year as the North American Free Trade Agreement (NAFTA), the project aimed to improve the competitiveness of Mexican firms and attract foreign investment while embarking on a program of long term institutional development. Project Objectives 2. The objectives of the project were to: * Rationalize public sector funding (for science and technology) by supporting increased public spending for: (i) grants for basic scientific research projects and equipment infrastructure projects, with improved allocation on a competitive basis to generate relevant research and train scientists; and (ii) technology infrastructure in the area of metrology, standards and quality assurance, and intellectual property protection to improve services to industry, thereby encouraging modernization and enhancing competitiveness, and increasing attractiveness for foreign investment. * Develop institutions through (i) supporting the restructuring of a science research program, and (ii) development of institutions providing support to industry in metrology, standards and quality assurance, and intellectual property protection to improve the efficiency of public support in these areas. Implementation Experience and Results 3. Overall, substantial progress was made toward meeting these objectives. In the areas of institutional development (all components) and increased attractiveness to foreign investment (technology components), the project was largely successful in meeting the established goals. The impact of the project on the competitiveness and modernization of Mexican industry appears positive but is not yet fully realized. The project's impact on overall financing to science and technology activities, however, is ambiguous as a result of the financial crisis of 1994-1995. 4. The Mexican financial crisis of 1994-1995 strongly impacted the availability of funds for project activities. In November 1995, the Government and Bank agreed to accelerate the disbursement of funds through retroactive financing of US$80 million for activities associated with vi  the project which were previously funded by the GOM. In spite of this reduction of funding, the project was largely successful in meeting basic goals. 5. The Scientific Research Component saw an increase in the number of Mexican scientific research publications and their impact, a significant production of research-trained personnel, a renewal of the Mexican research instrumentation infrastructure, the institutionalization of merit- based peer review, and improvements in the efficiency of the National Science and Technology Council (Consejo Nacional de Ciencia y Tecnologia - CONACYT). 6. The project supported the creation of the Mexican National Center for Metrology (Centro Nacional de Metrologia - CENAM). With 104 laboratories now operating, demand from industry for calibration service has far outstripped projections. CENAM appears to be helping to attract foreign investment and promoting the competitiveness of Mexican industry. 7. The project supported the creation of the Mexican Institute of Industrial Property (Instituto Mexicano de la Propiedad Industrial - IMPI), significantly reducing delays in award of patents, increasing enforcement activities, and increasing inspections related to intellectual property violations. Use of the system by Mexican firms and individuals has remained low, but this lack of use is arguably the result of underlying weaknesses in the system of institutions and firms involved in creation, diffusion, and application of industrially-useful knowledge in Mexico. 8. The standardization component was intended to support the Directorate General of Standards (Direcci6n General de Normas - DGN) of the Ministry of Commerce and Industrial Promotion, but Govermment budgetary allocations were never made available for the component activities. Funds were either cancelled (US$1 million) or reallocated to the CONACYT component (US$2 million).' Despite the lack of disbursement under the loan, the DGN accomplished many of the objectives agreed during Appraisal. 9. Overall, the Bank performance in the implementation of the project is considered satisfactory. Implementation costs were held low, and the considerable capacity of the counterpart institutions was allowed to grow and be applied to the management of the project. Overall performance of the borrower was satisfactory. However, disbursement was subject to initial delays. The complexity of procurement and disbursement arrangements under the science research component were the single largest weakness in project design, resulting in excessive delays and burdensome procedures for beneficiaries and staff of CONACYT, NAFIN, and the Bank (para. 32). 10. Project sustainability is likely to be strong, given the advances in institutional development and likely future growth in demand for science and technology services in Mexico. The development objectives (growth with stability, social development, and modernization of the state) of Mexico's Country Assistance Strategy (CAS) imply increasing demand for creation and application of knowledge and technology, highly skilled scientific and technological human resources, technological infrastructure (including metrology, standards, quality control, intellectual property rights protection), and modernization of state institutions supporting science and technology. Conversely, reduced prospects for fuiture growth - or renewed macroeconomic and budgetary instability - could undermine 'US$500,000 in studies under the component were supported under the Mexico Industrial Restructuring Loan (3047-ME). vii  institutional and other gains. The executing agencies have progressed rapidly under the proj ect, but remain highly vulnerable to changes in their operating environment (particularly to funding levels and staffing changes). Summary of Findings, Future Operation, and Key Lessons Learned 11. The project was largely successful in meeting the stated objectives of building a basic institutional infrastructure in support of long-term scientific and technological development. This success is particularly striking in light of the macroeconomic instability experienced during implementation. Although this support for creating a supply of basic S&T infrastructure may be considered appropriate given the chronic underinvestment during the 1980s, the project should have incorporated measures to promote articulation of demand for S&T services and for linkage of research to societal needs. Given the challenges facing Mexican firms during a period of rapid trade liberalization, the project clearly should have aimed for a much more direct and immediate impact on firm-level technological capabilities. A second failure in project design was the lack of incentives to link research with teaching, thus potentially reducing the impact of research on the formation of skilled human resources. 12. The project enhanced the stability of scientific funding during the crisis of 1994-95, when as so often happened in the past, research funding was threatened by fiscal cutbacks. The project helped to sustain development of an R&D capacity in Mexico which would be hard to replace and will likely prove increasingly important to future development. 13. The Government requested a follow-on operation to support a second generation of reforms to science and technology (S&T) policy. The Knowledge and Innovation Project (KIP), approved on June 16, 1998, is designed to enhance the effectiveness of research support programs while increasing linkages to user groups in society and industry. In addition, the KIP supports a restructuring of CONACYT's programs to promote university-industry linkage and industrial technology development. In parallel, SECOFI has initiated a series of studies to assess strategic options in competitiveness policy with support of a Japanese grant. 14. The project lessons include: (i) institutionalization of a competitive mechanism for allocation of research funds in a developing country can be feasible and beneficial, particularly with close participation of scientific community in the planning and review process; (ii) a well-designed system for support of science incorporates incentives for scientific excellence and national developmental needs in an open, competitive, and transparent manner. Especially desirable is some mechanism to strengthen fields of science and technology that are significantly weaker than appropriate to national developmental needs while maintaining incentives for excellence; (iii) development of "one-stop shopping" mechanisms, which aim to reduce the expenditure of time and effort of researchers in obtaining resources, is a difficult process requiring a high degree of commitment by implementing agencies over the medium-term; (iv) development of human resources for science and technology is perhaps the most important output of this project, and this output could have been strengthened by more viii  explicit incorporation of incentives for training of Masters and Doctoral students in research grants. In addition, systems to support scientific research should include a mechanism to ensure participation of highly-qualified young researchers in funding programs; (v) in tandem with the creation of a world-class metrology capability, policies to stimulate private sector demand for services and formation of a private secondary metrology network are critical to achieving significant medium-term impact on competitiveness of local industry; (vi) similarly, creation of a world-class intellectual property rights (IPR) agency is a necessary but not sufficient condition for productive application of IPR for development. In tandem with institutional strengthening, a systemic approach is needed to address weaknesses in the judicial system and broader issues in the creation, diffusion and application of technical knowledge in the country; (vii) the project also confirms the truism that continuity in staffing at the managerial and technical level is critical in assuring the successful creation or restructuring of an executing agency. The high degree of stability in each executing agency across a change in administration helped ensure rapid and sustained institutional development. ix  IMPLEMENTATION COMPLETION REPORT MEXICO SCIENCE AND TECHNOLOGY INFRASTRUCTURE PROJECT (LOAN 3475-ME) Part I: Project Implementation Assessment A. Statement/Evaluation of Objectives 1. The objectives of the project were to: * Rationalize public sector funding (for science and technology) by supporting increased public spending for: (i) grants for scientific research projects and equipment infrastructure projects, with improved allocation on a competitive basis to generate relevant research and train scientists; and (ii) technology infrastructure in the area of metrology, standards and quality assurance, and intellectual property protection to improve services to industry, thereby encouraging modernization and enhancing competitiveness, and increasing attractiveness for foreign investment. * Develop institutions through (i) supporting the restructuring of a science research program, and (ii) development of institutions providing support to industry in metrology, standards and quality assurance, and intellectual property protection to improve the efficiency of public support in these areas. 2. Given the broad program of structural reforms implemented by the Mexican Government during 1986-1992, including rapid trade liberalization, privatization, and deregulation of industry', the project's aim to strengthen the basic infrastructure for scientific and technological development was well-directed and timely. The growing openness of the Mexican economy required greater investment in scientific and technological systems to boost long-term competitiveness of enterprises. 3. The project supported the Government's National Program for Science and Technology Modernization 1990-94 (NPSTM), which set the goal of increasing total public and private expenditure for S&T from 0.32 percent of GDP in 1991 to 1.0 percent in 1994 and 2.0 percent in 2000 (Staff Appraisal Report - SAR, p. 5). In light of evidence from leading industrial countries, the Government's goal was perhaps overly ambitious even in the absence of the financial crisis of 1994-1995.2 4. At least one half of the total in 2000 was to be provided by the private sector; however, neither the NPSTM nor the project supported explicit measures to incentivize private spending in the sector. Although support for creating a supply of basic S&T infrastructure was appropriate given the chronic underinvestment during the 1980s, the project should have incorporated I Mexico Country Economic Memorandum - Fostering Private Sector Development in the 1990s. Report No. 11823-ME. 2 1993 public support for research and development in advanced economies ranged from 0.5 to 0.6 percent of GDP in Japan and Italy, to 0.9 to 1.1 percent of GDP in France, the United Kingdom and the United States. Key determining factors included military R&D spending, Government strategy, and per capita income.  measures to promote articulation of demand for S&T services and for linkage of research to societal needs. Given the challenges facing Mexican firms during a period of rapid trade liberalization, the project clearly should have aimed for a much more direct and immediate impact on firm technological capabilities. A second failure in project design was the lack of incentives to link research with teaching, thus potentially reducing the impact of research on the formation of skilled human resources. 5. The project was negatively impacted by the financial crisis of 1994-1995. In early 1995, during the period of severe financial turmoil following the devaluation of the peso, the Government requested a restructuring of the entire portfolio of Bank-financed projects under supervision. A letter of amendment was signed November 17, 1995 to accelerate the disbursement of funds under the Loan. The Bank agreed to accept retroactive financing of US$80 million for activities associated with the Project (research scholarships, chairs of excellence and repatriation grants) originally funded by the Government. The rationale for this restructuring was to provide additional liquidity support to the Mexican Government at the time of the financial crisis. Although the decrease in support to Project activities which resulted from the financial crisis is unfortunate, the Bank and Government acted appropriately in response to the financial stress experienced at the time. B. Achievement of Project Objectives 6. The project achieved a substantial positive impact toward meeting the stated objectives at Appraisal. In the area of rationalization of public sector funding, substantial progress was made toward creation of the competitive review mechanism for science research projects and in creating a basic infrastructure in the areas of metrology and intellectual property protection. Regarding the goal of increased attractiveness to foreign investment (technology components), the project was largely successful in meeting the established goals. The impact of the project on the competitiveness and modernization of Mexican industry is positive but not yet fully realized. Finally, the project's impact on overall financing to science and technology activities is ambiguous as a result of the financial crisis of 1994-1995. 7. As is customary in science and technology projects, net present value, economic rates of return and financial rates of return were not included in the Staff Appraisal Report for this project, and it is not possible now to estimate the value of project benefits. While inefficiencies in the procurement system reduced the positive effect of the project (para. 32), available evidence suggests that the project did represent a low cost solution to the problems of increasing human and material resources for science and technology. Science and Technology Research Component 8. The science research component supported the creation of PACIME (Programa de Apoyo a la Ciencia en Mexico - Program to Support Science in Mexico) under the administration of CONACYT. This component was successful in achieving the goals of supporting high-quality research and human resource formation while building sustainable institutions. Several external evaluations by international and Mexican experts have agreed that this basic goal has been met.3 3 Aron Kuppernann, Evaluation of PA CIME, April 1997; Dan Newlon, Evaluation ofPA CIME, February 1997; Carlos Elizondo Mayer-Serra, PACIME: Algunos Criterios de Evaluaci6n, 1997; and J. M. 2  9. Rationalization of Public Sector Funding. The project aimed to increase the creation of scientific knowledge and formation of trained scientists. The number of publications by Mexican authors in the ISI data base rose from 1,869 in 1991 to 2,619 in 19954 and 2,974 in 19965. This 59 percent increase in five years is a significant indicator of project success. Articles by Mexican researchers in the natural sciences and engineering increased from 0.23 percent of the ISI data base in 1992 to 0.32 percent in 19956, supporting the conclusion that Mexican scientific production increased during the project. The average number of citations per paper for Mexican papers was 1.91 in 1992-96, slightly improved from the 1980's, but was still far lower than the three to five citations per paper found in advanced developed nations.' 10. Public funding of science and technology (Gasto Federal en Ciencia y Tecnologia, GFCYT) was 0.45 percent of Gross Domestic Product (GDP) in 1981, but fell to a low of 0.25 percent of GDP by 1988 and 1989. The project was conceptualized when GFCYT was recuperating. The percentage of GDP devoted to Federal expenditure on science and technology increased to 0.41 by 1994, but with the budget pressures of the succeeding years again dropped to 0.35 percent in 1995 and 1996 returning to 0.41 percent in 1997. Thus, in spite of the setback of the 1994-95 crisis, the project has been accompanied by increasing public funding for science and technology. However, 1997 GFCYT had not reached the level of 1981, and the original arguably unrealistic targets set by the Government of Mexico were not met. Despite this shortfall, the project may have forestalled an even more dramatic reduction of public support for science and technology under the budgetary pressures of 1995-96. 11. The NPSTM targeted an increase of the number of Mexican researchers in the National System of Researchers (Sistema Nacional de Investigadores - SNI) from 6,442 in 1991 to 19,300 in the year 2000 (SAR, page 36). The number of enrolled researchers was 5,969 in 1996 (IACyT, page 84) and 6,278 in mid 1998 (Project Implementation Plan, Knowledge and Innovation Project - KIP). However, the initial reduction in numbers of researchers appears to have been largely due to reduction of the numbers of SNI Candidates, confined primarily to the category of membership for engineers and technological researchers. Thus SNI shifted away from technological research toward increased support for basic researchers. Survey results indicate that well over 30,000 people were actively involved in research in Mexico in 1996. The 1,300 retention and repatriation grants made during the project, and the estimate of some 250 doctoral students graduating per year in Mexico (many with CONACYT financial assistance for their research) suggest that the project has made a substantial contribution to sustaining and increasing human resources for research in Mexico. 12. Institutional Development. The project has succeeded in institutionalizing a process of allocation of resources for research and research infrastructure in CONACYT through merit Rojo, PACIME Science Programme Report, April 1997 available in project file. Also see, Programa de Repatriaciones: 1991-96: Parte L Resultados, Anailisis e Impacto, SEP-CONACYT, November, 1997. 4Indicadores de Actividades Cientificas y Tecnol6gicas, 1996: Mexico, Table HI..15, CONACYT, 1996. 5Uribe E., Misael and Hector Delgado A., Producci6n Cientif ca Mexicana 1980-1996 por Areas del Conocimiento, Unidad de Apoyo para la Evaluacion de la Actividad Cientifica, CONACYT, undated. 6 Science and Engineering Indicators; 1998; Table 5-49, U.S. National Science Foundation, 1998. 7 "U.S. Share of World Papers Slides as Europe, Asia Rise", Science Watch, Vol. 8, No. 3, May-June 1997. 3  based competition judged by independent scientific review boards. This is a significant accomplishment. Perfecting peer review is by its nature an ongoing process. The KIP supports a second generation of reforms to the system. CONACYT also has established a science and technology indicator program for the first time, and the data is widely available through hard copy and Internet publication. This accomplishmnent is likely to help further rationalize management of science and technology in Mexico. 13. One objective of the project was to decrease fragmentation of CONACYT funding, both concentrating resources in the best projects and allowing integrated support for research projects (one stop shopping). The project did result in an initial increase in the size of research grants provided by CONACYT, but the average research grant size peaked in 1993 at US$62,000, dropped to US$35,000 by 1995, and returned to US$51,000 in 1997. Early progress in de- fragmentation was interrupted at the time of the economic crisis and change in administration. The infrastructure grants, which were the largest in the program, were reduced in number in 1994, and eliminated thereafter. Similarly, the numbers of projects per year strengthening postgraduate education was reduced greatly in 1994 and thereafter. Several new modalities of chairs of excellence grants were introduced, and the numbers of these grants increased in the latter years of the project, as did the individual research grants. A new category of grants for sabbaticals and postdoctorates was introduced and many such grants were made in 1996 and 1997. Overall, the program went from 1,306 grants in 1992 with a total value of US$32.1 million to 1,796 grants in 1997 with a value of US$65.8 million. Thus overall, the average value per grant rose faster than inflation, but was still less than US$37,000 in 1997. The KIP seeks to continue the effort to provide "one-stop shopping" for Mexican researchers. 14. During 1990-1995, CONACYT reduced staff by 21% while adding new responsibilities, making the agency considerably more staff efficient, but less efficient than was planned in the SAR. With 1150 staff positions in 1990, CONACYT reports 360 staff in the Joint Directorate for Scientific Research (DAIC) and a total staff of 843 in 1992. There was a modest increase in CONACYT staff in mid-project with the addition of two responsibilities: (i) administration of SNI, transferred from SEP; and (ii) coordination of the SEP-CONACYT system of science and technology institutes. Total staff is reported to be 912 in 1998. Prior to the 1992 reorganization, CONACYT had 162 management positions. The SAR reported that higher and mid level positions were reduced 54 percent in 1992, with 72 Directorships or Sub-directorships. Retrospective data show that there were 76 such positions in 1992. The number of management positions was increased to 172 in 1993, with the transfer of new responsibilities to CONACYT, and remains at that level today. Metrology Component 15. Industrial Competitiveness and Foreign Investment. The CENAM component did not include direct indicators of impact on either industrial competitiveness or attraction of inward foreign investment to Mexico. However, project output indicators and firm interviews indicate a positive impact on both areas. The calibration services provided by CENAM are indicative. The SAR projected that CENAM would calibrate 820 instruments during project implementation versus the actual figure of over 5700 during 1992-1997. Demand from industry for calibration service has far outstripped projections. In addition, CENAM's client list includes a large number of foreign-owned enterprises - an indication of perceived quality of CENAM services as well as the agency's role in helping to attract foreign investment. The high demand for CENAM's 4  relatively high-cost services, however, indicates the weakness of the system of secondary metrology facilities in Mexico (see para. 45 for further discussion). 16. Institutional Development. The component was highly successful in achieving goals of institutional development, especially in light of the budgetary reductions resulting from the financial crisis. Following initial delays in construction, CENAM management moved rapidly to establish a world-class facility with international recognition from peer organizations. CENAM was selected to preside over the Interamerican Metrology System during 1995-98, a position which involves coordination of five basic measures on a regional basis. 17. In spite of the initial construction delays, CENAM achieved most Appraisal estimates of investment and institutional development during the originally scheduled implementation period. By 1995, end of the implementation period projected in the SAR, CENAM had established 83 laboratories versus 31 as planned. Expenditure on equipment during 1992-95 was only slightly higher than Appraisal estimates (US$30.5 million versus US$26.6 million at Appraisal). This increased number of laboratories was achieved primarily through a review of metrological priorities and cost effectiveness of equipment purchases. 18. After the financial crisis of 1995, budgetary allocations for component activities were dramatically reduced (para. 5). Annual budgetary allocations, including Government and Bank funding, fell from a high of US$32.1 million in 1994 to US$13.72 million in 1996. As a result, loan disbursements were delayed. In October 1997, the Government requested the reallocation of remaining funds of US$3.8 million for retroactive financing of activities under the CONACYT component. 19. Nevertheless, total financing for the component, including Government contributions, reached US$111.9 million by 1997, versus US$62.6 million at Appraisal.8 US$11.8 million of the increased cost was due to construction cost overruns during 1993 and 1994 resulting from unforeseen redesign requirements for conversion of the facilities of a former horticultural research center. CENAM reports that the remaining US$37.5 million in increased cost resulted primarily from operational costs arising from the longer implementation period. Intellectual Property Component 20. Industrial Competitiveness and Foreign Investment. As in the case of the metrology component, the SAR did not include explicit impact indicators in this area. Nevertheless, institutional development indicators cited below, (e.g., reduced delays, improved enforcement) imply that the component has supported incremental progress toward the goal of industrial competitiveness. The overall system of intellectual property protection, however, continues to experience weaknesses in two areas: (i) enforcement and (ii) utilization by Mexican nationals.9 Interviews with private firms indicated continuing problems in enforcement of intellectual property rights due to inconsistent treatment by the judiciary. Increased training of judicial staff sCENAM project cost includes US$1.0 million provided under the Mexico Industrial Technology Loan (2747-ME) for building remodeling and physical contingencies. 9IMPI is responsible only for "industrial property", e.g., patents and trademarks. Other forms of IPR, including copyright and plant variety protection, are undertaken by other agencies. 5  and the creation of a specialized intellectual property court are measures which could improve enforcement activities. Use of the system by Mexican firms and individuals has remained low. Only 116 patents were awarded to Mexican entities in 1996 out of a total of 3,186 (3.6 percent). In 1992, by contrast, 9.1 percent of patents (out of 3,160) were awarded to Mexicans. 21. Factors which may explain this reduction include the tighter requirements for granting of IPR after legal reform in 1993, higher fees charged by IMPI, reciprocation agreements with the United States and European Union, and the financial crisis of 1994-1995. The optimal level of IPR protection accruing to Mexican firms is a complex issue, depending on the strength of local technology institutions and openness to imported technology arnong other factors, and will not be fully explored in this paper. 22. The low level of IPR use is also a result of weaknesses in the system for generation and diffusion of knowledge. Although selected Mexican universities and research institutes have developed world-class scientific capabilities, incentive systems and regulations too often impede collaboration with industry and utilization of IPR. 23. With respect to foreign investmnent, the component supported strengthening of intellectual property rights critical to the implementation of the North American Free Trade Agreement (NAFTA) in 1994. The high proportion of intellectual property protection provided to foreigners in Mexico (96.4% of patents in 1996) gives a clear indication to foreign investors that Mexico is committed to providing intellectual property protection. 24. Institutional development. IMPI has substantially met project objectives in terns of institutional development criteria. Created by decree in December 1993, IMPI reduced delays in award of patents from 6 years to 2.5-3.0 years by 1996, a performance level similar to worldwide best practice. Enforcement activities have increased in tandem, from 886 resolutions/opinions issued in 1994 to 1711 in 1997. Inspections related to intellectual property violations have also increased, from 947 in 1994 to 1504 in 1997. This progress is largely due to two factors: the improved quality of IMPI staff, through training and staffing renewal; and investment in information systems (e.g., digital scanners, networked databases) which radically simplified operations. Benefits of informatics use include eliminating the printing of over 23,000 document pages per month, with corresponding reductions in processing time and staffing and storage requirements. 25. The SAR indicators focused on project inputs rather than results. IMPI surpassed the sole operational indicator established at Appraisal. As estimated at Appraisal, IMPI's own income from services was expected to cover 2.5 times the agency's operational costs. Actual cost recovery averaged 3.2 times operating costs during implementation.'0 26. Overall cost of the component, at US$32.1 million, was less than the Appraisal estimate of US$40.6 million. Component investment in informatics was slightly greater than planned at Appraisal, due to rapid obsolescence of computer equipment. In addition, the agreement with the