EXECUTIVE BOARD 132nd session Provisional agenda item 13.2
EB132/30 9 November 2012
Evaluation: update and proposed workplan for 2013
INTRODUCTION 1. The Executive Board at its 131st session approved a formal evaluation policy for WHO.1 The policy states that evaluation is an essential function at WHO, carried out at all levels of the Organization. It ensures accountability and oversight for performance and results, and reinforces organizational learning in order to inform policy for decision-makers and support individual learning. 2. In line with the policy, WHO will develop a biennial, Organization-wide evaluation workplan as part of the Organization’s planning and budgeting cycle. The policy defines the role and responsibilities of the Board in this regard as being, inter alia, the provision of oversight of the evaluation function within the Organization, and specifically in relation to the workplan, to provide input on the items of specific interest to Member States and to approve the biennial Organization-wide evaluation plan. The workplans are to be submitted to the Board for approval through the Programme Budget and Administration Committee. 3. The purpose of this document is therefore to inform the Board on the Secretariat’s progress in implementing the evaluation policy in 2012 and to submit a proposed workplan for 2013.
CURRENT STATUS AND WAY FORWARD 4. Following the establishment of the evaluation policy in May 2012, the Secretariat has moved forward with the two main streams of activities envisaged by the policy. 5. One stream is to foster both the culture of evaluation and its active use across the Organization. In order to implement this the Secretariat is developing a WHO evaluation practice handbook. This complements the evaluation policy, providing step by step practical guidance. The handbook documents the procedures for evaluation and clarifies the roles and responsibilities for it as well as showing the use of associated tools and methods. The handbook is divided into two parts. Part 1 outlines the principles and organization of evaluation in WHO. Part 2 provides guidance on preparing for and conducting an evaluation. The handbook will assist WHO staff involved in evaluations to plan, commission and/or carry out evaluations in conformity with best practices and with the norms and standards for evaluation of the United Nations Evaluation Group; and to improve the quality assurance and control of the evaluations commissioned by WHO at all levels.
1
Decision EB131(1).
EB132/30
6. The other activity stream is to conduct evaluations in conformity with norms, standards and best practices. In connection with this, the Secretariat has undertaken the following activities: (a) prepared terms of reference for the establishment of a global working group on evaluation. The goal of the group is to instill ownership and participation in evaluation across all levels and programmes of the Organization. The group will comprise representatives from country, regional and headquarters offices . The purpose of the group is to promote the culture of evaluation, facilitate the sharing of information and knowledge management, and strengthen the practice of evaluation. The members of the group will participate in the preparation of the biennial Organization-wide evaluation workplan, provide technical support, act as focal points for evaluation in their respective areas, assist in maintaining the Organization-wide evaluation inventory and assist in follow up and utilization of evaluation findings. The group will also form task forces that will act as resource bases for strengthening capacity, guidance on specific issues related to methodology and practice and oversee the compliance with a quality assurance mechanism. (b) developed a quality control system through the use of checklists that ensures that every evaluation carried out under the biennial workplan conforms to the requirements of the formal evaluation policy.
EVALUATION WORKPLAN 7. It is envisaged that the evaluation framework will be wholly implemented during 2013 and will be fully operational to provide input into the 2014–2015 biennium evaluation workplan. The Secretariat has considered 2013 to be a transition period, for which interim measures have been adopted, in order to collate the information needed for the Organization-wide evaluation activities and workplan for 2012–2013. 8. The Office of Internal Oversight Services undertook a series of surveys and consultations with all programmes at headquarters and regional offices to update the status of evaluation activities conducted and to obtain information on planned activities for 2013. This exercise also resulted in an updated inventory of evaluation within the Organization. The proposed workplan for 2013 is a compendium of evaluations reported to the Office of Internal Oversight Services as part of that process. The information is presented in two sections: a list of evaluations that have already commenced or are planned to commence in 2012; and proposed evaluations that will commence in 2013 (see Annex ).
ACTION BY THE EXECUTIVE BOARD 9. The Board is invited to note the proposed transitional workplan for 2013 contained in Annex 1. A regular biennial work plan for the 2014–2015 biennium will be submitted to the Board in January 2014 for its approval.
2
EB132/30
ANNEX EVALUATION – PROPOSED TRANSITIONAL WORKPLAN
Office, Programme, Project Evaluations proposed for 2013
Title
AMRO/FCH
Evaluation of the project “Strengthening Families with Adolescents 10 to 14 years old: Love and Limits” (process and impact) in Bolivia (Plurinational State of), Colombia, Ecuador and Peru Evaluation of the implementation of the WHO Global Strategy for Infant and Young Child Feeding in Latin American countries Evaluation of the status of the Baby Friendly Hospital Initiative in Latin America and the Caribbean Evaluation of the 10-Year plan on oral health for the Americas
AMRO/GDR
Final assessment of the PAHO Gender Plan of Action 2009–2014 Intermediate assessment for the certification of malaria elimination in Argentina Evaluation of the tuberculosis programme in Argentina
AMRO/PWR/ARG Evaluation of IHR capacities for 2014 in Argentina Evaluation of UNDAF and development of a new UNDAF in Argentina AMRO/PWR/ECU HQ/DGO/IOS HQ/HTM/MAL HQ/NMH/TFI Evaluation of the project to improve health and strengthen protection against communicable diseases for women, children and excluded populations in vulnerable situations in Latin America and the Caribbean (CIDA–Canada) Evaluation of the ombudsperson function in WHO Independent evaluation of the Roll Back Malaria partnership 2009–2012 Performance review/Evaluation of the Center for Tobacco Control in Africa (Y2-3), Uganda
Evaluations ongoing and planned for 2012 Improving child survival in the African Region: A review of factors influencing progress Child health facility survey in Botswana AFR/FRH/CAH Child health facility survey in Niger Child health facility survey in the United Republic of Tanzania Child health facility survey in Togo The Africa Neonatal Sepsis Trial (AFRINEST) (impact evaluation Kenya, Democratic Republic of the Congo, Nigeria) AFR/FRH/GWH AFR/FRH/MPS Situation analysis on cervical cancer prevention and control in the African Region Status of implementation of postnatal care home visit strategy in the African Region Evaluation of the provision of family planning services by community health workers in the African Region Situation Analysis and Need Assessment (SANA) for the Implementation of Libreville Declaration on Health and Environment in Africa The Global Analysis and Assessment of Sanitation and Drinking-Water (GLAAS) AFR/HPR/SDH School health promotion implementation status, African Region
AFR/HPR/PHE
3
EB132/30
Office, Programme, Project AFR/SEA/FRH/CAH
Title Neonatal Vitamin A Supplementation Studies (impact evaluation Ghana, India, United Republic of Tanzania) Evaluation of the Integrated Management Strategy for Dengue in Argentina
AMR/PWR/ARG
Chagas disease follow-up evaluation in Santiago del Estero, Argentina Evaluation in two of the five provinces certified for Chagas disease in Argentina UNDAF midterm review for Argentina Evaluation of the Country Cooperation Strategy 2008–2012, Brazil
AMR/PWR/BRA
Management reports on the six-monthly “Terms of Cooperation”, drafted jointly with national counterparts in Brazil Evaluation of National Programme for Dengue Control in Brazil Evaluation by donors (Bloomberg) and WHO of the RS-10 project in Brazil ( “Life in Transit”) Assessment of the Integrated Management of Adult and Adolescent Illnesses (IMAI) programme in Guyana Evaluation of the situation of case-detection and treatment of leprosy programme in selected regions in Guyana AECID Evaluation of the Spanish Fund Mid-term evaluation of the initiative “HIV Prevention in Young People Using a Human Rights Framework in Central America and the Caribbean” (new) Virtual Campus of Public Health, PAHO
AMR/PWR/GUY
AMRO/ERP AMRO/FCH AMRO/HSS
AECID Evaluation of the grant to PAHO’s medicine programme Evaluation of the Secretariat’s Response to the Health Agenda for the Americas 2008–2017 AMRO/IES Evaluation of PAHO’s experiences with decentralized technical co-operation arrangements (Cancelled) Assessment of the tuberculosis programme implementation in Maldives Integrated Disease Surveillance System (IDSR) Assessment in Bhutan Integrated Disease Surveillance System (IDSR) Assessment in the Democratic People’s Republic of Korea SEARO/CDS Integrated Disease Surveillance System (IDSR) Assessment in Timor Leste External Review of National Malaria Programme in Bangladesh External Review of National Malaria Programme in Myanmar External Review of National Malaria Programme in Thailand External Review of National Malaria Programme in Indonesia Assessment of Vital Registration System in Timor Leste SEARO/HSS Assessment of Vital Registration System in Indonesia Assessment of Vital Registration System in Myanmar Assessment of Vital Registration System in Bangladesh Regional Framework for Action on Access to Essential Medicines in the Western Pacific (2011–2016) building on the previous Regional Strategy for Improving Access to Essential Medicines in the Western Pacific Region 2005–2010 Regional Strategy on Human Resources for Health (2006–2015) updated in 2010 by development of Human Resources for Health, Framework for Action (2011–2015)
WPR/DHS
4
EB132/30
Office, Programme, Project
Title Health Financing Strategy for the Asia-Pacific Region (2010–2015) (produced in association with the South-East Asia Region) building on the previous strategy (2006–2010) Asia Pacific Strategy for Strengthening Health Laboratory Services 2010–2015 (produced in association with the South-East Asia Region) Western Pacific Regional Strategy for Health Systems Based on the Values of Primary Health Care (2010) Regional Strategy for Traditional Medicine in the Western Pacific Region (2011–2020) building on the previous strategy (2001–2010) Assessment of the role and function of WHO at country level Mid-term evaluation of Maternal, Newborn, and Child Health Initiative in the Lao People’s Democratic Republic Viet Nam Water Safety Plans Phase 2 External Assessment
WPR/DHS
WPR/Other WPR/WCO/LAO WPR/WCO/VTN
Workers’ health protection project 2009–2011: Evaluation Report WPRO/MCN Report on assessments of the quality of paediatric hospital care in Oudomxay and Phongsaly Provinces (Lao People’s Democratic Republic) US Government Accountability Office evaluation on WHO management reforms HQ/DGO/Other Australian Multilateral Assessment (AMA) on a commitment in “An Effective Aid Program for Australia: Making a real difference – Delivering real results” Evaluation Report of Stage 1 of Reform Proposals of WHO – Report of External Auditor HQ/FWC/ALC HQ/FWC/RHR HQ/GMG/Other HQ/HSS/EMP Review on frailty and its relevance to low- and middle- income countries External Evaluation of the UNDP/UNFPA/WHO/World Bank Special Programme of Research, Development and Research Training in Human Reproduction (HRP) Review of WHO’s development effectiveness End of Programme Evaluation of the Good Governance for Medicines Programme (GGM) Evaluation of the reproductive health component of the Joint WHO/Bill & Melinda Gates Foundation Programme on Prequalification of Medicines Strengthening health workforce development and tackling the critical shortage of health workers (SANTE/2008/153–644) Support to the Development of Human Resources or Health in PALOP (EC-WHO Contribution Agreement – 9.ACP.MTR.04 –) EC End of Programme Evalutiaon – Strengthening Health Workforce Development and Tackling the Critical Shortage of Health Workers Positive Practice Environments Campaign Evaluation Report Evaluation of the Global Observatory for ehealth series of publications (6 publications, based on the second global survey on eHealth 2009–2010) Evaluation of the use of the Blue Trunk Library Knowledge – Translation Platforms in low- and middle- income countries (KTPE) HQ/IER/PSP HQ/IER/TDR HQ/NMH/TFI HQ/PEC/POL Evaluation of the Multi-professional Patient Safety Curriculum Guide TDR External Review Performance review/Evaluation of the Center for Tobacco Control in Africa (Y1), Uganda Global Polio Eradication Initiative: Value for Money
HQ/HSS/HDS
HQ/HSS/HWA
HQ/IER/KMS
=
=
= 5