World Health Organization (WHO) · Technical Documents

Conceptual background and case studies: introduction to EVIPNet Europe

World Health Organization
View original document

The full text is hosted by the publishing organisation. lawenc.com indexes the metadata and links to the official source.

Full text

The World Health Organization (WHO) is a specialized agency of the United Nations created in 1948 with the primary responsibility for international health matters and public health. The WHO Regional Office for Europe is one of six regional offices throughout the world, each with its own programme geared to the particular health conditions of the countries it serves. THE WHO REGIONAL OFFICE FOR EUROPE MEMBER STATES Albania Andorra Armenia Austria Azerbaijan Belarus Belgium Bosnia and Herzegovina Bulgaria Croatia Cyprus Czech Republic Denmark Estonia Finland France Georgia Germany Greece Hungary Iceland Ireland Israel Italy Kazakhstan Kyrgyzstan Latvia Lithuania Luxembourg Malta Monaco Montenegro Netherlands Norway Poland Portugal Republic of Moldova Romania Russian Federation San Marino Serbia Slovakia Slovenia Spain Sweden Switzerland Tajikistan The former Yugoslav Republic of Macedonia Turkey Turkmenistan Ukraine United Kingdom Uzbekistan IN TR O D U C TIO N TO EVIP N ET EU R O P E WORLD HEALTH ORGANIZATION REGIONAL OFFICE FOR EUROPE UN City, Marmorvej 51 DK-2100 Copenhagen Ø, Denmark Tel.: +45 45 33 70 00 Fax: +45 45 33 70 01 E-mail: euwhocontact@who.int Web: www.euro.who.int Evidence-informed Policy Network Europe CONCEPTUAL BACKGROUND AND CASE STUDIES Introduction to EVIPNet Europe - R es ou rc es - K no w le dg e tr an sl at io n th eo ry - Kn owle dge tran slat ion m echa nism s - K no wl ed ge tr an sl at io n pl at fo rm s - K no wl ed ge tr an sla tio n p lat for m cas e s tud ies The World Health Organization was established in 1948 as the specialized agency of the United Nations serving as the directing and coordinating authority for international health matters and public health. One of WHO’s constitutional functions is to provide objective and reliable information and advice in the field of human health. It fulfils this responsibility in part through its publications programmes, seeking to help countries make policies that benefit public health and address their most pressing public health concerns. The WHO Regional Office for Europe is one of six regional offices throughout the world, each with its own programme geared to the particular health problems of the countries it serves. The European Region embraces nearly 900 million people living in an area stretching from the Arctic Ocean in the north and the Mediterranean Sea in the south and from the Atlantic Ocean in the west to the Pacific Ocean in the east. The European programme of WHO supports all countries in the Region in developing and sustaining their own health policies, systems and programmes; preventing and overcoming threats to health; preparing for future health challenges; and advocating and implementing public health activities. To ensure the widest possible availability of authoritative information and guidance on health matters, WHO secures broad international distribution of its publications and encourages their translation and adaptation. By helping to promote and protect health and prevent and control disease, WHO’s books contribute to achieving the Organization’s principal objective – the attainment by all people of the highest possible level of health. 1Evidence-informed Policy Network Europe CONCEPTUAL BACKGROUND AND CASE STUDIES Introduction to EVIPNet Europe 2INTRODUCTION TO EVIPNET EUROPE Some rights reserved. This work is available under the Creative Commons Attribution-NonCommercial- ShareAlike 3.0 IGO licence (CC BY-NC-SA 3.0 IGO; https:// creativecommons.org/licenses/by-nc-sa/3.0/igo). Under the terms of this licence, you may copy, redistribute and adapt the work for non-commercial purposes, provided the work is appropriately cited, as indicated below. In any use of this work, there should be no suggestion that WHO endorses any specific organization, products or services. The use of the WHO logo is not permitted. If you adapt the work, then you must license your work under the same or equivalent Creative Commons licence. If you create a translation of this work, you should add the following disclaimer along with the suggested citation: “This translation was not created by the World Health Organization (WHO). WHO is not responsible for the content or accuracy of this translation. The original English edition shall be the binding and authentic edition”. Any mediation relating to disputes arising under the licence shall be conducted in accordance with the mediation rules of the World Intellectual Property Organization. Suggested citation. EVIPNet Europe. Introduction to EVIPNet Europe: Conceptual background and case studies. Copenhagen: World Health Organization Regional Office for Europe; 2017. Licence: CC BY-NC-SA 3.0 IGO. Cataloguing-in-Publication (CIP) data. CIP data are available at http://apps.who.int/iris/ http://apps.who.int/iris. Sales, rights and licensing. To purchase WHO publications, see http://apps.who.int/bookorders. To submit requests for commercial use and queries on rights and licensing, see http://www.who.int/about/licensing. Third-party materials. If you wish to reuse material from this work that is attributed to a third party, such as tables, figures or images, it is your responsibility to determine whether permission is needed for that reuse and to obtain permission from the copyright holder. The risk of claims resulting from infringement of any third-party-owned component in the work rests solely with the user. General disclaimers. The designations employed and the presentation of the material in this publication do not imply the expression of any opinion whatsoever on the part of WHO concerning the legal status of any country, territory, city or area or of its authorities, or concerning the delimitation of its frontiers or boundaries. Dotted and dashed lines on maps represent approximate border lines for which there may not yet be full agreement.The mention of specific companies or of certain manufacturers’ products does not imply that they are endorsed or recommended by WHO in preference to others of a similar nature that are not mentioned. Errors and omissions excepted, the names of proprietary products are distinguished by initial capital letters. All reasonable precautions have been taken by WHO to verify the information contained in this publication. However, the published material is being distributed without warranty of any kind, either expressed or implied. The responsibility for the interpretation and use of the material lies with the reader. In no event shall WHO be liable for damages arising from its use. Address requests about publications of the WHO Regional Office for Europe to: Publications WHO Regional Office for Europe UN City, Marmorvej 51 DK-2100 Copenhagen Ø, Denmark Alternatively, complete an online request form for documentation, health information, or for permission to quote or translate, on the Regional Office website (http://www.euro.who.int/pubrequest). © World Health Organization 2017 Document number: WHO/EURO:2017-6434-46200-66830 3CONCEPTUAL BACKGROUND AND CASE STUDIES CONTENTS 1. KNOWLEDGE TRANSLATION THEORY .......................................................................... 9 1.1 Knowledge translation ...................................................................................................................................... 9 1.2 The “knowledge” of knowledge translation ........................................................................................ 12 1.3 Knowledge syntheses .................................................................................................................................... 16 1.4 Knowledge brokering ...................................................................................................................................... 18 1.5 Networking and knowledge translation .............................................................................................. 19 2. KNOWLEDGE TRANSLATION MECHANISMS ............................................................... 23 2.1 Priority setting .................................................................................................................................................. 24 2.2 Evidence briefs for policy ............................................................................................................................ 26 2.3 Policy dialogues ................................................................................................................................................ 28 2.4 Rapid response services ............................................................................................................................... 31 2.5 Clearinghouses .................................................................................................................................................. 33 3. KNOWLEDGE TRANSLATION PLATFORMS ................................................................. 35 3.1 KTP form and function ............................................................................................................................ 35 3.2 KTP establishment, operationalization and launch ................................................................... 40 4. KNOWLEDGE TRANSLATION PLATFORM CASE STUDIES .......................................... 44 4.1 EVIPNet regional networking ............................................................................................................... 44 4.2 Brazil ................................................................................................................................................................. 46 4.3 Uganda ........................................................................................................................................................... 48 4.4 Peru ................................................................................................................................................................... 49 4.5 Zambia ........................................................................................................................................................... 51 5. RESOURCES ................................................................................................................ 53 5.1 Annotated list of knowledge translation resources .................................................................. 53 5.2 Glossary of knowledge translation terms ....................................................................................... 60 REFERENCES .............................................................................................................. 64 4INTRODUCTION TO EVIPNET EUROPE ACKNOWLEDGEMENTS This publication was produced by the Division of Information, Evidence, Research and Innovation of the WHO Regional Office for Europe, under the leadership of Dr Claudia Stein, Director, and the supervision of Tim Nguyen, Unit Leader. The principal authors of this publication were: • Sandy Campbell, Knowledge Translation Specialist, Canada • Tanja Kuchenmüller, Technical Officer, Evidence and Information for Policy, WHO Regional Office for Europe • Ryoko Takahashi, Technical Officer, Evidence and Information for Policy, WHO Regional Office for Europe • Kaelan Moat, Scientific Lead, Health Systems Evidence and Learning, McMaster Health Forum, Canada • James Bao, Intern, Evidence and Information for Policy, WHO Regional Office for Europe Other contributors included Akbar Suvanbekov (Ministry of Health, Kyrgyzstan); Ausra Zelviene (Health Information Center, Institute of Hygiene, Lithuania); Christian Riquelme (Franche-Comte Regional Council, France); Claudia Dima (National Institute of Public Health, Romania); Gemma Derrick (Lancaster University, United Kingdom); Fadi El-Jardali (American University of Beirut, Lebanon); Harriet Nabudere (Makerere  University, Uganda); Jihee Lee (Korea Centers for Disease Control and Prevention, Korea); John Lavis (McMaster University, Canada); Jorge Barreto (Ministério da Saúde, Brazil); Lely Solari (Ministry of Health, Peru); Luis Gabriel (WHO, Regional Office for the Americas); Michael Wilson (McMaster University, Canada); Rhona Mijumbi (Makerere University, Uganda); Sonya Corkum (Canada); Tomas Pantoja (Pontificia Universidad Católica de Chile, Chile); and Ulysses Panisset (Federal University of Minas Gerais, Brazil). ABBREVIATIONS AND ACRONYMS EVIPNet Evidence-informed Policy Network KTP knowledge translation platform M&E monitoring and evaluation NEv Centre for Health Evidence RAG research-to-action group WHA World Health Assembly WHO World Health Organization 5CONCEPTUAL BACKGROUND AND CASE STUDIES INTRODUCTION ABOUT THIS DOCUMENT In 2012, all Member States in the WHO European Region adopted the new European health policy framework, Health 2020. The use of the best available scientific evidence in policy- making has never been more relevant in discussions about how to maximize intended health outcomes and strengthen health systems in the Region (1). The Evidence-informed Policy Network (EVIPNet) Europe works to strengthen country capacity to develop evidence- informed policies on health system priorities that are in line with Health 2020, the European Health Information Initiative (2) and the “Action plan to strengthen the use of evidence, information and research for policy-making in the WHO European Region 2016–2020”. It functions as a network of platforms represented by multistakeholder partnership and multiple sectors. The document has two main objectives. First, it provides an overview of evidence- informed policy-making, knowledge translation and EVIPNet. It presents lessons learned and experiences gained from the many groups around the world undertaking activities to support the use of research evidence in the policy process. Second, it assists countries in establishing EVIPNet country teams known as knowledge translation platforms (KTP). The document is divided into five sections. Section 1 provides an overview of the major theoretical concepts in knowledge translation, including what it means. The section covers key related concepts such as the “knowledge” of knowledge translation, knowledge brokering, knowledge synthesis and networks. Finally, it discusses how both EVIPNet and EVIPNet Europe have operationalized knowledge translation processes through the work of KTPs around the world. Section 2 introduces key knowledge translation mechanisms and approaches that have been implemented in various contexts around the world. In particular, this section introduces priority-setting approaches, evidence briefs for policy, deliberative policy dialogues (for which evidence briefs are a primary input), rapid response services and online clearinghouses (often called “one-stop shops”). Section 3 provides a description of KTPs, highlights their possible forms and functions, discusses the challenges in establishing and launching them, and illustrates possible strategies and workplans for operating a KTP. Section 4 provides four brief case studies of KTPs that have been established in Brazil, Peru, Uganda and Zambia. This section presents an overview of experiences in which EVIPNet has been the most active. In particular, it discusses the successes, challenges and lessons learned across KTPs in sub-Saharan Africa. Finally, section 5 provides a short annotated list of knowledge translation resources and a glossary. This document should give readers an understanding of the underlying concepts and the mechanisms and approaches available to support the use of research evidence in the policy- making process. This will allow them to respond more appropriately to specific needs in their own contexts. The document provides readers with short, targeted overviews and reference 6INTRODUCTION TO EVIPNET EUROPE lists. The resources and information in this kit provide concrete ideas on creating and launching a KTP that can bring together policy-makers, stakeholders and researchers at the country level to support evidence-informed policy-making and policy implementation and improve the health of populations. For information on the process of joining EVIPNet Europe, please refer to “How to join EVIPNet Europe” (3). ABOUT EVIPNET EVIPNet is a knowledge translation network established by WHO. EVIPNet envisions a world in which policy-makers and other stakeholders in low- and middle-income countries use the best available research evidence to inform policy-making. As a WHO initiative in knowledge translation, EVIPNet’s mission is to promote a network of partnerships at the national, regional and global levels among health system policy-makers, researchers and civil society. Taken together, this will strengthen health systems and improve health outcomes through regular access to, and assessment, adaptation and use of context-specific research evidence (5). Since 2005, regional EVIPNet networks have been established in sub-Saharan Africa, the Americas, Asia and the Eastern Mediterranean. Over 40 individual country teams are interconnected within these regional networks. These country teams – often called KTPs (see Box 2) – are the core element of EVIPNet. Discussing the ideas and concrete steps that countries take in creating a KTP is the primary focus of this document. BOX 2. KTPs A KTP is an organization or network that brings together the worlds of research and policy. A KTP designs, leads and/or delegates strategies to: (i) understand the prevailing situation on a particular issue; (ii) harvest local evidence and experience and synthesize it with global knowledge to provide guidance in policy development and implementation; (iii) broker among stakeholders on key issues; (iv) package syntheses and other communications for specific audiences; (v) and strengthen the capacities of researchers, policy-makers and other stakeholders in accessing research evidence, in performing synthesis work, and in knowledge translation more generally (6). BOX 1. KNOWLEDGE TRANSLATION WHO defines knowledge translation as: “the exchange, synthesis, and effective communication of reliable and relevant research results. The focus is on promoting interaction among the producers and users of research, removing the barriers to research use, and tailoring information to different target audiences so that effective interventions are used more widely (4). 7CONCEPTUAL BACKGROUND AND CASE STUDIES EVIPNET EMR EVIPNET AMERICA EVIPNET GLOBAL (SECRETARIAT AND STEERING GROUP) KTPs KTPs EUROPEAN KTPs EVIPNET ASIA EVIPNET AFRICA EXTERNAL STEERING GROUP VIRTUAL SUBNET- WORKS WHO SECRETARIAT OF EVIPNET EUROPE Note. KTP = knowledge translation platform, EMR = Eastern Mediterranean Region. FIG. 1. THE NATIONAL, REGIONAL AND GLOBAL CONNECTIONS OF EVIPNET EUROPE’S NETWORKING STRUCTURE ABOUT EVIPNET EUROPE Launched in 2012, EVIPNet Europe is the most recent EVIPNet regional network. Like the global network, EVIPNet Europe seeks to improve public health and reduce inequities by increasing the systematic use of the best available scientific evidence to guide health systems policy development. EVIPNet Europe operates on three separate yet closely interconnected levels (Fig. 1): • Country level: Country teams or KTPs comprising key national actors (including policy-makers, researchers and civil society representatives) lead the planning and implementation of knowledge translation activities and interventions. • Regional level: Country teams or KTPs interact with each other to share experiences, lessons learned and innovative approaches. These interactions are supported by the WHO Secretariat of EVIPNet Europe based in the WHO Regional Office for Europe. The EVIPNet Europe Steering Group, comprising eight people with extensive experience in knowledge translation and evidence-informed policy-making, provides strategic advice and technical support to the WHO Secretariat of EVIPNet Europe. • Global level: The global EVIPNet Secretariat within WHO headquarters in Geneva coordinates and supports the country and regional levels, and actively involves funders and other global stakeholders. 8INTRODUCTION TO EVIPNET EUROPE Initial implementation period: multicountry- and country-specific tracks Following its launch, EVIPNet Europe developed a five-year strategic plan for 2013–2017 (7) outlining its strategic directions and the roadmap for implementation, including both multicountry and country-specific tracks. The multicountry track focuses on capacity- building and strengthening of exchanges and networking among countries. The country- specific track refers to a formal pilot phase, launched in 2014, to test the feasibility of the EVIPNet methodology in the WHO European Region (5). Piloting comprises: • undertaking situation analyses to better understand opportunities and barriers for evidence-informed policy-making in the country, specifically to create a KTP; • formally establishing and operating a KTP; and • planning and implementing one full EVIPNet action cycle (see section 3.1.3) and other knowledge translation interventions adapted to the local context. Added value and benefits of EVIPNet Europe EVIPNet Europe members are formally supported, in particular through KTPs, to achieve improved, evidence-informed national health policy-making, leading to stronger health systems and improved health outcomes. Member countries become part of a peer-support and capacity-building network. At the regional level, the WHO Secretariat of EVIPNet Europe offers support to individual brokers and countries intending to institutionalize knowledge brokering in the form of a KTP, through: • skills development training and capacity-building workshops; • direct technical support in operational and strategic positioning and implementation; • access to knowledge translation tools, technical guidelines and global, regional and national best practices; • establishment of interactive exchanges and communication channels among peers; and • fostering a culture, practice and the advancement of knowledge translation at national and regional levels. Recent updates on EVIPNet Europe member countries and activities are available on the WHO Regional Office for Europe website (http://www.euro.who.int/en/evipnet). 9CONCEPTUAL BACKGROUND AND CASE STUDIES 1. KNOWLEDGE TRANSLATION THEORY This section provides an overview of the theory on knowledge translation mechanisms and approaches. At the end of section 1, readers should be able to describe: • the history and scope of knowledge translation (section 1.1); • the knowledge that informs knowledge translation activities (section 1.2); • the role that knowledge brokering and synthesis play in knowledge translation (sections 1.3 and 1.4); and • how networking in knowledge translation adds a crucial knowledge sharing dimension (section 1.5). 1.1 KNOWLEDGE TRANSLATION 1.1.1 Research–policy gap Identifying the best approaches to supporting evidence-informed health policy-making is becoming increasingly important on the international agenda to strengthen national health systems. There is a commitment to establish new, or scale up existing, mechanisms to improve the linkages between the best available research evidence and policies adopted to strengthen health systems and improve population health (4,8–10). This is evident in the 2004 World report on knowledge for better health (4), the resolutions of the Fifty-eighth World Health Assembly (11) and knowledge translation initiatives such as EVIPNet. Transferring research into policy is a complex and haphazard process. “Researchers […] busy filling shelves of a shop front with a comprehensive set of all possible relevant studies that a decision-maker might some day drop by to purchase” (12) will rarely be sufficient to influence decision-making. Major barriers exist to the use of research evidence in health policy-making. • Research is not valued by policy-makers as a helpful input to their work. • It is viewed as irrelevant to the policy process, which is characterized by power and budget struggles. • It is difficult to use because it lacks quality or relevance, or is not available when policy- makers need it (13,14). • It is not effectively communicated, due to an absence of personal contact and interaction between researchers and policy-makers, and/or mutual mistrust. KEY MESSAGES • Knowledge translation is a process of increasing the systematic and transparent use of research evidence in policy- and decision-making to improve health outcomes. • WHO has become a key player in knowledge translation as part of its mandate to improve public health. • EVIPNet focuses on exchange, linkages and integrated models of knowledge translation frameworks. 10 INTRODUCTION TO EVIPNET EUROPE 1.1.2 The evolution of knowledge translation Knowledge translation is a process of increasing the systematic and transparent use of research evidence in policy- and decision-making to improve health outcomes. WHO defines knowledge translation as: the exchange, synthesis, and effective communication of reliable and relevant re- search results. The focus is on promoting interaction among the producers and us- ers of research, removing the barriers to research use, and tailoring information to different target audiences so that effective interventions are used more widely. (4) Knowledge translation is rooted in the evidence-based medicine movement of the 1990s, which highlighted the need for clinicians to integrate research evidence into practice (15,16). It also has its origins in the field of health technology assessment, which likewise emerged in the early 1990s as an approach to policy decision support based on evidence (17). The evidence- based medicine movement fundamentally changed how clinicians delivered health care, but revealed that despite the availability of research evidence, the implementation of evidence- based interventions was far from uniform. In some cases, interventions that were supported by evidence were not implemented (13,15,17). The Bellagio Child Survival Study (2003) brought the practical implications of this challenge to the fore. It revealed that many mothers and their children were not receiving care based on the best available research evidence. If evidence- based interventions were to become universally available to them, it was possible that 63% of the 10 million annual child deaths could be avoided (17). Within the field of health, the paradigm of evidence-based medicine has inspired other areas to improve the quality of health systems and care, and has expanded to become evidence- based policy. The term “evidence-based policy” has since evolved into “evidence-informed policy” to emphasize the coexistence of other contextual and political factors that equally influence (and sometimes dominate) decision-making. These include institutional structures and policy legacies, interest group pressure, and dominant values and beliefs (18–21). 1.1.3 The WHO approach to knowledge translation In the last 20–30 years, recognition of the importance of the “know–do gap” has gained political momentum. This describes the difference between what we “know” and what we “do” in terms of practice and policy development. This trend culminated in the World Health Assembly (WHA) of 2005, at which knowledge translation was one of the main agenda topics. That year, the WHA called on WHO Member States to “establish or strengthen mechanisms to transfer knowledge in support of evidence-based public health and health care delivery systems and evidence-based health-related policies”(11). Bridging the know–do gap has become a great challenge and opportunity for achieving the best care for all in global health (13,22–24). WHO supported a meeting of the world’s health ministers in Mexico in 2004 and in Mali in 2008 (10,25). These summits both resulted in formal declarations and commitments for Member States to establish or strengthen mechanisms to support the use of research evidence and bring together research and policy communities. WHO supports knowledge translation primarily through EVIPNet (see Introduction). 11 CONCEPTUAL BACKGROUND AND CASE STUDIES 1.1.4 Knowledge translation models Knowledge translation efforts can be grouped into four models (see Fig. 1.1) (13). • Push efforts tailor and target the key messages arising from research evidence to policy- makers by making it more accessible and easier to use. Examples include the preparation and targeted distribution of user-friendly summaries of policy-relevant systematic reviews. • User-pull efforts concentrate on how policy-makers are supported through processes and structures to demand evidence from the research community. These efforts are facilitated through the establishment of one-stop shops, which make it easier for policy-makers to efficiently access high-quality research evidence. An example of this is online repositories of high-quality, policy-relevant, systematic reviews. • Exchange efforts encourage researchers and policy-makers to developing partnerships, collaborative research projects or shared understandings, which enable them to jointly ask and answer relevant policy questions. Examples include convening deliberative policy dialogues. • Integrated efforts bring together various different components of push, user-pull and exchange, and are embodied in a knowledge translation platform. This approach acknowledges that activities that fall within each of the other categories are not mutually exclusive or meant to be considered in isolation. While EVIPNet focuses on all four efforts, it concentrates in particular on institutionalizing exchange and integrated efforts, which have shown much promise in a number of settings (15, 26). There is an increased interest in understanding the factors that contribute to the successful development of knowledge translation activities in low-and middle-income countries (6,26–29), and in evaluating their effectiveness (26,30). Section 2 provides a more detailed description of activities within each of the models. Exchange efforts Integrated efforts Push efforts Researchers Researchers ResearchersPolicy-makers KT platforms Policy-makersPolicy-makers User pull efforts Researchers Policy- makers FIG 1.1. MODELS FOR LINKING RESEARCH AND POLICY Source: Adapted from Moat et al. (26). 12 INTRODUCTION TO EVIPNET EUROPE 1.2 THE “KNOWLEDGE” OF KNOWLEDGE TRANSLATION Knowledge can be both scientific (31,32) and experience-based (32–36), in that it derives from scientific study and from experience that often contextualizes the issue (33,34) (Fig. 1.2). An awareness of these different dimensions of knowledge is central to knowledge translation. 1.2.1 Types of knowledge Any knowledge translation strategy needs to take both explicit and tacit knowledge into account. Explicit knowledge is scientific, structured, verifiable and replicable. Several methods have been suggested to rank knowledge according to the strength of evidence and scientific rigor. One of the most widely accepted methods groups explicit knowledge into two tiers (Fig. 1.2) (37,38). The bottom tier includes individual studies including randomized SYSTEMATIC REVIEWS CRITICALLY-APPRAISED TOPICS (EG. EVIDENCE SUMMARIES) CRITICALLY-APPRAISED INDIVIDUAL ARTICLES (E.G. ARTICLES SYNPOSES) RCTs COHORT STUDIES CASE CONTROL STUDIES; CASE SERIES / REPORTS TACIT KNOWLEDGE BELIEF OPINION BEST PRACTICE EXPERIENCE ORGANISATIONAL TRADITION Source: Campbell (23). FIG. 1.2. THE HIERARCHY OF EXPLICIT KNOWLEDGE CONTRASTED (23) KEY MESSAGES • Knowledge is a combination of explicit knowledge (e.g. research evidence, health information and data) and tacit knowledge (e.g. expertise, tradition and/or common sense). • Explicit knowledge is structured, verifiable and replicable, while tacit knowledge is often unarticulated and context-specific, deriving from experience. • The “best available evidence” typically refers to explicit knowledge from global and national research evidence combined with tacit knowledge at the local level. 13 CONCEPTUAL BACKGROUND AND CASE STUDIES controlled trials, cohort studies and case-control studies. The quality of individual studies might vary as methods, assumptions, contexts and chance variation can result in contradictory findings. The top tier includes evidence synthesis products, such as systematic reviews, in which research evidence has been systematically and transparently searched, appraised and synthesized (see section 1.3). Evidence synthesis products package the most relevant and high-quality studies to provide a more comprehensive picture than any single study can. Explicit knowledge also includes health information produced from data that has been analysed into meaningful and relevant information for decision-making (39). Knowledge derived from data, such as that routinely collected through monitoring and evaluation and epidemiological surveys, is required to clarify policy issues (40). Data may be used to describe the size and/or consequences of the issue in terms of risk factors, disease, coverage, quality of care, cost of services and implementation rates. These data can be compared to, for example, targets in a national plan, regional averages, international standards, and across different time periods (41). Tacit knowledge, on the other hand, is drawn from experience, lessons learned, organizational tradition and best practice. It is a mixture of intuition, common sense, know-how and pragmatism (42). Often the knowledge translation literature refers to a different kind of knowledge and/or evidence typology, as outlined in Box 1.1. 1.2.2 The best available evidence The use of “the best available evidence” aims to address the lack of perceived relevance and unavailability of research evidence, which are identified as barriers to the use of research evidence in policy-making (see section 1.1.1). This involves combining strong and undisputed evidence from global databases (often systematic reviews) with local evidence and/or local BOX 1.1. CONTEXT-FREE, CONTEXT-SENSITIVE AND COLLOQUIAL EVIDENCE As another way of thinking about the “knowledge” of knowledge translation, Lomas et al. (43) describe three different types of evidence (context-free and context-sensitive evidence refer to explicit knowledge and colloquial evidence refers to tacit knowledge). • The first is context-free evidence. This is typically medical effectiveness or biomedical research (e.g. male circumcision can be a strong preventative measure for HIV acquisition in men living in high incidence populations). • The second is context-sensitive evidence, which puts evidence into a context that makes it operational or relevant to a particular setting (e.g. male circumcision in low- and middle-income countries may fail as an intervention due to health system weaknesses and underlying poverty issues).Both of these types of evidence are captured in systematic reviews, in other syntheses, in single studies and in pilot or case studies. • The third category of evidence is colloquial evidence – evidence “that establishes a fact or gives reason for believing in something” (43) (e.g. most experts agree that implementing a universal male circumcision policy is impossible because of the current cultural, political and socioeconomic environment). This type of evidence can be very useful for addressing the weaknesses in the other types of evidence (e.g. implementation context). Box 1.1: (43) 14 INTRODUCTION TO EVIPNET EUROPE tacit knowledge to design context-specific solutions. In many low- and middle-income countries, locally created explicit evidence on a particular issue might be limited, while a raft of studies performed globally or in other countries exist. A knowledge translation practitioner can synthesize the best available evidence using different knowledge translation mechanisms (e.g. policy dialogue) to determine how this evidence might both inform and blend with local tacit evidence (see section 2). 1.2.3 Policy-makers and knowledge When a knowledge translation practitioner understands how a particular type of knowledge fits into the larger puzzle, the knowledge translation strategy has a better chance to influence policy (23). In addition to methodological rigor, the following contextual factors need to be taken into consideration to increase the uptake of research evidence. Alignment with policy-makers’ beliefs and aims: Humans “believe in” the knowledge that best aligns with their own values or perceptions (22,44–47) . “Users selectively interpret and use knowledge as it serves their own purposes, fits their unique situations and reflects their relations with their practicing community.”(48). For example, policy-makers may use research evidence in an instrumental way if it directly aligns with and provides answers about how to address a pressing policy challenge. They may use it in a conceptual way if it helps them think about the issues they are dealing with differently, or in a symbolic or strategic way if it helps to justify a decision already taken (49–52). These opportunities include developing actionable messages for decision-makers (only 30 percent of research organizations frequently or always do this). Perceived competence and integrity of researchers or knowledge brokers: Policy-makers prefer to work with researchers or knowledge brokers if they are deemed to be trustworthy, not whether they are the most objective and/or the best source of relevant evidence about a particular topic (53). Trustworthiness can be perceived as competence, integrity and support of a policy reform agenda. Researchers’ personal traits, motivations and willingness to advocate appear to matter most for getting them into the policy fray, and not the quality or objectivity of their research (54). Perceived quality of research: Policy-makers turn to knowledge that is available, easy to consume, uncontroversial and clear, and is the most relevant to their context and issue (22,24,43–45,55). Researchers who actively dispute the evidence base on a particular issue may weaken the role that research evidence as a whole might play. This could lead policy- makers to turn to other types of (largely tacit) knowledge – such as those created and advanced by lobbyists and paid consultants. Timeliness of research: Policy-makers prefer that research is provided within a timeframe that aligns with the hours, days or weeks they work within, rather than the years it can take to complete a research project (24). Perceptions of knowledge, motivations to use it, approaches to accessing it, and how it is used to inform decision-making are dynamic. Knowledge translation strategies need to be designed, tailored and implemented based on the prevailing conditions and opportunities for the uptake of evidence by policy-makers. 15 CONCEPTUAL BACKGROUND AND CASE STUDIES 1.2.4 The use of research evidence in policy-making Research evidence can play a critical role in clarifying the issues being addressed at each stage of the policy cycle (see Fig. 1.3). The uptake of research evidence can be grouped into the following: • Direct use (i.e. instrumental or engineering) refers to the link between research findings and their applicability to solving specific problems, which policy-makers are seeking to address. • Selective use (i.e. symbolic or legitimating) refers to research being applied in a political, strategic manner to persuade, and legitimize predetermined decisions. • Enlightening use (i.e. conceptual) refers to research that has informed or influenced how policy-makers think about issues (56). The importance of analysing the policy cycle is to identify the extent to which evidence is being used in the different phases (see Table 1.1). • Agenda setting: This stage involves establishing the rationale for key policies including identification of health problems. • Formulation: The appropriate use of evidence can support the formulation of clear and specific policy objectives and options. AGENDA SETTING POLICY EVALUATION POLICY IMPLEMENTATION POLICY FORMULATION IDENTIFYING POLICY OPTIONS ANALYSING OPTIONS CHOOSING POLICY INSTRUMENTS [METHODS] CO-ORDINATING WITH OTHER POLICY DECIDING ON METHODS EVALUATING (COMPARING MONITORING DATA AGAINST ANTICIPATED RESULTS) MONITORING THE RESULTS DEVELOPING IMPLEMENTATION STRATEGY ALLOCATING RESOURCES (HUMAN, FINANCIAL AND OTHERS) IDENTIFYING ISSUES SETTING POLICY OBJECTIVES Source: New Zealand Ministry for the Environment (57). FIG. 1.3. THE POLICY CYCLE 16 INTRODUCTION TO EVIPNET EUROPE • Implementation: This is the stage at which policy options identified in the previous stage are rolled out. Evidence can be of utmost importance in making well-designed choices. Implementation includes monitoring of results to understand the impact of interventions on health and enable policy or programme corrections. • Evaluation: This phase may include research evidence and methods, or focus on the social response to policy. The issue will be the extent to which the original problem is being addressed and the efficiency of the programmes and actions implemented to this end. Evaluation findings inform the next actions in the policy cycle. TABLE 1.1. COMPONENTS OF POLICY PROCESSES AND DIFFERENT EVIDENCE ISSUES STAGE OF THE POLICY PROCESS DESCRIPTION DIFFERENT EVIDENCE ISSUES Agenda setting Awareness and priority given to an issue The evidence needs here are in terms of identifying new problems or the build up of evidence regarding the magnitude of a problem so that relevant policy actors are aware that the problem is indeed important. A key factor here is the credibility of evidence but also the way evidence is communicated. Formulation There are two key stages to the policy formulation process: determining the policy options and then selecting the preferred option (58). For both stages, policy-makers should ideally ensure that their understanding of the specific situation and the different options is as detailed and comprehensive as possible - only then can they make informed decisions about which policy to go ahead and implement. This includes the instrumental links between an activity and an outcome as well as the expected cost and impact of an intervention. The quantity and credibility of the evidence is important. Implementation Actual practical activities Here the focus is on operational evidence to improve the effectiveness of initiatives. This can include analytic work as well as systematic learning around technical skills, expert knowledge and practical experience. Action research and pilot projects are often important. The key is that the evidence is practically relevant across different contexts. Evaluation Monitoring and assessing the process and impact of an intervention The first goal here is to develop monitoring mechanisms. Thereafter, according to Young and Quinn (58), ‘a comprehensive evaluation procedure is essential in determining the effectiveness of the implemented policy and in providing the basis for future decision-making’. In the processes of monitoring and evaluation, it is important to ensure not only that the evidence is objective, thorough and relevant, but also that it is then communicated successfully into the continuing policy process. Source: Reproduced from Sutcliffe and Court (59). 1.3 EVIDENCE SYNTHESES A strong body of evidence shows that a single set of findings alone rarely influences policy, with research being more likely to influence policy in a synthesized form (22,60–64). For that reason, evidence synthesis is a core mechanism of knowledge translation. 17 CONCEPTUAL BACKGROUND AND CASE STUDIES Evidence synthesis is a process of “contextualizing and integrating research findings of individual research studies within the larger body of knowledge on the topic”(65). This can result in systematic reviews, summaries of systematic reviews, evidence briefs for policy, and press releases. Realist syntheses, narrative syntheses, meta-analyses, meta- syntheses and practice guidelines are all forms of synthesis (66). These syntheses summarize information from a wide range of sources including the non-peer-reviewed literature through rigorous, systematic and transparent processes. Evidence syntheses respond to policy concerns and questions from policy-makers. They are up-to-date summaries of evidence that highlight what is known and not known about the policy question in concern. They indicate gaps in evidence and information, underscore key areas of debate and trends, and provide practical policy options for action. The approaches and products described above package evidence in specific formats that present key messages for different audiences. Because each synthesis is aimed at different target audiences (e.g. researchers, policy-makers, the general public) it is crucial to match the type of message package to the intended recipients. Knowledge syntheses become a highly useful mechanism for influencing policy-makers when they move beyond purely scientific considerations and include a fuller appreciation of all relevant contextual factors. As Morestin et al. state, “decision-makers are influenced by considerations that go beyond effectiveness, and which must be taken into account in the information they are provided: syntheses that present evidence in a manner that is divorced from the realities of policy implementation are of little use to decision-makers”(67). Systematic reviews combine findings from multiple research studies in a systematic, transparent and reproducible manner using quantitative and/or qualitative methods (68). High-quality systematic reviews provide a comprehensive and weighted overview of the evidence that responds to a certain question (55). Systematic reviews are often preferable to single studies as they: • reduce the likelihood of biased selection and interpretation of evidence because of the methods used to identify, select, appraise and synthesize a range of single studies; • increase confidence about what can be expected from a particular intervention, because the results are based on a larger number of study units and settings than any individual study; and • allow policy-makers to invest more time considering the applicability of the findings in their own context, since the hard work of finding all relevant single studies is done for them and presented in a single place (63). Building on systematic reviews, summaries of systematic reviews and evidence briefs for policy are tools which further synthesize knowledge that is generally targeted at policy- makers. Summaries of systematic reviews are structured summaries of relevant systematic reviews on a specific topic (69, 70). An evidence brief for policy (see section 2.2) summarizes the findings from a full range of systematic reviews that clarify policy problems, frame policy options and identify key implementation considerations. These are combined with local evidence related to a specific policy issue (26,71). A consideration of the quality of the evidence is generally provided so that users can determine how much confidence to place in the results of a review. Two tools are often used to achieve this: (i) the AMSTAR assessment system, which provides a quality rating of how well a review was conducted based on the methods used (72); and (ii) the GRADE system, which determines the strength of the evidence 18 INTRODUCTION TO EVIPNET EUROPE (and thus, whether recommendations can be made based on the evidence) (73). This type of “value-added” information can be important for policy-makers who want to know whether a review or set of reviews are of high or low quality before making a decision (74). The second major type of evidence synthesis is less scientific in nature, yet it is a more accessible, user-friendly approach to providing research evidence to a lay audience and/or policy-makers. This includes press releases, take-home messages and community events such as radio shows or dramas. As these approaches do not explicitly demonstrate the quality of the research being considered, some discretion should be advised to the potential users. 1.4 KNOWLEDGE BROKERING Knowledge brokering is another key mechanism of knowledge translation. This refers to the act of bringing together stakeholders – mainly researchers and policy-makers – through building relationships and alliances, sharing ideas and knowledge, and improving knowledge translation skills and capacities. 1.4.1 Knowledge brokers Whether an individual, an institution or a network, a knowledge broker serves as “a catalyst for systems change, establishing and nurturing connections between researchers and end users, and facilitating learning and exchange of knowledge”(75). A knowledge broker is generally a respected opinion leader, who has experience in the worlds of research, policy and/or practice (23). Although an official mandate is useful in purveying more credibility and authority, knowledge brokers can function without a formalized role, utilizing their unique attributes and skills to facilitate the exchange of knowledge (76). Knowledge translation platforms are a specific type of a knowledge broker organization that institutionalizes these characteristics (see section 3). 1.4.2 Knowledge brokering activities An effective knowledge broker is a catalyser of change (77–79), through: • accessing, critically appraising and synthesizing research information for specific audiences; • establishing online databases that serve as one-stop shops for the best available research evidence (see section 2.5); KEY MESSAGES • Knowledge brokers are often senior, well-connected and respected individuals, or an organization (such as a knowledge translation platform) whose core function is to connect people to exchange knowledge. • Knowledge brokers bring stakeholders together, build relationships, cement coalitions and alliances, and build new skills and capacities. • Effective knowledge brokering drives the change agenda, typically by convening the required stakeholders to exchange knowledge and discuss how change might unfold. 19 CONCEPTUAL BACKGROUND AND CASE STUDIES • convening deliberative, multistakeholder meetings to discuss the research agenda and knowledge gaps; discuss partnerships among researchers, or between researchers and research-users; consider new or pressing issues that require collective action; and to conduct situation analyses identifying major stakeholders and the dynamics among them; • facilitating off-the-record meetings (potentially using the Chatham House Rule) to discuss sensitive policy concerns, given that stakeholders are sometimes unwilling to speak on behalf of their organization for fear of stating the wrong thing or making a difficult commitment; and • encouraging the secondment of brokers to specific organizations (e.g. a government ministry) working as “boundary spanners, identifying, selecting, and obtaining information from the environment and efficiently transmitting it within the organization according to needs” (32). 1.4.3 Qualifications of knowledge brokers As either an individual or an institution, knowledge brokers perform core knowledge translation tasks (23,75,77). They possess: • an in-depth understanding of the research and policy communities, allowing them to develop relationships and trust across these communities, including by supporting the development of multidisciplinary research projects; • the ability to access and critically appraise research information, and then to synthesize it for specific audiences; • expertise in knowledge utilization, including a sound awareness of conduits into particular policy-making organizations and processes; and • experience in knowledge translation, which allows them to build the capacities of both researchers and research-users to foster knowledge translation. 1.5 NETWORKING AND KNOWLEDGE TRANSLATION “No one knows everything, everybody knows something” – Pierre Lévy (80) A network comprises groups of individuals, organizations and/or existing networks, which interact based on shared interests and goals (81). The creation and use of a network structure may be decided at operational, personal and strategic levels. KEY MESSAGES • Networks are a critical part of knowledge translation and offer the space to combine explicit and tacit knowledge to create products for addressing health priority issues. • Networking opens space for dialogue and joint value creation among researchers, policy-makers and civil society. • EVIPNet is a prime example of a knowledge translation network, bringing together interdisciplinary stakeholders to advance knowledge translation mechanisms and methodologies that ultimately improve health outcomes. 20 INTRODUCTION TO EVIPNET EUROPE 1.5.1 Comparative advantages of networks While an individual or a single organization is limited by its own resources and expertise, networks create a multiorganizational structure to expand mutually supportive actions to achieve individual and collective goals. Network coordination has many advantages. • Enhanced learning: Shared learning is often a network-level outcome and a rationale for collaboration. Capacity building, mentoring and sharing best practices can be a network- level activity. • Strategic advantages: A network structure can facilitate effective communication and sharing of priorities, organizational changes, and resource mobilization that are otherwise not possible without vertical and horizontal linkages in a network. • Increased and diversified authority, resources and expertise: These advantages are particularly manifest in horizontal networks with multidisciplinary, cross-organizational environments. • Mutual accountability and healthy competition: These allow network-level outcomes to be achieved collectively. • Shared risks: A new or untested endeavour or cost intensive project, for example, may be a strategic reason for a network structure. 1.5.2 Knowledge translation networks A knowledge translation network may assume similar functions to a knowledge broker (see section 1.4), but it exceeds the knowledge brokers’ role as an intermediary or a catalyst of knowledge translation. The key activities of a knowledge translation network are outlined below. • Space for regular multistakeholder engagement, institutionalized interaction and partnership creation: Beyond the typical knowledge broker functions of facilitating push, pull and exchange efforts (see section 1.1), EVIPNet operates through multidisciplinary knowledge translation platforms. It brings together researchers, policy-makers and other stakeholders in an institutionalized manner to achieve policy influence. This includes the joint creation, synthesis, dissemination and promotion of the use of knowledge to shape policy and research agendas. Knowledge translation networks provide the opportunity for stakeholders to collaborate in partnership, develop and maintain trusting relationships and overcome barriers. • Routine exchanges, learning and communication with multiple stakeholders: This can include sharing lessons learned and peer-support among its members no matter their location. A network may identify and invite stakeholders essential to its own operation, or stakeholders outside the network who, for instance, are in a position to act upon the network’s knowledge products. • Joint identification of policy priorities: Based on internal relationships between researchers, policy-makers and other stakeholders, knowledge translation networks are well suited to identify policy-relevant knowledge gaps and policy priorities. They are able to mobilize resources to generate knowledge addressing these gaps. • Collaborative research: Knowledge networks support context-specific collaborative research on the real-world implementation of policies based on the best available evidence (82). This ensures that all stakeholders necessary for the successful roll-out 21 CONCEPTUAL BACKGROUND AND CASE STUDIES or scale-up of a promising intervention are working together to identify and overcome policy implementation challenges. 1.5.3 EVIPNet and knowledge translation networks EVIPNet is a prime example of a knowledge translation network, bringing together interdisciplinary stakeholders to advance knowledge translation mechanisms and methodologies that ultimately improve health outcomes. National and regional networks of researchers, policy-makers and civil society that support evidence-informed policy-making are the core form and function of EVIPNet Europe (see Introduction). EVIPNet operates on three closely interconnected levels. • The country level: Formalized networks of key national actors (including policy-makers, researchers and civil society representatives) known as a knowledge translation platform (KTP) are charged with planning and implementing knowledge translation activities and interventions (see section 2). • The regional level: KTPs share experiences, lessons learned and innovative approaches, supported and coordinated by the regional EVIPNet secretariats in the WHO regional offices. • The global level: The global EVIPNet Secretariat within WHO headquarters supports national and regional networks of KTPs and actively involves funders and other global stakeholders to create another layer of networking. 1.5.4 Network structures and forms related to EVIPNet at country level Table 1.2 outlines key features and forms of a network, and highlights the links with EVIPNet. Any network can assume one or a combination of these forms. In order to decipher which form(s) of networks are most relevant, influential and appropriate in a given context, an analysis of existing and potential stakeholders and their power dynamics and structures is crucial. EVIPNet Europe conducts national situation analyses to understand interactions among a country’s research and policy-making communities and identify opportunities and barriers in organizing and establishing a KTP (see section 3). A national EVIPNet Europe KTP may be initiated by its own members or convened or mandated by an external stakeholder. A network may have a combination of vertical and horizontal linkages depending on varying mandates, degrees of authority, resources and discipline. Some of these forms might be open (anyone can join) or closed (one must apply or be invited to join). They may be time limited or functioning for an indeterminate amount of time, or transitional and multidisciplinary. In summary, networks matter in knowledge translation processes. The dynamics of relationships among policy actors can have a significant effect on knowledge translation outcomes, as the literature often highlights (83–85). 22 INTRODUCTION TO EVIPNET EUROPE TABLE 1.2. NETWORK FORMS NETWORK FORM DESCRIPTION EVIPNET Formal Has a governance structure with budget, staff, etc. EVIPNet institutionalizes a formal network at national, regional and global levels, comprising policy-makers, researchers and civil society. This is called a knowledge translation platform (KTP) at a national level (see section 3). Informal Arising periodically to share ideas and expertise to advance work on a particular issue. In an early stage of implementation, an informal network made up of committed leaders and individuals (e.g. from a ministry of health and a research institute) may be formed while resources are mobilized, and capacity and awareness are built. Event specific Created for a specific event (e.g. delegates to an upcoming conference all share information and collectively prepare for the event). For EVIPNet’s stakeholder consultation meetings and policy dialogues, an ad-hoc network may be formed to plan, organize and implement events. Thematic Stakeholders are connected through their interest in a core issue (e.g. tobacco control). The network might determine a formal agenda (e.g. to lobby the government to raise taxes on tobacco products), and the types of knowledge products needed to effectively influence the government (e.g. an evidence brief for policy analysing local and regional evidence on the issue and suggesting concrete policy options). Resulting action from this thematic network could see researchers studying particular knowledge gaps, civil society groups highlighting critical implementation issues, and policy- makers contributing their experience and know-how in terms of how policy could be created, amended or shifted. In Zambia’s KTP, these thematic networks have taken the form of research-to-action groups, serving to crystallize the country’s expertise and interests in three broad groups. There is a group on mental health, another on human resources for health and a third on reproductive health. For more on Zambia’s KTP, see section 4.5. 23 CONCEPTUAL BACKGROUND AND CASE STUDIES TABLE 2.1. KNOWLEDGE TRANSLATION MECHANISMS KNOWLEDGE TRANSLATION MECHANISMS KEY CHARACTERISTICS Priority setting • shapes a policy and/or research agenda and determines which health topics should be addressed by knowledge translation platforms through an evidence brief and dialogue processes • includes priority setting for policy issues and priority setting for research • based on clear, objective and fair criteria Evidence brief for policy Synthesis of the best available global and locally produced evidence (explicit knowledge) • starts with a priority policy issue and then draws on the best available global research evidence (usually systematic reviews) alongside local data and studies that address the local context and realities Policy dialogue Deliberations among policy- makers, researchers and stakeholders that integrate explicit knowledge and tacit knowledge to guide policy development • informed by a pre-circulated evidence brief • stakeholder mapping helps to identify participants • a neutral facilitator ensures a fair and inclusive process • includes deliberations about the problem, options for addressing it and key implementation considerations (and in some cases next steps) • following the dialogue a summary of major points is disseminated to participants and other stakeholders Rapid response service User-friendly synthesis of high- quality research in a short timeframe • starts with a request from policy-makers about a specific high- priority policy issue or question • concisely summarizes research evidence for policy-makers in a short timeframe, typically within days, and at most a few weeks • does not typically include implementation guidelines • does not deliberately include both tacit and explicit knowledge • undergoes peer and/or expert review process to verify technical details Clearinghouse Repository of documents that allows users to easily access research evidence • includes a comprehensive and continually updated inventory of the best available and pre-appraised research evidence (usually systematic reviews) • presents research evidence in formats that highlight policy-relevant information and add value by providing other information (e.g. quality ratings, links to free full-text, links to related documents) • most often accessed online and usually free, removing barriers related to payment for access to full-text journal articles • packaged specifically for policy-makers and stakeholders • identification of documents to be included is a transparent and methodologically rigorous process 2. KNOWLEDGE TRANSLATION MECHANISMS This section introduces the core knowledge translation mechanisms of EVIPNet: priority- setting processes, evidence briefs for policy, policy dialogues, rapid response services and clearinghouses. A description of these mechanisms can be found in Table 2.1. 24 INTRODUCTION TO EVIPNET EUROPE The knowledge translation mechanisms best suited to a policy-maker’s needs depend on the timeliness and interaction with users that are required, as shown in Fig. 2.1. Further information about each of these knowledge translation mechanisms, including real-world applications, are included as part of the case studies in section 4. At the end of this section, readers should be able to: • explain the role priority setting plays in knowledge translation (section 2.1); and • describe the key characteristics of evidence briefs for policy (section 2.2), policy dialogues (section 2.3), rapid response services (section 2.4) and clearinghouses (section 2.5). 2.1 PRIORITY SETTING Priority-setting processes can be used in shaping a policy and/or research agenda. Priority setting has particular importance for an EVIPNet knowledge translation platform (KTP) in determining which health issues should be addressed through evidence briefs and dialogue processes. Given that every country has critically unresolved issues and stakeholders perceive these in different ways, KTPs use priority setting to select a health topic in a fair, transparent and legitimate way. Priority setting, in addition, may be useful for identifying gaps in the evidence base. KEY MESSAGES • Priority setting is a knowledge translation mechanism that identifies and ranks urgent issues, topics and/or research questions based on explicit, pre-defined criteria. • Priority-setting processes bring together policy-makers and a range of other stakeholders (e.g. professional associations and civil society representatives) to discuss their policy needs, and researchers to discuss the existing evidence base or knowledge gaps. • The dialogue inherent to priority setting builds relationships, trust and interactions among policy- makers, researchers and civil society. FIG. 2.1. OVERVIEW OF KNOWLEDGE TRANSLATION MECHANISM USE Evidence brief for policy + policy dialogue HIGH LOW Clearinghouse Rap id r esp ons e se rvic e TIMELINESS DAYS MONTHS AM O U N T O F CA TE R ED IN TE R AC TI O N W IT H K N OW LE D GE U SE R Source: Michael Wilson, McMaster, unpublished observations, 2013. 25 CONCEPTUAL BACKGROUND AND CASE STUDIES BOX 2.1. THE CONVERGENCE OF PRIORITY SETTING Priority setting is a formal process where policy-makers can discuss their policy needs. Researchers can discuss the types of knowledge or methods that might answer those needs, or existing knowledge gaps. Other stakeholders can provide their own perspective on the knowledge needed to help solve pressing problems. As a knowledge translation mechanism, priority setting is a unique and powerful intervention that connects research and policy processes. 2.1.1 Major types of priority-setting processes The two major types of priority setting are for policy issues and for research. Priority setting for policy issues is closely linked to the agenda-setting stage in the policy development process (see section 1.2.4). When knowledge translation practitioners try to determine which priority issues are most likely to gain traction and where to focus their knowledge translation efforts, the following model could be considered. Kingdon’s “three streams” model explains why some policy issues rise to become priorities, while others do not (86). Overall, the model suggests that issues become priorities for decision-making (i.e. they make it on to a government’s decision agenda) when a policy entrepreneur combines compelling problems (stream I) with viable solutions (stream II) within a conducive political environment (stream III) (86). Priority setting for research, on the other hand, involves deliberative techniques to create consensus on the priorities for a research agenda. Three questions are being addressed. • What are the (general or specific) research needs of policy-makers? • What are the present gaps in the research evidence? • What types of research could best fill those gaps? Both priority-setting types: • require clear, objective and fair criteria to determine the knowledge needs (see section 2.1.2); • rely on the participation of a range of stakeholders (researchers, policy-makers and other stakeholders), which have been purposefully selected based on stakeholder mapping and analysis; • usually result in a ranked list of priority topics or priority research questions. Achieving consensus, however, is not a necessary requirement of any priority-setting exercise (87,88). The process of dialogue and building social relationships, trust and interactions that are essential to a strong health system is just as important as the product itself for knowledge translation. KTPs should use a stakeholder mapping exercise to determine who should be involved in any priority-setting process. 2.1.2 Criteria for priority setting Determining explicit criteria for a specific priority-setting exercise is crucial to allow a group to objectively weigh, analyse and determine what is a priority and what is not, and how 26 INTRODUCTION TO EVIPNET EUROPE seemingly equal priorities measure against each other (89). This is particularly important, as priority setting involves value decisions (e.g. Why does stakeholder X consider topic A more important than topic B?). Although not an inclusive list, the criteria listed below are often used in priority setting for research, and should be adapted to priority setting for policy issues (86). • Magnitude, relevance and urgency: Will the research be needed within the next 3–5 years? Will the issue at hand still be a priority in five years’ time? (91,92) • Applicability, deliverability, affordability and sustainability: Is the research highly applicable to its context? Will the research study or inform the development of interventions that are deliverable, affordable and sustainable? (93) • Maximum potential to reduce disease burden equitably: Will the research address issues designed to reduce poor health outcomes across all dimensions of a society? (93,94) • Originality: Is the issue under researched or is there an existing knowledge base? (91,92) • Research capacity and feasibility: Do the skills exist to do the research? Is it feasible financially, technically, socioculturally and ethically? (92,93,95) • Policy relevance: Will the research influence health policy decision-making? (91) • Expected impact of the research: Will the impact of the research be greater than its relative cost? (95) Table 2.2 describes some of the steps involved in conducting a priority-setting process. See Campbell (23) and El-Jardali (90) for more information. 2.2 EVIDENCE BRIEFS FOR POLICY 2.2.1 Research evidence and policy-making KEY MESSAGES • Evidence briefs for policy are a core knowledge translation mechanism. They package the synthesis of the best available research evidence in a way that is accessible, relevant, easy to use and applicable for policy-making. • Evidence briefs for policy begin with the identification of a high-priority issue within a specific policy context and include descriptions of a problem, policy options and implementation considerations. • Evidence briefs for policy are deliberated, validated and further complimented with tacit knowledge at policy dialogues. A central challenge in the use of research evidence is that policy-makers often do not consider evidence relevant to their decision-making (96). Existing evidence syntheses, such as systematic reviews, are of limited use for policy-makers as they are typically not adapted to the local context and are not written with policy-makers in mind. This causes policy- makers to “hear noise, not music” (97). Above all, policy-makers require high-quality research evidence that is accessible, understandable and contextualized, factoring in implementation and financial considerations (24,97). 27 CONCEPTUAL BACKGROUND AND CASE STUDIES TABLE 2.2. A PRIORITY-SETTING CHECKLIST BEFORE THE PRIORITY-SETTING PROCESS 1. Context: Which contextual factors underpin the process? What are the underlying values and/or principles? What is the reason for the process? What resources are available? 2. Approach: Is it comprehensive, appropriate and suited to context? Is guidance for the process structured, detailed and step-by-step? 3. Inclusivity: Who will be involved in the process? Is representation of expertise, disciplines, gender, regions, etc. sufficient? Have other sectors or constituencies been consulted and/or included? 4. Information: What information will inform the process? This could be literature reviews, technical data, stakeholder survey reviews or evaluations of previous priority-setting exercises, etc. 5. Planning for implementation: Are plans in place to either implement or enforce the priorities? Who will implement the identified research priorities? DURING THE PRIORITY-SETTING PROCESS 6. Criteria: How will criteria for the process be determined? 7. Methods for determining priorities: How will the stakeholders ultimately decide among priorities? Will they use a consensus-based approach or a metrics-based approach (pooling individual rankings) or a combination? AFTER THE PRIORITY-SETTING PROCESS 8. Evaluation: When and how will evaluation of the priorities and of the process take place? 9. Transparency: Write and disseminate widely a report documenting who set the priorities and how. 2.2.2 Key features of evidence briefs for policy Evidence briefs for policy address this challenge by synthesizing the best available global research evidence (generally in the form of systematic reviews) with locally produced evidence and other studies to cater to what is most relevant to the policy process. In the knowledge translation literature, the term “local evidence” is often used to describe locally generated evidence that studies domestic issues. In many cases, this local evidence is not formally databased and is thus not accessible beyond the country, city or institution in which it was produced. Evidence briefs maximize user-friendliness and quality by packaging research evidence in a way that is accessible, relevant, easy to use and applicable in a given national context (98). Evidence briefs begin with a priority-setting process – the identification of a high-priority issue within a specific policy context (98). The brief includes a description of the problem and its context and an exploration of three policy options that address the problem. For each policy option, the briefs include cost effectiveness, benefits and harms. In addition, they explore policy-relevant information such as each policy option’s costs, barriers to implementation, stakeholder views, lessons learned from past implementation of these options and any associated uncertainties (26,98). Knowing how another jurisdiction Source: Adapted from Viergever (95). 28 INTRODUCTION TO EVIPNET EUROPE addressed a problem and implemented a solution is, for instance, often extremely valuable at the policy level (55). 2.2.3 Graded entry In order to improve the accessibility, timeliness and ease of use, evidence briefs are written using a graded-entry format, known as the 1:3:25 format, to reflect page length. This format allows the reader to quickly assess the brief’s relevance and whether it warrants a fuller read-through. Graded entry keeps research language and jargon to a minimum while maintaining transparency and thoroughness in its methodology (98). The graded entry format provides three different summaries: • a one-page sheet of take-home messages that summarizes the brief’s major contributions (intended for high-level policy-makers with limited time and/or evidence-comprehension abilities); • a three-page executive summary that provides more detail and context around the brief’s major contributions (intended for a more general policy-maker audience); and • a 25-page report that presents the research evidence and contextual factors much more comprehensively (intended for scientific advisors or researchers connected to the policy- making process). Additional resources on developing an evidence brief for policy can be found in the SUPPORT Tools for evidence-informed Policy-making (STP) (99) and The SURE Guides for preparing and using evidence-based policy briefs (41) described in section 5.1.1. 2.2.4 Evidence briefs for policy and policy dialogues Once an evidence brief is drafted and peer- and merit-reviewed, it is further deliberated and validated at a policy dialogue with researchers, policy-makers and other key stakeholders (see section 2.3). While research evidence is central, a policy dialogue provides an opportunity to compliment the evidence brief with tacit knowledge and political considerations. An effective policy development process depends on the active participation of policy-makers at several different points. These include identifying a topic for the brief, participating in deliberative dialogue and pushing forward next steps that may lead to the formulation of a policy. Given that the policy development process does not always lead to the development of a new policy, per se, the evidence brief and deliberative dialogue process can also result in: • a shift in how key policy-makers and stakeholders conceive of policy problems and/or appropriate options; • a decision to develop another evidence brief and convene another dialogue in order to fully understand a new conceptualization of problems and/or options; and • a decision on how to improve the implementation of existing policies, or that nothing should be done (i.e. a “no go” decision). 29 CONCEPTUAL BACKGROUND AND CASE STUDIES Regardless of what the evidence brief and dialogue process result in, the important point is that the process systematically and transparently integrates what is known from the best available research evidence with all of the other factors (e.g. stakeholders’ views and experiences, contextual factors) that influence policy development. 2.2.5 Evidence briefs for policy and EVIPNet KTPs Evidence briefs for policy are used as a core mechanism by almost every knowledge translation platform (KTP). These briefs have focused on many issues, including task shifting, improving the delivery of maternal and child health care and increasing adherence to tuberculosis treatments. The case studies in section 4 provide further examples of evidence briefs, and a list of published EVIPNet evidence briefs is available on the WHO website (100). 2.3 POLICY DIALOGUES Policy dialogues are a knowledge sharing mechanism that convenes researchers, policy- makers and other stakeholders – typically in a meeting or workshop format – for facilitated discussions on a high-priority issue. Policy dialogues allow stakeholders to consider the best available research evidence alongside real-world factors, facilitating decision-making processes that are strongly evidence-informed (71). When local research evidence is not available, a policy dialogue is a good mechanism for utilizing local tacit knowledge. 2.3.1 Policy dialogues and evidence briefs EVIPNet policy dialogues use evidence briefs as a pre-circulated input to ensure all dialogue participants have the same knowledge baseline (26). While the evidence brief presents the best available evidence, the dialogue takes into account context, experience, needs and politics. This kind of structured discussion can “help to clarify the problem and solutions and to develop a shared understanding among stakeholders; contribute to the development and implementation of effective policies; and contribute to good governance and democracy” (41). In addition to evidence briefs, other documents and information may be relevant and useful to the policy dialogue process. KEY MESSAGES • Policy dialogues allow policy-makers to consider research evidence alongside the views, experiences and lessons learned (tacit knowledge) from major stakeholders (e.g. civil society groups) affected by decisions on the issue. • The policy dialogue is informed by a pre-circulated evidence brief for policy. • The end goal of the policy dialogue is often not consensus, rather it is a means for considering all inputs – including research evidence – to the policy-making process. 30 INTRODUCTION TO EVIPNET EUROPE 2.3.2 Guidance for conducting policy dialogues Table 2.3 lists the characteristics that differentiate a policy dialogue from a debate. The policy dialogue may also follow rules that create a safe space, such as the Chatham House Rules, where participants may speak confidentially, without fear of formal attribution (71). As the activity is a dialogue and not a debate, the end goal is typically not to reach consensus for policy action (71). The policy dialogue is considered one input into the policy development process, and thus not an end-point for policy-makers (in some examples in Africa, however, dialogue participants decided to pursue consensus in order to have firm policy guidance). Policy-makers may require additional consultation with other stakeholders relating to institutional constraints and interest groups before finalizing a policy decision (101). 2.3.3 Policy dialogue participants Policy dialogue participants are those involved in or likely to be affected by decisions on the issue at hand, including researchers, policy-makers and civil society groups. Stakeholder mapping exercises can help organizers determine the final composition of attendees. Organizers complete an inventory of relevant stakeholders with role categories (e.g. policy- makers, researchers, youth group, etc.). They then select participants based on their ability to (i) articulate the views and experiences of their affiliation, and effectively engage and learn from other participants; and (ii) support and advocate for the actions that will address the needs and perspectives of their affiliations (71). 2.3.4 Policy dialogue facilitators A skilled and neutral facilitator is instrumental to ensuring inclusivity, fairness and the principles of the policy dialogue (71). The specific roles of a facilitator include: • clarifying the goal, objectives and expectations of a dialogue; • drawing out different opinions, values and beliefs, while maximizing the participants’ contributions to the group in a fair, inclusive and respectful manner; and • intervening and stewarding as necessary in order to keep the participants to the agenda and objectives. TABLE 2.3. DIFFERENCES BETWEEN DIALOGUE AND DEBATE DIALOGUE DEBATE Collaborative Common ground Enlarges perspectives Searches for agreement Causes inuospection Looks for strengths Re-evaluates assumptions Listening for meaning Remains open-ended Oppositional Winning Affirms perspectives Searches for differences Causes critique Looks for weaknesses Defends assumptions Listening for countering Implies a conclusion 31 CONCEPTUAL BACKGROUND AND CASE STUDIES Convening a policy dialogue is one of the core tasks of a knowledge broker, thus policy dialogue facilitators need to have similar attributes and qualifications, such as credibility and neutrality (see sections 1.4.1–1.4.3). 2.3.5 Post-dialogue events Following the policy dialogue, a summary of its major points is disseminated to participants and to other concerned stakeholders, including the media. Video interviews of participants describing the insights from the policy dialogue and critical actions for addressing the issue can also be used to disseminate the results. When new evidence emerges about the priority issue, it should be shared to add momentum to proposed actions from the policy dialogue (71). More information about how policy dialogues have been used in the policy-making process can be found in the case studies in section 4. 2.4 RAPID RESPONSE SERVICES Policy-makers often work within timelines of days and weeks, rather than months and years (102,103). When political factors come into alignment on a particular issue, a window to influence policy opens for a limited amount of time, and policy-makers must act quickly (86). For research evidence to become a timely input into the policy decision-making process, it must be readily available and accessible to policy-makers, sometimes in a matter of only hours (86). Similarly to evidence briefs and policy dialogues, a rapid response service can provide high- quality research syntheses on a priority issue, but in a much shorter time. In a timeframe of hours to days to weeks, a team of researchers can provide policy-makers or other demanders with a synthesis of research evidence. This is in contrast to the months and years required for completing a systematic review or primary study, or to the months needed to systematically and transparently prepare an evidence brief and convene a policy dialogue (98,104). A rapid response service often specifies deliverables and timelines, although some services respond exactly as the requestor requires (104,105). For very short timelines (e.g. 1–2 days), a rapid response service may only provide a list of relevant references; for longer timelines (e.g. 1–3 weeks), such a service can generate a much more thorough synthesis of the key findings (104,105). Aside from the quick turnaround, a rapid response has several key limitations when compared to an evidence brief. First, a rapid response is not necessarily oriented to a policy KEY MESSAGES • A rapid response service starts with a request from a policy-maker about a specific, high-priority issue he/she is facing. • It provides policy-makers with a user-friendly synthesis of the best available research evidence. • It is tailored to the timelines of policy-makers, which range from days to weeks, rather than months to years. 32 INTRODUCTION TO EVIPNET EUROPE decision, and often does not feature governance, delivery, financial and/or implementation considerations. Second, it does not go through the same deliberative steps to combine tacit and explicit knowledge – it is almost entirely a synthesis of explicit knowledge. Third, while a rapid response is peer-reviewed, it is not subject to revision and commentary through a policy dialogue process. 2.4.1 Steps in a rapid response Once the rapid response team has refined the topic or problem, it searches of the scientific literature to locate key information sources, and contacts experts in the field for additional counsel (104,105). The team creates a synthesis of the key findings, which typically aims to concisely summarize the research evidence in a way policy-makers find useful (104,105). On completion, the synthesis undergoes a formal peer-review or verification process. Some rapid response services utilize a panel of researchers and policy-makers, while others invite recognized experts to verify technical details. If the policy-maker or demander requires the synthesis before this peer-review or verification process is complete, a draft copy is provided and if discrepancies later arise, they are promptly notified. 2.4.2 Rapid response service pilot phases The sustainability of the rapid response service model depends on the demand. In Canada, a rapid response team was progressively created within the Ontario HIV Treatment Network as the number of requests originating from partner organizations and agencies seeking timely access to research evidence increased. In other instances, pilot phases have been so successful that “once we turned on the tap, we could not turn it off” (Mijumbi R, REACH Uganda Rapid Response Service, personal communication, 2013). In this sense, the development and sustainability of a rapid response service is demand driven. In turn, the service helps deepen the culture of research evidence use. Without a rapid response service, many organizations and stakeholders would not use research evidence in their work since organizations rarely possess the capacity to synthesize research quickly. Rapid response services have become successful in many countries. Several EVIPNet countries including Cameroon, Kenya, Uganda and Zambia, have launched such services with great success, while other countries are establishing their own services. More information on how rapid response services are being implemented can be found in the case study on Uganda in section 4.3. BOX 2.2. PROBLEM CLARIFICATION As shown in the Ugandan experience in piloting a rapid response service (see section 4.3), policy-makers have difficulty formulating their concerns into answerable research questions. A rapid response begins with a problem clarification process where the requestor and researcher discuss the specific policy issue and the kind of interventions that may be considered. Since staff workload varies with requests from policy-makers, organizations hosting a rapid response service often have difficulty balancing and prioritizing staff time. Organizations mitigate this challenge by diversifying the tasks for staff to work on. 33 CONCEPTUAL BACKGROUND AND CASE STUDIES 2.5 CLEARINGHOUSES One challenge for the uptake of evidence is that research is not easy to use, and is rarely available when policy-makers need it and in a form that they can use (24,35,74). Clearinghouses allow lay audiences such as policy-makers and stakeholders to quickly access high-quality research evidence. Clearinghouses are repositories of documents that act as a “one-stop shop” for users seeking research evidence, relevant to and packaged for policy-makers and other research-users (74,106). Documents included in clearinghouses are identified through a transparent and methodologically rigorous search strategy and appraisal. Table 2.4 lists examples of clearinghouses. Through clearinghouses, users can be confident that the research evidence they access is up to date, relevant and rated for quality. Once identified for inclusion in a clearinghouse, the research evidence is categorized with a topic-specific taxonomy to allow for easy retrieval. TABLE 2.4. EXISTING CLEARINGHOUSES FOR SYNTHESIZED EVIDENCE RELATED TO HEALTH SUBJECT(S) ADDRESSED LINK Cochrane Review Programmes, services and drugs http://www.cochrane.org/ cochrane-reviews Health Evidence Public health interventions http://www. healthevidence.org Health Systems Evidence Health systems governance, financial and delivery arrangements, and implementation strategies http://www. healthsystemsevidence. org EVIPNet A resource that draws on many sources that address programmes, services and drugs, public health, and health systems, to support evidence- informed policy http://global.evipnet.org/ KEY MESSAGES • Clearinghouses are “one-stop shops” that include a comprehensive inventory of best available and pre-appraised research evidence for policy-makers and other stakeholders to quickly access in user-friendly formats. • Documents are identified through a transparent and methodologically rigorous search strategy and then categorized with a topic-specific taxonomy. • Clearinghouses are the most “self-serve” option for accessing research evidence (see Figure 2.1). 34 INTRODUCTION TO EVIPNET EUROPE 2.5.1 Online clearinghouses Clearinghouses are most often available online and are usually free of charge. Health Systems Evidence (see Table 2.4), for instance, provides links to free full-text articles whenever available, with a one-page summary of the content (74,107). Clearinghouses recognize that researchers need to stay up to date with evidence on specific topics. Thus, they provide a customizable evidence service, allowing users to identify areas of interest and receive periodic digest updates whenever relevant documents are added to the clearinghouse (74). Clearinghouses enable users to rapidly identify key documents whenever and wherever they need them (108). Policy-makers can also be sure they are making their best effort to gather evidence given the time invested. Users, however, need skills in accessing the most appropriate databases and interpreting the evidence. In response, EVIPNet is developing capacity-building initiatives for policy-makers (109). More information about how clearinghouses have been created and successfully implemented can be found in the case study on Uganda in section 4.3. 35 CONCEPTUAL BACKGROUND AND CASE STUDIES 3. KNOWLEDGE TRANSLATION PLATFORMS A knowledge translation platform (KTP) brings together the worlds of research and policy. KTPs are a core element of EVIPNet Europe as it launches and leads knowledge translation interventions. These platforms convene dialogues, synthesize explicit and tacit knowledge and lead networking. KTPs implement or delegate many key mechanisms including evidence brief and policy dialogue exercises, rapid response services, clearinghouses, and priority- setting exercises (see section 2). Now established in over 40 countries around the world, KTPs undertake some or all of the following activities: • organizing and facilitating joint meetings (e.g. priority-setting exercises, policy dialogues) among multiple actors to identify how research and policy processes might connect; • inviting policy-makers to participate in research processes; • compiling an inventory of local researchers, institutions, agencies and funders to describe the local evidence base, and illustrate who is doing and funding what; • synthesizing and packaging research (e.g. preparing evidence briefs for policy); • strengthening the capacity of researchers (e.g. in writing syntheses), research-users (e.g. helping the media to interact with research and researchers), and policy-makers (e.g. in research methodologies or in the role research might play in the policy process); and • leading advocacy efforts to disseminate and support the use of research evidence, along with other core knowledge products. This section will provide an overview of KTPs, including organizational structures, functions, guidelines for setting up a KTP and challenges that may be encountered when establishing one. At the end of this section, readers should be able to describe: • the different organizational forms a KTP might take (section 3.1) • steps to consider in developing a KTP (section 3.2.1–3.2.2) • challenges in establishing a KTP (section 3.2.3). 3.1 KTP FORM AND FUNCTION Planning to create and launch a KTP should include consideration of possible organizational forms (including options for its location, funding, staffing and governance) as well as the functions or activities the KTP may carry out (see Box 3.1). KEY MESSAGES • A knowledge translation platform (KTP) can take one of three established organizational forms. • Fundamental to establishing a KTP is determining the values it will maintain. • The EVIPNet action cycle represents a possible sequence of KTP activities. 36 INTRODUCTION TO EVIPNET EUROPE 3.1.1 Organizational form There are six commonly established organizational forms for a KTP (110). Table 3.1 groups these forms into three distinct categories, with defining characteristics listed for each, along with a consideration of potential strengths and weaknesses. In some instances, a KTP might initially operate best as a partnership of individuals in a ministry of health and a research institute. This kind of piloting can allow both parties to understand the potential value of a KTP before proceeding to the creation of a formalized organization. Part of establishing a KTP is to demonstrate its values including credibility, innovation, continuous learning and networking. A KTP draws on innovative approaches to fairly balance explicit and tacit knowledge, arriving at policy options to support the decision-making process. As KTPs are a new organizational form, it is key for them to document and communicate achievements and best practices, and share these with stakeholders and other KTPs. 3.1.2 KTP activities Newly formed KTPs may initially embark on activities that are simple and have a great probability of success. They may engage in multiple activities to demonstrate their value to the target audience, and expand their work areas as the momentum builds. Table 3.2 outlines some of the possible activities and functions that could be adopted by a KTP as well as suggested resources. 3.1.3 The EVIPNet action cycle An EVIPNet KTP often incorporates into the action cycle several of the functions detailed in section 3.1.2. The six steps of the EVIPNet action cycle are illustrated in Fig. 3.1., and described in more detail below. BOX 3.1. DESIGNING ORGANIZATIONAL MODELS TO SUPPORT KNOWLEDGE BROKERING IN EUROPEAN HEALTH SYSTEMS – THE BRIDGE PROJECT If the goal of knowledge-brokering organizations [such as a KTP] is to serve as credible, competent and catalytic bridges between researchers and policy-makers, they need to organize themselves so as to: • inform policy-making in an objective manner using the best health-systems information that can be prepared and packaged given time and resource constraints; • inform the production, packaging and sharing of health-systems information in an objective manner and based on current and emerging policy-making priorities; and • employ and continuously improve information-packaging and interactive knowledge-sharing mechanisms that are based on a solid understanding of all aspects of the national policy-making context, operate in an objective manner, and complement other national, European and global mechanisms. Source: Lavis et al. (110) 37 CONCEPTUAL BACKGROUND AND CASE STUDIES TABLE 3.1. KTP ORGANIZATIONAL FORMS KTP as a stand-alone, independent organization (e.g. forum, think tank) General characteristics • often located in civil society • has new, formal, physical office premises • requires dedicated funding • governed by a board of directors Potential strengths • can advocate for policy reform/ adoption • can leverage its autonomy into neutrality/credibility in policy debates • potential to be a strong/ neutral broker among key health system actors • freedom to hire most-capable staff Potential weaknesses • high start-up costs (e.g. in creating new office premises) • potential financial/institutional instability • potential conflict of interest via donor support • may, through its advocacy efforts, alienate political stakeholders KTP hosted at another organization (e.g. at a policy-making entity, university, national research organization, parastatal organization, etc.) General characteristics • office premises at existing organization, to which it has formal ties (e.g. through a memorandum of understanding or partnership agreement) • governed by a supervising unit Potential strengths • can capitalize on existing organizational strengths, networks, employees, etc. • no need to create new operational systems (e.g. human resource, payroll etc.) • already part of an established actor, which may serve to attract highly qualified staff and provide a recognizable or esteemed brand identity etc. • connected to policy-making processes, giving its work a higher probability of influence • can quickly identify policy needs • can broker the development of research–policy partnerships Potential weaknesses • may have to align interests with existing organizational positions, bureaucracy or culture of host organization, which may negatively affect its abilities to advocate or broker • operations may be slowed or impeded by the organizational bureaucracy of the host organization • staff/finances may be drawn into other organization business KTP as a network General characteristics • without office premises: could be a virtual organization • operates through key individuals and/or organizations • run via consultancy contracts, in-kind and volunteer contributions with staff widely dispersed Potential strengths • light organizational structure • can employ best-suited staff without regard for geography • few organizational constraints to advocacy • can swiftly broker among actors (e.g. no bureaucracy to navigate) Potential weaknesses • key individuals leading or working for network may only work on a time-limited basis • virtual operations: dependent on internet connection; may not be taken as seriously as a physical organization; may have credibility issues • may have financial constraints Note. KTP = knowledge translation platform. 38 INTRODUCTION TO EVIPNET EUROPE TABLE 3.2. OVERVIEW OF KTPS’ KEY KNOWLEDGE TRANSLATION FUNCTIONS KEY KNOWLEDGE TRANSLATION FUNCTIONS DESCRIPTION OF HOW THE KTP MAY WISH PURSUE THE ACTIVITY OR FUNCTION ILLUSTRATIVE EXAMPLES AND RESOURCES Organization of a knowledge translation platform or team Those interested in establishing a new KTP, or strengthening an existing one, may work through: • decisions about the optimal organizational model; and • determining how best to pursue individual and institutional capacity-building to support the full range of knowledge translation activities they wish to pursue. Lavis et al. (2013) (110) Uneke et al. (2015) (111) Priority setting As an initial step, the KTP may wish to convene one or more deliberative priority-setting exercises that could determine the most important areas and activities the KTP should work on or help determine various research agendas. Section 2.1 Campbell (2012) (23) Campbell (2010) (89) El-Jardali et al. (2010) (90) Evidence brief and policy dialogue A newly formed KTP may wish to consider how to ensure the following key roles: • synthesizing and packaging research (when developing an evidence brief for policy); • creating linkages and exchange between research and policy; • facilitating meetings among multiple actors (e.g. priority setting or policy dialogue). Sections 2.2 and 2.3 Moat et al. (2014) (26) SURE Collaboration (2011) (41) Lavis et al. (2009) (71,98) Clearinghouse While several sources provide “one-stop shopping” for the best available global evidence (i.e. systematic reviews), in many countries, a single common resource (either physical or online) housing all local research evidence does not exist. As such, some KTPs have focused on developing clearinghouses featuring both primary local research evidence and synthesis work that often brings together the best available global evidence with local evidence. Section 2.5 Uganda Clearinghouse for Health Policy and Systems Research (112) Rapid response service Rapid response services are one of the most common activities that KTPs pursue, although they often require significant investments of resources (both human and financial) and time to ensure that they can effectively respond to policy-makers’ requests. A KTP may perform or delegate this service. Section 2.4 EVIPNet REACH (113) Mijumbi et al. (2014) (29) Capacity- building Many KTPs have focused on strengthening the capacity of core knowledge translation actors, including: • policy-makers – to improve their abilities to access, assess, adapt and apply research evidence; • researchers – to perform knowledge translation techniques or design knowledge translation strategies; • the media – to demand and use research evidence; and • civil society – to better contribute to the production and utilization of research evidence. Kasonde and Campbell (2012)(6) 39 CONCEPTUAL BACKGROUND AND CASE STUDIES 2 SEEKING EVIDENCE 3 SUMMARIZING EVIDENCE: EVIDENCE BRIEF FOR POLICY 1 SETTING PRIORITIES FOR POLICY ISSUES TO BE ADDRESSED CONVENING A DELIBERATIVE DIALOGUE 4 5 SUPPORTING POLICY CHOICE AND IMPLEMENTATION 6 MONITORING AND EVALUATION FIG. 3.1. EVIPNET ACTION CYCLE KEY KNOWLEDGE TRANSLATION FUNCTIONS DESCRIPTION OF HOW THE KTP MAY WISH PURSUE THE ACTIVITY OR FUNCTION ILLUSTRATIVE EXAMPLES AND RESOURCES Development of research-to- action groups (RAGs) RAGS are a decentralized, networked component of the KTP, focusing knowledge translation activities on a specific issue (e.g. mental health), on identified policy priorities, and/or in developing an evidence brief for policy. RAGs have a decentralized leadership (i.e. they are led by someone other than the KTP’s leader) and work to identify all the relevant stakeholders and dynamics within that issue. Critically, they serve to identify the individuals within the issue domain, be they policy-makers or researchers, with KTP leadership serving to mentor them as need be. RAGs may also lead evidence briefs, policy dialogues, training and the development of other RAGs, and identify young researchers for mentoring. Kasonde and Campbell (2012) (6) Communications and advocacy Communications and advocacy are routine activities for KTPs. This can be as simple as issuing a press release to signify that a policy dialogue will be convened. A KTP should work to be visible and relevant; having strong communications and advocacy skills and good programming are a key part of this. A KTP typically advocates for a particular policy issue (as in the evidence brief/policy dialogue model), for behaviour change (e.g. through media dissemination of the implications of health research) and for a climate more favourable for knowledge translation. This includes advocating for increased funding for health research in general and for knowledge translation activities in particular. Campbell (2012) (23) Note. KTP = knowledge translation platform. 40 INTRODUCTION TO EVIPNET EUROPE Step 1. Setting priorities for policy issues to be addressed: The KTP periodically organizes priority-setting processes to identify and frame public health policy and/or health system priority issues that they anticipate facing in the next 6–18 months and over longer time scales. These issues will be converted into topics for evidence briefs for policy, systematic reviews and/or new primary research. Step 2. Seeking evidence: Once a health priority issue is identified, the KTP develops a searchable research question and a search strategy. Next, it finds, retrieves and maps relevant evidence, and appraises its quality. Finally, it examines the findings in terms of local applicability (assesses stakeholders’ values and beliefs, power dynamics among actors, institutional constraints and donor funding flows) while taking related benefits, damage, costs and equity into consideration. Step 3. Summarizing evidence: In this step, the KTP summarizes and packages the relevant information in a user-friendly format (e.g. an evidence brief) to frame the priority policy issue; outline the governance, delivery and financial considerations for viable policy options; and set out potential implementation issues. Step 4. Convening a deliberative dialogue: A deliberative dialogue convenes key national stakeholders concerned with the priority policy issue addressed in the evidence brief to: discuss factors that influence decision-making about the issue; capture the tacit knowledge, views and experiences of stakeholders; and identify key next steps for different constituencies. Step 5. Supporting policy choice and implementation: In this step, the KTP fosters the integration of the findings into policy formulation and the implementation of actions. Step 6. Monitoring and evaluation (M&E): KTPs regularly monitor and evaluate their processes and results, and assess whether observed changes can be attributed to their interventions. The M&E findings should inform KTPs whether to continue, change or cancel activities. It is worth noting that not all potential KTP activities are represented in the action cycle above. Only the three most innovative EVIPNet KTP activities – priority setting, evidence briefs and policy dialogue – are included. A KTP may opt to integrate any of the other knowledge translation mechanisms described in section 2. 3.2 KTP ESTABLISHMENT, OPERATIONALIZATION AND LAUNCH This section outlines some of the key steps in establishing, operationalizing and launching a KTP, including the development of strategies, work plans and terms of references for KTP members. These steps are relevant to country teams who support EVIPNet activities prior to a formal launch of a KTP. A country team may comprise members of the WHO Country Office and key stakeholders from policy and research communities as well as civil society. 3.2.1 Steps in the KTP development process EVIPNet Europe assists country teams in selecting an optimal KTP form through direct technical support and a series of guidance documents that explain important steps in the 41 CONCEPTUAL BACKGROUND AND CASE STUDIES process. EVIPNet Europe suggests three broad steps for countries to complete in taking a KTP from idea to organization, as shown in Fig. 3.2. These development steps are sequential and are illustrated in more detail in Fig. 3.3. In the first step, situation analysis, the country team collects information on existing barriers and opportunities to strengthen evidence-informed policy-making. This includes an assessment of the national context and the major political, public health, socioeconomic and cultural factors influencing evidence-informed policy-making. It looks at the health system and health research system – its structures, capacities, activities and actors related to evidence-informed policy-making – and reviews already existing policy processes in the country. This analysis provides essential background information required to inform decisions on the establishment and operationalization of a KTP. The EVIPNet Europe situation analysis manual (114) provides approaches and tools that country teams can apply in conducting this assessment. INTENT TO CREATE A KTP GENERAL CONSENSUS AMONG MAJOR STAKEHOLDERS ON THE NEED FOR A KTP STEP 1. SITUATION ANALYSIS WHAT IS THE COUNTRY'S EVIDENCE-INFORMED POLICY CONTEXT AND WHO ARE THE ACTORS? STEP 2. KTP SCENARIOS WHAT ORGANIZATIONAL FORM BEST SUITS THE CONTEXT? STEP 3. KTP OPERATIONAL STRATEGY WHAT ARE THE KTP'S STRATEGIC DIRECTIONS, ACTIVITIES AND RESOURCES? WHO ARE ITS STAFF? FIRST YEAR SECOND YEAR FORMAL KTP LAUNCH FIG. 3.2. THE THREE STEPS IN DEVELOPING A KNOWLEDGE TRANSLATION PLATFORM Note. KTP = knowledge translation platform. KEY MESSAGES • A knowledge translation platform (KTP) is led by an individual or organizational champion ensuring that it fulfils its mission and mandate. • A KTP must find “early wins” to immediately demonstrate its value. • A KTP should regularly evaluate its activities along with its overall achievements to make the necessary adjustments, and to determine a second phase of activities. • Engagement of multiple stakeholders is crucial in establishing and determining the programming for a KTP. 42 INTRODUCTION TO EVIPNET EUROPE In the second step, country teams use the findings to construct three distinct KTP scenarios. Each scenario explores an organizational model for a KTP, including establishment considerations, possible policy-making activities, the organizational model’s strengths and weaknesses and resource considerations. Stakeholders then convene to deliberate and assess each scenario against a set of criteria. Enriched by the tacit knowledge of stakeholders, the scenarios are submitted to the ministry of health and other key national stakeholders for final decision-making. The first and the second steps may take anytime between six months to a year. Once a decision has been made about the type of KTP to pursue, in the third and final step, the country team (or other designee) develops a formal strategy to operationalize the KTP, often through the creation of a strategic plan, business plan and/or operational plan. Steps 2 and 3 are estimated to take between three months and one year depending on local context. In many cases, country teams will hire consultants to lead specific aspects of the process. It is essential to secure, at minimum, one national consultant for 60 days to implement steps 1 and 2, and 10 working days for step 3. The WHO Secretariat of EVIPNet Europe at the WHO Regional Office for Europe assists in the development of KTPs throughout the Region, with an initial focus on low- and middle-income countries. The EVIPNet Europe guidance documents for country teams developing a KTP are available from the WHO website (http://www.euro.who.int/en/data-and-evidence/evidence-informed- policy-making/evidence-informed-policy-network-evipnet). 1 3 2 COUNTRY TEAM CREATES OPERATIONAL STRATEGY FOR ESTABLISHMENT AND LAUNCH OF KTP COUNTRY TEAM PLANS ACTIVITIES AND COLLECTS DATA FOR THE SITUATION ANALYSIS DEVELOPING A KTP IN THREE STEPS PRODUCES A FINAL SITUATION ANALYSIS REPORT FORMAL LAUNCH OF THE KTP CREATES WORK PLAN TO IDENTIFY STAFF, OFFICE LOCATION, ACTIVITIES ETC. COUNTRY TEAM DEVELOPS 3 KTP SCENARIOS STAKEHOLDERS SELECT THE BEST KTP OPTION TO SUBMIT TO MOH STAKEHOLDERS ASSESS STRENGTHS AND WEAKNESSES OF SCENARIOS AT A CONSULTATION STAKEHOLDERS DELIBERATE ON AND VALIDATE THE REPORT AT A (TECHNICAL) CONSULTATION FIG. 3.3. DETAIL ON THE THREE STEPS TO DEVELOPING A KNOWLEDGE TRANSLATION PLATFORM Note. KTP = knowledge translation platform. MOH = ministry of health. 43 CONCEPTUAL BACKGROUND AND CASE STUDIES 3.2.2 Challenges in KTP establishment Country teams may encounter some challenges in establishing a KTP. For example, the purpose for establishing a KTP may not be clear; some may perceive it as a research organization, while others assume it is a policy organization. In most low- and middle- income countries, financial and human resources are limited, and thus existing organizations may perceive a KTP to be a competitor. Research institutions may see it as a threat to their funding sources, and as poaching their organizational expertise (e.g. by hiring their staff members). Policy institutions (e.g. a ministry of health) may see the knowledge translation processes pursued by the KTP as a threat to their domain (i.e. policy-making). As such they may elect not to participate in any of the KTP’s programming, or may ignore the recommendations in, for instance, an evidence brief for policy. Some ideas for navigating these challenges are set out below. • In the establishment and planning phases, multistakeholder involvement is essential, ensuring that all are aware of the KTP, and are able to shape it such that it does not directly compete with existing organizations. • If the KTP’s governance structure includes a board of directors, it should involve key individuals from central organizations to ensure buy-in and to reduce real or perceived competition. • A KTP must carefully consider the values it wishes to espouse. Credibility (e.g. neutrality and objectivity), transparency, accountability and learning – among others – are crucial to help navigate the challenges of being a new organization in an established hierarchy of organizations. • Multistakeholder deliberation should be a routine feature of KTP operations. Where possible, KTP programming (e.g. strategy development, priority-setting exercises, situation analyses, evidence briefs and policy dialogues) should feature multidisciplinary, multistakeholder groups. This should “reduce individual bias, resolve institutional conflicts, draw upon much wider social networks, and orient the group beyond any particular sector or perspective” (23). Programmes should listen to or stimulate the participation of multiple actors and solicit a range of views before any decision or resolution is made. • KTPs should use M&E to document these challenges, including the ways in which they were – or were not – surmounted. The KTP movement around the world is continually growing, and contributing to best practice through M&E measures is crucially important. More information on M&E of KTPs can be found in El-Jardali et al. (27), and on M&E relevant to specific knowledge translation interventions in Straus et al. (115). 44 INTRODUCTION TO EVIPNET EUROPE 4. KNOWLEDGE TRANSLATION PLATFORM CASE STUDIES EVIPNet knowledge translation platforms (KTPs) have evolved differently throughout the world. This section describes case studies from four countries (Brazil, Peru, Uganda and Zambia) that have established KTPs. Various organizational structures were adopted depending on the specific country context (e.g. the social, political and economic circumstances) and opportunities (e.g. the available resources, capacities and events) (Fig. 4.1). These KTPs each employ a different set of knowledge translation mechanisms, ranging from evidence briefs for policy and policy dialogues to rapid response services, clearinghouses and priority-setting exercises. CLEARINGHOUSE BRAZIL EVIDENCE BRIEF AND DIALOGUE UGANDA RAPID RESPONSE SERVICE ZAMBIA PRIORITY SETTING PERU Parastatal KTP at municipality level Parastatal KTP at government level KTP at university KTP as independent civil society organization FIG. 4.1. OVERVIEW OF KTP CASE STUDIES Note. KTP = knowledge translation platform. At the end of section 4, readers should be able to describe: • knowledge translation interventions in different national contexts, and how these contexts create unique opportunities for KTPs and EVIPNet; • a variety of KTP organizational and partnership forms depending on the national context, including specific lessons around KTP creation; and • the refinement and expansion of knowledge translation programming over time by KTPs. 4.1 EVIPNET REGIONAL NETWORKING EVIPNet connects individuals and institutions dedicated to evidence-informed policy- making. It promotes networking to narrow the research and policy divide, with networks operating on three distinct levels. As a global network, it brings together like-minded experts and institutions from around the world in the EVIPNet Steering and Resource Group to design new approaches to knowledge translation, to determine best practice, and to offer 45 CONCEPTUAL BACKGROUND AND CASE STUDIES BOX 4.1. EVIPNET REGIONAL NETWORKS EVIPNet operates through five different regional networks: • EVIPNet Africa: This network was launched in 2006 and comprises 11 country teams: Burkina Faso, Cameroon, Central African Republic, Ethiopia, Kenya, Malawi, Mozambique, Nigeria, Sudan, Uganda and Zambia. • EVIPNet Asia (Western Pacific and South-East Asia): This network was launched in 2005 and comprises networking among EVIPNet China (national), EVIPNet Shandong (subnational), EVIPNet Sichuan (subnational), EVIPNet Lao, EVIPNet Malaysia, EVIPNet Philippines and EVIPNet Viet Nam. • EVIPNet Americas: Launched in 2007, this network comprises country teams from Brazil, Chile, Colombia, Costa Rica, Ecuador, USA-Mexico Border Office, Paraguay, Peru and Trinidad and Tobago – with several other teams currently being developed. • EVIPNet Europe: Launched in 2012, the network currently comprises 1 9 member countries. • EVIPNet Eastern Mediterranean: This network is still in the development phase, and includes 13 interested countries. capacity-building and technical support. As a regional network, it brings together country teams from similar geographies, with networking often oriented to solving common yet complex problems. These country teams – which themselves are networks – represent the third and most active layer of EVIPNet. Country teams are typically knowledge translation platforms (KTPs) and are the fundamental unit of EVIPNet. Regional networking is a central EVIPNet innovation. By connecting national KTPs at a regional level, each EVIPNet member country benefits in a number of ways. • Capacity development: Capacity-building workshops on a variety of topics (e.g. evidence briefs for policy, policy dialogues, rapid response services) are held by the WHO regional offices or by a peer that has strength and experience in a particular knowledge translation innovation. For instance, a staff member of the EVIPNet KTP in Uganda trained network members from Burkina Faso, Cameroon and Zambia to build rapid response services. • Funding: Rather than a single member country approaching global funders, forming a group of member countries with common funding needs may be effective. For example, the SURE project, which builds on and supports EVIPNet Africa and the REACH-Policy Initiative, receives significant funding from the European Commission, which is spread among EVIPNet country teams in Africa. • Methodology piloting and innovation: Having a group of countries attempting similar innovations allows for greater piloting, validation and learning from success and failure. • Increased knowledge base: A group of countries sharing common approaches leads to a robust knowledge base of experiences and lessons learned that each country can contribute to and draw upon. Country case studies also permit strong learning across contexts. • Influencing regional and global bodies: A regional network creates a critical mass – a unified voice – that can be very influential within both regional and global bodies. 4.1.1 EVIPNet Africa EVIPNet Africa has steadily evolved from its inception in 2006, and is the most developed of all the regional EVIPNet networks (see Fig. 4.2). As with any network, it has progressed through a series of “major moments”, and experienced alternating periods of innovation, consolidation and occasional stagnation. In early 2008 in Ethiopia, the network hosted the 46 INTRODUCTION TO EVIPNET EUROPE first evidence-brief workshop, where all country teams discussed how to produce and evaluate evidence briefs, and then add context and nuance to these through policy dialogues. All teams worked on creating one evidence brief related to ways of supporting the widespread use of artemisinin-based combination therapies to treat uncomplicated falciparum malaria. This included supportive governance, finance and delivery arrangements within health systems, and implementation strategies. This work led directly to policy change in several of the member countries, while also contributing to the ongoing development of the evidence brief and policy dialogue as knowledge translation mechanisms to create policy change (116). Another major moment for the network arose from the development of the rapid response service, initially in Uganda. This service has been in great demand in Uganda, and is the subject of much interest from other members of the network who want to establish their own. Through a Ugandan trainer, the network has directly contributed to establishing such services in Burkina Faso, Cameroon and Zambia. All of this work has led directly to important grant synergies that have further deepened and strengthened the network. The European Commission-funded SURE project has provided sound support to the network in the creation of evidence briefs for policy, hosting of policy dialogues and preparation of rapid response services. A project funded by Canada’s International Development Research Centre supported capacity-building fora, travel and exchange, and a “call for proposals” encouraging teams to develop innovative strategies for narrowing the evidence–policy divide. Much of this work culminated in a 2012 conference in Ethiopia, bringing together network members from the country and the global level to share experiences. A preliminary day involved journalists and their many roles at the interface between research, policy and the general public, with the conference then moving into purely technical areas (e.g. costing policy options), pragmatic approaches (e.g. best practice in convening policy dialogues), training sessions, and exchange of lessons and experiences. This conference was a crowning moment for the network. 4.2 BRAZIL In response to its large population and geographical size, EVIPNet Brazil forms unique relationships with municipalities to create local KTPs able to deliver knowledge translation KEY MESSAGES • The Centre for Health Evidence (NEv Centre) in Piripiri municipality facilitates evidence-informed policy- making at the municipal level. • The NEv Centre utilizes a working group of local health professionals, trained in using the SUPPORT tools for evidence-informed health systems policy-making to create evidence briefs and convene policy dialogues. • The success of this initiative has led to the development of additional municipal knowledge translation platforms (KTPs) throughout Brazil. FIG. 4.2. EVIPNET AFRICA COUNTRIES (IN BURGUNDY) 47 CONCEPTUAL BACKGROUND AND CASE STUDIES interventions. In partnership with the Pan American Health Organization/BIREME, EVIPNet Brazil has supported the creation of the Virtual Health Library’s Centres for Health Evidence (Núcleos de Evidências e Estações da Biblioteca Virtual de Saúde). These centres are tasked with building local capacities to incorporate scientific knowledge into the management of health systems and services. To date, four NEv centres have been implemented in different Brazilian municipalities: Piripiri, Sobral, Recife and Brasília.4.2.1 The Centre for Health Evidence in Piripiri In March 2010, the NEv Centre was established in Piripiri municipality (Fig. 4.3), to promote the use of research evidence at a policy level to address local health system problems (117). The NEv Centre is supported by EVIPNet at the country, regional and global levels, and within Brazil by BIREME, the federal government, and most importantly, the Municipal Health Council of Piripiri. The NEv Centre was established in conjunction with EVIPNet’s Virtual Health Library, a user-friendly clearinghouse that unites, organizes and offers integrated access to health information in English, Spanish and Portuguese (117). The NEv Centre contains computer workstations with internet access for not only the working group, but also patient group representatives, municipal council members and other health professionals. This is to encourage and facilitate the use of research evidence in the policy-making process (117). 4.2.2 NEv Centre activities At the NEv Centre, knowledge translation activities are driven by a working group comprising local health professionals (medical doctors, nurses) trained in the use of the SUPPORT tools methodology (99). While no researchers were in this working group, its primary advantage lies in developing local resources and capacity that will be retained in the long term. The working group is also cost-efficient, an important consideration for any resource-constrained health system. Importantly, local health professionals are highly familiar with the health issues of their region, which allows the working group to quickly and dynamically immerse themselves into essential knowledge translation activities. The working group generates evidence briefs for policy and has convened policy dialogues to inform the planning and creation of health programmes. Writing evidence briefs has been the NEv Centre’s central activity so far – largely in response to requests from policy-makers in local government. The first evidence brief exercise focused on the priority issue of reducing the incidence of cardiovascular-related diseases, which accounted for almost half of Piripiri’s deaths over the previous five years (117). After a policy dialogue, the process concluded with the implementation of a “gym in the square” programme in Piripiri’s College Square. This programme provides the opportunity for aerobic physical activity for residents as an effective intervention to reduce the prevalence of hypertension, while also promoting community involvement and improving individual prognoses (117). Since then, additional evidence brief and policy dialogue exercises have focused on policies to attract and retain human resources in primary care, and the control of dengue fever in urban areas. FIG. 4.3. LOCATION OF PIRIPIRI MUNICIPALITY WITHIN PIAUÍ STATE, BRAZIL BRAZIL PIAUÍ STATE PIRIPIRI MUNICIPALITY 48 INTRODUCTION TO EVIPNET EUROPE 4.2.3 NEv Centre and policy-making The NEv Centre is an example of how scientific evidence can be integrated into the policy- making process at the municipal level, where often minimal investments for evidence to inform policy-making can yield significant outcomes (117). Furthermore, the EVIPNet Brazil country team found that training local health professionals to form the NEv Centre’s working group reduced costs, built capacity within the local health system and catered to the interests of local professionals. Based on the success of the Piripiri experience, additional EVIPNet teams are being formed in a further six municipalities across Brazil. 4.3 UGANDA The EVIPNet collaborating platform in Uganda is part of the Ugandan National Health Research Organization and is formally housed at Makerere University in Kampala. It was originally established as the Regional East African Community Health (REACH) Policy Initiative in 2005, at the headquarters of the East African Community in Arusha, Tanzania. The project moved to Uganda in 2008 to take advantage of an offer by the university to help staff and operationalize the project. As the country’s largest educational institution, Makerere made the ideal location for a KTP, allowing the country team to work more closely with researchers, policy-makers and stakeholders (5). From the outset, REACH Uganda has been at the global forefront of developing, testing and implementing knowledge translation mechanisms and methodologies. This includes work on an online clearinghouse, various evidence briefs and policy dialogues, and EVIPNet’s first rapid response service for evidence-informed health systems policy-making. 4.3.1 REACH Uganda’s rapid response service The rapid response service began as a six-month pilot with modest expectations. However, ongoing collaboration between REACH Uganda, EVIPNet and the SURE project allowed the pilot to spearhead the idea with receptive policy-makers. Since then, the pilot has extended for an additional two years, arguably becoming their most successful programme to date. The rapid response service’s success arises from how it responds to the needs of the requestor, – providing Ugandan policy-makers with syntheses of requested research evidence anywhere between several days and several weeks (29,113). Since policy- makers are often unclear in their needs, the rapid response team works through a problem clarification process with the requestor to refine the problem into a tangible policy issue KEY MESSAGES • Uganda’s EVIPNet knowledge translation platform (KTP), called REACH Uganda, is located at Makerere University. • REACH Uganda partners with EVIPNet to deliver high-quality knowledge translation interventions to facilitate evidence-informed health systems policy-making. • The rapid response service is REACH Uganda’s most popular service, helping policy-makers clarify and refine their policy issue, while providing timely access to user-friendly research evidence for their health system policy-making needs. 49 CONCEPTUAL BACKGROUND AND CASE STUDIES and/or question. Then the team conducts comprehensive literature searches, with all relevant evidence then synthesized into a user-friendly summary. As of September 2012, the rapid response team had conducted 67 rapid response syntheses for policy-makers within and beyond Uganda’s borders – part of a larger culture shift valuing how evidence can inform policy-making (29) (see Box 4.2 for an example of two very successful responses). The success of REACH Uganda’s rapid response service has attracted the attention of other KTPs seeking to develop a similar service through active mentorship from Ugandan staff. As a result, REACH Uganda has trained KTP staff throughout the African region (notably in Burkina Faso and Zambia) and worldwide (in Canada). 4.3.2 REACH Uganda’s evidence brief and policy dialogue exercises To date, REACH Uganda has produced four evidence briefs for policy and held seven policy dialogues, spanning topics from increasing access to skilled attendance at delivery to palliative care in Uganda (112). The evidence briefs have been widely disseminated while policy dialogues have involved parliamentarians, policy-makers, researchers, civil society and the media. 4.3.3 REACH Uganda’s clearinghouse To improve the long-term accessibility of research evidence, REACH Uganda developed an online clearinghouse specific to the needs of health systems policy-makers in Uganda (112). The Uganda Clearinghouse for Health Policy and Systems Research includes a collaborative space for researchers and policy-makers, a repository of all REACH policy publication products, and links to sources of global evidence for policy-making. The clearinghouse can be accessed at: www.uchpsr.org (112). 4.4 PERU Peru’s EVIPNet-supported KTP sits in the Unidad de Análisis y Generación de Evidencias en Salud Pública (UNAGESP), a unit dedicated to evidence generation and analysis for public health. The unit is part of the technical arm of the National Institute of Health, which is located outside of the Ministry of Health in order to protect against sudden political shifts that might affect the KTP’s stability and operations (120). BOX 4.2. REACH UGANDA RAPID RESPONSES Is mandatory food fortification an efficient strategy for the alleviation of micronutrient deficiency? (118) Answer: Yes. Food fortification is “effective, cost effective, has the potential to achieve high coverage and has been tested in many rigorous research studies”. How can the sustainability of a public health (food fortification) programme be ensured? (119) Answer: “Sustainability starts with the beginning of program development and as such, should not be conceived as a final phase of development….” 50 INTRODUCTION TO EVIPNET EUROPE From its establishment in 2009, UNAGESP has relied on EVIPNet mechanisms and methodology to create: 1. systematic reviews focusing on priority topics as designated by policy-makers 2. rapid response services meeting policy-maker demands 3. economic evaluations of interventions for the Ministry of Health 4. evidence briefs for policy and policy dialogues. 4.4.1 Evidence briefs and policy dialogues The Peruvian team has had a variety of valuable experiences with two evidence brief and policy dialogue exercises. Each exercise took a different approach, generating lessons learned that will influence how they implement future briefs and dialogues. The first brief and dialogue exercise focused on which health system policy options could be used to reduce the numbers of patients abandoning anti-tuberculosis treatments (121). This was a priority issue identified by policy-makers, and as such was the driving force for the project. The Peruvian team was supported technically through a training workshop led by EVIPNet Americas for the development and planning of the evidence brief and policy dialogue. After the EVIPNet team completed the brief, a policy dialogue was convened to allow the research evidence to be considered alongside the views, beliefs and tacit knowledge of those likely to be affected by a decision. Participants from diverse backgrounds came to the dialogue, including policy-makers, researchers, patient group representatives and other stakeholders. Though the discussions went smoothly, an abrupt change in government months later affected the prospects of possible policy changes stemming from this dialogue process. The second brief and dialogue exercise focused on the use of multinutrient supplements to treat anaemia in children. This researcher-driven initiative stemmed from a WHO guideline, which served as the evidence base for the brief and dialogue. Similarly, a policy dialogue was convened, but the invited participants were largely policy-makers. This composition of participants led to a focus on implementation strategies informed by the local evidence, in contrast to the more theoretical discussions (e.g. quality of evidence) of the earlier dialogue. A key lesson learned was that the composition of participants clearly influences the type of discussions. A balance of different participant types is essential to ensure that the necessary theoretical and practical elements (e.g. local evidence) are sufficiently considered. KEY MESSAGES • UNAGESP, a unit within the National Institute of Health, is EVIPNet’s collaborating knowledge translation platform (KTP) in Peru. • Experiences from evidence briefs for policy and policy dialogues influence future activity implementation. • UNAGESP plans to contribute to the development of a national health research system, facilitating linkages between researchers and policy-makers. • The composition of participants in a policy dialogue clearly influences the type of discussions. FIG. 4.5. PERU’S LOCATION IN SOUTH AMERICA 51 CONCEPTUAL BACKGROUND AND CASE STUDIES The Peruvian team is planning to expand their evidence-informed health policy-making activities. By 2016, they will contribute to the implementation of a national health research system. This governance and linkage system will engage researchers with public health priorities – as identified by policy-makers – and likewise encourage policy-makers to include research evidence in their policy-making processes. 4.5 ZAMBIA As in most countries in sub-Saharan Africa, the research and policy communities in Zambia have historically been very separate. To address this separation, in 2005, one of the world’s first KTPs, ZAMFOHR, was born. The KTP moved from idea to civil society organization through a planning process that lasted over a year. During this time, a senior knowledge broker – with support from an international funder – conducted various situation analysis exercises to document and understand the prevailing situation between the research and policy communities. Two strategic planning retreats were held over the planning process, involving a number of actors from across the spectrum, including researchers, policy-makers from the Ministry of Health, the media, the University of Zambia and civil society. These retreats created ZAMFOHR’s first strategic plan, and set the stage for ZAMFOHR to become a fully staffed organization. 4.5.1 ZAMFOHR’s knowledge translation programming Since 2006, ZAMFOHR has launched many different knowledge translation activities. These include: capacity development workshops on systematic reviews, evidence retrieval, and evidence briefs and policy dialogues; creating a (virtual and physical) national database of local evidence; leading evidence brief and policy dialogue processes on mental health (122) and reproductive health (123); and creating a rapid response service – with essential technical assistance from REACH Uganda. The establishment of RAGs; a multidisciplinary, multisectoral board of directors; and international partnerships have played an important role in the Zambian experience. FIG. 4.6. ZAMBIA’S LOCATION IN AFRICA KEY MESSAGES • The Zambia Forum for Health Research (ZAMFOHR) was one of the world’s first knowledge translation platforms (KTPs), a civil society organization led by a senior knowledge broker and governed by a multistakeholder board of directors. • ZAMFOHR has launched and fine-tuned many knowledge translation innovations, including databasing, evidence briefs for policy and policy dialogues, capacity-building, and a rapid response service. • One of ZAMFOHR’s core innovations was the creation of research-to-action groups (RAGs) that galvanize multistakeholder communities on specific issues. 52 INTRODUCTION TO EVIPNET EUROPE 4.5.2 Research-to-action groups RAGs focus on knowledge translation activities on specific issues including mental health, reproductive health and human resources for health. These RAGs are led by someone other than ZAMFOHR’s Executive Director under a decentralized leadership, and identify relevant stakeholders and dynamics within that issue (6). Importantly, RAGs take ownership of their particular issue, and have wide knowledge of the stakeholders and attendant power dynamics. This leads to a depth of approach that a national KTP on its own may not be able to achieve. 4.5.3 Board of directors It was critical for ZAMFOHR to establish a Board of Directors that was multidisciplinary, intersectoral and representative of both the research and policy communities. The establishment of such a board was a critical early achievement of ZAMFOHR and led directly to buy-in among the community. “Convincing local, national and even global stakeholders of ZAMFOHR’s function and utility is a phenomenon common to any new institution, but particularly acute when the field (KT) [knowledge translation] is itself relatively new and largely misunderstood.”(6) 4.5.4 International partnerships Another aspect central to ZAMFOHR’s success has been its international partnerships. Membership of EVIPNet Africa has brought ZAMFOHR a number of benefits. It has shared the innovations and experience of like-minded KTPs in other African countries, received funds from global agencies, and had international technical support to help develop and implement knowledge translation mechanisms. This demonstrates the high value of regional networking. 53 CONCEPTUAL BACKGROUND AND CASE STUDIES 5. RESOURCES 5.1 ANNOTATED LIST OF KNOWLEDGE TRANSLATION RESOURCES Despite the relative youth of the knowledge translation field, many excellent resources are available to assist individuals and knowledge translation platforms (KTPs) in expanding their work. This section features a short descriptive analysis of some of these knowledge translation resources, including peer-reviewed papers, e-books and videos. Resources are divided into four sections: • practical guides for knowledge translation practitioners • knowledge translation frameworks and theory • empirical papers • videos. 5.1.1 Practical guides for knowledge translation practitioners SUPPORT tools for evidence-informed health policy-making (STP) SUPPORT tools are the most comprehensive set of tools for knowledge translation thus far. They are peer-reviewed papers offering strong insights into a range of different knowledge translation innovations. Each of these 18 articles provides a straightforward description and analysis of a particular tool, and presents a wealth of resources for the reader. 1. What is evidence-informed policy-making? 2. Improving how your organisation supports the use of research evidence to inform policy-making 3. Setting priorities for supporting evidence-informed policy-making 4. Using research evidence to clarify a problem 5. Using research evidence to frame options to address a problem 6. Using research evidence to address how an option will be implemented 7. Finding systematic reviews 8. Deciding how much confidence to place in a systematic review 9. Assessing the applicability of the findings of a systematic review 10. Taking equity into consideration when assessing the findings of a systematic review 11. Finding and using evidence about local conditions 12. Finding and using research evidence about resource use and costs 13. Preparing and using policy briefs to support evidence-informed policy-making 14. Organising and using policy dialogues to support evidence-informed policy-making 15. Engaging the public in evidence-informed policy-making 16. Using research evidence in balancing the pros and cons of policies 17. Dealing with insufficient research evidence 18. Planning monitoring and evaluation of policies Oxman A, Hanney S, editors. SUPPORT Tools for evidence-informed health Policy-making (STP). Special supplement of Health Research Policy and Systems. 2009;7(1). (http://www. health-policy-systems.com/supplements/7/s1, accessed 20 November 2015). 54 INTRODUCTION TO EVIPNET EUROPE World report on knowledge for better health This is the seminal global report on knowledge translation that got the ball rolling on an international scale in terms of emphasizing the need for knowledge translation processes for supporting evidence-informed policy and systems in low- and middle-income countries. World report on knowledge for better health. Geneva: World Health Organization; 2004. (http://www.who.int/rpc/meetings/pub1/en/, accessed 20 November 2015). Priority setting for health policy and systems research This is a helpful overview and guide for those interested in research priority-setting processes. Priority setting for health policy and systems research. Briefing note 3. Geneva: Alliance for Health Policy and Systems Research; 2009. (http://www.who.int/alliance-hpsr/resources/ AllianceHPSR_Brief_Note3_ENG.pdf, accessed 20 November 2015). The knowledge translation toolkit: bridging the know-do gap: a resource for researchers An important tool for researchers who want a comprehensive assessment of the range of activities they can undertake to get their research into policy and practice. Bennett G, Jessani N. The Knowledge Translation Toolkit: bridging the know-do gap: a resource for researchers. Ottawa: International Development Research Centre; 2011. (http:// www.idrc.ca/EN/Resources/Publications/Pages/IDRCBookDetails.aspx?PublicationID=851, accessed 20 November 2015). Using linkage and exchange to move research into policy at a Canadian foundation This is a seminal article that clearly makes the case for greater interactions between researchers and policy-makers as a way to support the uptake of research evidence into policy-making processes. This underpins the entire idea of convening policy dialogues. Lomas J. Using linkage and exchange to move research into policy at a Canadian foundation. Health Affairs. 2000;19(3):236–40 (http://www.sandy-campbell.com/sc/Knowledge_ Translation_files/using%20linkage%20and%20exchange.pdf, accessed 20 November 2015). The SURE guides for preparing and using evidence-based policy briefs Based on the SUPPORT tools, these guides provide concrete guidance to individuals and teams going through an evidence brief and policy dialogue process. These guides have been extensively tested and refined by the KTPs that comprise EVIPNet Africa. As of 2011, there are 8 individual guides: • Getting started with the SURE guides • Prioritizing topics for policy briefs • Clarifying the problem • Deciding on and describing policy options • Identifying and addressing barriers to implementing policy options 55 CONCEPTUAL BACKGROUND AND CASE STUDIES • Clarifying uncertainties and needs for monitoring and evaluation • Organizing and running policy dialogues • Informing and engaging stakeholders The SURE guides for preparing and using evidence-based policy briefs. Version 2.1 [updated November 2011]. The SURE Collaboration; 2011 (http://global.evipnet.org/SURE-Guides/, accessed 11 August 2014). The knowledge translation curriculum This comprehensive teaching guide touches on many of the core knowledge translation competencies, mixing discussions of knowledge translation theory with its application (primarily in a low- and middle-income country context). Three modules cover knowledge translation, situation analysis and priority setting. Each module is divided into lessons, and each lesson contains links to peer-reviewed papers and other web resources. Campbell S. The Knowledge Translation Curriculum. Ottawa: The Canadian Coalition for Global Health Research; 2012 (http://www.ccghr.ca/resources/knowledge-translation/, accessed 20 November 2015). 5.1.2 Knowledge translation frameworks and theory Pathways to evidence-informed policy and practice: a framework for action This article features some strong analysis of the central problem knowledge translation seeks to address. Bowen S, Zwi AB. Pathways to evidence-informed policy and practice: a framework for action. PLoS Medicine. 2005;2(7) (http://www.plosmedicine.org/article/fetchObject.action? uri=info%3Adoi%2F10.1371%2Fjournal.pmed.0020166&representation=PDF, accessed 20 November 2015). Guide to knowledge translation planning at CIHR: integrated and end-of-grant approaches This guide explores the differences between end-of-grant knowledge translation (essentially dissemination of findings) and integrated knowledge translation (a partnership approach that encourages the participation of policy-makers). Guide to knowledge translation planning at CIHR: integrated and end-of-grant approaches. Ottawa: Canadian Institutes of Health Research; 2012 (http://www.cihr-irsc.gc.ca/e/ documents/kt_lm_ktplan-en.pdf, accessed 20 November 2015). Knowledge exchange processes in organizations and policy arenas: a narrative systematic review of the literature This outstanding, extensive piece examines knowledge and knowledge translation processes from an organizational perspective. 56 INTRODUCTION TO EVIPNET EUROPE Contandriopoulos D, Lemire M, Denis JL, Tremblay E. Knowledge exchange processes in organizations and policy arenas: a narrative systematic review of the literature. The Milbank Quarterly. 2010;88(4):444–83 (http://www.milbank.org/uploads/documents/featured- articles/pdf/Milbank_Quarterly_Vol-88_No-4_2010.pdf, accessed 20 November 2015). Lost in knowledge translation: time for a map? This paper has a good overview of the various attempts to define knowledge translation and to develop knowledge translation frameworks. Graham I, Logan J, Harrison MB, Straus SE, Tetroe J, Caswell W et al. Lost in knowledge translation: time for a map? The Journal of Continuing Education in the Health Professions. 2006;26:13–24 (http://onlinelibrary.wiley.com/doi/10.1002/chp.47/pdf, accessed 20 November 2015). Assessing country-level efforts to link research to action Very useful for those planning KTPs, this piece provides a framework for the ways in which knowledge translation interventions and approaches might work at the national level. Lavis JN, Lomas J, Hamid M, Sewankambo NK. Assessing country-level efforts to link research to action. Bulletin of the World Health Organization. 2006;84:620–28 (http://www.who.int/ bulletin/volumes/84/8/06-030312.pdf?ua=1, accessed 20 November 2015). Conceptualizing and combining evidence for health system guidance This paper was one of the first to look at the many different types of evidence that may be required for any policy discussion. Lomas J, Culyer T, McCutcheon C, McAuley L, Law S. Conceptualizing and combining evidence for health system guidance. Final report. Ottawa: Canadian Health Services Research Foundation; 2005 (http://www.cfhi-fcass.ca/migrated/pdf/insightAction/evidence_e.pdf, accessed 20 November 2015). Do we really understand tacit knowledge? This author is a leading thinker in promoting the value and role of tacit knowledge in arriving at a comprehensive picture – be it in policy or in everyday life. Tsoukas H. Do we really understand tacit knowledge? In: Easterby-Smith M, Lyles MA, editors. The Blackwell handbook of organizational learning and knowledge management. Oxford: Blackwell Publishing; 2005. Knowledge for theory and practice This highly regarded piece advances the idea of engaged scholarship (which complements knowledge translation very effectively) while also exploring some of the dynamics within the term “knowledge”. 57 CONCEPTUAL BACKGROUND AND CASE STUDIES Van de Ven AH, Johnson PE. Knowledge for theory and practice. Academy of Management Review. 2006;31(4):802–21 (http://www.sandy-campbell.com/sc/KTC_Module_1_files/2.1a Van de Ven and Johnson 2006.pdf, accessed 20 November 2015). 5.1.3 Empirical papers Researchers and policymakers: travelers in parallel universes This paper provides an excellent analysis of the divisions and gaps between research and policy communities, and is an oft-cited resource. Brownson RC, Royer C, Ewing R, McBride TD. Researchers and policymakers: travelers in parallel universes. American Journal of Preventive Medicine. 2006;30(2):164–72 (http://www. sandy-campbell.com/sc/KTC_Module_1_files/1.1a%20Brownson%20et%20al%202006. pdf, accessed 23 November 2015). A randomized controlled trial evaluating the impact of knowledge translation and exchange strategies While the field of knowledge translation science – studying what knowledge translation interventions work, for whom and under what circumstances – is growing, little to date has been published. This however, is one of a very few randomized control trials on the subject. Dobbins M, Hanna SE, Ciliska D, Manske S, Cameron R, Mercer SL et al. A randomized controlled trial evaluating the impact of knowledge translation and exchange strategies. Implementation Science. 2009;4(61) (http://www.implementationscience.com/content/ pdf/1748-5908-4-61.pdf, accessed 23 November 2015). Health policy-makers perceptions of their use of evidence: a systematic review This piece was one of the first to examine the barriers and facilitators in evidence-informed policy, with its observations remaining relevant to this day. Innvaer S, Vist G, Trommald M, Oxman A. Health policy-makers perceptions of their use of evidence: a systematic review. Journal of Health Services Research & Policy. 2002;7(4):239–44 (http://www.sandy-campbell.com/sc/KTC_Module_1_files/KTC Module 1 - 3.1d - Innvaer et al 2002.pdf, accessed 23 November 2015). Focus on knowledge brokering This piece (not from a peer-reviewed journal) provides a good overview of the field of knowledge brokering. Jackson-Bowers E, Kalucy I, McIntyre E. Focus on knowledge brokering. Adelaide: Primary Health Care Research & Information Service; 2006. (http://www.sandy- campbell.com/sc/KTC_Module_1_files/KTC%20Module%201%20-%204.1b%20-%20 Jackson%E2%80%93Bowers%20et%20al%202006.pdf, accessed 23 November 2015). 58 INTRODUCTION TO EVIPNET EUROPE Developing good taste in evidence: facilitators of and hindrances to evidence-informed health policy-making in state government Like Innvaer et al. (2002), this piece has a strong overview of the barriers and facilitators to evidence-informed policy-making. While its data is from the United States of America, it is of great relevance for other contexts. Jewell CJ, Bero LA. Developing good taste in evidence: facilitators of and hindrances to evidence-informed health policy-making in state government. The Milbank Quarterly. 2008;86(2):177–208 (http://www.milbank.org/uploads/documents/featured-articles/pdf/ Milbank_Quarterly_Vol-86_No-2_2008.pdf, accessed 23 November 2015). Creating a knowledge translation platform: nine lessons from the Zambia Forum for Health Research This is one of the few peer-reviewed articles analysing one country’s experience in creating a national-level KTP in civil society. Its nine lessons have high value for those planning a KTP in any context. Kasonde J, Campbell S. Creating a knowledge translation platform: nine Lessons from the Zambia Forum for Health Research. Health Research Policy and Systems. 2012;10(31) (http:// www.health-policy-systems.com/content/pdf/1478-4505-10-31.pdf, accessed 23 November 2015). • Towards systematic reviews that inform health care management and policy-making • Working within and beyond the Cochrane Collaboration to make systematic reviews more useful to healthcare managers and policy-makers • How can we support the use of systematic reviews in policymaking? This trio of papers looks at the role systematic reviews might play in policy-making, particularly at how this core knowledge translation resource can become better adapted to policy-making realities and needs. Lavis JN, Davies H, Oxman A, Denis J, Golden-Biddle K, Ferlie E. Towards systematic reviews that inform health care management and policy-making. Journal of Health Services Research and Policy. 2005;10(1):35–48 (http://hsr.sagepub.com/content/10/suppl_1/35.full.pdf+html, accessed 23 November 2015). Lavis JN, Davies H, Gruen RL, Walshe K, Farquhar CM. Working within and beyond the Cochrane Collaboration to make systematic reviews more useful to healthcare managers and policy-makers. Healthcare Policy. 2006;1(2) (http://www.ncbi.nlm.nih.gov/pmc/articles/ PMC2585325/pdf/policy-01-21.pdf, accessed 23 November 2015). Lavis JN. How can we support the use of systematic reviews in policymaking? PLoS Medicine. 2009;6(11) (http://www.plosmedicine.org/article/info%3Adoi%2F10.1371%2Fjournal. pmed.1000141, accessed 23 November 2015). Evidence-informed health policy: 1. Synthesis of findings from a multi-method study of organizations that support the use of research evidence 59 CONCEPTUAL BACKGROUND AND CASE STUDIES This piece looks at some of the commonalities among organizations in terms of how and under what conditions they demand or use research evidence. Lavis J, Oxman AD, Moyihan R, Paulsen EJ. Evidence-informed health policy: 1. Synthesis of findings from a multi-method study of organizations that support the use of research evidence. Implementation Science. 2008;3(53) (http://www.implementationscience.com/ content/pdf/1748-5908-3-53.pdf, accessed 23 November 2015). Improving research dissemination and uptake in the health sector: beyond the sound of one hand clapping This paper is close to 20 years old but has some essential observations about the different types of knowledge. It discusses some of the misperceptions policy-makers have about research, and that researchers have about policy-makers. Note that this is a shortened version of the original piece. Lomas J. Improving research dissemination and uptake in the health sector: beyond the sound of one hand clapping. Policy Commentary C97-1. Hamilton: McMaster University, Centre for Health Economics and Policy Analysis; 1997 (http://www.cfhi-fcass.ca/migrated/ pdf/mythbusters/handclapping_e.pdf, accessed 23 November 2015). Evidence summaries tailored to health policy-makers in low- and middle-income countries This piece is self-explanatory, and worth a look to understand the ways in which knowledge translation practitioners have reached policy-makers. Rosenbaum SE, Glenton C, Wiysonge CS, Abalos E, Mignini L, Young T et al. Evidence summaries tailored to health policy-makers in low- and middle-income countries. Bulletin of the World Health Organization. 2011;89(1):54–61 (http://www.who.int/bulletin/ volumes/89/1/10-075481.pdf, accessed 23 November 2015). 5.1.4 Video resources A number of videos featuring members of EVIPNet Africa can be found at: http://vimeo. com/43001338. They speak about networking in knowledge translation, the rapid response service, EVIPNet generally and EVIPNet Africa in particular. An overview of a policy dialogue process in Cameroon can be found at: http://vimeo. com/38883972. 60 INTRODUCTION TO EVIPNET EUROPE 5.2 GLOSSARY OF KNOWLEDGE TRANSLATION TERMS Below are some of the key terms used in this document. TERM DEFINITION(S) actors (also called stakeholders) Actors or stakeholders refer to individuals, groups, organizations and/or networks that have a stake or vested interests in a specific issue. Their roles, rights and/ or ownership related to an issue are critical in the implementation and success of any policy or policy change (23). In the context of EVIPNet, actors or stakeholders refer to, but are not limited to, policy-makers, researchers, civil society and funders who share the goal of improving health system performance and health outcomes through evidence-informed policy-making. (See Introduction) best available evidence This refers to a synthesis of high-quality evidence from global databases (e.g. systematic reviews), which is combined with local evidence to design context- specific solutions (99,124). It can also be complimented with tacit knowledge, especially when explicit knowledge from local contexts is of poor quality or is not available (125). (See section 1.2.2) clearinghouses Clearinghouses are continuously updated repositories of documents, serving as a “one-stop shop” for users seeking reliable and relevant research evidence on a given topic. They typically contain systematic reviews that are high quality and optimally packaged for policy-makers and other stakeholders, and may also house other types of documents relevant to the subject area (74,106). (See section 2.5) colloquial evidence See “tacit knowledge” context-free evidence Context-free and context-sensitive evidence are types of explicit knowledge. Context-free evidence is from systematic and methodologically rigorous clinical research (126) such as medical effectiveness or biomedical research (43,127). (See section 1.2.1) context-sensitive evidence Context-sensitive evidence is a type of explicit knowledge that is context-based and operational or relevant to a particular setting (43,126,127). (See section 1.2.1) data Data are all the given facts of a study or work, in qualitative or quantitative form, before they are arranged, sorted and summarized. In public health, data usually refers to statistical data (usually numerical), routine data, survey data or data collected through observations in the form of monitoring and evaluation activities to be used for communication and interpretation (40,128,129). evidence Evidence refers to “findings from research and other knowledge that may serve as a useful basis for decision-making in public health and health care” (130). Evidence is a combination of explicit and tacit knowledge (42,43). The term “evidence” is often used synonymously with “knowledge”. (See section 1.2.1) evidence brief for policy Evidence briefs for policy – also known as policy briefs – provide direct support to policy-making by packaging the research evidence in a way that it is accessible, relevant, easy to use and applicable at the local level (98). They start with the priority policy issue (not the research evidence). Thereafter, they use the best available evidence to clarify the problem and its causes, and identify and frame policy options to address the problem (26). They often feature issues related to governance, financing and delivery, along with important implementation considerations. (See section 2.2) 61 CONCEPTUAL BACKGROUND AND CASE STUDIES TERM DEFINITION(S) evidence-informed health policy-making Evidence-informed health policy-making is an approach to policy decisions that aims to ensure that decision-making is well-informed by the best available research evidence. It is characterised by the systematic and transparent access to, and appraisal of, evidence as an input into the policy-making process (14,131). evidence synthesis An evidence synthesis is a core mechanism of knowledge translation and refers to a process of summarizing information from a wide range of research findings in a rigorous, systematic and transparent manner to repackage a large body of evidence (66,132). Evidence synthesis products include systematic reviews, summaries of systematic reviews and evidence briefs for policy. This term is used interchangeably with “knowledge synthesis”. exchange effort This is one of the four models of knowledge translation and refers to the interactions, partnerships and joint actions between researchers, policy-makers and other stakeholders to increase shared understanding and ownership of the use of research in decision-making. Exchange efforts might include undertaking collaborative research projects and convening policy dialogues (13,66). (See section 1.1.4) explicit knowledge This refers to structured, verifiable and replicable evidence. Explicit knowledge can be categorized in two ways. One is to describe it as either context-free or context-sensitive evidence (38,43). Another way is to rank explicit knowledge according to the scientific rigor or data collection methodology and strength of evidence, which can be displayed as a hierarchy of evidence from strongest to weakest (42,47). (See section 1.2) health information “Information is facts that have been arranged and/or transformed to provide the basis for interpretation and conversion into knowledge.”(133). Health information is “generated by both population-based (e.g. surveys, censuses and civil registration) and institution-based (e.g. service records, individual records) data sources” providing support to decision-making at all levels of the health system (39). Health information includes “descriptions of health status and mortality of populations over time, analysis of causation of health problems, quantification of associations between health outcomes and risk or protective factors, and assessment of the effectiveness of public health interventions”(134). “The activities necessary to obtain health information and bring this information into the health policy-making process can be described as public health monitoring and reporting”(2) . (See section 1.2.1) integrated effort This effort brings together push, user-pull and exchange efforts (see definitions in this glossary) for knowledge translation (13,135). An example is a knowledge translation platform. (See section 1.1.4) knowledge Knowledge refers to a combination of values, experiences, expert insights and contextual information, as well as research findings (115,136). It includes both explicit and tacit knowledge and may serve as an aid for decision-making (137–139). Explicit knowledge refers to structured, verifiable and replicable evidence. Explicit knowledge can be categorized in two ways. One is to describe it as either context- free or context-sensitive evidence (38,43). Another way is to rank explicit knowledge according to the scientific rigor or data collection methodology and strength of evidence, which can be displayed as a hierarchy of evidence from strongest to weakest (42,47). Tacit knowledge refers to knowledge comprised of expertise, opinions, tradition and belief that compliment explicit knowledge. It is particularly critical where the evidence is inconclusive, lacking or non-existent (42,47). 62 INTRODUCTION TO EVIPNET EUROPE TERM DEFINITION(S) knowledge broker This is often a senior, well-connected and respected individual or an organization whose core function is to connect people to exchange knowledge (23). A broker brings stakeholders together, builds relationships, cements coalitions and alliances, and helps to build new skills and capacities (75). (See section 1.4) knowledge brokering This refers to activities that facilitate the transfer of knowledge between stakeholders, including policy-makers, researchers and civil society (66). The goal of knowledge brokering is to build and maintain partnerships or networks for knowledge translation and promote mutual understanding about each other’s roles and cultures (140). (See section 1.4) knowledge synthesis See “evidence synthesis” knowledge translation This refers to “the exchange, synthesis, and effective communication of reliable and relevant research results. The focus is on promoting interaction among the producers and users of research, removing the barriers to research use, and tailoring information to different target audiences so that effective interventions are used more widely”(4,141). (See section 1.1) knowledge translation platform (KTP) A KTP promotes and creates an environment that supports both research use in policy-making and policy needs in research design (6). It may be a formal organization, department or network, focusing on bringing actors together, synthesizing explicit and tacit knowledge, and leading networking in knowledge translation (110). A KTP leads the development of evidence briefs and policy dialogue exercises, offers rapid response services, conducts priority-setting exercises and performs clearinghouse functions. (See section 3) policy brief See “evidence briefs for policy” policy dialogue These dialogues allow the best available research evidence to be considered among the real-world factors influencing the policy-making process (71). They are informed by an evidence brief for policy, which is subsequently considered alongside tacit knowledge of local health policy-makers and stakeholders to inform future policy decisions (26). (See section 2.3) priority setting Priority setting is a knowledge translation mechanism used in shaping a policy and/ or research agenda. It is a transparent and explicit process for guiding decisions on how resources should be used among competing issues and agenda items (142). Priority setting brings together stakeholders including policy-makers, researchers and civil society (143), and is led by a KTP in the context of EVIPNet. (See section 2.1) push effort A push effort describes the tailoring and targeting of key messages from research evidence to make it more accessible and easier to use for policy-makers (13,115) (14,117). (See section 1.1.4) rapid response service A rapid response service responds to a question or issue arising from a policy-maker, producing a synthesis of research evidence on a timescale of hours to days to weeks (49,104). (See section 2.4) 63 CONCEPTUAL BACKGROUND AND CASE STUDIES TERM DEFINITION(S) research A systematic investigation, inquiry or examination which aims to generate and contribute to new scientific knowledge through discovering and interpreting health- related phenomena and observable facts or testing hypotheses (4,143). Public health research, in particular, refers to health research at population and organisational level using statistical, social and behavioural science methods”. Public health research “includes both researchaimed directly at prevention of disease (and promotion of health) and also research on systems and services for health and healthcare” (143). research use Research evidence can be used in an instrumental, conceptual, symbolic or strategic way (49–52) these opportunities include developing actionable messages for decision- makers (only 30 percent of research organizations frequently or always do this). (See section 1.2.3) situation analysis EVIPNet Europe conducts situation analysis as the first step towards establishing a KTP at a national level. It facilitates understanding of the national context, the health system and health research system and any existing evidence-informed policy- making processes. It provides information on opportunities and barriers in organizing and establishing a KTP (7). (See section 3.2) tacit knowledge This refers to knowledge comprised of expertise, opinions, tradition and belief that compliment explicit knowledge. It is particularly critical where the evidence is inconclusive, lacking or non-existent (42,47). Tacit knowledge is also referred to as “colloquial evidence” (43). (See section 1.2) user-pull effort This effort is made by users of research or policy-makers who demand research evidence from the research community. It can take the form of one-stop shops, which provide access to high-quality and relevant research evidence (13,115). (See section 1.1.4) 64 INTRODUCTION TO EVIPNET EUROPE REFERENCES 1. About Health 2020. In: World Health Organization Regional Office for Europe [website]. Copenhagen: WHO Regional Office for Europe; 2015 (http://www.euro.who.int/en/health- topics/health-policy/health-2020-the-european-policy-for-health-and-well-being/about- health-2020, accessed 31 July 2015). 2. European Health Information Initiative. Copenhagen: WHO Regional Office for Europe; 2015 (http://www.euro.who.int/__data/assets/pdf_file/0004/287275/EHII_Booklet_EN_rev1. pdf?ua=1, accessed 22 June 2016). 3. Joining the Evidence-informed Policy Network (EVIPNet) Europe. Information for the WHO heads of country offices. Copenhagen: WHO Regional Office for Europe (http://www.euro.who. int/__data/assets/pdf_file/0012/307200/Joining-EVIPNet-Europe-HCO.pdf, accessed 16 May 2016). 4. World report on knowledge for better health: strengthening health systems. Geneva: World Health Organization; 2004 (http://www.who.int/rpc/meetings/en/world_report_on_knowledge_ for_better_health2.pdf, accessed 18 November 2015). 5. EVIPNet Strategic Plan 2012–2015. Geneva: World Health Organization; 2012 (http://www.who. int/evidence/OMSEVIPNetStratPlan.pdf, accessed 18 November 2015). 6. Kasonde JM, Campbell S. Creating a knowledge translation platform: nine lessons from the Zambia Forum for Health Research. Health research policy and systems/BioMed Central 2012;10(31). doi: 10.1186/1478-4505-10-31. 7. EVIPNet Europe Strategic Plan 2013–2017. Copenhagen: WHO Regional Office for Europe; 2013 (http://www.euro.who.int/__data/assets/pdf_file/0009/291636/EVIPNet-Europe-strategic-plan- 2013-17-en.pdf, accessed 8 February 2016). 8. The Mexico statement on health research. Knowledge for better health: strengthening health systems. Geneva: World Health Organization; 2004 (www.who.int/rpc/summit/agenda/Mexico_ Statement-English.pdf, accessed 20 February 2014). 9. EVIPNet Americas Secretariat. EVIPNet Americas: informing policies with evidence. Lancet. 2008;372:1130–1. 10. Hamid M, Bustamante-Manaog T, Truong VD, Akkhavong K, Fu H, Ma Y et al. EVIPNet: translating the spirit of Mexico. Lancet. 2005;366(1474-547X (Electronic)):1758–60. 11. Fifty-eighth World Health Assembly. Geneva: World Health Organization; 2005 (http://apps. who.int/gb/ebwha/pdf_files/WHA58-REC1/english/A58_2005_REC1-en.pdf, accessed 13 May 2016). 12. Lomas J. Connecting research and policy. Isuma: Canadian Journal of Policy Research. 2002;1(1):140–4. 65 CONCEPTUAL BACKGROUND AND CASE STUDIES 13. Lavis JN, Lomas J, Hamid M, Sewankambo NK. Assessing country-level efforts to link research to action. Bulletin of the World Health Organization. 2006;84:620–8 (http://www.who.int/ bulletin/volumes/84/8/06-030312.pdf?ua=1, accessed 11 August 2014). 14. Oxman AD, Lavis JN, Lewin S, Fretheim A. SUPPORT Tools for evidence-informed health Policymaking (STP) 1: What is evidence-informed policymaking? Health Research Policy and Systems. 2009;7(Suppl 1):S1. 15. Harms S, Neufeld V. Knowledge translation in low and middle income countries: a learning module. Ottawa: Canadian Institutes of Health Research; 2010 (http://www.cihr-irsc. gc.ca/e/44240.html, accessed 11 August 2014). 16. Guyatt G, Cairns J, Churchill D, Cook D, Haynes B, Hirsh J et al. Evidence-based medicine. Journal of the American Medical Association. 1992;268(17):2420–5 (http://jama.jamanetwork. com/article.aspx?articleid=400956, accessed 11 August 2014). 17. Banta D. The development of health technology assessment. Health Policy. 2003;63(2):121–32 (http://www.ncbi.nlm.nih.gov/pubmed/12543525, accessed 16 November 2015). 18. Woolf SH. The meaning of translational research and why it matters. Journal of the American Medical Association. 2008;299(2):211–13 (http://jama.jamanetwork.com/article. aspx?articleid=1149350, accessed 11 August 2014). 19. Lavis JN, Røttingen JA, Bosch-Capblanch X, Atun R, El-Jardali F, Gilson L et al. Guidance for evidence-informed policies about health systems: linking guidance development to policy development. PLoS Med. 2012;9(3):e1001186. doi: 10.1371/journal.pmed.1001186. 20. Moat KA, Lavis JN, Abelson J. How contexts and issues influence the use of policy-relevant research syntheses: a critical interpretive synthesis. Milbank Quarterly. 2013;91(3):604–48. doi: 10.1111/1468-0009.12026. 21. Lavis JN, Ross SE, Hurley JE, Hohenadel JM, Stoddart GL, Woodward CA et al. Examining the role of health services research in public policymaking. Milbank Quarterly. 2002;80(1):125–54. 22. Lavis JN. How can we support the use of systematic reviews in policymaking? PLoS Medicine. 2009;6(11) (http://www.plosmedicine.org/article/info%3Adoi%2F10.1371%2Fjournal. pmed.1000141, accessed 11 August 2014). 23. Campbell S. The knowledge translation curriculum. Ottawa: The Canadian Coalition for Global Health Research; 2012 (http://www.ccghr.ca/resources/knowledge-translation, accessed 11 August 2014). 24. Lavis JN, Davies H, Oxman A, Denis J, Golden-Biddle K, Ferlie E. Towards systematic reviews that inform health care management and policy-making. Journal of Health Services Research and Policy. 2005;10(1):35–48. 25. The Bamako call to action: research for health. Lancet. 2008;372(9653):1855. doi: 10.1016/S0140- 6736(08)61789-4. 66 INTRODUCTION TO EVIPNET EUROPE 26. Moat KA, Lavis JN, Clancy SJ, El-Jardali F, Pantoja T. Evidence briefs and deliberative dialogues: perceptions and intentions to act on what was learnt. Bulletin of the World Health Organization. 2014;92(1):20–8. doi: 10.2471/BLT.12.116806. 27. El-Jardali F, Lavis J, Moat K, Pantoja T, Ataya N. 2014. Capturing lessons learned from evidence- to-policy initiatives through structured reflection. Health Research Policy and Systems. 12(2):10–1186 (http://www.health-policy-systems.com/content/12/1/2, accessed 13 May 2015). 28. Ongolo-Zogo P, Lavis JN, Tomson G, Sewankambo NK. Initiatives supporting evidence informed health system policymaking in Cameroon and Uganda: a comparative historical case study. BMC Health Services Research. 2014;14(612). doi: 10.1186/s12913-014-0612-3. 29. Mijumbi RM, Oxman AD, Panisset U, Sewankambo NK. Feasibility of a rapid response mechanism to meet policymakers’ urgent needs for research evidence about health systems in a low income country: a case study. Implementation Science. 2014;9(114). doi: 10.1186/s13012-014- 0114-z. 30. Lavis JN, Boyko JA, Gauvin F. Evaluating deliberative dialogues focussed on healthy public policy. BMC Public Health. 2014;14(1287). doi: 10.1186/1471-2458-14-1287. 31. Greenhalgh T. What is this knowledge that we seek to exchange? The Milbank Quarterly. 2010;88(4):492–99 (http://www.milbank.org/uploads/documents/featured-articles/pdf/ whatisthisknowledge.pdf, accessed 11 August 2014). 32. Contandriopoulos D, Lemire M, Denis JL, Tremblay E. Knowledge exchange processes in organizations and policy arenas: a narrative systematic review of the literature. The Milbank Quarterly. 2010;88(4):444–83. doi: 10.1111/j.1468-0009.2010.00608.x. 33. Dobrow MJ, Goel V, Lemieux-Charles L, Black NA. The impact of context on evidence utilization: a framework for expert groups developing health policy recommendations. Social Science and Medicine. 2006;63(7):1811–24. 34. Dobrow MJ, Goel V, Upshur RE. Evidence-based health policy: context and utilisation. Social Science and Medicine. 2004;58(1):207–17. 35. Mays N, Pope C, Popay J. Systematically reviewing qualitative and quantitative evidence to inform management and policy-making in the health field. Journal of Health Services Research & Policy. 2005;10(1):6–20. 36. Pope C, Mays N, Popay J. How can we synthesize qualitative and quantitative evidence for healthcare policy-makers and managers? Healthcare Management Forum. 2006;19(1):27–31. 37. Greenhalgh T. How to read a paper: getting your bearings (deciding what the paper is about). British Medical Journal. 1997;315:243–6 (http://www.ncbi.nlm.nih.gov/pmc/articles/ PMC2127173/pdf/9253275.pdf, accessed 9 February 2016). 38. Daly J, Willis K, Small R, Green J, Welch N, Kealy M et al. A hierarchy of evidence for assessing qualitative health research. Journal of Clinical Epidemiology. 2007;60(1):43–9 (http://www. sandy-campbell.com/sc/KTC_Module_1_files/2.4b%20Daly%20et%20al%202007.pdf, accessed 9 February 2016). 67 CONCEPTUAL BACKGROUND AND CASE STUDIES 39. Framework and standards for country health information systems. Geneva: World Health Organization; 2007 (http://apps.who.int/iris/bitstream/10665/43872/1/9789241595940_eng.pdf, accessed 16 May 2016). 40. Lewin S, Oxman AD, Lavis JN, Fretheim A, García Martí S, Munabi-Babigumira S. SUPPORT Tools for evidence-informed health Policymaking (STP) 11: Finding and using research evidence about local conditions. Health Research Policy and Systems. 2009;7(Suppl 1):S11 (https://health- policy-systems.biomedcentral.com/articles/10.1186/1478-4505-7-S1-I1, accessed 22 June 2016). 41. SURE guides for preparing and using evidence-based policy briefs. The SURE Collaboration. 2011 (http://www.who.int/evidence/sure/guides/en/, accessed 20 November 2015). 42. McAdam R, Mason B, McCrory J. Exploring the dichotomies within the tacit knowledge literature: towards a process of tacit knowing in organizations. Journal of Knowledge Management. 2007;11(2) (http://www.sandy-campbell.com/sc/KTC_Module_1_files/2.2a%20 McAdam%20et%20al%202007.pdf, accessed 11 August 2014). 43. Lomas J, Culyer T, McCutcheon C, McAuley L, Law S. Conceptualizing and combining evidence for health system guidance. Final report. Ottawa: Canadian Health Services Research Foundation; 2005 (http://www.cfhi-fcass.ca/migrated/pdf/insightAction/evidence_e.pdf, accessed 11 August 2014). 44. Ginsburg L, Lewis S, Zackheim L, Casebeer A. Revisiting interaction in knowledge translation. Implementation Science. 2007;2(34) (http://www.implementationscience.com/content/pdf/1748- 5908-2-34.pdf, accessed 11 August 2014). 45. Davies P. Is evidence-based government possible? Paper presented at the 4th Annual Campbell Collaboration Colloquium, Washington DC, 19 February 2004. London: Cabinet Office (http:// www.sandy-campbell.com/sc/KTC_Module_1_files/KTC%20Module%201%20-%202.3b%20 -%20Davies%202004.pdf, accessed 11 August 2014). 46. Jacobson N, Butterill D, Goering P. Development of a framework for knowledge translation: understanding user context. Journal of Health Services Research & Policy. 2003;8(2):94–9 (http://www.sandy-campbell.com/sc/KTC_Module_1_files/1.3b%20Jacobson%20et%20al%20 2003.pdf, accessed 9 February 2016). 47. Kothari AR, Bickford JJ, Edwards N, Dobbins MJ, Meyer M. Uncovering tacit knowledge: a pilot study to broaden the concept of knowledge in knowledge translation. BMC Health Services Research. 2011;11(198) (http://www.biomedcentral.com/content/pdf/1472-6963-11-198.pdf, accessed 11 August 2014). 48. Van de Ven AH, Johnson PE. Knowledge for theory and practice. Academy of Management Review. 2006;31(4):802–21 (http://www.sandy-campbell.com/sc/KTC_Module_1_files/2.1a%20 Van%20de%20Ven%20and%20Johnson%202006.pdf, accessed 11 August 2014). 49. Amara N, Ouimet M, Landry R. New evidence on instrumental, conceptual, and symbolic utilization of university research in government agencies. Science Communication. 2004;26(1)75–106. doi: 10.1177/1075547004267491. 68 INTRODUCTION TO EVIPNET EUROPE 50. Weiss CH. The many meanings of research utilization. Public Administration Review. 1979;39(5)426–31. 51. Lavis JN, Robertson D, Woodside JM, McLeod CB, Abelson J. How can research organizations more effectively transfer research knowledge to decision makers? Milbank Quarterly. 2003;81(2):221–48, 171–2. 52. Stetler CB. Updating the Stetler Model of research utilization to facilitate evidence-based practice. Nursing Outlook. 2001;49(6):272–9. 53. Haynes AS, Derrick GE, Redman S, Hall WD, Gillespie JA, Chapman S et al. Identifying trustworthy experts: how do policymakers find and assess public health researchers worth consulting or collaborating with? PLoS One. 2012;7(3):e32665. doi: 10.1371/journal. pone.0032665. 54. Haynes AS, Derrick GE, Chapman S, Redman S, Hall WD, Gillespie J et al. From “our world” to the “real world”: exploring the views and behaviour of policy-influential Australian public health researchers. Social Science and Medicine. 2011;72(7):1047–55. doi: 10.1016/j. socscimed.2011.02.004 55. Lavis JN, Davies H, Gruen RL, Walshe K, Farquhar CM. Working within and beyond the Cochrane Collaboration to make systematic reviews more useful to healthcare managers and policy makers. Healthcare Policy. 2006;1(2):21–33 (http://www.ncbi.nlm.nih.gov/pmc/articles/ PMC2585325/pdf/policy-01-21.pdf, accessed 11 August 2014). 56. Innvaer S, Vist G, Trommald, M, Oxman A. Health policy-makers’ perceptions of their use of evidence: a systematic review. Journal of Health Services Research & Policy. 2002;7(4):239–44. 57. Why the provisions matter. In: Drafting issues, objectives, policies and methods in regional policy statements and district plans. Wellington, New Zealand: Ministry for the Environment; 2014 (http://queenstown-noise.co.nz/pdf/MFEDRA~1.PDF, accessed 24 October 2016). 58. Young E, Quinn L. Writing Effective Public Policy Papers: A Guide for Policy Advisers in Central and Eastern Europe. Budapest, Hungary; 2002:13–4 (http://www.icpolicyadvocacy.org/ sites/icpa/files/downloads/writing_effective_public_policy_papers_young_quinn.pdf, accessed 24 May 2017). 59. Sutcliffe S, Court J. Evidence-based policymaking: What is it? How does it work? What relevance for developing countries? London: Overseas Development Institute; 2005 (https://www.odi.org/ sites/odi.org.uk/files/odi-assets/publications-opinion-files/3683.pdf, accessed 24 October 2016). 60. Walley J, Khan MA, Shah SK, Witter S, Wei X. How to get research into practice: first get practice into research. Bulletin of the World Health Organization. 2007;85(6) (http://www.who. int/bulletin/volumes/85/6/07-042531/en/, accessed 11 August 2014). 61. Bero LA, Grilli R, Grimshaw JM, Harvey E, Oxman AD, Thomson MA. Closing the gap between research and practice: an overview of systematic reviews of interventions to promote the implementation of research findings. British Medical Journal. 1998;317(7156):465–68 (http:// www.ncbi.nlm.nih.gov/pmc/articles/PMC1113716/, accessed 11 August 2014). 69 CONCEPTUAL BACKGROUND AND CASE STUDIES 62. McGrath PJ, Lingley-Pottie P, Emberly DJ, Thurston C, McLean C. Integrated knowledge translation in mental health: family help as an example. Journal of the Canadian Academy of Child Adolescent Psychiatry. 2009;18(1) (http://www.cacap-acpea.org/uploads/documents// February_2009_Integrated_KT.pdf, accessed 11 August 2014). 63. Moat KA, Lavis JN, Wilson MG, Røttingen JA, Bärnighausen T. Twelve myths about systematic reviews for health system policymaking rebutted. Journal of Health Services Research & Policy. 2013;18(1):44–50. doi: 10.1258/jhsrp.2012.011175. 64. Langlois EV, Ranson MK, Bärnighausen T, Bosch-Capblanch X, Daniels K, El-Jardali F et al. Advancing the field of health systems research synthesis. Systematic Reviews. 2015;4(90). doi: 10.1186/s13643-015-0080-9. 65. Grimshaw J. A knowledge synthesis chapter. Ottawa: Canadian Institute of Health Research; (n.d). (http://www.cihr-irsc.gc.ca/e/documents/knowledge_synthesis_chapter_e.pdf, accessed 15 May 2016). 66. Weighing up the evidence: making evidence-informed guidance accurate, achievable, and acceptable. A summary of the workshop held on September 29, 2005, Ottawa, Ontario. Ottawa: Canadian Health Services Research Foundation; 2006 (http://www.sandy-campbell.com/sc/ KTC_Module_1_files/KTC Module 1 - 2.3d - CHSRF 2006.pdf, accessed 24 November 2015). 67. Morestin F, Gauvin FP, Hogue MC, Benoit F. Method for synthesizing knowledge about public policies. Montréal: National Collaborating Centre for Healthy Public Policy, Institut national de santé publique du Québec ; 2010 (http://www.ncchpp.ca/docs/MethodPP_EN.pdf, accessed 11 August 2014). 68. Petticrew M, Roberts H. Systematic reviews in the social sciences. A practical guide. Oxford: Blackwell; 2006. 69. SUPPORT structured summaries of systematic reviews [website]. SUPPORT (http://www. supportsummaries.org/, accessed 17 November 2015). 70. Rosenbaum SE, Glenton C, Wiysonge CS, Abalos E, Mignini L, Young T et al. Evidence summaries tailored to health policy-makers in low- and middle-income countries. Bulletin of the World Health Organization. 2011;89(1):54–61. doi: 10.2471/BLT.10.075481. 71. Lavis JN, Boyko JA, Oxman AD, Lewin S, Fretheim A. SUPPORT Tools for evidence-informed health Policymaking (STP) 14: Organising and using policy dialogues to support evidence- informed policymaking. Health Research Policy and Systems. 2009;7(1):S14. doi: 10.1186/1478- 4505-7-S1-S14. 72. Shea BJ, Hamel C, Wells GA, Bouter LM, Kristjansson E, Grimshaw J et al. AMSTAR is a reliable and valid measurement tool to assess the methodological quality of systematic reviews. Journal of Clinical Epidemiology. 2009;62(10):1013–20. doi: 10.1016/j.jclinepi.2008.10.009. 73. Andrews JC, Schünemann HJ, Oxman AD, Pottie K, Meerpohl JJ, Coello PA et al. GRADE guidelines: 15. Going from evidence to recommendation-determinants of a recommendation’s direction and strength. Journal of Clinical Epidemiology. 2013;66(7):726–35. doi: 10.1016/j. jclinepi.2013.02.003. 70 INTRODUCTION TO EVIPNET EUROPE 74. Lavis JN, Wilson MG, Moat KA, Hammill A, Boyko JA, Grimshaw J et al. Developing and refining the methods for a ‘one-stop shop’ for research evidence about health systems. Health Research Policy and Systems. 2015;13(10) (http://www.health-policy-systems.com/ content/13/1/10, accessed 30 November 2015). 75. Dobbins M, Hanna SE, Ciliska D, Manske S, Cameron R, Mercer SL et al. A randomized controlled trial evaluating the impact of knowledge translation and exchange strategies. Implementation Science. 2009;4(61) (http://www.implementationscience.com/content/pdf/1748- 5908-4-61.pdf, accessed 11 August 2014). 76. Haynes AS, Gillespie JA, Derrick GE, Hall WD, Redman S, Chapman S et al. Galvanizers, guides, champions, and shields: the many ways that policymakers use public health researchers. Milbank Quarterly. 2011;89(4):564–98. doi: 10.1111/j.1468-0009.2011.00643.x. 77. The theory and practice of knowledge brokering in Canada’s health system: a report based on a CHSRF national consultation and a literature review. Ottawa: Canadian Health Services Research Foundation; 2003 (http://www.cfhi-fcass.ca/migrated/pdf/Theory_and_Practice_e.pdf, accessed 11 August 2014). 78. Jackson-Bowers E, Kalucy I, McIntyre E. Focus on knowledge brokering. Adelaide: Primary Health Care Research & Information Service; 2006 (http://www.sandy-campbell.com/sc/KTC_ Module_1_files/KTC%20Module%201%20-%204.1b%20-%20Jackson%E2%80%93Bowers%20 et%20al%202006.pdf, accessed 11 August 2014). 79. Ward V, House A, Hamer S. Knowledge brokering: the missing link in the evidence to action chain? Evidence & Policy. 2009;5(3):267–79 (http://www.ncbi.nlm.nih.gov/pmc/articles/ PMC3024540/pdf/ukmss-31790.pdf, accessed 11 August 2014). 80. Lévy P. Collective intelligence. Mankind’s emerging world in cyberspace. Cambridge, Massachusetts: Perseus Books; 1997. 81. Provan K, Kenis P. Modes of network governance: structure, management, and effectiveness. Journal of Public Administration Research and Theory. 2008;18(2):229–252. 82. Panisset U, Koehlmoos TP, Alkhatib AH, Pantoja T, Singh P, Kengey-Kayondo J et al. Implementation research evidence uptake and use for policy-making. Health Research Policy and Systems. 2012;10(20). doi:10.1186/1478-4505-10-20. 83. Bennett S, Ssengooba F. Closing the gaps: from science to action in maternal, newborn, and child health in Africa. PLoS Medicine. 2010;7(6):e1000298. doi: 10.1371/journal.pmed.1000298. 84. Ssengooba F, Atuyambe L, Kiwanuka SN, Puvanachandra P, Glass N, Hyder AA. Research translation to inform national health policies: learning from multiple perspectives in Uganda. BMC International Health and Human Rights. 2011;11(1):S13. doi: 10.1186/1472-698X-11-S1-S13. 85. Orem JN, Mafigiri DK, Marchal B, Ssengooba F, Macq J, Criel B. Research, evidence and policymaking: the perspectives of policy actors on improving uptake of evidence in health policy development and implementation in Uganda. BMC Public Health. 2012;12(109). doi: 10.1186/1471-2458-12-109. 71 CONCEPTUAL BACKGROUND AND CASE STUDIES 86. Kingdon JW. Agendas, alternatives, and public policies (Longman Classics Edition), Second edition. New York: HarperCollins College; 2003. 87. WHA: Priority setting in the health sector. Ministerial round table at the 1999 WHA. Medicus Mundi Schweiz Bulletin. 2003;91 (http://www.medicusmundi.ch/de/bulletin/mms-bulletin/ moglichst-viel-gesundheit-furs-geld/choosing-health-interventions-and-setting-priorities-at- national-level/wha-priority-setting-in-the-health-sector, accessed 10 February 2016). 88. Lavis JN, Oxman AD, Lewin S, Fretheim A. SUPPORT Tools for evidence-informed health Policymaking (STP) 3: Setting priorities for supporting evidence-informed policymaking. Health Research Policy and Systems; 2009 (http://www.ncbi.nlm.nih.gov/pmc/articles/ PMC3271830/pdf/1478-4505-7-S1-S3.pdf, accessed 11 August 2014). 89. Campbell S. Deliberative priority setting. A CIHR KT module. Ottawa: Canadian Institutes of Health Research; 2010 (http://www.cihr-irsc.gc.ca/e/43533.html, accessed 11 August 2014). 90. El-Jardali F, Makhoul J, Jamal D, Ranson MK, Kronfol NM, Tchaghchagian V. Eliciting policymakers’ and stakeholders’ opinions to help shape health system research priorities in the Middle East and North Africa region. Health Policy and Planning. 2010;25(1):15–27. doi: 10.1093/heapol/czp059. 91. Working Group on Priority Setting. Priority setting for health research: lessons from developing countries. Health Policy and Planning. 2000;15(2):130–36 (http://heapol.oxfordjournals.org/ content/15/2/130.full.pdf, accessed 11 August 2014). 92. Rudan I, Gibson J, Kapiriri L, Lansang MA, Hyder AA, Lawn J et al. Setting priorities in global child health research investments: assessment of principles and practice. Croatian Medical Journal. 2007;48:595–604 (http://www.cmj.hr/2007/48/5/17948946.htm, accessed 11 August 2014). 93. Baltussen R, Niessen L. Priority setting of health interventions: the need for multi-criteria decision analysis. Cost Effectiveness and Resource Allocation. 2006;4(14) (http://www.resource- allocation.com/content/pdf/1478-7547-4-14.pdf, accessed 11 August 2014). 94. Priority setting for health research: toward a management process for low and middle income countries. Working Paper 1. Geneva: Council on Health Research for Development; 2006 (http://www.cohred.org/downloads/cohred_publications/WP1_PrioritySetting.pdf, accessed 11 August 2014). 95. Viergever RF, Olifson S, Ghaffar A, Terry RF. A checklist for health research priority setting: nine common themes of good practice. Health Research Policy and Systems. 2010;8(36) (http:// www.health-policy-systems.com/content/pdf/1478-4505-8-36.pdf, accessed 11 August 2014). 96. Campbell S. The policy dialogue process in Cameroon: using evidence and multi-stakeholder deliberation to improve malaria control [video]. Vimeo; 2011 (http://vimeo.com/38883972, accessed 11 August 2014). 97. Moat KA, Lavis JN. 10 best resources for... evidence-informed health policy making. Health Policy and Planning. 2012;1–4 (http://heapol.oxfordjournals.org/content/early/2012/06/20/ heapol.czs050.full.pdf?keytype=ref&ijkey=LSzssgcB9V8dvUx, accessed 10 February 2016). 72 INTRODUCTION TO EVIPNET EUROPE 98. Lavis JN, Permanand G, Oxman AD, Lewin S, Fretheim A. SUPPORT Tools for evidence- informed health Policy-making (STP) 13: Preparing and using policy briefs to support evidence-informed policy-making. Special supplement of Health Research Policy and Systems. 2009;7(1):S13 (http://www.health-policy-systems.com/content/7/S1/S13, accessed 11 August 2014). 99. Oxman A, Hanney S, editors. SUPPORT Tools for evidence-informed health Policy-making (STP). Special supplement of Health Research Policy and Systems. 2009;7(1) (http://www.health-policy- systems.com/supplements/7/s1, accessed 20 November 2015). 100. Evidence briefs for policy. In: WHO [website]. Geneva: World Health Organization (http://www. who.int/evidence/resources/policy_briefs/en/, accessed 15 May 2016). 101. Lazar H, Forest PG, Lavis JN, Church J, editors. Paradigm freeze: why it is so hard to reform health care in Canada. Queen’s Policy Studies Series. Montreal: School of Policy Studies; 2013 (http://www.mqup.ca/paradigm-freeze-products-9781553393245.php, accessed 26 November 2015). 102. Lavis JN. Moving forward on both systematic reviews and deliberative processes. Health Care Policy. 2006;1(2):59–63 (http://www.ncbi.nlm.nih.gov/pmc/articles/PMC2585328/pdf/policy- 01-59.pdf, accessed 11 August 2014). 103. Lomas J. Using research to inform health care managers and policy-makers questions: from summative to interpretive synthesis. Health Care Policy. 2005;1(1):55–71 (http://www.ncbi.nlm. nih.gov/pmc/articles/PMC2585236/pdf/policy-01-55.pdf, accessed 11 August 2014). 104. Rapid response service. In: Ontario HIV Treatment Network [website]. Toronto: Ontario HIV Treatment Network; 2009 (http://www.ohtn.on.ca/rapid-response-service/, accessed 19 September 2014). 105. About the rapid response service. In: Canadian Agency for Drugs and Technology in Health [website]. Ottawa: Canadian Agency for Drugs and Technology in Health; 2013 (https://www. cadth.ca/about-cadth/what-we-do/products-services/rapid-response-service, accessed 11 August 2014). 106. Dobbins M, DeCorby K, Robeson P, Husson H, Tirilis D, Greco L. A knowledge management tool for public health: health-evidence.ca. BMC Public Health. 2010;10(496). doi: 10.1186/1471- 2458-10-496. 107. Wilson MG, Moat KA, Lavis JN. The global stock of research evidence relevant to health systems policymaking. Health Research Policy and Systems. 2013;11(32). doi: 10.1186/1478-4505-11-32. 108. Program in policy decision-making. Why use it and who’s behind it? In: Health Systems Evidence [website]. Hamilton: McMasters University; 2013 (http://www.healthsystemsevidence. org/why-use- it.aspx, accessed 11 August 2014). 109. Moat KA. Health systems learning: capacity building for health system decision-makers. Cochrane Canada Policy Webinar Series; 18 March 2015. 73 CONCEPTUAL BACKGROUND AND CASE STUDIES 110. Lavis JN, Jessani N, Permanand G, Catallo C, Zierler A. Matching form to function: designing organizational models to support knowledge brokering in European health systems. Policy summary 9 (BRIDGE series). Copenhagen: WHO Regional Office for Europe; 2013 (http://www. euro.who.int/__data/assets/pdf_file/0007/195235/Obs-Policy-Summary-9,-Matching-form-to- function.pdf, accessed 24 November 2015). 111. Uneke CJ, Ndukwe CD, Ezeoha AA, Uro-Chukwu HC, Ezeonu CT. Implementation of a health policy advisory committee as a knowledge translation platform: the Nigeria experience. International Journal of Health Policy and Management. 2015;4(3):161–8. doi: 10.15171/ ijhpm.2015.21. 112. Uganda Clearinghouse for Health Policy and Systems Research [website]. (http://nwtdemos. com/uchs/, accessed 15 May 2016). 113. EVIPNet Africa: Evidence-informed policy-making. In: World Health Organization [website]. Geneva: World Health Organization; 2015 (http://www.who.int/evidence/resources/country_ reports/africa/en/index5.html, accessed 24 November 2015). 114. EVIPNet Europe situation analysis manual. Copenhagen: WHO Regional Office for Europe; 2016. 115. Straus S, Tetroe J, Graham I. Knowledge translation in healthcare: moving from evidence to practice. Second edition. Chichester: John Wiley & Sons; 2013. 116. Lavis JN, Panisset U. EVIPNet Africa’s first series of policy briefs to support evidence- informed policy-making. International Journal of Technology Assessment in Health Care. 2010;26(2):229–32 (http://www.who.int/evidence/resources/policy_briefs/2Policybriefs.pdf, accessed 11 August 2014). 117. Barreto JOM, Souza NM. Making progress in the use of health policies and practices informed by evidence: the Piripiri-Piauí experience. Ciência & Saúde Coletiva. 2013;18(1):25–34 (http:// www.scielo.br/pdf/csc/v18n1/04.pdf, accessed 11 August 2014). 118. SURE Rapid Response. Is mandatory food fortification an efficient strategy for the alleviation of micronutrient deficiency? Kampala, Uganda: Regional East African Community Health Policy Initiative; 2011 (http://www.who.int/evidence/resources/country_reports/RRSfoodfortificaton. pdf, accessed 11 August 2014). 119. SURE Rapid Response. How can the sustainability of a public health (food fortification) program be ensured? Kampala, Uganda: Regional East African Community Health Policy Initiative; 2011 (http://www.who.int/evidence/resources/country_reports/RRSPHprograms.pdf, accessed 11 August 2014). 120. Unidad de Análisis y Generación de Evidencias en Salud Pública [Unit of Analysis and Generation of Evidence in Public Health]. In: Ministerio de Salud – Instituto National de Salud [website]. Lima: Unidad de Análisis y Generación de Evidencias en Salud Pública; 2013 (http:// www.ins.gob.pe/portal/jerarquia/4/605/evidencias-cientificas-unagesp/jer.605, accessed 11 August 2014). 74 INTRODUCTION TO EVIPNET EUROPE 121. Intervenciones dirigidas a disminuir el abandono antituberculoso [Interventions aimed at reducing TB abandonment] In: Ministerio de Salud – Instituto National de Salud [website]. Lima: Unidad de Análisis y Generación de Evidencias en Salud Pública; 2011 (http://www.ins. gob.pe/portal/jerarquia/4/605/evidencias-cientificas-unagesp/jer.605, accessed 11 August 2014). 122. Vundamina NK, Mwape L, Kasonde JM, Nambao M, Hazemba A, Maimbolwa M et al. Reducing deaths due to postpartum haemorrhage in homebirths in Zambia (SURE policy brief). Lusaka, Zambia: Zambia Forum for Health Research; 2011 (http://www.who.int/evidence/sure/ ZambiaReducingpostpartumhaemmorhage.pdf, accessed 12 February 2016). 123. Orton L, Lloyd-Williams F, Taylor-Robinson D, O’Flaherty M, Capewell S. The use of research evidence in public health decision making processes: systematic review. PLoS ONE. 2011;6(7):e21704 (http://www.sandy-campbell.com/sc/KTC_Module_1_files/1.2b%20Orton%20 et%20al%202011.pdf, accessed 14 March 2016). 124. Dobrow MJ, Chafe R, Burchett HED, Culyer AJ, Lemieux-Charles L. Designing deliberative methods for combining heterogeneous evidence: a systematic review and qualitative scan. Ottawa: Canadian Health Services Research Foundation; 2009. 125. Sharma T, Choudhury M, Kaur B, Naidoo B, Garner S, Littlejohns P et al. Evidence informed decision making: the use of “colloquial evidence” at NICE. International Journal of Technology Assessment in Health Care. 2015;31(3):138–146. 126. Terminology on statistical metadata: Conference of European Statisticians, Statistical Standards and Studies, No. 53. Geneva: United Nations Statistical Commission and Economic Commission for Europe; 2000 (http://ec.europa.eu/eurostat/ramon/coded_files/UNECE_TERMINOLOGY_ STAT_METADATA_2000_EN.pdf, accessed 22 June 2016). 127. Glossary of statistical terms. Paris: Organisation for Economic Co-operation and Development; 2007 (https://stats.oecd.org/glossary/, accessed 22 June 2016). 128. Banta D. Considerations in defining evidence for public health. International Journal of Technology Assessment in Health Care. 2003;19(3):559–573 (https://researchonline.lshtm. ac.uk/19469/1/IL7.pdf, accessed 14 March 2016). 129. Evidence-informed policy-making. In: World Health Organization [website]. Geneva: World Health Organization (http://www.who.int/evidence/about/en/, accessed 14 March 2016). 130. Ashrafian H, Darzi A, Athanasiou T. Evidence synthesis: evolving methodologies to optimise patient care and enhance policy decisions. In: Darzi A, Athanasiou T, editors. Evidence synthesis in healthcare. London: Springer; 2011:1–46 (http://link.springer.com/chapter/10.1007/978-0- 85729-206-3_1, accessed 14 March 2016). 131. A dictionary of epidemiology, Six edition. Oxford: Oxford University Press; 2014. 132. AbouZahr C, Boerma T. Health information systems: the foundations of public health. Bulletin of the World Health Organization. 2005;83:578–83 (http://www.who.int/bulletin/ volumes/83/8/578.pdf, accessed 9 February 2016). 75 CONCEPTUAL BACKGROUND AND CASE STUDIES 133. Bennett G, Jessani N. The Knowledge Translation Toolkit: bridging the know-do gap: a resource for researchers. Ottawa: International Development Research Centre; 2011 (http://www.idrc. ca/EN/Resources/Publications/Pages/IDRCBookDetails.aspx?PublicationID=851, accessed 20 November 2015). 134. Davenport T, Prusak L. Working knowledge: how organizations manage what they know: Boston: Harvard Business School; 1998. 135. MacDermid C, Graham ID. Knowledge translation: putting the ‘practice’ in evidence-based practice. Hand Clinics. 2009;25(1):125–43. 136. Pablos-Mendez A, Chunharas S, Lansang MA, Shademani R, Tugwell P. Knowledge translation in global health. Bulletin of the World Health Organization. 2005;83(10):723 (http://www.who. int/bulletin/volumes/83/10/723.pdf?ua=1, accessed 24 November 2015). 137. Cornelissen E, Mitton C, Sheps S. Knowledge translation in the discourse of professional practice. International Journal of Evidence-Based Healthcare. 2011;9(2):184–8 (http:// onlinelibrary.wiley.com/doi/10.1111/j.1744-1609.2011.00215.x/full, accessed 15 June 2016). 138. Dopson S, Fitzgerald L. Knowledge to action? Evidence-based health care in context: Oxford: Oxford University Press; 2006. 139. Brown J, Duguid P. Organizing knowledge. California Management Review. 1998;40(3):90–111 (http://cmr.ucpress.edu/content/40/3/90, accessed 15 June 2016). 140. Uneke CJ, Ezeoha AE, Ndukwe CD, Oyibo PG, Onwe F, Aulakh BK. Research priority setting for health policy and health systems strengthening in Nigeria: the policymakers’ and stakeholders’ perspective and involvement. Pan African Medical Journal 2013;16(10). doi:10.11604/pamj.2013.16.10.2318 (http://www.panafrican-med-journal.com/content/ article/16/10/full/, accessed 14 March 2016). 141. Ellen M. Knowledge translation framework for ageing and health. Geneva: World Health Organization; 2012 (http://www.who.int/ageing/publications/knowledge_translation.pdf, accessed 14 March 2016). 142. Nass SJ, Levit LA, Gostin LO. The HIPAA Privacy Rule. Glossary. Washington, DC: National Academies Press (US); 2009 (https://www.ncbi.nlm.nih.gov/books/NBK9572/, accessed 7 October 2016). 143. McCarthy, M. STEPS report: Public health research - Europe’s future. London: Department of Epidemiology and Public Health, University College London; 2011. The World Health Organization (WHO) is a specialized agency of the United Nations created in 1948 with the primary responsibility for international health matters and public health. The WHO Regional Office for Europe is one of six regional offices throughout the world, each with its own programme geared to the particular health conditions of the countries it serves. THE WHO REGIONAL OFFICE FOR EUROPE MEMBER STATES Albania Andorra Armenia Austria Azerbaijan Belarus Belgium Bosnia and Herzegovina Bulgaria Croatia Cyprus Czech Republic Denmark Estonia Finland France Georgia Germany Greece Hungary Iceland Ireland Israel Italy Kazakhstan Kyrgyzstan Latvia Lithuania Luxembourg Malta Monaco Montenegro Netherlands Norway Poland Portugal Republic of Moldova Romania Russian Federation San Marino Serbia Slovakia Slovenia Spain Sweden Switzerland Tajikistan The former Yugoslav Republic of Macedonia Turkey Turkmenistan Ukraine United Kingdom Uzbekistan IN TR O D U C TIO N TO EVIP N ET EU R O P E WORLD HEALTH ORGANIZATION REGIONAL OFFICE FOR EUROPE UN City, Marmorvej 51 DK-2100 Copenhagen Ø, Denmark Tel.: +45 45 33 70 00 Fax: +45 45 33 70 01 E-mail: euwhocontact@who.int Web: www.euro.who.int Evidence-informed Policy Network Europe CONCEPTUAL BACKGROUND AND CASE STUDIES Introduction to EVIPNet Europe - R es ou rc es - K no w le dg e tr an sl at io n th eo ry - Kn owle dge tran slat ion m echa nism s - K no wl ed ge tr an sl at io n pl at fo rm s - K no wl ed ge tr an sla tio n p lat for m cas e s tud ies

Key facts
Document type Technical Documents
Adoption date
Source World Health Organization