Feedback & feed-forward Immunization, Vaccines and Biologicals Training for mid-level managers (MLM) The immunization system & indicators Data collection & management Data analysis & display Taking action 5. Monitoring the immunization system IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dc hnhiZb Training for mid-level managers (MLM). Module 5: monitoring the immunization system ISBN 978-92-4-001571-5 (electronic version) ISBN 978-92-4-001572-2 (print version) This publication was originally published under WHO reference number WHO/IVB/08.05. © World Health Organization 2008, republished 2020 under the CC BY-NC-SA 3.0 IGO licence Some rights reserved. This work is available under the Creative Commons Attribution- NonCommercial-ShareAlike 3.0 IGO licence (CC BY-NC-SA 3.0 IGO; https://creativecommons.org/licenses/by-nc-sa/3.0/igo). Under the terms of this licence, you may copy, redistribute and adapt the work for non- commercial purposes, provided the work is appropriately cited, as indicated below. In any use of this work, there should be no suggestion that WHO endorses any specific organization, products or services. The use of the WHO logo is not permitted. If you adapt the work, then you must license your work under the same or equivalent Creative Commons licence. If you create a translation of this work, you should add the following disclaimer along with the suggested citation: “This translation was not created by the World Health Organization (WHO). WHO is not responsible for the content or accuracy of this translation. The original English edition shall be the binding and authentic edition´. Any mediation relating to disputes arising under the licence shall be conducted in accordance with the mediation rules of the World Intellectual Property Organization (http://www.wipo.int/amc/en/mediation/rules/). Suggested citation. Training for mid-level managers (MLM). Module 5: monitoring the immunization system. Geneva: World Health Organization; 2008, republished 2020 under the licence: CC BY-NC-SA 3.0 IGO. Cataloguing-in-Publication (CIP) data. CIP data are available at http://apps.who.int/iris. Sales, rights and licensing. To purchase WHO publications, see http://apps.who.int/bookorders. To submit requests for commercial use and queries on rights and licensing, see http://www.who.int/about/licensing. Third-party materials. If you wish to reuse material from this work that is attributed to a third party, such as tables, figures or images, it is your responsibility to determine whether permission is needed for that reuse and to obtain permission from the copyright holder. The risk of claims resulting from infringement of any third-party-owned component in the work rests solely with the user. General disclaimers. The designations employed and the presentation of the material in this publication do not imply the expression of any opinion whatsoever on the part of WHO concerning the legal status of any country, territory, city or area or of its authorities, or concerning the delimitation of its frontiers or boundaries. Dotted and dashed lines on maps represent approximate border lines for which there may not yet be full agreement. The menWion of specific companies or of cerWain manXfacWXrers¶ prodXcWs does noW impl\ WhaW they are endorsed or recommended by WHO in preference to others of a similar nature that are not mentioned. Errors and omissions excepted, the names of proprietary products are distinguished by initial capital letters. All reasonable precautions have been taken by WHO to verify the information contained in this publication. However, the published material is being distributed without warranty of any kind, either expressed or implied. The responsibility for the interpretation and use of the material lies with the reader. In no event shall WHO be liable for damages arising from its use. BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* ?djheZkYj_edjej^[i[h_[i This new series of modules on immunization training for mid-level managers replaces the version published in 1991. As there have been many changes in immunization since that time, these modules have been designed to provide immunization managers with up-to-date technical information and explain how to recognize management and technical problems and to take corrective action and how to make the best use of resources. More and more new, life-saving vaccines are becoming available, yet the introduction of a new vaccine does not necessarily require a separate plan and separate training. This new series for mid-level managers integrates training for new vaccine introduction into each subject addressed by the modules. In this way, introduction of new vaccines is put into its day-to-day context as part of the comprehensive range of activities required to improve immunization systems. In the context of these modules, mid-level managers are assumed to work in secondary administrative levels, such as a province ; however, the modules can also be used at national level. For district managers (third administrative level), a publication on ‘immunization in practice’1 is widely available. As it contains a large amount of technical detail, it is also recommended for mid-level managers courses. In writing these modules, the authors tried to include essential topics for mid-level managers, while keeping the modules brief and easy to use. They are intended to complement other published materials and guidelines, some of which are referred to in the text. Many more documents are available on the CD-ROM which accompanies this series. Each module is organized in a series of steps, in which technical information is followed by learning activities. Some knowledge and experience are needed to complete the learning activities, but even new readers should be imaginative and constructive in making responses. Facilitators should also be aware that the responses depend on the national context. Thus, there are no absolutely right or wrong answers, and the series does not set down new ‘policies’ or ‘rules’. The au- thors hope that the readers of these modules will find them informative, easy to read and an enjoyable learning experience. Modules in the mid-level managers series Module 1 : Cold chain, vaccines and safe-injection equipment management Module 2 : Partnering with communities Module 3 : Immunization safety Module 4 : Supportive supervision Module 5 : Monitoring the immunization system Module 6 : Making a comprehensive annual national immunization plan and budget Module 7 : The EPI coverage survey Module 8 : Making disease surveillance work 1 Immunization in practice : A practical guide for health staff. Geneva, World Health Organization, 2004. > BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* 7Yademb[Z][c[dji This new series of modules on immunization training for mid-level managers is the result of team work between a large number of partners including the Cent- ers for Disease Control and Prevention (CDC), IMMUNIZATIONbasics, Program for Appropriate Technology in Health (PATH), United Nations Children’s Fund (UNICEF), United States Agency for International Development (USAID) and the World Health Organization (WHO). The authors are especially grateful to the consultants from the University of South Australia who have made a major contribution to the development of the modules. >> BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* 9edj[dji Introduction to the series I Modules in the mid-level managers series I Acknowledgements II Abbreviations and Acronyms IV Introduction to Module 5 1 Purpose of this module 1 1. The immunization system and indicators 2 1.1 What is monitoring and why is it important? 2 1.2 Which aspects of the immunization programme should be monitored? 2 1.3 How is the immunization system monitored? 3 1.4 Which levels of the immunization programme should be monitored? 5 2. Data collection and management 8 2.1 Data collection at the health-facility level 8 2.2 Data collection at the district or provincial level 15 2.3 Data management 21 3. Data analysis and display 24 3.1 Common tools for displaying monitoring data 24 3.2 Comparing quarterly performance 29 4. Taking action 34 4.1 Investigating problems before deciding on action 34 4.2 Preparing an action plan 37 5. Feedback and feed-forward 38 5.1 Feedback to reporting sites 38 5.2 Feedback to the community 40 5.3 Feed-forward 40 Annex 1 : Key references 42 Annex 2 : Parameters of the immunization system 43 Annex 3 : Reaching Every District : implementation monitoring tools 45 Annex 4 : Sample form for recording timeliness and completeness 47 Annex 5 : How to prepare a coverage/drop-out monitoring chart 48 >>> BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* 7XXh[l_Wj_ediWdZ7Yhedoci The following abbreviations have been used in this document. AD auto-disable (syringe) AEFI Adverse Events Following Immunization AFP acute flaccid paralysis BCG bacille Calmette-Guérin (vaccine) CDC Centers for Disease Control & Prevention DO drop-out DTP diphtheria-tetanus-pertussis vaccine HepB hepatitis B (vaccine) Hib Haemophilus influenzae type b HMIS Health Management Information System IEC Information, education and communication IIP Immunization in practice NRA National Regulatory Authority NT neonatal tetanus OPV oral polio vaccine PAB protected at birth PATH Program for Appropriate Technology in Health (USA) RED Reaching Every District TT tetanus toxoid UNICEF United Nations Children’s Fund USAID United States Agency for International Development VPD vaccine-preventable disease VVM vaccine vial monitor WHO The World Health Organization YF yellow fever >K &BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* ?djheZkYj_edjeCeZkb[+ EjgedhZd[i]^hbdYjaZ Each month, every health facility and district sends a monthly report containing a vast amount of data. As a busy mid-level manager it is hard to look at every report, but you do need to know if there are any serious problems needing corrective action. How will you know when such problems occur? This module encourages mid-level managers to measure the performance of all components of the immunization system, by a combination of passive data collection (monthly reports), and active data collection (supervisory visits). It describes how managers can use the data they collect to identify problems and take corrective action, in order to improve the quality and success of their immunization programmes. Monitoring and surveillance are very closely linked and have much in common. However, for practicality and to ensure adequate focus upon the various technical issues, Module 5 : Monitoring the immunization system and Module 8 : Making disease surveillance work are separate. Both modules should be read in conjunction, however. This module is organized into the following steps: The immunization system & indicators Data collection & management Data analysis & display Taking action > > > Feedback & feed- forward > I]Z^bbjc^oVi^dchnhiZb^cY^XVidghÕ9ViVXdaaZXi^dcbVcV\ZbZciÕ9ViVVcVanh^hY^heaVnÕIV`^c\VXi^dcÕ;ZZYWVX`[ZZY"[dglVgY BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* ' '$J^[_cckd_pWj_edioij[cWdZ _dZ_YWjehi &#&L]Vi^hbdc^idg^c\VcYl]n^h^i^bedgiVci4 Monitoring is the systematic and continuous process of examining data, procedures and practices. It is used to measure progress, identify problems, develop solutions, and guide policies and interventions. Monitoring is an important tool for mid-level managers. It can help improve the quality of the immunization programme by ensuring : s ALL INFANTS AND PREGNANT WOMEN ARE IMMUNIZED s VACCINES AND SAFE INJECTION EQUIPMENT ARE DELIVERED IN CORRECT QUANTITIES AND on time; s STAFF ARE WELL TRAINED AND ADEQUATELY SUPERVISED s INFORMATION ON DISEASE INCIDENCE AND ADVERSE EVENTS FOLLOWING IMMUNIZATION (AEFI) are collected and analysed ; s THE COMMUNITY HAS CONlDENCE IN THE VACCINES DELIVERED AND THE IMMUNIZATION service they receive. &#'L]^X]VheZXihd[i]Z^bbjc^oVi^dcegd\gVbbZ h]djaYWZbdc^idgZY4 For the purpose of monitoring your immunization programme it is useful to divide the immunization system into five components ; these are shown in Figure 5.1. Each component can then be broken down into smaller parts that are easier to evaluate. For example : Component 2 (vaccine supply, quality and logistics) can be broken down into vaccine storage, distribution, quality, and disposal of safe injection equipment, as well as many other aspects. You will need to look at each of these smaller parts in order to monitor overall aspects of Component 2. BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* (I]Z^bbjc^oVi^dchnhiZb^cY^XVidghÕ9ViVXdaaZXi^dcbVcV\ZbZciÕ9ViVVcVanh^hY^heaVnÕIV`^c\VXi^dcÕ;ZZYWVX`[ZZY"[dglVgY Annex 2 lists the different smaller parts of each component that you should consider monitoring. As a mid-level manager you are probably familiar with some of these smaller parts, but may have never realized that they could be used as part of an overall, systematic monitoring plan. ;^\jgZ*#&/;^kZXdbedcZcihd[i]Z^bbjc^oVi^dchnhiZbidWZbdc^idgZY 2) Vaccine supply, quality & logistics 5) Programme management 3) Surveillance & monitoring 4) Advocacy & communication 1) Service delivery Key point: Five components of the immunization system must be monitored. Each component can be broken down into smaller parts to make monitoring easier. &#(=dl^hi]Z^bbjc^oVi^dchnhiZbbdc^idgZY4 Now that you are familiar with the five different components and understand that each one can be broken down into smaller parts to make monitoring easier, you must decide what level of quality or type of performance you are aiming for in your programme. For example : Drop-out rates are very important when monitoring Component 1, service delivery. But what is the drop-out rate you consider acceptable? A statement that describes the quality you hope to achieve in your programme is called a ‘programme goal’, ‘benchmark’, ‘standard’ or ‘indicator’. To avoid confusion, in this Module we will use the word ‘indicator’. Developing good quality indicators is the first, and one of the most important steps in monitoring the progress of your immunization programme. Key point : Indicators set the standard that you are aiming for in your immunization programme. Monitoring is the continuous and regular measurement of progress towards these indicators. I]Z^bbjc^oVi^dchnhiZb^cY^XVidghÕ9ViVXdaaZXi^dcbVcV\ZbZciÕ9ViVVcVanh^hY^heaVnÕIV`^c\VXi^dcÕ;ZZYWVX`[ZZY"[dglVgY BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* ) It is worth questioning whether the existing indicators in your programme actually measure every component of the immunization system, and whether they provide the necessary information to take corrective action. Sometimes new indicators may be formulated to monitor certain components of the immunization system that were not being previously systematically monitored. &#(#&:chjg^c\\ddYfjVa^in^cY^XVidgh An indicator should be written in such a way that you can clearly see what is to be monitored. This in turn will help you decide how it is best monitored, and therefore the kind of data that must be collected. A good quality indicator should be: s BASED ON DATA THAT ARE EASY TO COLLECT s EASY TO UNDERSTAND s LINKED TO A CORRECTIVE ACTION THAT IS SPECIlC ACTION THAT CAN BE TAKEN TO IM- prove performance). For example : You have implemented a safe injection policy at the district level. The indicator states that all injections should be given with an auto-disable (AD) syringe and the correct injection technique used (what is to be measured). The best way to measure this is to identify what proportion of all injections are given in this way (how it is to be measured). If only 80% of injections are given in this way, then more AD syringes might need to be ordered or more training given to staff on correct injection technique (i.e. the corrective action to be taken). Another example : To measure the standard of programme management at the provincial level the indicator states that there should be at least one supportive supervision visit to each district every quarter (i.e. what is to be measured). The best way to measure this is to identify how many supportive supervision visits were made during a quarter (i.e. how it is to be measured). If only one supportive supervision visit is made to a district in a 12–month period, then perhaps more funding is required for petrol or vehicle repair (i.e. the corrective action to be taken). An indicator can sometimes alert us to many things in the same way that the engine oil-pressure indicator on a vehicle tells the driver the oil-pressure reading. If it is not in the normal range it suggests that something is wrong and the driver needs then to check a number of things such as: whether the oil level is correct ; whether the oil pump is working correctly ; whether the engine gaskets are holding. In the same way, a good immunization programme indicator will have multiple meanings and will tell a manager what problems may need to be addressed. BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* *I]Z^bbjc^oVi^dchnhiZb^cY^XVidghÕ9ViVXdaaZXi^dcbVcV\ZbZciÕ9ViVVcVanh^hY^heaVnÕIV`^c\VXi^dcÕ;ZZYWVX`[ZZY"[dglVgY Indicator Primary meaning Additional meaning BCG coverage in children < 1 year of age is at least 80% by 2008. Infants who have come the first time for immunization. Level of access to services and effectiveness of community mobilization. Drop-out rate for BCG-measles is 30%. Infants who have not completed the primary immunization series. Quality of service delivery and defaulter tracking mechanisms. 5% of health facilities have non-functioning refrigerators. Equipment status. Efficiency of maintenance and repair system. 75% of health facilities have an up-to-date coverage/drop-out monitoring chart by 2007. Status of coverage/drop-out monitoring. Effectiveness of supportive supervision. ;dgZmVbeaZ/ &#)L]^X]aZkZahd[i]Z^bbjc^oVi^dcegd\gVbbZ h]djaYWZbdc^idgZY4 To ensure that your immunization programme is monitored systematically, each level of the health system should be included. For simplicity, three levels are used in this document : health-facility level ; district level ; national (and/or provincial) level. Sometimes it is not possible to use the same indicator for each level because the data are not available, or the indicator is not relevant. In these cases it might be necessary to adapt the indicator for each different level of the health system. Key point : A well-designed monitoring programme will measure the quality of the immunization service at each level of the health system. I]Z^bbjc^oVi^dchnhiZb^cY^XVidghÕ9ViVXdaaZXi^dcbVcV\ZbZciÕ9ViVVcVanh^hY^heaVnÕIV`^c\VXi^dcÕ;ZZYWVX`[ZZY"[dglVgY BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* + L ea rn in g a ct iv it y 5. 1 : A ss es si n g t h e q u al it y o f fr eq u en tl y- u se d in d ic at o rs Yo u ar e a m id -le ve l m an ag er in D ee p B ay P ro vi nc e an d ha ve b ee n as ke d to re vi ew s om e co m m on ly -u se d in di ca to rs to e ns ur e th at th ey ar e of g oo d qu al ity a nd r el ev an t to e ac h le ve l o f th e he al th s ys te m . TA S K : R ea d ea ch in di ca to r an d de ci de w he th er t he d at a ar e ea sy t o co lle ct , e as y to u nd er st an d an d lin ke d to c or re ct iv e ac tio n fo r th e th re e le ve ls o f th e he al th s ys te m . P la ce a t ic k (v ) i f th ey a re , o r a cr os s (x ) i f th ey a re n ot . I n th e ex am pl e be lo w , t he in di ca to r da ta a re ea sy t o co lle ct a t na tio na l/p ro vi nc ia l l ev el ; h ow ev er , a t di st ric t an d he al th -fa ci lit y le ve l t hi s ki nd o f ag gr eg at ed in di ca to r ca nn ot b e ea si ly co lle ct ed a nd u se d. C o m p o n en ts o f th e im m u n iz at io n s ys te m In d ic at o r Q u al it y o f in d ic at o r at d iff er en t le ve ls o f th e h ea lt h s ys te m Is t h e in d ic at o r: N at io n al / P ro vi n ci al D is tr ic t H ea lt h fa ci lit y 1) S er vi ce d el iv er y By 2 01 0, a ll di st ric ts h av e DT P3 c ov er ag e gr ea te r t ha n 80 % . Ea sy to c ol le ct (e xa m pl e) ? 3 x x Ea sy to u nd er st an d? Li nk ed to c or re ct iv e ac tio n? 2) Va cc in e su pp ly, q ua lit y an d lo gi st ic s Di st ric ts w ith s to ck -o ut o f m ea sl es v ac ci ne in th e pr ev io us q ua rte r. Ea sy to c ol le ct ? Ea sy to u nd er st an d? Li nk ed to c or re ct iv e ac tio n? 3) Su rv ei lla nc e an d m on ito rin g N um be r o f r ep or te d m ea sl es c as es is le ss th an 1 0 pe r m on th . Ea sy to c ol le ct ? Ea sy to u nd er st an d? Li nk ed to c or re ct iv e ac tio n? 4) Ad vo ca cy a nd c om m un ic at io n Pl an ni ng m ee tin gs c on du ct ed w ith c om m un ity . Ea sy to c ol le ct ? Ea sy to u nd er st an d? Li nk ed to c or re ct iv e ac tio n? 5) Pr og ra m m e m an ag em en t Pe rc en ta ge o f v ac an t p os iti on s th at w er e sa nc tio ne d. Ea sy to c ol le ct ? Ea sy to u nd er st an d? Li nk ed to c or re ct iv e ac tio n? BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* ,I]Z^bbjc^oVi^dchnhiZb^cY^XVidghÕ9ViVXdaaZXi^dcbVcV\ZbZciÕ9ViVVcVanh^hY^heaVnÕIV`^c\VXi^dcÕ;ZZYWVX`[ZZY"[dglVgY Le ar n in g a ct iv it y 5. 2 : D ra ft in g in d ic at o rs fo r th e d iff er en t co m p o n en ts o f th e im m u n iz at io n s ys te m In L ea rn in g ac tiv ity 5 .1 y ou r ev ie w ed t he in di ca to rs fo r D ee p B ay P ro vi nc e. S om e w er e of p oo r qu al ity , a nd s om e w er e no t re le va nt t o ea ch le ve l o f th e he al th s ys te m . N ow y ou m us t tr y to w rit e yo ur o w n in di ca to rs . TA S K : F or e ac h co m po ne nt o f t he im m un iz at io n sy st em , c ho os e on e in di ca to r a nd tr y to w rit e it fo r e ac h le ve l o f t he h ea lth -c ar e sy st em . R em em be r th at t he d at a m us t be e as y to c ol le ct , a nd t he in di ca to r sh ou ld b e ea sy t o un de rs ta nd a nd b e lin ke d to a c or re ct iv e ac tio n. A n ex am pl e is p ro vi de d. A nn ex 2 li st s th e fiv e co m po ne nt s in d et ai l a nd m ay h el p yo u ch oo se a s ui ta bl e in di ca to r; o th er w is e re fe r to M od ul e 4 :S up po rt iv e su pe rv is io n an d M od ul e 2 : P ar tn er in g w ith c om m un iti es fo r ot he r po ss ib le in di ca to rs . Co m po ne nt s of th e im m un iz at io n sy st em In di ca to r f or e ac h le ve l o f t he h ea lth -c ar e sy st em N at io na l/P ro vi nc ia l l ev el D is tr ic t l ev el H ea lth -f ac ili ty le ve l 1) Se rv ic e de liv er y (e xa m pl e) By 2 01 0 al l d is tri ct s ha ve D TP 3 co ve ra ge gr ea te r t ha n 80 % . By 2 01 0 al l h ea lth fa ci lit ie s ha ve D TP 3 co ve ra ge gr ea te r t ha n 80 % . By 2 01 0 al l v ill ag es h av e DT P3 c ov er ag e gr ea te r th an 8 0% . 2) Va cc in e su pp ly, qu al ity a nd lo gi st ic s 3) Su rv ei lla nc e an d m on ito rin g 4) Ad vo ca cy a nd co m m un ic at io n 5) Pr og ra m m e m an ag em en t I]Z^bbjc^oVi^dchnhiZb^cY^XVidghÕ9ViVXdaaZXi^dcbVcV\ZbZciÕ9ViVVcVanh^hY^heaVnÕIV`^c\VXi^dcÕ;ZZYWVX`[ZZY"[dglVgY BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* - ($:WjWYebb[Yj_edWdZcWdW][c[dj In Section 1 of this module we described the process for writing indicators which will help you measure the progress of your immunization programme. To summarize, to monitor the immunization system effectively you must : s BREAK DOWN THE lVE COMPONENTS OF THE IMMUNIZATION SYSTEM INTO SMALLER parts ; s DEVELOP GOOD QUALITY INDICATORS FOR EACH OF THESE SMALLER PARTS s INCLUDE INDICATORS FOR EACH LEVEL OF THE HEALTH SYSTEM FROM HEALTH FACILITY TO national level ; s MEASURE PROGRESS TOWARDS THE INDICATORS REGULARLY A good quality indicator is written so that the data needed to measure it are easy to collect. There are many sources of data available to the mid-level manager consolidated or aggregated for forwarding to the district (and later provincial) level. Some data must be collected through regular reporting forms (passive data collection), and others must be gathered by supervision and site visits (active data collection). See Box 5.1 for a description of these two methods. This section outlines some of the sources of data that mid-level managers can use for monitoring their immunization programmes, and also some ways to improve the accuracy of this data. Many of the following tools are displayed and described in the book Immunization in practice : A practical guide for health staff (Geneva, World Health Organization, 2004). Key point: The mid-level manager must be aware that data used for monitoring may be incorrect or incomplete. Supportive supervision plays an important role in ensuring that staff are properly trained in accurate documentation and data collection. '#&9ViVXdaaZXi^dcVii]Z]ZVai]"[VX^a^inaZkZa The following tools are used for routine recording of immunization-related activities at the service-delivery level. 1) Tally sheet. 2) Immunization register. 3) Immunization card. 4) Defaulter register. 5) Stock record. 6) Refrigerator temperature chart. 7) Health-facility consultation register. for this purpose, much of which is collected at the health-facility level and then BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* .I]Z^bbjc^oVi^dchnhiZb^cY^XVidghÕ9ViVXdaaZXi^dcbVcV\ZbZciÕ9ViVVcVanh^hY^heaVnÕIV`^c\VXi^dcÕ;ZZYWVX`[ZZY"[dglVgY '#&#&IVaanh]ZZih Tally sheets are the forms that health workers use to document an immunization session, by making a record for every dose of vaccine given. Tally sheets should be used for all sessions whether fixed, outreach or conducted by mobile teams. It is always worthwhile for a supervisor to spend time reviewing tally sheets with staff to improve the quality of reporting. Table 5.1 shows some common mistakes and corrective practices which supervisors can use as examples. Also, errors can be identified and practices corrected, but tally sheets should not be edited retrospectively. Key point : The immunization monitoring system depends upon the accuracy of tally sheets made at the time of immunization sessions. ;^\jgZ*#'/HVbeaZiVaanh]ZZi Source : Immunization in practice : A practical guide for health staff. Geneva, World Health Organization, 2004. Children Less than 1 year More than 1 year Vaccine Tally Total Tally Total BCG DTP1 DTP2 DTP3 OPV0 OPV1 OPV2 OPV3 Measles Vit. A HepB0 HepB1 HepB2 HepB3 Protected at Birth (ask at DTP1) Yes No Tally Total Tally Total Women Pregnant women Non-pregnant women Tally Total Tally Total TT1 TT2 TT3 TT4 TT5 Total TT Total TT2+TT3+ TT4+TT5 Names of staff Name of the health facility Date of session Fixed — Name of site Outreach/Mobile — Name of the site I]Z^bbjc^oVi^dchnhiZb^cY^XVidghÕ9ViVXdaaZXi^dcbVcV\ZbZciÕ9ViVVcVanh^hY^heaVnÕIV`^c\VXi^dcÕ;ZZYWVX`[ZZY"[dglVgY BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* &% To ensure accuracy of entries, the tally sheet should be structured according to: s VACCINATION SCHEDULE CURRENTLY IN USE PLUS ANY NEWLY INTRODUCED VACCINE should be included in the updated tally sheets) ; s TARGET AGE GROUPS TO BE IMMUNIZED AS A PRIORITY TARGET GROUP CHILDREN UNDER one year of age should be separated from any other age group that you may be immunizing) ; s OTHER INTERVENTIONS GIVEN ALONG WITH IMMUNIZATION EG VITAMIN ! Health facilities should record doses given to children and tetanus toxoid (TT) immunization to pregnant women in the appropriate register. There may be one register to record both infant immunizations and TT given to pregnant women, or two separate registers. Mistake in tallying Possible result Correct practice Using the same tally sheet for more than one session. Inaccurate number of doses and/or clients per session. Use a new tally sheet for each session. Tallying before the vaccine is administered. The child or pregnant woman may not receive the vaccine. Give the dose first and then tally using the tally sheet. Tallying at the end of a session according to number of doses contained in the used vials. ‘Wasted’ doses may be added to the total. Tally only those doses actually given. Tallying all vaccines under one age group (including those outside the targeted age). Will result in inaccurate coverage data. Separate tally for under one and over one year of age, and pregnant women. IVWaZ*#&/8dbbdcb^hiV`Zh^ciVaan^c\ '#&#'>bbjc^oVi^dcgZ\^hiZg While tally sheets record the doses given for each session, the immunization register records doses given to each individual and helps health workers keep track of the immunization services they offer to each infant and pregnant woman. Each dose given to every child or pregnant woman in the catchment area should be recorded against their names in the register. In this way the immunization register is the basis for tracking individual immunization status, and defaulters. Key point : Health workers should be urged to treat the immunization register with respect and care as it may be the only permanent record of immunization available. BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* &&I]Z^bbjc^oVi^dchnhiZb^cY^XVidghÕ9ViVXdaaZXi^dcbVcV\ZbZciÕ9ViVVcVanh^hY^heaVnÕIV`^c\VXi^dcÕ;ZZYWVX`[ZZY"[dglVgY ;^\jgZ*#(/>bedgiVci^c[dgbVi^dcidWZ^cXajYZY^cVc^bbjc^oVi^dcgZ\^hiZg What to include in the register A register should include the following information, as well as any information required by your health facility : s A UNIQUE IDENTIlCATION NUMBER s REGISTRATION DATE USUALLY THE DATE OF THE lRST VISIT s NAME OF INFANT s INFANTS BIRTHDATE s INFANTS SEX s NAME AND ADDRESS OF MOTHERPARENT s VACCINATIONS PROVIDED AND VITAMIN ! SUPPLEMENTATION s 44 VACCINATION PROVIDED TO PREGNANT WOMEN DEPENDING ON COUNTRY POLICY s WHETHER INFANT WAS 0ROTECTED AT "IRTH 0!" FOR NEONATAL TETANUS Source : Immunization in practice : A practical guide for health staff. Geneva, World Health Organization, 2004. Learning activity 5.3: Correct practice when using immunization registers You are the mid-level manager in Gic Province and during a supervisory visit you observe the following problems with the registers. TASK: Complete the table below by listing the correct practice that would avert each problem. Common problems Possible result Correct practice Not used at every session, especially outreach sessions. Inaccurate recording of services provided. Incomplete data. Inaccurate recording of services provided. Data entered twice. Inaccurate recording of services provided (same infant or woman may be counted twice). Difficulty in tracking defaulters. Not used to track defaulters. Infants drop out and do not complete the immunization series. I]Z^bbjc^oVi^dchnhiZb^cY^XVidghÕ9ViVXdaaZXi^dcbVcV\ZbZciÕ9ViVVcVanh^hY^heaVnÕIV`^c\VXi^dcÕ;ZZYWVX`[ZZY"[dglVgY BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* &' '#&#(9Z[VjaiZggZ\^hiZgdg^bbjc^oVi^dcgZb^cYZgWdm It is important to track children and pregnant women who fail to present for immunization. If many in the catchment area of the health facility are defaulting, then this may indicate a widespread lack of confidence in vaccines, poor outreach services, or problems with stock-outs. A system to track drop-outs is an integral part of the Reaching Every District (RED) strategy (See Annex 3), and is well described in Immunization in practice : A practical guide for health staff. '#&#)>bbjc^oVi^dcXVgYh It is important that immunization cards are completed accurately so that they can be used for tracking defaulters and providing caregivers and pregnant women with information on when to return for services. Some cards include a space for recording the batch number of each vaccine administered, or an area for documenting any adverse events following immunization (AEFI). The immunization cards should be of sufficient quality to last for several years as a record of the immunization status of a child or woman. They are often designed in the form of a small booklet the size of a purse or wallet. BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* &(I]Z^bbjc^oVi^dchnhiZb^cY^XVidghÕ9ViVXdaaZXi^dcbVcV\ZbZciÕ9ViVVcVanh^hY^heaVnÕIV`^c\VXi^dcÕ;ZZYWVX`[ZZY"[dglVgY It is important to distinguish between different batches of vaccine because they may have different expiry dates and should be used accordingly ; plus, in the event a certain vaccine is recalled, it is important to easily identify the location of the vaccine batch. Stock records can be maintained using a simple exercise book or using separate cards. Stock records are discussed in more detail in Module 1 : Cold chain, vaccines and safe-injection equipment management, and in Immunization in practice : A practical guide for health staff. Key point : Batch numbers for each vaccine should always be recorded. Common problems Possible result Correct practice No stock record. Can lead to overstocking, shortage of storage space, or stock-outs. Use stock record. Not updated. Can lead to overstocking, shortage of storage space, or stock-outs. Update stock record for every transaction. Incomplete data – expiry date, VVM status or batch number missing. Expired vaccines in stock or vaccines with VVM status reaching the discard point might be in stock. Complete all fields of record and discard expired vaccine. IVWaZ*#'/8dbbdcegdWaZbhl^i]hidX`gZXdgYh '#&#*HidX`gZXdgY Wherever vaccines are stored, a system of stock management must be in place to record the movement of vaccines and safe injection equipment in and out of the storage facility, including those received, dispatched and used. This will help ensure that : s VACCINES AND SAFE INJECTION EQUIPMENT ARE USED BEFORE THEIR EXPIRY DATE s THE VACCINE VIAL MONITOR 66- STATUS IS RECORDED AT RECEIPT AND ISSUE OF vaccines ; s THERE ARE NO STOCK OUTS OR OVER STOCKING I]Z^bbjc^oVi^dchnhiZb^cY^XVidghÕ9ViVXdaaZXi^dcbVcV\ZbZciÕ9ViVVcVanh^hY^heaVnÕIV`^c\VXi^dcÕ;ZZYWVX`[ZZY"[dglVgY BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* &) '#&#+GZ[g^\ZgVidgiZbeZgVijgZX]Vgi Twice a day (including weekends and holidays) the temperature of every refrigerator and freezer that stores vaccines should be recorded on a refrigerator temperature chart. This information is not difficult to collect and can provide valuable information about the quality of vaccines, the training of health workers, and the availability of equipment (including thermometers) at the health-facility level. ;^\jgZ*#)/8dbeaZiZYiZbeZgVijgZbdc^idg^c\X]Vgi!7d`^hEgdk^cXZ&Ä&+6j\jhi'%%* '#&#,=ZVai]"[VX^a^inXdchjaiVi^dcgZ\^hiZg Every health facility should maintain a register of consultations, including both outpatient and inpatient consultations. The register usually records name, address, age, diagnosis, and treatment. The health-facility consultation register is an important source of information on vaccine-preventable diseases (VPDs) and AEFI. These data are usually included in the monthly report (Section 2.2.1), and are reviewed during supervision visits (Section 2.2.2). Depending on national policies, the identification of certain VPDs or serious AEFI will generate an additional and immediate report to the next level. More information about recording and reporting AEFI and VPDs is included in Module 3 : Immunization safety and Module 8 : Making disease surveillance work. M E 14 12 10 8 6 4 2 0 -2 M E 21 M E 3 M E 4 M E 5 M E 6 M E 7 M E 8 Date (M = morning, E = evening) Temperature Monitoring Chart Bokis Health Facility – refrigerator#1 August 2005 M E 9 M E 10 M E 11 M E 12 M E 13 M E 14 M E 15 M E 16 °C x x x x x x x x x x x x x x x x x x x x x x x x x x x x x x x x BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* &*I]Z^bbjc^oVi^dchnhiZb^cY^XVidghÕ9ViVXdaaZXi^dcbVcV\ZbZciÕ9ViVVcVanh^hY^heaVnÕIV`^c\VXi^dcÕ;ZZYWVX`[ZZY"[dglVgY '#&#-Iddah[dgbdc^idg^c\VYkdXVXn!Xdbbjc^XVi^dc!VcYegd\gVbbZ bVcV\ZbZci^cY^XVidghVii]Z]ZVai]"[VX^a^inaZkZa The monthly workplan that outlines activities for the month can also serve as a tool to monitor Components 4 and 5. In addition to monitoring immunization sessions, the following activities can also be monitored : s COMMUNITY MOBILIZATION s COMMUNITY MEETINGS s SUPERVISORY VISITS s STAFF MEETINGS s TRAINING SESSIONS s STAFF MOVEMENTS s TRANSPORTATION SCHEDULE '#'9ViVXdaaZXi^dcVii]ZY^hig^Xidgegdk^cX^VaaZkZa '#'#&Bdci]angZedgi It is very important that immunization data be collated into a monthly report at each level of the health service. The monthly report should contain critical data on most of the components of the immunization system, without being too detailed and without putting too much burden on health staff. Most of the data collected from health facilities (Section 2.1) will be consol- idated into a monthly report that is forwarded to the district level. The district then consolidates data from all the health facilities into a monthly report, and forwards this on to the provincial level. Finally, the province consolidates all the district data in a provincial monthly report, which is then sent up to the national level. Figure 5.5 provides an example of a monthly report sent from the health facility. It shows: s THE NUMBER OF VACCINES ADMINISTERED IN *ULY INCLUDING THE NUMBER OF lXED and outreach sessions ; s STOCKS RECEIVED AND USED INCLUDING VACCINES AND SAFE INJECTION EQUIPMENT s THE NUMBER OF 60$S AND !%&) IDENTIlED Note that this is an ‘integrated’ monthly report, meaning that it includes immunization data as well as disease data. In some countries, however, the disease data is completed in a separate report. As a mid-level manager, both the immunization data and the disease data are very important to help you monitor the progress of immunization services in your area, and to take action when problems are identified. I]Z^bbjc^oVi^dchnhiZb^cY^XVidghÕ9ViVXdaaZXi^dcbVcV\ZbZciÕ9ViVVcVanh^hY^heaVnÕIV`^c\VXi^dcÕ;ZZYWVX`[ZZY"[dglVgY BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* &+ ;^ \j gZ * #* / :m Vb ea Z d[ V c ^c iZ \g Vi ZY b dc i] an gZ ed gi EP I- TE N G A PR OV IN CE : D IS TR IC T: M oH He al th F ac ili ty : N am e of th e M an ag er : M on th ly ta rg et in fa nt s: F ix ed s es si on s pl an ne d: N o. o f o ut re ac h pl an ne d: M O N TH LY V A CC IN AT IO N R EP O RT M on th : Ye ar : 1. S YN TH ES IS O F M ON TH LY V AC CI N AT IO N S GI VE N IN ST RU CT IO N S : Th is te m pl at e is th e on ly m on th ly re po rti ng to ol fo r a ll le ve ls . at s er vi ce & s ub -d is tri ct le ve ls : th e he al th w or ke r fi lls in th e fo rm b y m ak in g a sy nt he sis o f a ll va cc in at io n se ss io n ta lly sh ee ts o f t he m on th , t he st oc k r ec or d bo ok /s he et s a nd th e di se as e su rv ei lla nc e. T he co m pl et ed te m pl at e sh ou ld b e se nt to th e hi gh er le ve l b ef or e th e 10 th o f e ac h m on th . at d is tri ct le ve l: fo r i te m 1 . & 3 ., th e m an ag er sh ou ld m ak e th e su m m ar y o f t he d at a ite m s f or a ll pe rip he ra l v ac ci na tio n un its . F or it em 2 . t he st at us o f h is o w n st oc ks (q ty re ce iv ed , s to ck b al an ce a t t he e nd o f m on th a nd th e m in /m ax va cc in e te m pe ra tu re e xp os ur es ) s ho ul d be re po rte d. T he c om pl et ed te m pl at e sh ou ld b e se nt to th e hi gh er le ve l l at es t t he 1 0t h of th e ne xt m on th . at p ro vi nc ia l & n at io na l l ev el s: pr ov in ci al & n at io na l l ev el s re ce iv ed th e re po rts fr om d is tri ct s. M an ag er s at th os e le ve ls w ill m ak e th e re qu ire d st an da rd a na ly si s an d fe ed -b ac k to d is tri ct s. VA CC IN AT IO N ST RA TE G IE S TT V A CC IN AT IO N S TO P RE G N A N T W O M EN B CG PO LI O M YE LI TI S VA CC IN AT IO N S D TP /Q /P V A CC IN AT IO N S M EA SL ES VA CC IN AT IO N S YF VA CC IN AT IO N S VI TA M IN A SU PP LE M EN TA TI O N < 1 ye ar > 1 ye ar < 1 ye ar > 1 ye ar N o. o f se ss io ns 1s t do se 2n d do se 3r d do se 4t h do se 5t h do se 0- 11 m os >_1 ye ar at bi rth 1s t do se 2n d do se 3r d do se 1s t do se 2n d do se 3r d do se 1s t do se 2n d do se 3r d do se 1s t do se 2n d do se 3r d do se 9- 11 m on th s >_ 1 ye ar 9- 11 m on th s >_ 1 ye ar M ot he rs 0- 11 m on th s >_ 1 ye ar Fi xe d Ou tre ac h To ta l m on th To ta l d os es o pe ne d 2. FA CI LI TY /D IS TR IC T ST OC K M AN AG EM EN T DA TA 3. S YN TH ES IS O F DI SE AS E SU RV EI LL AN CE & A EF I Va cc in es & in je ct io n eq ui pm en t Q ua nt ity re ce iv ed ea ch m on th St oc k ba la nc e at th e en d of th e m on th Va cc in e do se s di sc ar de d du e to V VM c ha ng e Te m pe ra tu re s at w hi ch va cc in es h av e be en e xp os ed Ta rg et ed di se as es 0- 11 m on th s 1- 4 y ea rs 5- 14 y ea rs 15 y ea rs & + To ta l Va cc in at io n St at us (d os es re ce iv ed ) ca se s de at hs ca se s de at hs ca se s de at hs ca se s de at hs ca se s de at hs 0 1 2 3 un kn ow n M in (° C) M ax (° C) AF P Va cc in es & V ita m in A M ea sl es BC G M N T DT P Di ph th er ia OP V Pe rtu ss is M ea sl es Ye llo w F ev er TT M en in gi tis YF M al ar ia He pB Ot he rs Hi b Vi ta m in A Ty pe o f A EF I (E ve nt s) To ta l N o. of c as es Va cc in es -r el at ed e ve nt s A dd iti on al c om m en ts (if a ny ) In je ct io n eq ui pm en t BC G Po lio DT P M SL TT YF He pB Hi b AD S yr in ge s 0. 05 m l Ab sc es se s AD S yr in ge s 0. 5m l An ap hy la xi s Re co ns tit ut io n sy rin ge s, 2m l Ot he r a lle rg ic re ac tio ns Re co ns tit ut io n sy rin ge s, 5m l BC G Ly m ph ad en iti s Sa fe ty b ox es De at hs BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* &,I]Z^bbjc^oVi^dchnhiZb^cY^XVidghÕ9ViVXdaaZXi^dcbVcV\ZbZciÕ9ViVVcVanh^hY^heaVnÕIV`^c\VXi^dcÕ;ZZYWVX`[ZZY"[dglVgY Key point: Reliable monitoring of the immunization system requires a combination of passive and active data collection. '#'#'Hjeedgi^kZhjeZgk^h^dck^h^ih You may have noticed that the monthly reporting form did not capture much information on the advocacy and communication, and programme-management components of the immunization system. Active supervision is one way to collect data that is not otherwise captured in passive reports such as tally sheets, or monthly reports. Box 5.1 gives an explanation of the difference between passive and active data collection. Supervision includes the active observation of immunization activities and discussion with health workers and the community. ‘Supportive supervision’ refers to the process of detecting problems and identifying solutions by working with staff, recognizing achievements, and avoiding blame and criticism. There is little benefit to be gained in conducting brief unplanned visits which do not aim to systematically monitor performance. More information on this is included in Module 4 : Supportive supervision. Box 5.1 : What is the difference between passive and active data collection? Passive data collection Passive data collection implies that regular reports (e.g. monthly) are sent from the periphery to the mid-level manager. This is also known as ‘routine’ reporting and is usually part of a national Health Management Information System (HMIS). Usually passive data collection begins with tally sheets that are completed during immunization sessions. The tally sheets are then aggregated into a monthly report. Monthly reports are further aggregated at each administrative level. The monthly report should be designed so that it has as much information as possible on all five components of the immunization system. However, in practice, the monthly report cannot always provide the detail that is needed to obtain more complete information on progress. Active data collection A supervisory visit presents an excellent opportunity for monitoring the components of the immunization system, and providing details that will complement the monthly (passive) report. For example, active observation of immunization work and discussion with health workers and the community will provide information that cannot be captured in a monthly report. I]Z^bbjc^oVi^dchnhiZb^cY^XVidghÕ9ViVXdaaZXi^dcbVcV\ZbZciÕ9ViVVcVanh^hY^heaVnÕIV`^c\VXi^dcÕ;ZZYWVX`[ZZY"[dglVgY BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* &- Le ar n in g a ct iv it y 5. 4 : U si n g a ct iv e an d p as si ve d at a co lle ct io n t o m o n it o r im p le m en ta ti o n o f th e R ea ch in g E ve ry D is tr ic t (R E D ) st ra te gy Yo u ar e th e m id -le ve l m an ag er in B an ga y Pr ov in ce a nd w is h to m on ito r t he p ro gr es s of R E D im pl em en ta tio n in o ne o f y ou r d is tr ic ts . S om e in fo rm at io n is a va ila bl e fr om m on th ly r ep or ts a nd s om e is n ot , s o yo u w ill n ee d to u se o th er m et ho ds t o ob ta in a f ul l p ic tu re . TA S K : I n th e fo llo w in g ta bl e de ci de w hi ch in fo rm at io n ca n be c ol le ct ed t hr ou gh m on th ly r ep or ts , a nd w hi ch n ee ds t o be c ol le ct ed b y m ak in g a vi si t an d ob ta in in g in fo rm at io n by o bs er va tio n an d di sc us si on . R ef er t o A nn ex 3 fo r de ta ils o f R E D a ct iv iti es . RE D o pe ra tio na l c om po ne nt Pa ss iv e da ta c ol le ct io n (fr om m on th ly re po rt s) A ct iv e da ta c ol le ct io n (fr om v is its , o bs er va tio n an d di sc us si on ) Re -e st ab lis hi ng o ut re ac h se rv ic es . Su pp or tiv e su pe rv is io n. Li nk in g se rv ic es w ith c om m un iti es . M on ito rin g an d us e of d at a fo r a ct io n. Pl an ni ng a nd m an ag em en t o f r es ou rc es . BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* &.I]Z^bbjc^oVi^dchnhiZb^cY^XVidghÕ9ViVXdaaZXi^dcbVcV\ZbZciÕ9ViVVcVanh^hY^heaVnÕIV`^c\VXi^dcÕ;ZZYWVX`[ZZY"[dglVgY '#'#(Di]ZggZedgih Depending on the status of national disease control and vaccine safety policies, additional reports may be received at the district and provincial levels that could provide important data for monitoring the immunization system. These could include reports of serious AEFI, and AEFI investigations, and also case investigations of acute flaccid paralysis (AFP). '#'#)Bdc^idg^c\i^bZa^cZhhVcYXdbeaZiZcZhhd[gZedgih The possibility of a prompt and effective response is greater when reports are sent and received on time. Ideally all data should be available and analysed on time so that information on the situation prevailing can be taken into account. However, there may be situations where data for a particular period and facility or district are late. The best way to manage a late report is to submit an addendum to the monthly report. Late incoming data should not be rejected or ignored ; they must be used to update the existing data set at all levels. The completeness of reporting for each particular period is calculated on the basis of total number of reports expected (denominator) and number of reports received (numerator) and is expressed as a percentage. If reports are not complete for a district, the cumulative immunization coverage figure will drop and not reflect the true situation. A sample form for recording timeliness and completeness of monthly reporting from the health facility to the district is included in Annex 4. Key point : Districts should not pass their own reporting deadline when waiting to receive the latest report from the delaying health facility. I]Z^bbjc^oVi^dchnhiZb^cY^XVidghÕ9ViVXdaaZXi^dcbVcV\ZbZciÕ9ViVVcVanh^hY^heaVnÕIV`^c\VXi^dcÕ;ZZYWVX`[ZZY"[dglVgY BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* '% Learning activity 5.5 : Monitoring completeness and timeliness of reports You are the mid-level manager in Voletti Province and are calculating the completeness and timeliness of reporting for the first six months of the year in your 12 districts. TASK 1 : Complete the last two rows of the table by calculating the complete- ness and timeliness of reporting for each month (refer to the sample form in Annex 4). TASK 2 : What steps will you take to enhance the timeliness and complete- ness in Voletti Province? Monitoring form for completeness and timeliness of district reports in Voletti Province Reports due on the fifteenth of every month Districts Reports received on : Jan. Feb. Mar. Apr. May Jun. District 1 12 23 12 24 22 22 District 2 23 15 12 25 20 22 District 3 24 13 13 25 20 22 District 4 14 14 13 25 20 24 District 5 14 20 13 22 13 25 District 6 12 23 13 22 13 24 District 7 23 23 13 22 12 23 District 8 12 23 13 22 – – District 9 13 25 12 22 22 22 District 10 23 25 – – – 22 District 11 23 24 12 12 22 10 District 12 24 25 12 22 22 23 Completeness # received# districts Timeliness # on time# districts x 100________ ________ x 100 BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* '&I]Z^bbjc^oVi^dchnhiZb^cY^XVidghÕ9ViVXdaaZXi^dcbVcV\ZbZciÕ9ViVVcVanh^hY^heaVnÕIV`^c\VXi^dcÕ;ZZYWVX`[ZZY"[dglVgY Box 5.2: How do I find the right balance between too much and too little data? A vast amount of information is sent to the provincial level. A mid-level manager will receive reports from each district, reports of supervisory visits to health- facility and outreach sites, and reports from provincial administrative, financial and cold-chain/logistics units. In addition, a mid-level manager will compile reports on his or her own supervisory visits. To handle this volume of information, it is very important that the manager is clear about what information will be routinely analysed, based on the immunization programme indicators. These indicators should be chosen wisely so that they pro- vide enough information about the progress of the immunization programme but do not overwhelm the manager with the volume of data to be collected. Remember that you need enough information to make sure you can take corrective action when a problem is identified. '#(9ViVbVcV\ZbZci At the end of every month, district and provincial managers need to review all the data collected through passive and active reporting. The following steps ensure that the manager will be in a good position to take action on the data they receive. 1) Scan incoming reports : All reports should be reviewed for blanks, inaccur- acies (such as miscalculation or misplacement of figures), and inconsistencies. Reasons should be sought and corrections made, if possible. 2) Focus on priority indicators and areas : Collate the data that will measure the progress of the indicators, and examine the results from priority locations that may have performed poorly in the past, or areas that have had an unexpected change in performance. 3) Consolidate the data : Prepare a report for forwarding on to the next administrative level. The monthly report shown in Figure 5.5 includes some of the data necessary for measuring indicators and is designed for use by all levels. Data that are not presented in the monthly report, such as results from supervisory visits, should also be consolidated. 4) Analyse the data : The following section describes how the data can be analysed to measure progress towards the indicators. I]Z^bbjc^oVi^dchnhiZb^cY^XVidghÕ9ViVXdaaZXi^dcbVcV\ZbZciÕ9ViVVcVanh^hY^heaVnÕIV`^c\VXi^dcÕ;ZZYWVX`[ZZY"[dglVgY BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* '' '#(#&Jh^c\VXdbejiZg^oZYYViVWVhZ Ideally, data collected from monthly reports and other sources should be consolidated into a computer database for easy reference and to generate useful tables and graphs. The database should be sufficiently comprehensive to include all the quantitative data provided in the monthly report ; for example, immunization doses, disease incidence, AEFI, vaccine and supply and stock levels, etc. There are many examples of computerized databases available in various countries. One example is an Excel-based database that has been developed at WHO-HQ to include the quantitative data likely to be collected in a monthly report. BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* '(I]Z^bbjc^oVi^dchnhiZb^cY^XVidghÕ9ViVXdaaZXi^dcbVcV\ZbZciÕ9ViVVcVanh^hY^heaVnÕIV`^c\VXi^dcÕ;ZZYWVX`[ZZY"[dglVgY CdiZh/ I]Z^bbjc^oVi^dchnhiZb^cY^XVidghÕ9ViVXdaaZXi^dcbVcV\ZbZciÕ9ViVVcVanh^hY^heaVnÕIV`^c\VXi^dcÕ;ZZYWVX`[ZZY"[dglVgY BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* ') )$:WjWWdWboi_iWdZZ_ifbWo At every level, staff should use the data they have collected to monitor progress towards indicators for their catchment area. This will allow them to examine priority locations that may have performed poorly in the past, or areas that have experienced an unexpected change in the quality of performance. In this section, you will be shown the most common tools to help mid-level managers analyse and display data, and identify problem areas. A number of methods are described, including coverage/drop-out monitoring charts, bar charts, maps and tables. (#&8dbbdciddah[dgY^heaVn^c\bdc^idg^c\YViV (#&#&8dkZgV\Z$Ygde"djibdc^idg^c\X]Vgi A coverage/drop-out monitoring chart is a simple and effective tool for visually monitoring the progress towards immunization coverage targets across a region or area. The following information is presented on a graph. s 4HE NUMBER OF VACCINES ADMINISTERED ON A MONTH BY MONTH BASIS COMPARED with the number of children who should have received them (the target population). s )F THE COVERAGE RATES OF TWO VACCINES ARE PLOTTED ON THE SAME GRAPH THEN it is also possible to monitor the drop-out rates between the two vaccines, i.e. the number of infants that started receiving immunizations compared to the number of infants that received all doses of vaccine. Each level, from health facility to the national level, should display a current coverage/drop-out monitoring chart on the wall, so it is important that mid-level managers are familiar with producing these. See Annex 5 for instructions and a blank chart for your use. BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* '*I]Z^bbjc^oVi^dchnhiZb^cY^XVidghÕ9ViVXdaaZXi^dcbVcV\ZbZciÕ9ViVVcVanh^hY^heaVnÕIV`^c\VXi^dcÕ;ZZYWVX`[ZZY"[dglVgY L ea rn in g a ct iv it y 5. 6 : P re p ar in g a n d in te rp re ti n g a c ov er ag e/ d ro p -o u t m o n it o ri n g c h ar t A s th e m id -le ve l m an ag er in B ra dd ic i P ro vi nc e yo u ar e re sp on si bl e fo r m on ito rin g th e co ve ra ge a nd d ro p- ou t in y ou r pr ov in ce . T A S K 1 : C om pl et e th e gr ap h lin es fo r d ip ht he ria -t et an us -p er tu ss is v ac ci ne (D TP ) D TP 1 co ve ra ge a nd D TP 3 co ve ra ge in N ov em be r a nd D ec em be r (s ee A nn ex 5 fo r in st ru ct io ns ). TA S K 2 : L is t th re e m ai n in te rp re ta tio ns o f th e ch ar t. M * 12 = 1 20 00 M * 11 = 1 10 00 M * 10 = 1 00 00 M * 9 = 90 00 M * 8 = 80 00 M * 7 = 70 00 M * 6 = 60 00 M * 5 = 50 00 M * 4 = 40 00 M * 3 = 30 00 M * 2 = 20 00 M * 1 = 10 00 M * 0 = 0 M on th s Ja n. Cu m To ta l Fe b. Cu m To ta l M ar . Cu m To ta l Ap r. Cu m To ta l M ay Cu m To ta l Ju n. Cu m To ta l Ju l. Cu m To ta l Au g. Cu m To ta l Se p. Cu m To ta l Oc t. Cu m To ta l N ov . Cu m To ta l De c. Cu m To ta l DT P1 88 5 88 5 82 3 17 08 91 6 26 24 83 4 34 58 81 2 42 70 79 2 50 62 91 6 59 78 93 8 69 16 10 52 79 68 11 98 91 66 45 8 96 24 75 0 10 37 4 DT P3 52 0 52 0 45 9 97 9 42 7 14 06 67 7 20 83 52 1 26 04 58 3 31 87 45 8 36 45 52 1 41 66 80 2 49 68 55 2 55 20 20 8 57 28 52 1 62 49 Dr op o ut # 36 5 72 9 12 18 13 75 16 66 18 75 23 33 27 50 30 00 36 46 38 96 41 25 Dr op o ut % 41 .2 4 42 .6 8 46 .4 2 39 .7 6 39 .0 2 37 .0 4 39 .0 3 39 .7 6 37 .6 5 39 .7 8 40 .4 8 39 .7 6 x x x x x x x x x x x I]Z^bbjc^oVi^dchnhiZb^cY^XVidghÕ9ViVXdaaZXi^dcbVcV\ZbZciÕ9ViVVcVanh^hY^heaVnÕIV`^c\VXi^dcÕ;ZZYWVX`[ZZY"[dglVgY BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* '+ Learning activity 5.7 : Deciding which coverage/drop-out charts might be useful You are a mid-level manager deciding which coverage/drop-out charts might provide useful information about progress in your province. TASK 1 : Look at the following coverage/drop-out monitoring charts. List one piece of information from each chart that could be useful for monitoring your immunization programme indicators. Coverage/drop-out monitoring charts Information gained from the chart that could be helpful in monitoring immunization programme indicators BCG and DTP3 DTP1 and Measles HepB3 and DTP3 OPV3 and DTP3 OPV1 and OPV3 Measles and Yellow Fever Measles 1 and Measles 2 Key point : Bar charts are often easier to interpret if the columns are arranged in order of performance, rather than by name. This is called ‘ranking’. (#&#'7VgX]Vgih Although the coverage/drop-out monitoring chart can display information for one region such as a health facility or province, usually mid-level managers need to compare data across several areas which cannot be done using monitoring charts. The bar chart is easy to prepare and interpret, and can be used for the pres- entation of simple numbers, rates, or percentages across a number of districts, or more complex analysis involving a number of different indicators. Where possible, a bar chart should include information about the time period covered by the chart, including the year. BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* ',I]Z^bbjc^oVi^dchnhiZb^cY^XVidghÕ9ViVXdaaZXi^dcbVcV\ZbZciÕ9ViVVcVanh^hY^heaVnÕIV`^c\VXi^dcÕ;ZZYWVX`[ZZY"[dglVgY 100 90 80 70 60 50 % 40 30 20 10 0 Dis tric t 1 Dis tric t 2 Dis tric t 3 Dis tric t 4 Dis tric t 5 Dis tric t 6 Dis tric t 7 Dis tric t 8 Dis tric t 9 2002 2003 2004 In the above examples, the bar charts displayed data from just one indicator ; in this case DTP3 coverage. Bar charts can also be used for displaying more complex information, including change over time, although care must be taken to ensure the data can still be easily interpreted. ;^\jgZ*#+/9IE(XdkZgV\Z^cXdbeVg^hdcidWVhZa^cZnZVg'%%' ;^\jgZ*#,/7VgX]Vgih]dl^c\9IE&XdkZgV\ZXdbeVgZYl^i]hZhh^dc^beaZbZciVi^dc 100 90 80 70 60 50 40 30 20 10 0 Coverage Session implementation District 1 District 2 District 3 District 4 District 5 District 6 District 7 District 8 % I]Z^bbjc^oVi^dchnhiZb^cY^XVidghÕ9ViVXdaaZXi^dcbVcV\ZbZciÕ9ViVVcVanh^hY^heaVnÕIV`^c\VXi^dcÕ;ZZYWVX`[ZZY"[dglVgY BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* '- Key point : Always remember to look at the time period covered by the chart or map, as this may affect the way you interpret the data. For example, annual data may hide problems that occur at the same time each year (e.g. where community mobilization activities cease during the rainy season), but monthly data may overemphasize these problems. (#&#(BVehÅhedibVeh!h]VYZYbVeh Mapping is a very useful tool for displaying data on the progress of an immunization programme towards indicators. Simple maps, such as spot maps and shaded maps, can illustrate the distribution of cases of vaccine-preventable diseases, or display coverage data. Maps should be accompanied by a description of the indicator being measured by the map, and details of the time period covered, including the year. ;^\jgZ*#- /HedibVeh]dl^c\adXVi^dcd[[jcXi^dc^c\VcYcdc"[jcXi^dc^c\ gZ[g^\ZgVidgh^ci]ZhjW"Y^hig^Xihd[H^c\Zg9^hig^Xi!?VcjVgn'%%, BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* '.I]Z^bbjc^oVi^dchnhiZb^cY^XVidghÕ9ViVXdaaZXi^dcbVcV\ZbZciÕ9ViVVcVanh^hY^heaVnÕIV`^c\VXi^dcÕ;ZZYWVX`[ZZY"[dglVgY (#'8dbeVg^c\fjVgiZganeZg[dgbVcXZ An easy way of comparing quarterly performance is to divide the number of doses given during that quarter by the target population for that quarter. This method is the simplest way to compare performance within each district quarter-by-quarter and to make a real comparison between several districts. Table 5.3 shows how data from different districts can be entered into a single table for easy display and analysis by the mid-level manager. District 1 has an annual target population of 2400 and the quarterly DTP3 coverage is calculated using the following values of numerator (i.e. number of DTP3 doses given). ;^\jgZ*#./H]VYZYbVeh]dl^c\adl!bZY^jbVcY]^\]9IE(^bbjc^oVi^dc XdkZgV\Z^c<Vga^XEgdk^cXZ!'%%)Ä'%%+ Q1 (Jan., Feb., Mar.) Q2 (Apr., May, June) Q3 (July., Aug., Sep.) Q4 (Oct., Nov., Dec.) Doses given 500 450 380 550 Quarterly coverage 83 75 63 91 Note that the annual coverage will be the total of all doses given in the four quarters divided by the annual target population. For example : 500 + 450 + 380 + 550 ÷ 2400 = 78% 50% – 80%<50% >80% I]Z^bbjc^oVi^dchnhiZb^cY^XVidghÕ9ViVXdaaZXi^dcbVcV\ZbZciÕ9ViVVcVanh^hY^heaVnÕIV`^c\VXi^dcÕ;ZZYWVX`[ZZY"[dglVgY BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* (% B CG D TP 1 D TP 3 O PV 3 M ea sl es H ep B 3 TT 2+ Q 1 Q 2 Q 3 Q 4 Q 1 Q 2 Q 3 Q 4 Q 1 Q 2 Q 3 Q 4 Q 1 Q 2 Q 3 Q 4 Q 1 Q 2 Q 3 Q 4 Q 1 Q 2 Q 3 Q 4 Q 1 Q 2 Q 3 Q 4 D is tr ic t 1 D is tr ic t 2 D is tr ic t 3 D is tr ic t 4 D is tr ic t 5 D is tr ic t 6 D is tr ic t 7 D is tr ic t 8 D is tr ic t 9 D is tr ic t 1 0 IV Wa Z *# ( /F jV gi Zg an X dk Zg V\ Z YV iV V cV an h^ h ;d g ZV X] Y ^h ig ^X i/ 6 ii ]Z Z cY d [Z VX ] fj Vg iZ g! Z ci Zg i] Z gZ ed gi ZY X dk Zg V\ Z [d g ZV X] V ci ^\ Zc ^c i] Z Ve eg de g^ Vi Z Xd aj b c BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* (&I]Z^bbjc^oVi^dchnhiZb^cY^XVidghÕ9ViVXdaaZXi^dcbVcV\ZbZciÕ9ViVVcVanh^hY^heaVnÕIV`^c\VXi^dcÕ;ZZYWVX`[ZZY"[dglVgY Box 5.3 : How accurate does my denominator data need to be? To monitor the progress of the immunization system, mid-level managers are highly dependent upon accurate baseline data. This progress is often expressed as a percentage, and so the use of reliable denominator data is very important. The denominator can generally be defined as the target population, be they children less than one year of age, women of childbearing age, or a hard-to-reach population. There are many different sources of denominator data, and often several of these are available in a single country. Unfortunately, some of these sources are outdated and may not reflect the true population dynamics. Figures regarding emigration (inward or outward movement of populations) or the true birth rate may not be known. These and other factors can result in inaccurate baseline figures, with the effects shown below. The following list of activities may help you calculate a realistic denominator. 1) Consult with local experts and others in your country who have been involved in calculating denominator data for other immunization activities such as polio eradication or measles elimination. 2) Review demographic data from various official and unofficial sources, including community birth registers, government census surveys, and population surveys. 3) Consider using data from previous campaigns to estimate a denominator figure (e.g. a polio campaign reaching 90% coverage vaccinated 50 000 children, so the denominator can be calculated as 50 000/0.9 or 55 556 children under five years of age). 4) Conduct local headcounts using health workers or local community volunteers (care must be taken to include remote or difficult-to-access populations). 5) Consider systematically adding or subtracting a population multiplier e.g. adding a factor of 10% in an urban area in line with recent population trends. 6) After reaching a consensus on the denominator figure to be used, ensure it is used consistently for all calculations. 7) If the figure differs from official government estimates always note this when it is used in reports, tables or graphs. NEVER deliberately use an inaccurate denominator figure so as to over-inflate coverage figures. This will only place children and women at risk of disease. Effects of using inaccurate denominator data If the denominator figure is LOWER than the true target population figure If the denominator figure is HIGHER than the true target population figure For example : You think your target group is 100 000 children when in reality there are 150 000. For example : You think your target group is 200 000 children when in reality there are 100 000. Higher coverage (sometimes over 100%). Lower coverage. Inadequate supply of vaccines and safe injection equipment. Over-supply of vaccines and safe injection equipment. Difficulty identifying programme gaps. Lack of motivation when coverage targets appear not to be reached in spite of good service delivery. I]Z^bbjc^oVi^dchnhiZb^cY^XVidghÕ9ViVXdaaZXi^dcbVcV\ZbZciÕ9ViVVcVanh^hY^heaVnÕIV`^c\VXi^dcÕ;ZZYWVX`[ZZY"[dglVgY BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* (' Learning activity 5.8 : Understanding over-reporting problems You are the mid-level manager in Khalili Province and are compiling your annual coverage report based on data sent from the districts. You notice that several districts report annual coverage for DTP3 between 100% and 130%. TASK 1 : List three possible problems with the numerator that might have caused this. 1) 2) 3) TASK 2 : List three possible problems with the denominator that might have caused this. 1) 2) 3) TASK 3 : As a mid-level manager, what action can you take to understand and resolve the situation? Key point : 120% coverage is not better than 100%. It just indicates that you cannot monitor the real performance of your programme, and that the quality and accuracy of the denominator needs investigation. BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* ((I]Z^bbjc^oVi^dchnhiZb^cY^XVidghÕ9ViVXdaaZXi^dcbVcV\ZbZciÕ9ViVVcVanh^hY^heaVnÕIV`^c\VXi^dcÕ;ZZYWVX`[ZZY"[dglVgY CdiZh/ I]Z^bbjc^oVi^dchnhiZb^cY^XVidghÕ9ViVXdaaZXi^dcbVcV\ZbZciÕ9ViVVcVanh^hY^heaVnÕIV`^c\VXi^dcÕ;ZZYWVX`[ZZY"[dglVgY BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* () *$JWa_d]WYj_ed One of the key reasons for implementing a monitoring system is to identify problems and develop solutions that will improve the quality of the immunization system. Having established a reliable monitoring system, the mid-level manager must be prepared to respond to these problems and concerns. In this section we refer to ‘taking action’ specifically in the context of rectifying or averting problems. Two other ways of taking action — feedback and feed- forward — form part of the routine reporting and management of a monitoring system, and as such are discussed in the following section. )#&>ckZhi^\Vi^c\egdWaZbhWZ[dgZYZX^Y^c\dcVXi^dc Each time you investigate a problem, it can be helpful to think of the ‘iceberg effect’. As shown in Figure 5.10 below, the ‘iceberg effect’ means that the most obvious problem is usually identifiable (i.e. the part of the iceberg that is showing above the water), but also there are often underlying problems that are harder to see (i.e. the part of the iceberg hidden under the water). Key point : Any single problem identified may just be a symptom of many underlying problems in the immunization system. Always be prepared to investigate the underlying causes of a problem. Hidden problems training staffing levels stock control denominator data Low coverage equipment maintenance ;^\jgZ*#&%/>aajhigVi^dcd[i]ZÈ^XZWZg\Z[[ZXiÉl]ZgZi]ZbV^cegdWaZbXVcWZ hZZcWjidi]Zg]^YYZcegdWaZbhXdcig^WjiZid^i BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* (*I]Z^bbjc^oVi^dchnhiZb^cY^XVidghÕ9ViVXdaaZXi^dcbVcV\ZbZciÕ9ViVVcVanh^hY^heaVnÕIV`^c\VXi^dcÕ;ZZYWVX`[ZZY"[dglVgY Box 5.4 : How quickly should I respond to a problem? The speed at which you respond to a problem depends on the potential impact that problem will have on the immunization programme. In general these can be categorized into three levels of priority. 1) Immediate problems that may cause interruption to the immunization service or risk health and/or lives. 2) Trends that threaten the failure of the immunization programme. 3) General improvement in the performance and quality of the immunization service. The table below shows how each priority level will affect the speed at which the problems should be resolved. Sometimes an urgent problem may also need some medium- and long-term action. For example : If a vaccine stock-out has been identified, the urgent response will be to ensure vaccines are delivered as soon as possible to avoid an interruption to the immunization programme. A medium-term action might be to provide training and supervision regarding stock control and a long-term action might be to employ a vaccine storekeeper. Urgent action Medium-term action Long-term action Purpose Solve immediate problems that may cause interruption to the immuniza- tion service or risk health and/ or lives. Reverse trends that threaten the failure of the immunization programme. Improve the performance and quality of the immunization service. Should be solved within : Next few days/weeks. Next few months. Next planning cycle : usually quarterly or annually. Examples Stock-out or confirmed report of polio case. Reduced coverage or increased drop-out. Improving the number of reports of adverse events following immunization. I]Z^bbjc^oVi^dchnhiZb^cY^XVidghÕ9ViVXdaaZXi^dcbVcV\ZbZciÕ9ViVVcVanh^hY^heaVnÕIV`^c\VXi^dcÕ;ZZYWVX`[ZZY"[dglVgY BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* (+ Learning activity 5.9 : Taking action and solving problems You are the mid-level manager in Nabili Province, comprising 20 districts and 200 health facilities. The table below lists some problems that have been identified during monitoring. TASK: In each of the columns write one action you would take for the problem. Remember that one problem may be a symptom of many others in the sys- tem, and also that an urgent problem may also need medium- and long-term action. Components of the immunization system Problem Urgent action Medium-termaction Long-term action 1) Service delivery Failure of outreach services in hard-to-reach areas last quarter. Provincial coverage for measles vaccine declined last quarter compared to previous year. 2) Vaccine supply, quality & logistics Stock-out of AD syringes reported in three districts last month. National pentavalent vaccine wastage rate exceeded expected rate last year. 3) Surveillance & monitoring A measles outbreak reported in two districts last month. Last quarter, five districts did not send in reports. 4) Advocacy & communication An AEFI has resulted in all immunization activities being stopped in one district. Community mobilizers not being used effectively. 5) Programme management 20 health facilities have vacant posts. At least 25% of health facilities had received no supervisory visits last year. BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* (,I]Z^bbjc^oVi^dchnhiZb^cY^XVidghÕ9ViVXdaaZXi^dcbVcV\ZbZciÕ9ViVVcVanh^hY^heaVnÕIV`^c\VXi^dcÕ;ZZYWVX`[ZZY"[dglVgY )#'EgZeVg^c\VcVXi^dceaVc In this section we have listed the important steps a mid-level manager must take once a problem has been identified during the monitoring process. 1) Investigate the possible underlying causes. 2) Decide on the actions needed. 3) Build on this and make a plan to ensure follow-up is undertaken. An action plan is a simple way to track the decisions you have made and the people responsible for implementing the solutions. Once complete, an action plan, such as the example in Figure 5.11, becomes part of the monitoring process and must be reviewed regularly to ensure that progress is being made. Action Person(s) responsible Start-date End-date Progress 1) 2) 3) 4) 5) 6) PROBLEM IDENTIFIED : Area : Year : Adapted from: Increasing immunization coverage at the health facility level. (WHO/V&B/02.27). Key point : Regular review and analysis of data is important to ensure : early identification of problems; timely action ; progress towards goals and solving problems. ;^\jgZ*#&&/:mVbeaZd[VcVXi^dceaVc I]Z^bbjc^oVi^dchnhiZb^cY^XVidghÕ9ViVXdaaZXi^dcbVcV\ZbZciÕ9ViVVcVanh^hY^heaVnÕIV`^c\VXi^dcÕ;ZZYWVX`[ZZY"[dglVgY BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* (- +$<[[ZXWYaWdZ\[[Z#\ehmWhZ The terms ‘feedback’ and ‘feed-forward’ refer to the process of routinely sending results of data analysis to different levels of the monitoring system. Feedback (sending information to the peripheral levels) is particularly important for those who have provided the data, so that they can see the value of collecting and reporting information, and to compare their performance in relation to others at the same level. Feed-forward (forwarding results of data analysis to higher administrative levels) can help to promote accomplishments as well as highlight areas of concern and seek assistance with problems. *#&;ZZYWVX`idgZedgi^c\h^iZh The main reasons for providing feedback to reporting sites (such as district health staff and health facilities) are to : s CREATE A COLLABORATIVE ENVIRONMENT BY ACKNOWLEDGING THE HARD WORK OF DATA providers and reassuring them that their data will be analysed ; s IMPROVE THE ACCURACY AND PROMPTNESS OF THE REPORTS s VERIFY WITH THE PERIPHERAL LEVELS THAT THE DATA RECEIVED AT HIGHER LEVELS ARE correct ; s IMPROVE PERFORMANCE BY SHOWING NATIONAL PROGRESS TOWARDS SPECIlC PUBLIC health goals and comparing performances between regions ; s FACILITATE THE USE OF DATA BY PROVIDING DATA ANALYSIS IN GREATER DEPTH THAN CAN be achieved peripherally ; for instance, if the peripheral level is not computer- ized the central level might provide computerized tables, graphs and maps to enhance the local analysis of data ; s PROVIDE THE COMMUNITY WITH INFORMATION ON COVERAGE DROP OUT AND OTHER indicators, so they can help plan and implement better services ; s PLACE THE LOCAL DATA IN THE CONTEXT OF REGIONAL DATA ALLOW FOR COMPARISON OF data and performance and visualize the extent of coverage and drop-out. Key point : The importance of feedback should never be underestimated. The mid-level manager should remember feedback can be a valuable tool for improving coverage and other indicators. BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* (.I]Z^bbjc^oVi^dchnhiZb^cY^XVidghÕ9ViVXdaaZXi^dcbVcV\ZbZciÕ9ViVVcVanh^hY^heaVnÕIV`^c\VXi^dcÕ;ZZYWVX`[ZZY"[dglVgY Routine feedback to the reporting sites should comprise a consolidated report of the provincial and district priority indicators for the five components of the immunization system. It is important to first show the overall progress made in the last quarter, and secondly to show a more detailed analysis of the location and nature of the problem areas. At minimum, the following information should be included in routine feedback reports. *#&#&BZi]dYVcY[gZfjZcXnd[[ZZYWVX` There are many different ways a mid-level manager can feed back the results of monitoring. These depend on the data that are to be presented, the level at which the information is targeted, and whether a specific problem requires solving. Every mid-level manager should have a plan for providing regular feedback, but one-off, spontaneous, or ad hoc opportunities can also be advantageous. Although monthly newsletters or reports help to keep the peripheral levels informed and updated, a quarterly meeting can give the mid-level manager an opportunity to discuss achievements and problems face to face with staff and other interested partners. Meetings are most effective if the relevant data are analysed and prepared in advance in the form of visual displays, such as those illustrated in Section 3. For quarterly meetings this can sometimes result in complicated data covering many districts ; a table to help prepare quarterly coverage data for each antigen on a district-by-district basis has been included in Table 5.3 s #OVERAGE AND DROP OUT s 4IMELINESSCOMPLETENESS OF REPORTS s #ASES OF VACCINE PREVENTABLE DISEASES s 3TOCK OUTS s 2ESULTS OF INVESTIGATIONS INTO ADVERSE events following immunization. s 3UMMARY OF PROBLEMS IDENTIlED including underlying problems or contributing factors. s )NFORMATION ON ACTIONS TAKEN AND requests for further action, if needed. s #ONGRATULATIONS ON DOING A GOOD JOB or encouragement to do a better job. Key point : Prompt feedback of results should occur regularly ; by monthly newsletter if possible, or at least quarterly in a meeting. I]Z^bbjc^oVi^dchnhiZb^cY^XVidghÕ9ViVXdaaZXi^dcbVcV\ZbZciÕ9ViVVcVanh^hY^heaVnÕIV`^c\VXi^dcÕ;ZZYWVX`[ZZY"[dglVgY BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* )% *#';ZZYWVX`idi]ZXdbbjc^in As a mid-level manager, you should encourage your staff to provide feedback to communities about immunization services, and always involve local politicians, religious leaders, community group leaders, and parents in planning, implementing and improving immunization programmes. Unfortunately mid-level managers frequently overlook the importance of feeding information back to the community, both regarding the general immunization programme and when there are specific problems that need solving. For further information about providing feedback, and involving the community, refer to Module 2 : Partnering with communities. *#(;ZZY"[dglVgY Feed-forward is the process of forwarding the results of monitoring activities to more central levels. There are many formal feed-forward requirements with which the mid-level manager must comply, including a variety of surveillance reports referred to in Module 8 : Making disease surveillance work. Unfortunately these formal reports do not always provide a full picture of the situation. Feed-forward is therefore a very useful mechanism for both communicating issues/concerns that are affecting programme performance, and promoting successes, achievements or ‘lessons from the field’ from which others could learn. Since feed-forward data is usually intended for people who make or influence decisions at the higher level, the mid-level manager should ensure that they tell an accurate story about the performance in his/her province. The manager should also remember that feeding-forward does not always have to be through formal mechanisms such as monthly reports ; ad hoc opportunities such as writing newsletter articles and attending meetings can also be invaluable. BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* )&I]Z^bbjc^oVi^dchnhiZb^cY^XVidghÕ9ViVXdaaZXi^dcbVcV\ZbZciÕ9ViVVcVanh^hY^heaVnÕIV`^c\VXi^dcÕ;ZZYWVX`[ZZY"[dglVgY Routine feed-forward (monthly or at least quarterly) should comprise a consoli- dated report of the provincial and district priority indicators for the five components of the immunization system. The mid-level manager should consider feeding-forward the following information. s 3UMMARY OF THE RESULTS FOR PRIORITY INDICATORS s 4HE MOST SERIOUS PROBLEMS IDENTIlED INCLUDING UNDERLYING PROBLEMS OR contributing factors. s !REAS OF SUBSTANTIAL IMPROVEMENT OR GOOD PERFORMANCE s !CTIONS TAKEN OR THAT ARE RECOMMENDED AND REQUESTS FOR ASSISTANCE if needed. s #OPIES OF SUPPORTIVE SUPERVISION REPORTS Key point : In addition to regular feed-forward reports, the mid-level manager can send ad hoc information to inform decision-makers of important changes in monitoring results, both good and bad. )' BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* 6ccZm&/@ZngZ[ZgZcXZh Immunization in practice : A practical guide for health staff. Geneva, World Health Organization, 2004. Global Immunization Vision and Strategy (GIVS) 2006–2015 (WHO/IVB/05.05). Excel-based database that has been developed by WHO-HQ to include the quantitative data likely to be collected in a monthly report (this tool is available separately). Increasing immunization coverage at the health facility level (WHO/V&B/02.27) )( BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* 6ccZm'/EVgVbZiZghd[i]Z^bbjc^oV" i^dchnhiZb Components of the immunization system Parameters 1) Service delivery s #OVERAGE WITH "#' $40 $40 /06 (EP" (IB Measles, Yellow Fever, Vitamin A, TT2+ (e.g. <50%, 50%– 79%, >80%). s to Measles, Measles and Yellow Fever. s %XISTENCE OF A NATIONAL PLAN FOR IMMUNIZATION 2) Vaccine supply, quality and logistics s !VAILABILITY AND CONTINUITY OF SERVICES ADEQUATE SUPPLIES equipment, consumables and transport for distribution, outreach and supervision). s %XISTENCE OF GUIDELINES ON VACCINE MANAGEMENT TRANSPORT management ; cold chain ; waste disposal and destruction. s #OLD CHAIN EQUIPMENT OPERATING AND IN GOOD REPAIR s #OMPLETION AND DISPLAY OF COLD CHAIN MONITORING CHARTS s %XISTENCE OF INVENTORY OF IMMUNIZATION EQUIPMENT THAT includes date-of-purchase, functional status, maintenance schedule, and evidence that equipment has been maintained. s !VAILABILITY AND SUSTAINABLE ACCESS TO OTHER IMMUNIZATION equipment (e.g. laboratory, vehicles, computers, communication and specimen equipment, and consumables). s 6ACCINE FORECASTING VACCINE UTILIZATION AND WASTAGE MONITOR- ing (e.g. minimum, maximum and critical stocks and vaccine wastage rate). s 1UALITY OF VACCINE FULLY FUNCTIONAL .ATIONAL 2EGULATORY Authority (NRA) or other independent assessment of quality performed; manufacturer viable or vaccines procured from prequalified sources. s )MPLEMENTATION OF MULTI DOSE VIAL POLICY s #OMPLETION OF A STANDARDIZED IMMUNIZATION INJECTION SAFETY survey. s %XISTENCE AND IMPLEMENTATION OF POLICY PLAN AND BUDGET on injection safety assessment. s 4YPE OF INJECTION EQUIPMENT IN USE s -ETHOD OF INJECTION EQUIPMENT DISPOSAL $ROP OUT RATES FOR "#' TO $40 TO $ $40 $40 40 )) BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* Components of the immunization system Parameters 3) Surveillance and monitoring s #OMPLETENESS AND TIMELINESS OF ROUTINE REPORTING s #OMPLETION AND DISPLAY OF COVERAGEDROP OUT MONITORING CHARTS s 2EPORTED NEW CASES OF NON POLIO !&0 NEONATAL TETANUS .4 and measles. s 6ACCINE PREVENTABLE DISEASE INCIDENCE RATE s 0ROPORTION OF CASES CONlRMED BY LABORATORY s -ORTALITY RATE s #ASE FATALITY RATE s 3YSTEM FOR DETECTING INVESTIGATING AND REPORTING ADVERSE events following immunization (AEFI). s .OTIlED AND INVESTIGATED !%&) s .ON POLIO !&0 RATE AND PERCENTAGE OF !&0 CASES WITH TWO adequate stool samples. s #ASEOUTBREAK INVESTIGATION INITIATED WITHIN HOURS OF notification. s 0ERCENTAGE OF REPORTED 60$ CASES WITH INFORMATION ON AGE and vaccination status. s &EEDBACK OF DATA TO SUBNATIONAL LEVELS s 3UPERVISORY CHECKLISTS COMPLETED s $EVELOPMENT OF MONITORING INDICATORS s 3TAFF MONITOR STATUS AND STOCK OF SUPPLIES EQUIPMENT AND consumables when visiting subnational service-delivery areas. 4. Advocacy and communication s !VAILABILITY OF SOCIAL MOBILIZATION ADVOCACY OR OVERALL communication plan. s !VAILABILITY OF SPECIlC STRATEGY FOR HARD TO REACH POPULATION in immunization policy. s %XISTENCE OF CLINICIAN ADVOCACY AND COMMUNITY MOBILIZATION s %XISTENCE OF ACTIVE COMMUNITY HEALTH COMMITTEES s 0LANNING MEETINGS CONDUCTED WITH COMMUNITIES s #OMMUNITY MOBILIZERS INVOLVED IN IMMUNIZATION SESSIONS AND outreach. s %NGAGEMENT OF SECTORS OTHER THAN THE -INISTRY OF (EALTH EG Information, Education, Finance, Development, Planning). s #OMMITMENT OF BROAD RANGE OF HIGH LEVEL DECISION MAKERS (demonstrated by active support and public promotion). s "UDGET FOR ACTIVITIES STAFlNG AND MATERIALS s !VAILABILITY OF ADEQUATE AND APPROPRIATE INFORMATION EDUCATION and communication (IEC) materials. 5. Programme management s 'OVERNMENT FUNDING OF VACCINES FOR ROUTINE IMMUNIZATION AND programme-recurrent costs for supplies and operations. s Multiple-year commitment to financing (government and partner). s 0ROPORTION OF PLANNED SUPPORTIVE SUPERVISION VISITS CONDUCTED s !DEQUACY OF PERSONNEL TO CARRY OUT TASKS s !DEQUACY OF PERSONNEL TRAINING s %XISTENCE OF MICROPLANS FOR EACH DISTRICT s 2EPORTS ON IMPLEMENTATION OF THE PLANS s !SSESSMENT OF SERVICES CONDUCTED )* BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* 6ccZm(/GZVX]^c\:kZgn9^hig^Xi/ ^beaZbZciVi^dcVcYbdc^idg^c\iddah Reaching Every District (RED) is the name given to a strategy that aims to improve immunization coverage by means of the five steps listed below. A number of simple tools have been developed to help with implementation of the RED strategy, and these are shown on the following page. Re-establishing outreach services : In many countries a large proportion of the population can only have access to immunization services through outreach. For some communities, access can only be provided infrequently by mobile teams and may involve additional resources. Regular outreach should be incorporated in all session plans. Outreach sessions, especially mobile teams, also present opportunities to provide other interventions with immunization. Supportive supervision : Supportive supervision implies providing on-site training to health workers at the time of a supervisory visit, or at regular district meetings. To be supportive, supervisors should make regular visits, help to solve problems locally, and follow up regularly with supply and resource issues. Supervisors will themselves need training to adapt their own approaches to supervision. Linking services with communities : Strong links between the service and the community can be achieved by involving the community in the planning and delivery of services. Examples of activities include identifying outreach sites and convenient times, providing community volunteers with roles such as identifying newborns and defaulter tracking, and also holding regular meetings with the community. Monitoring and use of data for action : Monitoring and use of data for action implies not only the timely collection of data at various levels, but also the use of the data to solve problems. Some simple monitoring tools, including wall charts, are available to track monthly progress. In addition, other useful information on logistics, supply, and surveillance is usually collected regularly and should be analysed, together with coverage data, to improve the immunization system. Planning and management of resources : A district microplan is the key to RED strategy. The microplan should be based upon a local situation analysis which involves every health facility, and through them the communities they serve. At the national level there is a responsibility to ensure that the financial and human resources needed at district level are available and managed correctly, while the district must ensure that these resources are efficiently used. )+ BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* B 10/250 C 150/3750 A 400/10000 District Health Center HC 1. Area map 3. Work plan 6. Monitoring chart 5. Drop-outs tracking system February March A JanuaryImmunization reminder Box Year : 2001 Go for 100% coverage 4. Stock record BCG DTP OPV Mea TT SyringesSafetyboxes 2. Session plan Ejii]ZhZG:9iddah^cidVXi^dc ), BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* 6ccZm)/HVbeaZ[dgb[dggZXdgY^c\ i^bZa^cZhhVcYXdbeaZiZcZhh Sample form for recording timeliness and completeness of monthly reporting from the health facility to the district Legend T = arrived on time L = arrived late W = report not received N = reports expected Country District Year NB : Please note that timeliness and completeness are expressed as percentages (%). When the surveillance system is good, the rates for timeliness and completeness should approach 100%. This table allows for monitoring the progress of these two indicators in the district so that action can be taken to improve timeliness for each health facility in the district. Name of health facility Jan. Feb. Mar. Apr. May Jun. Jul. Aug. Sep. Oct. Nov. Dec. Total number of reports expected (N) Total reports sent on time (T) Total reports sent late (L) Total number of reports not received (W) Timeliness of the reports = 100 * T / N Completeness of reporting = 100 * (N-W) / N )- BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* 6ccZm*/=dlidegZeVgZVXdkZgV\Z$ Ygde"djibdc^idg^c\X]Vgi The following steps will help you prepare a chart for monitoring the number of doses administered and drop-outs in infants less than one year of age. 1) Calculate the annual target population to receive immunization services of infants less than one year of age. Each health facility should aim to reach every infant in its catchment area, especially those who are hard to reach. Where possible, use the most accurate existing population figures for infants under one year of age. These can be obtained from official census data or your own community census. If precise numbers are not available, estimate by multiplying the total population by four per cent. This document uses four per cent as the estimated percentage of infants less than one year of age and of pregnant women in any population. For example : If the total population is 3900, then the annual target population of infants under one year would be 3900 x 4/100 = 156. 2) Calculate the monthly target population of infants less than one year of age to receive immunization services. To calculate the number of children who should be vaccinated each month (i.e. the monthly target population), divide the annual target population by 12. For example : If the annual target under one year is 156, the monthly target is 156/12 = 13. That means each month 13 children should be vaccinated : 13 IN *ANUARY ANOTHER IN &EBRUARY ANOTHER IN -ARCH ETC 3) Label the chart. Always ensure that the chart has a title, usually written across the very top so that it does not obscure the chart. ). BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* For example : “DTP1 and DTP3 doses administered and drop-outs in infants less than one year of age – Lorne province – 2008“ Label the left side of the chart with the ‘cumulative’ monthly target, i.e. the increasing number of children that are targeted each month. For example )F THE MONTHLY TARGET IS THE CUMULATIVE TARGET FOR *ANUARY WILL be 13 ; for February it will be 26 (13 + 13) ; for March it will be 39 (13 + 13 + 13) ; for April it will be 52 (13 + 13 + 13+ 13), etc. 4) Label the boxes at the bottom with the name of the vaccine and dose that you are monitoring, e.g. DTP1 and measles, or DTP1 and DTP3. 13* 12 = 156 13* 11 = 143 13* 10 = 130 13* 9 = 117 13* 8 = 104 13* 7 = 91 13* 6 = 78 13* 5 = 65 13* 4 = 52 13* 3 = 39 13* 2 = 26 13* 1 = 13 13* 0 = 0 Fill in at the end of each month Jan. Cum Tot. Feb. Cum Tot. Mar. Cum Tot. Apr. Cum Tot. May Cum Tot. Jun. Cum Tot. Jul. Cum Tot. Aug. Cum Tot. Sep. Cum Tot. Oct. Cum Tot. Nov. Cum Tot. Dec. Cum Tot. Total immunized DTP1 10 10 12 22 7 29 12 41 14 55 15 70 14 84 7 91 Total immunized DTP3 8 8 9 17 8 25 10 35 11 46 12 58 12 70 7 76 Drop out number (DO) (DTP1-DTP3) 2 5 4 6 9 12 14 15 Drop out % (DO/DTP1)*100 20 23 14 15 16 17 17 16 DTP1 coverage DTP3 coverage 13* 12 = 156 13* 11 = 143 13* 10 = 130 13* 9 = 117 13* 8 = 104 13* 7 = 91 13* 6 = 78 13* 5 = 65 13* 4 = 52 13* 3 = 39 13* 2 = 26 13* 1 = 13 13* 0 = 0 Fill in at the end of each month Jan. Cum Tot. Feb. Cum Tot. Mar. Cum Tot. Apr. Cum Tot. May Cum Tot. Jun. Cum Tot. Jul. Cum Tot. Aug. Cum Tot. Sep. Cum Tot. Oct. Cum Tot. Nov. Cum Tot. Dec. Cum Tot. Total immunized DTP1 10 10 12 22 7 29 12 41 14 55 15 70 14 84 7 91 Total immunized DTP3 8 8 9 17 8 25 10 35 11 46 12 58 12 70 7 76 Drop out number (DO) (DTP1-DTP3) 2 5 4 6 9 12 14 15 Drop out % (DO/DTP1)*100 20 23 14 15 16 17 17 16 DTP1 coverage DTP3 coverage *% BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* 5) Draw a diagonal line from zero to the top right-hand corner to show the ideal coverage rate if every targeted infant is immunized on time. 6) Plot the immunization data on the chart. Locate the row of boxes underneath the graph. Locate the spaces for the month you are recording. Enter the monthly total of DTP1 doses given. a) Add the current month’s total doses to the previous cumulative total to calculate the current cumulative total, and enter it on the right side of the month column you are recording. b) Make a dot on the graph for the cumulative1 total recorded on the right side of the month column you are recording. c) Connect the new dot to the previous month’s dot with a straight line. d) Repeat above (a to c) every month until the end of the year. e) Plot DTP3 immunizations given in the same way as DTP1 (follow steps a to d). 7) Calculate the total number of drop-outs between DTP1 and DTP3 (DO#) by subtracting the cumulative total for DTP3 from the cumulative total for DTP1. 1 Cumulative means the total number of doses of vaccines given in the current month plus the monthly totals for all the previous months. Use the same time period for each dose and vaccine. For example, the cumulative number of DTP1 doses given by the end of March is the total number of DOSES GIVEN IN *ANUARY PLUS THE TOTAL NUMBER GIVEN IN &EBRUARY PLUS THE TOTAL NUMBER GIVEN IN -ARCH 13* 12 = 156 13* 11 = 143 13* 10 = 130 13* 9 = 117 13* 8 = 104 13* 7 = 91 13* 6 = 78 13* 5 = 65 13* 4 = 52 13* 3 = 39 13* 2 = 26 13* 1 = 13 13* 0 = 0 Fill in at the end of each month Jan. Cum Tot. Feb. Cum Tot. Mar. Cum Tot. Apr. Cum Tot. May Cum Tot. Jun. Cum Tot. Jul. Cum Tot. Aug. Cum Tot. Sep. Cum Tot. Oct. Cum Tot. Nov. Cum Tot. Dec. Cum Tot. Total immunized DTP1 10 10 12 22 7 29 12 41 14 55 15 70 14 84 7 91 Total immunized DTP3 8 8 9 17 8 25 10 35 11 46 12 58 12 70 7 76 Drop out number (DO) (DTP1-DTP3) 2 5 4 6 9 12 14 15 Drop out % (DO/DTP1)*100 20 23 14 15 16 17 17 16 DTP1 coverage DTP3 coverage *& BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* 8) Calculate the cumulative drop-out rate (DO%) as follows: The drop-out rate can be easily visually monitored : it is the gap between the line of DTP1 and of DTP3. DO% = DTP1 cumulative total minus DTP3 cumulative total x 100 DTP1 cumulative total 13* 12 = 156 13* 11 = 143 13* 10 = 130 13* 9 = 117 13* 8 = 104 13* 7 = 91 13* 6 = 78 13* 5 = 65 13* 4 = 52 13* 3 = 39 13* 2 = 26 13* 1 = 13 13* 0 = 0 Fill in at the end of each month Jan. Cum Tot. Feb. Cum Tot. Mar. Cum Tot. Apr. Cum Tot. May Cum Tot. Jun. Cum Tot. Jul. Cum Tot. Aug. Cum Tot. Sep. Cum Tot. Oct. Cum Tot. Nov. Cum Tot. Dec. Cum Tot. Total immunized DTP1 10 10 12 22 7 29 12 41 14 55 15 70 14 84 7 91 Total immunized DTP3 8 8 9 17 8 25 10 35 11 46 12 58 12 70 7 76 Drop out number (DO) (DTP1-DTP3) 2 5 4 6 9 12 14 15 Drop out % (DO/DTP1)*100 20 23 14 15 16 17 17 16 DTP1 coverage DTP3 coverage *' BdYjaZ*/Bdc^idg^c\i]Z^bbjc^oVi^dchnhiZb IgV^c^c\[dgb^Y"aZkZabVcV\Zgh BAB "L=D$>K7$%-#%* >b b jc ^o Vi ^d c b dc ^id g^ c\ X ]V gi [d g 9 IE & Vc Y 9 IE ( M x 1 2 = M x 1 1 = M x 1 0 = M x 9 = M x 8 = M x 7 = M x 6 = M x 5 = M x 4 = M x 3 = M x 2 = M x 1 = M x 0 = Fi ll in a t t he e nd o f e ac h m on th Target population Ar ea N am e : Ye ar : To ta l C at ch m en t p op ul at io n : To ta l p op ul at io n un de r o ne : M on th ly ta rg et (M ) : To ta l i m m un ize d DT P1 To ta l i m m un ize d DT P3 Dr op -o ut # (D TP 1- DT P3 ) Dr op -o ut % (# /D TP 1) x1 00 JA N FE B M AR AP R M AY JU N E JU LY AU G 0% SE PT OC T N OV DE C Cu m . To t. Cu m . To t. Cu m . To t. Cu m . To t. Cu m . To t. Cu m . To t. Cu m . To t. Cu m . To t. Cu m . To t. Cu m . To t. Cu m . To t. Cu m . To t. 25 % 50 % 75 % 10 0% The World Health Organization has provided technical support to its Member States in the field of vaccine-preventable diseases since 1975. The office carrying out this function at WHO headquarters is the Department of Immunization, Vaccines and Biologicals (IVB). IVB's mission is the achievement of a world in which all people at risk are protected against vaccine-preventable diseases. The Department covers a range of activities including research and development, standard-setting, vaccine regulation and quality, vaccine supply and immunization financing, and immunization system strengthening. These activities are carried out by three technical units: the Initiative for Vaccine Research; the Quality, Safety and Standards team; and the Expanded Programme on Immunization. The Initiative for Vaccine Research guides, facilitates and provides a vision for worldwide vaccine and immunization technology research and development efforts. It focuses on current and emerging diseases of global public health importance, including pandemic influenza. Its main activities cover: i) research and development of key candidate vaccines; ii) implementation research to promote evidence-based decision-making on the early introduction of new vaccines; and iii) promotion of the development, evaluation and future availability of HIV, tuberculosis and malaria vaccines. The Quality, Safety and Standards team focuses on supporting the use of vaccines, other biological products and immunization-related equipment that meet current international norms and standards of quality and safety. Activities cover: i) setting norms and standards and establishing reference preparation materials; ii) ensuring the use of quality vaccines and immunization equipment through prequalification activities and strengthening national regulatory authorities; and iii) monitoring, assessing and responding to immunization safety issues of global concern. The Expanded Programme on Immunization focuses on maximizing access to high quality immunization services, accelerating disease control and linking to other health interventions that can be delivered during including expansion of immunization services beyond the infant age group; ii) accelerated control of measles and maternal and neonatal tetanus; iii) introduction of new and underutilized vaccines; iv) vaccine supply and immunization financing; and v) disease surveillance and immunization coverage monitoring for tracking global progress. The Director's Office directs the work of these units through oversight of immunization programme policy, planning, coordination and management. It also mobilizes resources and carries out communication, advocacy and media-related work. immunization contacts. Activities cover: i) immunization systems strengthening, World Health Organization 20, Avenue Appia CH-1211 Geneva 27 Switzerland E-mail: vaccines@who.int Web site: http://www.who.int/immunization/en/
Всемирная организация здравоохранения (ВОЗ / WHO) · Publications
Training for mid-level managers (MLM): module 5: monitoring the immunization system
Открыть оригинал документа
Полный текст размещён на сайте публикующей организации. lawenc.com индексирует метаданные и ведёт на официальный источник.
Полный текст