Organisation mondiale de la santé (OMS) · Publications

Health facility survey on quality of outpatient child health services: IMCI Health facility survey. Sudan, March-April 2003 [report]

Organisation mondiale de la santé
Voir le document original

Le texte intégral est hébergé par l’organisation qui le publie. lawenc.com indexe les métadonnées et renvoie vers la source officielle.

Texte intégral

WHO-EM/CAH/013/E/G Distribution: General

Health Facility Survey on Quality of Outpatient Child Health Services

IMCI Health facility Survey Sudan March–April 2003

Federal Ministry of Health Sudan

WHO-EM/CAH/013/E/G Distribution: General

Health Facility Survey on Quality of Outpatient Child Health Services

IMCI Health Facility Survey Sudan March–April 2003

Federal Ministry of Health Sudan

© World Health Organization 2004 This document is not a formal publication of the World Health Organization (WHO), and all rights are reserved by the Organization. The document may, however, be freely reviewed, abstracted, reproduced or translated, in part or in whole, but not for sale or for use in conjunction with commercial purposes. The views expressed in documents by named authors are solely the responsibility of those authors. Document WHO-EM/CAH/013/E/G/02.04/500

CONTENTS Acknowledgements .......................................................................................................V Executive summary........................................................................................................1 1. Objectives .................................................................................................................. 6 2. Background ............................................................................................................... 6 2.1 Setting ...................................................................................................................................6 2.2 Child health indicators........................................................................................................7 2.3 The response: an integrated child care strategy (IMCI).................................................8 3. Survey methodology .................................................................................................. 9 3.1 Planning ..............................................................................................................................10 3.2 Geographic scope of the survey and selection of health facilities to survey ............10 3.3 Target age group and timing of the survey....................................................................11 3.4 Survey instruments, teams and procedures for data collection ..................................12 3.4.1 Forms ....................................................................................................................12 3.4.2 Survey teams.........................................................................................................12 3.4.3 Surveyor training..................................................................................................13 3.4.4 Data collection .....................................................................................................13 3.5 Data entry, cleaning and analysis ....................................................................................14 3.6 Differences between IMCI follow-up visits and this survey ......................................14 4. Feedback meetings................................................................................................... 15 4.1 Debriefing with the Federal Minister of Health and Undersecretary of Health......15 4.2 National feedback meeting ..............................................................................................16 5. Findings.................................................................................................................... 16 5.1 Sample characteristics.......................................................................................................16 5.1.1 Characteristics of cases observed and of their caretakers..............................16 5.1.2 Patterns of illness.................................................................................................18 5.1.3 Relationship of caretakers’ report of fast or difficult breathing with pneumonia and care-seeking..............................................................................19 5.2 Quality of clinical care ......................................................................................................20 5.2.1 Assessment ...........................................................................................................20 5.2.2 Classification ........................................................................................................24 5.2.3 Treatment and advice..........................................................................................26 5.2.3.1 Management of severe cases ................................................................26 5.2.3.2 Use of injectable drugs..........................................................................26 5.2.3.3 Rational use of oral antibiotics.............................................................27 5.2.3.4 Rational use of oral antimalarials.........................................................28 5.2.3.5 Oral rehydration salts (ORS)................................................................29 5.2.3.6 Other treatment and opportunities for immunization .....................30 5.2.3.7 Advice on follow-up..............................................................................31 5.2.3.8 Provider advice and caretaker knowledge about home care............32 5.2.3.9 Provider communication skills.............................................................33 5.2.3.10 Age-appropriate advice on feeding ....................................................33 5.2.3.11 Use of mosquito bednets and chloroquine at home .......................33 5.2.3.12 Advice on mother’s health ..................................................................34 5.3 Health systems...................................................................................................................34 5.3.1 Caretaker satisfaction ..........................................................................................34 5.3.2 Organization of work..........................................................................................34 5.3.3 IMCI training .......................................................................................................35 5.3.3.1 IMCI training coverage .........................................................................35 5.3.3.2 Quality of child care by provider training status ...............................35 5.3.4 Availability and reliability of malaria laboratory..............................................36

5.3.5 Availability of drugs ............................................................................................37 5.3.6 Availability of supplies and equipment for vaccination .................................38 5.3.7 Availability of other basic supplies and equipment for IMCI.......................38 5.3.8 Availability of transportation for referred cases..............................................39 5.3.9 Health expenditure ..............................................................................................39 5.3.10 Availability of child health services...................................................................40 5.3.11 Supervision ...........................................................................................................40 5.3.12 Records .................................................................................................................40 5.4 Context to interpret findings: the pre-intervention survey .........................................41 5.5 Limitations of this survey.................................................................................................42 6. Conclusions and recommendations .........................................................................43 6.1 Access to drugs and services: providing equitable access to care to the most vulnerable group................................................................................................................43 6.2 Training...............................................................................................................................44 6.2.1 Skills reinforcement: strengthening follow-up visits after training ..............44 6.2.2 Improving basic skills of health providers.......................................................44 6.3 Strengthening malaria laboratory diagnostic capacity ..................................................45 6.4 Organization of work: building capacity and re-distributing selected tasks at health facilities ...............................................................................................................................45 6.5 Improving supervision and reporting ............................................................................45 6.6 Improving care-seeking practices ...................................................................................46 Annexes Annex 1: Areas to be emphasized in future IMCI clinical training and follow-up visits 49 Annex 2: Main steps of the IMCI process in Sudan........................................................53 Annex 3: IMCI training and implementation ..................................................................54 Annex 4: Schedule of survey activities ...........................................................................56 Annex 5: Schedule of planning .......................................................................................57 Annex 6: Survey planning team ......................................................................................58 Annex 7: Survey selection criteria ..................................................................................59 Annex 8: Sampling of districts ........................................................................................60 Annex 9: List of health facilities surveyed......................................................................62 Annex 10: Consideration about timing of the survey........................................................64 Annex 11: Main survey form adaptations .........................................................................65 Annex 12: List of supervisors and surveyors ....................................................................66 Annex 13: Surveyor training schedule ..............................................................................67 Annex 14: Training evaluation form .................................................................................69 Annex 15: Survey teams itinerary .....................................................................................70 Annex 16: Survey procedures for data collection at health facility ..................................72 Annex 17: List of participants in the national feedback meeting......................................73 Annex 18: Minimum survey requirement for drug availability ........................................76 Annex 19: Findings related to the WHO generic list of IMCI priority indicators (P) and supplemental measures (S) at health facility level ..........................................77 Annex 20: Findings: Tables and graphs ............................................................................85 Appendix: Survey forms… ........................................................................................... 149

iv

ACKNOWLEDGEMENTS

This survey was a collaborative effort of the Federal Ministry of Health, Sudan, academic institutions and the World Health Organization, Regional Office for the Eastern Mediterranean and country office. UNICEF staff from the country office also participated in selected activities. The cooperation of State authorities and staff of the health facilities surveyed is much appreciated. The dedication of all survey teams and data entry and analysis staff is acknowledged. Special gratitude goes to all caretakers who accepted to have their children enrolled and kindly cooperated in the survey.

v

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

EXECUTIVE SUMMARY Background Integrated management of childhood illness (IMCI) was introduced in Sudan in 1996 as a strategy to address the most important causes of under-five mortality and morbidity using an integrated approach in line with the primary health care policy. It has since expanded to cover about 500 health facilities in 71 (30%) out of 240 districts located in 10 States. This survey was planned to measure outcome indicators on quality of care at IMCI health facilities. Methods The management was observed of 364 sick children aged 2 months up to 5 years old seen at 66 health facilities (‘clusters’), randomly selected from 136 ‘IMCI facilities’ (dressing stations, dispensaries, health centres and outpatient departments of hospitals) reporting a daily caseload of at least two children under 5 years and located in rural and urban areas of 7 states. 350 interviews with child caretakers were also conducted, and facilities, services and supplies were assessed in the 66 facilities visited. Results More than half (54%) of children were under 2 years old: 10 of the 14 severe cases fell in this vulnerable age group. The proportion of female children was slightly lower than male children (47% vs 53%). The majority of caretakers (83%) were mothers of the sick children; 42% of caretakers had no education, the proportion reaching 65% at dispensary level, and this having implications for health communication activities. More than three-quarters of children were managed by medical assistants; 77% were managed by IMCI-trained providers (100% at dispensaries), 74% by providers who had received IMCI follow-up visits, but only 22% by providers who had been followed up within 2 months of training. The average visit length was 20 minutes for children examined by IMCI-trained providers vs 8 minutes by untrained ones. Patterns of illness: About 4% of children had a severe condition requiring urgent referral, mostly severe pneumonia. 63% of children had an acute respiratory infection; 57% were febrile or had a history of fever, but only one child had a validated laboratory diagnosis of malaria; 30% had diarrhoea, 8% an ear problem, 17% anaemia based on clinical pallor, and 6% were very low weight-for-age. Noteworthy is that 11% of children had an eye infection. The proportion of children having a severe condition, or requiring drug treatment or specific nutrition advice was very high (73%) at dispensary level, confirming the importance of this level of the health system in delivering child care. Caretaker report of a breathing problem had a low sensitivity for any severity of pneumonia (19%). Among the local terms used, deeg nafass and eltihab had slightly better sensitivity, specificity and positive predictive value. Only 32% of caretakers who had spontaneously reported a breathing problem in their child had taken the child to this facility within a day of their recognizing the breathing problem. Case management by provider’s IMCI training status: Key case management and advising tasks were much more likely to be performed—and performed correctly—in children managed by providers trained in IMCI than by those untrained, with the difference reaching high statistical significance in many cases (§ 5.3.3.2). Performance by providers not trained in IMCI was often rather poor, raising the issue about pre-service training and in-service supervision: for example, 74% of children were prescribed antibiotics unnecessarily, none of the caretakers of diarrhoea cases given ORS was advised on its preparation and administration, and often no advice on home care was given by providers not trained in IMCI. The findings described below refer to the whole sample, thus including children seen by both trained and untrained providers. 1

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

Assessment: Problems in taking the history accurately led to misclassification of some of the cases. An average of 5.9 tasks were performed in a child out of the 10 main assessment tasks to be performed. 24% of children below 2 years old and of those with very low weight-forage and/or anaemia was assessed for feeding practices. Most children (82%) were weighed, and the weight was taken correctly and checked against the growth chart in about half of the cases. The temperature was taken in 47% of children, but taken correctly only in 14%; the vaccination status was checked in 60% of cases. Signs assessed (correctly) less frequently included assessment of palmar pallor (45% of cases) to detect clinical anaemia, and oedema of both feet (32%) and visible severe wasting (24%) to detect clinical severe malnutrition. The child road-to-health card was checked only in 9% of children, indicating that it was not a standard procedure for sick children. The respiratory rate was taken in three-quarters (76%) of the children with cough or breathing problems but the count was considered reliable in 41% of them. Duration of the diarrhoea episode to distinguish acute from persistent diarrhoea was asked about in 76% of cases and presence of blood to identify dysentery was asked about in 57% of cases. Unfortunately, this information was often not used by providers to classify the child’s condition. Among the tasks to assess the hydration status, while 69% of children with diarrhoea had their skin pinched to check skin turgor and 50% were offered something to drink to check thirst, the skin was pinched correctly only in a third of them. A history of measles was checked in 42% of children with fever or history of fever. Caretakers of about half (48%) of the children were asked about the presence of any other problems than those listed in the IMCI algorithm, to complete the assessment of the child. Classification: There was agreement between provider and surveyor classification in about a third (32%) of all children having conditions requiring urgent referral, treatment, or specific nutrition advice. 95% of the conditions incorrectly classified by the provider were underclassified as milder cases. Reasons for case mis- and under-classification included inaccurate history, incomplete or incorrect assessment, not taking assessment findings into account, or giving no classification at all. The very low rate of agreement (21%) in cases with clinically detected anaemia was mostly due to provider’s omitting to check for palmar pallor. Malaria laboratory diagnostic reliability in the field was very low, with a sensitivity of 0%, a specificity of 74%, a positive predictive value of 0%, and an accuracy of 73%. Treatment and advice: Six of the 14 severe cases requiring urgent referral or admission to hospital were correctly identified and a referral note was prepared in half of referred cases. However, no case received pre-referral treatment and thus no case was eventually managed correctly. Overall use of injectable drugs was contained, with benzylpenicillin unnecessarily prescribed in 5% of non-severe cases. Most children were unlikely to receive proper antibiotic and/or antimalarial treatment: while of the cases needing these drugs 72% were prescribed an antibiotic and 74% were prescribed a recommended antimalarial, less than a third was eventually correctly prescribed the antibiotics (32%) and antimalarials (27%). The weak area in providers’ instructions was the dose, followed by the duration of treatment. Furthermore, only one caretaker in five was asked questions to check for her understanding of the instructions received for antibiotics (19%) and antimalarials (20%), and only 15% and 4% of children needing these drugs were given the first dose of the drug at the facility, respectively. As a result, about one in five of the caretakers prescribed drugs was able to describe correctly how to administer the antibiotic (22%) and antimalarial (20%). 6% of children with fever or history of fever were reported receiving chloroquine before being taken to this health facility. A substantial overuse of antibiotics was noticed, with 37% of children not needing antibiotics prescribed the drugs unnecessarily, mostly because of misclassification of their conditions. In this scenario, only a small proportion of children with infections or malaria would be likely to be managed properly at home. Only 2 of the 9 cases with diarrhoea and dehydration were treated at the facility, while about half (49%) of those with no dehydration were given ORS to take home. When given ORS, less than a third (31%) of caretakers was correctly advised and 2

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 one in four (24%) was able to describe correctly how to administer ORS at home, not knowing especially when and how much ORS to give to the child. Pre-existing, correct knowledge among caretakers about ORS preparation was noticed, despite the lack of correct instructions by the provider. As noted for drugs, the chances of a child with diarrhoea receiving ORS correctly at home would be rather low. Concerning other main treatments, one child in four (24%) with anaemia was prescribed iron, 24% of children with an eye infection was given tetracycline ointment, 17% of children needing vitamin A and 49% of children needing vaccination were given them or advised to come back on another day to receive them. Cough medicines and antidiarrhoeals were used rarely, while metronidazole for children with diarrhoea seemed to enjoy some popularity. Advice on definite follow-up would have been required in as many as 62% of all children seen based on the guidelines, raising some issues about the feasibility of such a recommendation. The caretakers of only one child in ten (12%) were advised on home care (feeding, fluids and when to seek care): only 2% of them were clear before leaving the facility about all the three key home care rules, showing substantial lack of knowledge especially about the danger signs that should prompt them to seek immediate care. Encouraging was the finding that 79% of caretakers mentioned they would continue feeding their child during illness. Feeding advice, however, was largely inadequate: only 24% of target children received age-appropriate advice on feeding, including breastfeeding, and 20% of children 6 to 11 months old were given proper advice on the frequency of complementary feeding. Effective communication techniques were used rarely by providers: the IMCI home care card was used in 34% of cases as a counselling tool, utilising effective communication techniques in only 5% of cases. About half (52%) of caretakers reported having a mosquito bednet at home (21% having a bednet impregnated with insecticide), and 20% of children were reported as having slept under a bednet (10% under a treated bednet) the night before. Only two mother caretakers received some advice on their health. Health systems: The large majority of caretakers (88%) said they were satisfied with the health services provided, valuing the treatment given, and provider’s examination of the child. Except for taking the child weight (which was done by the nutrition educator in 40% of cases) and some involvement in assessing and advising on feeding and ORS (especially by IMCItrained nurses at dispensaries), all the other tasks tended to be carried out by the same person examining the child. Almost two-thirds (62%) of non-hospital primary care facilities had at least 60% of providers trained in IMCI (82% in Gezira vs 33% in Khartoum), with 100% training coverage at dispensary level. An average of 5 out of the 6 essential oral drugs was found available at the time of the visit for at least one treatment course for pneumonia, dysentery, diarrhoea, fever and anaemia, 8.6 out of 12 key non-injectable drugs for IMCI conditions, and at least one dose of 2.6 out of the 4 parenteral drugs recommended for prereferral treatment. Salbutamol was available in one in ten (12%) facilities. 62% of facilities had essential supply and equipment for malaria microscopy laboratory. The reliability of the diagnosis of these laboratories was however very low (see above). Most (80%) of the facilities reported providing immunisation services, with 36% of them having cold chain equipment and supplies for vaccination at the time of the visit and 70% reporting providing all antigens within weekly sessions. About a third (32%) of facilities had basic supplies and materials for IMCI. Transportation for referred cases was reported to be accessible to 85% of the population living in the health facility catchment areas, with usually an average time of 15 minutes to reach the referral facility, given the fact that 69% of the cases seen lived at walking distance from the facility. Yet, referral-related problems (including among others family inability to afford referral and hospitalization-related costs) were reported by 32% of facilities. For those who needed transportation, the average cost was SDD 106 (with average costs twice as much in rural as in urban areas), with a maximum of SDD 800. For those who needed to pay for care at the facility (laboratory and consultation fees, drug costs), the average cost was SDD 503, with a maximum of SDD 1750. Drug expenses represented 73% of the total health-related expenses at the facility. These estimates are conservative, considering also 3

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 that 16% of children seen in the survey were covered by health insurance and thus charged only 25% of the drug cost. About a quarter (26%) of facilities had a supervisory book, and records of visits’ findings and recommendations were found in 15% of cases. Case management practices were observed in 21% of the most recent supervisory visits. Facility outpatient records were often unreliable or incomplete and did not enable the collection of useful information. Record review suggested under-reporting of under-five visits in facilities implementing the insurance system. Conclusions The survey enabled the collection of health facility data on child health service indicators, useful to monitor progress towards the achievement of the Millennium Development Goals. The results on case management clearly show a better performance for tasks carried out by providers trained in IMCI than those untrained, evidence that IMCI training can improve quality of care. The overall level of performance however remains sub-optimal. These findings also underline the challenges of institutionalizing changes in quality of care, so that standards remain at the same level when trained providers leave. The poor performance of many tasks for cases seen by providers not trained in IMCI raises the issue about the quality of pre-service training and in-service supervision. Weak health system elements add to the challenges. Aspects of the current national IMCI guidelines needing review include possible inclusion of eye infections, given their high prevalence and weak management, feeding recommendations and indications for follow-up. The recommendations should serve as the basis to develop a strategic plan for IMCI implementation. Case management areas needing improvement are described in detail in Annex 1. Recommendations To provide equitable access to care to the most vulnerable group: 1. Consideration should be given to protecting children below 2 years old, especially in poor families, by issuing a policy and establishing mechanisms (e.g. funds) to provide affordable (free or at reduced cost) drugs to them; 2. When planning to train staff from health facilities in IMCI, States should commit to making key drugs regularly available through effective schemes to the health facilities where those staff work, to make the most of the substantial financial investment placed in IMCI training; 3. States should promote the implementation of the ‘open vial’ policy to increase immunization coverage and reduce vaccine wastage. To reinforce skills, by strengthening follow-up visits after IMCI training: 4. The Federal level and States concerned should jointly plan to develop and commit adequate human resources to follow up visits after IMCI training, and to conduct them on timely basis and according to the standard methodology. To improve health providers’ basic skills: 5. Consideration should be given to strengthening the curriculum of pre-service training of medical assistants and introducing the IMCI outpatient care approach as a way to develop basic skills. To strengthen malaria laboratory diagnostic capacity: 6. Close supervision by Federal and State levels with quality control of malaria microscopic diagnosis should be carried out regularly to improve the quality of malaria laboratory diagnosis. To build capacity and re-distribute selected tasks at health facilities: 7. States should consider setting and promoting the policy that all child caretakers take the road-to-health card to the facility not only for immunization but also for sick child visits. 8. Federal and State in-service training curriculum for vaccinators and nutrition educators should be revised to include taking temperature and weight, checking immunization status

4

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 by the health card, counselling on feeding and similar basic skills, as part of their routine responsibilities. To improve supervision and reporting: 9. A training package on supervision of child health services should be developed; supervisors responsible for routine supervision should be trained and involved in IMCI follow-up visits and trained in child health supervisory skills on a trial basis once the materials are developed. To improve care-seeking practices: 10. High priority should be given to targeting the community through health communication activities to improve family knowledge about the early signs that should prompt careseeking for sick children (e.g. breathing problem in a child with cough).

5

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 1. OBJECTIVES The Federal Ministry of Health (FMOH) of the Republic of the Sudan, in collaboration with the Eastern Mediterranean Regional Office (EMRO) of the World Health Organization (WHO) conducted a survey from 12 March to 22 April 2003 on the quality of outpatient child health services at facilities in which the Integrated Management of Childhood Illness (IMCI) strategy had been implemented. The writer collaborated in all phases of the survey, from planning to surveyor training, observation of data collection and analysis of the results. More specifically, the ‘IMCI health facility survey’ had the following objectives: (1) (2) (3) (4) To assess the quality of outpatient care, including both clinical and counselling care, provided to sick children aged 2 months up to 5 years old1 at health facilities implementing the IMCI strategy; To describe organizational and other ‘health systems support’ elements influencing the quality of care and identify major constraints to it; To measure key indicators of quality care to monitor progress of the IMCI strategy at health facilities; and To recommend further approaches to improving the quality of outpatient child health services. 2. BACKGROUND This section summarizes information that was reviewed to discuss survey objectives, adapt the survey questionnaires, and develop country-specific survey rules. It served also as part of the background for the interpretation of the results of the survey. 2.1 SETTING

The population of Sudan, comprising some 19 major ethnic groups, was estimated at over 31 million in 2001, with 63% living in rural areas2. The majority of the population is concentrated in six States of the Central Region and 60% live around the River Nile. The population is unevenly distributed: the population density in Khartoum and Gezira is five times as high as in the rest of the country3. Children below 5 years of age are estimated to be 16.4% of the total population. Delivery of care has been based on the primary health care (PHC) approach, with over 6000 PHC facilities delivering outpatient services usually through a three-tier system: a) the PHC unit, usually staffed by a community health worker, providing essential PHC services and serving a population of 1000–3000 people; b) the dressing station, commonly staffed by a nurse, providing curative care for common diseases and having the same catchment area as the PHC unit; and c) the dispensary, for the management of more serious cases, and the health centre. The latter may be equipped with laboratory, X-ray and patient lay-in observation facilities. Dispensaries serve a population of 5000–10 000 and health centres 10 000–15 000 people4. While dispensaries are staffed with medical assistants, The expression ‘up to 5 years old’ in this report refers to children less than 5 years old, therefore excluding the day of their 5th birthday. This expression, although not fully correct, is used here as it appears to be more easily understood by readers without epidemiological background. 2 World Bank, World Development Indicators Database, April 2002. 3 Safe Motherhood Survey, 1999. 4 World Health Organization, Regional Office for the Eastern Mediterranean: Country Programme Statements – Sudan: Country situation and national health development objectives, WHO Programme Budget 2000-2001 1

6

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 health centres in urban areas are usually staffed also with doctors, in addition to other staff. Rural hospitals represent the first referral level. Accessibility to services varies considerably between areas and States. The health system in Sudan is decentralized and consists of 26 State Ministries of Health. WHO estimates of national health accounts suggest that the percentage of the gross domestic product (GDP) for expenditure on health has been increasing over the past 5 years up to an estimated 4.7% in 20005 (about US$ 48 PPP per head6): almost 80% of the total health expenditure is private and the percentage coming from the government has been decreasing over time5. 2.2 CHILD HEALTH INDICATORS

Infant (IMR) and under-five (U5MR) mortality rates have remained at high levels in Sudan over the past 15 years. The IMR and U5MR were reported at levels of 68 and 105 deaths per 1000 live births, respectively, for the 5-year period preceding 1999 according to the ‘Safe Motherhood Survey’ conducted in Northern Sudan in 1999 (Fig. 1)7. Out of all childhood8 deaths, two-thirds (65%) occurred in the first year of life and 29% occurred in the neonatal period. 120 110 100 90 Deaths per 1000 live births 80

105

101

105

67 70 60 50 40

65

68 NMR IMR U5MR

30 30 20 10 0 1985–1989

31

30

1990–1994 Five-year reference periods

1995–1999 Source: Safe Motherhood Survey, 1999

Figure 1. Neonatal, infant and under-five mortality in Sudan7

5

World Health Organization, The World Health Report 2002, Statistical Annex, National Health Accounts, Geneva, WHO, 2002. 6 At purchasing power parity (PPP) exchange rates, estimate for 1990–98, World Bank 2002. This is almost half of the average of US$89 health expenditure per capita estimated by the World Bank for sub-Saharan Africa. 7 Estimates based on other data sources suggest a reduction in under-5 mortality by 12% from 1990 to 2000. 8 Childhood in this report refers to children below 5 years old.

7

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 Interestingly, no major differences were found in the IMR between urban and rural areas (67 vs 68). However, remarkable differentials in IMR and U5MR were observed by mother’s education level: IMR was almost twice as high and U5MR two and a half times as high in children of illiterate mothers as in children whose mothers had completed junior secondary or higher education. Both IMR and U5MR were higher in boys than girls (73 and 108 in boys vs 62 and 99 in girls, respectively). Notable differences were found between States, with IMR about 50% higher in Red Sea (116), Kassala (101), Blue Nile (101) and Southern Kordofan (95) than the country average. This is important when prioritizing public health interventions designed to have impact on child mortality. Diarrhoeal diseases (30%), acute respiratory infections (20%), malaria (16%), malnutrition (10%) and childhood preventable diseases, especially measles, were estimated to account together for more than three-quarters of the outpatient consultations for children under 5 years at health facilities in 19979. The same conditions represented also 86% of hospital admissions in children under 5 years and were responsible for more than threequarters of hospital deaths in under-5s in 1997. Seven per cent (7%) of children under 5 years were found to be severely wasted (<–3 SD for weight-for-height) at household level in 200010. 2.3 THE RESPONSE: AN INTEGRATED CHILD CARE STRATEGY (IMCI)

The strategy on Integrated Management of Childhood Illness (IMCI) was formally introduced in Sudan in 1996 as a strategy appropriate for the situation in the country, as it addressed the most important causes of under-5 mortality and morbidity and represented an integrated approach that well suited the primary health care policy promoted in the country11. The main steps of the IMCI process in Sudan from introduction through the early implementation phase are shown in Annex 2. An IMCI Task Force was set up in 1996 to prepare the introduction of IMCI in the country, followed by the establishment of an IMCI Working Group to coordinate activities. A high level IMCI Steering Committee was also formally established by ministerial decree (3/1997) in 1997, chaired by the State Minister of Social Planning, to set policies, revise and endorse the plan of action, monitor and supervise activities, and mobilize resources for IMCI. Since about 2000, the strategy has been expanding to cover about 500 health facilities in 71 (30%) out of 240 districts located in 10 States (Annex 3). Furthermore, four new States have introduced the strategy. Taking into consideration the marked differentials in IMR between States, the strategy has been expanding also to the States with the highest IMR (Red Sea and, more recently, also Kassala and Southern Kordofan). The main target for training has been the category of medical assistants, but doctors, nurses and other supportive staff such as nutritionists have also been trained in selected health facilities. Among the main adaptations to the generic WHO/UNICEF clinical guidelines, which were further revised in Sudan in 2001, are: the inclusion of wheezing, the requirement of laboratory confirmation for the diagnosis of malaria in facilities where laboratory services are available in low malaria risk areas, the separation of the management of anaemia and malnutrition, and the extension of the recommendation for exclusive breastfeeding to the first 6 months of life. The main focus of the strategy has initially been on the health system.

9 Federal Ministry of Health, Primary Health Care: Report on the Integrated Management of Childhood Illness Early Implementation in Sudan, November 1999. 10 Federal Ministry of Health, Central Bureau of Statistics and UNICEF: Multiple Indicator Cluster Survey, Sudan, 2000 11 See footnote (9)

8

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 ™ Improving health providers’ skills: A total of 83 clinical training courses on IMCI has been conducted for almost 1400 people from PHC facilities and hospital outpatient departments, including over 200 facilitators, as of August 2002 (Annex 3). Nine training centres have been set up to decentralize IMCI training at State level. A large number of trained staff has been followed up after the training course (‘IMCI follow-up visits’). PHC staff report that one important issue has been the high attrition rate of trained staff, which has made the training efforts more demanding. Finally, a well-coordinated initiative has been initiated to introduce the IMCI outpatient approach in the teaching of seven medical schools, four of which were selected for the pilot phase, to address the issue of long-term sustainability. ™ Improving the health system: The essential drug list (EDL) has been reviewed: basically, all drugs needed for IMCI are included in the national list. However, injectable antibiotics and antimalarials (quinine), oral 2nd line antimalarial (sulfadoxine-pyrimethamine), diazepam, oral tetracycline, 2nd line antibiotic for dysentery (nalidixic acid) and salbutamol inhaler are not included in the EDL for outpatient facilities. Supplies (e.g. thermometers, weighing scales, nebulizers) have been provided to facilities implementing IMCI. IMCI recording form and supervisory checklist have been designed and are either being tested or distributed. ™ Improving family and community practices: A multidisciplinary group was created within the IMCI Task Force in 2000 to review the level of key family practices in the community and existing community-based interventions related to child care, and to develop a comprehensive communication strategy. This followed the recommendation of a review of the IMCI early implementation phase that activities in this area should be stepped up. A plan of action was drafted at the intercountry workshop on the IMCI community component in Cairo in July 2002. The plan for Sudan focuses on conducting baseline and needs assessment surveys in selected communities, fostering partnership with medical schools, and strengthening the linkages between the health system and the community through community health workers and health facility support staff. Linkages have already been established with other initiatives, such as the basic development needs initiative (BDN). 3. SURVEY METHODOLOGY The survey consisted of the following main phases (Annex 4): planning (1 week), conducted about 4 months earlier; training of surveyors and supervisors (1 week); data collection and data entry (2 weeks), data cleaning (3 days), data analysis (1 week), and presentation and discussion of the findings and recommendations. Box 1 summarizes the main features of this survey. This section highlights the main methodological aspects of the survey12.

For detailed survey plans, methodology and rationale, see Pieche S. Planning for an IMCI health facility in Sudan, Report of a mission, 25–31 October 2002, Cairo, WHO Regional Office for the Eastern Mediterranean, 2002.

12

9

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

3.1

PLANNING

Box 1. Survey at a glance Objective To assess the quality of outpatient child health services at ‘IMCI health facilities’, whether delivered by IMCI-trained or untrained providers When March-April 2003 Where In 7 States implementing IMCI Survey type Cluster survey Facilities Outpatient departments of district hospitals, health centres, dispensaries and dressing stations with a minimum caseload of 2 children below 5 years old per day Sample 364 children 2 months up to 5 years old enrolled in 66 IMCI health facilities Sampling frame All districts and facilities implementing IMCI in 8 States Sampling Multi-stage sampling: first selection of 29 districts by PPS method, then 66 facilities by systematic random sampling No. of surveyors 6 teams, each team consisting of two surveyors and one supervisor No. of facilities per team 1 facility per day, for an average of 11 facilities per team National feedback Khartoum, 22 April 2003

Plans for the survey were developed from 26 to 31 October 2002 (Annex 5) by a planning team consisting of FMOH, academic institutions and WHO staff. The team included: the national IMCI coordinator and other members of the IMCI team and PHC department at central level; faculties of community medicine departments of three medical schools; and a two-member WHO team from the country and regional levels (Annex 6). UNICEF staff from the country office also attended some of the sessions. The planning team carried out the following tasks: discussed the survey objectives; reviewed the survey methodology; selected districts where the ‘IMCI health facilities’ were located and planned for the selection of health facilities to survey; discussed plans for surveyor training, data entry, data analysis and the national feedback meeting. 3.2

GEOGRAPHIC SCOPE OF THE SURVEY AND SELECTION OF HEALTH FACILITIES TO SURVEY

This survey was a cluster survey, with children taken to a health facility on the day of the survey forming a cluster. The survey was conducted in 66 health facilities (66 clusters) implementing the IMCI strategy (IMCI health facilities), including dressing stations, dispensaries, health centres and outpatient departments of hospitals; thus, it covered mostly medical assistants, the primary target group of IMCI training in Sudan. The criteria used to decide which geographical areas and facilities to cover in the survey are described in Annex 7. Southern States were excluded from this survey, as the classical IMCI strategy had not yet been implemented there13. Sampling was carried out in two stages. First, 29 districts were selected from the list of the 60 districts in 8 States in which the IMCI facilities were located, using the probability proportionate to size (PPS) method, which gives higher chances of selection to areas having a larger population (Annex 8). This was done for logistical reasons, in order to concentrate the survey geographically in fewer districts, and to avoid spreading the sample over the very large area of Sudan, where health facilities might be 13

Box 2. States included in the survey 1. 2. 3. 4. 5. 6. 7. Khartoum Gezira River Nile Al Gadarif Red Sea White Nile Sennar

This survey therefore did not evaluate the essential community child health care approach in the South.

10

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 Table 1. Final distribution of health facilities by geographical location and type: sampling frame and survey sample (facilities with an estimated minimum daily caseload of two children below 5 years old) Location Distribution Type of facility Rural Urban Total Sampling frame Survey sample Sampling frame Survey sample Sampling frame Survey sample 53/136 (39%) 25/66 (38%) 83/136 (61%) 41/66 (62%) 136/136 (100%) 66/66 (100%) No. 53 25 83 41 136 66 Hospital 6 (11.3%) 3 (12.0%) 4 (4.8%) 2 (4.9%) 10 (7.4 %) 5 (7.6%) HC 22 (41.5%) 10 (40.0%) 67 (80.7%) 33 (80.5%) 89 (65.4%) 43 (65.2%) D/DS 25 (47.2%) 12 (48.0%) 12 (14.5%) 6 (14.6%) 37 (27.2%) 18 (27.2%)

HC: Health Centres D/DS: Dispensaries and dressing stations

rather distant from each other in some cases, something that would have required substantial, additional travel time and cost. Next, 66 health facilities were selected by systematic random sampling from the list of 136 IMCI health facilities located in the selected 29 districts and having an estimated minimum daily caseload of two cases below 5 years old (Annex 9). The caseload threshold and the number of facilities selected aimed at ensuring the recruitment of a sufficient number of children under 5 years old in the survey, i.e. an adequate sample size, and limits of precision of the results not greater than ±10 for the whole sample. The sample was weighted during the selection, to ensure the same distribution of facilities in the sample as in the sampling frame, according to their geographical location (rural vs urban areas) and type. Facilities were grouped into three types: 1. hospitals, 2. health centres, and 3. dispensary and dressing stations. Because of the replacement of a rural facility with an urban one during data collection, the distribution by location slightly changed. Another facility had to be replaced with one of the same type, based on a list of alternative facilities prepared in advance. The reason for replacement was that the facilities were either closed or not functional at the time of the visit (Annex 9). The final list of States included in the survey is shown in Box 2 and the final distribution of the facilities in the sampling frame and sample is shown in Table 1. 3.3 TARGET AGE GROUP AND TIMING OF THE SURVEY

Children aged 2 years up to 5 years old with a non-surgical complaint and seen for the first time for that episode of illness were eligible to be enrolled. In fact, health providers trained in IMCI in Sudan are expected to follow the IMCI approach in the assessment of all sick children. Children below 2 months old were excluded from this survey as they are managed differently from older children and it would have been necessary to select a separate and adequate sample just for this age group. Furthermore, the number of infants under 2 months old seen at health facilities is usually very low, especially at dispensaries and dressing stations. To make meaningful conclusions on their management, a substantial increase in the number of facilities surveyed and a much longer duration of the survey would have been required: this would not have been feasible. A total of seven cases could not be enrolled in the survey as their caretakers did not consent; an additional 11 cases had to be excluded as their caretakers left the facility before their children completed the visit and were re-examined by the surveyor. The pattern of these cases is shown in Table 2. Table 2. Complaints reported by caretakers for 18 eligible children not enrolled in the survey Cough 11 Fever 7 Diarrhoea 6 Urine problem 2 Eye problem 2 Skin problem 1 Ear problem 1 Other problem 1

A child may have one or more complaints. 9 out of 18 (50%) children were boys; 3 children were less than 1 year old.

11

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 The population served by the 60 IMCI districts in the sampling frame was over 9 500 000 people, including over 1 500 000 children below 5 years old; about 75% of them lived in the districts selected for the survey. The survey was conducted in March and April 2003 (Annex 4). Although these months were not ‘peak months’ in terms of facility caseload, the choice was based on a number of practical considerations, including accessibility to health facilities and time required to prepare for the survey (see Annex 10). 3.4 SURVEY INSTRUMENTS, TEAMS AND PROCEDURES FOR DATA COLLECTION

The methodology used in this survey was based on the methodology described in the draft manual on the IMCI health facility survey prepared by WHO (Health facility survey for integrated child health services, Geneva, WHO, 2002) and revised by EMRO according to previous survey experience. Some of the main adaptations are presented in Annex 11, while survey procedures are described in detail in section 3.4.4. 3.4.1 Forms Two types of information were collected: quantitative and qualitative. Quantitative data were collected by an enrolment card and four forms (see Appendix). These forms had been carefully reviewed, adapted to the country situation and programme needs, and tested during the survey-planning phase. The forms used included: EC : Form 1: Form 2: Form 3: Form 4: Enrolment card; Observation of health facility provider’s management of a sick child; Exit interview with the caretaker of the sick child; Re-examination of the sick child by a surveyor; and Assessment of facilities, services and supplies.

Qualitative information (surveyors’ observations) was recorded on a separate, semistructured form for each facility and used as an additional resource in data analysis to assist in the interpretation of the quantitative data. Observations focused on issues related to the organization of work at health facilities, drugs (procurement, uninterrupted supply, etc.), referral, utilization of services, routine reporting, constraints to implementing IMCI, and also left room for any additional observations and comments by the survey team. 3.4.2 Survey teams

The following persons participated in the survey (Annex 12): 13 surveyors (including one recruited as additional support for contingencies), 7 supervisors (one for contingencies), the national IMCI coordinator as survey manager, the national IMCI focal point as survey coordinator, the data entry coordinator and WHO staff. UNICEF staff joined surveyor training and field visits. Based on selection criteria, all supervisors and surveyors were very familiar with the national IMCI guidelines and had good clinical skills and field experience, with substantial exposure to and involvement in IMCI. They were in fact selected among staff at national and State level who had received training in the standard IMCI clinical course, in facilitation skills, in conducting skill reinforcement and follow-up visits after IMCI training, and had been involved in IMCI follow-up visits.

12

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 3.4.3 Surveyor training

Survey staff participated in a 40-hour surveyor training course at Omdurman paediatric hospital (a facility not included in the survey sample) in Khartoum State, from 15 to 20 March 2003. The training schedule is shown in Annex 13. The survey rules to complete the forms and on procedures, adapted to reflect the adaptations in the forms, served as the guide to training to standardize the survey methodology and surveyors’ fieldwork. The training consisted of: a) presentation and explanation of all forms, with classroom practice by extensive use of examples, reinforced by role-plays and followed by active discussions; b) two special sessions on equipment and supplies for EPI and malaria laboratory, respectively; and c) practice with real cases in small groups, using the forms in four practical sessions at the outpatient department of the hospital. Practice included all the tasks as in the actual survey and was followed by a thorough review of each session with each team individually. A major constraint to training was represented by the hospital staff’s common practice of referring cases to the laboratory. This practice substantially prolonged the time required by the survey trainees to complete the observation of case management, caretaker interview and reexamination for each case referred to the laboratory. Nonetheless, a reliability check conducted during one of the last practical sessions to assess inter-surveyor agreement, yielded good rates of 92%, 96% and 94% for forms 1, 2 and 3, respectively. Drills were used in a session on the last day to review all procedures and instructions with the surveyors, focusing on those items that had caused more difficulties during practice. Finally, participants’ evaluation of training was overall positive (Annex 14). 3.4.4 Data collection

Data were collected in seven States in two weeks from 22 March to 3 April 2003. The survey itinerary is shown in Annex 15. The 12 surveyors (with support from the spare one) formed six two-member teams, with each team directly supervised by a supervisor. Each team visited one facility per day. Additional time was allocated to account for internal travel to facilities located far apart from each other in different districts. The procedures on data collection at each facility are illustrated in Annex 16. At each facility visited, the supervisor identified and (after obtaining caretaker’s informed consent) enrolled children aged 2 months to 5 years old taken to the facility on that day14. In order to standardize procedures in all facilities and enable a feedback meeting before the end of the staff morning shift, only children seen by the local health provider by 1.00 p.m. were enrolled in the survey, this time largely covering peak clinic hours at the facilities. One of the two surveyors in the team observed the management of these children performed by facility staff (Form 1). Soon after each child had been managed, the second surveyor interviewed the child caretaker in a separate place (exit interview, Form 2), to assess her level of satisfaction with the care provided and her understanding of the advice just received on antibiotic, antimalarial use and/or home care. The same surveyor then examined the same children independently, to set a ‘gold standard’ (surveyor’s findings) against which to compare health providers’ findings on each case (Form 3). The supervisor supervised the surveyors and collected information on facility services, facility staff’s IMCI training status, quality of supervision, case-load, availability of antibiotics, availability of antimalarials and other drugs needed for IMCI, and other supply and basic equipment and materials (Form 4). At the end of the visit, the team provided feedback and discussed the findings with the staff of each

14

For ethical reasons, it was agreed that any child found by the supervisor to be ‘unconscious’ or in ‘coma’ would not be enrolled in the survey and would urgently be referred. If a child had any other confirmed severe condition requiring urgent referral, the exit interview with the caretaker would be skipped, to avoid delays in care.

13

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 facility, and summarized additional observations on a separate open-ended form (Observation sheet). 3.5 DATA ENTRY, CLEANING AND ANALYSIS

All forms were checked in the field by each supervisor during data collection. Forms were then cross-checked at FMOH in Khartoum by the data entry manager, independently. Next, data were entered into a computer programme using EpiInfo Version 6.04d15 by two two-member data entry teams at the FMOH under the supervision of the data manager. A data entry validation programme facilitated the data entry process and helped detect and correct inconsistent data. Thanks to arrangements to collect the forms from the field during fieldwork, it was possible to start entering data already on the fourth day of data collection. The data were further checked after they had been entered and during the preparation of data summary tables. Thus, quality control was ensured at different levels and before, during and after data entry. The data were then organised in tables and graphs and analysed by a small team at central level, including also university and field staff. 3.6 DIFFERENCES BETWEEN IMCI FOLLOW-UP VISITS AND THIS SURVEY

There are a number of important differences between the follow-up visits carried out after IMCI training and this survey. These differences are summarized below to help understand how to interpret the results obtained from the two types of activities. Both activities are of high value for programme management and planning. ™ Purpose: The IMCI follow-up visits have been designed with the objective of strengthening health providers’ clinical and counselling skills and following up on improvements in health systems in order to support their work after training. As such, the follow-up visits are an essential part of training and focus on the performance of providers trained in IMCI. The survey however is an evaluation that aims at assessing the quality of care, whether given by trained or untrained staff, received by children taken to IMCI facilities16. In the follow-up visits the focus is on the provider, while in the survey the focus is on the child, although information on provider’s performance can indirectly be inferred from the data collected in the survey. Both activities help strengthen the supervisory skills of those involved and, through the feedback to facility staff, are valuable instruments to address key management questions. On the one hand, follow-up visits collect useful, practical semi-quantitative information on outcome indicators at a fixed time, e.g. 1 or 6 months, after IMCI training which managers can immediately use for action locally. On the other hand, surveys provide a cross-sectional picture about the overall situation at one point in time irrespective of the time of training and furnish data on key outcome indicators that can be used for longer-term planning and future comparison. Training of supervisors and surveyors: The supervisors involved in IMCI follow-up visits receive a short, standard training course to enable them to conduct the visits and meet the objectives described above. Surveyors receive a very intensive training course, lasting a full week and following rigid standards and many practical sessions, aiming at

™

Info, Version 6.04c (updated to 6.04d): A word processing, database and statistics program for epidemiology on microcomputers, Centers for Disease Control and Prevention, Atlanta, Georgia, U.S.A. in collaboration with the Global Programme on AIDS, World Health Organization (WHO), Geneva, Switzerland, October 1997. 16 A facility implementing IMCI may have one or more staff providing care to children; not all of them may have been trained in IMCI.

15Epi

14

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 reducing surveyor intra- and inter-variability, i.e. to ensure that all surveyors behave in the same way when collecting data. Methodology and applicability of data: Because of the different nature of the two activities, there are differences in the methodology followed. In the survey, the clinical findings of the provider recorded by a surveyor are compared with the findings of the clinical examination performed independently by another surveyor; in the follow-up visits the same person observes and judges the findings. Sample size and limits of precision of the results also differ. In the survey, all children taken to a health facility are enrolled based on selected criteria and the number of children observed per provider may vary, according to the natural flow at the facility. Given the different purpose, follow-up visits collect information on the management of a few cases (usually one case per provider), while surveys enrol hundreds of children in order to draw statistically valid conclusions with narrow limits of precision that are applicable to all facilities from which the sample has been taken. It should be emphasized that follow-up visits are useful as an initial and practical monitoring tool; however, as they are limited in time and size and because of the different methodology, caution is needed in generalizing the results. Data analysis and use of results: Data analysis in surveys is conducted much more in depth and on more indicators than follow-up visits. The results of follow-up visits are usually summarized and not entered in a database program that would enable relational analysis (i.e., relating variables with each other). Thus, on the one hand, follow-up visits remain a very practical instrument to reinforce provider skills, rapidly assess health system support and call for prompt local action. On the other hand, by collecting ‘hard data’ surveys generate strong ‘evidence’ on IMCI and can also serve as advocacy and policy tools to draw interest, mobilize resources and back up supportive policy decisions. 4. FEEDBACK MEETINGS 4.1 DEBRIEFING WITH THE FEDERAL MINISTER OF HEALTH AND UNDERSECRETARY OF HEALTH

™

™

Two meetings were held, namely with H.E. the Federal Minister of Health and the Undersecretary of Health, respectively, on 21 April 2003, to present and briefly discuss the main conclusions and recommendations of the survey. The meetings were attended by national staff, including the Primary Health Care director (national IMCI coordinator) and the national IMCI focal point, and a WHO team, consisting of the regional adviser in child health, the regional and country medical officers who had collaborated in the survey, and the officer-in-charge of the WHO country office. The Federal Minister of Health expressed his support for the implementation of the IMCI strategy in the country and for policies that would increase access to child health services and improve their quality. Key issues were briefly discussed, such as free provision of one dose of pre-referral treatment as emergency care for severely sick children under 5 years and implementation of approaches to improve drug availability at facilities implementing IMCI; in principle, the Minister agreed with the need to provide free pre-referral emergency treatment to the under 5s. During the debriefing with the Undersecretary of Health, the importance of health system support as an integral component of the IMCI strategy, in addition to training, was emphasized.

15

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

4.2

NATIONAL FEEDBACK MEETING

Major survey findings, conclusions and recommendations and their implications for future planning in the area of child health were presented and discussed at a national meeting in Khartoum at the end of the survey, on 22 April 2003 (Annex 17). The event was included as a key activity in the programme of the Child Health Week that was launched on the same day. As many as 94 people attended the meeting, as part of the large audience attending the launching of the Child Health Week. Participants included decision-makers (ministers of health and director-generals) from the federal and state levels, programme managers and IMCI coordinators from the FMOH and State level; staff from other ministries (Social Welfare, Education, Communication, Agriculture and Forest), academic institutions, nongovernmental organizations, health professionals and other partners supporting or interested in child health care initiatives in Sudan; WHO and UNICEF. 5. FINDINGS This section of the reports presents the most significant findings of the survey. A summary of results related to the generic list of WHO priority indicators and supplemental measures, with their definitions, is given in Annex 19. Detailed and additional findings are presented in tables and graphs in Annex 20. 5.1 5.1.1 SAMPLE CHARACTERISTICS Characteristics of cases observed and of their caretakers

Sixty-six (66) health facilities were visited, namely 5 hospitals, 43 health centres and 18 dispensaries (including a dressing station), located in 10 states implementing the IMCI strategy. The management of 364 children aged 2 months up to 5 years was observed; most of them (72%) were seen at health centres. A total of 350 exit interviews with their caretakers was carried out, and all 66 facilities were checked for health system support. Details of sample characteristics by type of facility are shown in Tables 3, 4 and 5. Age More than half (54%) of the cases enrolled and managed were under 2 years old. These children represent a more vulnerable group: 10 of the 14 cases classified as having a severe condition needing urgent referral or admission to hospital fell into this age group. The proportion of female children seen was slightly lower (47%) than male children, especially at hospitals, although the difference is not statistically significant. The large majority of caretakers of sick children (89%) was female and mothers of the children (83%). As many as 42% of the caretakers had no education, i.e. they were unable to read and write. The proportion was much higher among caretakers of children seen at dispensaries (65%) than health centres or hospitals. This finding has practical implications when designing health education materials and communication interventions on childcare in Sudan, as these need to be in the form of illustrations rather than text. Furthermore, as mentioned in § 2.2, under-5 children of illiterate mothers carry a much higher risk of dying than children of mothers of junior secondary or higher education.

Gender Caretakers

16

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 Table 3. Sample characteristics by facility type (sample not stratified; results in the ‘total’ column unweighted) Characteristics Health facilities surveyed Cases observed# > Sex Girls Boys > Age (both sexes) - < 1 year ( 2 - 11 months) - 1 year (12 - 23 months) - 2 years (24 - 35 months) - 3 years (36 - 47 months) - 4 years (48 - 59 months) Cases managed by - Doctors - Medical assistants - Nurses Caretakers (interviewed)3 > Sex - Female - Male > Relationship - Mother - Father - Other > Education level - None - Primary - Secondary - Higher - Missing information 1 Outpatient 2

Hospitals (OPD)1 5 (8%) 40 (11.0%) 18 (45.0%) 22 (55.0%) n = 40 10 (25.0%) 10 (25.0%) 8 (20.0%) 6 (15.0%) 6 (15.0%) n = 40 13 (32.5%) 27 (67.5%) 0 ( 0.0%) n = 403 31 (77.5%) 9 (22.5%) 29 (72.5%) 7 (17.5%) 4 (10.0%) 17 (42.5%) 11 (27.5%) 9 (22.5%) 3 ( 7.5%) 0 ( 0.0%)

Health centres 43 (65%) 261 (71.7%) 121 (46.4%) 140 (53.6%) n = 261 92 (35.3%) 51 (19.6 %) 52 (19.9%) 45 (17.2%) 21 ( 8.0%) n = 261 58 (22.2%) 203 (77.8%) 0 ( 0.0%) n = 2503 230 (92.0%) 20 ( 8.0%) 215 (86.0%) 14 ( 5.6%) 21 ( 8.4%) 91 (36.4%) 75 (30.0%) 57 (22.8%) 23 ( 9.2%) 4 ( 1.6%)

Dispensaries2 18 (27%) 63 (17.3%) 31 (49.2%) 32 (50.8%) n = 63 23 (36.5%) 12 (19.1%) 16 (25.4%) 6 ( 9.5%) 6 ( 9.5%) n = 63 0 ( 0.0%) 51 (81.0%) 12 (19.0%) n = 603 50 (83.3%) 10 (16.7%) 45 (75.0%) 6 (10.0%) 9 (15.0%) 39 (65.0%) 14 (23.3%) 6 (10.0%) 0 ( 0.0%) 1 ( 1.7%)

Total 66 364 170 (46.7%) 194 (53.3%) n = 364 125 (34.3%) 73 (20.0%) 76 (20.9%) 57 (15.7%) 33 ( 9.1%) n = 364 71 (19.5%) 281 (77.2%) 12 ( 3.3%) n = 3503 311 (88.9%) 39 (11.1%) 289 (82.6%) 27 ( 7.7%) 34 ( 9.7%) 147 (42.0%) 100 (28.6%) 72 (20.6%) 26 ( 7.4%) 5 ( 1.4%)

departments Include also 1 dressing station 3 Interviews conducted only with caretakers of cases not needing urgent referral # Average time of examination per case observed: range 2–53 minutes with a median of ~18 min. (n = 362, as information not available for 2 cases): By trained providers (cases no.: 278): mode 20 min (median 20 min)* By untrained providers (cases no.: 84): mode 5 min (median 8 min)* * P < 0.001

Providers Training

More than three-quarters of children enrolled were managed by medical assistants and one in five (20%) by doctors. The case management practices described in this survey therefore relate mostly to medical assistants. More than three-quarters (77%) of children enrolled in the survey were managed by health providers who had received training in IMCI (Table 4). Notably, the proportion was 100% for cases seen at dispensaries, going down substantially (57%) for those seen at hospitals. This may partially be explained by the fact that dispensaries often have only one provider managing sick children and staff turnover at this level is lower than at higher level facilities. A similar proportion of children (74%) was managed by providers who had received follow-up visits after they had been trained in IMCI, the rate being higher for dispensaries than health centres and hospitals. Follow-up visits are carried out as an integral part of IMCI training and have the objective of reinforcing trainees’ skills in their working environment and strengthening those elements of the health system necessary to deliver quality care. To be effective, however, these follow-up visits should be carried out no later than 4–6 weeks after training. Despite the high 17

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 rate of training and follow-up described above, only about one child in five (22%) was seen by a provider who had received a follow-up visit within 2 months of IMCI training. It is possible that by then, in the absence of support, practices might tend to revert to the way they were before training. The average time of examination per case observed was 18 minutes, ranging from 2 to 53 minutes. The examination of children by IMCI-trained providers took 20 minutes on average as compared to the 8 minutes of untrained providers. In some settings, visit length has recently been proposed as a quality indicator in primary care, although the complexity of the case, facility caseload, provider’s experience and organization of work at the facility are some of the factors which influence it17,18.

Visit length

5.1.2

Patterns of illness

Table 5 shows the pattern of illness of cases enrolled in the survey, according to surveyor’s examination, by type of facility. A child had on average 2.5 ‘IMCI conditions’; many children (59%) had 3 or more ‘IMCI classifications’. Almost two-thirds of cases (63%) had an acute respiratory condition (ARI), more than half (57%) were febrile or had a history of fever, 30% reported diarrhoea, despite this not being a diarrhoea peak season, and 8% had an ear problem, mostly acute (Fig. 2). More than a quarter (28%) of the children with ARI had pneumonia or severe pneumonia, while about one in a hundred had wheezing. One child in ten of those with diarrhoea had dehydration, 9% had persistent diarrhoea and 7% bloody stools. Although 17% of all children enrolled – 30% of those with fever – were classified as malaria cases, subsequent validation of malaria laboratory findings by the National Malaria Administration in Khartoum found only one case to have malaria (§ 5.3.4). An important finding was that more than one child in ten (11%) was found to have an eye infection, defined as the presence of pus draining from the eye. This was expected, as eye problems are reportedly common in Sudanese children. Although the IMCI protocol includes guidelines for the management of eye infections in children with measles who present with eye complications, eye infections are not specifically listed among those IMCI conditions to be routinely checked in each child. Six percent (6%) of all children were very low weight-for-age (< 3 SD) and 17% had anaemia. About 4% of all children enrolled had a severe condition requiring referral. This rate is similar to the one (3%) found in a study in Gezira19. Most of these severe cases had ‘severe pneumonia’. Noteworthy is the fact that, when looking at the overall pattern of illness of each child rather than by each condition individually, more than half (52%) of all children enrolled with one or more ‘IMCI conditions’ had a classification needing referral, drug treatment, or specific nutrition advice, that is, a condition that required action by a qualified health provider. The proportion was much higher in children seen at dispensaries (73%) than other facilities, thus confirming the importance of this level of the health system in delivering child care. Outpatient departments of hospitals would then appear to function as any health centre rather than a referral facility. This may suggest that caretakers might simply take their children to the nearest health facility irrespective of the level of the facility and the condition of the child, or be unable to recognize the severity of the child’s condition, or both (see also § 5.1.3 Druss, B, Mechanic D, Should visit length be used as a quality indicator in primary care?, The Lancet 2003, 361:1148. 18 Wilson A, Childs S., The relationship between consultation length, process and outcomes in general practice: a systematic review, British Journal of General Practice 2002, 52:1012-20 19 Evaluation of family responses to recommendations of referral and follow-up under the strategy IMCI, Masalamia District, Gezira State, 2000, Preliminary report by Simon Cousens to WHO headquarters, Geneva. 17

18

Table 4. Sample characteristics: cases seen, by provider’s training status and facility type Characteristics Cases managed by: IMCI-trained providers IMCI-untrained providers IMCI-trained providers followed up after training IMCI-trained providers followed up within 2 months of training 1OPD:

Hospitals (OPD)1 n = 40 23 (57.5%) 17 (42.5%) 22 (55.0%) 8 (20.0%)

Health centres n = 261 194 (74.3%) 67 (25.7%) 185 (70.9%) 67 (25.7%)

Dispensaries1 n = 63 63 (100%) 0 63 (100%) 7 (11.1%)

Total n = 364 280 (76.9%) 84 (23.1%) 270 (74.2%) 82 (22.5%)

outpatient departments of hospitals; the column for dispensaries includes also 1 dressing station

Fig. 2. Distribution of main conditions in the sample (n=364)

i

Table 5. Sample characteristics by facility type: classification of cases enrolled according to surveyor’s re-examination findings (sample not stratified; results in the “total” column unweighted) Classifications# Cases observed for management2 Acute respiratory infection Severe pneumonia/very severe disease Pneumonia No pneumonia (cough or cold) [Wheezing]3 Diarrhoeal diseases Diarrhoea with severe dehydration Diarrhoea with some dehydration Diarrhoea with no dehydration Severe persistent diarrhoea Persistent diarrhoea Dysentery Fever Very severe febrile disease Malaria Fever – malaria unlikely Severe complicated measles Measles with eye/mouth complications Measles Ear problem Mastoiditis Acute ear infection Chronic ear infection No ear infection

Hospitals (OPD)1 n = 40 24 (60.0%) 0 10 (25.0%) 14 (35.0%) 1 ( 2.5%) 6 (15.0%) 0 3 ( 7.5%) 3 ( 7.5%) 0 1 ( 2.5%) 2 ( 5.0%) 23 (57.5%) 0 5 (12.5%) 18 (45.0%) 0 0 1 ( 2.5%) 2 ( 5.0%) 0 1 ( 2.5%) 0 1 ( 2.5%)

Health centres n = 261 165 (63.2%) 7 ( 2.7%) 33 (12.6%) 125 (47.9%) 1 ( 0.4%) 82 (31.4%) 2 ( 0.8%) 6 ( 2.3%) 74 (28.4%) 0 8 ( 3.1%) 6 ( 2.3%) 148 (56.7%) 3 ( 1.1%) 37 (14.2%) 108 (41.4%) 0 1 ( 0.4%) 2 ( 0.8%) 18 (6.9%) 0 13 ( 5.0%) 3 ( 1.1%) 2 ( 0.8%)

Dispensaries1 n = 63 39 (61.9%) 3 ( 4.8%) 11 (17.5%) 25 (39.7%) 1 ( 1.6%) 21 (33.3%) 0 0 21 (33.3%) 0 1 ( 1.6%) 0 36 (57.1%) 0 20 (31.7%) 16 (25.4%) 0 0 0 11 (17.5%) 0 9 (14.3%) 1 ( 1.6%) 1 ( 1.6%)

Total n = 364 228 (62.6%) 10 ( 2.7%) 54 (14.8%) 164 (45.1%) 3 ( 0.8%) 109 (29.9%) 2 ( 0.5%) 9 ( 2.5%) 98 (26.9%) 0 10 ( 2.7%) 8 ( 2.2%) 207 (56.9%) 3 ( 0.8%) 62 (17.0%) 142 (39.0%) 0 1 ( 0.3%) 3 ( 0.8%) 31 ( 8.5%) 0 23 ( 6.3%) 4 ( 1.1%) 4 ( 1.1%)

3 ( 1.2%) 0 3 ( 0.8%) 0 Severe malnutrition 11 ( 4.2%) 3 ( 7.5%) 23 ( 6.3%) 9 (14.3%) Very low weight 247 (94.6%) 37 (92.5%) 338 (92.9%) 54 (85.7%) No very low weight 1 ( 0.4%) 0 1 ( 0.3%) 0 Severe anaemia 32 (12.3%) 10 (25.0%) 60 (16.5%) 18 (28.6%) Anaemia 228 (87.3%) 30 (75.0%) 303 (83.2%) 45 (71.4%) No anaemia 113 (43.3%) 17 (42.5%) 167 (45.9%) 37 (58.7%) Feeding problems 28 (10.7%) 3 ( 7.5%) 41 (11.3%) 10 (15.9%) Eye infection Children with IMCI conditions requiring treatment or urgent referral (“yellow” and “red” 23 (57.5%) 120 (46.0%) 46 (73.0%) 189 (51.9%) row classifications of the IMCI chart) # A child may have more than one classification 1 OPD: outpatient departments of hospitals; the column for dispensaries includes also 1 dressing station 2 According to surveyor classification (“gold standard”). The distribution of classifications refers to the month in which the survey was conducted, which is usually a low season for such conditions as diarrhoeal diseases, malaria etc. 3 Children with recurrent wheezing are first given a rapid-acting bronchodilator and then re-assessed 30 minutes later, before being classified 10 (71%) of the 14 cases requiring urgent referral were children less than 2 years old

ii

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 and 5.3.9). A higher proportion of these children with conditions requiring specific actions and better management skills was distributed in the group of cases seen by IMCI-trained providers (55% of all cases managed by them) than untrained ones (42%), and in rural (68%) than urban (54%) facilities. 5.1.3 Relationship of caretakers’ report of fast or difficult breathing with pneumonia and care-seeking

Difficult breathing, fast breathing or ‘pneumonia’ (referred to in this paragraph as ‘breathing problems’ all together) were reported by caretakers in 37 (16%) of the 228 children with an acute respiratory condition. Although the survey was not an ethnographic study designed to identify the local terminology used by caretakers to refer to ‘breathing problems’, the relationship of caretakers’ report of breathing problems with pneumonia or severe pneumonia was briefly reviewed (Annex 20, Tables A1 and A220). In fact, one of the key home care messages for families, promoted first by the ARI21 control programme and then by IMCI, is to seek care promptly if their sick children develop a breathing problem. In this survey, caretakers reported a breathing problem only in 12 (19%) of the 64 children found by the surveyors to have pneumonia or severe pneumonia (very low sensitivity), although all of them had by definition an increased respiratory rate and/or chest in-drawing on examination (Table A1)22. The specificity was somewhat higher (85%): if caretakers did not report breathing problems, their children were then less likely to have pneumonia. Examining whether caretaker’s report of breathing problems had a good predictive value for pneumonia or severe pneumonia, it was found that about a third (32%) of the children with reported breathing problems actually had pneumonia or severe pneumonia (Table A2)23. Children with a breathing problem spontaneously reported by caretakers were only 1.2 times more likely to have pneumonia or severe pneumonia than those in whom it had not been reported. Since the predictive value also depends on the prevalence of the disease in the population under study (children taken to health facilities in this case), ‘breathing problems’ might have an even lower predictive value for pneumonia in the community. This is because a higher prevalence of the illness is to be found in a population of children who are ill (i.e. those seen at health facilities, more so if at hospitals) than in the community. Thus, in this particular sample of children taken to a health facility and found to have pneumonia or severe pneumonia, most caretakers had either missed the breathing problem or simply not given particular importance to it alone. Among the local terms used by caretakers which had a better sensitivity (although still very low), specificity and positive predictive values were deeg nafas (βϔϧ ϖϴο) and eltihab24 (ΏΎϬΘϟ΍). Eltihab was a sign also mentioned often by caretakers interviewed in a household survey conducted in Gezira, Khartoum and Kassala states in 1995 as a common reason for seeking care in children with ARI25. The Arabic version of the Sudan home care card uses the terms suraa fialtanafas (βϔϨΘϟ΍ ϲϓ Δϋήγ) and soaba fialtanafas (βϔϨΘϟ΍ ϲϓ ΔΑϮόλ). In this survey, information was collected from 25 of the 37 caretakers who had spontaneously complained of a breathing problem in their child concerning how long they had waited before seeking care from this facility since the time they had realized the child had difficult breathing or a chest problem. About a third (32%) of them answered that they had taken the child within a day, Tables starting with the letter A (e.g. A1) are available in Annex 20 of this report. ARI: acute respiratory infections 22 It should be noted that this sample consisted of children taken to a health facility, rather than children at home. The classification of cases as ‘pneumonia’ or ‘severe pneumonia’ was based on clinical signs such as general danger signs, chest indrawing and fast breathing. 23 32.4% was the positive predictive value for pneumonia or more severe illness of caretakers’ report of fast or difficult breathing or pneumonia in this sample; the negative predictive value for absence of pneumonia or more severe illness of caretakers’ not reporting breathing problems was 72.6%. 24 Another term, nafaso sari (ϊϳήγ Ϫδϔϧ), was used more rarely, only in three instances. 25 Mangiaterra V, An ARI, CDD and Breastfeeding household survey, Report on a mission, Sudan, 1996, Alexandria, WHO, Regional Office for the Eastern Mediterranean. 21 20

19

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 while the rest had waited for 2–7 days; the median time was 2 days. Although caretakers might have consulted other sources of care first or may have delayed seeking advice because of reasons other than lack of knowledge, the findings suggest that much work needs to be done to improve family care-seeking practices for children with ARI in Sudan. 5.2 QUALITY OF CLINICAL CARE

A summary of results on selected indicators on the quality of clinical care is shown in Table 6. The next sections present the findings on the key components of case management in detail, namely assessment, classification, treatment and counselling, to describe the quality of integrated care that children received at health facilities. It should be emphasized that the survey looked at the quality of care that each child received rather than provider’s performance, although information on the latter could often be inferred from the former. Therefore, the results apply to care delivered by both IMCI-trained and untrained providers. ™ Reliability of caretakers: An interesting finding in this survey, noted also in a previous IMCI health facility survey in Egypt, was caretakers’ inconstant reliability in giving information on signs and symptoms, first to the survey team supervisor on enrolment of the child, next to the local health provider, and finally to the surveyor re-examining the child. For example, in 12 cases in whom the caretakers reported the presence of cough or difficult breathing to the surveyor, they had previously told the local provider that the child had no cough or difficult breathing; two of these children had pneumonia which was then missed by the provider. And vice versa, in 28 cases in whom caretakers told the surveyor that the child had no cough or difficult breathing, they had told the local provider that the child did have cough or difficult breathing. Similarly, in 7 cases in whom the caretakers reported the presence of diarrhoea to the surveyor, they had previously told the local provider that the child had no diarrhoea; one child with some dehydration among them was then missed by the provider. In 21 cases in which caretakers told the surveyor that the child had no diarrhoea, they had told the local provider that the child did have diarrhoea. One chronic and two acute cases of ear infection were missed for the same reasons. This was one of the reasons why certain assessment tasks were not carried out by the local providers in some children: the negative history resulted in the provider’s misclassification and incorrect treatment of the child when compared with the surveyor findings used as a reference standard. It should also be noted that where there were discrepancies between health provider’s and surveyor’s history findings, the analysis of data suggested that surveyor’s findings were more reliable. More careful history-taking by the provider would then have been likely to improve his/her performance. Assessment

5.2.1

The guidelines on integrated child health care (IMCI) require that a number of key assessment tasks should be performed in any sick child, irrespective of the specific complaint. This helps identify conditions that are not reported by the caretaker. To measure how complete the assessment that each child received was, an index of integrated assessment was used in the analysis. The index consists of many key tasks and gives equal weight to each task done (score per task done = 1): it is expressed as the mean of the number of tasks performed in each child (out of those that should have been performed). This index is preferred to compound indicators as these result just in ‘yes’ answers if all and only all component tasks of which they consist are done: even if only one task is missed out of many, the compound indicator would result in a ‘no’ answer. This prevents documentation of changes in some of the compound indicators’ component tasks in future. The index of integrated assessment, 20

Table 6. Summary table with selected survey results on the quality of clinical care Quality of clinical care: tasks ™Assessment x x Children in whom all the 10 main assessment tasks were carried out 1.9% 24.0% Children below 2 years old and those with very low weight and/or anaemia assessed for feeding practices ™Classification x Agreement between provider’s and surveyor’s classifications of conditions requiring urgent referral, treatment or specific counselling

Findings

46.4% 94.6% 0 out of 14 32.5% 62.6% 48.6%

x Cases underclassified among those incorrectly classified by the provider ™Treatment and advice x x x x x Severe cases correctly managed Children needing an oral antibiotic prescribed correctly Children not needing antibiotics leaving the facility without antibiotics Children needing vaccinations who leave the facility with all needed vaccinations or advice on when to come back for scheduled vaccination Children prescribed oral antibiotic, ORS or antimalarials whose caretakers knew how to give the treatment before leaving the facility:  Antibiotic  Antimalarial  ORS Children whose caretakers were advised on all the three home care rules Children whose caretakers knew all the three home care rules before leaving the facility Proportion of children less than 2 years old and those with low weight-for-age and/or anaemia whose caretakers were given age-appropriate feeding advice

22.2% 19.6% 24.1% 11.7% 1.7% 23.7%

x x x

Fig. 3. Integrated assessment: Main tasks and WHO index

iii

Fig. 4. Agreement of provider classifications with surveyor classifications on main conditions

(Cases given a recommended antibiotic for IMCI condition n=54)

Fig. 5. Provider correct prescription and caretaker correct knowledge about antibiotic treatment iv

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 instead, enables follow-up of improvements in care and progress over time, taking into account each of the tasks of which it consists: the higher the number of tasks performed, the higher the index. Two versions of the index were used in this analysis: a) one version based on the generic index proposed by WHO for these surveys on a trial basis; and b) a second version representing the index adapted to Sudan. The latter was meant to take into account a few additional, key assessment tasks and adaptations present in the Sudan IMCI guidelines. The WHO index was included in the analysis to allow comparisons with other surveys in different countries. Note on results: Rather than describe health providers’ ‘practices’, the survey results provide some information on providers’ ‘skills’. Health providers knew that they were being observed by the surveyor; therefore, what they did not necessarily reflect what they would do under routine circumstances (i.e. their routine practices). However, if they carried out a task and did it correctly while being observed, this would indicate at least that they would have the skills to do that task properly. The IMCI chart was consulted by the providers in the large majority of cases observed (72.5%). The use was obviously much higher for providers trained in IMCI (chart used in 93.2% of cases) than those untrained (3.6%).

™

Index of integrated assessment (Fig. 3; Table A3): The index values found in this survey were: a) a mean of 5.9 tasks performed out of 10 assessment tasks to be performed, for the WHO index26; and b) a mean of 7.6 out of 14 tasks, for the Sudan-adapted index24. These values for both indices are of intermediate level and suggest that a number of tasks were often missed in the assessment of a child. However, when the findings are analysed by provider IMCI training status, the data consistently show that children seen by an IMCI-trained provider were assessed more systematically for the main tasks through the IMCI protocol than untrained staff (Fig. 10): while on average only 3.4 assessment tasks were carried out in a child by untrained staff (a rather poor performance), about twice as many tasks were performed by IMCI-trained providers (P<0.0001). Yet, even in the latter group of providers, the index of 6.6 was suboptimal (Table A36). Assessment tasks (Table A3): Most children were weighed (82%), while the weight was checked against the growth chart in half (52%) of the children to determine the weight-for-age and classify the child according to it. The temperature was taken in less than half of the cases (47%), and the vaccination status was checked in 60% of cases. One child in five (21%) was correctly checked for the presence of the three general danger signs (inability to drink, vomiting everything and convulsions) to detect cases with a very severe disease requiring urgent referral. In this survey, the emphasis was on ‘correctly’ checking for these signs, rather than simply checking, and this explains the difference between this rate and that observed in other studies. Three-quarters of children (75%) were checked for the presence of the three main symptoms of cough, diarrhoea and fever, irrespective of the initial complaints, in order not to miss conditions not reported spontaneously by caretakers. Sixty-one per cent (61%) of children were checked for the presence of an ear problem.

™

Signs that were assessed less frequently, apart from some of those mentioned above, included: palmar pallor (assessed in 45% of cases) to detect clinical anaemia; and oedema of both feet (32%) and visible severe wasting (24%) to detect clinical severe malnutrition. As for 26 The ten assessment tasks of the WHO index are: child checked for three danger signs (1,2,3), checked for the three main symptoms (4,5,6), child weighed (7) and weight checked against a growth chart (8), child checked for palmar pallor (9) and for vaccination status (10). The Sudan index adds the following 4 tasks: temperature checked with thermometer (11) and child checked for the presence of ear problem (12), wasting (13) and oedema of both feet (14).

21

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 danger signs, the emphasis for these tasks was on tasks ‘correctly’ performed rather than simply performed. As noted earlier, assessment tasks were performed more frequently in cases examined by providers trained in IMCI than those seen by untrained staff (P<0.0001) for most of the individual tasks) (Fig. 11; Table A36). None of the 84 children seen by untrained providers was assessed for palmar pallor, visible wasting and presence of oedema on both feet. Note: 32% of children in whom caretakers initially did not report cough or difficult breathing, 9% of those in whom they did not report diarrhoea and 16% in whom they did not report fever, were then found by the surveyor to have an acute respiratory infection (ARI), diarrhoea or fever (or history of fever), respectively, in addition to the complaint/s spontaneously reported: they were thus examined also for these conditions. The systematic checking for an ear problem enabled the surveyor to detect 10 additional cases of ear infection, for whom caretakers had initially not reported an ear problem, that is, about half (48%) of the 27 cases ultimately found to have an ear infection. These findings, which are similar to those found in the survey in Egypt, further confirm the validity of the integrated childcare (IMCI) guidelines for a more complete examination of the sick child, not limited to the main complaint initially reported by the caretakers.

™

Child road-to-health cards (Table A3) were checked in 9% of cases. The cards contain useful information on the child’s nutrition and immunization status. Caretakers usually take it with them for immunization sessions but not for sick child visits – as they are not advised to do so, although the card contains useful information on the child. Feeding assessment (Table A4): About one child in four (24%) under 2 years old or with very low weight or anaemia not referred by the provider was assessed for feeding practices as recommended by the IMCI guidelines (including assessing breastfeeding for those less than 2 years old, complementary feeding and feeding changes during illness for all)27. This task, which aims at detecting and improving incorrect feeding practices, was performed only by IMCI-trained providers: it was carried out in a third (30%) of cases seen by them but in none of the 47 eligible children seen by untrained providers (P<0.001) (Table A37). Although children with very low weight-for-age and/or anaemia were not more likely to receive feeding assessment than those without those conditions, it should be noted that 78% of those older than 2 years with the condition had been misclassified by the provider as cases with no anaemia or not very low weight-for-age and, based on this wrong classification, would not have required feeding assessment. Qualitative and additional findings on assessment: As part of the adaptation of the survey instrument, an attempt was made to check not only whether a certain number (‘quantity’) of key tasks was carried out for any sick child, but also how (‘quality’) they were performed and whether further assessment tasks were carried out in those children in whom a condition was found. A sample of key assessment tasks was chosen that could reliably be assessed through observation (Table A5). ¾ Weight and temperature for all children: although the weight was taken and also recorded in the majority of cases (80% of children), it was taken correctly28 in about half (53%) of the cases. The temperature was taken correctly28 in 14% of children. Noteworthy are the significant differences observed between cases seen by IMCI-

™

™

27

See definitions at bottom of table A4. If the indicator is limited to children under 2 years of age, as proposed in the WHO general list of priority indicators for ease of calculation, the proportion of these children assessed for feeding in this survey rises slightly to 27.5%. 28 For the definition of correctly, see footnote to Table A5.

22

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 trained and untrained providers (Table A36). For example, the temperature was hardly ever taken (although thermometers were often available) and never taken correctly by untrained providers. ¾ History of difficult breathing: providers failed to ask whether the child had a breathing problem in at least one caretaker in five (20%) among those who had reported no cough in their children. The entry symptoms into the ARI section of the IMCI protocol are in fact cough or difficult breathing or both. However, providers often ask only about cough and, if this symptom is not present, may not ask about breathing problems. In this way, they may miss cases with pneumonia that present with breathing problems as the main complaint. This omission has therefore important implications, as confirmed in this survey: the group asked only about cough and not about any breathing difficulty included a child with severe pneumonia and two children with non-severe pneumonia; eventually, two cases of pneumonia were missed by the provider. This fact may be due to the provider’s asking questions automatically and quickly, without paying too much attention to them. In fact, the caretakers of these two children with pneumonia had reported that their children had cough and/or a breathing problem to both the survey supervisor upon arrival at the facility and then the surveyor. This suggests that caretaker’s unreliability may in some cases be due to the provider’s not taking the history properly (see ‘Reliability of caretakers’ under § 5.2). ¾ Respiratory rate in cases with cough or difficult breathing: This was counted in three-quarters (76%) of all cases (and in 89% of cases seen by trained providers, P<0.0001). In 12 (22%) of the 55 cases in which it was not counted, the caretaker had told the provider that the child had no cough. The count was taken correctly28, however, in 57% of children with ARI. There was a striking difference by provider training status, as the respiratory rate was rarely taken and taken correctly in cases seen by untrained providers (Table A38). In this analysis, the counts were considered ‘reliable’29 in 41% of cases in which they were taken. Ample differences in counts were found between the provider and the surveyor, ranging from –34 breaths/min. to +46 breaths/min. (Table A6). This analysis showed that ‘unreliable’ counts were directly responsible for providers’ under-classifying as ‘no pneumonia’ 11 children who actually had fast breathing (‘pneumonia’) and overclassifying as ‘pneumonia’ 35 children with ‘no pneumonia’. ¾ History, skin pinch and offering water in cases with diarrhoea: information on duration of the diarrhoea episode – necessary to distinguish acute from persistent diarrhoea cases – was asked in three-quarters (76%) of cases, and on presence of blood – to identify dysentery cases – in 57% of cases. These findings are similar to those of a CDD30 health facility survey carried out in Sudan in October 199731. More than two-thirds (69%) of children with diarrhoea had their abdomen skin pinched to check skin turgor, and 50% were offered something to drink to check thirst – to assess dehydration status. The latter rate is much higher than the one found in the CDD survey in 199732. However, the skin was pinched correctly in only a third of children with diarrhoea33. All the above tasks were performed much more frequently in children with diarrhoea seen by IMCI-trained providers, and were rarely done by the untrained providers (Table A38). 29

Exclusively for the purpose of this analysis, a count was considered ‘reliable’ if the difference in count between the provider and the surveyor for the same child was not greater than 5 breaths per minute. This arbitrary level was based on experience from previous health facility surveys on acute respiratory infections: about two-thirds of all counts would usually lie within this difference. 30 Control of diarrhoeal diseases programme. 31 FMOH/WHO: A CDD health facility survey, Sudan, October 1997 32 See footnote (31). 33 See footnote (28)

23

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 ¾ Checking both ears in children with an ear problem: more than a third (35%) of children with a history of ear pain or ear discharge had both their ears checked. This task was carried out only by trained providers (Table A38). ¾ Checking for measles in children with fever: a history of measles within the last 3 months was checked in 42% of children with fever or history of fever, but never by untrained providers (Table A38). ™ Assessment of other problems (Table A3): Although the IMCI guidelines focus on the most common causes of mortality and important causes of morbidity, what makes them thorough are the instructions to complete the assessment of each child by asking about other problems and assessing them if present. The caretakers of almost half (48%) of the children were asked about the presence of any other problems. Classification

5.2.2

There was an agreement between the provider’s classification and the surveyor’s classification on 46% of the conditions found in the 364 children examined and requiring urgent referral, drug treatment or specific counselling (Fig. 4; Table A7)34, 35. The full breakdown by condition is presented in Tables A8 through Table A15 in Annex 20. Overall, about a third (32%) of all children having one or more of these conditions was correctly classified by the provider. The analysis of the data also tried to establish whether the misclassified cases had actually been ‘under-classified’, i.e. considered as milder cases than they actually were, as this would have important clinical implications. Under-classification occurred in 95% of the misclassified conditions (Table A7). The results are described below. Although the samples by illness or by condition are small in some cases, the data may help understand whether an inadequate assessment of the child (inaccurate history, or incomplete or incorrect physical examination) was responsible for the under-classification of the condition. ¾ Very severe pneumonia, severe pneumonia and pneumonia (Table A8): there was agreement on these classifications in 56% of the 64 cases identified by the surveyor. Most (95%) of the 28 such conditions that were misclassified by the provider were under-classified. This resulted in four cases of severe pneumonia not being referred by the provider and eight cases of pneumonia being about to be sent home with no antibiotic treatment36. Caretakers of two of these cases with non-severe pneumonia had answered negatively the provider’s question on whether the child had cough or difficult breathing, although they had reported it upon enrolment in the survey, and were therefore not assessed for pneumonia by the provider. Other reasons for missing non-severe pneumonia included provider’s inaccurate count of the respiratory rate, or not taking it at all. Diarrhoea with persistent diarrhoea, dysentery and severe or some dehydration (Tables A9-A11): there was agreement on the classification of three of the 10 cases with persistent diarrhoea, four of the eight cases with dysentery, and four of the 11

¾

A total of 276 conditions requiring urgent referral, treatment, or specific counselling were identified, falling in the following seven categories: 1) Very severe disease or severe pneumonia or pneumonia; 2) Diarrhoea with severe or some dehydration, severe and non-severe persistent diarrhoea, dysentery; 3) Very severe febrile disease or malaria; 4) measles with or without eye and mouth complications; 5) Mastoiditis or acute or chronic ear infection; 6) Severe malnutrition or very low weight; and 7) Severe anaemia or anaemia. 35 ‘Correct’ is used in this report when health provider’s case management practices agree with surveyor’s (the ‘gold standard’), i.e. if they comply with the national, standard IMCI case management guidelines. 36 These cases were advised correct treatment in the end. In fact, the survey team supervisor reviewed these cases with the facility provider, after they had been examined by the provider and re-examined by the surveyor, who detected the condition.

34

24

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 cases with dehydration. The reasons for the misclassification of diarrhoea cases varied: cases were either not assessed for this problem, or the assessment findings were not taken into account for the classification, or simply no classification was given. For example, although the provider asked about the duration of the diarrhoea episode in nine of the 10 cases with persistent diarrhoea and about the presence of blood in the stools in seven of the eight cases with dysentery, only three cases were classified as persistent diarrhoea and only four cases were classified as dysentery, respectively. All the seven dehydrated cases misclassified were under-classified. Very severe febrile disease or malaria (Table A12): there was agreement in 72% of these cases. The agreement rate was higher in cases with fever than other conditions because of provider’s routine request for microscopical examination (blood smear) in cases with fever and relying on the laboratory results for the diagnosis, in the same way as the surveyor did. This process then required no clinical skills on the provider’s side when laboratory facilities were available. Unfortunately, two independent and blind validity checks of the laboratory diagnoses carried out in Khartoum at the end of the survey showed that the diagnoses at health facilities were unreliable in many cases (see § 5.3.4). The 18 cases with fever that were misclassified by the provider were all under-classified: often no classification for fever was given. Measles (with or without complications) (Table A12): all four cases of measles were under-classified, including a case with eye or mouth complications. However, it was likely that the three cases without complications were simply given no specific measles classification because there were no complications. To support this view is the fact that in two of these three cases the providers specifically asked the caretaker whether the child had had measles in the last 3 months. In these cases it would then be more appropriate to talk about ‘no classification given’ rather than real under-classification. Acute and chronic ear infection (Table A13): provider and surveyor classifications agreed with each other in 37% of children with an acute or chronic infection. The reasons for missing the other cases included inadequately checking the ears37, not asking about ear problems, not considering the findings of the assessment for the classification, or, in a few instances, caretaker’s unreliable answer to the provider. Severe malnutrition or very low weight (Table A14): the provider classification agreed with the surveyor classification in 10 (38%) of the 26 cases with the condition. The nutrition status of one of the three cases with severe malnutrition was not classified at all. Of the 15 cases with very low weight under-classified, three had not been weighed while for the others it is possible that the weight had not been considered in the assessment of the child. Severe anaemia or anaemia (Table A15): as noted also in a previous survey in Egypt, this remains the most problematic area. There was agreement only in 21% of the 61 cases with clinically detected severe anaemia or anaemia. The only case having severe anaemia and 46 cases with non-severe anaemia were missed. The most common reason for missing anaemia was not checking for palmar pallor (39% of the 46 cases with anaemia not classified or under-classified for anaemia). Only for eight of the 46 cases with anaemia was an incorrect classification given, among which were seven ‘no anaemia’ classifications indicating true under-classification. In all the other 39 anaemia cases underclassified, instead, no classification was given, suggesting that particular attention should be paid to the assessment of this sign during training and follow-up. Eye infections: although not specifically included in IMCI among the main conditions to be checked routinely in each sick child, the prevalence of eye infections (pus draining from the eye) in the sample was high (11%). Data on this condition

¾

¾

¾

¾

¾

¾

37

It was observed, for example, that some providers turned the child’s head to both sides, as the surveyor was present, but looked at both ears very superficially and from a distance. Although the surveyor would record that both ears were checked in these cases, the ears were actually not properly checked.

25

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 showed a 41% agreement between surveyor and provider. In more than half (58%) of the 24 cases in which eye infections were not reported by the provider, he/she had not checked for other problems at the end of the examination, a task instead recommended in the IMCI guidelines. Identification of feeding problems: feeding problems were common and were found in 167 children (46% of cases) by the surveyors: providers were able to identify them in 8% of these cases. Treatment and advice

¾

5.2.3

5.2.3.1 Management of severe cases A total of 14 cases were classified by the surveyor as cases with a severe condition warranting urgent referral or admission to hospital: two thirds (9) of them were ARI cases with ‘severe pneumonia’/‘very severe disease’ (Table A16). Six (43%) of the 14 severe cases were correctly identified as severe and referred or admitted to hospital by the local health providers, all of them trained in IMCI. Two-thirds (67%) of the cases referred by the provider were given explanations on the reasons for urgent referral, most of the caretakers (92%) accepted referral, and a referral note was prepared and given to half of the referred cases. However, no case eventually received pre-referral treatment as advised by the IMCI guidelines, i.e. first dose of a recommended antibiotic and/or antimalarial, ORS and vitamin A as applicable (Table A16). A study in Gezira had found a mortality risk of 10% among children requiring urgent referral according to the IMCI guidelines; the risk appeared lower in children presenting to the hospital on the same day of referral, although the number of deaths in that study was small and the difference was not statistically significant38. In conclusion, none of the 14 severe cases was correctly managed, that is, was identified and managed according to the IMCI guidelines. The main reasons that may explain this outcome include provider’s failure to identify the severity of the case (inadequate assessment), the lack of pre-referral drugs at the facility in some cases, or failure to provide pre-referral treatment upon referral or admission. It should be noted that pre-referral drugs at primary health care level facilities are currently charged to the patient, unlike emergency treatment provided at hospitals. This fact may then act as a disincentive to administer pre-referral treatment, especially when caretakers may lack the financial resources to pay even for a single dose. Note: The national IMCI guidelines recommend that even for children with a severe classification seen at the outpatient or emergency department of a hospital, a pre-referral (admission) dose of antibiotic and/or quinine should be given upon admission to those with suspected bacterial infection or severe malaria as standard operating procedure. In fact, these cases have a severe or very severe condition, and should be dealt with as medical emergencies. There is often a substantial delay in starting treatment at the referral facility, from the time the child is assessed in the outpatient or emergency department to the time the patient has been transferred to the ward, re-assessed, all treatment instructions have been given and treatment has finally been started.

5.2.3.2 Use of injectable drugs Injectable drugs, including parenteral chloroquine (1 case) and benzylpenicillin (all other cases), seemed to enjoy some popularity among providers, although the overall use rate found in this survey was contained (Table A16). Benzylpenicillin was in fact administered in about 5% of all children who were not referred by the provider. When considering the classification given by the provider, whether correct or not, most of these cases were unlikely to need benzylpenicillin (e.g. most were classified as pneumonia cases). The proportion of

38

Evaluation of family responses to recommendations of referral and follow-up under the strategy IMCI, Masalamia District, Gezira State, 2000, Preliminary report by Simon Cousens, to WHO headquarters, Geneva.

26

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 children who received therapy by injection in a previous study conducted in Gezira (4%) was similar39. 5.2.3.3 Rational use of oral antibiotics ™ Prescription: Most children (72%) with an IMCI condition not requiring urgent referral and who needed oral antibiotics were prescribed them. More than two-thirds (67%) were given a recommended antibiotic and less than a third (32%) were prescribed antibiotics correctly (Table A17). No child seen by untrained provider was prescribed antibiotics correctly (P<0.05) (Fig. 12; Table A40). For the antibiotic to be prescribed correctly, the provider had to state the dose, frequency and duration of treatment clearly in the prescription. The main reason for an incomplete or incorrect prescription was prescribing an incorrect amount of the drug and, next, providing no or incorrect information about the duration of treatment. On the other hand, as many as 37% of children not needing antibiotics were prescribed antibiotics unnecessarily, mostly because these cases had been misclassified by the provider as conditions (mostly pneumonia) that would have required antibiotics had their classification been correct. Children seen by trained providers were given antibiotics unnecessarily much less often than those seen by untrained providers (P<0.001) (Table A40). ¾ Non-severe pneumonia (Table A17): most (80%) of these cases were prescribed an oral antibiotic, 72% were given a recommended oral antibiotic. All children that the provider had correctly classified as having ‘pneumonia’ were prescribed an oral antibiotic – 90% were given a recommended one. On the other hand, all the 11 children with ‘pneumonia’ who were not prescribed an antibiotic had been misclassified by the provider as ‘no pneumonia’ cases. None of the nine children with pneumonia seen by untrained providers was prescribed an antibiotic correctly (Table A40). ¾ Dysentery (Table A17): only four (50%) of the eight cases with ‘dysentery’ were prescribed an oral antibiotic and three were prescribed a recommended antibiotic correctly. It should be noted that three of the four cases who were not prescribed an oral antibiotic had not been classified as dysentery cases by the provider. ™ Advice and caretaker recall: Caretakers of children to whom an oral antibiotic is prescribed should be: a) given advice on how much, how many times per day and for how many days they should give the antibiotic to the child; b) shown how to give it to the child; and c) asked open-ended questions to check for their understanding of the instructions received. It can be assumed that if caretakers are given incorrect or no advice on treatment or are unclear about it, they may be less likely to administer it correctly to the child at home. The third task above (c) is therefore a key task, as oral antibiotic treatment is delegated to families: checking for caretaker comprehension of the instructions given is the only way to ascertain whether the caretaker has clearly understood all the instructions and to clarify any doubt before she leaves the facility. In this survey, about two caretakers in three (64%) were advised on drug treatment40 (item a) above), 17% were shown how to give it (b), and only about one in five (19%) was asked checking questions (c) (Table A24). As few as 15% of children were given the first dose of the antibiotic at the facility. Providing the first dose of the antibiotic is important also because it may increase the chance that the caretaker will take the

39 40

See footnote (38). This means that these caretakers were given some advice, whether correct or not. This item was included to know whether providers would as a routine practice explain treatment to caretakers or simply write the prescription or dispense the drug with no verbal instructions. It should be noted that caretakers of 42% of the children enrolled in this survey were illiterate and unable to read providers’ prescription.

27

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 child back for follow-up as advised. In a previous study on compliance with follow-up advice, receiving treatment at the health facility during the first visit was in fact found to be strongly associated with a higher compliance41. As a result of the advice received, about one in five (22%) of the caretakers who had been prescribed an antibiotic for their child was able to describe correctly to the surveyor during exit interviews how to give the antibiotic to the child (Table A17). This means that 22% of caretakers correctly knew all the following three items before going home: a) the dose (44% recalled this individual message correctly), the frequency (56%), and the duration of treatment (44%). The lower level of knowledge about the dose and duration of treatment was consistent with providers’ tendency to overlook this advice. In fact, there was a direct relationship of provider’s advice on dose, frequency and duration of treatment with caretaker’s correct knowledge about treatment: caretakers correctly advised on these items were more likely to recall them correctly at exit interview than those not advised (P<0.01) (Table A18). Given the above findings, it can be expected that only a low proportion of children with conditions needing antibiotic treatment would be managed correctly in the home (15%). ™ Potential compliance with advice: Caretakers of children who had been prescribed an oral antibiotic for any reason by the provider were asked what they would do if the child got better before completing the treatment course advised by the provider. Almost two thirds of them (64%) replied that they would continue treatment as advised, while 22% stated that they would stop treatment (Fig. 6; Table A19). A higher proportion of the caretakers who said they would continue the medicine was in the group that was given correct instructions on antibiotic compared with the group advised incorrectly (P < 0.05). Thus, provider’s advice makes a difference and is an essential component of correct medical management. 5.2.3.4 Rational use of oral antimalarials ™ Prescription: About three children with malaria in four (74%) not requiring urgent referral were prescribed recommended antimalarials; all but one of the cases not prescribed an antimalarial by the provider had been misclassified as cases without malaria. However, only one in four (27%) malaria cases was eventually prescribed antimalarials correctly (Table A20). For the antimalarial to be prescribed correctly, the provider had to state the dose, frequency and duration of treatment clearly in the prescription. The main reason for an incomplete or incorrect prescription was prescribing an incorrect or no amount of the drug. This was in some cases due to an incorrect estimate of the dose based on a formula learnt at the medical assistant school that differed from the national malaria guidelines. A recent change in the national guidelines about the duration of treatment may also have accounted for errors in advising the duration of treatment. Once more, children seen by IMCItrained providers were prescribed oral antimalarials correctly more often than untrained providers (P<0.05) (Fig. 13; Table A41). Advice and caretaker recall: Similarly to those given antibiotics, caretakers of children to whom an oral antimalarial is prescribed should be: a) given advice on how much, how many times per day and for how many days they should give the antimalarial to the child; b) shown how to give it to the child; and c) asked open-ended questions to check for their understanding of the instructions received. As observed already for the antibiotics, oral antimalarial treatment is delegated to families; thus, checking for caretaker comprehension of the instructions becomes critical to ensure that the caretaker has clearly understood the instructions. Most caretakers (80%) were advised

™

41

See footnote (38)

28

Fig. 6. Caretaker potential compliance with provider advice on duration of treatment should child get better before completing treatment course

Fig. 7. Provider correct prescription and caretaker correct knowledge about oral antimalarial treatment (n=46)

v

Fig. 8. Provider correct advice on ORS and caretaker knowledge about ORS treatment (n=54)

Fig. 9. Provider advice and caretaker knowledge about home care

vi

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 on drug treatment42 (item a) above), 17% were shown how to give it (b), and only one in five (20%) was asked checking questions (c.) (Table A24). These results are very similar to those on antibiotic treatment, and the tasks were performed more often by IMCI-trained providers than untrained ones (Table A43). Only 4% of children was given the first dose of the antimalarial at the facility. As a result of the advice received, one in five caretakers (20%) who had been prescribed an antimalarial was able to describe correctly how to give it to the child (Table A20). This proportion is very low, considering that antimalarials (e.g., chloroquine) are drugs used very commonly by families, also on their own. So, caretakers correctly knew all the following three items when leaving the facility: the dose (28% recalled this individual message correctly), frequency of treatment (35%) and duration of treatment (35%). As noted for antibiotics, there was a direct relationship between provider’s advice on dose, frequency and duration of treatment and caretaker’s correct knowledge about treatment: caretakers correctly advised on these items were more likely to recall them correctly at exit interview than those not advised (P<0.01) (Fig. 7; Table A21). One may then expect knowledge level about antimalarial treatment to be very low or even lower at community level. None of the caretakers seen by untrained providers was able to describe how to give the antimalarials to the child correctly, compared to 24% of those seen by IMCI-trained providers (P<0.05) (Table A41). The findings on malaria management of this survey therefore show that, despite being common, malaria is often misdiagnosed, provider’s treatment instructions are often incomplete or incorrect and caretakers’ knowledge of antimalarial treatment is poor. In this scenario, the chances of a child with fever being managed properly at home are rather low. Also, providers’ common belief regarding ‘chloroquine resistance’ may often be a biased ‘perception’ deriving from incorrect diagnosis in the first place – since the true conditions of course would not respond to chloroquine – and wrong use of the drug by both providers and families. 5.2.3.5 Oral rehydration salts (ORS) ™ Prescription: Two of the nine diarrhoea cases with some dehydration were treated with ORS at the facility (Table A22); five of the seven who were not treated had been misclassified by the provider. About half (49%) of the 95 diarrhoea cases with no clinical signs of dehydration were given ORS to take home. This was only partly due to the fact that only 57% of these cases had been correctly classified as such: in fact, still less than two-thirds of these cases – correctly identified by the provider – were given ORS sachets to take home. Since ORS was available at the health facility for all of these cases except two, who were not given it, and all these cases except two were seen by IMCI-trained providers, it can be concluded that giving ORS for home use for children with diarrhoea and no dehydration is not a routine, standard practice. This finding is somehow surprising as it differs remarkably from the one of the CDD survey of 1997, in which 81% of children with diarrhoea and no dehydration were prescribed ORS43. However, data from IMCI follow-up visits had described the absence of functioning ORT corners as a problem with health facility support in many facilities. When ORS is prescribed, providers should state to caretakers how to prepare and administer it, since the solution will be prepared and used at home. Less than a third (31%) of the diarrhoea cases who were given ORS were correctly advised on ORS, especially because they were provided with no advice or incorrect advice on when and how much solution to give to the child each time. Furthermore, no child with diarrhoea seen by untrained providers was given any advice on ORS (Fig. 14; Table A42).

42 43

See footnote (40) FMOH/WHO: A CDD health facility survey, Sudan, October 1997.

29

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 ™ Advice and caretaker recall: As noted also for antibiotic and antimalarial treatment, caretakers of children with diarrhoea given ORS for home use should be advised on treatment (dose, frequency and duration), given a demonstration on or explained how to prepare ORS referring to containers commonly available at home, and checked for their understanding of the advice received. The caretakers of half of the diarrhoea cases (52%) given ORS were advised on the three items of ORS treatment and one in five (20%) was shown how to give it to the child and asked checking questions (Table A24).

When asked how they would prepare ORS, and when and how much solution they would give to the child, caretakers of less than a quarter (24%) of the cases with diarrhoea who were prescribed ORS were able to describe all the following items correctly: a) how much water to mix with an ORS sachet to prepare the solution (78% responded correctly on this item), b) when to give ORS to the child each day (30%), and how much ORS to give the child each time (50%) (Fig. 8; Table A22). Interestingly, while a direct relationship was noted of provider advice on ORS administration with caretaker correct knowledge about it, this was not the case for the information on ORS preparation (Table A23). In fact, while only 57% of children given ORS were correctly advised by the provider on how much water to mix with one sachet, a much higher proportion of the caretakers (80%) mentioned the correct amount, including therefore those who had not been told about it by the provider during this encounter at the facility. This finding was noted also in the CDD survey in 199744 and most likely reflects caretaker’s pre-existing knowledge, probably acquired through earlier, effective CDD promotion activities. It is obvious that this knowledge is incomplete and should continue to be sustained and reinforced by providers each time, rather than taken for granted, as otherwise it is bound to decrease over time. Caretakers of children advised by untrained providers tended to know how to use ORS at home less often than those advised by IMCItrained providers, although the number of cases was small and the difference was not statistically significant (Table A42). In conclusion, the chances of a child with diarrhoea receiving ORS and being given the solution correctly at home were rather low, i.e. one in seven (14%). 5.2.3.6 Other treatment and opportunities for immunization Data are shown in Table A24 ¾ Paracetamol for children with high fever and ear pain: 71% of children with high fever (i.e. an axillary temperature of 38.5ºC or above) and half (52%) of those with an acute ear infection were given paracetamol, as recommended by the national IMCI guidelines. Paracetamol was often given also to children with lower temperature values. Salbutamol for children with wheezing: Just three children of the 364 of the whole sample surveyed were found to have wheezing during the surveyor’s re-examination; only one of them was given salbutamol by the provider as the other two were misclassified. Interestingly, another five cases were prescribed salbutamol, although the provider had not reported wheezing. Cough medicines use in children with ARI: The majority of children was correctly prescribed no cough or cold medicines by the provider (only 14 did receive it), in line with the national guidelines. ‘Antidiarrhoeal’ use in children with diarrhoea: The use of these drugs has been strongly discouraged by the national CDD programme in Sudan in the past, because of their potential harmful effects, especially in infants. Only two children, both older than two years, were prescribed antidiarrhoeal (antispasmodic) drugs in this survey:

¾

¾ ¾

44

See footnote (43).

30

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 this should be seen as a very positive outcome, sustained over time. In fact, antispasmodic drugs were prescribed in five (4%) cases enrolled in the CDD survey in 1997, which covered facilities with high CDD training coverage45. Metronidazole use in children with diarrhoea: Metronidazole plays no role in the routine treatment of watery diarrhoea: 16 children were prescribed it, most of them having only diarrhoea. Also the CDD survey in 1997 found that this drug enjoyed some popularity among providers46. A household survey in 1995 reported a 19% rate of use of ‘anti-protozoal drugs’ (mostly metronidazole) in children below 5 years old with diarrhoea47. Iron for children with anaemia: Only 25% of children with clinical pallor was prescribed iron, as most (95%) of those who were not, had been misclassified by the provider. Vitamin A for children with measles, severe malnutrition, and as supplementation for children aged 6 months or older who had not received it in the previous 6 months: 17% of the 46 children who needed vitamin A were given it or advised to come back on another day to receive it. It may be noted that in all other cases but one who did not receive it, vitamin A was available at the facility. Tetracycline for children with eye infection48: About one child in four (24%) with an eye infection was given tetracycline ointment. For those who did not receive it, the eye infection had been missed by the provider in most cases (56%) but correctly identified in a few (20%). Thus, three-quarters of children with an eye infection were left untreated, because either the condition was missed or they were prescribed no treatment. This happened despite the fact that 72% of caretakers of these children with eye infection had spontaneously reported an ‘eye problem’ in their child among the complaints. It should be noted that routinely checking for eye infections is not listed specifically in the IMCI guidelines; in fact, there was no difference in identifying these cases between the providers trained in IMCI and those untrained. Given the common occurrence of eye infections in children in Sudan and the current weak treatment practices described in this survey, there is a strong argument in favour of including ‘eye infections’ among the ‘IMCI conditions’ to be assessed routinely in each child. Immunization: About half (49%) of all children needing vaccination left the facility with all needed vaccinations or advice to come back for vaccination on the scheduled vaccination day49.

¾

¾ ¾

¾

¾

5.2.3.7 Advice on follow-up The national IMCI guidelines recommend that children found to have some specific conditions should come back to the facility for definite follow-up within a certain number of days, which may vary according to the condition. In this survey, almost two-thirds (62%) of all children seen would have needed definite follow-up based on the guidelines (Table A26). This rate is very high and there is concern that it may not be practical and feasible to advise the caretakers of such a high proportion of children to return for follow-up and expect them to do so. Forty-three per cent (43%) of the cases that should have been advised to return to the facility for follow-up based on the IMCI guidelines were cases with feeding problems (e.g. changes in feeding practices during illness). In a previous study on adherence to provider’s follow-up advice in Gezira, a little more than half (57%) of caretakers complied and took their children back for follow-

45 46

See footnote (43). See footnote (43) 47 Mangiaterra V, An ARI, CDD and Breastfeeding household survey, Report of a mission, Sudan, 1996, Alexandria, WHO Regional Office for the Eastern Mediterranean, 1996. 48 Defined in this survey as ‘pus draining from the eye’ 49 Immunization services are not always provided on a daily basis.

31

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 up50. In that study, factors most strongly associated with compliance were: a) caretaker’s education (the higher, the more likely to return); b) caretaker’s place of residence (more likely to return if living in the same village in which the health facility was located); c) Receiving treatment at the health facility; and d) the number of days of follow-up (the fewer, the more likely to return). Changing feeding practices during illness is very common and it may be practical in this setting and at this stage to follow up only those children with feeding problems that are very low weight or anaemic. The shorter the interval of days the child should be taken back to the facility for follow-up, the higher was the agreement of provider’s advice on definite follow-up with surveyor’s: providers correctly advised follow-up in 37% of the children who needed to return in 2 days, in 20% of those needing to return in 5 days and in only one of the 11 children needing to come back in 2 weeks for follow-up (Table A26). Follow-up in 2 days was required for those cases given antibiotics, such as pneumonia, dysentery and acute ear infection cases. When caretakers were given the advice on follow-up, they recalled it well in most (70%) cases (Table A27). The study in Gezira indicated that caretakers who complied did so because they had been advised by the provider51. Once more, this underlines the importance of communicating properly to caretakers, as, when they are advised properly, they do listen carefully and recall the advice correctly. This increases the chances of their compliance with the advice received. 5.2.3.8 Provider advice and caretaker knowledge about home care Three basic messages on home care during illness–’home care rules’-should be given to the caretakers of all sick children: giving extra fluids, continuing feeding and knowing which signs to watch out for at home that would prompt immediate return to the health provider. In this survey, the caretakers of only 12% of children were advised by the provider on all three home care rules (Fig. 9; Table A28). Hardly any advice was given to caretakers by untrained providers (Fig. 15; Table A44). When the caretakers were interviewed before leaving the facility and asked about the three home care rules, only six of them (2%) mentioned all the three rules (Table A28). What was missed in most cases was the specific early danger signs that should prompt a caretaker to take the child back to the facility without delay. It is important to note that this was the caretaker knowledge level after provider advice. Some of the knowledge was however preexisting, as clearly indicated by a high percentage of caretakers (79%) responding that they would continue feeding the child during illness, when only about half of them had been given this advice by the provider in this particular encounter. In the end, a little less than half of the caretakers (45%) mentioned they would give extra fluids and continue feeding the sick child at home. It is important to emphasize that while this is knowledge, a gap between knowledge and practice should be expected. In fact, in a household survey in Sudan, carried out in three States in 1995, only 18% of children with diarrhoea were reported to have received both increased fluids and continued feeding during the diarrhoea episode, although caretaker knowledge about it was higher52. Although there are methodological issues related to the way a general question on knowledge about care-seeking is formulated in these surveys, caretakers tended to miss the key signs while mentioning others that are much more generic as ‘triggers’ to care-seeking (e.g. diarrhoea, vomiting, cough) (Table A29). For example, only a small proportion of caretakers of children with cough and no pneumonia mentioned respiratory signs as signs to watch out at home (i.e. 4% mentioned fast breathing and 18% difficult breathing). As seen also for other advice, caretakers who had been correctly advised by the provider on the signs to seek care, mentioned most of those signs significantly more often

50

Evaluation of family responses to recommendations of referral and follow-up under the strategy IMCI, Masalamia District, Gezira State, 2000, Preliminary report by Simon Cousens to WHO headquarters, Geneva. 51 See footnote (50). 52 See footnote (47)

32

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 than those who had not (P < 0.01) (Table A30). Yet, the level of caretaker knowledge about some of the signs remains very low and calls for more efforts in this area. 5.2.3.9 Provider communication skills Giving correct advice to caretakers of sick children is certainly important, as shown in the above sections: it is the caretakers who will be caring for children at home and even treating them with drugs. Delivering child care messages using good communications techniques gives this action more chances to be effective. In this survey, attention was paid to the use of the ‘home care card’, which is a standardized IMCI home care counselling card with illustrated messages meant for providers’ use when advising caretakers of sick children53. The card was used in about a third (34%) of children that were not referred – it was not available in 23% of cases – and it was used properly with good communication techniques in just a 5% of cases (Table A31). In fact, in only 12% of cases was the card held properly – in such a way that the caretaker could see the pictures and text, were the pictures pointed to while referring to the related messages and was caretaker’s understanding of the messages given checked. Caretakers of children seen by IMCI-trained providers were more likely to be counselled using these techniques (P<0.01), but the rate remained low also in this group. Also the study in Gezira had found that provider performance in counselling was much weaker than clinical performance54. Thus, more practical emphasis should be given in training courses and followup visits, not only to advising caretakers, but also to using effective communication techniques, which currently seem to be rather deficient. 5.2.3.10 Age-appropriate advice on feeding The caretakers of only 24% of children below 2 years old and those with very low weight and/or anaemia were given appropriate advice on feeding according to the age of the child, including breastfeeding and frequency of complementary feeding (for the definition of appropriate feeding, please refer to the footnote at the bottom of Table A32). The group of children in which the feeding advice was more often inadequate was that of children 2 years old or older with very low weight and/or anaemia. Feeding advice therefore appeared largely inadequate. 5.2.3.11 Use of mosquito bednets and chloroquine at home About half (52%) of caretakers reported having a mosquito bednet at home and about one in five (21%) having a bednet impregnated with insecticide (Table A33). Bednets are an effective means of protection against malaria if they are used regularly. In this particular sample of sick children taken to a health facility, 20% of children were reported to have slept under a bednet and 10% under a treated bednet the night before, with no difference between the group with fever and without fever. All areas included in the survey were low risk malaria areas, and March and April were not considered malaria peak months. Caretakers with higher education level tended to be more likely to use bednets and bednets treated with insecticide, and their children to sleep under them, but the difference was not statistically significant. Caretakers of 6% of children with fever or history of fever reported having given chloroquine to their child during this fever episode before coming to this facility.

53 54

Also commonly known as ‘mother card’ See footnote (50)

33

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 5.2.3.12 Advice on mother’s health Only two of all the caretaker-mothers of children not needing urgent referral received some advice on their health55. The IMCI guidelines recommend that health providers should counsel the mother of the sick child about her own health. The low rate of counselling on mother’s health was expected, as training courses in Sudan, as in other countries in the Region, have to date focused on child health. This is a missed opportunity, as mothers represented 83% of all caretakers in this survey. For children seen at health facilities having mild conditions, IMCI would help build a bridge between child and mother health by reminding health providers that the child’s mother, and not only the child, is also there. 5.3 HEALTH SYSTEMS

The survey reviewed some key aspects of health systems support that are required for the provision of quality services and affect their utilization, namely: caretaker satisfaction with the services provided; organization of work at the facility; provider’s IMCI training status; reliability of malaria laboratory examinations; availability of essential drugs, basic supply and equipment – including immunization, and transportation facilities for referred cases; cost of care; supervision of providers; and records. The main findings are summarized in Table 7. When looking at the results and drawing conclusions, it should be noted that the survey excluded from the sample facilities with small case load, i.e. those with an average of less than two cases below 5 years old per day, i.e. about half (46%) of all facilities covered by the IMCI strategy in the country (§ 3.2). 5.3.1 Caretaker satisfaction

Most (88%) of the caretakers interviewed reported being satisfied or very satisfied with the health services provided at the facility (Table A34). The aspects of care that were most appreciated by the caretakers included the treatment that had been given (35%), the fact that their child had been examined by the provider (26%), and provider’s good attitude (8%). It should be noted that these aspects of care that were perceived by the caretakers as an indication of good services are an integral part of the IMCI approach. According to the IMCI protocol, all children are to be examined thoroughly, treatment is standardized, with the first dose to be administered at the facility whenever possible, and counselling is a prominent feature of the clinical process. Thus, indirectly, the findings suggest that the use of the IMCI case management protocols and approach, including counselling, should help make services more attractive to the clients and contribute to improving their reputation. However, for those who expressed lack of satisfaction for the services received, the main reasons were again the treatment given or not given (e.g. unavailability of drugs), and the cost of services. 5.3.2 Organization of work

The task that was most often redistributed among health providers at the facilities visited was taking the child’s weight: while in half (51%) of the children it was taken by the provider examining the child, in as many as 40% of cases this was done by the nutrition educator, especially at health centres. At dispensary level, one child in five (22%) was weighed by the nurse. When the weight was taken by a person different from the medical assistant at non-hospital facilities, it was then likely to be checked against the growth chart by the same person who had taken it or by the medical assistant. The situation with regard to taking the 55

Any of the following: counselling on how to care for herself if sick or if she has a breast problem; advising to eat well; checking her tetanus toxoid immunization status; and ensuring access to reproductive health services and counselling for STD and AIDS prevention.

34

Table 7. Main findings on health system support Health system component x x x x x x x x x Caretakers satisfied with the child health care services Non-hospital facilities with at least 60% of doctors managing children trained in IMCI Index of availability of essential oral treatments Index of availability of 12 non-injectable drugs Index of availability of injectable drugs for pre-referral treatment Facilities providing immunisation services with vaccination supply and equipment available at time of the visit Facilities with basic supplies and materials for IMCI available Facilities with minimum malaria laboratory supply and equipment Facilities that received at least one supervisory visit in the last six months that included observation of case management

Findings 87.8% 57.6% 5.0 out of 6 drugs 8.7 out of 12 drugs 2.6 out of 4 drugs 35.8% 31.8% 62.1% 10.6%

Fig. 10. Integrated assessment by provider IMCI training status: main tasks and WHO index trained vs untrained

vii

Fig. 11. Performance of selected assessment tasks by provider IMCI training status: ARI and diarrhoea trained vs untrained

Fig. 12. Prescription of recommended oral antibiotic treatment by provider IMCI training status trained vs untrained

viii

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 temperature was different: temperature was taken directly by the person examining the child in 91% of cases – most often incorrectly. At dispensary level, the temperature was taken by the nurse in 26% of cases. Thus, the data suggest that, while taking the child’s weight (a task done in immunization sessions) was a task not rarely carried out by a person different from the one examining the child, the load of all the other tasks usually fell on just one person, even at facilities where other staff, e.g. nutrition educator, vaccinator, were available. Also, the nurses trained in IMCI assisted in some other tasks at dispensaries and dressing stations, such as assessing feeding practices and advising on feeding. There is therefore good evidence that selected tasks at health facilities could be re-distributed among available health personnel, in order to facilitate the delivery of the whole scope of IMCI while reducing the load on the one person. 5.3.3 IMCI training

5.3.3.1 IMCI training coverage Forty percent (40%) of all providers managing children in the facilities visited had received IMCI training. The training coverage for all clinical staff managing sick children was highest at dispensary level (100% of all providers had been trained in IMCI), decreasing to 47% at health centres and 8% at hospitals. Overall, almost two-thirds (62%) of non-hospital primary care facilities had at least 60% of providers managing children trained in IMCI and more than half (51%) had all providers trained. This by itself is a good achievement, considering how demanding it is to increase and maintain in-service training coverage. Worth mentioning is the high proportion of facilities (82%) with at least 60% of providers trained found in Gezira (compared with 33% in Khartoum). Half of the facilities in the sample, i.e. 34 of them, were staffed with one provider to manage children: in all but three of them the provider had been trained in IMCI. Thus, all sick children taken to these 31 facilities were going to be seen by an IMCI-trained provider. The findings related to cases managed by IMCI-trained providers showed that the large majority of providers had been trained in the past 2 years, reflecting the efforts to expand the coverage after the early implementation phase (Table A35). In fact, almost twothirds (64%) of children were managed by providers who had received IMCI training in the previous 12 months or so. All children but one (99%) seen in Gezira were examined by an IMCI-trained provider, as compared with 52% of those seen in Khartoum. Although the sample was not stratified by state, the data on IMCI training coverage – presented here – and provider’s clinical performance by state would suggest that there might be substantial differences between states. Although reported as a problem and partly suggested by these figures, turnover of staff trained in IMCI was not measured directly in this survey. Information on follow-up after IMCI training has been described earlier (see § 5.1.1). 5.3.3.2 Quality of child care by provider training status When the data on the quality of case management were disaggregated by the provider training status, the results showed that key case management tasks were much more likely to be performed, and performed correctly, by the IMCI-trained providers than the untrained ones, despite the fact that IMCI-trained providers happened to see more complex cases. In many cases the difference reached high statistical significance (even at P < 0.0001). Although caution should be exercised in interpreting the data as the survey was not stratified by provider training status, the data describe a pattern of rather poor clinical performance by untrained providers: this is a cause for great concern and raises the issue of the level of pre-service training and in-service supervision. Also, although the performance of tasks by IMCI-trained providers was consistently and often significantly better than the performance of untrained ones, there was still much room for improvement for many case management tasks to reach a desirable level of quality. Furthermore, the findings raise the issue about 35

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 institutionalization of standard procedures: as the aim of the IMCI strategy is to improve care in facilities in which it is introduced and implemented, similar standards of care should in principle remain also after IMCI-trained staff leave. The IMCI strategy is in fact meant to go well beyond the training undertaking. Some of the findings by training are shown in Fig. 10 to Fig. 15, while more details are provided in Tables A36-A46. ™ Assessment (Table A36-A38): the index of integrated assessment, that is, the average number of key assessment tasks performed on a child, was almost twice as high for children seen by IMCI-trained providers as for those seen by untrained providers (P<0.0001) (Fig. 10). Assessment tasks that were carried out almost exclusively by IMCI-trained providers included checking for: the three general danger signs, child’s temperature, history of recent measles in cases with fever, palmar pallor, visible wasting, oedema of both feet and feeding practices. Children with diarrhoea were more likely to be assessed properly by IMCI-trained providers than untrained providers (P<0.001) (Fig. 11). Treatment (Table A40): Children needing antibiotics were more likely to be prescribed the drugs correctly if they were seen by IMCI-trained providers (P<0.05) (Fig. 12). Also, antibiotics were used more rationally by IMCI-trained providers than untrained staff: about three-quarters (74%) of the children seen by untrained providers and not needing antibiotics received them unnecessarily compared with a quarter (26%) of children seen by IMCI-trained providers (P<0.001). None of the caretakers of children with diarrhoea given ORS by untrained providers received any instructions on its preparation and administration (Fig. 14). Advice on home care (Table A44): Caretakers of children seen by IMCI-trained providers were much more likely to be advised on home care than those seen by untrained ones who often received no advice at all (P<0.001), even on key messages originally promoted by of the CDD and ARI programmes (Fig. 15). Much work then needs to be undertaken in the area of pre-service training. Availability and reliability of malaria laboratory

™

™

5.3.4

The second and most recent version of the Sudan IMCI guidelines recommends that the clinical malaria diagnosis be confirmed by laboratory test, namely microscopy, in facilities provided with a laboratory for this purpose. Functional microscopes were found in all hospitals but one (83%), most (83%) of the health centres, and one of the 11 dispensaries visited; except for 5 health centres, these facilities also had minimum supplies for the malaria laboratory, including equipment and reagents (Table A49). Because of the wide availability of malaria laboratory facilities in this survey sample, children with fever or history of fever were automatically referred by the provider to the laboratory for microscopic examination of the blood smear; the provider then relied on the laboratory results for the malaria diagnosis. Microscopy is sensitive, informative (description of species and stages of the malaria parasite), relatively inexpensive, but also time-consuming and strongly dependent on welltrained and well-supervised technicians. To assess the reliability of the malaria laboratory results, a sample of 111 blood smears among those performed by health facilities’ laboratory technicians on children with fever or history of fever during the survey were taken to Khartoum by the survey teams to be re-examined independently at the end of the survey by two skilled staff of the National Malaria Administration, who were kept blind to the results of the field. When the findings of the re-examination (‘gold standard’) were compared with the results in the field, the field microscopic malaria diagnosis had a sensitivity of 0%, specificity of 74%, and a positive predictive value of 0%, with an accuracy of 73%. In simple words, none of the positive blood slides was confirmed to be positive for malaria parasites, and one

36

Fig. 13. Prescription of oral antimalarial treatment by provider IMCI training status trained vs untrained

Fig. 14. Advice on ORS treatment by provider IMCI training status trained vs untrained

ix

Fig. 15. Advice on home care by provider IMCI training status trained vs untrained

Fig. 16. Index of drug availability (n=66 facilities)

x

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 of the negative slides was found to be positive56. Low quality of laboratory services and diagnosis, and high false positive rates for some areas were also described in ‘The national strategic plan for Roll-Back Malaria (RBM)–2001-2010, Sudan’. As most of the results in the field contained no information on the Plasmodium species and stage, this information is omitted here. The implications were that many children without malaria were treated as malaria cases unnecessarily, mostly with chloroquine. Furthermore, should fever persist for more than a few days (as may be the case in ARI episodes), then providers would be likely to believe that chloroquine resistance was the reason for the lack of response. It was also observed that the microscopic examination was often carried out in a short time, further reducing its reliability in case of a negative reading. Adequate time should in fact be spent on each smear before excluding the presence of malaria parasites. Fortunately, this was not the malaria peak season, when more cases may have malaria and the implications of the unreliability of the microscopic diagnosis in the field would be expected to be much higher. In these circumstances, microscopic diagnosis loses much of its value and becomes rather unreliable, unless intensive initiatives are pursued to ensure high-quality training and follow-up, and close quality supervision of laboratory technicians and assistants. 5.3.5 Availability of drugs

Three measures – indexes57 – to assess the availability at health facilities of drugs required to manage cases according to the national IMCI clinical guidelines (Fig. 16; Table A47) were used, namely the indexes of availability of: ¾ Essential oral treatments, that is oral drugs recommended for home treatment of pneumonia, malaria, dysentery, diarrhoea, fever and anaemia (i.e. cotrimoxazole, chloroquine, ORS, vitamin A, iron and paracetamol). The index was 5.0, that is a mean of 5.0 drugs available out of 6 drugs. ¾ 12 non-injectable drugs, including the six above and another six drugs for the treatment of pneumonia, dysentery and malaria cases not responding to first-line treatment (amoxycillin, sulfadoxine-pyrimethamine and nalidixic acid, respectively), eye infections (tetracycline ointment), skin infections (gentian violet), and convulsions (diazepam). The index level was low, a mean of 8.6 out of 12 drugs. ¾ Injectable drugs for one-dose pre-referral treatment for children with severe classifications needing urgent referral, namely chloramphenicol, quinine, benzylpenicillin and gentamicin. The index was 2.6 out of 4 drugs. Salbutamol solution or metered dose inhaler was available in just one in ten (12%) facilities (Table A48). This is not surprising as only 10 (15%) facilities had a working nebulizer. An acceptable solution for intravenous rehydration of children with diarrhoea and severe dehydration was available in 73% of facilities; Ringer’s lactate solution was found in only one of the five hospitals visited. The definition of drug availability used in this and similar surveys required only the presence of just one full course of treatment for each of the drugs per facility (Annex 18). Thus, non-availability of a drug meant total lack of any dose of that drug. An attempt was made in this survey to relate stocks of drugs for pneumonia (cotromixazole or amoxycillin) and malaria (chloroquine or sulfadoxine-pyrimethamine) to caseload, to estimate very approximately for how long the stock might last. As data on caseload were rather unreliable, There was no agreement on one additional negative slide, confirmed as negative by one re-examiner but reported as positive by the second re-examiner. The ‘false positives’ of field laboratories represented 26.1% of all their readings, i.e. about one in four tests. 57 As observed for the index on integrated assessment, each index of drug availability represents the mean of the total number of drugs considered in each category. 56

37

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 this analysis is not presented here. The data, however, would suggest that drug stocks were unlikely to be based on actual needs, resulting in facilities either under- or over-supplied. Problems in regular supply of drugs were described in this survey and reported not rarely also in the IMCI follow-up visits. In a number of facilities, providers themselves procured the drugs they needed, in some cases on a daily basis, to sell them on in turn to the patients, according to their own prescription pattern. This practice, while ensuring to a certain extent some availability of certain drugs based on the provider’s own initiative, is likely to act as an incentive to prescribing drugs, as it tends to become a source of income. This also partly explains why drugs such as cotrimoxazole, chloroquine, paracetamol and benzylpenicillin – commonly prescribed by providers – were found more often than for example iron, tetracycline eye ointment and salbutamol, which were more rarely used (Table A48). 5.3.6 Availability of supplies and equipment for vaccination

The data related to availability of supply and equipment for immunization should be interpreted with caution, as some facilities are not supposed to provide such services in Sudan. The communities served by those facilities may be covered by other levels of the heath system through out-reach immunization services that bypass the facility itself. Also, vaccines and syringes may only be taken to a facility on the day of the immunization session and may then not be found on other days, including when the survey team may have visited the facility. In this survey, 53 (80%) of the 66 facilities surveyed reported providing immunization services. Of these, 36% had cold chain equipment and supplies for vaccination (Table A50). All facilities but one (22) which were supplied with a refrigerator had a functioning thermometer inside; in 18 of the 23 refrigerators the temperature was kept within the range of 2ºC to 8ºC as recommended by the national EPI. For the reasons given above, information on the availability of vaccines on the day of the visit was not collected, as it might have been misleading. A total of 47 (89%) of the 53 facilities providing immunization services held weekly sessions for all or some of the antigens; 16 (30%) facilities held sessions less frequently – but within a month – for all the antigens or for those which they were not able to administer within the weekly sessions (Table A51). All in all, 37 (70%) of the 53 facilities reported providing all antigens (measles, BCG, DPT, and OPV) during weekly sessions and another 13 facilities (24%) being able to provide all of them within each month (Table A52). The only antigen that was not available within a month in the remaining three facilities was BCG. 5.3.7 Availability of other basic supplies and equipment for IMCI

Only about a third (32%) of the facilities visited were provided with the basic supply and equipment needed for IMCI, including adult and baby scales, timing devices to count the respiratory rate, supplies to mix ORS, and tap water (Table A49). Adult scales needed to weigh older children were the items less often available among them, making it difficult to identify older children with very low-weight-for-age. Basic equipment and supplies for a malaria laboratory were available in 62% of facilities (§ 5.3.4). IMCI cards to counsel caretakers on home care and IMCI chart booklets were found in three-quarters (77%) of cases, although the ‘home care cards’ were used infrequently (§ 5.2.3.9). Lack of these cards was also reported in IMCI follow-up visits in a number of states. Supplies such as thermometers, road-to-health cards and recording forms were available in more than threequarters of cases. Nebulizers in working condition were found in only 10 (15%) facilities (§ 5.3.5).

38

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 5.3.8 Availability of transportation for referred cases

People living in the catchment area of 85% of the facilities visited were reported by facility staff to have access both physically (e.g. distance) and economically to a means of transportation to transfer referred cases to a higher-level facility. For most (79%) facilities, it was estimated that the referral hospital could be reached within 30 minutes – usually 15 minutes, with only 3 facilities reporting time longer than an hour (Table A53). It should be noted that: the implementation of the IMCI strategy is often started in areas with accessible services, almost two-thirds (62%) of facilities were located in urban areas, and many (61%) of the facilities covered by this survey were located in Khartoum and Gezira states. Despite this, various problems related to referral were reported in almost a third (32%) of facilities, the proportion being higher in rural than urban areas, although the difference was not statistically significant. Some of the problems concerned the inability of patients to afford expenses related to referral and hospitalization and not just to transportation. It is these cases which are often more vulnerable. Access to referral facilities for severe cases appeared therefore constrained for a proportion of patients. It was not within the scope of this survey to assess how functional the referral system was, as this would have required a different survey design. 5.3.9 Health expenditure

An attempt was made in the survey to obtain – very approximately – some of the direct health care costs borne by families. The figures so obtained should be considered very indicative and interpreted with some caution. ¾ Transportation: Caretakers of more than two-thirds (69%) of children seen lived near the health facility, as documented by their reporting no transportation expenses to reach the facility. For the remainder who needed transportation, the average (mean) cost was SDP 105758, with a maximum of SDP 800058. People in rural areas were likely to pay more to reach the facility than those in urban areas (P<0.01), i.e. about twice as much (a mean of SDP 920 in urban areas vs SDP 1765 in rural areas). Total health expenditure at the facility: At the health facility, the health expenses that were considered included fees for laboratory investigations and consultation, and drug costs. A fifth (22%) of caretakers had no expenses: their children were prescribed no laboratory tests and no drugs. For those who paid, the average cost was SDP 5028, with a maximum of SDP 17 500. It should be taken into account that some laboratory investigations are requested often, such as the microscopic examination of blood smears for malaria in children with fever or history of fever, a symptom present in 57% of children in this survey, which was not conducted during a malaria peak season. Expenses per child were higher at hospital level (average SDP 6440), than health centre (SDP 3976) and dispensary (SDP 2311), although a higher proportion of complex cases was seen at dispensaries than higher-level facilities in this sample (§ 5.1.2). Drug expenses: Given the high rate of prescribing, especially by untrained providers, 73% of caretakers reported that they had spent on drugs an average of SDP 3 942 (up to SDP 16 000 in two cases)59. However, it should be considered that patients covered by insurance would be charged only 25% of the drug cost: 16% of children seen in this survey were covered by health insurance. The amount spent on drugs by caretakers for their sick children represented 73% of the total amount they spent at

¾

¾

Although the official currency in Sudan is the ‘Sudanese Dinar’ (SDD), people still express most prices in ‘pounds’, here abbreviated as SDP. One dinar corresponds to 10 pounds. One US dollar corresponded approximately to SDP 2605 at the time of the survey. So, SDP 8000 = about US$ 3.1. 59 Ample differences may exist between locally produced and imported drugs.

58

39

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 the facility for health-related items (see previous item); drugs were the only expense for 121 cases. The issue of health care cost plays an important role in access to care, as poorer families–who are those most in need for care–may be unable to afford services when they need them most. The study in Gezira confirmed that the single most commonly cited reason why caretakers of referred children had not complied with the referral advice was lack of money60. 5.3.10 Availability of child health services All facilities but two (97%) were reported to provide services, including child health services, at least 6 days a week (Table A54). 5.3.11 Supervision Half (50%) of the facilities visited reported having received at least one supervisory visit for whatever purpose in the past 6 months; urban facilities were more than twice as likely to be supervised as rural facilities (P<0.05). About a quarter (26%) had a supervisory book available, broadly defined as any book – even a multi-purpose register – in which supervisory visits would be recorded (Table A54). Observation of case management was performed as a supervisory task in a fifth (21%) of the last supervisory visits conducted in the past six months. Supervision appeared therefore usually inadequate to support clinical achievements made with IMCI training and follow-up visits. It should be noted that the CDD survey in 1997 had already reported that health providers who were properly supervised performed better61. Findings and recommendations made during the last visit were recorded on a supervisory book in 30% of the facilities in which the visit had been carried out, although a supervisory book was available in a higher proportion of facilities. Thus, recording findings and recommendations for effective follow-up was not a standard practice. Combining all findings together, only one facility had eventually received clinical supervision with findings and recommendations recorded on a supervisory book. These data confirmed that quality supervision was an activity given low priority, conducted unevenly among facilities, and unstructured. 5.3.12 Records An attempt was made to collect some additional information on patterns of cases by reviewing routine outpatient records for the month of January 2003 at the facilities visited. Most (82%) of the health facilities visited had a logbook where the outpatients’ diagnoses were to be recorded. Unfortunately, the records were often unreliable or some information was not available. For example, no information was available on outpatients in 36% of the facilities. Lack of or incomplete records were also reported not rarely in the IMCI follow-up visits. There was underreporting of children under 5 years in many facilities, especially if the insurance system was being implemented: less than 20% of all OPD consultations were recorded as visits for children under 5 years in as many as 75% of the facilities that had records on insured patients vs 28% of the facilities without records on insured patients. Also, the proportion of under-five OPD visits in the ‘insured’ and ‘uninsured’ groups varied remarkably from each other in 62% of facilities in which data were available for both. An attempt to compare caseload data from records with those estimated by providers often yielded unreliable information and discordant data. It is unclear how these data can be used 60 61

See footnote (50) See footnote (43)

40

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 effectively for estimating drug needs and planning purposes in general. The situation of recording and unreliable data therefore adversely affects the quality of planning and services that should rely on such data. 5.4 CONTEXT TO INTERPRET FINDINGS: THE PRE-INTERVENTION SURVEY Interpretation of the findings of this survey should take into consideration: a) the high quality standards set by the IMCI strategy on outcome indicators for outpatient child health services; and b) the basic level of performance of these services in facilities in which IMCI has not yet been introduced. The latter would enable understanding of whether there has been some progress, even when the optimal standards have not been reached. As no comparable health facility baseline data were available for IMCI before implementation, a ‘Pre-intervention survey in health facilities not implementing IMCI’ was carried out by the PHC Department of FMOH in February 2003 in 66 facilities, mostly health centres, located in five of the seven states already selected for the IMCI survey and in which no staff had ever been trained in IMCI. These facilities therefore were not included in the IMCI survey sampling frame. Most of the staff surveyed (79%) were medical assistants: although not trained in IMCI, three-quarters of them (73%) had received training in ARI and almost two-thirds (62%) in CDD. Although the sample was smaller than the IMCI survey and the limits of precision should therefore be expected to be wider than this survey, the results on clinical management describe a rather low level of performance for many of the tasks reviewed, much lower than that observed in the IMCI survey. For example, only 3% of children had their weight correctly checked against the growth chart (vs 53% in the IMCI survey), 12% had their immunization status checked (vs 60% in IMCI), and 3% were checked for danger signs to help identify severe cases (vs 21% in IMCI). Thirteen per cent (13%) of caretakers of children with diarrhoea were advised on ORS (vs about three times as many in IMCI), 8% were advised on fluids and feeding during illness (vs 32% in IMCI) and 1% on all the three home care rules (vs 12% in IMCI). Expectedly, only 3% of caretakers knew when they should take their child back without delay (vs 33% in IMCI), while only 12% of caretakers of children with diarrhoea knew how much ORS to administer to the child each time (vs 26% in IMCI). Furthermore, 13% of those needing vaccination were given the needed vaccinations or advised where to go or when to return for vaccination (vs 49% in IMCI); one case (5% of all) needing vitamin A was given it or advised on it (vs 17% in IMCI). Drugs also tended to be less available than in the IMCI facility survey, for example: ORS (found in 71% in the pre-intervention survey vs 92% in the IMCI survey), salbutamol syrup (42% vs 68%), IM chloramphenicol (29% vs 50%), diazepam (61% vs 82%), gentian violet (36% vs 50%), vitamin A (61% vs 71%), iron syrup (47% vs 56%), benzylpenicillin (85% vs 92%), cotrimoxazole (91% vs 97%). Very similar rates of availability were found for antimalarial drugs. On the other hand, data from IMCI follow-up visits show patterns that differ substantially between states. For example, quinine for parenteral use was available in 25% of facilities followed up after IMCI training in Khartoum, vs 54% in River Nile, 74% in Gezira, etc.; wide variations also concerned availability of gentamicin, chloramphenicol, vitamin A, diazepam etc. These differences may reflect differences existing between facilities according to the various approaches followed to avail of the needed drugs. A full report on the pre-intervention survey with more details is available from FMOH. Even if caution must be exercised when comparing data from the two surveys, the pre-intervention data seem to indicate that in facilities where the IMCI strategy has been 41

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 introduced child health services tend to perform better than in ‘non-IMCI facilities’, even in those with staff trained in ARI or CDD. 5.5 LIMITATIONS OF THIS SURVEY

In any study, it is very important to identify and describe its limitations and take into account the original objectives, so that the findings can be interpreted and used properly. No study is exempt from limitations. Below are the main limitations found for this survey. ™ Sampling frame: the caseload criterion of at least 2 cases less than 5 years old used to include health facilities in the sampling frame led to the exclusion of 46% of all facilities initially listed among those in which the IMCI strategy had been introduced. Within the time and financial resources allocated, however, this was unavoidable. As there were more facilities in rural areas with very low caseload than urban areas, ultimately the sampling frame had a higher representation of urban facilities. Surveyors and supervisors: the criteria for selection of surveyors and supervisors included previous training in IMCI and facilitation skills, and involvement in IMCI follow-up visits after training. This enabled the selection of staff who were very familiar with IMCI and supervisors who needed to be trained only in the survey procedures. The limitation of this choice is in that people fully involved in IMCI may in principle be unintentionally more biased than people not involved in it. However, it would have been almost impossible to conduct a survey of this type – requiring excellent familiarity with the IMCI clinical guidelines as a prerequisite for surveyors – using staff not trained in IMCI. To reduce the effects of this bias, attention was placed on the supervision of survey activities and interpretation of data. Generalization of results: for any survey, it must be very clear to which population the results apply, to avoid inappropriate generalizations for which the data would be unsuitable. The results of this survey apply to the whole sample, consisting of the total of all facilities in all districts covered by the survey and meeting the enrolment caseload criteria. The sample was not stratified by state, district or type of facility, to limit it to a manageable size. Based on the objectives of this survey, the results refer only to the quality of care provided to children aged 2 months up to 5 years old in facilities where the IMCI strategy had been introduced and with an estimated daily caseload of two or more cases. The results therefore describe the quality of care that a sick child would be likely to receive in an IMCI facility in general, whether or not the child was seen by an IMCI-trained provider, and they do not apply to facilities with a small caseload. A quick look at the data on performance of clinical indicators by state, suggested that there might exist a substantial difference in performance between states. However, as the sample was not stratified by state, the data breakdown by state is not presented in this report. In fact, there were considerable differences in the proportion of children seen by IMCI-trained providers by state (§ 5.3.3.1), and the findings have shown that training favourably affected quality of care. Furthermore, the different distribution by state of the number of ‘clusters’ (health facilities) and number of cases, complex cases (red and yellow row classifications), and cases seen by doctors and medical assistants, at hospital or health centre or dispensary, at rural and urban facilities, at facilities that had received clinical supervision, etc. did not warrant this type of analysis, more so in the limited time available. Availability of drugs: the presence of just one course of treatment was sufficient to meet the definition of drug availability in this survey. Attempts to relate drug stocks to caseload failed, due to incomplete or unreliable records in many facilities. Staff turnover: 7 (11%) of the 66 facilities visited no longer had any staff trained in IMCI (including two hospitals and five health centres) and in another three facilities 42

™

™

™ ™

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 (all health centres) IMCI-trained staff were not present at the time of the visit. Thus, no IMCI-trained staff were available in 15% of facilities. This information indirectly underlines the importance of the problem of staff turnover, whether temporary or permanent, and its implications for an in-service training strategy in the long term. 6. CONCLUSIONS AND RECOMMENDATIONS This survey has provided useful information on outcome indicators related to the quality of health care delivered to children below 5 years old at public health facilities. These data will help to monitor progress towards the achievement of the child health-related Millennium Development Goals to which the country has committed. The results relative to indicators for clinical and communication skills clearly show a better performance for many of the tasks assessed of health providers trained in IMCI than those who have not been trained, including assessment, treatment and advising skills. They provide evidence that IMCI training can improve quality of outpatient child care. The overall level of performance for both trained and untrained health providers is however sub-optimal and calls for the strengthening of the planning approach to training, as outlined below. According to the selection criteria of this survey, all the facilities surveyed had introduced the IMCI strategy. The clear differences observed in the skills between staff trained in IMCI and those not trained in IMCI in these facilities, therefore, on the one hand, underline the challenges of institutionalizing changes in the quality of care at health facilities where the IMCI strategy has been introduced and, on the other hand, draw attention to the urgent need to improve preservice training in general. While substantial efforts have been made to date to upgrade health providers’ skills through IMCI in-service training, the survey suggests that much work needs to be undertaken to improve the health system component of the IMCI strategy in Sudan. Strengthening of this component, which is vital for successful implementation of an ‘IMCI strategy’ and would complement current IMCI efforts (mostly training), requires strong coordination with the various parties involved. The analysis of the results of the survey also identifies some clinical and communication skills and tasks that require further emphasis in future training, follow-up visits after training and supervision (see Annex 1). It also supports arguments in favour of reviewing some aspects of the current IMCI guidelines, to consider including eye infections, and revising recommendations on feeding and indications for definite follow-up, which currently include a large proportion of the children seen. The analysis finally suggests that it would be beneficial to establish better links between IMCI and mother care. The recommendations presented in this section should serve as the basis to develop a strategic plan for IMCI implementation in the future, in close collaboration with all the main actors involved in child health and, especially, IMCI. 6.1 ACCESS TO DRUGS AND SERVICES: PROVIDING EQUITABLE ACCESS TO CARE TO THE MOST VULNERABLE GROUP

Facts and rationale: None of the severe cases that required urgent referral received proper prereferral treatment, even in facilities where the recommended drugs were available. One of the possible explanations given was that patients should pay for them, as for any other drugs. Patients seen at hospital casualty departments are exempted from paying emergency care costs. Children in poor families, which may be unable to afford the costs of outpatient and hospital care (drugs, transport, etc.), are also among those most exposed to illness and most in need of health services. Most of the very severe cases needing referral occurred in children under 2 years old: the cost of pre-referral treatment is limited to a pre-referral dose of the 43

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 drugs for the few cases of severe sickness requiring urgent referral. Currently, there seems to be no systematic approach to providing free drugs, including the pre-referral dose to those referred, to young children. Improving access to care for those most at risk is an essential approach to reducing infant and under-5 mortality and achieving the ambitious Millennium Development Goals. Recommendation 1: Consideration should be given to protecting children below 2 years old, especially in poor families, by issuing a policy and establishing mechanisms (e.g. funds) to provide affordable (free or at reduced cost) drugs to them. Facts and rationale: Drugs are made available and procured by providers at health facilities in different ways, whether through a drug revolving mechanism, other schemes or personal initiative. Many children received antibiotics and other drugs unnecessarily, according to the IMCI guidelines. The revenues generated through the sale of drugs to patients may act as an incentive to prescribing. The availability of key drugs for child care at the facilities visited varied considerably, with some lacking even a single dose of selected pre-referral drugs, ORS, vitamin A, iron, paracetamol etc. The lack of a regular supply of key drugs seriously reduces the potential for impact of the IMCI strategy on the quality of care and child health outcomes. The ‘open vial’ policy in immunization to reduce missed opportunities seemed to be rarely practised at health facilities providing immunization services. This policy, if implemented especially for OPV and DPT, would help reduce wastage of vaccines and improve immunization coverage. Recommendation 2: When planning to train staff from health facilities in IMCI, States should commit to making key drugs regularly available through effective schemes to the health facilities where those staff work, to make the most of the substantial financial investment placed in IMCI training. Recommendation 3: States should promote the implementation of the ‘open vial’ policy to increase immunization coverage and reduce vaccine wastage. 6.2 6.2.1 TRAINING Skills reinforcement: strengthening follow-up visits after training

Facts and rationale: Although most of the cases in the survey were seen by providers trained in IMCI and followed up after training, most of the follow-up visits appeared to have been originally conducted 2 or more months after training. ‘Follow-up visits’ in IMCI are an essential part of training aiming at reinforcing the skills acquired in the standard 11-day training and providing the required support in the setting where the trained provider works. A delay in conducting them beyond 6 weeks after training is strongly believed to reduce their value as a training and supportive instrument. Furthermore, the practice of covering more than one facility per day and using role-play rather than actual cases further reduces their effectiveness. Recommendation 4: The Federal level and States concerned should jointly plan to develop and commit adequate human resources to follow up visits after IMCI training, to conduct them on timely basis and according to the standard methodology. 6.2.2 Improving basic skills of health providers

Facts and rationale: The level of performance of health providers not trained in IMCI was very low, highlighting weaknesses in basic clinical and communication skills adversely affecting the 44

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 quality of child care. Most of the primary health care providers in Sudan are medical assistants. The turnover of health providers represents a big challenge to a strategy if it relies only on in-service training, and hampers efforts to sustain achievements in improved quality of care in the future. Teaching at schools should be consistent with FMOH guidelines (e.g. treatment of malaria). Recommendation 5: Consideration should be given to strengthening the curriculum of preservice training of medical assistants and introducing the IMCI outpatient care approach as a way to develop basic skills. 6.3 STRENGTHENING MALARIA LABORATORY DIAGNOSTIC CAPACITY

Facts and rationale: More than two-thirds of the facilities surveyed, 60% of which were located in urban areas, had laboratory facilities to prepare and examine blood smears for malaria parasites. A quality control test was carried out in Khartoum of the reading results made at health facilities for children enrolled in the survey and for whom blood smears had been prepared in the field. None of the results reported as positive by the health facility laboratory staff (26% of the survey total) were confirmed as positive. This raises serious concerns about the reliability of laboratory malaria diagnosis in the field and results also in a high percentage of false positives and unnecessary treatment with antimalarials. Most (87%) of the laboratory technicians or assistants who had prepared and read the blood films in the field had received specific training in microscopic examination of malaria parasites, in addition to their basic training. Recommendation 6: Close supervision by Federal and State levels with quality control of malaria microscopic diagnosis should be carried out regularly to improve the quality of malaria laboratory diagnosis. 6.4 ORGANIZATION OF WORK: BUILDING CAPACITY AND REDISTRIBUTING SELECTED TASKS AT HEALTH FACILITIES

Facts and rationale: There are currently many facilities staffed with more than one category of health provider, such as ‘vaccinator’, ‘nutrition educator’, in addition to the doctor or medical assistant. To provide the full scope of quality care promoted by IMCI, these staff could assist routinely in selected tasks for sick children, for example taking and recording weight and temperature, checking the child’s road-to-health card and immunization status, providing counselling on feeding. Recommendation 7: States should consider setting and promoting the policy that all child caretakers take the road-to-health card to the facility not only for immunization but also for sick child visits. Recommendation 8: Federal and State in-service training curriculum for vaccinators and nutrition educators should be revised to include taking temperature and weight, checking immunization status by the health card, counselling on feeding and similar basic skills, as part of their routine responsibilities. 6.5 IMPROVING SUPERVISION AND REPORTING

Facts and rationale: Supervision remains a major challenge: half of the facilities reported receiving no supervisory visit in the past 6 months; clinical supervision was infrequently conducted and the findings and recommendations of the visits were rarely recorded in a book to facilitate follow-up also by other supervisors. Regular and good quality supervision is the main instrument to maintain the gains obtained through IMCI training and skills 45

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 reinforcement (‘follow-up’) visits. It requires quality training, including practising of the supervisory skills. The lack of reliable information on the number and type of cases seen at health facilities makes it difficult to plan (e.g. for staffing health facilities, estimating drug requirements, prioritizing interventions in selected areas, etc.). Discussions to revise the current health information system are ongoing. Recommendation 9: A training package on supervision of child health services should be developed; supervisors responsible for routine supervision should be trained and involved in IMCI follow-up visits and trained in child health supervisory skills on a trial basis once the materials are developed. 6.6 IMPROVING CARE-SEEKING PRACTICES

Facts and rationale: The level of knowledge about the signs that should prompt families to seek care for their sick children without delay was low among the caretakers interviewed, despite the fact that some of these caretakers had also received some advice on these signs by the provider at the health facility. This finding is further supported by the fact that two-thirds of caretakers who had recognized a breathing problem in their children waited more than a day before seeking advice from the health provider. Recommendation 10: High priority should be given to targeting the community through health communication activities to improve family knowledge about the early signs that should prompt care-seeking for sick children (e.g. breathing problem in a child with cough).

46

ANNEXES

ANNEX 1. AREAS TO BE EMPHASIZED IN FUTURE IMCI CLINICAL TRAINING AND FOLLOW-UP VISITS

Step

Targeted children

Condition

Areas to emphasize

Assessment All

All children

Case history and caretaker’s answers should be carefully validated (unreliability of caretaker) General danger signs should be correctly checked in all children The temperature should be taken correctly

All children All

Severe conditions

All children

All children ARI

Very low weight

Evidence from survey (cases managed by IMCI-trained providers) Discordant information provided by the same caretaker to provider and surveyor in several cases, leading to incorrect assessment and management of the child The three general danger signs were not checked in 72.1% of children The temperature was not taken or not taken correctly with a thermometer in 82.1% of children Child’s weight was not checked against a growth chart in 37.5% of children

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

49 ARI Diarrhoea Fever Correct technique to pinch abdomen skin to be emphasized and practised Children should be checked more carefully; both tasks should be performed: checking both ears and feeling for tender swelling behind the ear History of measles within the last three months should be asked in all children with fever or history of fever

All children

Child’s weight should not only be taken but also checked against a growth chart Caretakers should be asked not only Breathing problem not asked of 20% of caretakers whether the child has cough but also whether reporting that child had no cough the child has difficult breathing

Children with cough or difficult breathing Children with diarrhoea

The respiratory rate should be counted Respiratory rate considered unreliable in 59% of carefully; more supervised practice is needed children in whom taken Abdomen skin either incorrectly pinched or not pinched in 58.8% of children with diarrhoea (Both) ears not checked in 57.7% and feeling for tender swelling behind the ears not performed in 80.8% of children with ear problem History of measles within the last three months not checked in 47.3% of children with fever or history of fever.

Children with an ear problem

Ear problem

Children with fever

Step Areas to emphasize

Targeted children

Condition

Evidence from survey (cases managed by IMCI-trained providers)

Assessment (continued) Anaemia

All children

All children

Malnutrition

Children less than 2 years old and those with low weight and/or anaemia

Feeding assessment

All children

Other problems

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

50

Road-tohealth card

All children

Road-to-health card

Classification

Children with diarrhoea

Persistent diarrhoea and dysentery

Treatment and counselling

Children needing urgent referral or admission to hospital

Severe classification

All children should be checked for palmar Palmar pallor not assessed in 41.8% of children pallor No agreement on classification of cases with severe More practice is needed to assess palmar anaemia or anaemia in 76.6% of children with palmar pallor pallor Visible severe wasting not (or not properly) assessed All children should be checked properly for in 68.2% of children; oedema of both feet not (or not visible severe wasting and oedema of both feet properly) checked in 58.2% of children Feeding assessment not performed in 65.1% of Particular attention should be paid to assess children age less than 2 years and in 93.1% of those feeding practices, also in children with low two years old or older with low weight and/or weight and/or anaemia anaemia Asking about and checking for ‘other problems’ Caretakers not asked about the presence of other and routinely checking for eye infections in all problems in 55.7% of children; 59% of children with children should be emphasized eye infection – pus draining from the eye – missed Child’s health card should be routinely asked for and checked also for sick children, not Health card not asked for in 89.6% of children only for immunization sessions. Caretakers should be advised on it. Caretakers of 9 out of 10 children with persistent diarrhoea asked about duration of diarrhoea, but 7 Assessment findings should be used to classify cases not classified as persistent diarrhoea; caretakers the child of 7 out of 8 children with blood in stools asked about presence of blood in stool, but 4 cases not classified as dysentery All children with a severe classification needing urgent admission to hospital should None of the severe cases needing urgent referral or receive the first dose of ‘pre-referral treatment’, admission to hospital received a first dose of preincluding at the hospital out-patient or referral treatment (antibiotic, quinine, ORS, emergency department: this should be vitamin A -- as appropriate) practised during training courses

Step Areas to emphasize

Targeted children

Condition

Treatment and counselling (continued) Providers should improve their prescription practices and advise caretakers correctly on treatment Giving the first dose of treatment at the facility should be practised during training courses Children with diarrhoea and some dehydration should be rehydrated with ORS at the facility and ORS sachets given for home use to those with no dehydration Diarrhoea

Children needing oral antibiotics and/or antimalarials

IMCI conditions requiring antibiotics and/or antimalarials

Children with diarrhoea Communication skills to advise on ORS treatment should be enhanced through more supervised practice

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

51

Evidence from survey (cases managed by IMCI-trained providers) Prescription incorrect in 62.3% and 69.4% of cases with IMCI conditions needing oral antibiotics and/or antimalarials, respectively; caretakers of 75% of children prescribed oral antibiotics and of 75.7% of children prescribed oral antimalarials did not know how to administer them correctly at home 85.7% and 94.6% of children not given the first dose of antibiotic and antimalarial, respectively, among those prescribed them 71.4% of children with diarrhoea and some dehydration not administered the solution at the facility; caretakers of 48% of children with diarrhoea and no dehydration given no ORS sachets for home use Caretakers of 74.4% children given ORS were given no demonstration or explanation on how to give it nor asked checking questions; 72.1% were unable to describe how to prepare and administer ORS correctly; 65.1% did not know when to give it to the child, and 44.2% did not know how much to give it each time

Children needing vitamin A

IMCI conditions requiring vitamin A, and children age 6 months or older not given a dose in previous 6 months

Giving vitamin A to the target group of 82.8% of children needing to receive vitamin A were children, according to the IMCI guidelines, not given it or not advised to come back to receive it should be practised during training on another day

Children with eye infection

Other problems

All children with an eye infection should be given 75.9% of children with pus draining from the eye tetracycline ointment: practise during the were not given tetracycline ointment training course

Step Areas to emphasize

Targeted children

Condition

Treatment and counselling (continued)

All children

Any non-severe condition

Children needing immunization

Needing immunization

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

52 Feeding

Children less than 2 years old and children with low weight and/or anaemia

Evidence from survey (cases managed by IMCI-trained providers) Caretakers of 58.0% of children not needing urgent Advice on giving extra fluids and continue feeding referral given no advice on both home care rules 84.8% of caretakers not given advice on all the three Advice on when to take the child back to the home care rules, especially the specific early danger facility immediately signs to watch out at home (74.3% not advised on at least 3 of the 7 key signs) Use of home care card and communication techniques should be emphasized and Home care card and good communication techniques practised under supervision during training not used in 93.2% of caretakers of children not and closely monitored during follow-up needing urgent referral visits Ensure that all children’s immunization status and road-to-health card are routinely 48.2% of children needing immunization left the checked and those needing immunization facility with no immunization nor advice on are given it or advised when/where to where/when to obtain it obtain it Caretakers of 76.3% of children less than 2 years old Practice on counselling on complementary feeding and those with very low weight and/or anaemia (seen should be strengthened during training and by IMCI-trained and untrained providers) not given follow-up visits correct advice on breastfeeding and frequency of complementary foods

Caretaker-mother

Children not needing urgent referral, drug or ORS treatment, or specific advice (i.e., “green row’ conditions)

Training should start emphasizing the need 99% of caretaker-mothers of children not needing to counsel on their health mothers of sick urgent referral were asked no questions on their children who have only a mild illness health

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 ANNEX 2. MAIN STEPS OF THE IMCI PROCESS IN SUDAN August 1996 –December 1999

1996 August October November x IMCI Task Force established and a focal point appointed x IMCI Working Group created with two Sub-groups: Adaptation (4 technical units) and Implementation x National IMCI Orientation Meeting x Adoption of the IMCI strategy by the Federal Ministry of Health x Preliminary planning workshop x Selection of 4 Districts (2 in Khartoum and 2 in Gezira) 1997 May August September December 1998 March April May June July – December 1999 February March June December x Implementation at district level x Arabic version of IMCI training materials used for 1st course for medical assistants x First follow-up visit x Review of the IMCI Early Implementation Phase and Planning for Expansion x First IMCI facilitation skills training course x 2nd national IMCI case management course x 2nd IMCI facilitation skills training course x Strengthening health facilities’ services1 in the 4 districts selected for early implementation x Translation of IMCI materials into Arabic x National IMCI Steering Committee established by Ministerial Decree x IMCI Planning and Adaptation Workshop (1st Consensus meeting) x State IMCI co-ordinators and IMCI Task Forces established in Khartoum and Gezira x 2nd Consensus meeting on the IMCI adapted guidelines x First national 11-day IMCI training course

1Provision

of drugs, organization of work, etc.

DRUGS: Drugs needed for IMCI were already included in the national Essential Drug List (EDL). However, use of some drugs (e.g. parenteral chloramphenicol and gentamicin as injectable pre-referral drugs) was not allowed for medical assistants and nurses at dispensaries and health centres. Special arrangements were made with local authorities for exemption from EDL restrictions of facilities with staff trained in IMCI.

53

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 ANNEX 3. IMCI TRAINING AND IMPLEMENTATION

IMCI Training Type of course Case Management National Regional State/Dr* State/MA* Others Facilitation skills National Regional State Supervisory University Total State/Dr: Course at State level for doctors State/MA: Course at State level for medical assistants

Level

No. of courses 4 5 43

No. of participants Nationals 91 93 360 520 25 7 1 82 8 104 12 31 48 1374 19 2 Foreigners 0 17

13 2 6 2 83

National

(follow-up after training) State

IMCI implementation status 1997 Khartoum Gezira River Nile Sennar North Kordofan Kassala El Gadarif Red Sea South Darfour White Nile West Kordofan South Kordofan West Darfour Bher Elgazal 1997 Introduction 1998 1999 Training 2000 2001 2002 1998 1999 2000 2001 2002 Introduction Training ------ --------------------------------------------------------------------------Introduction Training ------ --------------------------------------------------------------------------Int. Training -------------------------------------------> Int. Training -------------------------------------------> Int. Training ----------------------> Int. Training ----------------------> Introduction Introduction Introduction Training ------> Training ------> Training ------> Int. Training--> Introduction Introduction Introduction

54

IMCI COVERAGE: Percentage of districts and facilities implementing IMCI in 14 States where IMCI has been introduced from inception through August 2002

States IMCI introduced

Date 1st training

Districts implementing IMCI 18 13 9 5 8 4 7 2 3 3 15 2 2 2 2 80 311 11 18% 26% 19 11% 3 495 15 1333 20% 37% 19 11% 16 13% 41 7% 17 18% 21 10% 16 73 65 77 19% 20 35% 22 45 24 17% 19 114 18 44% 35 109 16 31% 46 68 68% 32% 17% 49% 22% 19 47% 65 176 37% 34 38% 177 236 75% 36 50% 97 355 27% 474 913 327 213 645 262 75 238 302 396 248 247 357 64 4761

Total % Total Facilities Total % facilities in implementing % districts implementing facilities implementing implementing IMCI in IMCI in State IMCI in State in State districts districts 20% 19% 20% 22% 5% 7% 29% 7%

Khartoum

1998

Gezira

1998

River Nile

2000

Sennar

2000

North Kordofan

2001

Gadarif

2002

Red Sea

2002

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

55

White Nile

2002

Kassala

2001

South Darfour

2002

4%

West Darfour

2002

South Kordofan

2002

West Kordofan

2002

Bher Algazal

1998

5% 10%

Total

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 ANNEX 4. SCHEDULE OF SURVEY ACTIVITIES October 2002 (planning); March – April 2003 (survey)

x PLANNING Planning meeting x TRAINING Surveyor training x FIELD WORK Data collection x DATA ENTRY AND ANALYSIS Completion of data entry and cleaning Preparation of tables for data analysis Team analysis Additional analysis, preparation for feedback meeting, conclusions and recommendations 5 – 9 April 2003 10 - 13 April 2003 14 - 15 April 2003 22 March - 3 April 2003 15 - 20 March 2003 26 – 31 October 2002

16 - 20 April 2003

x PRESENTATION OF MAIN FINDINGS, CONCLUSIONS AND RECOMMENDATIONS Meeting with H.E. the Federal Minister of Health and Undersecretary of Health National feedback meeting 21 April 2003 22 April 2003 Calendar March 15 Sa 16 Su 17 Mo 18 Tu 19 We 20 Th 21 Fr 22 Sa 23 Su 24 Mo 25 Tu 26 We 27 Th 28 Fr 29 Sa 30 Su 31 Mo 1 Tu

April 2 We 3 Th 4 Fr

Surveyor training

Data collection Data entry

April 5 Sa 6 Su 7 Mo 8 Tu 9 We 10 Th 11 Fr 12 Sa 13 Su 14 Mo 15 Tu

16 We

17 Th

18 Fr

19 Sa

20 Su

21 Mo

22 Tu

Data cleaning Data entry *

Tables

Data analysis, with conclusions and recommendations Graphs

Meetings*

Meetings with H.E. the Federal Minister of Health and Undersecretary of Health, and National feedback meeting

56

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 ANNEX 5. SCHEDULE OF PLANNING Federal Ministry of Health 26–31 October 2002

Saturday, 26 October ª Meeting with National IMCI coordinator and focal point ª Meeting with UNICEF ª Meeting with survey planning team: Planning for the survey:  Background on the child health situation in the country (e.g., DHS data, health facility data), rationale for the IMCI strategy and progress in implementation; summary results of follow-up visits and observations and lessons.  Tentative schedule of planning visit  Survey manager and co-ordinator  Objectives of survey  Geographic scope and sampling (options and related issues, data required)  Surveyors, supervisors (responsibilities, requirements)  Review of survey forms -to be cont’dSunday, 27 October ª Meeting with interested partners (SCF)* ª Meeting with survey planning team: Planning for the survey (continued):  Review of survey forms (and plans for translation of selected sections) –to be cont’d Initial list of country-specific health facility survey rules Monday, 28 October  Review of survey forms (and plans for translation of selected sections) – continued  List of country-specific health facility survey rules – continued Tuesday, 29 October  Visit to the outpatient department of Omdurman hospital, Khartoum: ƒ Pre-test of forms ƒ Patient flow, outpatient logbooks, drug stock cards ƒ Revision of forms and survey rules Wednesday, 30 October  Plans for revision of EpiInfo data entry and analysis files based on revised forms  Selection of districts  Health facilities to survey: criteria and random selection procedures  Estimate of number of sets of forms, summary comment sheets and surveyor instructions needed for the survey; instruments to translate (survey rules, checklist of tasks, forms)  List of potential surveyors and supervisors  Review of plans for data entry and analysis  Budget Thursday, 31 October ª Debriefing with the Undersecretary of Health and Director-General for International Health ª Planning for surveyor training (responsibility, language, schedule) ª Planning for data collection (survey itinerary) ª Planning for data entry and analysis; labels for ‘health facility envelopes’ ª Planning for dissemination of findings and Feedback Meeting ª Finalization of survey schedule ª Planning for remaining survey tasks ª Debriefing with WR --------------*Unavailable

57

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 ANNEX 6. SURVEY PLANNING TEAM 26–31 October 2002

Federal Ministry of Health Department of Primary Health Care Dr Samia Mohammed El Hassan Dr Igbal Ahmed El Bashim Dr Khalid Mohamed Khalid Dr Hanan Mukhtar Dr Wafaa Mustafa Osman Dr Tarig Abdul Wahid Dr Rogaia Abuelgasim Dr Siham Ahmed Balla Acting Director, and national IMCI coordinator National IMCI focal point IMCI team (1st component) IMCI team (2nd component) Nutritionist, IMCI team (3rd component – community) PHC support Reproductive health and Dean, School of Nursing, Khartoum University Nutrition Academic institutions Khartoum University Prof Zein Abdul Rahim Karrar* Ms Nadia Bushra Gezira University Dr Samira Hamid Abdelrahman Al Rabat University Dr Abd Rahim Babikir Department of Community Medicine UNICEF Dr Rafah S. Aziz* Senior Project Officer for Health and Nutrition, Chief of Health and Nutrition Section, UNICEF Sudan Country Office World Health Organization Dr Sumaia Elfadil Dr Sergio Pièche National Officer, Focal Point for Child Health, Office of the WHO Representative for Sudan Medical Officer, Child Health and Development (CAH), Regional Office for the Eastern Mediterranean (EMRO) Resource persons Dr El Tayeb Ahmed El Sayed Dr Al Fatih Malik *Able

Dean, Graduate College Sociologist, Faculty of Medicine

Associate Professor, Department of Community Medicine

Expanded Programme on Immunization Malaria Programme

to attend some of the sessions

58

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 ANNEX 7. SURVEY SELECTION CRITERIA

The following criteria were agreed upon to decide which geographical areas and facilities to cover in the survey: ‰

States where more than one IMCI training course (with follow-up visit after training) had been conducted. This was done to provide time for implementation of actions recommended at debriefing meetings after follow-up visits to strengthen health system support in facilities located in districts implementing IMCI (“IMCI districts”); Facilities implementing IMCI (“IMCI health facilities”) and belonging to the following types: o Outpatient departments of hospitals; o Health centres; o Dispensaries; and o Dressing stations.

‰

59

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 ANNEX 8. SAMPLING OF DISTRICTS

Sampling method: probability proportionate to size (pps) Areas to be selected: 40 Contained in 29 districts Sampling method: Probability proportionate to size Areas to be selected: 40 Contained in 29 districts Total Cumulative population population under-five under-five 12,726 1 2 3 4 5 6 7 8 9 10 52,984 45,701 41,856 15,568 13,427 19,311 91,623 107,740 97,607 8,850 24,135 8,498 122,596 63,446 8,284 11,559 2,322 11 18,518 14,439 12 13 14 45,505 19,327 17,047 18,267 7,516 16,464 15 16 17 22,189 10,727 21,054 17,382 16,976 14,153 7,709 5,923 8,158 12,726 65,710 111,411 153,267 168,835 182,262 201,573 293,196 400,936 498,543 507,393 531,528 540,026 662,622 726,068 734,352 745,911 748,233 766,751 781,190 826,695 846,022 863,069 881,336 888,852 905,316 927,505 938,232 959,286 976,668 993,644 1,007,797 1,015,506 1,021,429 1,029,587 993,151 953,962 914,774 875,585 797,207 836,396 758,018 562,074 601,263 679,640 718,829 640,452 522,885 209,374 248,563 326,941 366,130 405,319 444,507 483,696 287,752 170,185 13,430 52,619 91,808 130,997

State Khartoum 1 2 3 4 5 6 7 8 9

Districts Soba Walgeref White Nile Elkalakla Elazhari Omdurman North Omdurman South Elreif Elganoubi Elameer Elbogaa

Areas selected

10 Elsalam 11 Elreif Elshamali 12 Elmukhtar 13 Elgaile 14 Elhag Yousif 15 Elgeraifat & Omdoum 16 Elailafoon 17 Umdwanban 18 Elsileat Gezira 19 Alhoosh 20 Elhadad 21 Wadmedani 22 Alhag abdala 23 Ummalgura wasat 24 Umelgura Ganoop 25 Umelgora shimal 26 Elmanagil 27 Reifi Almanagil 28 Almosalamia 29 Alhasahesa 30 Lemaseed 31 Wasat Elbotana River Nile 32 Reif Barbar 33 Abeedeaya 34 Barbar 35 Elbawga

60

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 Total Cumulative population population under-five under-five 18 19 24,976 9,176 10,593 18,697 7,601 20 21 22 62,268 21,086 13,442 20,930 18,537 28,500 23 24 25 26 63,539 22,971 13,660 34,864 12,836 21,392 16,183 41,773 15,700 7,771 5,510 10,416 29 16,531 19,015 9,558,256 1,567,554 39189 13430 7,131,323 1,169,537 74.6% 1,063,739 1,074,332 1,071,529 1,093,029 1,100,630 1,162,898 1,110,718 1,149,907 1,183,984 1,197,426 1,189,096 1,218,356 1,236,893 1,228,284 1,265,393 1,328,932 1,267,473 1,306,662 1,351,903 1,345,851 1,365,563 1,400,427 1,385,040 1,413,263 1,434,655 1,424,229 1,450,838 1,450,838 27 28 1,492,611 1,463,417 1,508,311 1,502,606 1,516,082 1,521,592 1,532,008 1,548,539 1,541,795 1,567,554

State 36 Atbara 37 Damar

Districts

Areas selected

1,054,563 1,032,340

38 Reifi Damar 39 Zeidab 40 Sedwan Al Gadarif 41 Algadarif 42 Middle Gadarif 43 Kasap Red Sea 44 Middle Portsudan 45 East Portsudan 46 South Portsudan North Kordofan 47 Elobeid 48 Reifi sheakan 49 Abu Haraz 50 Alrahad 51 Bara wasat 52 Sharig Bara 53 Garip Bara 54 Kasgail White Nile Sennar 55 Kosti 56 Aldeweam 57 Singa 58 Soki 59 Shargi 60 Elgarbi 61 Sennar Total population in IMCI districts Total population under five Sampling interval Random number Population in the districts selected: Population under-five Proportion of total population:

---------------------------------------Note: The population of the district of Kasgail was not available at the time of the selection and the district was then automatically left out. It was learnt later on, however, that the correct name of the district was Sheikan district, already included in this list. For practical purposes, it was agreed to accept the list of districts as shown in this annex.

61

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 ANNEX 9. LIST OF HEALTH FACILITIES SURVEYED

STATE RED SEA RED SEA AL GADARIF AL GADARIF AL GADARIF AL GADARIF AL GADARIF AL GADARIF KHARTOUM KHARTOUM SENNAR SENNAR SENNAR GEZIRA GEZIRA GEZIRA GEZIRA GEZIRA GEZIRA GEZIRA GEZIRA GEZIRA GEZIRA GEZIRA GEZIRA GEZIRA GEZIRA GEZIRA GEZIRA GEZIRA GEZIRA GEZIRA GEZIRA KHARTOUM KHARTOUM KHARTOUM KHARTOUM KHARTOUM KHARTOUM KHARTOUM KHARTOUM KHARTOUM KHARTOUM KHARTOUM KHARTOUM

DISTRICT

FACILITY

Code EAST PORT SUDAN EAST PORT SUDAN AL GADARIF AL GADARIF AL GADARIF AL GADARIF AL GADARIF KASSAB AL AMIR AL AMIR ALRIF ALGARBI ALRIF ALGARBI ALRIF ALGARBI AL HAJ ABDALLAH AL HAJ ABDALLAH AL HASAHISA AL HASAHISA AL HASAHISA AL HASAHISA AL HOUSH RIFI ALMANAGIL RIFI ALMANAGIL RIFI ALMANAGIL RIFI ALMANAGIL RIFI ALMANAGIL RIFI ALMANAGIL UMM ALGOURA GANOOP UMM ALGOURA GANOOP UMM ALGOURA GANOOP WADMEDANI WADMEDANI WADMEDANI WADMEDANI AL AZHARI AL BOKAA AL BOKAA AL BOKAA AL HAJ YOUSSEF AL HAJ YOUSSEF AL HAJ YOUSSEF AL HAJ YOUSSEF AL JERIFFAT & UMM DOM AL SALAM AL SALAM ALKALAKLAT 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45

Name of facility

Type

Caseload/month Location 75 311 143 140 176 196 93 225 87 134 66 65 138 60 63 194 78 106 185 204 86 58 78 86 89 116 85 75 83 63 81 103 264 1000 57 124 177 115 424 588 447 342 159 206 900 Urban Urban Rural Urban Urban Urban Urban Rural Urban Urban Rural Rural Rural Rural Rural Rural Rural Rural Rural Rural Rural Rural Rural Rural Rural Rural Rural Rural Rural Urban Urban Urban Urban Urban Urban Urban Urban Urban Urban Urban Urban Urban Urban Urban Urban

Deam Altigani Health centre Almawani Health centre Ummshagara Health centre Algomhoria Health centre Al Soufi Al Azrag Health centre Ababo Health centre Alsaumah Dispensary Wad Alsanosi Dispensary AL Fatimab Health centre Al Quosai Health centre Ribia Health centre 33 alsukarr Dispensary Hilat albagar Dispensary Aldawha Health centre Awlad Yaseen Dispensary Arbagi Hospital Alaikora Health centre Arbagi Health centre Wad Alsaid Health centre Alhoush Hospital Alshikeania Health centre Al Raga Dispensary Umm Sidira Dispensary Bagadi Dispensary Ummzikra Dispensary Katir alnifidia Dressing station Babanosa Health centre Algaria 30 Dispensary Almasara Dispensary Arkawit Health centre Habeeb Allah Health centre Awoodah Health centre Alkireaba Health centre Soba Al Aradi Health centre Badr Al Kobra Health centre AL Manara Health centre Al Sheikh Abuzeid Health centre Al Shahida Nada Health centre Kamboni Health centre Khaled Ben Al Walid Health centre Al Razi Dispensary Halat Koko Health centre Al Bar International Organization Dispensary Al Kanaes Dispensary Sankaat Health centre

Note: > Gezira State: Facility with code 18 – “Arbagi” health centre (rural) in Al Hasahisa district: replaced during the survey with “Maringan Alumal” health centre (urban) in Medani district

62

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

List of health facilities surveyed (continued) STATE WHITE NILE WHITE NILE WHITE NILE WHITE NILE WHITE NILE WHITE NILE WHITE NILE GEZIRA GEZIRA KHARTOUM RIVER NILE RIVER NILE RIVER NILE RIVER NILE RIVER NILE RIVER NILE RIVER NILE RIVER NILE KHARTOUM KHARTOUM KHARTOUM DISTRICT FACILITY

Code ALDOIM ALDOIM KOSTI KOSTI KOSTI KOSTI KOSTI WADMEDANI WASAT ALBUTANA WHITE NILE ATBARA ATBARA ATBARA ATBARA RIFI ALDAMER RIFI ALDAMER RIFI ALDAMER RIFI ALDAMER OUMDORMAN SOUTH WHITE NILE WHITE NILE 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66

Name of facility Alshitib Alarshkol Kosti Allia Altigani Mohamed Khir Kadogli Alengaz Banat Alginead Abaashar Elsilah Eltibi Aldakhla Alshargi Hai Almatar Alaliab Ganoop Almahamia Alaliab Wasat Thiat Daw Haggog Tiba Alhasanab Sadra

Type Health centre Health centre Hospital Health centre Health centre Health centre Health centre Health centre Hospital Dispensary Hospital Health centre Health centre Health centre Health centre Health centre Health centre Dispensary Health centre Health centre Dispensary

Caseload/month Location 128 137 690 86 127 172 181 499 90 650 66 110 125 183 53 62 65 54 199 169 529 Urban Urban Urban Urban Urban Urban Urban Urban Rural Urban Urban Urban Urban Urban Rural Rural Rural Rural Urban Urban Urban

Note: > White Nile State: Facility with code 49 – “Allia” health centre (urban) in Kosti district: replaced during the survey with “Goze Al Salam” health centre (urban) in the same district

Table. Distribution of health facilities (clusters) in the states (sample not stratified by state) State Gezira Khartoum River Nile White Nile Al Gadarif Sennar Red Sea Total: 7 states No. of districts 7 9 2 2 2 1 1 24 Facilities included (clusters) 22 18 8 7 6 3 2 66 Children enrolled 123 99 52 41 27 12 10 364

63

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 ANNEX 10. CONSIDERATION ABOUT TIMING OF THE SURVEY

x Typical diarrhoea peak months are usually in Sudan in July and August. A higher under-five caseload would then be expected to occur at that time. At the same time, access to some facilities would also be likely to become an issue for some health facilities because of the rainy season. x Colder months – December to February – would have been suitable, with an expected increase in number of cases among children under 5 years old. However, these months were too close to the planning for all the arrangements to be completed by then. There was also the need to collect and validate data on caseload from the field, to select the sample of facilities to survey. This task took many months. For the above reasons the survey was carried out in March and April 2003.

64

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 ANNEX 11. MAIN SURVEY FORM ADAPTATIONS

Enrolment card: The enrolment card was thoroughly revised to become a true form containing key information not only on the enrolment of children in the survey but also on some key aspects of careseeking behaviour, such as local terminology for major illness entities and symptoms, delay in careseeking since the appearance of danger signs or respiratory signs, and signs triggering the care-seeking process. Observation of case management (Form 1): Further information on health provider’s IMCI training, followup after training and case management was included in the form. The aim of the additional questions on case management was to collect valuable information not only on whether a certain task was performed by the health provider (‘quantity’), but also on “how” the task would be carried out (‘quality’) and “who” would carry it out (organization of work). Feeding was given due attention. A number of questions on malaria were added (see below). “Eye infections” were pre-listed under “other problems” to standardize the collection of information on this condition, that was reportedly a common cause of consultation at health facilities in Sudan. Coding of selected questions by supervisors was improved. Exit interview (Form 2): A few questions on caretaker recall of the home care messages in Form 2 were added and harmonized with the observation of counselling on home care in Form 1, to enable relational analysis. A section relating to the use of the “IMCI mother card” to assess health provider communication skills and a section on total child care costs – including also costs of transportation to facility - were added. The malaria scope of the survey instrument was expanded to include information on availability and use of bed-nets, and timely home treatment. As the revised version of the IMCI guidelines in Sudan required a blood smear for the classification of cases with fever in facilities with a laboratory, all the blood smears taken in children enrolled in the survey were collected by the survey teams and brought back to Khartoum, to be re-examined in a malaria reference laboratory. This procedure was suggested because of concerns about the reliability of laboratory examinations in the field32. Equipment and supply (Form 4): One long-debated and still open issue in this type of surveys is the assessment of drug availability by rapid techniques. The common lack of information or of reliable information on drug management at health facilities (drug stock cards or registers), the need to relate drugs available at the time of the visit to expected caseload by age and illness and next procurement date, buffer stocks and so on, make the issue complex. The current survey method looks at the availability of just one course of treatment of each of the key drugs needed for IMCI as a rapid index of drug availability. This index is of limited value, although the absence of even a course of treatment on the day of the visit points to a serious problem in drug availability. In this survey, an attempt was made to use a proxy indicator on a trial basis, accepting all the limitations that such an indicator entails. When reviewing records to calculate the caseload for a given month in Form 4, supervisors were asked also to count the number of cases classified or diagnosed as “pneumonia” and “malaria” in the same logbook and for the same period and, independently, request health providers to estimate the number of the same type of cases they had managed the previous week. The supervisors then checked whether the facility has at least as many treatment courses of the recommended antibiotic for pneumonia and recommended antimalarial for malaria as the number of pneumonia and malaria cases, respectively, that have been recorded for the reference month. These figures were compared also with the estimates given verbally by the health providers. Pneumonia and malaria were chosen as they represented leading causes of mortality in children in Sudan and require prompt drug treatment, more so in young children.

32

The National Strategic Plan for Roll-Back Malaria, 2001-2010, Sudan

65

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 ANNEX 12. LIST OF SUPERVISORS AND SURVEYORS

Survey responsibility Survey manager Survey coordinator Technical support Supervisor Supervisor

Name Dr Samia M. Hassan Dr Igbal Ahmed Dr Sergio Pièche Dr Huda Mohamed Haroon Dr Iglal Bashir Nasir

Position FMOH – Acting director of PHC Dept FMOH – PHC Dept WHO/EMRO – Medical officer Paediatrician, University of Gezira, Faculty of Medicine Public health consultant, Gezira State FMOH – National trainer officer; Paediatrics registrar FMOH – National trainer officer; Paediatrics registrar Community physician; EPI officer Medical officer, Gezira State FMOH – Community physician, PHC Dept Registrar, community medicine Registrar, paediatrics, Bhri Teaching hospital Medical officer, Khartoum State Registrar, paediatrics, Soba hospital Registrar, paediatrics, Omdurman Paediatrics hospital Registrar, community medicine, Al Gadarif State Medical officer, River Nile State Medical officer MOH, IMCI office, Khartoum State MOH, IMCI office, Khartoum State Registrar, paediatrics, Khartoum State Medical officer, Sennar hospital, Sennar State FMOH – Medical officer

IMCI Responsibility National IMCI coordinator National IMCI focal point Child health and development Senior IMCI trainer and supervisor State IMCI focal point; senior IMCI trainer and supervisor National IMCI team National IMCI team Senior IMCI trainer and supervisor IMCI team Senior IMCI trainer and supervisor National IMCI team Senior IMCI trainer and supervisor Senior IMCI trainer and supervisor National IMCI team; senior IMCI trainer and supervisor Senior IMCI trainer and supervisor State senior IMCI trainer and supervisor State senior IMCI trainer and supervisor Master IMCI trainer and supervisor Master IMCI trainer and supervisor Master IMCI trainer and supervisor State master IMCI trainer and supervisor State IMCI coordinator; master IMCI trainer and supervisor National IMCI team

Supervisor Supervisor Supervisor Supervisor Supervisor Surveyor Surveyor Surveyor Surveyor Surveyor Surveyor Surveyor Surveyor Surveyor Surveyor Surveyor Surveyor

Dr Khalid Mohamed Khalid Dr Yasir Osman Abdallah Dr Tayfour Khidir Dr Ayman Osman Fadlala Dr Mohamed Sid Ahmed Dr Hanan Mukhtar Abdu Dr Bashir Mukhtar Elwasila Dr El Sadig Abdelrahman Dr Mubarak Abdelrahman Dr Abdelrahman Ali Sanosi Dr Seham Abdallah Gabir Dr Mohamed Banaga Elyas Dr Mohamed Sabir Bahary Dr Amir Omer Ahmed Dr Hind Omer Osman Dr Wefag Ibrahim Elkhidir Dr Safa Mohamed El Haj

Surveyor Observer Data entry coordinator

UNICEF – Khartoum Sociologist, Khartoum University, Faculty of Medicine FMOH=Federal Ministry of Health; PHC=Primary health care; IMCI=Integrated Management of Childhood Illness; WHO=World Health Organization; EMRO=Eastern Mediterranean Regional Office

Dr Yara Badreldin El Sheikh Dr Abdel Halim El Tahir Ms Nadia Bushra

66

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 ANNEX 13. SURVEYOR TRAINING SCHEDULE 15–20 March 2003 8:00–16:30 (30 min. for tea break)

DAY 1: y Welcome, purpose of the training and introduction of participants y Administrative information y Introduction to the survey: survey objectives and training agenda y Survey methodology y Introduction to survey forms y Introduction to survey Q-by-Q instructions ¾Enrolment card ¾Form 1: Observation of case management o Classroom practice with exercises and role-plays y Briefing on 1st practice with outpatients at health facility DAY 2: ª 1st practice with outpatients: using Enrolment Form and Form 1 y Review of practice in groups ™ Meeting with team supervisors: 9 Enrolment Form and Form 1 DAY 3: y Plenary on 1st practice ¾Form 2: Exit interview o Classroom practice ¾Form 3: Re-examination of child o Classroom practice ¾Form 4: Equipment and supply y Briefing on 2nd practice with outpatients at health facility ™ Meeting with team supervisors: 9 Forms 2, 3 & 4 9 Providing feedback to health facility staff DAY 4: ª 2nd practice with outpatients: using all forms y Review of practice in groups and plenary y Briefing on 3rd visit to health facility ™ Meeting with team supervisors: 9 Checking surveyor reliability and forms 9 Summarizing qualitative observations DAY 5: ª 3rd practice at health facility: using all forms y Review of practice in groups and plenary ™ Meeting with team supervisors: 9 Checking forms in the field 9 Collection of blood smears 9 Supervisors’ daily meetings with teams in the field

67

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 DAY 6: y Drills on Q-by-Q instructions and survey procedures y Training evaluation ™ Meeting with team supervisors: 9 Survey itinerary 9 Team composition 9 Forms and supplies 9 Final arrangements

68

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 ANNEX 14. TRAINING EVALUATION FORM 20 Respondents

1) How do you rate the training overall? Very good [8] Good [12] Just right [ ] Inadequate [ ]

2) How confident do you feel in using the survey forms by now? Very confident [11] Confident [9] Not too confident yet [ ] Not confident [ ]

3) How clear do you feel about the survey procedures? Very clear [6] Clear [14] Not too clear yet [ ] Unclear [ ]

4) How much practice do you feel you have had with the form/s that you are going to use in the survey? Too much [2] Practice with examples: Practice with role plays: Case demonstration at hospital: Practice with actual cases at hospital: Adequate [17] Adequate [19] Adequate [17] Very helpful [11] Adequate [19] Just right [1] Too many [1] Too many [1] Helpful [9] Too many [ ] Insufficient [ ] Too few [ ] Too few [2] Not helpful [ ] Too few [1]

5) In general, how clearly were all issues raised addressed in the training? Very clearly [4] Clearly [16] Not too clearly [ ] Not clearly [ ]

6) Which training method did you enjoy most? (Tick only ONE choice) Examples [1] Role-plays [2] Practice with actual cases [14] Drills [3]

7) How did you find the Q-by-Q explanations? Very useful [11] Useful [8] Not very useful [1] Not useful [ ]

8) Do you think that the duration of this training course was: Adequate [16] Too long [3] Too short [1]

9) Do you think the venue of the training was: Suitable [19] Not suitable [1]

69

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 ANNEX 15. SURVEY TEAMS ITINERARY

Teams Team A

State Red Sea

District East Port Sudan East Port Sudan Algadarif Algadarif Algadarif Algadarif Algadarif Kassab Al Amir Al Amir Alrif Algarbi Alrif Algarbi Alrif Algarbi Al haj Abdallah Al haj Abdallah Al Hasahisa Al Hasahisa Al Hasahisa Al Hasahisa Alhoush Rifi Almanagil Rifi Almanagil Rifi Almanagil Rifi Almanagil Rifi Almanagil Rifi Almanagil Umm Algoura Ganoop Umm Algoura Ganoop Umm Algoura Ganoop Wadmedani Wadmedani Wadmedani Wadmedani

Code 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33

Health facility Deam Altigani Almwani Ummshagra Algomhoria Alsoufi Al Azrag Ababyo Alsaumah Wad Alsanosi Al fatimab Al Quosai Ribia 33 Alsukarr Hilat Albagar Aldawha Awlad Yaseen Arbagi hospital Alakora Arbagi* Wad Alsaid Alhoush Alshikeania Alraga Umm Sidira Bagadi Ummzikra Katir Alnifidia Babanosa Algaria 30 Almasara Arkawit Habeeb Allah Awoodah Alkireab

Date of visit 22/3 23/3 24/3 26/3 27/3 29/3 30/3 31/3 2/4 3/4 22/3 23/3 24/3 26/3 27/3 29/3 30/3 31/3 1/4 2/4 3/4 22/3 23/3 24/3 25/3 26/3 27/3 29/3 30/3 31/3 1/4 2/4 3/4

Supervisor: Yasir S1: Amir S2: Bahari Algadarif

Khartoum

Team B

Sennar

Supervisor: Iglal S1: Alsadig S2: Yara Gezira

Team C

Supervisor: Huda S1: Mohammed S2: Abdelrahman

Gezira

*Note - Gezira State: Facility with code 18 – “Arbagi” health centre (rural) in Al Hasahisa district: replaced during the survey with “Maringan Alumal” health centre (urban) in Medani district

70

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

SURVEY TEAMS ITINERARY (continued)

Teams Team D

State

District Alazhari Albukaa Albukaa Albukaa Alhaj Youssef Alhaj Youssef Alhaj Youssef Alhaj Youssef Al Jeriffat & UmmDom Al Salam Al Salam Al Klaklat Aldoim Aldoim Kosti Kosti Kosti Kosti Kosti Wadmedani Wasat Albutana White nile Atbara Atbara Atbara Atbara Rifi Al Damer Rifi Al Damer Rifi Al Damer Rifi Al Damer Omdurman South White nile Whilte nile

Code 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66

Health facility Soba Al Aradi Badr Alkobra Al Mannara Al Sheikh Abuzeid Al Shahida Nada Kamboni Khaled Ben Al Walid Al Razi Halit KoKo Al Bar international Al Kanaes Sankaat Alshitib Alarashkol Kosti hospital Allia* Altigani mohammed Khir Kadogli Alengaz Banat Alginead Abaashar Elsilah Eltibi Aldakhla Alshargi Hai Almatar Alaliab Ganoop Almahamia Alaliab Wasat Thiat Daw Haggog Tiba alhasanab Sadra

Date of visit 22/3 23/3 24/3 25/3 26/3 27/3 29/3 30/3 31/3 1/4 2/4 3/4 22/3 23/3 24/3 25/3 26/3 27/3 29/3 1/4 2/4 3/4 22/3 23/3 24/3 25/3 26/3 27/3 29/3 30/3 1/4 2/4 3/4

Supervisor: Mohammed Sid Ahmed S1: Hanan S2: Mubarak Khartoum

Team E

Supervisor: Khalid S1: Wefag S2: Hind

White Nile

Gezira Khartoum Team F

Supervisor: Tayfoor River nile S1: Siham S2: Basheer

Khartoum S1 = surveyor 1; S2 = surveyor 2 *Note

- White Nile State: Facility with code 49 – “Allia” health centre (urban) in Kosti district: replaced during the survey with “Goze Al Salam” health centre (urban) in the same district

71

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 ANNEX 16. SURVEY PROCEDURES FOR DATA COLLECTION AT HEALTH FACILITY

Sequence at health facility Supervisor

Waiting room Enrolment

Supply and equipment Form 4

Surveyor’s room Weight,Temperature

Exit interview Form 2   Re-examination Form 3 Surveyor 2

Doctor’s room Observation Form 1 Surveyor 1

72

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 ANNEX 17. LIST OF PARTICIPANTS IN THE NATIONAL FEEDBACK MEETING

Federal Ministry of Health 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 Dr Ibrahim Elsubaie Mrs Nadia Eldirdery Miss Amani A. Razig Ms Amira Mohamed Elmuneer Ms Nima Ibrahim Mohamed Dr Hajir Ali El Haj Mr Tarig A/Alla Dr Khalid Khalefa Jawdat Alla Mrs Hala Mohamed A.Rahim Dr Mustafa Salih Dr A.All Tuktuk Dr El Sadig Eljali Dr Abubaker Mohamed Toum Dr Khalid Mohamed Eltahir Dr Yara Badr Eldin Elsheihk Mr Mohamed Ahmed Baroodi Dr Tarig A.Wahid Mrs Shazza Mohamed ElAmin Miss Sitana Ahmed Elsayed Dr Yasir Osman A.Alla Dr Mohamed Mustafa Mohamed Dr Ashraf Ibied Mohamed Elhadi Dr Mohamed Sabir El Bahari Dr Rania El Moniem Sharawi Dr Mayadah Imam Ali Dr Rawda Mohamed Ahmed Idris Ms Zennat Balla Dr Samia Mohamed Hassan Dr Igbal Ahmed Elbashi Health Promotion, FMOH Curative Medicine directorate, FMOH IMCI, PHC, FMOH Nutrition, PHC, FMOH TB Programme, FMOH IMCI, PHC, FMOH Health education, FMOH Non communicable disease, PHC, FMOH School Health, health promotion, PHC, FMOH Planning director, FMOH FMOH PHC support, FMOH EPI, PHC, FMOH Nutrition, PHC, FMOH IMCI, PHC, FMOH IMCI, PHC, FMOH PHC Support, PHC, FMOH RH, PHC, FMOH EPI, PHC, FMOH FMOH Epidemiology Department, FMOH Development and planning, FMOH IMCI, PHC, FMOH FMOH Nutrition, PHC, FMOH IMCI, PHC, FMOH Non-communicable disease, PHC, FMOH Director General, PHC, FMOH IMCI, PHC, FMOH

Federal Ministry of Social Welfare 30 31 32 Rabab Hamid Madina Ekrayah Seif Eldin A.Rahim Mohamed Ministry of Social Welfare Ministry of Social Welfare Ministry of Social Welfare

Federal Ministry of Education 33 Mrs Awatif Mohamed Babiker Ministry of Education

Federal Ministry of Communication 34 35 36 37 38 Marum Hassan Saad Niemat Mohamed Awad Samia Ibrahim Ahmed Mutaaz Mirghani Hussien Ibrahim Ahmed Mohamed Salih Ministry of Communication Ministry of Communication Ministry of Communication Ministry of Communication Ministry of Communication

Federal Ministry of Agriculture and Forest 39 Al-Amin Hassan Al –Amin Ministry of Agriculture & Forest

73

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 State Ministries of Health 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 Dr Ahmed Karamino Dr Peter Adok Aouto Dr Younis A.Rahman Dr Agweir Sabino Dr Mohamed Ibrahim Ali Ms Fatima Awad Elkarim Dr Abeer Mustafa Dr Al-Amin Hassan Mustafa Dr Fatima Ibrahim Al – Amin Dr Howida Hassan Abu – Salih Dr Ahmed Omer El Fahal Dr Aamir Omer Ahmed Dr Wifag Ibrahim Elkhidir Dr Abbas El Hadi Dr Abu El – Gasim Mirghani Dr Imad Mustafa A.Alla Dr Mohamed Banaga Elyas Dr Samia Mohmed A. Raham Dr Ahmed Elbashir Dr Siham A.Alla Gabir Minister of health - Northern State Minister of health – Organization Council for Southern States Minister of health – Sinnar State Minister of health – Western Kordofan State Minister of health – Northern Kordofan State PHC, MOH, Northern State MOH, Khartoum State MOH, Khartoum State MOH, Khartoum State MOH, Khartoum State MOH, Khartoum State MOH, Khartoum State MOH, Khartoum State MOH, White Nile State Director General. MOH, Western Kordofan State IMCI coordinator, River Nile State MOH, River Nile State PHC coordinator, PHC, MOH, River Nile State Director General, MOH, Gezira State MOH, Gadarif State

World Health Organization 60 61 62 63 Dr Suzanne Farhoud Dr Sergio Pièche Dr Sumaia El –Fadil Dr Samia Yousif Habani Regional adviser on child and adolescent health and development (CAH), WHO/ EMRO Medical officer, CAH, WHO/EMRO WHO, Sudan WHO, Sudan

UNICEF 64 65 Dr Abd Elhalim Eltahir Mr Mohamed A.Hamie UNICEF, Sudan UNICEF, Sudan

74

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 Academic institutions and other organizations, agencies and interested parties 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 Dr Farima A.Rahman Dr Yasir Ahmed Ibrahim Dr Mabou Mustafa Dr El Sir M. Hashim Dr Attiyat Mustafa Dr Zin El Abdeen Karrar Dr Alamin Osman Dr Huda Haroun Dr Samira Hamid Dr Siddiga A. Rahim Washy Ms Igbal Ahmed Ibrahim Ms Ihklas Ibrahim Elbashir Ms Tahani El – Hussien Ms Geronika Alex Ms Rawia Suliman Eljak Ms Manal Elbadri Ms Fatima Hamid Ali Dr Ali Naser Eissa Mr Fath El Rahman Abu Elgasim Mrs Nagia Elwasela Elsadig Ms Rasha Fadl Alla Ms Intisar Elhadi Bad Eldin Dr A.Rahman Ali Sanosi Dr Bashir Mukhtar Elwasela Dr Mubarak A.Rahamn Mohamed Dr Mohamed Ali Awad Elkarim Dr Gafaar Ibnaouf Suliman Dr Awatif Mustafa Dr Nagwan Shams Eldin Military hospital National Council for Child Care Paediarician Paediatrician Paediatrician Paediatrician, Faculty of Medicine, Khartoum University Paediatrician, Military hospital Paediatrician, Faculty of Medicine, Gezira University PHC, Faculty of Medicine, Gezira University Ahfad University Khartoum University Suna Agency Suna Agency Ireland Goal Organization NCCW, Childhood council Sudan Academy for Communication Science Childhood Council , Western Kordufan Plan Sudan, Khartoum Khartoum T.V. & Broadcast Corporation SABA SABA HTP Association Omdurman Paediatric Hospital Sudan Medical Association Council , FMOH Khartoumn Paediatric Hospital Community Medicine, Faculty of medicine, Khartoum University Director General, Khartoumn Emergency Paediatric Hospital Ahfad University Khartoum Childhood Curative Council

List provided by FMOH; names arranged by institution and order of registration Abbreviation used: FMOH=Federal Ministry of Health; IMCI=Integrated Management of Childhood Illness; PHC=Primary Health Care; SABA=Sudanese Association for Breastfeeding Action; TB=Tuberculosis control programme; RH=Reproductive health; MOH=Ministry of Health; EMRO=Eastern Mediterranean Regional Office of WHO; HTP=Harmful Traditional Practices

75

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 ANNEX 18. MINIMUM SURVEY REQUIREMENT FOR DRUG AVAILABILITY

1. ORS ....................................................................................................................... 1 sachet 2. Cotrimoxazole (tablet or suspension—First line antibiotic for pneumonia and dysentery............................................................................................ 2 bottles 3. Amoxycillin tablets (125mg) or suspension—Second line antibiotic for pneumonia ..................................................................................................................... 2 bottles 4. Nalidixic acid tablets (250mg)—Second line antibiotic for dysentery............................. 20 tabs 5. Chloroquine tablet (150) or syrup (50 mg or 75 mg base/5ml)......................................... 1 bottle 6. Sulfadoxine+ pyrimethamine tablets (500mg Sulfa + 25 mg Pyrim.)............................ 1 strip 7. Vitamin A blue (100,000 IU) or red (200,000 IU) capsules with nipple ........................... 3 caps 8. Iron syrup or drops 25mg/ml................................................................................................... 1 bottle 9. Paracetamol syrup 120 mg/5 ml or tablets 100 mg or 500mg .......................................... 1 bottle 10. Tetracycline eye ointment .................................................................................................... 1 item 11. Gentian violet (0.5%) .............................................................................................................. 1 bottle 12. Salbutamol solution or metered dose inhaler (MDI)......................................................... 1 bottle 13. Salbutamol syrup 2mg/5ml or tablets 2 mg or 4 mg......................................................... 1 bottle 14. Diazepam ampule (10mg/2ml) ............................................................................................. 1 ampule 14. Chloramphenicol IM ............................................................................................................. 1 ampule 16. Quinine IM ...............................................................................................................................1 ampule 17. Benzyl penicillin IM .............................................................................................................. 1 ampule 18. Procaine penicillin IM ........................................................................................................... 1 ampule 19. Gentamicin IM ........................................................................................................................ 1 ampule 20. Sterile water for injection ......................................................................................................... 3 vials 21. Ringer's Lactate Solution (for severe dehydration) .............................................................. 1 drip 22. Saline (for severe dehydration)................................................................................................ 1 drip

76

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 ANNEX 19. FINDINGS RELATED TO THE WHO GENERIC LIST OF IMCI PRIORITY INDICATORS (P) AND SUPPLEMENTAL MEASURES (S) AT HEALTH LEVEL

A validated classification is a classification made by the surveyor after re-examining the child. The indicators listed below refer to children two months up to five years of age

CASE MANAGEMENT ™ ASSESSMENT P1. Child correctly checked for three general danger signs: (*adapted definition) 21.4% of children were checked for the three general danger signs. Numerator: Number of sick children aged 2 months up to five years seen who are correctly checked for three danger signs (is the child able to drink or breastfeed, does the child vomit everything, has the child had convulsions) Number of sick children aged 2 months up to five years seen

Denominator:

S11.

Child not visibly awake checked for lethargy: Seven (77.8%) of the nine children who were not visibly awake (i.e. who were not playing, smiling, or crying with energy) were checked for lethargy. Numerator: Denominator: Number of sick children not visibly awake when assessed by the health provider (who are not playing, smiling, or crying with energy) who are checked for lethargy. Number of sick children not visibly awake seen.

P2.

Child checked for the presence of cough, diarrhoea and fever: 74.7% of children were checked for the presence of cough, diarrhoea, and fever. Numerator: Denominator: Number of sick children seen whose caretakers were asked about the presence of cough, diarrhoea, and fever Number of sick children seen

P3.

Child weight checked against a growth chart: 52.5% of children were weighed the same day and had their weight checked against a recommended growth chart. Numerator: Denominator: Number of sick children seen who have been weighed the same day and have their weight checked against a recommended growth chart Number of sick children seen

P4.

Child vaccination status checked: 59.6% of children had their vaccination status checked. Numerator: Denominator: Number of sick children seen who have their vaccination card or vaccination history checked. Number of sick children seen

77

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 P5. WHO Index of integrated assessment: mean of 5.9 assessment tasks performed out of 10 tasks per sick child assessed Definition: Arithmetic mean of 10 assessment tasks performed for each child (checked for three danger signs, checked for the three main symptoms, child weighted and weight checked against a growth chart, checked for palmar pallor, and checked for vaccination status). - checked for “ability to drink or breastfeed”, “vomits everything”, and “convulsions”:1 point each - checked for presence of “cough & fast/difficult breathing”, “diarrhoea”, and “fever”: 1 point each - child weighed the same day and child’s weight used against a recommended growth chart: 1 point each - child checked for palmar pallor: 1 point - child vaccination status checked (card or history): 1 point

Calculation:

P6.

Child under two years of age assessed for feeding practices: Caretakers of 27.5% of children under two years of age were asked about breastfeeding, complementary foods, and feeding practices during this episode of illness. Numerator: Number of sick children under two years of age whose caretakers are asked if they breastfeed this child, whether the child takes any other food or fluids other than breastmilk, and if during this illness the child’s feeding has changed. Number of sick children under two years of age seen

Denominator:

S3.

Child with very low weight and/or anaemia assessed for feeding problems: 16.9% of sick children with very low weight and/or anaemia were assessed for feeding problems. Numerator: Number of sick children with a validated classification of very low weight and no severe classification whose caretaker are asked if the mother breastfeeds the child, if the child takes food or fluids other than breastmilk, and if during this illness the child’s feeding has changed. Number of sick children with a validated classification of very low weight and/or anaemia

Denominator:

S1.

Child checked for other problems: 48.1% of children brought to the facility were checked for “other problems”. Numerator: Number of children brought to the facility for one or more of the main symptoms (cough/fast/difficult breathing, diarrhoea, fever) or for “ear problems” and with an “other problem”, whose caretaker were asked to describe this other problem. Number of children brought to the facility for one or more of the main symptoms (cough/fast/difficult breathing, diarrhoea, fever) or for “ear problems”.

Denominator:

™ CLASSIFICATION S4. Child with very low weight correctly classified: 34.8% of children with very low weight were correctly classified. Numerator: Denominator: Number of children with a validated classification of very low weight who are classified as very low weight. Number of children with a validated classification of very low weight

78

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 Child correctly classified: (*adapted definition) 46.0% of classifications given by the health provider for important conditions matched the classifications# given by an IMCI-trained surveyor for the same conditions (validated classification) Numerator: Number of validated classifications# for important conditions (very severe disease or severe pneumonia or pneumonia, and/or severe dehydration or some dehydration, and/or severe persistent diarrhoea or persistent diarrhoea, and/or dysentery, and/or mastoiditis or acute or chronic ear infection, and/or very severe febrile disease or malaria, and/or measles with or without eye and mouth complications, and/or severe malnutrition or very low weight, and/or severe anaemia or anaemia) that match the classifications given by the health provider. Number of classifications# for important conditions

S5.

Denominator: #

‘Red-coded’ and ‘ yellow-coded’ classifications, including also the ’green-coded’ classification of measles.

™ TREATMENT AND ADVICE S12. Child with severe illness correctly treated: (*adapted definition) None of the 13 children with severe classifications needing urgent referral and whose caretakers accepted referral received correct pre-referral treatment and referral. Numerator: Number of children with validated classifications of severe disease needing urgent referral (very severe disease or severe pneumonia, severe dehydration, severe persistent diarrhoea, very severe febrile disease, severe complicated measles, mastoiditis, severe malnutrition or severe anaemia) who receive correct pre-referral dose of the recommended antibiotic and/or antimalarial and/or ORS and/or vitamin A and referral Number of children with validated classifications of severe disease needing urgent referral

Denominator:

P7.

Child needing an oral antibiotic and/or antimalarial prescribed the drug correctly: 29.5% of children who did not need urgent referral and who needed an oral antibiotic and/or an antimalarial were prescribed the drug correctly. Numerator: Number of sick children with validated classifications, who do not need urgent referral, who need an oral antibiotic and/or antimalarial (pneumonia, and/or dysentery, and/or malaria, and/or acute ear infection) who are correctly prescribed them, including dose, number of times per day, and number of days Number of sick children with validated classifications who do not need urgent referral, who need an oral antibiotic and/or an antimalarial.

Denominator:

S6.

Child with pneumonia correctly treated: 33.3% of children with pneumonia were prescribed antibiotic treatment correctly. Numerator: Number of children with a validated classification of pneumonia and no severe classification who are given/prescribed treatment with an appropriate antibiotic (including correct amount, times per day, and number of days) Number of children with a validated classification of pneumonia and no severe classification

Denominator:

79

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 S7. Child with dehydration correctly treated: 22.2% of children with diarrhoea and some dehydration received ORS at the facility. Numerator: Denominator: Number of children with a validated classification of diarrhoea with some dehydration and no severe classification who receive ORS at the facility. Number of children with a validated classification of diarrhoea with some dehydration and no severe classification

S7.

Child with malaria correctly treated: 27.4% of children with malaria who are prescribed antimalarial treatment correctly. Numerator: Number of children with a validated classification of malaria and no severe classification who are given/prescribed treatment with an appropriate antimalarial (including correct amount, times per day, and number of days) Number of children with a validated classification of malaria and no severe classification

Denominator:

S9.

Child with anaemia correctly treated: (*adapted definition) 25.5% of children with anaemia were prescribed iron treatment. Numerator: Denominator: Number of children with a validated classification of anaemia and no severe classification who are given/prescribed iron treatment. Number of children with a validated classification of anaemia and no severe classification

S10.

Child receives first dose of oral treatment at facility: 9.1% of children, who did not need urgent referral, who needed an oral antibiotic and/or antimalarial received the first dose(s) at the facility. Numerator: Number of children with validated classifications, who do not need urgent referral, who need an oral antibiotic and/or antimalarial (pneumonia, dysentery, malaria, acute ear infection) who receive the first dose(s) at the health facility. Number of children with validated classifications, who do not need urgent referral, who need an oral antibiotic and/or antimalarial

Denominator:

P8.

Child not needing antibiotic leaves the facility without antibiotic: 62.6% of children who did not need urgent referral and who did not need an antibiotic left the facility without having received or having been prescribed antibiotics. Numerator: Number of children with validated classification who do not need urgent referral and do not need an antibiotic for one or more IMCI classifications or other problems (no pneumonia: cough or cold, diarrhoea with or without dehydration, persistent diarrhoea, malaria, fever-malaria unlikely, measles, chronic ear infection, no ear infection, anaemia / very low weight, and/or no anaemia / not very low weight, and/or other problems) who leave the facility without receiving antibiotics or a prescription for antibiotics for those validated classifications. Number of children seen who do not need urgent referral and who do not need an antibiotic for one or more IMCI classifications or other problems

Denominator:

80

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 S13. Child prescribed oral medication whose caretaker is advised on how to administer the treatment: 27.9% of children not needing urgent referral and who received or were prescribed an antibiotic and/or an antimalarial and/or ORS, who received at least two treatment counselling messages. Numerator: Number of children with validated classifications not needing urgent referral and who received or were prescribed an antibiotic and/or an antimalarial and/or ORS, who receive at least two treatment counselling messages (explanation on how to administer treatment, demonstration on how to administer treatment, open-ended question to check caretaker understanding). Number of children with validated classifications not needing urgent referral, who received or were prescribed an antibiotic and/or an antimalarial and/or ORS

Denominator:

P10.

Child needing vaccinations leaves facility with all needed vaccinations: (*adapted definition) 48.6% of children needing vaccinations (based on vaccination card or history) left the health facility with all needed vaccinations or advice to come back for vaccination on the scheduled vaccination day. Numerator: Number of children who need vaccinations (based on vaccination card or history) who leave the health facility with all needed vaccinations or advice to come back on the scheduled vaccination day Number of children seen who need vaccinations (based on vaccination card or history)

Denominator:

™ ADVICE ON HOME CARE P9. Caretaker of sick child is advised to give extra fluids and continue feeding: the caretakers of 32.3% of sick children were advised to give extra fluid and continue feeding. Numerator: Denominator: Number of sick children with validated classifications, who do not need urgent referral, whose caretakers are advised to give extra fluid and continue feeding Number of sick children with validated classifications, who do not need urgent referral

S14.

Sick child whose caretaker is advised on when to return immediately: the caretakers of 19.7% of sick children received at least three counselling messages on when to return immediately. Numerator: Number of sick children, who do not need urgent referral, whose caretakers received at least three of the following counselling messages on when to return immediately to a health facility: if the child is not able to drink or breastfeed, becomes sicker, develops a fever, has difficult breathing, has fast breathing, has blood in the stool, or is drinking poorly. Number of sick children seen who do not need urgent referral

Denominator:

S15.

Child less than two years old or with very low weight or anaemia whose caretaker received correct age-appropriate feeding counselling: (*adapted definition) The caretakers of 23.7% of children less than two years old or with very low weight and/or anaemia were provided with ageappropriate feeding messages#. Numerator: Number of children less than two years old or with a validated classification of very low weight and/or anaemia, who do not need urgent referral, whose caretakers are provided with age-appropriate feeding messages#. Number of children less than two years old or with a validated classification of very low weight and/or anaemia, who do not need urgent referral.

Denominator: #

For definition of age-appropriate feeding advice used in this survey see note under Table A32.

81

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 S16. Child leaving the facility whose caretaker was given or shown a mother’s card: The caretakers of 34.0% of children, who did not need urgent referral, were shown a mother’s counselling card by the health provider. Numerator: Denominator: Number of children, who do not need urgent referral, whose caretakers have been shown a mother’s card by the health provider during the visit. Number of sick children seen who do not need urgent referral.

™ CARETAKER KNOWLEDGE ABOUT ORAL TREATMENT P11. Caretaker of child who is prescribed ORS, and/or an oral antibiotic and/or an oral antimalarial knows how to give the treatment: caretakers of 24.3% of children prescribed ORS, and/or an oral antibiotic and/or an oral antimalarial could describe correctly how to give the treatment. Numerator: Number of sick children prescribed ORS, and/or an oral antibiotic and/or oral antimalarial whose caretakers can describe how to give the correct treatment including the amount, number of times per day, and number of days Number of sick children prescribed ORS and/or an antibiotic and/or an antimalarial

Denominator:

™ REFERRAL P12. Child needing referral is referred: 42.9% of children needing referral were referred by the health providers. Numerator: Number of sick children with a validated classification of severe disease needing referral (one or more danger signs, severe pneumonia or very severe disease, and/or severe dehydration with any other severe classification, and/or severe persistent diarrhoea, and/or very severe febrile disease, and/or severe complicated measles, and/or mastoiditis, and/or severe malnutrition or severe anaemia) who were referred by the health providers Number of sick children with a validated classification of severe disease needing referral

Denominator:

HEALTH SYSTEM SUPPORT P13. Health facility received at least one supervisory visit that included observation of case management during the previous six months: 10.6% of health facilities received at least one visit of routine supervision that included the observation of case management during the previous six months. Numerator: Number of health facilities that received at least one visit of routine supervision (excluding the follow-up visits to health providers shortly after their training that are part of IMCI training) that included the observation of case management during the previous six months Number of health facilities surveyed

Denominator:

P14. Index of availability of essential oral treatments: a mean of 5.0 out of 6 essential oral drugs for home treatment of sick children were present on the day of visit. Definition: Arithmetic mean of essential oral drugs recommended for home treatment of diarrhoea, dysentery, pneumonia, fever, malaria and anaemia available at each facility the day of visit. - ORS, 1 point - recommended antibiotic for pneumonia and dysentery, 1 point - recommended antimalarial, 1 point - vitamin A, 1 point - iron, 1 point - paracetamol, 1 point

Calculation:

82

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 P15. Index of availability of injectable drugs for pre-referral treatment: a mean of 2.6 out of 4 injectable antibiotics and antimalarials for pre-referral treatment of sick children and young infants were available in each facility on the day of visit. Definition: Calculation: Arithmetic mean of recommended injectable pre-referral treatment for children and young infant with severe classification needing immediate referral. - chloramphenicol, 1 point - quinine, 1 point - gentamicin, 1 point - benzylpenicillin, 1 point

P16.

Health facility has the equipment and supplies to support full vaccination services: (*adapted definition) 35.8% health facilities providing immunisation services had the equipment and supplies to provide full vaccination services on the day of survey. Numerator: Number of health facilities providing immunisation that have the equipment and supplies to support full vaccination services (functioning refrigerator or cold chain, and functioning sterilizer and needles/syringes or disposable needles/syringes) available on the day of survey Number of health facilities surveyed

Denominator:

S17.

Health facility has essential equipment and materials: 31.8% of health facilities had all needed equipment and materials available on the day of the survey. Numerator: Number of health facilities with all needed equipment and materials (accessible and working weighing scales for adults and children, timing device, source of clean water, spoons, cups and jugs to mix and administer ORS) available on the day of the survey Number of health facilities surveyed

Denominator:

S18.

Health facility has IMCI chart booklet and mothers’ counselling cards#: 77.3 % of health facilities had IMCI chart booklet available for use by health providers and mothers’ counselling cards for use during mothers’ counselling on the day of the survey. Numerator: Number of health facilities with at least one legible IMCI chart booklet available for use by health providers managing children and at least one mother counselling card for use during counseling of caretakers of sick children. Number of health facilities surveyed

Denominator:

#Counselling card given or shown to the caretaker during counselling and that includes at least country-appropriate and age-specific feeding

advices and the danger signs when to bring the child immediately back to a health facility.

P18.

Health facilities with at least 60% of providers managing children trained in IMCI: (*adapted definition) 60.7% of first-level health facilities had at least 60% of doctors managing children trained in IMCI. Numerator: Denominator: Number of non-hospital health facilities with at least 60% of doctors managing children who are trained in IMCI Number of non-hospital health facilities surveyed

83

ANNEX 20. FINDINGS: TABLES AND GRAPHS

85

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

REPORT OF BREATHING PROBLEMS AND PNEUMONIA Table A1. Sensitivity and specificity of caretakers’ report of breathing problems or ‘pneumonia’ for 64 children with “Very severe disease”/“Severe pneumonia” or “Pneumonia” (as classified by the surveyor) among 227 children with an acute respiratory condition Symptom reported by caretakers Classification of cases by surveyor Cases with only cough or cold Cases with pneumonia or (no pneumonia or serious illness) Serious illness n = 163 n = 64 Sensitivity 12 (18.8%)1 25 (15.3%) Specificity 138 (84.7%)2

Breathing problem/pneumonia reported

Only cough and no breathing problem/ pneumonia reported Accuracy3 of symptom “breathing problem”/”pneumonia” in detecting pneumonia 1Sensitivity

52 (81.3%)

(12+138)/(64+163) = 66.1%

of symptom “breathing problem” or “pneumonia”, as reported by caretakers, for pneumonia or serious illness in this selected population of sick children taken to health facilities [true positives / (true positives + false negatives)] 2Specificity [true negatives / (true negatives + false positives)] 3Accuracy [(true positives + true negatives) / all] x Likelihood ratio: 1.2 [sensitivity / (1 - specificity)]

Table A2. Predictive values for pneumonia or severe illness of caretakers’ report of fast or difficult breathing or ‘pneumonia’ (based on surveyor classification of 227 ARI cases) Severity of illness by surveyor Symptoms or condition reported by caretaker Breathing problem or ’pneumonia’3 Only cough n = 37 n = 190 Positive predictive value 12 (32.4%)4 52 (27.4%) Negative predictive value 138 (72.6%)5

Severe illness or pneumonia1

No pneumonia2 1”Very 2Cough

25 (67.6%)

severe disease”, “severe pneumonia” or “pneumonia” or cold or other non-serious ARI 3Children in whom a breathing problem or ‘pneumonia’ was reported by the caretaker 4Positive predictive value [true positives / (true positives + false positives)] 5Negative predictive value [true negatives / (true negatives + false negatives)]



One ARI case excluded from this analysis as information was missing on breathing problem.

86

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

QUALITY OF CLINICAL CARE: ASSESSMENT

Table A3. Integrated assessment: proportion of sick children in whom selected assessment tasks were performed by the health providers (WHO “priority indicators” shown in italics) ASSESSMENT TASKS o o o o o o o o o o o o x x 1

CASES (%) IN WHOM DONE n = 364 78 (21.4%) 272 (74.7%) 224 (61.5%) 163 (44.8%) 89 (24.5%) 117 (32.1%) 173 (47.5%) 291 (79.9%) 191 (52.5%) 33 ( 9.1%) 217 (59.6%) 175 (48.1%) 5.9 7.6

Child (correctly) checked for three general danger signs1 (ability to drink, vomiting everything, convulsions) Child checked for the presence of three main symptoms: cough, diarrhoea and fever Child checked for the presence of an ear problem Child (correctly) checked for palmar pallor Child (correctly) checked for visible wasting Child (correctly) checked for the presence of oedema of both feet Child temperature taken (by thermometer) Child weight taken and recorded Child weight checked against a growth chart Child road-to-health card asked Child vaccination status checked Child checked for the presence of other problems WHO INDEX OF INTEGRATED ASSESSMENT (mean of 10 assessment tasks performed)# ADAPTED INDEX OF INTEGRATED ASSESSMENT - SUDAN (mean of 14 assessment tasks performed)#

The three signs were checked correctly with the following frequency: Ability to drink in 210 (57.6%) cases, child vomiting everything in 186 (51.1%) and convulsions in relation to this episode of illness in 105 (28.8%) #

Index calculated as the arithmetic mean of the following 10 assessment tasks: child checked for three danger signs (1,2,3), and the three main symptoms (4,5,6); child weighed and weight recorded (7) and checked against a growth chart (8); child checked for palmar pallor (9) and health card asked to check for vaccination status (10). The Sudan index adds the following 4 tasks: child’s temperature checked with thermometer (11) and child checked for the presence of ear problem (12), wasting (13), and oedema of both feet (14).

87

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

88

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 Table A4. Assessment of feeding practices in all children under two years old or in older children with anaemia and/or very low weight TARGET GROUPS FOR ASSESSMENT OF FEEDING PRACTICES O Children under 2 years old - not referred by provider - assessed for feeding practices: breastfeeding, complementary foods and changes in feeding during this episode of illness (n = 189)1,2: > Children under 2 years old - not referred by provider - with very low weight and/or anaemia assessed for feeding practices (n = 29) > Children under 2 years old - not referred by provider - without very low weight and/or anaemia assessed for feeding practices (n = 160) o Children 2 years old or older - not referred by provider - with very low weight and/or anaemia assessed for feeding practices (n = 36)3 x IMCI target group for feeding assessment: Children not referred by provider who are under 2 years old or older children with very low weight and/or anaemia assessed for feeding practices (n = 225)3 1 2

FEEDING PRACTICES ASSESSED 52/189 (27.5%) 9/29 (31.0%) 43/160 (26.9%) 2/36 ( 5.6%)

54/225 (24.0%)

Nine children less than 2 years old referred by the provider are excluded from this denominator Of the caretakers of the 189 children not referred by the provider, 127 (67.2%) were asked about breastfeeding, 108 (57.1%) were asked about complementary foods and 57 (30.2%) were asked whether feeding practices had changed during the illness 3 Same definition as above used for children with very low weight or anaemia less than 2 years old; for older children, feeding practices were considered as assessed if caretakers were asked about complementary foods and changes in feeding practices during this episode of illness. 78% of children two years old or older with anaemia or very low weight had been misclassified by the provider as cases with no anaemia or not very low weight-for-age.

89

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 Table A5. Use of correct methodology for selected assessment tasks by the observed providers TASK Child weighed1 Child’s weight recorded Child weighed and weight recorded Child’s temperature taken2 Children with cough or difficult breathing: > Respiratory rate counted3 Children with diarrhoea: > Duration of episode asked > Presence of blood in stools asked > Something to drink offered > Abdomen skin pinched5 Children with ear problem: > a. Looks at both ears > b. Looks for tender swelling behind ear > Looks for both Children with fever: > Checks for measles within the last 3 months CHILDREN IN WHOM TASK TO BE PERFORMED n = 364 CHILDREN IN WHOM TASK PERFORMED 300 (82.4%) 291 (79.9%) 291 (79.9%) 173 (47.5%) 173 (75.9%) n= 1096 83 (76.1%) 62 (56.9%) 55 (50.5%) 75 (68.8%) n = 317 11 (35.5%) 5 (16.1%) 5 (16.1%) n = 207 87 (42.0%) CASES IN WHOM TASK <CORRECTLY> PERFORMED 194 (53.3%)

n = 364 n = 2284

50 (13.7%) 130 (57.0%)

36 (33.0%)

-

1 Weight considered as taken correctly if child weighed undressed or lightly clothed and using scale appropriate for child (as defined during surveyor training) 2 Temperature taken correctly if thermometer shaken first, then correctly placed under child’s axilla and kept in place for at least 2 minutes. A thermometer was available at the facility in 108 (56.5%) of the 191 children in whom the temperature was not taken. 3 Respiratory rate considered as counted correctly if the child was calm, the count was for a full minute and the child’s chest was undressed 4 Of the 18 cases in whom the respiratory rate was not counted by the provider: 12 caretakers told the provider that the child had no cough, while in 6 the provider did not check for the presence of cough 5 Skin pinched correctly if abdomen skin pinched halfway between the umbilicus and the side of abdomen, skin held firmly for one second between the thumb and the 1st finger in line up and down the child’s body 6 The caretakers of 7 of the 109 children with diarrhoea - identified by the surveyor – had told the provider that the child had no diarrhoea; in other 3 cases, the provider did not check for the presence of diarrhoea 7 In 7 cases in whom the ear problem was not assessed: 3 caretakers told the provider that the child had no ear problem, while in 4 cases the provider did not check for the presence of the ear problem 8 In 14 of the 120 cases with fever in whom measles was not checked: 5 caretakers told the provider that the child had no fever, in 8 cases the provider did not ask and in 1 case the information was missing

90

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

91

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

Table A6. Counting the respiratory rate in children with cough or difficult breathing: accurate counts and implications for classification of non-severe pneumonia RESPIRATORY RATE COUNTS AND THEIR IMPLICATIONS > Children in whom the respiratory rate was counted by both surveyor and provider x Respiratory rate counts considered as: > Reliable1 > Unreliable1 Differences in counts of 10 or more breaths per minute (range from 10 to 46) x “Pneumonia” cases that would have been incorrectly classified as “no pneumonia” by the provider based on his/her “unreliable” count (“under-classification”): - In infants (less than 12 months old) - In older children “No pneumonia” cases that would have been incorrectly classified as “pneumonia” by the provider based on his/her unreliable count (“over-classification”): - In infants (less than 12 months old) - In older children 1

n = 1721 70 (40.7%) 102 (59.3%) 33 (19.2%) 11/643 (17.2%) 6 5 35/1644 (21.3%) 12 23

Exclusively for the purpose of this analysis, “reliable” count was considered each count for which the difference in count between the provider and the surveyor for the same child was not greater than 5 breaths per minute. This arbitrary level was based on experience from previous health facility surveys on acute respiratory infections. The difference in counting the respiratory rate between health providers and surveyors was in the range between -34 (i.e., the provider counted 34 breaths per minute less than the surveyor for the same child) and +46 (i.e., the provider counted 46 breaths per minute more than the surveyor for the same child). 2 One child who was crying at the time the rate was counted by the provider and for whom the provider’s count was not available was removed from this analysis 3 The denominator is the total number of “pneumonia” cases 4 The denominator is the total number of cases with “no pneumonia”

92

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

QUALITY OF CLINICAL CARE: CLASSIFICATION

All 3 children found to have danger signs by the surveyor were missed by the provider

Table A7. Agreement of provider’s case classifications with surveyor’s classifications on identified conditions requiring urgent referral, treatment or special counselling (mostly “red” and “yellow” rows of the IMCI chart, and measles). CONDITION Very severe disease/severe pneumonia or pneumonia Diarrhoea with severe or some dehydration Severe and non-severe persistent diarrhoea Dysentery Very severe febrile disease or malaria Measles (with or without complications) Mastoiditis or acute or chronic ear infection Severe malnutrition or very low weight Severe anaemia or anaemia TOTAL IDENTIFIED BY Provider Surveyor 36 4 3 4 47 0 10 10 13 127 64 11 10 8 65 4 27 26 61 276 AGREEMENT (%) 56% 36% 33% 50% 72% 0% 37% 38% 21% 46.0% UNDERCLASSIFIED (OUT OF MISCLASSIFIED)

26/28 7/7 4/7 4/4 18/18 4/4 15/17 16/16 47/48 141/149 (94.6%)

The denominator is the total number of “IMCI conditions” that were identified in 189 (51.9%) of the 364 children examined, (i.e. 276 conditions). A sick child often had more than one condition.

93

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

Table A8. Agreement of provider’s case classification with surveyor’s classification for children with cough or difficult breathing (n = 228) SURVEYOR VSD1/Severe Pneumonia HEALTH PROVIDER Pneumonia No Pneumonia Cough not assessed or classified TOTAL n = 228

VSD1/Severe 5 (50%) 2 2 1 10 Pneumonia Pneumonia 2 31 (57%) 12 9 54 No Pneumonia 3 34 99 (60%) 28 164 Agreement between health provider’s and surveyor’s classifications for cases with co`ugh or difficult breathing: 135/228 (59%) x Agreement on cases with pneumonia or severe illness: 36/64 (56%) x 26 of the 28 cases with severe pneumonia and pneumonia misclassified were underclassified 1 VSD: Very severe disease All the 3 cases with wheezing – according to the surveyor – were missed by the provider

Shaded areas above show agreement

Table A9. Agreement of provider’s case classification with surveyor’s classification for children with diarrhoea (n = 109) SURVEYOR Severe dehydration HEALTH PROVIDER Some dehydration No dehydration Diarrhoea not assessed or classified Severe dehydration 0 (0%) 2 2 Some dehydration 4 (44%) 3 2 9 No dehydration 8 55 (56%) 35 98 Agreement between health provider’s and surveyor’s classifications for cases with diarrhoea: 59/109 (54%) x Agreement on cases with severe or some dehydration: 4/11 (36%). x 7 of the 11 cases with dehydration were underclassified Shaded areas above show agreement TOTAL n = 109 Pattern of cases

94

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

Table A10. Agreement of provider’s case classification with surveyor’s classification for children with persistent diarrhoea (n = 10) SURVEYOR Severe persistent diarrhoea HEALTH PROVIDER Persistent diarrhoea No classification given for persistent diarrhoea TOTAL n = 10 Pattern of cases

Severe persistent 0 diarrhoea Persistent 3 (30%) 4 10 3 diarrhoea x Agreement between health provider’s and surveyor’s classifications on cases with persistent diarrhoea: 3/10 (33%) x 4 of the 10 cases with persistent diarrhoea were underclassified. Shaded areas above show agreement

Table A11. Agreement of provider’s case classification with surveyor’s classification for children with dysentery (n = 8) SURVEYOR Dysentery HEALTH PROVIDER TOTAL n=8 No classification given for dysentery Dysentery 4 (50%) 4 8 x Agreement between health provider’s and surveyor’s classifications for cases with dysentery: 4/8 (50%) x 4 of the 8 cases with dysentery were underclassified

95

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

Table A12. Agreement of provider’s case classification with surveyor’s classification for children with fever (n = 207) SURVEYOR Very severe febrile disease HEALTH PROVIDER Malaria Fever – Malaria unlikely Fever not assessed or classified TOTAL n = 207

Very severe febrile 0 (0%) 1 0 2 3 disease Malaria 47 (76%) 5 10 62 Fever – Malaria 40 56 (39%) 46 142 unlikely Agreement between health provider’s and surveyor’s classifications for cases with fever: 47/207 (23%) x Agreement on cases with very severe febrile disease or malaria: 47/65 (72%). x All the 18 cases with very severe febrile disease or malaria misclassified were underclassified x Measles: All 4 cases with measles were underclassified by the provider: 1 case with measles and eye and mouth complications was classified as non-complicated measles by the provider; the other three noncomplicates measles cases were given no classification for measles by the provider Shaded areas above show agreement

Table A13. Agreement of provider’s case classification with surveyor’s classification for children with an ear problem (n = 31) SURVEYOR Acute ear infection HEALTH PROVIDER Chronic ear infection No ear infection TOTAL n = 31 Ear problem not assessed or classified Acute ear infection 9 (39%) 1 3 10 23 Chronic ear infection 2 1 (25%) 0 1 4 No ear infection 1 0 0 (0%) 3 4 Agreement between health provider’s and surveyor’s classifications for cases with ear problem: 10/31 (32%) x Agreement on cases with acute or chronic ear infection: 10/27 (37%). x 15 of the 17 cases with acute or chronic ear infection misclassified were underclassified 1

In 3 of the 17 cases misclassified the caretaker told the provider that the child had no ear problem; in 4 other cases the provider did not check for ear problem

Shaded areas above show agreement

96

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

Table A14. Agreement of provider’s case classification with surveyor’s classification on nutritional status (n = 26) SURVEYOR Severe malnutrition HEALTH PROVIDER Very low weight Not very low weight Nutritional status not classified 1 14 TOTAL n = 26

Severe malnutrition 2 (67%) 0 0 Very low weight 0 8 (35%) 1 x Agreement on cases with severe malnutrition or very low weight: 10/26 (38%). x All the 16 cases misclassified were underclassified Shaded areas above show agreement

3 23

Table A15. Agreement of provider’s case classification with surveyor’s classification on anaemia (n = 61) SURVEYOR Severe anaemia HEALTH PROVIDER Anaemia No anaemia 0 7 Anaemia not classified 1 39 TOTAL n = 61

Severe anaemia 0 (0%) 0 Anaemia 1 13 (22%) x Agreement on cases with severe anaemia or anaemia: 13/61 (21%) x 47 of the 48 cases misclassified were underclassified

1 60

Shaded areas above show agreement

Agreement of provider’s case classification with surveyor’s classification on “Not very low weight / no anaemia” (n = 290): 67/290 (23%)

Provider agreement with surveyor on children with eye infections: 17/41 (41.5%)

Provider’s correct identification of a feeding problem using surveyor’s identification of feeding problems as a reference: 13/167 (7.8%)

97

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

QUALITY OF CLINICAL CARE: MANAGEMENT OF SEVERE CASES AND USE OF INJECTABLE DRUGS

Table A16. Management of severe cases needing urgent referral and use of injectable drugs TYPE OF CASES x Cases needing urgent referral: > Referred (correctly identified by the provider) > Administered appropriate pre-referral treatment: o Severe pneumonia administered parenteral chloramphenicol or recommended oral antibiotic at the facility o Severe dehydration started receiving ORS at the facility o Very severe febrile disease administered parenteral quinine at the facility o Severe malnutrition administered vitamin A o Severe anaemia administered vitamin A > Correctly managed (referred and given appropriate pre-referral treatment) x Cases referred by the provider: > Given explanation about the need for referral > Accepting referral > Given referral note x Cases prescribed or administered an injectable drug at the facility10: 1

No. (%) 14/364 (3.8%) 6/14 (42.9%)1

0/9 (0.0%)3 0/2 (0.0%)4 0/3 (0.0%)5 0/3 (0.0%)6 0/1 (0.0%)6 0/13 (0.0%)7 n = 128 8 (66.7%) 11 (91.7%)9 6 (50.0%) n = 21 4 (19.0%) 17 (80.9%)

Cases referred by the provider Cases not referred by provider and unlikely to need injection

All the 6 cases correctly identified as needing urgent referral were assessed by health providers trained in IMCI. There was agreement on urgent referral between the provider and the surveyor in 6 (42.9%) of the 14 cases, i.e. 6/11 (54.5%) cases seen by IMCI-trained staff and 0/3 (0.0%) cases seen by non-IMCI-trained staff. 2 Appropriate pre-referral treatment here refers to the administration of a pre-referral dose of the recommended antibiotic, parenteral quinine and vitamin A as required by the national IMCI guidelines 3 2 of these 9 cases were administered Penicillin G IM. All facilities in which these cases were seen had cotrimoxazole; chloramphenicol was available in 4 cases; penicillin G was available in all cases. 4 ORS was available in both cases 5 Quinine was available only in 1 of the 3 cases 6 Vitamin A was available in 2 of the 3 cases with severe malnutrition and in the case with severe anaemia 7 One of the cases referred by the provider refused referral and was removed from this analysis 8 17 cases were referred by the provider; however, only 12 of them were referred urgently and thus considered in this analysis 9 The case that refused referral was given no explanation about the need for referral 10 One case was injected chloroquine and all the other cases were given benzylpenicillin

98

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

99

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

QUALITY OF CARE: ORAL ANTIBIOTIC TREATMENT

Table A17. Oral antibiotic treatment prescribed correctly for children with an “IMCI condition” not requiring urgent referral and needing oral antibiotics, and caretaker recall of the instructions CASES x Children with an IMCI condition not requiring urgent referral and needing oral antibiotics: > Prescribed oral antibiotics >Prescribed a recommended oral antibiotic > Prescribed recommended oral antibiotics correctly (all three below): - Of those prescribed recommended oral antibiotics: > 1. Prescribed correct amount (dose) > 2. Prescribed correct number of times per day (frequency) > 3. Prescribed correct number of days (duration) > Prescribed correctly (all 3 above) x Caretakers of children prescribed recommended oral antibiotics: > 1. Knowing the dose to be given each time > 2. Knowing the number of times a day to be given > 3. Knowing for how many days to be given > Able to describe correctly how to give antibiotics (i.e., knowing all 3 above) x Pneumonia cases (not requiring urgent referral): > Prescribed oral antibiotics >Prescribed recommended oral antibiotics > Prescribed oral antibiotics correctly x Dysentery cases (not requiring urgent referral): >Prescribed oral antibiotics >Prescribed recommended oral antibiotics > Prescribed recommended oral antibiotics correctly x Children not needing antibiotics (for an IMCI or non-IMCI reason) and not requiring urgent referral: > Prescribed no antibiotics > Prescribed antibiotics unnecessarily 1

No. (%) n = 80 58 (72.5%) 54 (67.5%) 26 (32.5%) n = 54 31 (57.4%) 48 (88.9%) 36 (66.7%) 26 (48.1%) n = 54 24 (44.4%) 30 (55.6%) 24 (44.4%) 12 (22.2%) n = 54 43 (79.6%)1 39 (72.2%) 18 (33.3%) n=8 4 (50.0%)2 3 (37.5%) 3 (37.5%) n = 254 159 (62.6%) 95 (37.4%)3

All the 11 “pneumonia” cases that were not prescribed an antibiotic had been misclassified by the provider as “no pneumonia” cases 2 Three of the 4 cases with dysentery who were not prescribed an oral antibiotic had not been classified as ‘dysentery’ cases by the provider 3 40 (42%) of these 95 cases that were prescribed antibiotics unnecessarily had been misclassified by the provider as cases with “pneumonia” (36 cases), “dysentery” (1) or “acute ear infection” (3), all of which would have required antibiotics had the classifications been correct

100

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

Table A18. Relationship of provider’s correct advice on treatment with a recommended oral antibiotic with caretaker correct recall of the advice (for cases not referred by the provider and for whom information is available) ADVICE CORRECT ADVICE GIVEN AND RECALLED CORRECTLY BY CARETAKER 43/76 (56.6%)* 66/113 (58.4%)* 43/77 (55.8%)* ADVICE INCORRECT OR NOT GIVEN BUT MENTIONED CORRECTLY BY CARETAKER 7/56 (12.5%)* 2/19 (10.5%)* 6/55 (10.9%)* TOTAL (n = 132 CASES NOT REFERRED AND GIVEN ANTIBIOTICS) 50/132 (37.9%)1 68/132 (51.5%)1 49/132 (37.1%)1

Dose Frequency Duration

1 Information not available in 6 cases, removed from this analysis *The difference is statistically significant at P<0.01

101

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

102

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

Table A19. Potential compliance with advice on duration of treatment CASES PRESCRIBED AN ANTIBIOTIC x Caretaker intention to continue treatment in case child gets better: - Would stop treatment - Would continue as advised - Would continue but reduce the dose - Other options - Would not know - Information missing n = 1071 (%) 24 (22.4%) 69 (64.5%) 1 ( 0.9%) 3 ( 2.8%) 2 ( 1.9%) 7 ( 6.5%)

1 A total of 158 caretakers were identified during the exit interview as having been prescribed an antibiotic; 51 of them were excluded from this analysis, as they did not recall for how long they should give the antibiotic to the child

103

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

Table A20. Oral antimalarial treatment prescribed correctly for children with malaria not requiring urgent referral, and caretaker recall CASES x Children with malaria not requiring urgent referral: > Prescribed oral antimalarials > Prescribed recommended oral antimalarials > Prescribed recommended oral antimalarials correctly (see below) - Of those prescribed recommended oral antimalarials: > 1. Prescribed correct amount (dose) > 2. Prescribed correct number of times per day (frequency) > 3. Prescribed correct number of days (duration) > Prescribed correctly (all 3 above) x Caretakers of children prescribed recommended oral antimalarials: > 1. Knowing the dose to be given each time > 2. Knowing the number of times a day to be given > 3. Knowing for how many days to be given > Able to describe correctly how to give antimalarials (i.e., knowing all 3 above) No. (%) n = 62 46 (74.2%) 46 (74.2%) 17 (27.4%) n = 46 21 (45.7%) 38 (82.6%) 33 (71.7%) 17 (37.0%) n = 46 13 (28.3%) 16 (34.8%) 16 (34.8%) 9 (19.6%)

Table A21. Relationship of provider’s correct advice on treatment with an oral antimalarial with caretaker correct recall of the advice (for cases not referred by the provider and for whom information is available) ADVICE CORRECT ADVICE GIVEN AND RECALLED CORRECTLY BY CARETAKER 24/44 (54.5%)* 41/77 (53.2%)* 36/71 (50.7%)* ADVICE INCORRECT OR NOT GIVEN BUT MENTIONED CORRECTLY BY CARETAKER 4/58 (6.9%)* 2/25 (8.0%)* 3/31 (9.7%)* TOTAL (n = 102 CASES NOT REFERRED AND GIVEN ANTIMALARIALS) 28/102 (27.5%) 43/102 (42.2%) 39/102 (38.2%)

Dose Frequency Duration

*The difference is statistically significant at P<0.01

104

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

105

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

Table A22. Oral rehydration salts (ORS) prescribed correctly for children with diarrhoea not requiring urgent referral, and caretaker recall CASES x Children with diarrhoea not needing urgent referral1: > No signs of dehydration: given ORS sachets > Some dehydration: - Administered the ORS solution at the facility - Given ORS sachets > Given correct instructions on ORS, including its preparation (all three below): - Of those given ORS: > 1. Correctly advised on amount of water to mix with 1 ORS sachet to prepare the solution > 2. Correctly advised on when to give ORS to the child each day > 3. Correctly advised on how much ORS to give to the child each time x Caretakers of children prescribed ORS: > 1. Knowing how much water to mix with 1 ORS sachet to prepare solution > 2. Knowing when to give ORS to the child each day > 3. Knowing how much ORS to give to the child each time > Able to describe correctly how to give ORS (i.e., knowing all 3 above) 47/951,2 (49.5%) 2/91 (22.2%) 5/91 (55.6%) 17/543 (31.5%) n = 543 31 (57.4%) 19 (35.2%) 17 (31.5%) n = 543 42 (77.8%) 16 (29.6%) 27 (50.0%) 13 (24.1%)

1 A total of 109 cases of diarrhoea were identified. Five of these were excluded from this analysis as they had severe conditions requiring urgent referral. Included in this analysis were then 104 cases, of which 95 with no signs of dehydration and 9 with some dehydration. 2 Only 54 (57%) of the 95 cases with no signs of dehydration were correctly classified as such by the provider but, even so, only 34 of these 54 cases were prescribed or given ORS packets for home use, although ORS was available at the facility for all but six cases 3 The denominator of 54 cases refers to: the 47 cases with no dehydration and the 5 cases with some dehydration given ORS sachets, and 1 case with some dehydration and 1 case with no dehydration administered the ORS solution at the facility

Table A23. Relationship of provider’s correct advice on ORS (oral rehydration salts) treatment with caretaker correct recall of the advice (for cases not referred by the provider and for whom information is available) ADVICE CORRECT ADVICE GIVEN AND RECALLED CORRECTLY BY CARETAKER 32/35 (91.4%) 14/21 (66.7%)* 15/19 (78.9%)** ADVICE INCORRECT OR NOT GIVEN BUT MENTIONED CORRECTLY BY CARETAKER 17/24 (70.8%) 6/38 (15.8%)* 16/40 (40.0%)** TOTAL (n = 59 CASES NOT REFERRED AND GIVEN ORS) 49/59 (83.1%) 20/59 (33.9%) 31/59 (52.5%)

How much water to use to prepare ORS When to give ORS How much ORS to give each time

*The difference is statistically significant at P<0.01 **The difference is statistically significant at P<0.05

106

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

107

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 Table A24. Antibiotic, antimalarial and/or ORS treatment: provider communication tasks in giving advice ADVICE x Caretakers of children not needing urgent referral, requiring an antibiotic for an IMCI condition and prescribed oral antibiotics: > 1. Given advice on dose, frequency and duration of treatment > 2. Given demonstration on how to give it > 3. Asked open-ended question to check for understanding > For whom at least 2 of the above 3 counselling tasks were performed > Given first dose of antibiotic at the facility x Caretakers of children not needing urgent referral, requiring an antimalarial and prescribed oral antimalarials: > 1. Given advice on dose, frequency and duration of treatment > 2. Given demonstration on how to give it > 3. Asked open-ended question to check for understanding > For whom at least 2 of the above 3 counselling tasks were performed > Given first dose of antimalarial at the facility x Caretakers of children with diarrhoea not needing urgent referral given ORS: > 1. Given advice on dose, frequency and duration of treatment > 2. Given demonstration on how to give it > 3. Asked open-ended question to check for understanding > For whom at least 2 of the above 3 counselling tasks were performed 1

No. (%) n = 581 37 (63.8%) 10 (17.2%) 11 (19.0%) 13 (22.4%) 9 (15.5%) n= 462 37 (80.4%) 8 (17.4%) 9 (19.6%) 11 (23.9%) 2 ( 4.3%) n = 543 28 (51.9%) 11 (20.4%) 11 (20.4%) 18 (33.3%)

A total of 163 children not needing urgent referral were given antibiotics. Of these, the following were excluded from this analysis: 6 cases who needed urgent referral and, of the remaining cases, 99 who did not have an IMCI condition requiring antibiotics (according to the surveyor) 2 A total of 99 children not needing urgent referral were given antimalarials. Of these, 53 were removed from this analysis as they did not need an antimalarial according to the surveyor 3 A total of 62 children not needing urgent referral were given ORS by facility providers. Of these, 8 cases were excluded from this analysis as they had no diarrhoea according to the surveyor

108

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 QUALITY OF CLINICAL CARE: OTHER TREATMENT AND IMMUNIZATION

Table A25. Other curative and preventive treatments# CASES x Children with wheezing given salbutamol x Children given paracetamol: > Of those with an axillary temperature >38.50C > Of those with acute ear infection with a temperature <38.50C > Of those with an axillary temperature >37.40C and <38.50C and no acute ear infection > Of those with an axillary temperature <37.50C and no acute ear infection x Children with an eye infection (pus draining from the eye) not needing urgent referral given tetracycline ointment x Children with anaemia not needing urgent referral prescribed iron2 x Children needing vitamin A: > Given vitamin A > Given vitamin A or told to come back on another day to receive vitamin A x Children needing vaccinations and not referred by provider: > Leaving the facility with all needed vaccinations given > Leaving the facility with all needed vaccinations given or advice to come back for vaccination on scheduled vaccination day #

No. (%) 1/3 (33.3%) 128/364 (35.2%) 27/38 (71.1%) 12/23 (52.2%) 29/52 (55.8%) 60/251 (23.9%) 9/39 (23.1%) 14/55 (25.5%)2 n = 46 6/46 (13.0%)3 8/46 (17.4%) n = 74 18 (24.3%) 36 (48.6%)

Concerning other medicines given than those recommended by the IMCI guidelines, 2 cases were prescribed an “antidiarrhoeal” drug (antispasmodic) and 14 were prescribed a “cough/cold medicine”. Interestingly, 16 children were prescribed metronidazole: according to the provider, 11 had diarrhoea (among which: 1 reported to have giardiasis and 1 amoebic dysentery), while 1 was reported to have a skin infection, 1 a “dental problem”, 1 giardiasis and 1 “intestinal parasites”. Three children were prescribed mebendazole, two of which reported to have “intestinal parasites”. 1

Of the 7 cases which were not administered the ORS solution at the facility: 3 cases were misclassified as cases with no dehydration (2 of them were given ORS sachets); 2 cases, classified correctly as having some dehydration, were given only ORS sachets; 1 case was not classified for diarrhoea; and in 1 case the caretaker told the provider that the child had no diarrhoea 2 39 of the 41 children not given iron were misclassified as cases with no anaemia 3 Vitamin A was available at the health facility for 39 of the 41 children who needed it and were not given it

109

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

110

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

QUALITY OF CLINICAL CARE: ADVICE ON FOLLOW-UP AND CARETAKER RECALL Table A26. Advice on follow-up (definite follow-up) CASES x Caretakers of children not needing urgent referral needing definite follow-up: > Advised to come back for follow-up by the provider x Overall agreement of provider’s advice on number of days caretaker should come back for definite follow-up with surveyor’s advice (for children not needing urgent referral and requiring definite follow-up) x Agreement of provider’s advice with the following surveyor’s advice on definite followup - In 2 days - In 5 days - In 14 days No. (%) 217/350 (62.0%) 99/217 (45.6%) 52/217 (24.0%)

21/57 (36.8%) 30/149 (20.1%) 1/11 ( 9.1%)

Table A27. Relationship of provider’s advice on follow-up with caretaker correct recall of the advice (n = 99 cases advised on definite follow-up by provider) DAYS WITHIN WHICH FOLLOW-UP ADVISED BY PROVIDER Any advice on follow-up Follow-up within 2 days Follow-up within 5 days Follow-up within 14 days CARETAKER CORRECT RECALL OF FOLLOW-UP ADVICE 69/99 (69.7%) 39/57 (68.4%) 29/40 (72.5%) 1/2 (50.0%)

111

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

QUALITY OF CLINICAL CARE: ADVICE ON HOME CARE AND CARETAKER KNOWLEDGE

Table A28. Advice on home care: advice given by provider CASES x Caretakers of children not needing urgent referral advised by the provider: > To give extra fluids > To continue feeding > Both messages on extra fluids and continue feeding x Caretakers of children not needing urgent referral advised by the provider to take the child back to the facility immediately if the child: > 1. Is unable to drink > 2. Becomes sicker > 3. Develops a fever (for those not having fever by history or temperature) > All the three above (the first 2 signs for all children and the last one only for children with no fever) x Caretakers of children classified as “cough or cold: no pneumonia” not needing urgent referral advised by the provider to take the child back to the facility immediately if the child: > 4. Develops fast breathing > 5. Develops difficult breathing x Caretakers of children with “diarrhoea and no signs of dehydration”, not needing urgent referral, advised to take the child back to the facility immediately if the child: > 6. Has blood in stools (for those with no bloody stools) > 7. Drinks poorly x Caretakers of children not needing urgent referral advised by the provider to take the child back to the facility immediately: > On at least three of the above 7 signs x Caretakers advised on all the three home care rules (to give extra to drink and continue feeding and at least three signs on when to return immediately) n = 3501 143 (40.9%) 133 (38.0%) 113 (32.3%) n = 3501 74/350 (21.1%) 112/350 (32.0%) 36/1472 (24.5%) 52/350 (14.9%)

n = 162 30 (18.5%) 34 (21.0%) n = 95 13 (13.7%) 5 (5.3%) n = 350 69 (19.7%) n = 350 41 (11.7%)

1 10 of the children who were not advised on fluids and food were referred by the provider but did not need urgent referral according to the surveyor. These children are included in the denominator. Information was missing for 2 children 2 This denominator refers to children having no fever

Caretakers, mothers of children not referred by provider, advised on their health: 2/284 (0.7%)

Child visits during which providers consulted the IMCI chart: 264/364 (72.5%)

112

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

113

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 Table A29. Caretaker knowledge about home care CASES Caretakers of children not referred by the provider knowing about the need: > To give extra to drink to their sick children > To continue feeding their sick children > To give extra fluids and continue feeding their sick children during illness x Caretakers of children not referred by the provider knowing the signs that indicate the need to seek care immediately: > 1. Child is unable to drink or breastfeed > 2. Child becomes sicker > 3. Child develops a fever > All the 3 signs above x Caretakers of children with “cough or cold: no pneumonia” not referred by the provider knowing the specific ‘respiratory’ signs indicating the need to seek care immediately: > 4. Develops fast breathing > 5. Develops difficult breathing > Either fast or difficult breathing x Caretakers of children with diarrhoea and no signs of dehydration, not referred by the provider knowing the specific ‘diarrhoea’ signs indicating the need to seek care immediately: > 6. Has blood in stools > 7. Drinks poorly x Caretakers of children not referred by the provider knowing at least two signs to seek care immediately x Caretakers of children not referred by the provider knowing the three rules of home care (give extra to drink, continue feeding and at least three signs on when to seek care immediately) Other signs mentioned by caretakers which would worry them and prompt them to seek care for a sick child3: - (Simple) diarrhoea - Vomiting - (Simple) cough - Abdominal pain - No improvement - Eye problem No. (%) n = 3471 167 (48.1%) 274 (78.9%) 156 (45.0%) n = 3471 16 ( 4.6%) 110 (31.7%) 241(69.5%) 4 ( 1.2%) n = 163 6 ( 3.7%) 30 (18.4%) 36 (22.1%) n = 94 2 (2.1%) 1 (1.1%) n = 3471 116 (33.4%) n = 3471 6 (1.7%)2 n = 347 221 (63.7%) 143 (41.2%) 91 (26.2%) 19 ( 5.5%) 18 ( 5.2%) 17 ( 4.9%)

1 17 cases referred by the provider were excluded from this analysis, as caretaker interviews were not conducted for those cases confirmed by the surveyor to need urgent referral, in order to avoid any delay in referral. It should be noted that the denominator in the earlier table showing the advice given by the provider on the same items of home care is different, as it concerns cases not needing urgent referral according to the surveyor, rather than cases not referred by the provider as in this case. 2 If only 2 signs on when to seek care had been used as a criterion for this compound indicator, the rate about caretaker knowledge of the three home care rules would have been: 156/347 = 45.0% 3 In many cases, caretakers were unable to “switch” to this hypothetical, general question and tended to simply mention the reasons why they had actually taken their sick children to the facility

114

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

Table A30. Comparison between provider’s advice on signs to return immediately with caretaker knowledge of signs to seek care promptly (n = 342 interviews for which this information available, irrespective of child illness, for cases not referred by provider) SIGNS TO RETURN IMMEDIATELY SIGN ADVISED BY PROVIDER AND MENTIONED BY CARETAKER 66/74 (89.2%)* 29/112 (25.9%) 44/60 (73.3%) 5/47 (10.6%)* 13/51 (25.5%) 5/20 (25.0%)* 1/12 (8.3%) SIGN NOT ADVISED BY PROVIDER BUT MENTIONED BY CARETAKER 8/266 (3.0%)* 80/230 (34.8%) 197/282 (69.9%) 4/295 (1.4%)* 50/291 (17.2%) 0/322 (0.0%)* 4/329 (1.2%) TOTAL (n = CARETAKERS INTERVIEWED) 74/3401 (21.8%) 109/342 (31.9%) 241/342 (70.5%) 9/342 (2.6%) 63/342 (18.4%) 5/342 (1.5%) 5/3413 (1.5%)

Child is unable to drink Child becomes sicker Child develops a fever Child develops fast breathing Child develops difficult breathing Child has blood in stool Child drinks poorly 1 Information 3 Information

missing on 2 records for this specific item missing on 1 record for this specific item

* The difference is statistically significant at P<0.01

115

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

QUALITY OF CARE: PROVIDER COMMUNICATION Table A31: Caretakers of children not referred by provider advised on home care by use of the mother home care counselling card and communication techniques TASK/SKILL x Caretaker of children not referred by provider with whom provider: - Used the home care card; - Used the home card and good communication techniques2 x Caretakers of children not referred by provider who recalled being shown home care card x Use of good communication techniques in cases in which the home care card was used: > Holding card properly > Pointing at pictures >Checking for caretaker understanding x Caretakers who recalled being shown the card among those with whom the provider actually used the card 1

No. (%) n = 3471 118 (34.0%) 18 ( 5.2%) 96 (27.7%) n = 118 31 (26.3%) 29 (24.6%) 27 (22.9%) 823,4 (69.5%)

14 caretakers who had not been shown the home care card actually responded during the exit interview that they had been shown it 2 The card was not available at the facility in 81 (35.8%) of the 226 cases in whom the home care card was not used by the provider. In 45 of these 81 cases the, IMCI chart booklet (that includes also the home care card) was not available at the facility either. 3 Information missing on 3 of these cases, included in this denominator 4 This indicator includes cases in whom all the following occurred: a) the home care card was used; b) The card was either held properly facing the caretaker or the pictures on the card were pointed at while counselling; and c) Caretaker understanding of the advice given was checked by open-ended questions

116

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

QUALITY OF CLINICAL CARE: ADVICE ON FEEDING

Table A32. Age-appropriate advice on feeding (cases not referred by provider whose caretakers were advised on feeding by the provider and interviewed by the surveyor) AGE GROUPS CASES GIVEN AGEAPPROPRIATE FEEDING ADVICE1 16/62 (25.8%)1 11/34 (32.4%)1 5/28 (17.9%) 11/56 (19.6%)2 18/71 (25.4%)3 5/36 (13.9%)1 50/225 (23.7%)4

Children less than 6 months old: > Children from 2 up to 4 months old > Children from 4 up to 6 months old Children 6 to 11 months old Children 12 to 23 months old Children 2 years old or older with very low weight and/or anaemia Children less then 2 years old and those with very low weight and/or anaemia 1 Information 2

on breastfeeding status or advice given missing for 5 cases Information on breastfeeding status or advice given missing for 1 case 3 Information on breastfeeding status or advice given missing for 4 cases 4 Information on breastfeeding status or advice given missing for 15 cases

This table was prepared mostly according to the 2nd version of the Sudan IMCI guidelines on feeding that started being used in IMCI training courses in 2001, and some practical considerations. The previous version of the guidelines recommended exclusive breastfeeding up to 4 months, rather than up to 6 months, as in the revised guidelines. Although a number of providers trained in IMCI before 2001 were then oriented to the new guidelines, other providers were not up to the time of the survey. In some of these cases, therefore, the provider’s feeding advice might have been considered not appropriate for the child age based on the revised guidelines, but might have been appropriate according to the previous version of the guidelines. The advice on feeding given by the provider was considered appropriate in this survey as follows: > Children less than 6 months old exclusively breastfed: advised to breastfeed at least 8 times a day and not to give complementary foods; > Children less than 4 months old breastfed but not exclusively: advised to breastfeed at least 8 times a day and not to give complementary foods; > Children from 4 up to 6 months old breastfed but not exclusively: advised to breastfeed at least 8 times a day exclusively, or to breastfeed at least 8 times a day and give complementary foods 2 times a day; > Children less than 6 months old not breastfed: advised to give complementary foods 5 or more times a day (this practical approach was considered acceptable when re-lactation would appear less feasible); > Child 6 to 11 months old breastfed, whether exclusively or not: advised to continue to breastfeed (as much as the child wants) and to give complementary foods as small frequent meals 5 times a day; > Child 6 to 11 months old not breastfed: advised to give complementary foods 5 times a day; > Child 12 to 23 months old, or child 2 years old and older with very low weight and/or anaemia: advised to give complementary foods 5 times a day.

117

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

Tables A33. Use of mosquito bednets (n = 350) ACTION Caretakers having a mosquito bed-net at home Caretakers having a mosquito bed-net treated with insecticide at home Children who had slept under a mosquito bed-night last night Children who had slept under a mosquito bed-night treated with insecticide last night # Analysis 18

No. (%) 181 (51.7%)# 73 (20.9%)#,1 70 (20.0%)#,2 35 (10.0%)#

by caretaker education level suggests an upward trend in these rates for higher caretaker education level caretakers, included in the denominator, were unsure about whether the bed net had been treated with an insecticide 2 2 caretakers, included in the denominator, did not know whether the child had slept under the bed net the night before

118

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 QUALITY OF CARE: HEALTH SYSTEMS CARETAKER SATISFACTION WITH HEALTH SERVICES Table A34. Caretaker satisfaction with services (cases not referred) CARETAKER SATISFACTION WITH SERVICES Very satisfied Satisfied Unsatisfied Does not know Reasons for satisfaction (either very satisfied or satisfied) - Treatment given - Examination of the child - What learnt - Provider’s good attitude - Affordable - Laboratory tests - Time spent - Accessible (near home) - Does not know or others Main reasons for dissatisfaction: - Treatment given / not given - Costly No. (%) n = 343 27 (7.9%) 274 (79.9%) 26 (7.6%) 16 (4.6%) % of all reasons given 35.0% 26.4% 4.3 % 7.8% 2.5 % 2.5 % 2.5 % 1.0% 18.0 % % of all reasons given 42.8 % 21.4 %

119

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

QUALITY OF CARE: HEALTH SYSTEMS TRAINING Table A35. Cases managed by providers trained in IMCI by year of training YEAR OF IMCI TRAINING 2003 2002 2001 2000 1999 1998 CASES MANAGED BY IMCI-TRAINED PROVIDERS No. (%) 26 ( 9.2%) 154 (55.0%) 61 (21.8%) 26 ( 9.3%) 3 ( 1.1%) 10 ( 3.6%)

Facilities with no staff trained in IMCI at time of visit: 10/66 (15.2%). In 3 of these 10 facilities, among the staff currently working at the facility, some were reported to have been trained in IMCI, but none of them was present at the time of the visit.

COMPARATIVE FINDINGS BY PROVIDER TRAINING STATUS Table A36. Integrated assessment, by provider training status: proportion of sick children in whom selected assessment tasks were performed (WHO “priority indicators” shown in italics) ASSESSMENT TASKS CASES (%) IN WHOM TASK DONE, BY PROVIDER STATUS Trained n = 280 78 (27.9%)1 220 (78.6%)2 220 (78.6%)1 163 (58.2%)1 89 (31.8%)1 117 (41.8%)1 170 (60.7%)1 248 (88.6%)1 175 (62.5%)1 29 (10.4%)3 198 (70.7%)1 124 (44.3%) 6.61 8.81 Untrained n = 84 0 (0.0%) 52 (61.9%) 4 (4.8%) 0 (0.0%) 0 (0.0%) 0 (0.0%) 3 (3.6%) 43 (51.2%) 16 (19.0%) 4 (4.8%) 19 (22.6%) 51 (60.7%)4 3.41 3.51

o o o o o o o o o o o o

Child (correctly) checked for three general danger signs (ability to drink, vomiting everything, convulsions) Child checked for the presence of three main symptoms: cough, diarrhoea and fever Child checked for the presence of an ear problem Child (correctly) checked for palmar pallor Child (correctly) checked for visible wasting Child (correctly) checked for the presence of oedema of both feet Child temperature taken (by thermometer) Child weight taken and recorded Child weight checked against a growth chart Child road-to-health card asked Child vaccination status checked Child checked for the presence of other problems

x WHO INDEX OF INTEGRATED ASSESSMENT (Mean of 10 assessment tasks performed)# x ADAPTED INDEX OF INTEGRATED ASSESSMENT – SUDAN (Mean of 14 assessment tasks performed)# 1 P<0.0001 2

P<0.01 = difference not significant (P>0.05) 4 P<0.05 3 NS #

Index calculated as the arithmetic mean of the following 10 assessment tasks: child checked for three danger signs (1,2,3), and the three main symptoms (4,5,6); child weighed and weight recorded (7) and checked against a growth chart (8); child checked for palmar pallor (9) and health card asked to check for vaccination status (10). The Sudan index adds the following 4 tasks: child’s temperature checked with thermometer (11) and child checked for the presence of ear problem (12), wasting (13), and oedema of both feet (14).

120

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

121

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

Table A37. Assessment of feeding practices in all children under two years old or in older children with anaemia and/or very low weight, by provider training status# TARGET GROUPS FOR ASSESSMENT OF FEEDING PRACTICES O Children under 2 years old - not referred by provider - assessed for feeding practices: breastfeeding, complementary foods and changes in feeding during this episode of illness: > Children under 2 years old - not referred by provider - with very low weight and/or anaemia assessed for feeding practices > Children under 2 years old - not referred by provider without very low weight and/or anaemia assessed for feeding practices o Children 2 years old or older - not referred by provider – with very low weight and/or anaemia assessed for feeding practices x IMCI target group for feeding assessment: Children not referred by provider who are under 2 years old or older children with very low weight and/or anaemia assessed for feeding practices # Children 1P

FEEDING PRACTICES ASSESSED No. (%)

TRAINED 52/149 (34.9%)1

UNTRAINED 0/40 (0.0%)

9/23 (39.1%)2 43/126 (34.1%)1 2/29 (6.9%)2

0/6 (0.0%) 0/34 (0.0%) 0/7 (0.0%)

54/178 (30.3%)1

0/47 (0.0%)

not referred by provider

2 NS

< 0.001 = difference not significant (P>0.05)

122

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

Table A38. Use of correct methodology for selected assessment tasks, by provider training status TASK Child weighed Child’s weight correctly taken Child’s temperature taken Child’s temperature correctly taken Children with cough or difficult breathing: > Respiratory rate counted > Respiratory rate correctly counted > Respiratory rate considered reliable in those in whom counted Children with diarrhoea: > Duration of episode asked > Presence of blood in stools asked > Something to drink offered > Abdomen skin pinched > Abdomen skin correctly pinched Children with ear problem: > a. Looks at both ears > b. Looks for tender swelling behind ear > Looks for both Children with fever: > Checks for measles within the last 3 months 1 Surveyor’s 2P 3P 4

TRAINED n = 280 254 (90.7%)2 155 (55.4%)3 n = 280 170 (60.7%)2 50 (17.9%)2 n = 187 167 (89.3%)2 128 (68.4%)4 n = 1661 68 (41.0%) n = 85 75 (88.2%)2 59 (69.4%)2 54 (63.5%)2 70 (82.4%)2 35 (41.2%) n = 26 11 (42.3%) 5 (19.2%) 5 (19.2%) n = 165 87 (52.7%)2

UNTRAINED n = 84 46 (54.8%) 39 (46.4%) n = 84 3 (3.6%) 0 (0.0%) n = 41 6 (14.6%) 2 ( 4.9%) n=6 2 (33.3%)5 n = 24 8 (33.3%) 3 (12.5%) 1 ( 4.2%) 5 (20.8%) 1 ( 4.2%)5 n=5 0 (0.0%)5 0 (0.0%)5 0 (0.0%)5 n = 42 0 (0.0%)

count missing in 1 case, excluded from this analysis

< 0.001 < 0.01 P < 0.05 5 Very few total observations as denominator: NS = difference not significant (P>0.05)

123

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

124

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

125

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

Table A39. Agreement of provider’s classifications with surveyor’s classifications for 189 cases needing treatment, urgent referral or special counselling, by provider training status# CLASSIFICATIONS Danger signs Severe or non-severe pneumonia Severe or some dehydration Severe and non-severe persistent diarrhoea Dysentery Very severe febrile disease or malaria Severe or non-severe measles with or without complications Mastoiditis, acute or chronic ear infections Severe malnutrition or very low weight Severe or non-severe anaemia CHILDREN FOR WHOM THERE WAS AGREEMENT ON THE ABOVE CLASSIFICATIONS #

AGREEMENT TRAINED1 UNTRAINED1 0/2 (0.0%) 0/1 (0.0%) 32/54 (59.3%) 4/8 (50.0%) 3/7 (42.9%) 4/8 (50.0%) 37/52 (71.2%) 0/4 (0.0%) 7/23 (30.4%) 9/21 (42.9%) 11/47 (23.4%) 53/154 (34.4%)2 4/10 (40.0%) 0/3 (0.0%) 0/3 (0.0%) No case seen 10/13 (76.9%) No case seen 3/4 (75.0%) 1/5 (20.0%) 2/14 (14.3%) 7/35 (20.0%)

Includes all “red” and “yellow” row classifications of the IMCI chart, and measles. The proportion of cases with the above classifications seen by IMCI-trained provider was higher than that seen by untrained providers. The difference was statistically significant at P<0.05. These cases require more clinical skills than those with “green” row classifications that need only advice on home care.

1 The number of cases in the untrained group, and for some indicators also in the trained group, was too small for any difference to reach statistical significance 2 NS = difference not significant (P>0.05)

126

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

Table A40. Oral antibiotic treatment prescribed correctly for children with an “IMCI condition”, by provider training status# CASES x Children with an IMCI condition not requiring urgent referral and needing oral antibiotics: > Prescribed oral antibiotics > Prescribed a recommended oral antibiotic > Prescribed recommended oral antibiotics correctly (see below): - Of those prescribed recommended oral antibiotics: > 1. Prescribed correct amount (dose) > 2. Prescribed correct number of times per day (frequency) > 3. Prescribed correct number of days (duration) > Prescribed correctly (all 3 above) x Caretakers of children prescribed recommended oral antibiotics: > 1. Knowing the dose to be given each time > 2. Knowing the number of times a day to be given > 3. Knowing for how many days to be given > Able to describe correctly how to give antibiotics (i.e., knowing all 3 above) x Pneumonia cases (not requiring urgent referral): > Prescribed oral antibiotics > Prescribed recommended oral antibiotics > Prescribed recommended oral antibiotics correctly x Dysentery cases (not requiring urgent referral): > Prescribed oral antibiotics > Prescribed recommended oral antibiotics > Prescribed recommended oral antibiotics correctly x Children not needing antibiotics (for an IMCI or non-IMCI reason) and not requiring urgent referral: > Prescribed no antibiotics > Prescribed antibiotics unnecessarily #

TRAINED n = 69 49 (71.0%) 48 (69.6%) 26 (37.7%)1 n = 48 30 (62.5%) 44 (91.7%) 35 (72.9%) 26 (54.2%) n = 48 24 (50.0%) 29 (60.4%) 22 (45.8%) 12 (25.0%)2 n = 45 36 (80.0%) 35 (77.8%) 18 (40.0%)1 n=8 4 (50.0%) 3 (37.5%) 3 (37.5%) n = 193 143 (74.1%) 50 (25.9%)3

UNTRAINED n = 11 9 (81.8%) 6 (54.5%) 0 (0.0%) n=6 1 (16.7%) 4 (66.7%) 1 (16.7%) 0 ( 0.0%) n=6 0 (0.0%) 1 (16.7%) 2 (33.3%) 0 (0.0%) n=9 7 (77.8%) 4 (44.4%) 0 ( 0.0%) n=0 n = 61 16 (26.2%) 45 (73.8%)

Children needing oral antibiotics and not requiring urgent referral

1P

< 0.05 = difference not significant (P>0.05) 3 P < 0.001 2 NS

127

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

128

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

129

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

Table A41. Oral antimalarial treatment prescribed correctly for children with malaria not requiring urgent referral, by provider training status CASES x Children with malaria not requiring urgent referral: > Prescribed (recommended) oral antimalarials > Prescribed recommended oral antimalarials correctly (see below) - Of those prescribed recommended oral antimalarials: > 1. Prescribed correct amount (dose) > 2. Prescribed correct number of times per day (frequency) > 3. Prescribed correct number of days (duration) > Prescribed correctly (all 3 above) x Caretakers of children prescribed recommended oral antimalarials: > 1. Knowing the dose to be given each time > 2. Knowing the number of times a day to be given > 3. Knowing how many days to be given > Able to describe correctly how to give antimalarials (i.e., knowing all 3 above) 1

TRAINED n = 49 37 (75.5%)1 15 (30.6%)1 n = 37 16 (43.2%) 29 (78.4%) 28 (75.7%) 15 (40.5%)1 n = 37 13 (35.1%) 14 (37.8%) 16 (43.2%) 9 (24.3%)2

UNTRAINED n = 13 9 (69.2%) 2 (15.4%) n=9 5 (55.6%) 9 (100%) 5 (55.6%) 2 (22.2%) n=9 0 ( 0.0%) 2 (22.2%) 0 ( 0.0%) 0 ( 0.0%)

2P

NS = difference not significant (P>0.05) < 0.05

130

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

131

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

Table A42. Oral rehydration salts (ORS) prescribed correctly for children with diarrhoea not requiring urgent referral, by provider training status CASES x Children with diarrhoea not needing urgent referral: > Given correct instructions on ORS, including its preparation (all three below): - Of those given ORS: > 1. Correctly advised on amount of water to mix with 1 ORS sachet to prepare the solution > 2. Correctly advised on when to give ORS to the child each day > 3. Correctly advised on how much ORS to give to the child each time x Caretakers of children prescribed ORS: > 1. Knowing how much water to mix with 1 ORS sachet to prepare solution > 2. Knowing when to give ORS to the child each day > 3. Knowing how much ORS to give to the child each time > Able to describe correctly how to give ORS (i.e., knowing all 3 above) 1P 2 NS

TRAINED n = 82 17 (20.7%)1 n = 43 31 (72.1%) 19 (44.2%) 17 (39.5%)

UNTRAINED n = 22 0 (0.0%) n = 11 0 (0.0%) 0 (0.0%) 0 (0.0%)

34 (79.1%) 15 (34.9%) 24 (55.8%) 12 (27.9%)2

8 (72.7%) 1 ( 9.1%) 3 (27.3%) 1 ( 9.1%)

< 0.05 = difference not significant (P>0.05)

132

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

133

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 Table A43. Antibiotic, antimalarial and/or ORS treatment: communication tasks in giving advice, by provider training status ADVICE x Caretakers of children not needing urgent referral, requiring an antibiotic for an IMCI condition and prescribed oral antibiotics: > 1. Given advice on dose, frequency and duration of treatment > 2. Given demonstration on how to give it > 3. Asked open-ended question to check for understanding > For whom at least 2 of the above 3 counselling tasks were performed > Given first dose of antibiotic at the facility x Caretakers of children not needing urgent referral, requiring an antimalarial and prescribed oral antimalarials: > 1. Given advice on dose, frequency and duration of treatment > 2. Given demonstration on how to give it > 3. Asked open-ended question to check for understanding > For whom at least 2 of the above 3 counselling tasks were performed > Given first dose of antimalarial at the facility x Caretakers of children with diarrhoea not needing urgent referral given ORS: > 1. Given advice on dose, frequency and duration of treatment > 2. Given demonstration on how to give it > 3. Asked open-ended question to check for understanding > For whom at least 2 of the above 3 counselling tasks were performed 1 For

TRAINED n = 49 33 (67.3%) 9 (18.4%) 10 (20.4%) 12 (24.5%) 7 (14.3%) n = 37 31 (83.8%) 8 (21.6%) 9 (24.3%) 11 (29.7%) 2 ( 5.4%) n = 43 28 (65.1%)1 11 (25.6%) 11 (25.6%) 17 (39.5%)

UNTRAINED n=9 4 (44.4%) 1 (11.1%) 1 (11.1%) 1 (11.1%) 2 (22.2%) n=9 6 (66.7%) 0 (0.0%) 0 (0.0%) 0 (0.0%) 0 (0.0%) n = 11 0 (0.0%) 0 (0.0%) 0 (0.0%) 1 (9.1%)

this indicator: P < 0.001. For all the other indicators in this table no significant difference (P>0.05).

134

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

135

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

Table A44. Advice on home care: advice given, by provider training status CASES x Caretakers of children not needing urgent referral advised by the provider: > To give extra fluids > To continue feeding > Both messages on extra fluids and continue feeding x Caretakers of children not needing urgent referral advised by the provider to take the child back to the facility immediately if the child: - 1. Is unable to drink - 2. Becomes sicker - 3. Develops a fever (for those not having fever by history or temperature) > All the three above (the first 2 signs for all children and the last one only for children with no fever) x Caretakers of children classified as “cough or cold: no pneumonia” not needing urgent referral advised by the provider to take the child back to the facility immediately if the child: - 4. Develops fast breathing - 5. Develops difficult breathing x Caretakers of children with “diarrhoea and no signs of dehydration”, not needing urgent referral, advised to take the child back to the facility immediately if the child: - 6. Has blood in stools (for those with no bloody stools) - 7. Drinks poorly x Caretakers of children not needing urgent referral advised by the provider to take the child back to the facility immediately: > On at least three of the above 7 signs > Caretakers advised on all the three home care rules (to give extra to drink and continue feeding and at least three signs on when to return immediately) 1 2

TRAINED n = 269 139 (51.7%)2 132 (49.1%)2 113 (42.0%)2 n = 269 74 (27.5%)2 107 (39.8%)2 n = 108 36 (33.3%)2 n = 269 52 (19.3%)2 n = 132 30 (22.7%)3 34 (25.8%)4 n = 75 13 (17.3%)5 5 (6.7%)5 n = 269 69 (25.7%)1 n = 269 41 (15.2%)6

UNTRAINED n = 81 4 (4.9%) 1 (1.2%) 0 (0.0%) n = 81 0 (0.0%) 5 (6.2%) n = 39 0 (0.0%) n = 81 0 (0.0%) n = 30 0/30 (0.0%) 0/30 (0.0%) n = 20 0 (0.0%) 0 (0.0%) n = 81 0 (0.0%) n = 81 0 (0.0%)

This denominator refers to children having no fever

P < 0.0001 < 0.05 4 P < 0.01 5 NS = difference not significant (P>0.05) 6 P < 0.001 3P

136

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

137

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 Table A45: Caretakers of children not referred by provider advised on home care by use of the mother home care counselling card and communication techniques, by provider training status TASK/SKILL x Caretaker of children not referred by provider with whom provider: - Used the home care card; - Used the home card and good communication techniques1 x Use of good communication techniques in cases in whom the home care card was used: > Holding card properly > Pointing at pictures >Checking for caretaker understanding 1

TRAINED n = 266 118 (44.4%)1 18 ( 6.8%)2 n = 118 31 (26.3%) 29 (24.6%) 27 (22.9%)

UNTRAINE D n = 81 0 (0.0%) 0 (0.0%) n=0 0 0 0

This indicator includes cases in whom all the following occurred: a) the home care card was used; b) The card was either held properly facing the caretaker or the pictures on the card were pointed at while counselling; and c) Caretaker understanding of the advice given was checked by open-ended questions < 0.001 < 0.01

1P 2P

Table A46. Children needing immunisation and given it or advised to come back for a scheduled session, by provider training status CASES x Children needing vaccinations and not referred by provider: > Leaving the facility with all needed vaccinations given > Leaving the facility with all needed vaccinations given or advice to come back for vaccination on scheduled vaccination day 1 NS

TRAINED n = 56 14 (25.0%)1 29 (51.8%)

UNTRAINE D n = 18 4 (22.2%) 7 (38.9%)

= difference not significant (P>0.05)

138

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

QUALITY OF CARE: HEALTH SYSTEMS AVAILABILITY OF DRUGS

Table A47. Indexes of availability of at least a treatment course of drugs for IMCI CATEGORY OF DRUGS o o Index of availability of essential oral treatments, namely cotrimoxazole, chloroquine, ORS, Vitamin A, iron and paracetamol (Max index = 6) Index of availability of the 12 non-injectable drugs for IMCI, including the 6 drugs listed above and the following: amoxycillin, nalidixic acid, sulfadoxine-pyrimethamine, diazepam, tetracycline eye ointment and gentian violet (Max index = 12) Index of availability of injectable drugs for pre-referral treatment for children and young infants needing urgent referral, namely chloramphenicol, quinine, benzylpenicillin and gentamicin (Max index = 4) INDEX 5.01 out of 6 8.72 out of 12

o 1

2.63 out of 4

Arithmetic mean of the 6 essential oral drugs recommended for home treatment of pneumonia and dysentery, malaria, diarrhoea, anaemia and fever. Expressed as a percentage, the index is 83.3%. 28 (42%) of the 66 facilities had all the 6 drugs; 18 (27%) facilities had 5 of the 6 drugs available 2 Arithmetic mean of the 12 non-injectable drugs required for IMCI. Expressed as a percentage, the index is 72.5%. 6 (9%) of the 66 facilities had all the 12 drugs; 5 (8%) had 10 and 55 (83%) had 9 or less. 3 Arithmetic mean of the 4 recommended injectable drugs for pre-referral treatment of children under five years old with severe classification. Expressed as a percentage, the index is 65.0%. 25 (38%) facilities had all the 4 drugs available, 10 (15%) had 3 of these drugs (chloramphenicol missing in 5 facilities – 4 health centres and 1 dispensary -, gentamicin in 3 – 1 health centre and 2 dispensaries- and quinine in 1, while benzylpenicillin was available in all the 10).

139

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003 Table A48. Availability of individual drugs recommended for IMCI at the 66 facilities surveyed DRUGS Cotrimoxazole Chloroquine ORS Vitamin A Iron Paracetamol Amoxycillin Nalidixic acid Sulfadoxine-pyrimethamine Tetracycline eye ointment Gentian violet Salbutamol solution or metered dose inhaler Salbutamol syrup Diazepam Chloramphenicol (inj) Quinine (inj) Benzylpenicillin (inj) Procaine penicillin (inj) Gentamicin (inj) Ringer’s Lactate Solution2 Saline2 1 Information 2

AVAILABLE No. (%) 64 (97%) 65 (98%) 61 (92%) 47 (71%)1 37 (56%) 56 (85%)1 61 (92%) 12 (18%) 46 (70%)1 41 (62%) 33 (50%) 8 (12%) 45 (68%) 54 (82%) 33 (50%) 45 (68%) 61 (92%)1 49 (74%) 33 (50%)1 14 (21%)1,3 43 (65%)3

missing for 1 facility Acceptable IV solutions for rehydration of diarrhoea cases with severe dehydration. Ringer’s Lactate Solution available in only one of the five hospitals visited. 3 At least one of the two intravenous solutions available in 48 (72.7%) of the 66 facilities surveyed.

140

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

141

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

QUALITY OF CARE: HEALTH SYSTEMS AVAILABILITY OF EQUIPMENT AND SUPPLY

Table A49. Availability of equipment and supply items for IMCI at the 66 facilities surveyed ITEMS Accessible and working adult scale* Accessible and working baby scale* Watch or other working timing device * Supplies to mix ORS (cups, spoons)* Source of clean water (tap water)* - Functioning microscope - Slides - Giemsa - Lancets to prick finger All 4 items for malaria laboratory Mother counselling card on home care for use by provider# Road-to-health cards Drug stock cards Vaccination register IMCI chart booklet# Working nebuliser Thermometer IMCI recording forms IMCI daily register 1Information 2

AVAILABLE No. (%) 30 (45%) 62 (94%) 59 (89%) 58 (88%) 60 (91%) 46 (70%) 51 (77%) 51 (77%) 45 (68%) 41 (62%) 51 (77%) 46 (70%)2 27 (41%)1 43 (65%)1 58 (88%) 10 (15%) 52 (79%) 51 (77%) 43 (65%)

missing for one facility Information missing for 2 facilities * Facilities with basic equipment and materials (items marked with *): 21/66 (32%). # Facilities with mother counselling card and IMCI chart booklet: 51/66 (77%).

142

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

143

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

144

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

Table A50. Availability of equipment and supply for vaccination1 ITEMS Facilities that reported providing immunization services Facilities with availability of: 1. Needles and syringes for vaccinations - Safety box to dispose of used needles and syringes 2. Functioning refrigerator with correct temperature inside 3. Cold box and all ice packs frozen Availability of equipment and supply for vaccination (1. and either 2. or 3. above) 1

AVAILABILITY No. (%) 53/66 (80.3%)1,2 n = 53 49 (92.4%) 41 (77.4%) 17 (32.1%)3 9 (17.0%) 19 (35.8%)4

The proposed WHO index of availability of key vaccines was not calculated because facilities providing immunisation services may receive the vaccines just for the immunization session. Vaccines would therefore not be found necessarily during the other days of the week. Thus, information on availability of vaccines on the day of the visit during the survey would have been misleading in the case of Sudan. Among the 13 facilities that did not provide immunisation services were: 4 health centres and 9 dispensaries. 2 This rate has to be interpreted with caution. In Sudan, even if some facilities may provide no immunization services, these services may be provided to the areas they cover by other levels of the health system through outreach services directly to those areas. 3 No information available on one refrigerator locked at the time of the visit 4 However, vaccines may be taken to the health facility by vaccine carrier on the day of the immunization session. No cold chain equipment would therefore be found at these facilities in these cases.

145

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

QUALITY OF CARE: HEALTH SYSTEMS IMMUNIZATION SERVICES

Table A51. Immunization sessions in the 53 facilities providing immunization services# SERVICE x Immunization sessions held weekly: > Number of sessions per week: - 1 session - 2 sessions - 3 sessions - 4 sessions - 6 sessions x Immunization session for selected or all antigens held less frequently than weekly but within any given month # 13

AVAILABILITY No. (%) 47 (88.7%) 2 ( 3.8%) 13 (24.5%) 8 (15.1%) 2 ( 3.8%) 22 (41.5%) 16 (30.2%)

facilities reported providing no immunization services and are excluded from this denominator

Table A52. Provision of vaccines in the 53 facilities providing immunization services# Availability of antigens > All antigens below - Measles - BCG - DPT - OPV # 13

Available weekly 37 (69.8%) 41 (77.3%) 40 (75.5%) 45 (84.9%) 46 (86.8%)

Not available weekly but available monthly 13 (24.5%) 12 (22.6%) 10 (18.9%) 8 (15.1%) 7 (13.2%)

Total available within any given month 50 (94.3%) 53 (100%) 50 (94.3%) 53 (100%) 53 (100%)

facilities reported providing no immunization services and are excluded from this denominator

146

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

QUALITY OF CARE: HEALTH SYSTEMS FACILITY SERVICES AND SUPERVISION

Table A53. Referral (n = 66 health facilities surveyed) SERVICE Availability of transportation to reach the referral facility1 > Time to go to the referral hospital: - Less than 30 minutes - From 31 minutes up to 1 hour - More than an hour Facilities reporting problems with referral 1

No. (%) 56 (84.8%)

52 (78.8%) 11 (16.7%) 3 ( 4.5%) 21 (31.8%)

Any means of transportation available to, and affordable by, the population living in the area covered by the facility

Table A54. Facility services and supervision (n = 66 health facilities surveyed) SERVICE Clinical services both for adults and for children available: 7 days a week 6 days a week 5 days a week 14 (21.2%) 50 (75.8%) 2 ( 3.0%) 33 (50.0%) 17 (25.8%)1 7 (10.6%)2 10 (15.2%)3 1 (1.5%)3 No. (%)

Facilities with a supervisory visit in the past 6 months Facilities with a supervisory book a) Case management observed as part of supervisory visit in the past 6 months b) Last visit’s recommendations recorded on the supervisory book Facilities that received clinical supervision with findings recorded 1Information 2

missing for 5 facilities Information missing for 2 facilities 3 Information on availability of supervisory book not available for 7 facilities; supervisory book not found in 3 facilities in which the health provider said it was available

147

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

148

Health facility survey on the quality of outpatient child health services, Sudan, March–April 2003

A P P E N D I X SURVEY FORMS [English and, where applicable, Arabic version]

149

Enrolment Card State: __________________________

Date: ______/______/ 2003

District: _____________________________ Facility type: [HOSP] Ԙ

Facility code: |___|___| Facility Name: __________________ Child’s Name: ________________ Child’s ID: |___|___|

[HC] ԙ [D/DS] Ԛ

Questionnaire # ~__~__~__~__~ HF code | Child ID

Child’s birthdate: |___|___| /|___|___| /|___|___|___|___| Age (months):|___|___|

Child sex: [M] Ԙ

[F] ԙ

ŷ Include only children 2 months up to 5 years, i.e. born after ____ March 1998 and before ____ January 2003. (today’s date) (today’s date)

EC1. Ask caretaker whether this is the first (initial) visit for this illness of the child at this facility. DO NOT INCLUDE follow-up visits for the same episode of illness. 1st visit?: [Yes] Ԙ [No] ԙ Æ \ STOP here EC2. Ask reasons for bringing child to health facility and tick ¥ all signs mentioned (then probe, asking: ‘Any other problems?’). A. Diarrhoea………A. [Yes] Ԙ [No] ԙ B. Fever/malaria….B. [Yes] Ԙ [No] ԙ



È B1.If Yes: write term used: __________________________________________________ D. [Yes] Ԙ [No] ԙ

C. Cough……….…C. [Yes] Ԙ [No] ԙ D. Fast/difficult breathing/ pneumonia



È D1.If Yes: write term/s used:__________________________________________________ È D2.Ask how long caretaker waited to seek care since she realised child had this sign: days |___|

E. Ear problem ...... E. [Yes] Ԙ [No] ԙ F. Unable to drink/breastfeed, vomiting everything, convulsions, lethargic/unconscious F. [Yes] Ԙ [No] ԙ

ÈF1. Ask how long caretaker waited to seek care since she realised child had this sign: days |___| G. Other…………...G. [Yes] Ԙ[No] ԙ (If Yes: specify _____________________________________________)

EC3. Ask: “What symptom worried you most that made you decide to take your child here?” __________________________________________ (write local term as mentioned by caretaker)

(___________________________________________________) (write meaning in English)

Read statement on this survey to caretaker and ask for her/his consent: Consent given: [Yes] Ԙ [No] ԙ (Supervisor initials: ______) Weight: |___|___|.|___| Form 1:Observation [ ] Ã Temperature: |___|___|.|___| 0C Form 2:Caretaker interview [ ] |___|___|.|___| 0F

Form 3:Re-examination [ ]

Approximate time taken for observation: __________ minutes

FORM 1 - OBSERVATION

Questionnaire No.

|___|___Œ___|___| HF code Œ Child ID .

Form 1. OBSERVATION CHECKLIST—CHILD (2 months - 5 years) Date: ____/____/ 2003 Child: Name_______________ Surveyor ID: |___|___| Facility: Code: |___|___| ID:|___|___| Type: [HOSP]Ԙ

[HC]ԙ

[D/DS]Ԛ

Birth date: _____/_____/______ Age (months)|___|___| ID: |___| Sex: [M] Ԙ [Nurse] Ԛ [F] ԙ

Health worker: Name ______________ Type: [Doctor] Ԙ

[Medical ass’t] ԙ

™I1. Health worker trained in IMCI?

[Yes] Ԙ

[No] ԙ Î Skip to question # A1

 If YES (trained in IMCI):

" I2. When trained in IMCI? |___|___||___|___||___|___|___|___| (Day) || Month || Year

" I3. Followed up after training? [Yes] Ԙ [No] ԙ Î Skip to question # A1

 If YES (followed up):

" I4. How many follow-up (not supervisory) visits after the training course? |___|___| visits

" I5. How long after the training course the 1st follow-up visit? [<2 months] Ԙ [2 or more months] ԙ

[Don’t remember] ԟ

ASSESSMENT MODULE (Record what you hear or see) ¾WEIGHT A1. Does the health worker, or another staff, weigh the child today?

[Yes] Ԙ

[No] ԙÎ Skip to question # A4

[Don’t know] ԟ Î Skip to question # A4

 If YES (weight taken): ‫ڡ‬ A1a. Who has taken the weight?

[Doctor]Ԙ [Medical ass’t]ԙ ‫ڡ‬

[Nurse]Ԛ

[Nutrition educator]ԛ

[Vaccinator]Ԝ

[Health visitor]ԝ

A1b. Is the weight taken correctly?

[Yes] Ԙ ‫ڡ‬

[No] ԙ

[Don’t know] ԟ

A1c. Is the weight recorded?

[Yes] Ԙ

[No] ԙ Record the weight, if taken, on the enrolment card

-

1 -

FORM 1 - OBSERVATION ¾TEMPERATURE A4.

Questionnaire No.

|___|___Œ___|___| HF code Œ Child ID .

Does the health worker, or another staff, check the temperature of the child today (with thermometer)?

[Yes]Ԙ

[No] ԙÎ Skip to question # A6

[Don’t know] ԟ Î Skip to question # A6

 If YES (temperature taken): ‫ڡ‬ A4a. Who has taken the temperature?

[Doctor]Ԙ [Medical ass’t]ԙ ‫ڡ‬

[Nurse]Ԛ

[Nutrition educator]ԛ [Vaccinator]Ԝ

[Health visitor]ԝ

A4b. Is the temperature taken correctly?

[Yes]Ԙ ¾DANGER SIGNS A6.

[No] ԙ

[Don’t know] ԟ Record the temperature, if taken, on the enrolment card

Does the health worker ask and correctly check whether the child is able to drink or breastfeed?

[Yes]Ԙ A7.

[No] ԙ

[Child breastfeeding now] Ԛ

Does the health worker ask and correctly check whether the child vomits everything?

[Yes]Ԙ A8.

[No] ԙ

Does the health worker ask and correctly check whether the child has convulsions (related to this episode of illness)?

[Yes]Ԙ A9.

[No] ԙ

[Child convulsing now] Ԛ

Is the child visibly awake (e.g., playing, smiling, crying with energy)?

[Yes]ԘÎ Skip to question # A11 ‫ڡ‬

[No] ԙ

A10.  If child NOT visibly awake: Does the health worker check for lethargy or unconsciousness (try to wake up the child)?

[Yes]Ԙ A11.

[No] ԙ

Does the health worker ask for COUGH or DIFFICULT BREATHING?

[Yes]Ԙ ‫ڡ‬

[No] ԙÎ Skip to question # A12

A11a.  If YES: Does the child have cough or difficult breathing?

[Yes]Ԙ

[No] ԙÎ Skip to question # A12

[Don’t know] ԟÎ Skip to question # A12

If YES, child has cough or difficult breathing: ‫ڡ‬ A11b. Does the health worker count the respiratory rate?

[Yes]Ԙ

[No] ԙÎ Skip to question # A12

-

2 -

FORM 1 - OBSERVATION If YES, rate is counted: ‫ڡ‬

Questionnaire No.

|___|___Œ___|___| HF code Œ Child ID .

A11c. Child calm before and during the count?

[Yes] Ԙ ‫ڡ‬ 

[No] ԙ

A11d. Respiratory rate counted correctly?

[Yes] Ԙ ‫ڡ‬ A12.

[No] ԙ |___|___|

A11e. Write the respiratory rate/min counted by the health worker: Does the health worker ask for DIARRHOEA?

[Yes]Ԙ ‫ڡ‬

[No] ԙÎ Skip to question # A121

A12a.  If YES: Does the child have diarrhoea?

[Yes]Ԙ

[No] ԙÎ Skip to question # A121

[Don’t know] ԟÎ Skip to question #A121

 If YES, child has diarrhoea: ‫ڡ‬ A12b. Does the health worker ask for how long the child has been having diarrhoea?

[Yes]Ԙ ‫ڡ‬

[No] ԙ

A12c. Does the health worker ask if there is blood in the stools?

[Yes]Ԙ ‫ڡ‬

[No] ԙ

A12d. Does the health worker offer the child something to drink or observe breastfeeding?

[Yes]Ԙ ‫ڡ‬

[No] ԙ

A12e. Does the health worker pinch the abdomen skin?

[Yes]Ԙ ‫ڡ‬

[No] ԙÎ Skip to question # A121

A12f.  If YES: Does the health worker pinch the skin correctly?

[Yes]Ԙ

[No] ԙ

A121. Does the health worker ask if the child has an EAR PROBLEM?

[Yes]Ԙ ‫ڡ‬

[No] ԙÎ Skip to question # A13

A121a.  If YES: Does the child have an ear problem?

[Yes]Ԙ

[No] ԙ Î Skip to question # A13

[Don’t know] ԟÎ Skip to question # A13

If YES, child has an ear problem: ‫ڡ‬ A121b. Does the health worker look at both ears of the child?

[Yes]Ԙ ‫ڡ‬

[No] ԙ

A121c. Does the health worker feel for swelling behind both ears of the child?

[Yes]Ԙ

[No] ԙ

-

3 -

FORM 1 - OBSERVATION A13.

Questionnaire No.

|___|___Œ___|___| HF code Œ Child ID .

Does the health worker ask/feel for FEVER (or refer to temperature if taken previously)?

[Yes]Ԙ ‫ڡ‬

[No] ԙÎ Skip to question # A14

A13a.  If YES: Does the child have fever (• 37.50C) or history of fever?

[Yes]Ԙ

[No] ԙÎ Skip to question # A14

[Don’t know] ԟÎ Skip to question # A14

If YES, child has fever: ‫ڡ‬ A13b. Does the health worker ask if child had MEASLES within the last 3 months?

[Yes]Ԙ A14.

[No] ԙ

Does the health worker check for visible severe WASTING?

[Yes]Ԙ A15.

[No] ԙ

[Don’t know] ԟ

Does the health worker look for PALMAR PALLOR?

[Yes]Ԙ A16.

[No] ԙ

[Don’t know] ԟ

Does the health worker look for OEDEMA of both feet?

[Yes]Ԙ A17.

[No] ԙ

[Don’t know] ԟ

Does the health worker check child’s WEIGHT against a growth chart?

[Yes]Ԙ

[No] ԙÎ Skip to question # A18a

 If YES (weight checked against the growth chart): ‫ڡ‬ A17a. Who has checked the weight against a growth chart?

[Doctor]Ԙ [Medical ass’t]ԙ

[Nurse]Ԛ

[Nutrition educator]ԛ [Vaccinator]Ԝ

[Health visitor]ԝ

A18a. Does the health worker ask for the child’s road-to-HEALTH CARD?

[Yes]Ԙ A19.

[No] ԙÎ Skip to question # A20

Does the caretaker have the child’s road-to-health card?

[Yes]Ԙ

[No] ԙÎ Skip to question # A20

A19a. Does the health worker check the child’s road-to-health card?

[Yes]ԘÎ Skip to question # A21 ‫ڡ‬

[No] ԙ

A20. If caretaker does NOT have the health card or health worker does not check it: Does the health worker try to find out from the caretaker whether the child has ever received: .. a. An injection in the forearm against tuberculosis (BCG)? ....... a. b. Drops against polio? ...............................................................b. c. An injection against DPT (thigh)?............................................c. d. A ‘9 months injection’ against measles? .................................d. e. Vitamin A blue/red capsule with nipple? ...................................e.

[Yes] Ԙ [No] ԙ [Yes] Ԙ [No] ԙ [Yes] Ԙ [No] ԙ [Yes] Ԙ [No] ԙ=NA] Ԛ [Yes] Ԙ [No] ԙ=NA] Ԛ

-

4 -

FORM 1 - OBSERVATION A21.

Questionnaire No.

|___|___Œ___|___| HF code Œ Child ID .

Does the health worker ask about BREASTFEEDING?

[Yes]Ԙ A22.

[No] ԙ

Does the health worker ask whether the child takes any other FOODS/FLUIDS?

[Yes]Ԙ A23.

[No] ԙ

Does the health worker ask whether child FEEDING CHANGED DURING ILLNESS?

[Yes]Ԙ

[No] ԙ

A23a. Who has asked these questions on feeding? (Tick all that apply)

[Doctor]Ԙ [Medical ass’t]ԙ [None] Ԟ A24.

[Nurse]Ԛ

[Nutrition educator]ԛ [Vaccinator]Ԝ

[Health visitor]ԝ

Does the health worker ask whether the child has “OTHER PROBLEMS”?

[Yes]Ԙ

[No] ԙ

-

5 -

FORM 1 - OBSERVATION

Questionnaire No.

|___|___Œ___|___| HF code Œ Child ID .

Classification Module C1. Does the health worker give one or more classifications for the child? If the health worker does not say anything spontaneously, probe by asking what his/her conclusions are about the child. If he does not know after probing, tick “No”

[Yes] Ԙ

[No] ԙÎ skip to Treatment Module To be completed by supervisor: Based on the re-examination of the child (Form 3) tick surveyor classifications: YES NO 105. One or more danger signs....................... [1] [2] 110. Severe pneumonia/ Very sev. Disease..... [1] [2] 111. Pneumonia............................................... [1] [2] 112. No pneumonia (cough or cold) .............. [1] [2] 113. Wheezing .................................................. [1] 120. (a) Severe dehydration ............................ [1] 120. (b) Some dehydration............................... [1] 120. (c) No dehydration ................................... [1] 121. Severe persistent diarrhoea .................... [1] 122. Persistent diarrhoea................................ [1] 123. Dysentery................................................ [1] 130. Very severe febrile disease...................... [1] 131. Malaria .................................................... [1] 132 Fever, malaria unlikely ............................ [1] 134. Severe complicated measles.................... [1] 135. Measles with eye/mouth complication .... [1] 136. Measles .................................................... [1] 140. Mastoiditis............................................... [1] 141. Acute ear infection .................................. [1] 142. Chronic ear infection .............................. [1] 143. No ear infection....................................... [1] 150. a Severe malnutrition .............................. [1] 150. b Severe anaemia .................................... [1] 151. a Very low weight.................................... [1] 151. b Anaemia................................................ [1] 152. a Not very low weight/No anaemia......... [1] 160. Other: Eye infection ................................ [1] 161. Other(specify) ____________________[1] 162. Other(specify) ____________________[1] 163.Feeding problems ....................................[1] 164. Child needs to be referred?................... [1] [2] [2] [2] [2] [2] [2] [2] [2] [2] [2] [2] [2] [2] [2] [2] [2] [2] [2] [2] [2] [2] [2] [2] [2] [2] [2] [2]

Record all classifications given in the table below:

YES NO C05. C10. C11. C12. One or more danger signs ........................ [1] Severe pneumonia/very severe disease ..... [1] Pneumonia ................................................ [1] No pneumonia (cough or cold) ................. [1] [2] [2] [2] [2] [2] [2] [2] [2] [2] [2] [2] [2] [2] [2] [2] [2] [2] [2] [2] [2] [2] [2] [2] [2] [2] [2] [2] [2] [2] [2]

C13. Wheezing .................................................. [1] C20a. Severe dehydration ................................ [1] C20b. Some dehydration.................................. [1] C20c. No dehydration...................................... [1] C21. Severe persistent diarrhoea ....................... [1] C22. Persistent diarrhoea................................... [1] C23. Dysentery.................................................. [1] C30. C31. C32. C34. C35. C36. C40. C41. C42. C43. Very severe febrile disease ....................... [1] Malaria...................................................... [1] Fever, malaria unlikely ............................. [1] Severe complicated measles ..................... [1] Measles with eye/mouth complications .... [1] Measles ..................................................... [1] Mastoiditis ................................................ [1] Acute ear infection.................................... [1] Chronic ear infection ................................ [1] No ear infection ........................................ [1]

C50a. Severe malnutrition ................................. [1] C50b. Severe anaemia ....................................... [1] C51a. Very low weight ...................................... [1] C51b. Anaemia .................................................. [1] C52a. Not very low weight/No anaemia............ [1] C60. Other: Eye infection ............................... [1] C61. Other (specify) ____________________ [1] C62. Other (specify) ____________________ [1] C63. Feeding problems ...................................... [1]

165. Follow-up visit required in ____days [if not required, enter 0] NOTE: IF CHILD HAS AN EYE PROBLEM, TICK [1] IN C60. 166. Any non-IMCI reason for antibiotics? ....[1] (e.g. skin infection, urinary tract infection, etc.) [2]

170. HIGH MALARIA RISK?..................... [1]

[2]

-

6 -

FORM 1 - OBSERVATION

Questionnaire No.

|___|___Œ___|___| HF code Œ Child ID .

TREATMENT MODULE T5. Does the health worker advise immediate referral for the child?

[Yes]Ԙ

[No] ԙÎ Skip to question # T1

 If YES (health worker advises immediate referral): ‫ڡ‬ T5a. Does the health worker explain to the caretaker the reasons for referral?

[Yes]Ԙ ‫ڡ‬

[No] ԙ

T5b. Does the caretaker accept referral for the child?

[Yes] Ԙ ‫ڡ‬

[No] ԙ

T5c. Does the health worker complete a referral note?

[Yes] Ԙ

[No] ԙ

Supervisor Correct as prereferral Tx?

T1. Does the health worker administer or prescribe injection(s)?

YES

NO

[Yes]Ԙ ‫ڡ‬

[No] ԙÎ Skip to question # T3

Ԙԙ F T1a1 F

T2.  If YES: Record all injections given: T2a. Antimalarial T2b. Antibiotic:

[Yes]Ԙ– T2as. Specify____________________ [No] ԙ [Yes]Ԙ– T2bs. specify __________________ [No] ԙ

F T2a1 F F T2b1 F

T2c. Other injection: [Yes]Ԙ– T2cs. specify ___________________ [No] ԙ T3. Does the health worker prescribe or give ORS sachets to take home?

[Yes]Ԙ

[No] ԙÎ Skip to question # T6

 If YES (health worker prescribes/gives ORS to take home): o ‫ڡ‬ Does the health worker explain: Supervisor Correct?

T3a. How much water to mix with 1 ORS sachet?

YES

NO

Ԙԙ † T3a1 †

[Yes]Ԙ If Yes, Amount: ____________________________ [No] ԙ ‫ڡ‬ T3b. When ORS should be given to the child during the day?

[Yes]Ԙ If Yes, When: ______________________________ [No] ԙ ‫ڡ‬ T3c. How much ORS should be given to the child each time?

† T3b1 †

[Yes]Ԙ If Yes, How much: __________________________ [No] ԙ ‫ڡ‬

† T3c1 †

T4. Does the health worker actually administer ORS – solution - to the child at the facility?

[Yes]Ԙ

[No] ԙ

[Don’t know] ԟ

T6. Does the health worker administer or prescribe oral treatment?

[Yes]Ԙ

[No] ԙÎ Skip to question # T12 if child not referred. If child referred and caretaker accepts referral, skip to question # CM12 at the end of the questionnaire.

-

7 -

FORM 1 - OBSERVATION

Questionnaire No.

|___|___Œ___|___| HF code Œ Child ID .

‫ڡ‬

T7.  IF YES: Record all oral treatment given: a. Antidiarrheal/antimotility .................................. a. [Yes]Ԙ a1. Cough/cold medicine...................................... a1. [Yes]Ԙ b. Metronidazole tablet/syrup .............................. b. [Yes]Ԙ c. Chloroquine tablets/syrup................................ c

[Yes]Ԙ

d. Sulfadoxine+pyrimethamine tablet.................. d. [Yes]Ԙ e. Paracetamol .................................................... e. [Yes]Ԙ f. Recommended* antibiotic tablets/syrup ......... f. (*: amoxycillin, cotrimoxazole, nalidixic acid)

[Yes]Ԙ

[No] ԙ [No] ԙ [No] ԙ [No] ԙ [No] ԙ [No] ԙ [No] ԙ [No] ԙ [No] ԙ [No] ԙ [No] ԙ [No] ԙ [No] ԙ [No] ԙ 

g. Other antibiotic tablet/syrup........................... g. [Yes]Ԙ .. [Yes]Ԙ g1. Salbutamol tablet/syrup.................................. g1. h. Vitamin A......................................................... h. [Yes]Ԙ i. Multi-vitamins .................................................. i. k. Mebendazole................................................... k. l. Iron tablet/syrup............................................... l. n. Others [Yes]Ԙ–

[Yes]Ԙ [Yes]Ԙ [Yes]Ԙ

n1. specify: _______________________

֐ If the health worker has referred the child and the mother has accepted referral (T5b=Yes), go to question CM12 at the end of the form. Otherwise, go to next question. ‫ڡ‬ T8. Is an oral antibiotic given or prescribed by the health worker? (see # T7)

[Yes]Ԙ ‫ڡ‬ T9.

[No] ԙÎ Skip to question # T10

IF YES (i.e. an oral antibiotic is given or prescribed): Record what the health worker says: Supervisor Correct for an IMCI condition? YES NO Ԙԙ Supervisor Correct for an IMCI condition?? YES NO Ԙԙ

First antibiotic a. Name: ___________________ b. Formulation: _____________ c. Amount each time:_________ d. Number of times per day:____ e. Total days:________________

Second antibiotic: f. Name: __________________ g. Formulation:_____________

F T9a1 F

F T9f1 F

F T9c1 F F T9d1 F F T9e1 F

h. Amount each time:________ i. Number of times per day:____ j. Total days:_______________

F T9h1 F F T9i1 F F T9j1 F

-

8 -

FORM 1 - OBSERVATION

Questionnaire No.

|___|___Œ___|___| HF code Œ Child ID .

‫ڡ‬

T10. Is an oral antimalarial given or prescribed by the health worker?

[Yes]Ԙ ‫ڡ‬ T11.

[No] ԙÎ Skip to question # T12

IF YES (i.e. an oral antimalarial is given or prescribed): Record what the health worker says: Supervisor Correct? YES NO Ԙԙ Supervisor Correct? YES NO Ԙԙ

First antimalarial: a. Name: ___________________ b. Formulation: _____________ c. Amount each time:_________ _______________________ d. Number of times per day:____ e. Total days:________________

Second antimalarial: f. Name: __________________ g. Formulation:_____________

F T11a1 F

F T11f1 F

F T11c1 F

h. Amount each time:________ _________________________

F T11h1 F

F T11d1 F F T11e1 F 

i. Number of times per day:____ j. Total days:_______________

F T11i1 F F T11j1 F

T12.

Is any of the following medicines given or prescribed by the health worker? a. Salbutamol inhaler/nebulised .......................... a. [Yes]Ԙ b. Epinephrine subcutaneous.............................. b. [Yes]Ԙ c. Tetracycline eye ointment ............................... c.

[No] ԙ [No] ԙ [No] ԙ

[Yes]Ԙ

FORM 1: SUPERVISOR CODING Information needed B If oral antibiotics were prescribed for an IMCI condition, were they prescribed correctly? If oral antimalarials were prescribed (whatever the reason) were they prescribed correctly? If the child was referred (whatever the reason), did the child receive an appropriate pre-referral treatment?

Where to find data YES in T8 and CORRECT for T9c1, d1 and e1 (and T9h1, i1 and j1 if 2 antibiotics) YES in T10 and CORRECT for T11c1, d1 and e1 (and T11h1, i1 and j1 if 2 antimalarials) YES in T5b and - if needing antibiotics: CORRECT in T1a1 and T2b1; (OR YES in T7f) - if needing antimalarials: CORRECT in T1a1 and T2a1; - if dehydrated: CORECT in T3

Codes

[Yes]

[No]

[NA]

Ԙ [Yes]

ԙ [No]

ԟ (no AB)

C

[NA]

Ԙ [Yes]

ԙ [No]

ԟ (no AM)

D

[NA]

Ԙ

ԙ

ԟ (child not referred)

NA = NOT APPLICABLE

-

9 -

FORM 1 - OBSERVATION

Questionnaire No.

|___|___Œ___|___| HF code Œ Child ID .

COMMUNICATION MODULE In some settings, tasks are shared and the drug dispenser counsels the caretaker on the treatment given and also administers the first dose. The child should then be followed to the drug dispenser to complete the observation.  If NO ORS (T3=No), oral Ab (T8=No) or Am (T10=No) is prescribed or given, skip to question # CM5. CM1. Does the health worker explain how to administer oral treatment? a. Antibiotic .................................... a. [Yes]Ԙ [No] ԙ [NA] b. Antimalarial ................................ b. [Yes]Ԙ c. CM2. ORS ........................................... c.

Ԛ

[No] ԙ [No] ԙ

[NA] Ԛ [NA] Ԛ

[Yes]Ԙ

Does the health worker demonstrate how to administer the oral treatment? a. Antibiotic .................................... a. [Yes]Ԙ [No] ԙ [NA] Ԛ b. Antimalarial ................................ b. [Yes]Ԙ c. ORS ........................................... c.

[No] ԙ [No] ԙ

[NA] Ԛ [NA] Ԛ

[Yes]Ԙ

CM3.

Does the health worker ask an open-ended question to check if the caretaker understands how to administer the oral treatment? [NA] Ԛ a. Antibiotic .................................... a. [Yes]Ԙ [No] ԙ b. Antimalarial ................................ b. [Yes]Ԙ c. ORS ........................................... c.

[No] ԙ [No] ԙ

[NA] Ԛ [NA] Ԛ

[Yes]Ԙ

CM4.

Does the health worker give or ask the mother to give the first dose of the oral drug at the facility? [NA] Ԛ a. Antibiotic a. [Yes]Ԙ [No] ԙ b. Antimalarial ................................ b. [Yes]Ԙ

[No] ԙ

[NA] Ԛ

CM5.

Does the health worker advise and explain when to return for a (‘definite’) follow-up visit?

[Yes]Ԙ ‫ڡ‬

[No] ԙÎ Skip to question # CM7

CM6. If YES: In how many days does the health worker advise the caretaker to come back? |___|___| days

CM7.

Does the health worker advise to give more to drink (liquid or breastmilk) at home?

[Yes]Ԙ CM8.

[No] ԙ

Does the health worker advise to continue feeding or breastfeeding at home?

[Yes]Ԙ CM9.

[No] ԙ

Does the health worker advise how often (no. of times) to feed and/or breastfeed the child?

[Yes]Ԙ

[No] ԙÎ Skip to question # CM10

 If YES (health worker advises how many times to feed and/or breastfeed the child): ‫ڡ‬ CM9a. How many times/24 hours did the health worker advise to feed the child? _________ times per 24 hours (Write 00 if nothing is mentioned about food and 77 if advice is “as much as the child wants”) CM9b. How many times/24 hours did the health worker advise to breastfeed the child? _________ times per 24 hours (Write 00 if nothing is mentioned about breastfeeding and 77 if advice is “as much as the child wants”))

‫ڡ‬

-

10 -

FORM 1 - OBSERVATION

Questionnaire No.

|___|___Œ___|___| HF code Œ Child ID .

‫ڡ‬

CM9c. Who has provided this advice on feeding and/or breastfeeding?

[Doctor]Ԙ

[Medical ass’t]ԙ

[Nurse]Ԛ

[Nutrition educator]ԛ [Vaccinator]Ԝ

[Health visitor]ԝ

CM10. Does the health worker tell the caretaker to bring the child back immediately for the following signs? Tick all that apply. a. Child is not able to drink or breastfeed ........... a. [Yes] Ԙ [No] ԙ b. Child becomes sicker...................................... b. [Yes] c. Child develops a fever .................................... c. d. Child develops fast breathing.......................... d. e. Child develops difficult breathing .................... e. f. Child develops blood in the stool .................... f. g. Child drinks poorly .......................................... g.

Ԙ [Yes] Ԙ [Yes] Ԙ [Yes] Ԙ [Yes] Ԙ [Yes] Ԙ

[No] ԙ [No] ԙ [No] ԙ [No] ԙ [No] ԙ [No] ԙ

h. Other . [Yes]Ԙ(CM10hs.Specify ______________________) [No] ԙ CM11. Does the health worker ask at least one question about the mother’s health (ask about her own health, access to family planning or vaccination status)?

[Yes]Ԙ

[No] ԙ

[NA] ԟ (Not Applicable if caretaker is not the child’s mother)

CM11a.Does the health worker use the “mother card” to advise the caretaker?

[Yes]Ԙ

[No] ԙÎ Skip to question # CM12

 ‫ڡ‬

 IF YES, mother card used: CM11b. Does the health worker hold the card so that caretaker sees the pictures easily?

[Yes]Ԙ  ‫ڡ‬

[No] ԙ

CM11c. Does the health worker point at the pictures on the card while counselling the caretaker?

[Yes]Ԙ  ‫ڡ‬

[No] ԙ

CM11d. Does the health worker ask open-ended questions to check if the caretaker understands how to care for the child at home (fluids, feeding, signs to watch out…)?

[Yes]Ԙ

[No] ԙ

CM12. Did the health worker use the IMCI chart booklet at any time during the management of the child?

[Yes]Ԙ

[No] ԙ

[Don’t know] ԟ

L NOW: CHECK THE FORM AND MAKE SURE IT IS COMPLETE! END OF OBSERVATION - The surveyor may need to ask the health worker about the classification made and the treatment given during the consultation, but only if these two components were not stated during the consultation. The surveyor must complete this form before the next child observation.

SUPERVISOR: Complete coding for Form 1 (drug treatment)

-

11 -

FORM 2 – EXIT INTERVIEW

Questionnaire No.

|___|___Œ___|___| HF code Œ Child ID

Form 2: EXIT INTERVIEW—CARETAKER OF CHILD (2 months-5 years) [If the caretaker has more than a sick child enrolled in the survey, complete separate exit interview forms for each child. Copy questions 1, 2, 21, 22 and 24 for all children and conduct a new interview with the caretaker for all remaining questions for each child.]

Date: ____/____/ 2003 Facility: Name: ___________ Child: Name_____________

State: ____________________ District: ____________________ Code: |___|___| ID: |___|___| Age (months): |___|___| Sex: [M] Ԙ [F] ԙ Type: [HOSP]

Ԙ

[HC] ԙ

[D/DS] Ԛ

Birth date: _____/_____/_____ Surveyor ID: |___|___| Caretaker: Sex: [M] Ԙ [F] ԙ

Education: [None]Ԙ [Primary]ԙ [Secondary]Ԛ [Higher]ԛ (e.g.: neighbour)

Relationship to child: [Mother] Ԙ [Father] ԙ [Other relative] Ԛ [Other] ԛ: ___________________ 1. How satisfied are you with the care provided to children in this facility? Read all options to the caretaker: “Very satisfied”, “Satisfied” or “Unsatisfied”? [Very satisfied] Ԙ [Satisfied] ԙ [Unsatisfied] Ԛ [Don’t know] ԟÎ Skip to question # 3

2. Why? Tick all reasons that apply. Do not prompt (do not read options). a. Time health worker spent with child ........................ a. [Yes] Ԙ b. I was given a chance to ask questions .................... b. [Yes] Ԙ c. Way the health worker examined the child.............. c. [Yes] Ԙ d. Treatment given (or not given) ................................ d. [Yes] Ԙ e. What I learnt from the health worker ....................... e. [Yes] Ԙ f. Don’t know............................................................... f. [Yes] Ԙ [No] ԙ [No] ԙ [No] ԙ [No] ԙ [No] ԙ [No] ԙ

g. Other.......[Yes] ԘIf Yes, specify:AAAAAAAAAAAAAAAAAAAAAAAA [No] ԙ 3. Did the health worker give you or prescribe any oral medicines for <CHILD’s NAME> at the health facility today?

[Yes] Ԙ

[No]ԙÎ Skip to question # 16

[Don’t know]ԟÎ Skip to question # 16

 If YES, ask the caretaker to show you the prescription or the medicines. Look at the prescription or the actual medicines and record: ‫ڡ‬ 4. Ź Oral antibiotics included?

[Yes] Ԙ

[No] ԙ Î Skip to question # 8

Ź Record name and formulation of the antibiotic: ‫ڡ‬ ‫ڡ‬ 4a. Name: ________________________________ 4b. Formulation: ________________________ Then ask the caretaker the following questions about the antibiotic (È record only what the caretaker says, not what is written on the prescription): ‫ڡ‬ ‫ڡ‬ ‫ڡ‬ 5. How much of this medicine will you give to <NAME> each time? __________ 6. How many times will you give it to <NAME> each day? _________ times 7. For how many days will you give it to <NAME> ? _________ days Supervisor Correct?

YES

NO

Ԙԙ † 5S † † 6S † † 7S †

1 -

FORM 2 – EXIT INTERVIEW

Questionnaire No.

|___|___Œ___|___| HF code Œ Child ID

‫ڡ‬

7o. If <NAME> gets better before then, what will you do with the medicine? (Tick only 1 answer) Will stop the medicine................................................[ ] Will continue the medicine, but will reduce the dose .[ ] Will continue the medicine as prescribed ..................[ ] Other..........................................................................[ ] Don’ t know................................................................[ ]

Ԙ ԙ Ԛ ԛ(Specify:___________________________ ) ԟ

‫ڡ‬

7x. Ź Second antibiotic included?

[Yes] Ԙ (second antibiotic included)

[No] ԙ Î Skip to question # 8 (no, only one antibiotic included)

‫ڡ‬

Ź Record name and formulation of second antibiotic: 7a. Name: ______________________________________ 7b. Formulation: _____________________________ Then ask the caretaker the following questions about the second antibiotic (record only what the caretaker says, not what is written on the prescription): Supervisor Correct?

YES

NO

Ԙԙ † 7cS † † 7dS † † 7eS †

‫ڡ‬ ‫ڡ‬ ‫ڡ‬ ‫ڡ‬

7c. How much of the medicine will you give to <NAME> each time? ________ 7d. How many times will you give it to <NAME> each day? _________ times 7e. For how many days will you give it to <NAME> ? 8. Ź Oral antimalarials included? _________ days

[Yes] Ԙ

[No] ԙ Î Skip to question # 16

Ź Record name and formulation of the antimalarial: ‫ڡ‬ ‫ڡ‬ 8a. Name: ________________________________ 8b. Formulation: ________________________ Then ask the caretaker the following questions about the antimalarial (È record only what the caretaker says, not what is written on the prescription): ‫ڡ‬ ‫ڡ‬ ‫ڡ‬ ‫ڡ‬ Supervisor Correct?

YES

NO

Ԙԙ 9S †

9. How much of this medicine will you give to <NAME> each time? __________ _____________________________________________________________________ † 10. How many times will you give it to <NAME> each day? _________ times 11. For how many days will you give it to <NAME> ? 12. Ź Second antimalarial included? _________ days

† 10S † † 11S †

[Yes] Ԙ

[No] ԙ Î Skip to question # 16

Ź Record name and formulation of the antimalarial: ‫ڡ‬ ‫ڡ‬ 12a. Name: ________________________________ Supervisor Correct?

12b. Formulation: ________________________ Then ask the caretaker the following questions about the antimalarial (È record only what the caretaker says, not what is written on the prescription):

YES

NO

Ԙԙ

‫ڡ‬ ‫ڡ‬ ‫ڡ‬

13. How much of this medicine will you give to <NAME> each time? __________ † 13S † 14. How many times will you give it to <NAME> each day? _________ times 15. For how many days will you give it to <NAME> ? _________ days

† 14S † † 15S †

2 -

FORM 2 – EXIT INTERVIEW

Questionnaire No.

|___|___Œ___|___| HF code Œ Child ID

16.

Ź Find out from caretaker and/or prescription whether ORS prescribed or given:

[Yes] Ԙ (ORS prescribed or given)

[No] ԙÎ Skip to question # 19a (no ORS prescribed or given)

Supervisor

 If YES (ORS prescribed or given): ‫ڡ‬ ‫ڡ‬ ‫ڡ‬ 17. How much water will you mix with one ORS packet? ________________ 18. When will you give ORS to <NAME> each day? _____________________ 19. How much ORS will you give to <NAME> each time? ________________

Correct? YES NO

Ԙԙ † 17S † † 18S † † 19S †

19a. Now that <NAME> is unwell: Will you give him/her more, about the same or less fluids - including breastmilk - to drink? [More] Ԙ [About the same] ԙ [Less] Ԛ [Don’t know] ԟ

19b. And will you give him/her more, about the same or less food - including breastmilk -? [More] Ԙ [About the same] ԙ [Less] Ԛ [Don’t know] ԟ

19c. ASK THIS QUESTION IF CHILD IS LESS THAN 24 MONTHS OLD (if not, skip to next question): How many times/24 hours did the health worker advise you to breastfeed <NAME>? 8 times or more.................... [ ] As much as the child wants . [ ] Less than 8 times ................ [ ] Other.................................... [ ] Did not tell me or don’t know[ ]

Ԙ ԙ Ԛ

(Tick only 1 answer)

ԛ (Specify: ______________________________________ ) ԟ

19d. How many times/24 hours did health worker advise you to feed <NAME>? (Enter: 77 if caretaker says “as the child wants”, 00 if caretaker says she was not told, and 88 if caretaker says she does not know) |___|___| times 20. Did the health worker tell you to bring <NAME> back to this facility on a specific day?

[Yes] Ԙ ‫ڡ‬

[No]ԙÎ Skip to question # 20b

[Don’t know] ԟÎ Skip to question # 20b

20a.  If YES: In how many days should you bring <NAME> back? ~__~__~ days

20b. Do you have a mosquito bed-net at home?

[Yes] Ԙ

[No]ԙÎ Skip to question # 21

[Don’t know] ԟÎ Skip to question # 21

 If YES (mosquito bed-net available at home): ‫ڡ‬ 20c. Is the bed-net treated with insecticide (a product that kills mosquitoes)?

[Yes] Ԙ ‫ڡ‬

[No]ԙ

[Don’t know] ԟ

20d. Did <NAME> sleep under the bed-net last night?

[Yes] Ԙ

[No]ԙ

[Don’t know] ԟ

-

3 -

FORM 2 – EXIT INTERVIEW

Questionnaire No.

|___|___Œ___|___| HF code Œ Child ID

21. Sometimes children who are sick should be taken right away to a health facility: What symptoms would worry you that would make you take your child to a health facility right away? Do not prompt – Tick all that is mentioned. Ask up to 2 times for more signs/symptoms . a. Child not able to drink or breastfeed.........a b. Child becomes sicker ...............................b c. Child develops a fever ..............................c d. Child has fast breathing............................d e. Child has difficult breathing/pneumonia....e f. Child has blood in the stools......................f g. Child is drinking poorly .............................g h. Child has convulsions...............................h. Mentioned [Yes] Ԙ [Yes] Ԙ [Yes] Ԙ [Yes] Ԙ [Yes] Ԙ [Yes] Ԙ [Yes] Ԙ [Yes] Ԙ Not mentioned [No] ԙ [No]

ԙ

[No] ԙ [No] ԙ [No] ԙ [No] ԙ [No] ԙ [No] ԙ

i. Other [Yes] Ԙ(specify:__________________________________ ) [No] ԙ j. Other [Yes] Ԙ(specify:__________________________________ ) [No] ԙ 22. IF THE CARETAKER IS THE MOTHER OF THE CHILD, ASK: Were you ever given an injection in the arm to prevent the baby from getting tetanus, that is convulsions after birth?

[Yes] Ԙ

[No]ԙÎ Skip to question # 23

[Don’t know] ԟÎ Skip to question # 23

 If YES (injection received): ‫ڡ‬ ‫ڡ‬ 23. 22a. How many injections did you receive? 22b. When did you receive the last injection? |___|___| injections Year: |___|___|___|___|

Did you receive or were you shown this card today? Show mother’s IMCI counselling card.

[Yes] Ԙ 24. 25.

[No]ԙ

[Don’t know]ԟ

How long did it take you to reach this facility from your place today? |___|___|___| minutes How much did you spend for transport for you and your child to get to this facility from your place today? .............................................................................|___|___|___|___|___| SDD

26. 27. 28.

How much did you spend for consultation, drugs, tests here today? |___|___|___|___|___| SDD How much of this was for medicines? |___|___|___|___|___| SDD Is the child covered by health insurance?

[Yes] Ԙ

[No]ԙ

[Don’t know]ԟ

L

NOW: CHECK THE FORM AND MAKE SURE IT IS COMPLETE! END OF EXIT INTERVIEW

Thank the caretaker for answering your questions and ask if he/she has any questions. Be sure that the caretaker knows how to prepare ORS for a child with diarrhoea, when to return for vaccination, how to give the prescribed medications, and when to return if the child becomes worse at home.

SUPERVISOR: Complete coding for Form 2 (oral drugs and ORS) -

4 -

FORM 2 – EXIT INTERVIEW

Questionnaire No.

|___|___Œ___|___| HF code Œ Child ID

Form 2: EXIT INTERVIEW—CARETAKER OF CHILD (2 months-5 years)

Arabic version

[If the caretaker has more than a sick child enrolled in the survey, complete separate exit interview forms for each child. Copy questions 1, 2, 21, 22 and 24 for all children and conduct a new interview with the caretaker for all remaining questions for each child.]

Date: ____/____/ 2003 Facility: Name: ___________ Child: Name_____________

State: ____________________ District: ____________________ Code: |___|___| ID: |___|___| Age (months): |___|___| Sex: [M] Ԙ [F] ԙ Type: [HOSP]

Ԙ

[HC] ԙ

[D/DS] Ԛ

Birth date: _____/_____/_____ Surveyor ID: |___|___| Caretaker: Sex: [M] Ԙ [F] ԙ

Education: [None]Ԙ [Primary]ԙ [Secondary]Ԛ [Higher]ԛ (e.g.: neighbour)

Relationship to child: [Mother] Ԙ [Father] ԙ [Other relative] Ԛ [Other] ԛ: ___________________

Ÿ ŗƒšŮƃŒ ŖťšƍƃŒ Ƒż (ŜƚŶƃŒƍ ŻŬƂƃŒ) ƁƄŽűƃ ŗƆťƀƆƃŒ ŗƒšŮƃŒ ŗƒœƈŶƃœŕ ŗƒŰŒŧ ŘƈŊ ƐťƆ ƐŊ Əƃō .1 Read all options to the caretaker:

"Δϴο΍έ ήϴϏ"ˬ"Δϴο΍έ" ˬ"΍ΪΟ Δϴο΍έ" [Very satisfied] Ԙ [Satisfied] ԙ [Unsatisfied] Ԛ [Don’t know] ԟÎ Skip to question # 3

ŸƊƒƃ .2 Tick all reasons that apply. Do not prompt (do not read options) a. Time health worker spent with child ........................ a. [Yes] Ԙ b. I was given a chance to ask questions .................... b. [Yes] Ԙ c. Way the health worker examined the child.............. c. [Yes] Ԙ d. Treatment given (or not given) ................................ d. [Yes] Ԙ e. What I learnt from the health worker ....................... e. [Yes] Ԙ f. Don’t know............................................................... f. [Yes] Ԙ [No] ԙ [No] ԙ [No] ԙ [No] ԙ [No] ԙ [No] ԙ

g. Other.......[Yes] ԘIf Yes, specify:AAAAAAAAAAAAAAAAAAAAAAAA [No] ԙ

ŸƅƍƒƃŒ ŗƒšŮƃŒ ŖťšƍƃŒ Ƒż ƅŽƃœŕ ƉƍťŤŋƒŕ ŇŒƍť ƐŊ (¾ŽűƃŒ ƅŪŒ) ¾ ŻŮƍ ƍŊ (ƅƒƂšƃŒ ) ƑšŮƃŒ ¾ƆœŶƃŒ ƁŒťŊ ¾Ƌ .3 [Yes] Ԙ [No]ԙÎ Skip to question # 16 [Don’t know]ԟÎ Skip to question # 16

 If YES, ask the caretaker to show you the prescription or the medicines. Look at the prescription or the actual medicines and record: ‫ڡ‬ 4. Ź Oral antibiotics included?

[Yes] Ԙ

[No] ԙ Î Skip to question # 8

Ź Record name and formulation of the antibiotic: ‫ڡ‬ ‫ڡ‬ 4a. Name: ________________________________ 4b. Formulation: ________________________

-

1 -

FORM 2 – EXIT INTERVIEW

Questionnaire No.

|___|___Œ___|___| HF code Œ Child ID

Supervisor Correct?

YES

NO

Then ask the caretaker the following questions about the antibiotic (È record only what the caretaker says, not what is written on the prescription):

Ԙԙ  † 5S † † 6S † † 7S †

______________Ÿ ŖŧƆ ¾Ƃ Ƒż (¾ŽűƃŒ ƅŪŒ)¾ Ɗƒťřš ŇŒƍťƃŒ ƇƆ ƍƈŬ ŧťſ - . 5 _________ times _________ days

Ÿ ƅƍƒ ¾Ƃ ƊƈƆ Ɗƒťřš ŖŧƆ ƅƂ . 6 Ÿ (¾ŽűƃŒ ƅŪŒ)¾ ŇŒƍťƃŒ Ƒż ƐŧƆřŪřš ƅƍƒ ƅƂ ŖťƆƃ . 7

ŸŇŒƍťƃŒ ƇƆ ŗƒſœŕƃŒ ŗƒƆƂƃœŕ ƍƈŬ ƑƄƆŶřš  ŖťƆƃŒ ŗƒœƌƈ ¾ŕſ (¾ŽűƃŒ ƅŪŒ) ƇŪšř ŒŦō . 7o (Tick only 1 answer) Will stop the medicine................................................[ ] Will continue the medicine, but will reduce the dose .[ ] Will continue the medicine as prescribed ..................[ ] Other..........................................................................[ ] Don’ t know................................................................[ ] ‫ڡ‬ 7x. Ź Second antibiotic included?

Ԙ ԙ Ԛ ԛ(Specify:___________________________ ) ԟ

[Yes] Ԙ (second antibiotic included)

[No] ԙ Î Skip to question # 8 (no, only one antibiotic included)

‫ڡ‬

Ź Record name and formulation of second antibiotic: 7a. Name: ______________________________________ 7b. Formulation: _____________________________ Supervisor Correct?

YES

NO

Then ask the caretaker the following questions about the second antibiotic (record only what the caretaker says, not what is written on the prescription):

Ԙԙ † 7cS † † 7dS † † 7eS †

___________ Ÿ ŖŧƆ ¾Ƃ Ƒż (¾ŽűƃŒ ƅŪŒ)¾ Ɗƒťřš ŇŒƍťƃŒ ƇƆ ƍƈŬ ŧťſ 7c. _________ times _________ days Ÿ ƅƍƒ ¾Ƃ ƊƈƆ Ɗƒťřš ŖŧƆ ƅƂ 7d.

Ÿ (¾ŽűƃŒ ƅŪŒ)¾ ŇŒƍťƃŒ Ƒż ƐŧƆřŪřš ƅƍƒ ƅƂ ŖťƆƃ 7e.

‫ڡ‬

8. Ź Oral antimalarials included?

[Yes] Ԙ

[No] ԙ Î Skip to question # 16

Ź Record name and formulation of the antimalarial: ‫ڡ‬ ‫ڡ‬ 8a. Name: ________________________________ 8b. Formulation: ________________________

-

2 -

FORM 2 – EXIT INTERVIEW Supervisor Correct?

Questionnaire No.

|___|___Œ___|___| HF code Œ Child ID

Then ask the caretaker the following questions about the antimalarial (È record only what the caretaker says, not what is written on the prescription):

YES

NO

Ԙԙ † 9S †

__________

Ÿ ŖŧƆ ¾Ƃ Ƒż (¾ŽűƃŒ ƅŪŒ)¾ Ɗƒťřš ŇŒƍťƃŒ ƇƆ ƍƈŬ ŧťſ 9.

---------------------------------------------------------------------------------------------_________ times _________ days

† 10S † † 11S † ‫ڡ‬

Ÿ ƅƍƒ ¾Ƃ ƊƈƆ Ɗƒťřš ŖŧƆ ƅƂ 10. Ÿ (¾ŽűƃŒ ƅŪŒ)¾ ŇŒƍťƃŒ Ƒż ƐŧƆřŪřš ƅƍƒ ƅƂ ŖťƆƃ 11.

12. Ź Second antimalarial included?

[Yes] Ԙ

[No] ԙ Î Skip to question # 16

Ź Record name and formulation of the antimalarial: ‫ڡ‬ ‫ڡ‬ 12a. Name: ________________________________

12b. Formulation: ________________________ Supervisor Correct?

YES

NO

Then ask the caretaker the following questions about the antimalarial (È record only what the caretaker says, not what is written on the prescription):

Ԙԙ † 13S † † 14S † † 15S † 16.

___________ _________ times _________ days

Ÿ ŖŧƆ ¾Ƃ Ƒż (¾ŽűƃŒ ƅŪŒ)¾ Ɗƒťřš ŇŒƍťƃŒ ƇƆ ƍƈŬ ŧťſ13. Ÿƅƍƒ ¾Ƃ ƊƈƆ Ɗƒťřš ŖŧƆ ƅƂ14. Ÿ (¾ŽűƃŒ ƅŪŒ)¾ ŇŒƍťƃŒ Ƒż ƐŧƆřŪřš ƅƍƒ ƅƂ ŖťƆƃ15.

Ź Record whether ORS prescribed or given:

[Yes] Ԙ (ORS prescribed or given) Supervisor

[No] ԙÎ Skip to question # 19a (no ORS prescribed or given)

Correct? YES NO

 If YES (ORS prescribed or given):

Ԙԙ † 17S † † 18S † † 19S †

Ÿ-ůƍŶƆƃŒ – ŇŒƍŧƗŒ ŠƄƆ ƇƆ ťšŒƍƃŒ ũƒƂƃŒ œƌƒŕ ƑƄšř ůƍŧŽƆ ŗƒƍƆƃŒ ƇƆ ƍƈŬ ŧťſ17. __________________________________________________________ __________________Ÿƅƍƒ ¾Ƃ (¾ŽűƃŒ ƅŪŒ)¾ -ůƍŶƆƃŒ– ŇŒƍŧƗŒ ŠƄƆ Ɛťřš ƇƒřƆ18. _____________________ŸŖŧƆ ¾Ƃ -ůƍŶƆƃŒ – ŇŒƍŧƗŒ ŠƄƆ ƇƆ ƍƈŬ ŧťſ Ɗƒťřš19.

-

3 -

FORM 2 – EXIT INTERVIEW

Questionnaire No.

|___|___Œ___|___| HF code Œ Child ID

:Ƈœƒŵ (¾ŽűƃŒ ƅŪŒ) ƑŪš

19a.

ŸŔŧŬƒ ƇœŬŵ - Ɓƈŕƃ ŴƆ - ¾őŒƍŪƃŒ ƇƆ ¾ſŊ ƍŊ ŗƒƆƂƃŒ ũŽƈ ƍŊ ƇƆ ŧśƂŊ Ɗƒťřš ¾Ƌ [More] Ԙ [About the same] ԙ [Less] Ԛ [Don’t know] ԟ

ŸƊƒƃ œƌƒťřŕƃŒ – Ɓƈŕƃ ŴƆ - ¾ƂƕŒ ŗƒƆƂ ƇƆ ƐťƒŨř ƙƍ ŗƒƆƂƃŒ ũŽƈ Ɛťř ƙƍ ƑƄƄƀřš ¾Ƌƍ [More] Ԙ [About the same] ԙ [Less] Ԛ [Don’t know] ԟ

19b.

19c. ASK THIS QUESTION IF CHILD IS LESS THAN 24 MONTHS OLD (if not, skip to next question):

Ÿ(ŗŵœŪ 24) ƅƍƒƃŒ Ƒż (¾ŽűƃŒ ƅŪŒ) ƑŶŰŧř (ƅƒƂšƃŒ )ƑšŮƃŒ ¾ƆœŶƃŒ Ɓƒƃ ¾œſ ŖŧƆ ƅƂ (Tick only 1 answer) 8 times or more.................... [ ] As much as the child wants . [ ] Less than 8 times ................ [ ] Other.................................... [ ] Did not tell me or don’t know[ ]

Ԙ ԙ Ԛ ԛ (Specify: ______________________________________ ) ԟ Ÿ (ŗŵœŪ 24) ƅƍƒƃŒ Ƒż ƊƒƄƂŋř Ɓƒƃ ¾œſ ŖŧƆ ƅƂ 19d.

(Enter: 77 if caretaker says “as the child wants”, 00 if caretaker says she was not told, and 88 if caretaker says she does not know) |___|___| times

ŸťťšƆ ƅƍƒ Ƒż ŗƒšŮƃŒ ŖťšƍƄƃ ŗƒƈœř ŖŧƆ (¾ŽűƃŒ ƅŪŒ) ƑŕƒŞ (ƅƒƂšƃŒ )ƑšŮƃŒ ¾ƆœŶƃŒ Ɓƒƃ ¾œſ ¾Ƌ [Yes] Ԙ ‫ڡ‬20a.  If YES: ~__~__~ days

20.

[No]ԙÎ Skip to question # 20b

[Don’t know] ԟÎ Skip to question # 20b

ŸŗƒšŮƃŒ ŖťšƍƄƃ ƊƒŕƒŞřš ƅƍƒ ƅƂ ťŶŕ ŸŘƒŕƃŒ Ƒż ŗƒŪƍƆœƈ ƅƂťƈŵ 20b.

[Yes] Ԙ [No]ԙÎ Skip to question # 21  If YES (mosquito bed-net available at home):

[Don’t know] ԟÎ Skip to question # 21

Ÿ (ůƍŶŕƃŒ ¾řƀřŕƃŒ ŗŞœšƃŒ) ťƒŕƆƃœŕ ŗŞƃœŶƆ Ɛť ŗƒŪƍƆœƈƃŒ ¾Ƌ20c. [Yes] Ԙ [No]ԙ [Don’t know] ԟ

ŸşŧœŕƆŊ ŗƒŪƍƆœƈƃŒ Řšř (¾ŽűƃŒ ƅŪŒ) ƅœƈ ¾Ƌ20d. [Yes] Ԙ [No]ԙ [Don’t know] ԟ

-

4 -

FORM 2 – EXIT INTERVIEW

Questionnaire No.

|___|___Œ___|___| HF code Œ Child ID

ˮΔ ˱ ϋήδΑ ΔϴΤμϟ΍ ΓΪΣϮϠϟ ϚϠϔσ ϱΩϮΗ ϚϴϠΨΘΑ (ΔΟΎΣ) ν΍ήϋ΃ ϮΗΎϳ ˬ ΔϴΤμϟ΍ ΓΪΣϮϠϟ ΔϋήδΑ ϢϫϭΩϮϳ νϭήϔϣ ϦϴϧΎϴόϟ΍ ϝΎϔσϷ΍ Ε΍ήϣ21. Do not prompt – Tick all that is mentioned. Ask up to 2 times for more signs/symptoms . a. Child not able to drink or breastfeed.........a b. Child becomes sicker ...............................b c. Child develops a fever ..............................c d. Child has fast breathing............................d e. Child has difficult breathing/pneumonia....e f. Child has blood in the stools......................f g. Child is drinking poorly .............................g h. Child has convulsions...............................h. Mentioned [Yes] Ԙ [Yes] Ԙ [Yes] Ԙ [Yes] Ԙ [Yes] Ԙ [Yes] Ԙ [Yes] Ԙ [Yes] Ԙ Not mentioned [No] ԙ [No]

ԙ

[No] ԙ [No] ԙ [No] ԙ [No] ԙ [No] ԙ [No] ԙ

i. Other [Yes] Ԙ(specify:__________________________________ ) [No] ԙ j. Other [Yes] Ԙ(specify:__________________________________ ) [No] ԙ .22 IF THE CARETAKER IS THE MOTHER OF THE CHILD, ASK: .(ŘŧƛƏƅŔ ŧŸŗ ŚŕŠƊŮś ) ūƊśśƅŔ Ɖƈ (ƃśŗ /ƃŧƅƏ) ƃƆſų Ɠƈţś ƉŕŮŷ ¿ŲŸƅŔ Ɠž řƊƂţ ƒŌ ŘŧƄ ¿ŗƁ ƃƏŧŌ ¿ƍ

[Yes] Ԙ

[No]ԙÎ Skip to question # 23

[Don’t know] ԟÎ Skip to question # 23

 If YES (injection received): |___|___|injections Year:|___|___|___|___| Show mother’s IMCI counselling card: ƅƍƒƃŒ Œť ŘŧƂƃŒ Ɓƍŧƍ ƍŊ ƁƍťŒ 23. ŸŗƈƀšƃŒ ƁƍťŊ ŖŧƆ ƅƂ 22a. Ÿ ŗƈƀš ŧŤň ƑřťŤŒ ƇƒřƆ 22b.

[Yes] Ԙ

[No]ԙ

[Don’t know]ԟ ŸƅƍƒƃŒ ŗƒšŮƃŒ ŖťšƍƄƃ ƅƂřƒŕ ƇƆ ƑƄŮř ƇœŬŵ ŘſƍƃŒ ƇƆ ƅƂ ƑřťŤŒ 24. .25 .26 .27 28.

|___|___|___| minutes |___|___|___|___|___| SDD |___|___|___|___|___| SDD |___|___|___|___|___| SDD

ŸƅƍƒƃŒ ƅƂřƒŕ ƇƆ ŗƒšŮƃŒ ŖťšƍƃŒ ƑƄŮř ƇœŬŵ ƁƄŽűƃƍ Ɓƒƃ ŘƚŮŒƍƆƃŒ ƏƄŵ ƍƈŬ ŧťſ ƑřżŧŮ

ŸƅƍƒƃŒ ŭšŽƃŒƍ ŇŒƍťƃŒ  ŻŬƂƃŒ ƏƄŵ

ƑřżŧŮ ƅƂ

ŸƉŒŧŕ ŇŒƍťƃŒ ƏƄŵ ƑřżŧŮ ƅƂ ŸƑšŮƃŒ ƇƒƆŋřƄƃ Ŵŕœř (¾ŽűƃŒ ƅŪŒ) Ŝƚŵ ¾Ƌ

[Yes] Ԙ

[No]ԙ

[Don’t know]ԟ

L

NOW: CHECK THE FORM AND MAKE SURE IT IS COMPLETE! END OF EXIT INTERVIEW

Thank the caretaker for answering your questions and ask if he/she has any questions. Be sure that the caretaker knows how to prepare ORS for a child with diarrhoea, when to return for vaccination, how to give the prescribed medications, and when to return if the child becomes worse at home.

SUPERVISOR: Complete coding for Form 2 (oral drugs and ORS) -

5 -

FORM 3: RE-EXAMINATION Date: ____/____/ Code: |___|___| HF codeŒ Child ID

2003 Surveyor ID: |___|___| Type: [HOSP] Ԙ Axillary temperature: |___|___|.|___|0C Questionnaire: |___|___Œ___|___|

District: ____________________ FACILITY: Name: ______________________ Age: |___|___| Sex: [M]

[HC] ԙ [D/DS] Ԛ

CHILD: Name: _____________ ASK: What are the child’s problems? ___________________________________________________________ CLASSIFY (Tick all relevant classifications)

ID: |___|___|

Ԙ [F]ԙ Weight: |___|___|.|___|Kg

Visit: [Initial] YES

Ԙ [Follow-up]ԙ

ASSESS (circle all signs present)

NO

1. DOES THE CHILD HAVE ANY GENERAL DANGER SIGNS?………….…………[Yes]

Ԙ [No] ԙ 

105. ONE OR MORE DANGER SIGNS ...................... [ ] Ԙ[ ] ԙ

NOT ABLE TO DRINK OR BREASTFEED VOMITS EVERYTHING HISTORY OF CONVULSIONS / CONVULSIONS NOW LETHARGIC OR UNCONSCIOUS

2. DOES THE CHILD HAVE COUGH OR DIFFICULT BREATHING?……………..[Yes]

Ԙ [No] ԙ

For how long? |___|___| days 3. Count the breaths in one minute: |___|___|___| breaths per minute. Fast breathing?

ƒ Look for chest indrawing.

110. SEVERE PNEUMONIA/VERY SEVERE DISEASE ........... [ ] Ԙ[ ] ԙ 111. PNEUMONIA ....................................................... [ ] Ԙ[ ] ԙ 112. NO PNEUMONIA (Cough or cold) ....................... [ ] Ԙ[ ] ԙ 113. WHEEZING.......................................................... [ ] Ԙ[ ] ԙ

ƒ Look and listen for stridor.

4. DOES THE CHILD HAVE WHEEZING? ................................................................ [Yes]

Ԙ [No] ԙ Ԙ [No] ԙ

5. DOES THE CHILD HAVE DIARRHOEA?…………………………………….…...….[Yes]

o For how long? |___|___| days o Is there blood in the stool?

ƒ Look at the child’s general condition. Is the child: Lethargic or unconscious?

120 a. SEVERE DEHYDRATION .............................. [ ] Ԙ[ ] ԙ 120 b. SOME DEHYDRATION .................................. [ ] Ԙ[ ] ԙ 120 c. NO DEHYDRATION........................................ [ ] Ԙ[ ] ԙ 121. SEVERE PERSISTENT DIARRHOEA ................ [ ] Ԙ[ ] ԙ 122. PERSISTENT DIARRHOEA ................................ [ ] Ԙ[ ] ԙ 123. DYSENTERY ....................................................... [ ] Ԙ[ ] ԙ

Restless and irritable? ƒ Look for sunken eyes ƒ Offer the child fluid. Is the child: Not able to drink or drinking poorly? Drinking eagerly, thirsty? ƒ Pinch the skin of the abdomen. Does it go back: Very slowly (longer than 2 seconds)? Slowly?

6. DOES THE CHILD HAVE FEVER? (by history/feels hot/temperature 37.50C or above)… [Yes]

Ԙ [No] ԙ

o For how long? ___ days o If more than 7 days, has fever been present every day? o Has child had measles within the last 3 months? ƒ Look for mouth ulcers If Yes, are they deep and extensive? ƒ Look for pus draining from the eye ƒ Look for clouding of the cornea

ƒ Look or feel for stiff neck ƒ Look for runny nose Look for signs of MEASLES: ƒ Generalised rash and ƒ One of these: cough, runny nose, or red eyes

130. VERY SEVERE FEBRILE DISEASE ................... [ ] Ԙ[ ] ԙ 131. MALARIA ............................................................. [ ] Ԙ[ ] ԙ 132. FEVER, MALARIA UNLIKELY............................. [ ] Ԙ[ ] ԙ

If the child has measles now or within the last 3 months

~

6a. MEASLES?

[Yes]Ԙ

[No] ԙ

134. SEVERE COMPLICATED MEASLES ................. [ ] Ԙ[ ] ԙ 135. MEASLES WITH EYE/MOUTH COMPLICATION . [ ] Ԙ[ ] ԙ 136. MEASLES ............................................................ [ ] Ԙ[ ] ԙ

-

1 -

FORM 3: RE-EXAMINATION Questionnaire: |___|___Œ___|___| HF code Œ Child ID CLASSIFY (Tick all relevant classifications)

ASSESS (circle all signs present)

7. DOES THE CHILD HAVE AN EAR PROBLEM?…………………………….…………[Yes]

Ԙ

[No] ԙ

o Is there ear pain? o Is there ear discharge? If Yes, for how long? ____ days

ƒ Look for pus draining from the ear ƒ Feel for tender swelling behind the ear

CHECK FOR MALNUTRITION AND ANAEMIA

ƒ Look for visible severe wasting ƒ Look for palmar pallor Severe palmar pallor? Some palmar pallor? ƒ Look for oedema of both feet ƒ Determine weight for age Very low ___ Not very low ___ Circle immunisations and vitamin A needed today Measles Vitamin A (2 dose) Vitamin A (1 dose) st nd

YES 140. MASTOIDITIS ......................................................[ ] Ԙ 141. ACUTE EAR INFECTION ....................................[ ] Ԙ 142. CHRONIC EAR INFECTION................................[ ] Ԙ 143. NO EAR INFECTION ...........................................[ ] Ԙ 150 a. SEVERE MALNUTRITION................................[ ] Ԙ 150 b. SEVERE ANAEMIA ..........................................[ ] Ԙ 151 a. VERY LOW WEIGHT........................................[ ] Ԙ 151 b. ANAEMIA ..........................................................[ ] Ԙ 152 a. NOT VERY LOW WEIGHT / NO ANAEMIA......[ ] Ԙ

NO [ ]ԙ [ ]ԙ [ ]ԙ [ ]ԙ [ ]ԙ [ ]ԙ [ ]ԙ [ ]ԙ [ ]ԙ

CHECK THE CHILD’S IMMUNISATION STATUS 9 months

Birth

6 weeks

10 weeks

14 weeks

BCG

DPT1

DPT2

DPT3

OPV0

OPV1

OPV2

OPV3

ASSESS CHILD’S FEEDING if child has ANAEMIA OR VERY LOW WEIGHT or is less than 2 years old

™ 8. IS <NAME> BREASTFED? .................................................................. [Yes]

Ԙ [No] ԙ [Don’t know] ԟ Ԙ [No] ԙ

™ 9.  If YES: HOW MANY TIMES IN 24 HOURS? |___|___| Do you breastfeed during the night? Yes __ No __

If NO breastfeeding or caretaker does not know, skip to question # 11

™ 10. IS NUMBER OF TIMES OF BREASTFEEDING AS RECOMMENDED? ..................... [Yes]

™ 11. DOES THE CHILD TAKE ANY OTHER FOOD OR FLUIDS? ....... [Yes]

Ԙ [No] ԙ [Don’t know] ԟ [Yes] Ԙ [No] ԙ [No] ԙ

If Yes, what food or fluids? ____________________________________________________________________

If NO other food or fluids or caretaker does not know, skip to question # 15

™ 12. IS THIS TYPE OF FOOD APPROPRIATE?……………………………………………….

™ 13. HOW MANY TIMES PER DAY? |___|___| times.

™ 14. IS NUMBER OF TIMES OF FEEDING AS RECOMMENDED? ……………….……..…[Yes]

Ԙ

What do you use to feed the child? _______________________

If low weight for age: How large are servings? _____________________________________________________

Does the child receive his own serving? Yes ___ No ___ Who feeds the child and how? ____________________

During this illness, has the child’s feeding changed? Yes ___ No ___

If Yes, how?

15. ASSESS OTHER PROBLEMS: ANY OTHER PROBLEMS?..……………………….[Yes]

Ԙ

[ [No] ԙ 160. EYE INFECTION (OTHER PROBLEM 1) 161. OTHER PROBLEM 2 (Sp.:__________________) [ 162. OTHER PROBLEM 3 (Sp.:__________________) [ 163. FEEDING PROBLEMS ........................................... [ 164. DOES CHILD NEED TO BE REFERRED?...................... [

]Ԙ[ ]Ԙ[ ]Ԙ[ ]Ԙ[ ]Ԙ[

]ԙ ]ԙ ]ԙ ]ԙ ]ԙ . 165. RETURN FOR DEFINITE FOLLOW-UP IN: ... |___|___| days 166. ANY NON-IMCI REASON FOR ANTIBIOTICS?.............. [ ] Ԙ [ ] ԙ 170. HIGH MALARIA RISK? .................................................... [ ] Ԙ [ ] ԙ

(Enter 00 if no follow-up is needed) Æ

-

2 -

FORM 3: RE-EXAMINATION 16. Ź Record if the child needs Vitamin A today:

Questionnaire: |___|___Œ___|___| HF code || Child ID

[Yes] Ԙ (Vitamin A needed) ‫ڡ‬

[No] ԙ

[Don’t know] ԟ

(not needed) Î If NO or DON’T KNOW, skip to question # 19

17.  IF YES, ASK THE CARETAKER: Has <NAME> been given vitamin A drops from a capsule like this today? (Show the mother a

capsule of vitamin A as per child age) [Yes] ԘÎ If YES, skip to question # 19  ‫ڡ‬

[No] ԙ

[Don’t know] ԟ

18.  IF NO or Don’t know: Has the health worker told you to bring back <NAME> to receive vitamin A on another day?

[Yes] Ԙ 19.

[No] ԙ

[Don’t know] ԟ

Ź Record if child’s road-to-health or vaccination card is available:

[Yes] Ԙ (available) 20.

[No] ԙ (not available)

Ź Record if child needs to receive any immunisation today:

[Yes] Ԙ (immunisation needed)

[No] ԙ [Don’t know] ԟ (not needed)Î If NO or DON’T KNOW, go to È

 IF YES, ASK THE CARETAKER: ‫ڡ‬ 21. Did <NAME> receive a vaccination today or has the health worker referred <NAME> to the immunisation room?

[Yes] ԘÎ If YES, go to È (vaccination received or child referred to immunisation room) ‫ڡ‬

[No] ԙ (vaccination not given and child not referred)

[Don’t know] ԟ

22.  IF NO or Don’t know: Has the health worker told you to bring back <NAME> on another day or to take him/her to another place to receive a vaccination?

[Yes] Ԙ

[No] ԙ

È DOES THE CHILD HAVE A FEVER CLASSIFICATION? IF NO, STOP HERE. IF YES, ASK THE CARETAKER: 23. Did <NAME> receive a medicine for ‘malaria’ before being taken to this health facility?

[Yes] Ԙ ‫ڡ‬

[No] ԙÎ \ STOP here

[Don’t know] ԟÎ \ STOP here

24.  IF YES: Which medicine did <NAME> receive? (Do not prompt) a. Paracetamol...................... a. [Yes] Ԙ b. Chloroquine ..................... b. [Yes] Ԙ c. Fansidar ........................... c.

[No] ԙ [No] ԙ [No] ԙ [No] ԙ

[Yes] Ԙ

d. Other ................................. d. [Yes] Ԙ (specify: _________________) [No] ԙ e. Do not know ...................... e. [Yes] Ԙ ‫ڡ‬ 

25.  IF CHLOROQUINE OR FANSIDAR, ASK: How long after <NAME> started having fever did <NAME> receive this medicine? [Within 24 hours]Ԙ [1 or 2 days later]ԙ [3 or more days later] Ԛ

L SUPERVISOR: COPY CLASSIFICATIONS IN APPROPRIATE BOX ON FORM 1, PAGE 6 AND COLLECT BLOOD FILM IF TAKEN -

3 -

FORM 3: RE-EXAMINATION Date: ____/____/ Code: |___|___| HF codeŒ Child ID

2003 Surveyor ID: |___|___| Type: [HOSP] Ԙ Axillary temperature: |___|___|.|___|0C Questionnaire: |___|___Œ___|___|

District: ____________________ FACILITY: Name: ______________________ Age: |___|___| Sex: [M]

[HC] ԙ [D/DS] Ԛ

CHILD: Name: _____________

ID: |___|___|

Ԙ [F]ԙ Weight: |___|___|.|___|Kg

Visit: [Initial]

Ԙ [Follow-up]ԙ

ASSESS (circle all signs present)

ASK: What are the child’s problems? ___________________________________________________________ Arabic version CLASSIFY (Tick all relevant classifications) YES NO

1. DOES THE CHILD HAVE ANY GENERAL DANGER SIGNS?………….…………[Yes]

Ԙ [No] ԙ 

105. ONE OR MORE DANGER SIGNS ...................... [ ] Ԙ[ ] ԙ

NOT ABLE TO DRINK OR BREASTFEED VOMITS EVERYTHING HISTORY OF CONVULSIONS / CONVULSIONS NOW LETHARGIC OR UNCONSCIOUS

2. DOES THE CHILD HAVE COUGH OR DIFFICULT BREATHING?……………..[Yes]

Ԙ [No] ԙ

For how long? |___|___| days 3. Count the breaths in one minute: |___|___|___| breaths per minute. Fast breathing?

ƒ Look for chest indrawing.

110. SEVERE PNEUMONIA/VERY SEVERE DISEASE ........... [ ] Ԙ[ ] ԙ 111. PNEUMONIA ....................................................... [ ] Ԙ[ ] ԙ 112. NO PNEUMONIA (Cough or cold) ....................... [ ] Ԙ[ ] ԙ 113. WHEEZING.......................................................... [ ] Ԙ[ ] ԙ

ƒ Look and listen for stridor.

4. DOES THE CHILD HAVE WHEEZING? ................................................................[Yes]

Ԙ [No] ԙ Ԙ [No] ԙ

5. DOES THE CHILD HAVE DIARRHOEA?…………………………………….…...….[Yes]

o For how long? |___|___| days o Is there blood in the stool?

ƒ Look at the child’s general condition. Is the child: Lethargic or unconscious?

120 a. SEVERE DEHYDRATION .............................. [ ] Ԙ[ ] ԙ 120 b. SOME DEHYDRATION .................................. [ ] Ԙ[ ] ԙ 120 c. NO DEHYDRATION........................................ [ ] Ԙ[ ] ԙ 121. SEVERE PERSISTENT DIARRHOEA ................ [ ] Ԙ[ ] ԙ 122. PERSISTENT DIARRHOEA ................................ [ ] Ԙ[ ] ԙ 123. DYSENTERY ....................................................... [ ] Ԙ[ ] ԙ

Restless and irritable? ƒ Look for sunken eyes ƒ Offer the child fluid. Is the child: Not able to drink or drinking poorly? Drinking eagerly, thirsty? ƒ Pinch the skin of the abdomen. Does it go back: Very slowly (longer than 2 seconds)? Slowly?

6. DOES THE CHILD HAVE FEVER? (by history/feels hot/temperature 37.50C or above)… [Yes]

Ԙ [No] ԙ

o For how long? ___ days o If more than 7 days, has fever been present every day? o Has child had measles within the last 3 months?

ƒ Look or feel for stiff neck ƒ Look for runny nose Look for signs of MEASLES: ƒ Generalised rash and ƒ One of these: cough, runny nose, or red eyes

130. VERY SEVERE FEBRILE DISEASE ................... [ ] Ԙ[ ] ԙ 131. MALARIA ............................................................. [ ] Ԙ[ ] ԙ 132. FEVER, MALARIA UNLIKELY............................. [ ] Ԙ[ ] ԙ

If the child has measles now or within the last 3 months

ƒ Look for mouth ulcers If Yes, are they deep and extensive?

~

ƒ Look for pus draining from the eye

6a. MEASLES?

[Yes]Ԙ

[No] ԙ

ƒ Look for clouding of the cornea

134. SEVERE COMPLICATED MEASLES ................. [ ] Ԙ[ ] ԙ 135. MEASLES WITH EYE/MOUTH COMPLICATION . [ ] Ԙ[ ] ԙ 136. MEASLES ............................................................ [ ] Ԙ[ ] ԙ

-

1 -

FORM 3: RE-EXAMINATION Questionnaire: |___|___Œ___|___| HF code Œ Child ID CLASSIFY (Tick all relevant classifications)

ASSESS (circle all signs present)

7. DOES THE CHILD HAVE AN EAR PROBLEM?…………………………….…………[Yes]

Ԙ

[No] ԙ

o Is there ear pain? o Is there ear discharge? If Yes, for how long? ____ days

ƒ Look for pus draining from the ear ƒ Feel for tender swelling behind the ear

CHECK FOR MALNUTRITION AND ANAEMIA

ƒ Look for visible severe wasting ƒ Look for palmar pallor Severe palmar pallor? Some palmar pallor? ƒ Look for oedema of both feet ƒ Determine weight for age Very low ___ Not very low ___

YES 140. MASTOIDITIS ......................................................[ ] Ԙ 141. ACUTE EAR INFECTION ....................................[ ] Ԙ 142. CHRONIC EAR INFECTION................................[ ] Ԙ 143. NO EAR INFECTION ...........................................[ ] Ԙ 150 a. SEVERE MALNUTRITION................................[ ] Ԙ 150 b. SEVERE ANAEMIA ..........................................[ ] Ԙ 151 a. VERY LOW WEIGHT ........................................[ ] Ԙ 151 b. ANAEMIA ..........................................................[ ] Ԙ 152 a. NOT VERY LOW WEIGHT / NO ANAEMIA......[ ] Ԙ

NO [ ]ԙ [ ]ԙ [ ]ԙ [ ]ԙ [ ]ԙ [ ]ԙ [ ]ԙ [ ]ԙ [ ]ԙ

CHECK THE CHILD’S IMMUNISATION STATUS Vitamin A (1 dose) st

Circle immunisations and vitamin A needed today Vitamin A (2 nd

Birth dose)

6 weeks

10 weeks

14 weeks

9 months

BCG

DPT1

DPT2

DPT3

Measles

OPV0

OPV1

OPV2

OPV3

ASSESS CHILD’S FEEDING if child has ANAEMIA OR VERY LOW WEIGHT or is less than 2 years old

™ 8. IS <NAME> BREASTFED? .................................................................. [Yes]

Ԙ [No] ԙ [Don’t know] ԟ Ԙ [No] ԙ

™ 9.  If YES: HOW MANY TIMES IN 24 HOURS? |___|___| Do you breastfeed during the night? Yes __ No __

If NO breastfeeding or caretaker does not know, skip to question # 11

™ 10. IS NUMBER OF TIMES OF BREASTFEEDING AS RECOMMENDED? ..................... [Yes]

™ 11. DOES THE CHILD TAKE ANY OTHER FOOD OR FLUIDS? ....... [Yes]

Ԙ [No] ԙ [Don’t know] ԟ [Yes] Ԙ [No] ԙ [No] ԙ

If Yes, what food or fluids? ____________________________________________________________________

If NO other food or fluids or caretaker does not know, skip to question # 15

™ 12. IS THIS TYPE OF FOOD APPROPRIATE?……………………………………………….

™ 13. HOW MANY TIMES PER DAY? |___|___| times.

™ 14. IS NUMBER OF TIMES OF FEEDING AS RECOMMENDED? ……………….……..…[Yes]

Ԙ

What do you use to feed the child? _______________________

If low weight for age: How large are servings? _____________________________________________________

Does the child receive his own serving? Yes ___ No ___ Who feeds the child and how? ____________________

During this illness, has the child’s feeding changed? Yes ___ No ___

If Yes, how?

15. ASSESS OTHER PROBLEMS: ANY OTHER PROBLEMS?..……………………….[Yes]

Ԙ

[ [No] ԙ 160. EYE INFECTION (OTHER PROBLEM 1) 161. OTHER PROBLEM 2 (Sp.:__________________) [ 162. OTHER PROBLEM 3 (Sp.:__________________) [ 163. FEEDING PROBLEMS ........................................... [ 164. DOES CHILD NEED TO BE REFERRED?...................... [

]Ԙ[ ]Ԙ[ ]Ԙ[ ]Ԙ[ ]Ԙ[

]ԙ ]ԙ ]ԙ ]ԙ ]ԙ 165. RETURN FOR DEFINITE FOLLOW-UP IN:... |___|___| days . 166. ANY NON-IMCI REASON FOR ANTIBIOTICS?.............. [ ] Ԙ [ ] ԙ 170. HIGH MALARIA RISK? .................................................... [ ] Ԙ [ ] ԙ -

(Enter 00 if no follow-up is needed) Æ

2 -

FORM 3: RE-EXAMINATION 16. Ź Record if the child needs Vitamin A today:

Questionnaire: |___|___Œ___|___| HF code || Child ID

[Yes] Ԙ (Vitamin A needed) ‫ڡ‬

[No] ԙ (not needed) Î If NO skip to question # 19

17.  IF YES, ASK THE CARETAKER:

Ÿ ƅƍƒƃŒ Ɛť ƎŦ ŗƃƍŪŕƂ ƇƆ (Ŋ) ƇƒƆœřƒż ƇƆ űƀƈ ƉƍťŊ (¾ŽűƃŒ ƅŪŒ) ¾Ƌ (Show the mother a capsule of vitamin A as per child age) [Yes] ԘÎ If YES, skip to question # 19  ‫ڡ‬ 18.  IF NO or Don’t know:

[No] ԙ

[Don’t know] ԟ

ƇƒƆœřƒż ťŤœƒ ƇœŬŵ ŗƒšŮƃŒ ŖťšƍƄƃ ŗƒƈœř ŖŧƆ (¾ŽűƃŒ ƅŪŒ) ƑŕƒŞ (ƅƒƂšƃŒ )ƑšŮƃŒ ¾ƆœŶƃŒ Ɓƒƃ ¾œſ ¾Ƌ ŸƑƈœř ƅƍƒ Ƒż (Ŋ) [Yes] Ԙ 19.

[No] ԙ

[Don’t know] ԟ

Ź Record if child’s road-to-health or vaccination card is available:

[Yes] Ԙ (available) 20.

[No] ԙ (not available)

Ź Record if child needs to receive any immunisation today:

[Yes] Ԙ (immunisation needed)

[No] ԙÎ If NO, go to È (not needed)

 IF YES, ASK THE CARETAKER:

ŸƅƒŶűřƃŒ ŗżŧźƃ (ƅƒƂšƃŒ )ƏšŮƃŒ ¾ƆœŶƃŒ Ɗƃƍš ƍŊ ƅƍƒƃŒ ƅƒŶűřƃŒ ťŤŒ (¾ŽűƃŒ ƅŪŒ) ¾Ƌ21 [Yes] ԘÎ If YES, go to È (vaccination received or child referred to immunisation room) ‫ڡ‬ 22.  IF NO or Don’t know:

[No] ԙ (vaccination not given and child not referred)

[Don’t know] ԟ

ƇœƂƆ Ɓƒƃ ŻŮƍ ƍŊ ŗƒšŮƃŒ ŖťšƍƄƃ ŗƒƈœř ŖŧƆ (¾ŽűƃŒ ƅŪŒ) ƑŕƒŞ (ƅƒƂšƃŒ )ƑšŮƃŒ ¾ƆœŶƃŒ Ɓƒƃ ¾œſ ¾Ƌ ŸƊƒż ƊƒƆŶűř ƇœŬŵ Ƒƈœř [Yes] Ԙ [No] ԙ

È

È ASK THE CARETAKER:

IF THE CHILD HAS A FEVER CLASSIFICATION

È 23.

ŸƐť ŗƒšŮƃŒ ŖťšƍƄƃ ƊƒŕƒŞř œƆ ¾ŕſ œƒŧƚƆ Ŝƚŵ ƊƒřƒťŊ (¾ŽűƃŒ ƅŪŒ) ¾Ƌ [Yes] Ԙ IF YES… (next page)

[No] ԙÎ \ STOP here

[Don’t know] ԟÎ \ STOP here

-

3 -

FORM 3: RE-EXAMINATION ‫ڡ‬ 24.  IF YES: (Do not prompt)

Questionnaire: |___|___Œ___|___| HF code || Child ID

Ÿ (¾ŽűƃŒ ƅŪŒ)¾ ƊƒřƒťŊ ŇŒƍť ƐŊ a. Paracetamol...................... a. [Yes] Ԙ b. Chloroquine ..................... b. [Yes] Ԙ c. Fansidar ........................... c.

[No] ԙ [No] ԙ [No] ԙ [No] ԙ

[Yes] Ԙ

d. Other ................................. d. [Yes] Ԙ (specify: _________________) [No] ԙ e. Do not know ...................... e. [Yes] Ԙ ‫ڡ‬ 

25.  IF CHLOROQUINE OR FANSIDAR, ASK:

ŸŇŒƍťƃŒ (¾ŽűƃŒ ƅŪŒ) ƑřƒťŊ ƏƆšƃŒ ƊřœŞ œƆ ƇƆ ƅƂ ťŶŕ [Within 24 hours]Ԙ [1 or 2 days later]ԙ [3 or more days later] Ԛ



L SUPERVISOR: COPY CLASSIFICATIONS IN APPROPRIATE BOX ON FORM 1, PAGE 6 AND COLLECT BLOOD FILM IF TAKEN

-

4 -

FORM 4 – EQUIPMENT AND SUPPLY

FACILITY CODE: |___|____

Form 4. EQUIPMENT AND SUPPLY CHECKLIST Date: ____/____/ Facility:

2003

State: __________________ Code |___|___|

District: _______________________ Type: [HOSP] Ԙ

Name _____________________

[HC] ԙ [D/DS] Ԛ

Team: |_____|

Discuss with the head of facility to determine the number of health providers who usually manage children: Table 1: Characteristics of health providers with case management responsibilities Category No. managing children No. managing children trained in IMCI No. trained in IMCI present today

Doctor Medical assistant Nurse Total

Ask a health provider to show you around the facility. Look and physically check items to complete the following questions. These questions are for you to answer, based on what you see and find. EQUIPMENT AND SUPPLIES MODULE E1. Does the facility have the following equipment and materials? a. Accessible and working adult scale? ...............................................a. [Yes] b. Accessible and working baby scale? ..............................................b. [Yes] c. Working watch or timing device? .....................................................c.

Ԙ Ԙ Ԙ Ԙ Ԙ Ԙ Ԙ Ԙ Ԙ Ԙ Ԙ

[No] ԙ [No] ԙ [No] ԙ [No] ԙ [No] ԙ [No] ԙ [No] ԙ [No] ԙ [No] ԙ [No] ԙ [No] ԙ [No] ԙ [No] ԙ [No] ԙ [No] ԙ [No] ԙ [No] ԙ [No] ԙ

[Yes] Ԙ

c1.Functioning microscope ...................................................................c1. [Yes] c2.Slides (at least 5) .............................................................................c2. [Yes] c3.Giemsa.............................................................................................c3. [Yes] c4. Lancets to prick finger (at least 10).................................................c4. [Yes] d. Supplies to mix ORS, cups and spoons ..........................................d. [Yes] e. Improved source of water (hand-pump, tap water, deep well) ........e. [Yes] f. Stock cards/drug logbook ................................................................f.

[Yes] Ԙ

f1. Vaccination register/logbook............................................................f1. [Yes] g. Child road-to-health cards................................................................g. [Yes] h. Mothers’ IMCI counselling cards for use by health worker? ............h. [Yes] i. IMCI chart booklet? ..........................................................................i. l. Working nebuliser? ............................................................................l.

[Yes] Ԙ [Yes] Ԙ

n. Thermometer? ..................................................................................n. [Yes] o. IMCI recording forms? ......................................................................o. [Yes] p. IMCI daily register? ...........................................................................p. [Yes]

Ԙ Ԙ Ԙ

- 1 -

FORM 4 – EQUIPMENT AND SUPPLY

FACILITY CODE: |___|____

k. Accessible* means of transportation for patients requiring referral .k. [Yes] Ԙ [No] ԙ ----------------------------------------*Accessible here refers to transportation that is both physically accessible (e.g., distance) and economically accessible (= affordable) daily to most people living in the catchment area of this facility during the clinic hours.

E1z. Does the facility provide immunisation services?

[Yes] Ԙ E2.

[No] ԙ Î Skip to Availability of Drugs Module, question # D1

Does the facility have needles and syringes appropriate for vaccinations?

[Yes] Ԙ ‫ڡ‬ E2a.

[No] ԙ Î Skip to question # E4a

 IF YES (appropriate needles/syringes): How do health workers use these needles? [Multiple uses] ԙÎ Skip to question # E4a

[Single use] Ԙ ‫ڡ‬

E2b. IF SINGLE (DISPOSABLE) USE: Does the facility have the safety box to dispose of them?

[Yes] Ԙ

[No] ԙ

E4a. Does the facility have a functioning refrigerator?

[Yes] Ԙ ‫ڡ‬

[No] ԙ Î Skip to question # E5

E4b.  IF YES: Is there a working thermometer inside the refrigerator?

[Yes] Ԙ ‫ڡ‬

[No]ԙ Î Skip to question # E5

E4c. IF YES: Is the refrigerator’s temperature between 20C and 80C at the time of visit?

[Yes] Ԙ E5.

[No]ԙ

Does the facility have ice packs and undamaged cold boxes?

[Yes] Ԙ ‫ڡ‬

[No]ԙ Î Skip to Availability of Drugs Module, question # D1

E5a.  IF YES: Are ice packs frozen?

[Yes] Ԙ

[No]ԙ

- 2 -

FORM 4 – EQUIPMENT AND SUPPLY

FACILITY CODE: |___|____

AVAILABILITY OF DRUGS MODULE Check the drug stocks. Answer the following questions based on what you see. D1. Does the facility have the following drugs available at the time of the visit? a. ORS ......................................................................................................a. [Yes] b. Cotrimoxazole tablets or susp. – First line antibiotic for pneumonia and First line antibiotic for dysentery:..............b. [Yes] c. Amoxycillin tablets (250mg) or susp.– Second line antibiotic for pneumonia ..............c. [Yes] e. Nalidixic acid 250mg tab. - Second line antibiotic for dysentery:........e. [Yes] f. Chloroquine tablet (150mg base) or syrup (50mg or 75mg base/5ml) ..........f. [Yes] g. Sulfadoxine+pyrimethamine tablet (500mg Sulfa + 25mg pyrim.) ....g. [Yes] h. Vitamin A blue (100,000 IU) or red (200,000IU) caps with nipple .......h. [Yes] i. Iron syrup or Drops 25mg/ml ...............................................................i. [Yes] j. Paracetamol syrup 120mg/5 ml or Tablets 100mg or 500mg ............j. [Yes] l. Tetracycline eye ointment .................................................................l. [Yes] m.Gentian violet (0.5%) ..........................................................................m. [Yes] n. Salbutamol solution or metered dose inhaler (MDI) ............................n. [Yes] o. Salbutamol syrup 2mg/5 ml or Tablets 2mg or 4mg............................o. [Yes] p. Diazepam ampule (10mg/2ml) .............................................................p. [Yes]

Ԙ Ԙ Ԙ Ԙ Ԙ Ԙ Ԙ Ԙ Ԙ Ԙ Ԙ Ԙ Ԙ Ԙ

[No]ԙ

[No]ԙ [No]ԙ [No]ԙ [No]ԙ [No]ԙ [No]ԙ [No]ԙ [No]ԙ [No]ԙ [No]ԙ [No]ԙ [No]ԙ [No]ԙ

D2.

Does the facility have the following injectable drugs available at the time of the visit?

Ԙ b. Quinine IM ............................................................................................b. [Yes] Ԙ c. Benzylpenicillin IM ..............................................................................c. [Yes] Ԙ c1.Procain penicillin IM ..........................................................................c1.[Yes] Ԙ d. Gentamycin IM.....................................................................................d. [Yes] Ԙ e. Sterile water for injection.......................................................................e. [Yes] Ԙ f1.Ringer’s Lactate Solution (for severe dehydration)..............................f1. [Yes] Ԙ f2.Saline (for severe dehydration) ............................................................f2. [Yes] Ԙ a. Chloramphenicol IM ...........................................................................a. [Yes]

[No]ԙ [No]ԙ [No]ԙ [No]ԙ [No]ԙ [No]ԙ [No]ԙ [No]ԙ

How many treatment courses of the following drugs for child weighing 10 kg does the facility have right now? D4. D5. D6. D7. Cotrimoxazole - for pneumonia Amoxycillin, oral - for pneumonia Chloroquine, oral – for malaria Sulfadoxine+pyrimethamine – for malaria |___|___|___|___| |___|___|___|___| |___|___|___|___| |___|___|___|___|

- 3 -

FORM 4 – EQUIPMENT AND SUPPLY

FACILITY CODE: |___|____

FACILITY SERVICES MODULE Ask the following questions of the health provider who has been observed during case management. If there are several health providers who have been observed managing cases in the same facility, discuss the following questions with all of them and try to reach a consensus for each question. Add comments on the back of the form if you have any problems. S1. S2. S3. How many days per week is the facility open (including emergency services)? _____ days/week How many days per week are curative child health services provided? Does the facility hold immunisation sessions during the week? _____ days/week

[Yes] Ԙ

[No]ԙÎ Skip to question # S4

 If Yes (immunisation sessions available during the week):  ‫ڡ‬ ‫ڡ‬ S3a. How many sessions are held at the facility per week? S3b. Which vaccinations are not available during the week? (Tick all that apply) _____ no./week

[Measles] Ԙ [BCG] ԙ ‫ڡ‬

[DPT] Ԛ

[OPV] ԛ

[All are available] ԜÎ Skip to question # S5

 If not all available: S4. Does the facility hold immunisation sessions in a month?

[Yes] Ԙ ‫ڡ‬ 

[No]ԙÎ Skip to question # S5

 If Yes: S4a: Which vaccinations are not available in a month? (Tick all that apply)

[Measles] Ԙ [BCG] ԙ S5.

[DPT] Ԛ

[OPV] ԛ

[All are available] Ԝ

How many times during the last six months did the facility receive a supervisory visit? ............................................................................. _________ times/6 months Î If No visit in the last 6 months, enter 0 and skip to question S7a

‫ڡ‬

S6.

How many of these supervisory visits were follow-up visits after training to health workers who have been recently trained in IMCI? _________ visits

ASK THE HEALTH PROVIDER/S QUESTION S7, BASED ON THE MOST RECENT SUPERVISORY VISIT THAT WAS NOT AN IMCI FOLLOW-UP VISIT AFTER TRAINING: ‫ڡ‬ S7. Did the supervisor observe case management of a sick child the last time he/she visited the facility?

[Yes] Ԙ

[No]ԙ

[Doesn’t know] ԟ

S7a. Does the facility have a supervisory book?

[Yes] Ԙ ‫ڡ‬

[No]ԙÎ Skip to question # S9

[Doesn’t know] ԟÎ Skip to question # S9

S7b.  If YES: Does the record of the latest supervisory visit in the book include also any recommendations to facility staff?

[Yes] Ԙ ‫ڡ‬

[No]ԙ

[No record of visit found] ԚÎ Skip to question # S9

S7c. How many months ago was the latest record of a supervisory visit? |___|___| months ago

- 4 -

FORM 4 – EQUIPMENT AND SUPPLY

FACILITY CODE: |___|____

S9. How long does it take for the patient to get to the referral hospital using the most common* local transport? _________ hours _________ minutes [If this is the OPD of a hospital, enter “0”] *Common here refers to the means of transport commonly taken by and affordable to most people in this area

S10. Have you ever wanted to refer a very severely-ill child but been unable to do so?

[Yes] Ԙ ‫ڡ‬

[No]ԙÎ Skip to question # S11

S10a.  IF YES, Why? ___________________________________________________________ ___________________________________________________________

S11. If you had to refer 10 children to the hospital, how many of them do you think will end up going to the hospital? _________ children

FACILITY CASELOAD DATA: ESTIMATED FIGURES ASK THE FOLLOWING QUESTIONS OF ALL THE HEALTH WORKERS SEEING OUTPATIENTS AND RECORD THE TOTAL NUMBER OF CASES FOR ALL OF THEM:

F1.

How many outpatients (all ages) did you see last week (best estimate)?

_____________ outpatients all ages seen last week F2. How many of these outpatients were children under-five (best estimate)?

_____________ children under-five seen last week F3. How many outpatients all ages had pneumonia or bronchopneumonia last week (best estimate)?

_____________ outpatients all ages with pneumonia or bronchopneumonia seen last week F4. How many of these outpatients with pneumonia or bronchopneumonia were children underfive (best estimate)?

_____________ children under-five with pneumonia or bronchopneumonia seen last week F5. How many outpatients all ages had malaria last week (best estimate)?

_____________ outpatients all ages with malaria seen last week F6. How many of these outpatients with malaria were children under-five (best estimate)?

_____________ children under-five with malaria seen last week F7. Does the facility have a logbook where outpatients’ diagnoses are recorded?

[Yes] Ԙ

[No]ԙÎ If NO, Stop here 8

- 5 -

FORM 4 – EQUIPMENT AND SUPPLY

FACILITY CODE: |___|____

FACILITY RECORDS MODULE Ask the health provider responsible for records to help you identify records for all visits to the health facility. Do not include inpatient records. Use these records to answer the questions below. If not enough information is available to answer a question, mark NI (not enough information).

Note: The availability of records may vary by level of health facility. Procedures to estimate attendance should be determined in each site. These procedures must be practical!

¾CHECK THE RECORDS OF THE MONTH OF JANUARY 2003 AND FILL IN THE TABLE BELOW Count total for each type of service. Children may visit more than one service during one visit to the facility.

OUTPATIENT Insured Uninsured R1. What is the total number of visits to the health facility for OUTPATIENT services (ALL AGES) during the month of January? How many of these visits were made by children UNDER-FIVE (from 0 up to 5 years old)? How many of these underfive child visits were made by FEMALE children? How many of these underfive visits were made by children UNDER TWO MONTHS (from 0 to 2 months)? How many OUTPATIENT visits (ALL AGES) were classified / diagnosed as PNEUMONIA or BRONCHOPNEUMONIA? How many of these visits were for UNDERFIVEs? How many OUTPATIENT visits (ALL AGES) were classified / diagnosed as MALARIA? How many of these visits were for UNDERFIVEs?

WELL CHILD (growth monitoring) Immunisation Growth monitoring

|__|__|__|__|

|__|__|__|__|

R2.

|__|__|__|__|

|__|__|__|__|

|__|__|__|__|

|__|__|__|__|

R3.

|__|__|__|__|

|__|__|__|__|

|__|__|__|__|

|__|__|__|__|

R4.

|__|__|__|__|

|__|__|__|__|

R5.

|__|__|__|__|

|__|__|__|__|

R6.

|__|__|__|__|

|__|__|__|__|

R7.

|__|__|__|__|

|__|__|__|__|

R8.

|__|__|__|__|

|__|__|__|__|

- 6 -

OBSERVATION SHEET Date: _____________ Supervisor:__________________________ Health facility code: |___|___| Team: ____

District: ___________________________

1. ORGANISATION OF WORK AT THE FACILITY (Flow of patients, waiting time, distribution of tasks triage to select severe cases, counselling, etc.-)

2. DRUGS (Availability in the past 3 months and out-of-stock situations lasting more than 1 week – esp. antibiotics and malaria drugs -, drug procurement system, perception about affordability of drugs by families)

3. REFERRAL (Pathway, accessibility to referral sites and perceived quality of services at the referral facility, feedback received from referral facility)

4. UTILISATION OF SERVICES (Has there been an increase in the utilisation of health services for sick children since IMCI has been introduced in this facility? If so, are there any data supporting this point?)

5. HIS: RECORDING AND REPORTING TO HIGHER LEVELS (how many different records are used to record information on the sick child from the time s/he enters the facility to the time s/he leave it? Check if the facility has a copy of the last routine report submitted to higher level)

6. PERCEIVED MAIN CONSTRAINTS TO THE IMPLEMENTATION OF THE IMCI STRATEGY AT THIS FACILITY AND SUGGESTED SOLUTIONS

Continue on the back of this page if necessary.

Informations clés
Type de document Publications
Date d'adoption
Source Organisation mondiale de la santé