Electronic monitoring of treatment adherence and validation of alternative adherence measures in tuberculosis patients: a pilot study

Bull World Health Organ 2011;89:632–639 | doi:10.2471/BLT.11.086462 Research 632 Electronic monitoring of treatment adherence and validation of alternative adherence measures in tuberculosis patients: a pilot study Jossy van den Boogaard,a Ramsey A Lyimo,b Martin J Boeree,a Gibson S Kibikib & Rob E Aarnoutsec Introduction Non-adherence to treatment for tuberculosis is a major barrier to global tuberculosis control. To ensure adherence to treatment by tuberculosis patients, the direct observation of treatment by a trained supervisor is recommended.1 Initially, such directly observed treatment (DOT) was provided in health-care facilities only, but because of workload demands, several countries have started to involve community members in the provision of DOT.2 Studies have shown that community-based DOT is a cost-effective strategy that yields treatment outcomes similar to those obtained with facility-based DOT.3–6 However, community-based DOT has been criticized for being beyond the control of health-care providers and hence conducive to self-administered (unsupervised) treatment and non-adherence.6,7 The actual degree of adherence by patients on community- based DOT has not yet been assessed. Measuring adherence is difficult because most available direct and indirect measures have limitations. Direct adherence measures, such as tests to measure drug levels in plasma or urine, cover brief medication intake pe- riods only. Indirect measures, such as pill counts and self-report questionnaires, cover longer periods but assume rather than prove the patient’s actual medication intake.8 A sophisticated indirect adherence measure is the Medication Event Monitoring System (MEMS). MEMS medication bottles contain a microelectronic chip that registers the date and time of every bottle opening. Assuming that bottle openings represent medication intake, MEMS provides a detailed profile of the pa- tient’s adherence behaviour. MEMS is currently regarded as the gold standard to measure adherence.8 It has been used as such in a wide range of studies on adherence to antihypertensive and lipid- lowering therapy,9,10 therapy for neurologic and psychiatric disor- ders,11,12 post-transplantation immunosuppressive therapy13,14 and antiretroviral therapy.15–17 Few studies report on the use of MEMS to monitor adherence to tuberculosis treatment.18–21 Because of the high cost involved, MEMS is not feasible for use in routine practice in most settings with a high tuberculosis burden but could be used as a reference standard to validate simple and affordable measures that can be used in patients on community-based DOT.8,21 In this pilot study, we used MEMS to: (i) describe adherence rates among Tanzanian tuberculosis patients on community-based DOT and (ii) determine the validity of several direct and indirect adherence measures of potential use in resource-limited settings. Methods Study setting The study was conducted in the Kilimanjaro region of the United Republic of Tanzania, where the annual tuberculosis case notifica- tion rate is 178 per 100 000 population.6 The national tuberculosis programme empowers patients to choose between community- and facility-based DOT. Most patients opt for community-based DOT and those on facility-based DOT are mostly inpatients.6 Patients on community-based DOT have to select a treatment supporter Abstracts in بيرع, 中文, Français, Pусский and Español at the end of each article. Objective To assess adherence to community-based directly observed treatment (DOT) among Tanzanian tuberculosis patients using the Medication Event Monitoring System (MEMS) and to validate alternative adherence measures for resource-limited settings using MEMS as a gold standard. Methods This was a longitudinal pilot study of 50 patients recruited consecutively from one rural hospital, one urban hospital and two urban health centres. Treatment adherence was monitored with MEMS and the validity of the following adherence measures was assessed: isoniazid urine test, urine colour test, Morisky scale, Brief Medication Questionnaire, adapted AIDS Clinical Trials Group (ACTG) adherence questionnaire, pill counts and medication refill visits. Findings The mean adherence rate in the study population was 96.3% (standard deviation, SD: 7.7). Adherence was less than 100% in 70% of the patients, less than 95% in 21% of them, and less than 80% in 2%. The ACTG adherence questionnaire and urine colour test had the highest sensitivities but lowest specificities. The Morisky scale and refill visits had the highest specificities but lowest sensitivities. Pill counts and refill visits combined, used in routine practice, yielded moderate sensitivity and specificity, but sensitivity improved when the ACTG adherence questionnaire was added. Conclusion Patients on community-based DOT showed good adherence in this study. The combination of pill counts, refill visits and the ACTG adherence questionnaire could be used to monitor adherence in settings where MEMS is not affordable. The findings with regard to adherence and to the validity of simple adherence measures should be confirmed in larger populations with wider variability in adherence rates. a Radboud University Nijmegen Medical Centre, University Centre for Chronic Diseases Dekkerswald, Nijmeegsebaan 31, 6560 AB, Groesbeek, Netherlands. b Kilimanjaro Clinical Research Institute, Kilimanjaro Christian Medical Centre, Moshi, Tanzania. c Department of Clinical Pharmacy, Radboud University Nijmegen Medical Centre, Nijmegen, Netherlands. Correspondence to Jossy van den Boogaard (e-mail: jossyvandenboogaard@gmail.com). (Submitted: 25 January 2011 – Revised version received: 4 May 2011 – Accepted: 4 May 2011 – Published online: 20 May 2011 ) R search Bull World Health Organ 2011;89:632–639 | doi:10.2471/BLT.11.086462 633 Research Monitoring treatment adherence electronically in tuberculosis patientsJossy van den Boogaard et al. from their community (usually a relative or spouse) who is instructed on how to provide daily DOT at home. Patients on community-based DOT are supposed to collect their medication once a week in the first two months of treatment and once every two weeks in the remaining four months. They should return medica- tion blisters for pill counts and their clinic attendance is registered.22 Study design and procedures This was a longitudinal pilot study in which treatment adherence among 50 patients on community-based DOT was monitored by MEMS throughout treatment. MEMS was used as a gold standard to validate several other adherence measures (single and in combinations) in this patient group. The adherence measures were selected for their applicability in the Tanzanian setting and included an isoniazid (INH) urine test, a urine colour test for rifampicin, the Brief Medication Questionnaire (BMQ), the Morisky scale, an adapted version of the AIDS Clinical Trials Group (ACTG) adherence questionnaire, pill counts and clinic attendance for medication refills. The participants were recruited be- tween February and May 2010 from one rural hospital, one urban hospital and two urban health centres. Considering the pi- lot nature of our study, we chose to enrol 50 patients only. Adult outpatients who consecutively presented at one of the study sites with newly diagnosed tuberculosis and who had chosen community-based DOT were eligible to participate. Eligible patients were informed about the study procedures by trained clinic staff and asked to sign an informed consent form. They were told that their tuberculosis medication would be provided in a medication bottle with a microelectronic chip that registers every bottle opening. They were asked not to use the MEMS bottle for other medication, to open it only to take out medication, and to bring the bottle to every medication refill visit. Patients were informed that they would be under routine treatment and care. Drug dispensing nurses were responsi- ble for providing patients with medication. Medication refill visits were conducted in accordance with routine practice, except that the medication blisters were cut into pieces to make them fit in the MEMS bottle. The nurses registered the dates of the patients’ clinic visits for medication refills and the number of tablets remaining at each visit. During the visits in weeks 4, 8, 12 and 16, the procedures deviated from routine practice. At these visits, patients submitted a sample of urine and were asked to fill out the BMQ and Morisky scale (in weeks 4, 8 and 12) or the ACTG adherence questionnaire (in week 16). At completion of treatment, the patients filled out a questionnaire about their experience with the use of MEMS bottles. Treatment adherence measures Medication Event Monitoring System MEMS medication bottles (250-ml con- tainers with a 38-mm MEMS 6 TrackCap, AARDEX Ltd, Sion, Switzerland) were used by all participants throughout treat- ment. MEMS data were used to calculate adherence rates (by dividing the number of days on which at least one bottle open- ing was registered by the total number of monitored days and multiplied by 100) and to differentiate between adherent and non-adherent patients for validation of the other adherence measures. For the latter purpose, commonly used adherence rate cut-off values of 100%, 95% and 80% were applied.8 Isoniazid urine test The isoniazid urine test or IsoScreen test (GFC Diagnostics Ltd, Bicester, England) is based on the Arkansas method for the detection of INH in urine and supplied in a ready-to-use plastic testing device. The test was performed in accordance with the directions provided in the accompa- nying manual. The test result was negative when no colour change was observed after 5 minutes, positive when the colour changed to dark purple and equivocal when the colour turned green. Patients with at least one negative test were regarded as non-adherent. Urine colour test Prior to each INH urine test, urine colour was checked for the presence of rifampicin. Orange urine was scored as positive and yellow urine as negative. Patients with at least one negative test were categorized as non-adherent. Morisky scale The Morisky scale is a self-report adherence measure with four questions about com- mon barriers to adherence.23 We classified as non-adherent all patients who answered “yes” to at least one of the four questions in at least one of the three repeated tests. Brief Medication Questionnaire The BMQ consists of three sections (“screens”) with questions about adher- ence behaviour, the experienced effects of treatment and other factors that could affect adherence. The screens were scored as described elsewhere.24 Patients with a total score of 1 or more in at least one of the three repeated tests were classified as non-adherent. AIDS Clinical Trials Group adherence questionnaire The adapted ACTG adherence question- naire was developed for patients infected with the human immunodeficiency virus (HIV) who participate in clinical trials25 and is available at www.ghdonline.org/ uploads/ACTG_Adherence_Baseline_ Questionnaire.pdf (last accessed: 12 May 2011). Our adapted version consisted of three multiple choice items corresponding to sections B (social support), C (possible reasons for non-adherence) and D (adher- ence behaviour) of the original baseline questionnaire. We scored any answer other than “never” to the questions in sections C and D or less than “somewhat satisfied” to the questions in section B as positive. A positive score was regarded as indicative of non-adherence. Refill visits and pill counts The patients’ clinic attendance for medica- tion refills was registered and remaining tablets were counted at every refill visit. Patients who delayed at least once for a medication refill visit and those who had an incorrect number of tablets remaining at least once were classified as non-adherent. Data analysis MEMS data were analysed by using Pow- erview software (AARDEX Ltd, Sion, Switzerland). Periods of “pocket dosing” (i.e. taking out medication for later use) that were identified by the MEMS use questionnaire were excluded from the analysis as non-monitored periods. Statisti- cal analysis was performed in SPSS version 16.0 (SPSS Inc., Chicago, United States of America). Means are presented with standard deviation (SD) and medians with interquartile range (IQR). Means were compared by using the Student t-test. The sensitivity, specificity, positive and negative predictive values and accuracy of single and combined adherence measures were calcu- lated by using MEMS as the gold standard. For combined measures, non-adherent patients were those who were classified as non-adherent by at least one of the single measures in the combination. Bull World Health Organ 2011;89:632–639 | doi:10.2471/BLT.11.086462634 Jossy van den Boogaard et al.Monitoring treatment adherence electronically in tuberculosis patients Research Ethical approval The study was approved by the insti- tutional review board of the Kiliman- jaro Christian Medical Centre (Moshi, United Republic of Tanzania) and the National Institute for Medical Re- search (Dar es Salaam, United Republic of Tanzania). Results Patient characteristics and treatment outcomes We enrolled 31 male and 19 female pa- tients. Their characteristics are summarized in Table 1. Six of the 22 patients who were co-infected with HIV used antiretroviral medication and 14 were on co-trimoxazole prophylaxis. Although all patients were on community-based DOT, seven had no formal treatment supporter. Thirty-seven patients successfully completed treatment. Six patients died; all were HIV-positive. Three patients de- faulted and four patients dropped out of the study (three were transferred to another region and one developed jaundice and his treatment had to be interrupted). Treatment adherence according to MEMS No MEMS data were available for three patients (one defaulter and two who died) because the medication bottle was not returned. For the other 47 patients, a total of 6871 treatment days were monitored by MEMS. On 194 monitored days the MEMS bottle was not opened; the median per patient was 2 days (IQR: 0–5). The mean adherence rate was 96.3% (SD: 7.7) and did not differ significantly between patients with and without a treatment sup- porter: 96.2% (SD: 8.2) and 97.1% (SD: 3.1), respectively (P = 0.79). Adherences was less than 100% in 70% of all patients; less than 95% in 21% of them, and less than 80% in 2% (Table 2). Among the patients who completed the six- month treatment course, adherence was less than 100% in 73%, less than 95% in 19% and less than 80% in none, respectively. Monthly adherence rates were fairly constant. In the group of patients who completed treatment, the median monthly adherence rate was 100% and the mean monthly adherence rate varied between 95.4% (SD: 7.3) in month 6 and 98.5% (SD: 2.7) in month 3. Validation of adherence measures For the validation of the alternative adher- ence measures only patients who com- pleted the six-month treatment course (n = 37) were included. As shown in Fig. 1, the proportions of non-adherent patients identified by the different measures varied widely. Table 3 shows the sensitivity, speci- ficity, positive and negative predictive value and accuracy of the adherence measures in terms of their ability to differentiate between adherent and non-adherent patients. The ACTG adherence question- naire and urine colour test had the highest sensitivities but lowest specificities. The Morisky scale and refill visits had the high- est specificities but lowest sensitivities. The sensitivities of most measures improved when the cut-off value to differentiate be- Table 1. Patient characteristics and treatment outcomes among participants (n = 50) in a study of adherence to tuberculosis treatment, United Republic of Tanzania, 2010 Characteristic No. (%)a Gender Females 19 (38) Males 31 (62) Mean age in years (SD) 41.6 (14.0) Education None 2 (4) Primary 38 (76) Secondary 9 (18) Advanced secondary 1 (2) Marital status Single 14 (28) Married 23 (46) Divorced 9 (18) Widow 4 (8) TB diagnosis Smear positive PTB 16 (32) Smear negative PTB 25 (50) EPTB 9 (18) Treatment clinic Urban 44 (88) Rural 6 (12) Transport to clinic Foot 30 (60) Public 17 (34) Private 3 (6) Treatment supporter None 7 (14) Spouse 13 (26) Relative 27 (54) Friend 3 (6) HIV status Positive 22 (44) Negative 28 (56) Treatment outcome Favourable Cured 12 (24) Treatment completed 25b (50) Unfavourable Died 6 (12) Defaulted 3 (6) Study drop-out 4 (8) EPTB, extrapulmonary tuberculosis; HIV, human immunodeficiency virus; PTB, pulmonary tuberculosis; SD, standard deviation; TB, tuberculosis. a All except for age, which is expressed as the mean and standard deviation. b All had smear-negative PTB or EPTB. Bull World Health Organ 2011;89:632–639 | doi:10.2471/BLT.11.086462 635 Jossy van den Boogaard et al. Monitoring treatment adherence electronically in tuberculosis patients Research tween adherent and non-adherent patients was lowered from 100% to 95% adherence, but the specificities dropped. The positive and negative predictive values were almost reversed by changing the cut-off value from 100% to 95%, reflecting the large difference in the proportions of patients categorized as non-adherent by using the former versus the latter cut-off value. A cut-off value of 80% could not be applied because none of the patients who completed treatment was less than 80% adherent. The combination of pill counts and refill visits that is used in routine practice had moderate sensitivity and specificity. Its sensitivity and negative predictive value for the identification of patients who were less than 95% adherent improved by adding any of the other adherence measures except the Morisky scale (Table 3). Patients’ experience with MEMS use The questionnaire about the use of MEMS, which was filled out by the 37 patients who completed treatment, revealed that only one patient had correctly understood the purpose of MEMS despite verbal and writ- ten information at the onset of the study. Twenty-five patients (68%) stated that the white, bulky appearance of the MEMS bottle reminded them to take the medica- tion. However, the other patients said that the use of MEMS had not influenced their adherence behaviour. Mean adherence rates did not differ between these two groups: 97.5% (SD: 3.0) and 97.3% (SD: 3.2), respectively (P = 0.86). Eight patients occasionally opened the MEMS bottle to take out medication for later use (resulting in a total of 42 non- monitored treatment days). This usually occurred when patients did not want to take the bottle along on travel occasions. Discussion This is the first study in which MEMS was used to assess treatment adherence rates in patients on community-based DOT over the full six-month tuberculosis treatment course. We observed high adherence rates in our pilot study of 50 Tanzanian patients. Almost 80% of the patients were more than 95% adherent and only one patient was less than 80% adherent. These findings do not confirm the concern that patients on community-based DOT are prone to become non-adherent, even though the study did reveal that some patients (i.e. those without a formal treatment sup- porter) turn community-based DOT into unsupervised treatment. The participants’ demographic char- acteristics, such as the ratio of males to females and their treatment outcomes, were comparable to those of the gen- eral tuberculosis patient population in the Kilimanjaro region.6 This suggests that we studied a regionally representative patient sample. However, the adherence rates of our patients could have been biased by their participation in the study. Although we tried to deviate as little as possible from routine practice, the repeated adherence questionnaires and urine tests certainly made participants aware of our interest in their adherence behaviour. Two thirds of the patients felt that their adherence behaviour had been influenced by the use of MEMS, but their average adherence rate did not differ from those observed among patients who stated that MEMS had not influenced their behaviour. Findings from other studies suggest that when MEMS is used over long periods, its “interventional Table 2. Median monitored treatment days and adherence rates, and proportions of patients who were less than 100%, 95% and 80% adherent,a as assessed by the Medication Event Monitoring System (MEMS), United Republic of Tanzania, 2010 Patientsa Monitored days Adherence rate (%) < 100% adherent < 95% adherent < 80% adherent Median (IQR)b Median (IQR)b No. (%) No. (%) No. (%) All (47) 168 (138–172) 98.4 (95.7–100) 33 (70) 10 (21) 1 (2) Completed treatment (37) 169 (168–180.5) 98.4 (95.7–100) 27 (73) 7 (19) 0 (0) Defaulters (2) 40.0/113c 50.0/100d 1 (50) 1 (50) 1 (50) Deaths (4) 63 (29.5–104) 98.4 (95.6–99.6) 3 (75) 1 (25) 0 (0) Study drop outs (4) 33 (21–73) 98.3 (88.4–100) 2 (50) 1 (25) 0 (0) IQR, interquartile range. a Only patients for whom MEMS data were available are included. b All values given are medians and IQRs except for the values of the two defaulters. c Number of monitored days for defaulter 1 and defaulter 2, respectively. d Adherence rates of defaulter 1 and defaulter 2, respectively. Fig. 1. Non-adherence to tuberculosis treatment among patients who completed treatment (n = 37) as assessed by different adherence measures, United Republic of Tanzania, 2010 0 Refill visits % assessed as 100% adherent Pill counts Morisky scale BMQ ACTG questionnaire Urine colour test INH urine test MEMS (<95% adherent) MEMS (<100% adherent) 10 20 30 40 50 60 70 80 90 100 ACTG, AIDS Clinical Trials Group; BMQ, Brief Medication Questionnaire; INH, isoniazid; MEMS, Medication Event Monitoring System. Bull World Health Organ 2011;89:632–639 | doi:10.2471/BLT.11.086462636 Jossy van den Boogaard et al.Monitoring treatment adherence electronically in tuberculosis patients Research effect” disappears.26,27 Since our sample size was small, larger population studies should be conducted to assess the real impact of community-based DOT with and without formal treatment supporter on adherence rates. We did not aim to validate the con- cept of community-based DOT; studies for this purpose should have a different design. The main objective of our study was to use MEMS as a reference standard to calculate the validity of several adherence measures whose use is feasible in patients on community-based DOT in resource- limited settings. The high adherence rates in the study population forced us to ap- ply high adherence rate cut-off values to calculate the validity and reliability of the adherence measures. This resulted in wide gaps between the sensitivities and speci- ficities of the measures.8 Combinations of measures were found to be more accurate than single measures in identifying as many true non-adherent patients as possible (reflected in high sensitivities and nega- tive predictive values). The sensitivity and negative predictive value of the routinely used combination of pill counts and clinic attendance for medication refills improved substantially by adding a simple and cheap measure such as the ACTG adherence questionnaire, particularly at an adherence rate cut-off value of 95%. The rifampicin urine colour test clas- sified more patients as non-adherent than the INH urine test. Since the orange urine colouration caused by rifampicin is of short duration and may be absent altogether,28 it is likely that the urine colour test misclas- sified some patients with yellow urine as non-adherent. Such misclassifications are difficult to confirm in a study population with high adherence rates. The adapted ACTG adherence ques- tionnaire yielded more favourable re- sponses than the other self-report measures. Differences in wording in the question- naires may account for this.8 While patients had to answer either “yes” or “no” to the questions in the Morisky scale, they could answer “often”, “sometimes”, “rarely”, or “never” to comparable questions in the ACTG adherence questionnaire. This wid- er range of choice options may have evoked more honest replies. The ACTG adherence questionnaire (and to a lesser extent the BMQ) has the added advantage of disclos- ing factors that cause non-adherence in the individual patient. These factors could be used to design tailored interventions for promoting adherence among non-adherent patients on community-based DOT. We therefore suggest using the triple combina- tion consisting of the ACTG adherence T ab le 3 . S en si tiv ity , s pe ci fic ity , p os iti ve a nd n eg at iv e pr ed ic tiv e va lu es , a nd a cc ur ac y of in di vi du al tr ea tm en t a dh er en ce m ea su re s, a lo ne a nd in c om bi na tio n, in a s tu dy o f a dh er en ce to tu be rc ul os is tr ea tm en t, Un ite d Re pu bl ic o f T an za ni a, 2 01 0 Ad he re nc e m ea su re Se ns iti vi ty a Sp ec ifi ci ty b PP Vc NP Vd Ac cu ra cy e M EM S cu t- of ff M EM S cu t- of ff M EM S cu t- of ff M EM S cu t- of ff M EM S cu t- of ff < 1 00 % < 9 5% < 1 00 % < 9 5% < 1 00 % < 9 5% < 1 00 % < 9 5% < 1 00 % < 9 5% IN H ur in e te st 33 43 40 60 60 20 18 82 35 57 Ur in e co lo ur te st 74 86 20 27 71 21 22 89 59 38 AC TG q ue st io nn ai re 70 10 0 30 37 27 27 73 10 0 60 49 BM Q 54 57 70 55 82 24 37 84 58 56 M or is ky s ca le 15 14 10 0 90 10 0 25 30 82 38 76 Pi ll co un ts 33 29 60 63 69 15 25 79 41 57 Re fil l v is its 22 14 10 0 83 10 0 17 32 81 43 70 Re fil l v is its + p ill co un ts 41 29 60 57 73 13 27 77 46 51 Re fil l v is its + p ill co un ts + A CT G qu es tio nn ai re 79 10 0 0 20 68 23 0 10 0 57 35 Re fil l v is its + p ill co un ts + u rin e co lo ur te st 78 86 20 23 72 21 25 88 62 35 Re fil l v is its + p ill co un ts + B M Q 69 71 50 38 78 22 39 85 64 44 Re fil l v is its + p ill co un ts + IN H ur in e te st 63 71 30 37 71 21 23 85 54 43 Re fil l v is its + p ill co un ts + M or is ky s ca le 41 29 60 57 73 13 27 77 46 51 AC TG , A ID S Cl in ic al T ria ls G ro up ; B M Q, B rie f M ed ic at io n Qu es tio nn ai re ; I NH , i so ni az id ; M EM S, M ed ic at io n Ev en t M on ito rin g Sy st em ; N PV , n eg at ive p re di ct ive v al ue ; P PV , p os iti ve p re di ct ive v al ue . a S en si tiv ity : t he p ro po rti on o f n on -a dh er en t i nd ivi du al s co rre ct ly id en tifi ed a s no n- ad he re nt b y th e m ea su re . b S pe ci fic ity : t he p ro po rti on o f a dh er en t i nd ivi du al s co rre ct ly id en tifi ed a s ad he re nt b y th e m ea su re . c P os iti ve p re di ct ive v al ue : t he p ro po rti on o f n on -a dh er en t i nd ivi du al s ac co rd in g to th e m ea su re w ho w er e no n- ad he re nt a cc or di ng to M EM S. d N eg at ive p re di ct ive v al ue : t he p ro po rti on o f a dh er en t i nd ivi du al s ac co rd in g to th e m ea su re w ho w er e ad he re nt a cc or di ng to M EM S. e A cc ur ac y: th e pr op or tio n of in di vid ua ls c or re ct ly id en tifi ed a s ei th er a dh er en t o r n on -a dh er en t b y th e m ea su re . f N on -a dh er en ce d efi ne d as a n ad he re nc e ra te o f < 1 00 % (2 7 pa tie nt s) o r < 9 5% (7 p at ie nt s) a s as se ss ed b y M EM S. Bull World Health Organ 2011;89:632–639 | doi:10.2471/BLT.11.086462 637 Jossy van den Boogaard et al. Monitoring treatment adherence electronically in tuberculosis patients Research questionnaire, refill visits and pill counts to monitor treatment adherence by Tanza- nian patients on community-based DOT. If the results are interpreted carefully, the combination seems valid and its use in routine practice appears feasible. In conclusion, this study revealed high levels of treatment adherence by Tanza- nian tuberculosis patients on community- based DOT. Although caution should be exercised in interpreting the results because this is a pilot study, the findings support the recommendation of using community-based DOT as an alterna- tive to facility-based DOT in settings with overburdened health-care facilities. To monitor adherence among patients on community-based DOT in resource- limited settings where electronic monitor- ing is not feasible, combinations of simple and affordable adherence measures can be used. Supplementing pill counts and clinic attendance with a self-report measure such as the ACTG adherence questionnaire will help to identify potentially non-adherent patients who could benefit from tailored adherence-promoting interventions. Fur- ther studies in larger patient populations are needed to assess the adherence rates of patients on community-based DOT and to confirm the validity of simple and afford- able adherence measures. ■ Funding: The KNCV Tuberculosis Foundation (the Netherlands) provided financial support for the study but was not involved in the design or conduct of the study, or in the decision to publish the results. Competing interests: None declared. Résumé Suivi électronique de l’adhésion au traitement et validation de mesures d’adhésion alternatives des patients tuberculeux: une étude pilote صخلم ةيدايترا ةسارد :لسلا ضىرم ينب جلاعلل لاثتملال ةليدبلا يربادتلا ةيقودصم قيثوتو جلاعلل لاثتملال ةينوتركللإا ةبقارلما شرابلما فاشرلإا تحت زكترلما ةيعمتجلما ةجلاعملل لاثتملاا سايق ضرغلا قيثوتو ،ةاوادلما ثدح ةبقارم ماظن مادختساب اينازنت في لسلا ضىرم ينب دراولما ةدودحلما عقاولما في جلاعلل لاثتملال ةليدبلا يربادتلا ةيقودصم .لياثم رايعمك ةاوادلما ثدح ةبقارم ماظن مادختساب مت ًاضيرم 50 لىع ةيدايترلاا ةينلاوطلا ةساردلا هذه تيرجأ ةقيرطلا ،ةيضرحلا تايفشتسلما دحأو ،ةيفيرلا تايفشتسلما دحأ نم لياوتلاب مهجاردإ ماظن قيرط نع جلاعلل مهلاثتما ةبقارم ىرجو .ينيضرح ينيحص نيزكرم نمو :جلاعلل مهلاثتملا ةيلاتلا يربادتلا ةيقودصم سيق ماك ةاوادلما ثدح ةبقارم ،Morisky كيسيروم زرحو ،لوبلا نول رابتخاو ،ليوبلا ديزاينوزيلأا رابتخا ةيريسرلا براجتلا ةعومجم نم هفييكت ىرج ةاوادلما نع زجوم نايبتساو تارايزو ،ءاودلا بوبح دادعتو ،جلاعلل لاثتملاا نع نايبتساو ،زديلإا نع .ءاودلاب دادملإا ةداعإ 96.3% ةساردلا في ينَجردُلما ينب جلاعلل لاثتملاا لدعم ناك جئاتنلا 70% في 100% نم لقأ جلاعلل لاثتملاا ناكو .)7.7 :يرايعلما فارحنلااو( ناكو .2% في 80% نم لقأو ،مهنم 21% في 95% نم لقأو ،ضىرلما نم رابتخاو زديلإا نع ةف َّيكُلما ةيريسرلا براجتلا ةعومجبم صاخلا نايبتسلاا زرح ناكو .ةيعونلا في لقلأا نكلو ةيساسحلا ثيح نم لىعلأا ماه لوبلا نول نكلو ةيعونلا ثيح نم لىعلأا ماه ءاودلاب دادملإا ةداعإ تارايزو كيسيروم ةداعإ تارايز عم ءاودلا بوبح ددع جمد ىدأ دقو .ةيسايسحلا في لقلأا ةيعونو ةيساسح لىإ ،ةينيتورلا ةسرمالما في مدختسم وه ماك ،ءاودلاب دادملإا صاخلا لاثتملاا نايبتسا ةفاضإ دنع ةيساسحلا تنسحت دقو ،ينتطسوتم .زديلإا نع ةيريسرلا براجتلا ةعومجبم شرابلما فاشرلإا تحت دملأا يرصقلا جلاعلل نوعضاخلا ضىرلما رهظأ جاتنتسلاا جيزم مادختسا نكيمو .جلاعلل ًاديج ًلااثتما ةساردلا هذه في زكترلما يعمتجلما لاثتملاا نايبتساو ،ءاودلاب دادملإا ةداعإ تارايزو ،جلاعلا بوبح ددع نم في جلاعلل لاثتملاا ةبقارلم زديلإا نع ةيريسرلا براجتلا ةعومجبم صاخلا دكأتلا بجيو .ةاوادلما ثدح ةبقارم ماظن دوجو اهيف سريتي لا يتلا عقاولما لىع ةطيسبلا لاثتملاا يربادت ةيقادصم قيثوتو لاثتملااب ةصاخلا جئاتنلا نم لاثتملاا تلادعم في ّريرغتلا نم عسوأ قاطن مهل ناكسلا نم عسوأ قاطن .جلاعلل 摘要 结核病人治疗依从性电子监控及替代的依从性方法验证：试点研究 目的 采用药物治疗活动监控系统（MEMS）评估坦桑尼 亚肺结核病人对基于社区直接观察治疗的依从性，并以 MEMS为金标准，对资源有限的背景下替代的依从性方 法验证。 方法 这是一项在一所农村医院、一所城市医院以及两所城 市健康中心连续招募的50位病人开展的纵向试点研究。采 用MEMS监控治疗依从性，并评估了以下依从性方法的有 效性：异烟肼尿试验、尿颜色试验、Morisky衡量标准、 简要药物治疗问卷、经修订的艾滋病临床试验组（ACTG） 依从性问卷、药丸数和药物治疗加药就诊数。 结果 研 究 人 群 中 的 平 均 依 从 率 为 9 6 . 3 ％ （标准差, SD：7.7）。70％的病人依从率低于100％，21 ％的病人低于95％，2％的病人低于80％。ACTG依从性问 卷和尿颜色试验的敏感性最高，但特异性最低。Morisky衡 量标准和加药就诊数的特异性最高，但敏感性最低。常规 诊疗药丸数和加药就诊数两者的混合使用敏感性和特异性 中等，但添加ACTG依从问卷后，敏感性有所上升。 结论 本研究中基于社区的直接观察治疗（DOT）病人表现 出良好的依从性。药丸数、加药就诊数和ACTG依从性问卷 可结合用于在无法承担MEMS的情况下进行依从性监控。 与依从性和简单依从性方法有效性相关的研究结果应在依 从率变化性更大的、更广泛的人群中进行证实。 Objectif Évaluer l’adhésion au traitement directement observé en milieu communautaire des patients tuberculeux tanzaniens, à l’aide du système de suivi des événements de médication (MEMS, Medication Event Monitoring System) et valider les mesures d’adhésion alternatives dans les configurations de ressources limitées utilisant le MEMS comme critère de référence. Méthodes Il s’agissait d’une étude pilote longitudinale sur 50 patients recrutés consécutivement dans un hôpital rural, un hôpital urbain et deux centres de soins urbains. L’adhésion au traitement a été contrôlée par le Bull World Health Organ 2011;89:632–639 | doi:10.2471/BLT.11.086462638 Jossy van den Boogaard et al.Monitoring treatment adherence electronically in tuberculosis patients Research Резюме Электронный мониторинг приверженности к лечению и проверка действенности альтернативных мер по контролю приверженности у больных туберкулезом (пилотное исследование) Цель Оценить приверженность к лечению, проводившемуся на базе общины под непосредственным наблюдением врача, у туберкулезных больных в Танзании с применением Системы электронного мониторирования выдачи препарата (Medication Event Monitoring System, MEMS) и проверить действенность альтернативных мер по контролю приверженности в условиях ограниченности ресурсов, используя MEMS в качестве «золотого стандарта». Методы Проведено лонгитюдное пилотное исследование 50 пациентов, отобранных последовательно из сельской больницы, городской больницы и двух городских медицинских центров. Мониторинг приверженности к лечению осуществлялся с помощью MEMS; проводилась также проверка действенности следующих мер по контролю приверженности: анализа мочи при приеме изониазида, контроля цвета мочи, применения шкалы Morisky, Краткого опросника по лекарственным препаратам (Brief Medication Questionnaire, BMQ) и адаптированного варианта «Опросника по приверженности» Группы клинических испытаний по СПИДу (ACTG), а также подсчета таблеток и посещения больных с целью пополнения запаса лекарств. Результаты Средний показатель приверженности в исследуемой популяции составлял 96,3% (стандартное отклонение, СО: 7,7). У 70% больных показатель приверженности был ниже 100%, у 21% – ниже 95% и у 2% ниже 80%. При применении опросника ACTG и контроля цвета мочи достигалась максимальная чувствительность при минимальной специфичности. Применение шкалы Morisky и визитов для пополнения запаса лекарств давало максимальную специфичность при минимальной чувствительности. Использование в рутинной практике подсчета таблеток в сочетании с посещениями больных для пополнения запаса лекарств обеспечивали умеренную чувствительность и специфичность, однако при добавлении опросника ACTG чувствительность повышалась. Вывод В данном исследовании пациенты, проходившие лечение под непосредственным наблюдением врача (DOT) на уровне общины, продемонстрировали высокий уровень приверженности. Для отслеживания приверженности больных к лечению в условиях, когда применение MEMS недоступно по финансовым причинам, можно применять подсчет таблеток, посещение больных с целью пополнения запаса лекарств и «Опросник по приверженности» ACTG. Полученные результаты, касающиеся приверженности к лечению и действенности простых мер контроля приверженности больных к лечению, необходимо подтвердить на примере более крупных популяций при широком разбросе значений показателя приверженности. Resumen Control electrónico del cumplimiento terapéutico de pacientes con tuberculosis y validación de medidas alternativas de cumplimiento: estudio piloto Objetivo Evaluar el cumplimiento de los tratamientos observados directamente que están dirigidos a la comunidad por parte de los pacientes con tuberculosis en Tanzania, mediante el Sistema de vigilancia de la medicación (Medication Event Monitoring System [MEMS]) y validar medidas alternativas de cumplimiento para los entornos de recursos limitados, empleando los MEMS como método de referencia. Métodos Se realizó un estudio piloto longitudinal con 50 pacientes seleccionados consecutivamente de un hospital rural, un hospital urbano y dos centros sanitarios urbanos. El cumplimiento terapéutico se controló con el MEMS y se evaluó la validez de las siguientes medidas de cumplimiento: detección de isoniacida en orina, prueba de color de la orina, test de Morisky, Cuestionario breve de medicación, cuestionario adaptado del cumplimiento terapéutico del Grupo de Ensayos Clínicos sobre el SIDA (ACTG), recuento de la medicación y visitas de aprovisionamiento de medicamentos. Resultados La tasa media de cumplimiento en la población del estudio fue de un 96,3% (desviación estándar, DE: 7,7). El cumplimiento fue inferior al 100% en el 70% de los pacientes, inferior al 95% en el 21% de los pacientes e inferior al 80% en el 2% de los pacientes. El cuestionario de cumplimiento ACTG y la prueba de color de la orina registraron los niveles más elevados de sensibilidad y los más bajos de especificidad. El test Morisky y las visitas de aprovisionamiento de medicamentos obtuvieron los niveles más elevados de especificidad y los más bajos de sensibilidad. La combinación del recuento de medicamentos y las visitas de aprovisionamiento, empleada en la práctica habitual, registró una sensibilidad y una especificidad moderadas, si bien la sensibilidad aumentó cuando se añadió el cuestionario de cumplimiento ACTG. Conclusión Los pacientes que siguieron un tratamiento observado directamente y dirigido a la comunidad mostraron un cumplimiento correcto MEMS et la validité des mesures d’adhésion conséquentes a été évaluée: test urinaire pour détecter la présence d’isoniazide, test de coloration des urines, échelle de Morisky, bref questionnaire sur la médication, questionnaire d’adhésion adapté du Groupe d’essais cliniques du SIDA (ACTG, AIDS Clinical Trials Group), décomptes de pilules et visites de réapprovisionnement en médicaments. Résultats Le taux d’adhésion moyen dans la population de l’étude atteignait 96,3% (déviation standard, DS: 7,7). L’adhésion était inférieure à 100% chez 70% des patients, inférieure à 95% chez 21% d’entre eux et inférieure à 80% chez 2% d’entre eux. Le questionnaire d’adhésion de l’ACTG et le test de coloration des urines présentaient les sensibilités les plus élevées, mais les spécificités les plus basses. L’échelle de Morisky et les visites de réapprovisionnement présentaient les spécificités les plus élevées, mais les sensibilités les plus basses. Les décomptes de pilules et les visites de réapprovisionnement en médicaments combinés, utilisés dans la pratique de routine, montraient une sensibilité et une spécificité modérées, mais la sensibilité s’améliorait lors de l’ajout du questionnaire d’adhésion de l’ACTG. Conclusion Les patients suivant un traitement directement observé en milieu communautaire ont montré une meilleure adhésion dans cette étude. La combinaison des décomptes de pilules, des visites de réapprovisionnement et du questionnaire d’adhésion de l’ACTG a pu être utilisée pour contrôler l’adhésion dans les cadres où le MEMS n’était pas abordable. Les résultats en termes d’adhésion et de validité des mesures d’adhésion simples devraient être confirmés auprès de populations plus larges, avec une variabilité plus importante des taux d’adhésion. Bull World Health Organ 2011;89:632–639 | doi:10.2471/BLT.11.086462 639 Jossy van den Boogaard et al. Monitoring treatment adherence electronically in tuberculosis patients Research en este estudio. La combinación del recuento de medicación, las visitas de aprovisionamiento de medicamentos y el cuestionario de cumplimiento ACTG podría emplearse para controlar el cumplimiento en entornos en los que el uso del sistema MEMS no resulte viable económicamente. Los resultados en cuanto al cumplimiento y a la validez de las medidas sencillas de cumplimiento podrían confirmarse en poblaciones más amplias con una mayor variabilidad de sus tasas de cumplimiento. References 1. An expanded DOTS framework for effective tuberculosis control (WHO/CDS/ TB/2002.297). Geneva: World Health Organization; 2002. 2. Maher D. The role of the community in the control of tuberculosis. Tuberculosis (Edinb) 2003;83:177–82. doi:10.1016/S1472-9792(02)00066-5 PMID:12758209 3. Lwilla F, Schellenberg D, Masanja H, Acosta C, Galindo C, Aponte J et al. Evaluation of efficacy of community-based vs. institutional-based direct observed short-course treatment for the control of tuberculosis in Kilombero district, Tanzania. Trop Med Int Health 2003;8:204–10. doi:10.1046/j.1365- 3156.2003.00999.x PMID:12631309 4. Wandwalo E, Kapalata N, Egwaga S, Morkve O. Effectiveness of community- based directly observed treatment for tuberculosis in an urban setting in Tanzania: a randomised controlled trial. Int J Tuberc Lung Dis 2004;8:1248–54. PMID:15527158 5. Floyd K, Skeva J, Nyirenda T, Gausi F, Salaniponi F. Cost and cost-effectiveness of increased community and primary care facility involvement in tuberculosis care in Lilongwe District, Malawi. Int J Tuberc Lung Dis 2003;7(Suppl 1):S29–37. PMID:12971652 6. van den Boogaard J, Lyimo R, Irongo CF, Boeree MJ, Schaalma H, Aarnoutse RE et al. Community vs. facility-based directly observed treatment for tuberculosis in Tanzania’s Kilimanjaro Region. Int J Tuberc Lung Dis 2009;13:1524–9. PMID:19919771 7. Frieden TR, Sbarbaro JA. Family observation of antituberculosis treatment. Lancet 2006;367:2055–6, author reply 2055-6. doi:10.1016/S0140- 6736(06)68913-7 PMID:16798377 8. Farmer KC. Methods for measuring and monitoring medication regimen adherence in clinical trials and clinical practice. Clin Ther 1999;21:1074–90, discussion 1073. doi:10.1016/S0149-2918(99)80026-5 PMID:10440628 9. Zeller A, Ramseier E, Teagtmeyer A, Battegay E. Patients’ self-reported adherence to cardiovascular medication using electronic monitors as comparators. Hypertens Res 2008;31:2037–43. doi:10.1291/hypres.31.2037 PMID:19098375 10. Schwed A, Fallab CL, Burnier M, Waeber B, Kappenberger L, Burnand B et al. Electronic monitoring of compliance to lipid-lowering therapy in clinical practice. J Clin Pharmacol 1999;39:402–9. doi:10.1177/00912709922007976 PMID:10197299 11. Grosset KA, Bone I, Grosset DG. Suboptimal medication adherence in Parkinson’s disease. Mov Disord 2005;20:1502–7. doi:10.1002/mds.20602 PMID:16037924 12. Rivers PH, Ardagh-Walter N, Wright EC. Measurement of anticonvulsant adherence behaviour in the community using a Medication Events Monitoring System (MEMS) Health Care Anal 1998;6:308–16. doi:10.1007/BF02678367 PMID:10345937 13. Denhaerynck K, Schäfer-Keller P, Young J, Steiger J, Bock A, De Geest S. Examining assumptions regarding valid electronic monitoring of medication therapy: development of a validation framework and its application on a European sample of kidney transplant patients. BMC Med Res Methodol 2008;8:5. doi:10.1186/1471-2288-8-5 PMID:18284675 14. Russell CL, Owens S, Hamburger KQ, Thompson DA, Leach RR, Cetingok M et al. Medication adherence and older renal transplant patients’ perceptions of electronic medication monitoring. J Gerontol Nurs 2009;35:17–21. doi:10.3928/00989134-20090903-06 PMID:19772223 15. Melbourne KM, Geletko SM, Brown SL, Willey-Lessne C, Chase S, Fisher A. Medication adherence in patients with HIV infection: a comparison of two measurement methods. AIDS Read 1999;9:329–38. PMID:12737122 16. Hugen PW, Langebeek N, Burger DM, Zomer B, van Leusen R, Schuurman R et al. Assessment of adherence to HIV protease inhibitors: comparison and combination of various methods, including MEMS (electronic monitoring), patient and nurse report, and therapeutic drug monitoring. J Acquir Immune Defic Syndr 2002;30:324–34. PMID:12131570 17. Arnsten JH, Demas PA, Farzadegan H, Grant RW, Gourevitch MN, Chang CJ et al. Antiretroviral therapy adherence and viral suppression in HIV-infected drug users: comparison of self-report and electronic monitoring. Clin Infect Dis 2001;33:1417–23. doi:10.1086/323201 PMID:11550118 18. Fallab-Stubi CL, Zellweger JP, Sauty A, Uldry C, Iorillo D, Burnier M. Electronic monitoring of adherence to treatment in the preventive chemotherapy of tuberculosis. Int J Tuberc Lung Dis 1998;2:525–30. PMID:9661817 19. Starr M, Sawyer S, Carlin J, Powell C, Newman R, Johnson P. A novel approach to monitoring adherence to preventive therapy for tuberculosis in adolescence. J Paediatr Child Health 1999;35:350–4. doi:10.1046/j.1440- 1754.1999.00371.x PMID:10457290 20. Ailinger RL, Black PL, Lima-Garcia N. Use of electronic monitoring in clinical nursing research. Clin Nurs Res 2008;17:89–97. doi:10.1177/1054773808316941 PMID:18387881 21. Ruslami R, van Crevel R, van de Berge E, Alisjahbana B, Aarnoutse RE. A step- wise approach to find a valid and feasible method to detect non-adherence to tuberculosis drugs. Southeast Asian J Trop Med Public Health 2008;39:1083–7. PMID:19062699 22. Manual of the National Tuberculosis and Leprosy Programme in Tanzania. Fifth edition. Dar es Salaam: Ministry of Health; 2010. 23. Morisky DE, Green LW, Levine DM. Concurrent and predictive validity of a self-reported measure of medication adherence. Med Care 1986;24:67–74. doi:10.1097/00005650-198601000-00007 PMID:3945130 24. Svarstad BL, Chewning BA, Sleath BL, Claesson C. The Brief Medication Questionnaire: a tool for screening patient adherence and barriers to adherence. Patient Educ Couns 1999;37:113–24. doi:10.1016/S0738-3991(98)00107-4 PMID:14528539 25. Chesney MA, Ickovics JR, Chambers DB, Gifford AL, Neidig J, Zwickl B et al. Self-reported adherence to antiretroviral medications among participants in HIV clinical trials: the AACTG adherence instruments. Patient Care Committee & Adherence Working Group of the Outcomes Committee of the Adult AIDS Clinical Trials Group (AACTG). AIDS Care 2000;12:255–66. doi:10.1080/09540120050042891 PMID:10928201 26. Bova CA, Fennie KP, Knafl GJ, Dieckhaus KD, Watrous E, Williams AB. Use of electronic monitoring devices to measure antiretroviral adherence: practical considerations. AIDS Behav 2005;9:103–10. doi:10.1007/s10461-005-1685- 0 PMID:15812617 27. Wagner GJ, Ghosh-Dastidar B. Electronic monitoring: adherence assessment or intervention? HIV Clin Trials 2002;3:45–51. doi:10.1310/XGXU-FUDK-A9QT- MPTF PMID:11819185 28. Whitfield R, Cope GF. Point-of-care test to monitor adherence to anti-tuberculous treatment. Ann Clin Biochem 2004;41:411–3. doi:10.1258/0004563041731637 PMID:15333195