WHO/HIV/2012.25
Annex 4. GRADE evidence profiles Question 1: Should rapid HBV vaccination regimen versus a standard HBV vaccination regimen be used among PWID? Author(s): Elie Akl Date: 2012-‐05-‐8 Bibliography: Christensen 2004. Brisette 2002. Systematic review by Amato et al. Quality assessment No of patients Rapid HBV vaccination regimen 297/405 (73.3%) Effect Quality Importance No of studies Design Risk of bias Inconsistency Indirectness Imprecision Other considerations Standard HBV vaccination regimen Relative (95% CI) Absolute
Completion of vaccination regimen (follow-‐up mean 6 months) 2 1,2
randomised very no serious 3 4 trials serious inconsistency
serious
5
no serious imprecision
none
184/400 (46%)
RR 1.6 (1.42 276 more per 1000 ÅOOO to 1.81) (from 193 more to 373 VERY more) LOW RR 1.12 (0.84 46 more per 1000 (from ÅOOO 8 to 1.49) 61 fewer to 187 more) VERY LOW -‐ -‐
CRITICAL
Immune response 1 1
randomised serious serious trials
3
6
serious
5
serious
7
none
148/365 (40.5%)
155/407 (38.1%)
CRITICAL
Satisfaction -‐ not measured 0 1
-‐
-‐
-‐
-‐
-‐
-‐
-‐
-‐
IMPORTANT
Brissette 2002 conducted in Quebec, Canada among 908 cocaine/heroin users. It compared an accelerated schedule regimen (0, 2, 4 weeks) using a high dose vaccine (40 mcg) to a standard schedule regimen (0, 4, 24 weeks) using a standard dose vaccine (10 mcg). There was no difference in seroprotection between the two regimens. 2 Christensen 2004 was conducted in Copenhagen, Denmark among prisoners who were injection drug users. It compared an accelerated regimen (0-‐1-‐3 weeks) to a standard regimen (0-‐1-‐6 months). 3 Brissette 2002: sequence generation adequate (computer generated) and allocation concealment probably adequate (“opening an envelope”). However, no blinding of outcome adjudicator reported; no mention whether analysis was intention to treat; unclear rate of loss to follow-‐up. Christensen 2004: essentially not randomized (34 randomized while 566 not randomized); no blinding of outcome adjudicator reported; no mention whether analysis was intention to treat; significant rate of loss to follow-‐up 4 I2=39% 5 Rated down for indirectness of outcome (regimen completion and immune response being surrogates for HBV infection). Also both studies were conducted in high income countries and Christensen recruited only prisoners. 6 I2=81% 7 Relatively small number of participants and of events 8 Calculated by meta-‐analyzing (using fixed effect model) data from high dose and low dose groups
Question 2: Should incentives for HBV vaccination completion versus no incentives be used among PWID? Author(s): Elie Akl Date: 2012-‐04-‐23 Bibliography: Seal 2003. Stitzer 2010. Systematic review by Amato et al. Quality assessment No of studies 2 1 1,2
No of patients Other Incentives for completion No considerations of HBV vaccination incentives 43/61 (70.5%) Relative (95% CI)
Effect Quality Importance
Design
Risk of bias 3
Inconsistency
Indirectness
Imprecision
Absolute
Vaccine completion (follow-‐up mean 6 months) randomised serious no serious 4 trials inconsistency no serious 5 indirectness Serious 6
none
17/61 RR 2.53 (1.64 426 more per 1000 (from ÅÅOO CRITICAL (27.9%) to 3.9) 178 more to 808 more) LOW
Seal 2003 was conducted among IDUs in San Francisco, USA. Eligible participants received their first dose of vaccine and were randomized to either monthly monetary incentives (monthly visit to neighbourhood field site once each month for 6 months to receive $20) or a weekly contact with an outreach worker (contacted participants weekly to provide safe injection information and reminder of upcoming vaccine appointments). Participants were also randomized to different schedules (rapid or accelerated) and 2 doses of vaccine (Recombivax 10 microg or 40 microg). 2 Stitzer 2010 was conducted in the USA among cocaine drug users. All participants received $20 for completing study intake procedures (screening, consent and initial injection) and $10 after each weekly visit to cover transportation costs. In the incentive participants, they were draws for attendance at each weekly visit with the chance to win prizes. They also received cash bonuses for attending injection visits. These started at $20 (intake visit) and increased by $5 each month, up to $50with total possible = $265. Overall incentive group earnings averaged $501 out of $751 possible. The control participants received no incentive. 3 Seal 2003: unclear methods of sequence generation and allocation concealment; no blinding of outcome adjudicator reported; analysis was intention to treat; unclear rate of loss to follow-‐up. Stitzer 2010: unclear methods of sequence generation and allocation concealment; no blinding of outcome adjudicator reported; unclear whether analysis was intention to treat; unclear rate of loss to follow-‐up 4 I2=48% 5 Regimen completion is a surrogate for HBV infection and this indirectness of outcome was accounted for when rating down the quality of evidence to low. 6 Relatively small number of participants and small number of events
2
Question 3: Should low dead space-‐syringes versus high dead space syringes be provided to PWID? Author(s): Elie Akl Date: 2012-‐04-‐24 Settings: needle syringe programs Bibliography: Gyarmathy 2010. Zule 2009. Systematic review by Amato et al. Quality assessment No of studies 0 2 1,2
No of patients Other Low dead space High dead space considerations syringes (LDSS) syringes (HDSS) none none 5
Effect Quality Importance Relative (95% CI) -‐
Design
Risk of bias -‐ 3
Inconsistency
Indirectness
Imprecision
Absolute
HBV infection -‐ not reported -‐ observational studies -‐ -‐ no serious indirectness -‐ no serious imprecision -‐ 264/692 (38.2%) -‐ 501/645 (77.7%) -‐ CRITICAL CRITICAL HCV infection (assessed with: serologic testing) serious no serious 4 inconsistency RR 0.49 (0.44 396 fewer per 1000 ÅOOO to 0.55) (from 350 fewer to 435 VERY fewer) LOW RR 0.29 (0.18 77 fewer per 1000 (from ÅOOO to 0.46) 59 fewer to 89 fewer) VERY LOW
HIV infection (assessed with: serologic testing) 2 1,2
observational studies
serious no serious 4 inconsistency
3
no serious indirectness
no serious imprecision
none
5
24/692 (3.5%)
70/645 (10.9%)
1 2
Gyamarthy 2010 was conducted among IDUs in Hungary and Lithuania (mean age 28; 77% males). Zule 2009 was conducted among IDUs in USA (mean age 40, 74% males). 3 Unclear how the SR calculated RR based on cross-‐sectional data 4 High I2 but individual effect estimates of study both suggest major reduction in outcome 5 No rating up for large effect size given the concern about the analytical method
3
Question 4: Should psychosocial interventions vs. no psychosocial interventions be used in people who inject drugs? Author(s): Elie Akl Date: 2012-‐05-‐08 Bibliography: Abou Saleh 2008; Gilbert 2010; Stein 2009; Tucker 2004; Wu 2007; Zule 2009. Systematic review by Amato et al.
Quality assessment No of studies 2 1,2
No of patients Other considerations none Psychosocial interventions 9/93 (9.7%) No psychosocial interventions 12/94 (12.8%) Relative (95% CI)
Effect Quality Importance
Design
Risk of bias
Inconsistency
Indirectness Imprecision
Absolute
HCV infection randomised serious trials 3,4
no serious inconsistency
no serious 5 indirectness
serious
6
RR 0.75 (0.33 32 fewer per 1000 ÅÅOO to 1.71) (from 86 fewer to 91 LOW more) RR 0.7 (0.49 44 fewer per 1000 14 to 1.02) (from 75 fewer to 3 more)
CRITICAL
Needle sharing behavior (assessed with: Self reported; surrogate for HIV infection) 2 7,8,9
randomised serious trials
10,11
no serious inconsistency
serious
12
serious
13
none
41/395 (10.4%)
61/416 (14.7%)
ÅOOO IMPORTANT VERY LOW
High risk sexual behavior (assessed with: Self reported; surrogate for HIV infection) 1 8,9
randomised serious trials
10
no serious inconsistency
serious
15
serious
none
104/265 (39.2%)
101/286 (35.3%)
RR 1.11 (0.89 39 more per 1000 ÅOOO IMPORTANT 16 to 1.38) (from 39 fewer to 134 VERY more) LOW RR 4.48 (0.48 from 481 fewer to to 41.42) 1000 more) -‐ -‐ ÅÅOO IMPORTANT LOW IMPORTANT
Satisfaction (assessed with: 5 point Likert scale (satisfied or very satisfied)) 1 17
randomised no serious risk no serious 18 trials of bias inconsistency -‐ -‐ -‐
no serious indirectness -‐
very 6 serious -‐
none
56/57 (98.2%) -‐
50/54 (92.6%) -‐
Quality of life -‐ not measured 0 1
-‐
Abou Saleh 2008 was conducted in the UK and included 95 IDUs (mean age 32 years, 70% male, mean duration of injecting drug use: 5.9 years). The enhanced prevention counseling (EPC) intervention consisted of 4 sessions of manual-‐guided intervention. The manual was based particularly on the Brief Intervention (Motivational Enhancement Therapy) and was concerned with the reduction of high-‐ risk sexual behavior and the introduction of safer sex. Duration: 8 weeks. Sessions were carried out by a drug clinic worker who was trained in delivering the intervention. All sessions last between 40-‐60 minutes. The control simple educational counseling (SEC) consisted of ten-‐minute session of information-‐giving intervention about the nature and the risk factors of HCV, with advice on prevention including the need to reduce sharing of injecting equipment and safer injecting practices. It was intended to be a non-‐interactive intervention. 2 Stein 2009 was conducted in the US and included 277 participants using heroin or cocaine (39% IDUs) at least three times weekly, HCV antibody negative, mean age 37.2 years, male: 65% (the SR considered only IDUs). The intervention consisted of 4 session motivational intervention and provision of a written informational handout about local treatment resources or to a control condition receiving. HCV risk behaviors specifically discussed during the session were initiating injection drug use (for non-‐injectors), continued injection drug use, sharing both injection (e.g., syringe, cooker) and non-‐injection (e.g. straws) drug equipment, sharing drug in certain ways (e.g., backloading), receiving tattoos, and having unprotected sex. The individual sessions each lasted 30-‐45 minutes and were conducted at baseline, 1, 3, and 6-‐months post-‐baseline. The control consisted of the provision of only the informational treatment resource list handout.
4
3 4
Abou Saleh 2008: allocation was concealed; no blinding reported; analysis was intention to treat; follow-‐up was 82% and 65% at 6 and 12 months. Stein 2009: unclear whether randomization was concealed; no blinding reported; unclear whether analysis was intention to treat; follow-‐up rates were 80% at 6-‐months and 75% at the 24-‐month. 5 Some indirectness of population (Saleh 2008: PWID in the UK; Stein 2009: PWID in the US) 6 The CI did not rule out either a beneficial or a harmful effect on the outcome of interest 7 Gagnon 2010 was conducted in Canada and included 260 IUDs (mean age 34.9 years, 69% male). The intervention consisted of standard intervention plus 4 session of computed tailored messages on the website. The control consisted of standard intervention: needle exchanges, psychosocial support, social and health service referral. Participants to both groups could have discussion with their assigned community worker. Interaction were tailored to the need of the participant and could last from 10 to 30 minutes 8 Zule 2009 was conducted in the USA and included 851 IDUs (mean age 41 years, male: 63%). The intervention consisted of 6 sessions; contents were motivation to change, developing a plan for change, reviewing progress and reaffirming commitment to change, build self efficacy and self regulation skills. Participants were given 10 dollars coupon at the end of each session. The control consisted of an educational intervention; 6 sessions; contents were information of Hepatitis, sharing practices and addiction. Participants were given 10 dollars coupon at the end of session 3 through 6. All participants were offered the HCV, HIV and hepatitis test 9 We excluded Wu 2007 (initially included by the systematic review) because the authors state that the study design was modified to cross-‐sectional due to a very low follow-‐up rate of 12%. 10 Zule 2009: unclear whether randomization was concealed; no blinding reported; unclear whether analysis was intention to treat; follow-‐up rate was 73%. 11 Gagnon 2010: allocation was not concealed; study was not blinded; analysis was not intention to treat; 9.6% lost at short term follow-‐up; 33% lost at long term follow-‐up 12 Outcome is indirect in the 2 studies (reported behavior). Population was indirect in the 2 studies (Zule 2009: PWID in the USA; Gagnon 2009: IUD in Canada). 13 CI includes both values suggesting benefit and values suggesting no effect 14 Analysis using continuous data for this outcome found highly heterogeneous data and no statistically significant effect 15 Outcome is indirect (reported behavior). Population was indirect (PWID in the USA). 16 Analysis using continuous data for this outcome found no statistically significant effect 17 Tucker 2004 was conducted in Australia and included 145 IDUs (mean age 41 years, 60% male, had been injecting for 18 years on average). The intervention consisted of standard written educational materials regarding HCV plus a single-‐session, 30 minutes , individually tailored brief behavioural intervention. The control consisted of only the standard written educational materials 18 Tucker 2004: allocation was concealed, participants and data collectors were blinded, analysis was ITT, data for satisfaction was available for 76% of those randomized.
5
Question 5: Should peer education and mentoring vs. no peer education and mentoring be used in people who inject drugs? Author(s): Elie Akl Date: 2012-‐04-‐27 Question: Should peer education and mentoring vs no peer education and mentoring be used in people who inject drugs? Bibliography: Garfein 2007. Latka 2008. Systematic review by Amato et al.
Quality assessment No of studies 2 1,2
No of patients Other considerations none Peer education and No peer education and mentoring mentoring -‐ -‐
Effect Quality Importance Relative (95% CI) OR 0.61 (0.44 to 0.85) OR 0.90 (0.67 to 9 1.21)
Design
Risk of bias 3,4
Inconsistency
Indirectness
Imprecision
Absolute
Needle sharing behavior (assessed with: Self reported; surrogate for HCV and HIV infection) randomised trials randomised trials serious no serious inconsistency serious no serious inconsistency 3
serious
5,6
no serious imprecision serious 8
-‐
7
ÅÅOO LOW ÅOOO VERY LOW
CRITICAL
High risk sexual behavior (assessed with: Self reported (total acts with all partners); surrogate for HCV and HIV infection) 1 2
serious
6
none
-‐
-‐
-‐
7
CRITICAL
Quality of life -‐ not measured 0 1
-‐
-‐
-‐
-‐
-‐
-‐
-‐
-‐
-‐
-‐
IMPORTANT
Latka 2008 included 418 HCV-‐positive injection drug users, mean age 26.5 years, 77% male. The intervention consisted of peer mentoring. 6 sessions 2 hours in length, held twice weekly. The intervention delivered risk reduction information by training participants to mentor other injection drug users about reducing HCV transmission risks. The intervention was guided by social cognitive theory. The control consisted of video discussion. 6 sessions 2 hours in length, held twice weekly; participants watched a docudrama television series about injection drug users and then took part in a facilitated group discussion focusing on family, education, self-‐respect, relationships, violence, parenting, and employment; participants who sought information about risk reduction or health care were referred to a resource table 2 Garfein 2007 inlcuded 854 IDUs, HIV and HCV antibody negative, mean age 23.8 years, 66.5% male. The peer education intervention (PEI) consisted of peer education skills, intervention incorporating cognitive-‐behavioural skills-‐building; six 2-‐h sessions over a 3-‐week period. The intervention was centered on teaching participants how to educate peers about HIV and HCV risk reduction. Contents were HIV and HCV transmission through sex and injection drug use, peer education and skills-‐building activities about safer injection and sexual practices, with activities designed to increase negotiation skills with sex and injection partners. The control included arm received a video discussion intervention (VDI) comprising equivalent hours and sessions as the PEI. VDI participants watched hour-‐long films addressing social (e.g. gun violence, gangs, prejudice) and health (e.g. cardiopulmonary resuscitation training, alcoholism, injury prevention) issues followed by facilitated discussion using scripted questions. Risk-‐reduction topics were diverted by offering the same education pamphlets given to PEI participants. 3 Garfein 2007: unclear whether randomization was concealed; only data analysts were clearly blinded; analysis was described as intention to treat; and lost to follow-‐up was at least 17%. 4 Latka 2008: unclear whether randomization was concealed; study was unblinded; analysis was intention to treat; retention rates were 66% and 80% at the 3-‐ and 6-‐month visits. 5 Latka 2008 provides indirect evidence: (1) population was HCV positive PWID in 5 US cities; (2) outcome was surrogate (participants’ self reported behaviors) 6 Garfein 2007 provides indirect evidence: (1) population was PWID in 5 US cities; (2) outcome was surrogate (participants’ self reported behaviors) 7 Absolute effects not calculable as rates and numbers of events not reported 8 CI includes both values suggesting harms and values suggesting benefits
6
9
Results consistent for all types of sexual acts (vaginal and anal) with different types of partners (main, non main other steady, sex trade partner) except for anal sex with casual/sex trade partner(s) (OR 3.15 (1.13 to 8.79))
7
© World Health Organization 2012 All rights reserved. Publications of the World Health Organization are available on the WHO web site (www.who.int) or can be purchased from WHO Press, World Health Organization, 20 Avenue Appia, 1211 Geneva 27, Switzerland (tel.: +41 22 791 3264; fax: +41 22 791 4857; e-mail: bookorders@who.int). Requests for permission to reproduce or translate WHO publications – whether for sale or for noncommercial distribution – should be addressed to WHO Press through the WHO web site (http://www.who.int/about/licensing/copyright_form/en/index.html). The designations employed and the presentation of the material in this publication do not imply the expression of any opinion whatsoever on the part of the World Health Organization concerning the legal status of any country, territory, city or area or of its authorities, or concerning the delimitation of its frontiers or boundaries. Dotted lines on maps represent approximate border lines for which there may not yet be full agreement. The mention of specific companies or of certain manufacturers’ products does not imply that they are endorsed or recommended by the World Health Organization in preference to others of a similar nature that are not mentioned. Errors and omissions excepted, the names of proprietary products are distinguished by initial capital letters. All reasonable precautions have been taken by the World Health Organization to verify the information contained in this publication. However, the published material is being distributed without warranty of any kind, either expressed or implied. The responsibility for the interpretation and use of the material lies with the reader. In no event shall the World Health Organization be liable for damages arising from its use.
8