Published on in Vol 10 (2023)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/43653, first published .
Findings From the Step Up, Test Up Study of an Electronic Screening and Brief Intervention for Alcohol Misuse in Adolescents and Young Adults Presenting for HIV Testing: Randomized Controlled Efficacy Trial

Findings From the Step Up, Test Up Study of an Electronic Screening and Brief Intervention for Alcohol Misuse in Adolescents and Young Adults Presenting for HIV Testing: Randomized Controlled Efficacy Trial

Findings From the Step Up, Test Up Study of an Electronic Screening and Brief Intervention for Alcohol Misuse in Adolescents and Young Adults Presenting for HIV Testing: Randomized Controlled Efficacy Trial

Original Paper

1Institute for Juvenile Research, Department of Psychiatry, University of Illinois Chicago, Chicago, IL, United States

2The Potocsnak Family Division of Adolescent and Young Adult Medicine, Ann & Robert H Lurie Children's Hospital of Chicago, Chicago, IL, United States

3The Chicago Center for HIV Elimination, The University of Chicago, Chicago, IL, United States

4Center for Dissemination and Implementation Science, University of Illinois Chicago, Chicago, IL, United States

5Center for Education, Research & Advocacy, Howard Brown Health, Chicago, IL, United States

Corresponding Author:

Niranjan S Karnik, MD, PhD

Institute for Juvenile Research

Department of Psychiatry

University of Illinois Chicago

1747 West Roosevelt Road

Chicago, IL, 60608

United States

Phone: 1 3122730185

Email: nkarnik@uic.edu


Background: Substance use, particularly binge drinking of alcohol and noninjection substance use, is associated with increased risk for HIV infection among youth, but structured substance use screening and brief intervention are not often provided as part of HIV risk reduction.

Objective: The purpose of the study was to test the efficacy of a fully automated electronic screening and brief intervention, called Step Up, Test Up, to reduce alcohol misuse among adolescents and young adults presenting for HIV testing. Secondary objectives were reduction in sexual risk and uptake of pre-exposure prophylaxis (PrEP) for HIV prevention.

Methods: Youth aged 16 years to 25 years who presented for HIV testing at community-based locations were recruited for study participation. Those who screened at moderate to high risk on the Alcohol Use Disorders Identification Test were randomized (1:1) to either an electronic brief intervention or a time-attention control. The primary outcome was change in alcohol use at 1, 3, 6, and 12-month follow-ups. Negative binomial and log binomial regression analyses with generalized estimating equations were conducted to evaluate the intervention efficacy.

Results: Among a sample of 329 youth, there were no significant differences in alcohol use outcomes between conditions over time or at the 1, 3, 6, or 12-month time points. In terms of secondary outcomes, there was evidence of reduction in condomless insertive anal sex under the influence of alcohol and drugs at 12 months compared with 3 months in the intervention versus the attention control condition (incidence rate ratio=0.15, 95% CI 0.05-0.44); however, there were no other significant differences in sexual risk and no difference in PrEP engagement.

Conclusions: We found no effect of electronic brief intervention to reduce alcohol use and some effect on sexual risk among youth aged 16 years to 25 years who present for HIV testing.

Trial Registration: ClinicalTrials.gov number NCT02703116; https://clinicaltrials.gov/ct2/show/NCT02703116

International Registered Report Identifier (IRRID): RR2-10.1186/s12889-020-8154-6

JMIR Ment Health 2023;10:e43653

doi:10.2196/43653

Keywords



The syndemic intersection of HIV risk and substance misuse among young men who have sex with men (YMSM) and young transgender women (YTW) has been well established and well documented [1-5]. Recent studies have shown that substance use, particularly binge drinking of alcohol and noninjection substance use, increases sexual risks and the potential for HIV infection [6]. In 2019, over 20% of new HIV infections occurred in youth aged 13 years to 19 years [7]. Among young people, the vast majority (66%) of HIV infections continue to occur among those having male-to-male sexual contact with YMSM constituting the largest share. Among those with male-to-male sexual contact, 25% of infections occur among YMSM aged 13 years to 24 years, and 31% occur among those aged 25 years to 29 years [7]. In addition to YMSM, substantial evidence exists that YTW are also at risk for HIV, and in 2019, their rate of diagnosis increased by 5% [7]. Along with routine condom use and pre-exposure prophylaxis (PrEP), addressing alcohol and other drug (AOD) use are among the most modifiable individual-level factors for the prevention of HIV and sexually transmitted infections (STIs). Although there are many structural factors including racism, stigma, and poverty that contribute to the dynamics of HIV infection, prevention strategies have often focused on individual or personal-level factors. Recent years have seen shifts toward HIV interventions in community clinics that provide primary care or specialized HIV services. At the intersection of individual behavioral change and structural change are attempts to insert brief motivational strategies into larger systems of care. Motivational interviewing (MI)–based approaches promote screening, brief intervention, and referral to treatment (SBIRT). Electronic screening and brief intervention (eSBI) is a subset of SBIRT in an electronic medium suitable for use in primary care and other generalist settings. YMSM and YTW often seek HIV testing and other supportive services in community-based and outreach settings. These settings are underutilized as potential entry points for engagement in comprehensive care across the HIV prevention and care continuum, including PrEP for HIV-negative youth who are at risk of HIV acquisition. We theorized that these same community settings could serve as an access point for substance use interventions if these interventions were brief and scalable.

The purpose of this study was to assess the feasibility, acceptability, and initial efficacy of eSBI in comparison to an electronic attention control intervention (ie, promotion of good nutrition), coupled with standard HIV prevention, on alcohol use among YMSM and YTW in community-based HIV testing environments in Chicago. Secondary objectives were to assess intervention effects on sexual behavior, as well as engagement within the HIV prevention and care continuum, and to assess modification of the intervention effect by comorbid mental health problems (ie, symptoms of depression and anxiety).


Design

This study was a randomized controlled trial of eSBI among YMSM and YTW seeking HIV testing [8]. Using an electronic web-based portal, all participants were screened for alcohol misuse and received immediate feedback regarding their level of use (eg, how their use compares to others, whether it exceeds “safe use” guidelines); those who screened for moderate to high alcohol use, including binge drinking, were then randomized to either electronic intervention or control modules. All participants, regardless of randomization status, were followed for 12 months with in-person visits conducted at 1, 3, 6, and 12-month intervals (see CONSORT diagram, Figure 1). All participants were recruited from HIV testing clinics that utilized a seek, test, treat, and retain (STTR) model of care [9].

Figure 1. Step up, Test Up CONSORT diagram.

Ethical Approval

The protocol was approved by the Ann & Robert H. Lurie Children’s Hospital Institutional Review Board (review #2015-703) with a waiver of parental permission for participation of minors (aged 16-17 years). All enrolled participants were consented prior to the start of any research activities using an electronic consent form. The consent form indicated that the purpose of the study was to learn more about whether screening and brief intervention for substance use is effective in reducing that use.

Identification and Recruitment of Participants

Youth were recruited from HIV testing centers at the 3 primary sites in Chicago: the Division of Adolescent Medicine at Lurie Children’s Hospital, Howard Brown Health, and the Village at the University of Chicago. Individuals were eligible if they were (1) aged 16 years to 25 years, (2) interested in testing for HIV infection, (3) HIV-negative or HIV status unknown (per self-report; verified at the point of HIV testing), (4) identified as a man who has sex with men or a transgender woman who has sex with men (ie, born male, identify as female or transgender, and at any point in the gender transition process), and (5) English-speaking. Individuals who were eligible and interested were enrolled by study staff.

Randomization

Upon enrollment, all participants completed HIV testing (using standard of preventive care testing and counseling at each site); individuals who screened reactive on the rapid HIV test were immediately referred for confirmatory HIV testing and were withdrawn from the study. All participants were screened for alcohol misuse using the Alcohol Use Disorders Identification Test (AUDIT) via an electronic portal. The AUDIT is a widely used, 10-item, validated screening tool for the assessment of alcohol use [10]. It contains items that reflect consumption, dependency, and alcohol-related harms. The AUDIT total score ranges from 0 to 40, divided into 4 Zones (I-IV), reflecting increasing levels of risk and recommended intervention (ie, Zone 1: alcohol education; Zone II: simple advice; Zone III: simple advice plus brief counseling and monitoring; Zone IV: referral to specialist for diagnostic evaluation and treatment). In addition, one item on the AUDIT reflects binge drinking (“How often do you have six or more drinks on one occasion?”). For our study, those scoring in Zones II-IV or endorsing the binge drinking item were included.

After completion of the AUDIT, participants received immediate feedback regarding their level of use. Participants who screened moderate to high risk for alcohol misuse or endorsed binge drinking on the AUDIT were randomized via computerized assignment (1:1) to either brief intervention modules to reduce alcohol misuse, eSBI, or a time and attention-matched control (ie, promotion of good nutrition). Study staff were blinded to random assignments. The randomization sequence was generated by NSK, uploaded to the Radiant platform (Radiant Interactive Group), and assigned automatically in the order of enrollment.

Description of the Intervention: eSBI

Those randomized to the intervention were asked to complete lessons or exercises on 11 topical areas focused on alcohol use (eg, importance of change, downsides of drinking, barriers to change, strategies for cutting back, change motivators) in an MI format, each with a single web page. The intervention is not a full MI intervention, as it was relatively simple in its presentation, but it did have components of the Elicit-Provide-Elicit approach. The intervention had been widely used in employee assistance programs. The intervention content was adapted for late adolescents and young adults in terms of voice and language (eg, open, nonjudgmental, inclusive), contexts (eg, school as well as work contexts), and reading level. The intervention was presented as a series of slides that contained an interactive element in which participants could click on checkboxes, drop-down menus, and short text fields as part of the brief MI exercises. An example slide is shown in Figure 2. By design, the intervention lacked any specific cultural tailoring for YMSM or YTW other than the age-appropriate language. This was intended to facilitate rapid scaling and broad adoption across the general population if the intervention proved effective. The electronic intervention and control modules were delivered using a customized eSBI platform developed by Radiant Interactive Group (Laguna Niguel, CA). Radiant uses industry-standard data encryption and security to manage protected health information recorded by their system.

Figure 2. Example slide from the electronic screening and brief intervention (eSBI).

Time and Attention-Matched Control: Diet and Nutrition

Those randomized to the control condition completed a brief time and attention-control intervention, also in an MI format and of equal length (ie, same number of intervention screens), which encouraged good nutrition but was not expected to impact alcohol use.

Standard of Care Prevention Services

The standard HIV preventive care at each site included rapid point-of-care HIV testing and counseling and linkage navigation to PrEP or HIV care, depending on the test result.

Study Assessments

Participants completed a baseline study visit that included a standardized assessment via computer-assisted self-interviewing (CASI). Follow-up CASI assessments were conducted at 1, 3, 6, and 12-month follow-up visits either in person or remotely via web-based assessment. Detailed contact information was collected to facilitate study retention.

Primary Outcome

All outcome measures were self-reported and constructed using the revised versions of the Daily Drinking Questionnaire [11] (DDQ-R [12]) including questions regarding the heaviest drinking week [13]. The questionnaire asks the participant to report the number of drinks consumed for each day of the week for both a typical week and heavy drinking week in the past 30 days. The outcomes assessed for this analysis were (1) the total number of drinks consumed in a typical drinking week, (2) the total number of drinks consumed in a peak drinking week, (3) the number of days 5 or more drinks were consumed in a typical week, (4) the number of days 5 or more drinks were consumed in a heavy drinking week, and (5) any binge drinking (ie, 5 or more drinks consumed in 1 episode) in the prior month.

Secondary Outcomes

Sexual risk behavior was measured via a modified version of the AIDS-Risk Behavior Assessment [14] used in prior studies with YMSM and YTW [15,16] and included (1) condomless receptive anal sex (RAS) acts, (2) condomless RAS acts while under the influence of alcohol or drugs, (3) condomless insertive anal sex (IAS) acts, and (4) condomless IAS acts while under the influence of alcohol or drugs. Condomless sex was defined as sex in which “no condom was used or a condom was used but only for a part of the time.” Attending at least one provider visit for PrEP care during the observation period was additionally included as a secondary outcome for HIV-negative participants who reported using PrEP (n=89).

We measured eSBI intervention satisfaction and acceptability using the Client Satisfaction Questionnaire (CSQ-8) [17]. Participants were asked to rate the quality of the intervention and their satisfaction, as well as whether they would recommend it to friends. We also include an open-ended item, “Do you have any other suggestions to improve this intervention?”

Moderators

Depression and anxiety were measured using the short version of the Center for Epidemiologic Studies Depression Scale (CES-D10) [18] and 7-item Generalized Anxiety Disorder (GAD-7) [19], respectively.

Statistical Analysis

The analysis used an intent-to-treat approach in which all randomized participants were included for analysis. Baseline characteristics of the intervention groups were inspected visually for imbalances; differences between the 2 intervention groups were assessed using chi-square or Fisher exact tests for categorical variables and t tests for numerical variables. Changes in drinking levels over time were examined descriptively using means with SDs and medians with IQRs. The targeted sample size of 450 was estimated to yield 80% power to detect effects for our primary (alcohol use) outcome under a range of retention levels (75%-85%).

To evaluate the efficacy of the intervention, generalized estimating equations (GEEs) with robust standard errors were conducted. Each outcome was regressed on intervention group, time, a group-by-time interaction, and the baseline value of the outcome, where the statistical significance of the interaction term indicates whether the groups differ in response to the intervention over time. The baseline outcomes were included in the model due to baseline imbalances in the outcomes between the groups. Unadjusted models are presented in Table S1 in Multimedia Appendix 1. Omnibus tests (Type III Score tests) were used to assess the overall effects of the intervention, time, and whether the differences between the groups varied across time points. Contrasts were performed to assess the effect of the intervention compared with the time and attention-matched control at each follow-up visit compared with first follow-up for exploratory purposes even when omnibus tests were not significant. Interaction contrasts represent the relative risk (RR) for binary outcomes or incidence rate ratio (IRR) for count outcomes in the intervention arm at that time point compared with the RR or IRR for the group comparison at first follow-up (ie, a ratio of ratios). All count outcomes were modeled as negative binomially distributed variables with log link functions to compute rate ratios; the binary outcome (having had more than 5 drinks in any single drinking session in the prior month) was modeled as a binomially distributed variable with log link function to estimate relative risk. An exchangeable working correlation was specified to account for repeated measurements on participants over time. All statistical analyses were conducted using SAS software version 9.4 (SAS Institute). Graphics were generated using STATA 17.


Participants

A total of 644 individuals were screened for the study: 549 were eligible, and 95 were not eligible. Study enrollment began in December 2016, and all follow-up visits were completed by October 2020. Among those eligible, 85 (85/549, 15.5%) were lost to follow-up prior to enrollment, resulting in 464 enrolled (see CONSORT diagram, Figure 1). Of those enrolled, 14 were withdrawn or considered incomplete, resulting in a final sample of 450 (450/549, 82% of eligible).

All enrolled participants were screened with the AUDIT; 120 screened low risk and were not randomized. Therefore, a total of 329 participants were included in the analysis described herein. Table 1 presents descriptive information on the 329 participants randomized to the intervention or attention control conditions. The average age of the participants was 22.8 years. Most participants identified as non-White (221/329, 67.2%). The majority identified as cisgender male (294/329, 89.4%) and gay (205/329, 62.3%). Most of the participants were employed either full-time or part-time (222/329, 67.7%) and had at least some college education or attended trade school (224/329, 68.3%). There were 70 (70/329, 21.3%) with a history of incarceration. A little more than one-half of participants had a primary care provider (174/329, 52.9%). There were no significant differences between the intervention groups in these characteristics at baseline. For each measure of drinking, there were reductions in the mean amounts of drinking over time in both groups (Table 2). The average duration of the eSBI intervention was just under 10 minutes and of the control condition was just over 10 minutes.

Table 1. Demographics for the intervention (electronic screening and brief intervention [eSBI]; n=167) and control (n=162) groups.
CharacteristicseSBIaControlaP value
Age (years), mean (SD)22.89 (1.99)22.79 (1.97).65
Gender identity, n (%).88

Cisgender male150 (89.8)144 (88.9) 

Transgender female15 (9.0)15 (9.3) 

Transgender male2 (1.2)3 (1.9) 
Sexual orientation, n (%) .98

Bisexual42 (25.1)41 (25.3) 

Gay105 (62.9)100 (61.7) 

Queer16 (9.6)16 (9.9) 

Straight/heterosexual4 (2.4)5 (3.1) 
Race/ethnicity, n (%).68

White NHb60 (35.9)48 (29.6) 

Black/African American NH65 (38.9)68 (42.0) 

Hispanic/Latino/a24 (14.4)26 (16.0) 

Other NH18 (10.8)20 (12.3) 
Employment, n (%).44

Employed full-time54 (32.3)63 (39.1) 

Employed part-time56 (33.5)49 (30.4) 

Unemployed57 (34.1)49 (30.4) 
Education, n (%).59

Less than high school15 (9.0)13 (8.1) 

High school or GEDc36 (21.6)40 (24.8) 

Some college or trade school50 (29.9)55 (34.2) 

College degree or higher66 (39.5)53 (32.9) 
Arrest history, n (%)44 (26.3)53 (32.9).24
Incarceration history, n (%)30 (18.0)40 (24.8).17
Currently has a PCPd, n (%)82 (49.1)92 (56.8).20
Baseline HIV test results, n (%).21

Nonreactive167 (100.0)159 (98.1) 

Reactive0 (0)2 (1.2) 

Confirmed positive0 (0)1 (0.6) 

aNot all sum to 329 due to missing data.

bNH: non-Hispanic.

cGED: General Education Development.

dPCP: primary care physician.

Table 2. Outcomes by treatment condition at all time points.
OutcomesAll participants (n=329)Control (n=162)eSBIa intervention (n=167)
Number of drinks in a typical drinking week, mean (SD)

Baseline11.89 (11.64)10.51 (10.45)13.24 (12.57)

1 month8.92 (10.01)9.33 (12.31)8.55 (7.31)

3 months8.51 (9.25)7.94 (8.43)9.04 (9.94)

6 months7.90 (8.00)7.49 (7.91)8.27 (8.09)

12 months8.68 (9.61)8.35 (7.74)8.98 (11.12)
Number of drinks in a typical drinking week, median (IQR)

Baseline8.00 (4.00-16.00)8.00 (4.00-14.00)10.00 (5.00-17.00)

1 month6.00 (3.00-12.00)6.00 (3.00-12.00)7.00 (3.00-13.00)

3 months6.00 (3.00-11.00)6.00 (3.00-10.00)6.00 (2.00-13.00)

6 months6.00 (2.00-12.00)5.00 (2.00-11.00)6.00 (2.00-12.00)

12 months7.00 (2.00-12.00)7.00 (2.00-11.75)6.00 (2.00-12.00)
Number of drinks in a peak drinking week, mean (SD)

Baseline6.36 (4.84)5.83 (4.48)6.87 (5.13)

1 month5.09 (3.84)5.15 (4.14)5.04 (3.57)

3 months4.96 (4.00)4.71 (3.81)5.18 (4.17)

6 months4.86 (3.54)4.62 (3.42)5.08 (3.64)

12 months4.90 (3.63)4.75 (3.24)5.04 (3.98)
Number of drinks in a peak drinking week, median (IQR)

Baseline5.00 (3.00-8.00)5.00 (3.00-8.00)6.00 (4.00-9.00)

1 month5.00 (2.00-7.00)4.00 (2.75-7.00)5.00 (2.00-7.00)

3 months4.00 (2.00-7.00)4.00 (2.00-6.00)4.00 (2.00-8.00)

6 months4.00 (2.00-7.00)4.00 (2.00-6.00)4.50 (2.00-7.25)

12 months5.00 (2.00-7.00)5.00 (2.00-7.00)5.00 (2.00-7.00)
Number of days with 5 or more drinks in a typical drinking week, mean (SD)

Baseline0.95 (1.41)0.84 (1.30)1.05 (1.51)

1 month0.63 (1.14)0.69 (1.24)0.58 (1.03)

3 months0.58 (1.02)0.47 (0.85)0.69 (1.14)

6 months0.56 (1.01)0.45 (0.88)0.65 (1.10)

12 months0.59 (1.07)0.57 (0.99)0.62 (1.14)
Number of days with 5 or more drinks in a typical drinking week, median (IQR)

Baseline0 (0-2.00)0 (0-1.00)0 (0-2.00)

1 month0 (0-1.00)0 (0-1.00)0 (0-1.00)

3 months0 (0-1.00)0 (0-1.00)0 (0-1.00)

6 months0 (0-1.00)0 (0-1.00)0 (0-1.00)

12 months0 (0-1.00)0 (0-1.00)0 (0-1.00)
Number of days with 5 or more drinks in a peak drinking week, mean (SD)

Baseline1.53 (1.78)1.32 (1.62)1.74 (1.90)

1 month1.02 (1.33)1.01 (1.44)1.03 (1.23)

3 months1.04 (1.38)0.95 (1.28)1.11 (1.47)

6 months1.06 (1.46)0.98 (1.29)1.13 (1.59)

12 months1.23 (1.54)1.18 (1.44)1.27 (1.64)
Number of days with 5 or more drinks in a peak drinking week, median (IQR)

Baseline1.00 (0-2.00)1.00 (0-2.00)1.00 (0-3.00)

1 month1.00 (0-2.00)0.00 (0-1.00)1.00 (0-2.00)

3 months0.50 (0-2.00)1.00 (0-2.00)0 (0-2.00)

6 months1.00 (0-2.00)1.00 (0-1.00)0.50 (0-2.00)

12 months1.00 (0-2.00)1.00 (0-2.00)1.00 (0-2.00)
Number of any days with 5 or more drinks in 1 event in the past month, n (%)

Baseline193 (58.7)85 (52.5)108 (64.7)

1 month141 (51.1)65 (49.2)76 (52.8)

3 months131 (48.5)62 (48.1)69 (48.9)

6 months128 (49.8)60 (49.6)68 (50.0)

12 months125 (53.4)61 (53.5)64 (53.3)

aeSBI: electronic screening and brief intervention.

Primary Outcomes

The results of the adjusted GEE models for primary outcomes are presented in Table 3. The omnibus tests (Type III Score tests) showed that the overall effect of the intervention on substance use was not statistically significant (ie, no significant differences between groups across all time points) for any of the primary outcomes. The overall effect of time was statistically significant only for binge drinking in a peak drinking week at 12 months compared with 1 month (ie, there was an increase in drinking outcomes over time across both groups; IRR=1.32, 95% CI 1.05-1.66), and the intervention group-by-time interaction was not statistically significant (ie, differences between groups did not vary over time) for any of the primary outcomes. Figure 3 displays the results of the GEE models with the predicted values and lower and upper 95% CIs.

Table 3. Primary outcomes from the generalized estimating equation estimates of the treatment effect.
ModelaIncidence rate ratio (95% CI)P valueb
Number of drinks in a typical drinking week

Treatment group.49c


eSBId0.97 (0.80-1.16).71

Time.56c


1 monthReferenceReference


3 months0.98 (0.83-1.14).74


6 months0.98 (0.85-1.14).80


12 months1.12 (0.97-1.30).14

Treatment effects (group × time)e.55c


3 months to 1 month1.04 (0.84-1.27).72


6 months to 1 month1.00 (0.81-1.24).97


12 months to 1 month0.89 (0.72-1.10).29
Number of drinks in a peak drinking week

Treatment group.88c


eSBI0.98 (0.84-1.14).78

Time.98c


1 monthReferenceReference


3 months0.95 (0.83-1.10).50


6 months0.96 (0.86-1.06).43


12 months1.00 (0.89-1.12).96

Treatment effects (group × time)e.82c


3 months to 1 month1.06 (0.88-1.28).52


6 months to 1 month1.06 (0.91-1.24).43


12 months to 1 month1.00 (0.84-1.19).99
Number of days with 5 or more drinks in a typical drinking week

Treatment group.76c


eSBI0.88 (0.60-1.28).49

Time.85c


1 monthReferenceReference


3 months0.75 (0.54-1.05).10


6 months0.82 (0.58-1.15).24


12 months1.02 (0.73-1.41).92

Treatment effects (group × time)e.13c


3 months to 1 month1.52 (0.99-2.31).056


6 months to 1 month1.36 (0.88-2.13).17


12 months to 1 month0.98 (0.63-1.53).94
Number of days with 5 or more drinks in a peak drinking week

Treatment group.62c


eSBI0.98 (0.75-1.28).87

Time.047c


1 monthReferenceReference


3 months1.02 (0.83-1.26).84


6 months1.13 (0.89-1.43).33


12 months1.32 (1.05-1.66).02

Treatment effects (group × time)e.94c


3 months to 1 month1.00 (0.76-1.33).97


6 months to 1 month0.95 (0.69-1.31).77


12 months to 1 month0.92 (0.66-1.27).60
Number of any days with 5 or more drinks in 1 event in the past month

Treatment group.33c


eSBI0.99 (0.81-1.21).92

Time.72c


1 monthReferenceReference


3 months0.97 (0.80-1.18).77


6 months1.02 (0.86-1.22).80


12 months1.08 (0.92-1.26).37

Treatment effects (group × time)e.75c


3 months to 1 month0.97 (0.76-1.23).79


6 months to 1 month0.89 (0.69-1.15).37


12 months to 1 month0.90 (0.71-1.15).40

aEach model also controlled for the baseline value of the outcome variable to control for baseline imbalances between the groups.

bOmnibus test P values were from Score tests; all other P values were from Wald tests.

cOmnibus P values.

deSBI: electronic screening and brief intervention.

eThe ratio of the intervention to control at the indicated time point versus baseline.

Figure 3. Primary outcome at each time point (0, 1, 3, 6, and 12 months) by intervention group based on generalized estimating equation (GEE) models: (A) number of drinks in a typical drinking week in the past 30 days, (B) number of drinks in a peak drinking week in the past 30 days, (C) number of days with 5 or more drinks in a typical drinking week in the past 30 days, (D) number of days with 5 or more drinks in a peak drinking week in the past 30 days, (E) any episodes with 5 or more drinks in the past 30 days.

Secondary Outcomes

The results of the adjusted GEE models for secondary outcomes are presented in Table 4. The intervention group showed a reduction in the number of condomless IAS acts while under the influence of alcohol or drugs, whereas the control group showed an increase in the number of acts from 3 months to 12 months (IRR=0.15, 95% CI 0.05-0.44) when examining the contrasts. There were no significant differences between the groups in the other sexual behavior outcomes or number of PrEP care visits between groups. The results of the GEE models are visualized in Figure 4.

In terms of acceptability and satisfaction, 89.7% (148/167) of intervention participants rated the quality of the intervention as “good” to “excellent,” and 94.6% (156/167) indicated they were “mostly satisfied” to “very satisfied.” A total of 89.7% (148/167) indicated that they would “probably” or “definitely” refer a friend to receive the intervention. The most common suggestions for improvement to the intervention were to include interaction with an educator or counselor (n=8); make the intervention less prescriptive for low levels of drinking (n=10); and include graphics, video, or music (n=3).

Table 4. Secondary outcomes from the generalized estimating equation estimates of the treatment effect.
ModelaIncidence rate ratio (95% CI)P valueb
Number of times of condomless receptive anal sex in the past 3 monthss

Treatment group.24c


eSBI0.79 (0.46-1.36).40

Time.16c


3 monthsReferenceReference


6 months1.76 (1.26-2.45).001


12 months1.17 (0.75-1.83).49

Treatment effects (group × time)d.26c


6 months to 3 months0.66 (0.37-1.17).16


12 months to 3 months1.03 (0.51-2.07).94
Number of times of condomless receptive anal sex while under the influence of alcohol or drugs

Treatment group.33c


eSBI0.80 (0.45-1.41).43

Time.20c


3 monthsReferenceReference


6 months1.87 (1.14-3.05).013


12 months1.33 (0.81-2.17).26

Treatment effects (group × time)d.49c


6 months to 3 months0.74 (0.32-1.71).48


12 months to 3 months1.10 (0.42-2.91).84
Number of times of condomless insertive anal sex in the past 3 months

Treatment group.29c


eSBI1.08 (0.61-1.89).79

Time.19c


3 monthsReferenceReference


6 months1.48 (1.06-2.05).02


12 months1.90 (1.11-3.26).02

Treatment effects (group × time)d.25c


6 months to 3 months0.73 (0.32-1.65).44


12 months to 3 months0.53 (0.25-1.12).10
Number of times of condomless insertive anal sex while under influence of alcohol or drugs

Treatment group.94c


eSBI2.48 (1.14-5.39).02

Time.32c


3 monthsReferenceReference


6 months2.39 (1.45-3.95).001


12 months3.58 (1.69-7.56).001

Treatment effects (group × time)d.06c


6 months to 3 months0.41 (0.12-1.38).15


12 months to 3 months0.15 (0.05-0.44).001
At least 1 PrEPecare visit in a 3-month periodf

Treatment group.09c


eSBI1.05 (0.80-1.37)0.728

Time.25c


3 monthsReferenceReference


6 months0.83 (0.63-1.10).19


12 months0.99 (0.74-1.32).94

Treatment effects (group × time)d.41c


6 months to 3 months1.28 (0.89-1.84).18


12 months to 3 months1.17 (0.84-1.64).36

aEach model also controlled for the baseline value of the outcome variable to control for baseline imbalances between the groups.

bOmnibus test P values were from Score tests; all other P values were from Wald tests.

cOmnibus P values.

dThe ratio of the intervention to control at the indicated time point versus baseline.

ePrEP: pre-exposure prophylaxis.

fOnly including time points after the first indicated PrEP use.

Figure 4. Secondary outcome at each time point (0, 3, 6, and 12 months) by intervention group based on generalized estimating equation (GEE) models: (A) number of times of condomless receptive anal sex (RAS), (B) number of times of condomless RAS while under the influence of alcohol or drugs, (C) number of times of condomless insertive anal sex (IAS), (D) number of times of condomless IAS while under the influence of alcohol or drugs, (E) any visits to a provider for pre-exposure prophylaxis (PrEP).

Moderation Effects

As an exploratory aim, we conducted tests of moderation to determine whether the efficacy of the intervention was modified by the presence of depression or anxiety. The observed effects for anxiety were unstable and varied in direction, magnitude, and statistical significance depending on the analytic approach. When we controlled for baseline imbalances in the outcomes, the intervention appeared to be more efficacious among participants with fewer symptoms of anxiety; however, when we did not control for baseline imbalances, the intervention appeared more efficacious among participants with more anxiety symptoms. The contradictory findings may be due to associations between anxiety and the baseline outcomes, but the result is difficult to interpret and should be considered with caution. No moderation effects were observed for depression in any of the analyses.


Principal Findings

In this study, we found no effect of the eSBI intervention on alcohol misuse, but there was evidence of an effect on sexual risk. This study was born from a desire to create a low-cost, scalable, and brief single time-point intervention to address substance misuse in community settings. Prior literature has shown that computerized interventions can successfully reduce substance misuse using an MI approach. For example, Ondersma and colleagues [20] demonstrated that a single 20-minute eSBI intervention, with a more comprehensive MI approach, successfully improved abstinence from drugs at 3 months and 6 months among postpartum drug users. In contrast, our eSBI approach failed to show any major effect of eSBI on drinking behavior in moderate to high-risk drinkers. Although there was an effect at 12 months with significant increase in the number of binge drinking episodes in a peak week for both the eSBI group and our control condition, these differences were not seen at 3 months or 6 months, and the time-by-group effect was not significant. Our intervention’s lack of effect, in contrast to the results by Ondersma et al [20], may be the result of differing populations (HIV at-risk YMSM and YTW vs postpartum women) and the need for cultural tailoring of the intervention for the former. In addition, the trial by Ondersma et al [20] used animation to deliver the intervention, which may have improved engagement with the content.

Since this study was conceived, there has been a number of trials of eSBI that have found no effect [21,22] or some impact in particular populations including college age drinkers [23], nonpregnant women of childbearing age [24], individuals on antiretroviral therapy [25], and graduate students using cannabis [26]. The literature on eSBI can best be described as mixed, and there is evidence that the more efficacious eSBI interventions have strong cultural tailoring, which our intervention did not have due to a desire to scale this intervention broadly. In addition, our MI approach was very brief and included relatively short MI components. It was by design simple, and we were seeking to test a system that might be broadly implemented. However, this brevity may have come with a price, as the intervention may not have had the robustness of a full MI intervention.

Despite the lack of findings for substance misuse, there was evidence of reduction in sexual risk in the intervention group in comparison to the control group for condomless IAS under the influence at 12 months. These analyses should be interpreted with caution, as there were multiple secondary analyses. Nevertheless, this finding is intriguing and should be the subject of additional study.

At the time that this study was conceived in 2014, trials had mixed findings on the impact of brief interventions on AOD. Since that time, observers have raised criticism of the value of screening and brief interventions [27-29]. The Substance Abuse and Mental Health Services Administration (SAMHSA)–promoted SBIRT model has generally shown impact on individuals with high levels of substance use and in primary care settings [27]. It is possible that our intervention was too brief and lacking in boosters or follow-up. Further trials may be merited with these elements in a dynamic trial design that might allow simultaneous comparisons.

Another promising line of inquiry that has shown impact is the use of relational agents (ie, using avatars, conversational bots, or other interfaces) that simulate face-to-face dynamics and allow for a more holistic experience during screening and a brief intervention [30-32]. Relative to this type of relational agent, our intervention was static; designed with simple, scalable elements; and presented in a slide format. The simplistic design was by intention, as we hypothesized that many clinics would not have the infrastructure, computing capabilities, and high bandwidth access that are often required for more computationally complex frameworks. We suspect that our eSBI system lacked enough appealing components to produce a robust attentional response; however, as we did not measure attention to the eSBI system, this is purely speculative.

Although, overall, the intervention received high ratings for acceptability and satisfaction, some participants suggested the addition of more dynamic and engaging components (eg, more graphics, video, and music), commented that the fully automated version was impersonal and would have preferred more interaction with an educator or counselor, or felt the intervention was too prescriptive for perceived low levels of drinking. These are important considerations to inform future iterations in this population.

Finally, since we conceptualized this study in 2014, eSBI approaches have been tested for feasibility among people living with HIV in sub-Saharan Africa, where alcohol misuse is associated with both HIV transmission risk as well as poor HIV treatment outcomes but is often underreported [25,33]. In Uganda and Namibia, an electronic screening approach was designed specifically to increase reporting of alcohol misuse and, in Namibia, was then coupled with brief intervention. In both studies, evidence of feasibility was apparent, although with concerns about confidentiality (ie, providers being aware of drinking levels), which hampered acceptability [25,33]. These types of initiatives will provide important additional tests of effectiveness of eSBI to reduce alcohol misuse in HIV care environments and, given our findings, may also hold promise for reducing the risk for ongoing HIV transmission (ie, via sexual risk reduction).

Conclusions

This study found a lack of longer-term impact of a single time point intervention, eSBI, on alcohol misuse among YMSM and YTW presenting to community-based HIV testing clinics. The intervention showed an effect in reducing one of the sexual risk outcomes (number of condomless IAS acts while under the influence). Given that this intervention was embedded within larger systems of care (ie, placed within HIV testing clinics without the need for staffing), there would appear to be some value in considering further trials in this space. Further adaptation of the eSBI approach might result in greater impact. This eSBI intervention was embedded within an STTR model of care that has been shown to be highly effective in addressing HIV risk and engaging individuals in care. The study showed excellent recruitment and retention of the sample over a 1-year follow-up period. Our eSBI system can be considered a branch of the broader SBIRT model of care. This model has come under some criticism in recent years due to a lack of compelling evidence to show its impact as a primary prevention and intervention approach. Our eSBI system may have failed to achieve the intended goals of alcohol misuse reduction because of the brevity of the intervention, the lack of boosters or follow-up, and the relatively simple design of the intervention. Regardless of the reason, this study falls into alignment with other negative trials of SBIRT. Future research may need to consider relational agents, digital interventions hybridized with human counselors or therapists, and interventions with boosters of some type. In addition, interventions that can address contextual factors (interpersonal, social, and environmental) may help boost the effect of digital interventions like eSBI. Given the instability of results for moderation of the intervention effect by symptoms of anxiety, future studies may need larger samples or be limited to the subpopulation of individuals with higher levels of anxiety to explore these effects more fully.

Acknowledgments

This study is funded by the National Institute on Drug Abuse of the National Institutes of Health (NIH) under Award Number R01-DA041071. Research reported in this publication was also supported by the NIH's National Center for Advancing Translational Sciences, Grant Number UL1-TR001422. The content is solely the responsibility of the authors and does not necessarily represent the official views of the NIH. We would like to thank member of the Step Up, Test Up team at all study sites for their contribution to study protocol and procedures. Special thanks to Marbella Cervantes for assistance with data cleaning and management.

Authors' Contributions

NSK, RG, and LMK contributed to the funding and design of all aspects of the study. GD, JS, KKB, and MM contributed to the study design and selection of measures. ALH designed the proposed data analysis, and ALH and NDV completed the analysis and created all tables. NSK and LMK drafted the manuscript. The manuscript has been read and approved by all authors.

Conflicts of Interest

None declared.

Multimedia Appendix 1

Table S1: generalized estimating equation (GEE) estimates of treatment effect unadjusted for baseline difference in alcohol use.

DOCX File , 28 KB

Multimedia Appendix 2

CONSORT-eHEALTH checklist (V 1.6.2).

PDF File (Adobe PDF File), 95 KB

  1. Brennan J, Kuhns LM, Johnson AK, Belzer M, Wilson EC, Garofalo R, Adolescent Medicine Trials Network for HIV/AIDS Interventions. Syndemic theory and HIV-related risk among young transgender women: the role of multiple, co-occurring health problems and social marginalization. Am J Public Health 2012 Sep;102(9):1751-1757 [FREE Full text] [CrossRef] [Medline]
  2. Lee JS, Safren SA, Bainter SA, Rodríguez-Díaz CE, Horvath KJ, Blashill AJ. Examining a syndemics network among young Latino men who have sex with men. Int J Behav Med 2020 Feb;27(1):39-51 [FREE Full text] [CrossRef] [Medline]
  3. Mimiaga MJ, Hughto JMW, Biello KB, Santostefano CM, Kuhns LM, Reisner SL, et al. Longitudinal analysis of syndemic psychosocial problems predicting HIV risk behavior among a multicity prospective cohort of sexually active young transgender women in the United States. J Acquir Immune Defic Syndr 2019 Jun 01;81(2):184-192 [FREE Full text] [CrossRef] [Medline]
  4. Mustanski B, Phillips G, Ryan DT, Swann G, Kuhns L, Garofalo R. Prospective effects of a syndemic on HIV and STI incidence and risk behaviors in a cohort of young men who have sex with men. AIDS Behav 2017 Mar;21(3):845-857 [FREE Full text] [CrossRef] [Medline]
  5. Teixeira da Silva D, Bouris A, Voisin D, Hotton A, Brewer R, Schneider J. Social networks moderate the syndemic effect of psychosocial and structural factors on HIV risk among young Black transgender women and men who have sex with men. AIDS Behav 2020 Jan 9;24(1):192-205. [CrossRef] [Medline]
  6. Robbins T, Wejnert C, Balaji AB, Hoots B, Paz-Bailey G, Bradley H, NHBS-YMSM Study Group. Binge drinking, non-injection drug use, and sexual risk behaviors among adolescent sexual minority males, 3 US cities, 2015. J Urban Health 2020 Oct;97(5):739-748 [FREE Full text] [CrossRef] [Medline]
  7. Centers FDC. Diagnoses of HIV Infection in the United States and Dependent Areas 2019. Centers for Disease Control and Prevention.   URL: https://www.cdc.gov/hiv/library/reports/hiv-surveillance/vol-32/index.html [accessed 2023-03-18]
  8. Kuhns LM, Karnik N, Hotton A, Muldoon A, Donenberg G, Keglovitz K, et al. A randomized controlled efficacy trial of an electronic screening and brief intervention for alcohol misuse in adolescents and young adults vulnerable to HIV infection: step up, test up study protocol. BMC Public Health 2020 Jan 08;20(1):30 [FREE Full text] [CrossRef] [Medline]
  9. Chandler RK, Kahana SY, Fletcher B, Jones D, Finger MS, Aklin WM, et al. Data collection and harmonization in HIV research: the seek, test, treat, and retain initiative at the National Institute on Drug Abuse. Am J Public Health 2015 Dec;105(12):2416-2422. [CrossRef] [Medline]
  10. Babor T, Higgins-Biddle J, Saunders J, Monteiro M. AUDIT : the Alcohol Use Disorders Identification Test : guidelines for use in primary health care. World Health Organization. 2001.   URL: https://www.who.int/publications/i/item/WHO-MSD-MSB-01.6a [accessed 2023-03-18]
  11. Collins RL, Parks GA, Marlatt GA. Social determinants of alcohol consumption: the effects of social interaction and model status on the self-administration of alcohol. J Consult Clin Psychol 1985 Apr;53(2):189-200. [CrossRef] [Medline]
  12. Morean ME, Corbin WR. Subjective alcohol effects and drinking behavior: the relative influence of early response and acquired tolerance. Addict Behav 2008 Oct;33(10):1306-1313. [CrossRef] [Medline]
  13. Murphy JG, McDevitt-Murphy ME, Barnett NP. Drink and be merry? Gender, life satisfaction, and alcohol consumption among college students. Psychol Addict Behav 2005 Jun;19(2):184-191. [CrossRef] [Medline]
  14. Donenberg GR, Emerson E, Bryant FB, Wilson H, Weber-Shifrin E. Understanding AIDS-risk behavior among adolescents in psychiatric care: links to psychopathology and peer relationships. J Am Acad Child Adolesc Psychiatry 2001 Jun;40(6):642-653 [FREE Full text] [CrossRef] [Medline]
  15. Garofalo R, Hotton AL, Kuhns LM, Gratzer B, Mustanski B. Incidence of HIV infection and sexually transmitted infections and related risk factors among very young men who have sex with men. J Acquir Immune Defic Syndr 2016 May 01;72(1):79-86 [FREE Full text] [CrossRef] [Medline]
  16. Garofalo R, Kuhns LM, Reisner SL, Biello K, Mimiaga MJ. Efficacy of an empowerment-based, group-delivered HIV prevention intervention for young transgender women: the Project LifeSkills randomized clinical trial. JAMA Pediatr 2018 Oct 01;172(10):916-923 [FREE Full text] [CrossRef] [Medline]
  17. Larsen DL, Attkisson CC, Hargreaves WA, Nguyen TD. Assessment of client/patient satisfaction: development of a general scale. Eval Program Plann 1979;2(3):197-207. [CrossRef] [Medline]
  18. Andresen EM, Malmgren JA, Carter WB, Patrick DL. Screening for depression in well older adults: evaluation of a short form of the CES-D (Center for Epidemiologic Studies Depression Scale). Am J Prev Med 1994;10(2):77-84. [Medline]
  19. Spitzer RL, Kroenke K, Williams JBW, Löwe B. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med 2006 May 22;166(10):1092-1097. [CrossRef] [Medline]
  20. Ondersma SJ, Svikis DS, Thacker LR, Beatty JR, Lockhart N. Computer-delivered screening and brief intervention (e-SBI) for postpartum drug use: a randomized trial. J Subst Abuse Treat 2014 Jan;46(1):52-59 [FREE Full text] [CrossRef] [Medline]
  21. Bendtsen M. An electronic screening and brief intervention for hazardous and harmful drinking among Swedish university students: reanalysis of findings from a randomized controlled trial using a Bayesian framework. J Med Internet Res 2019 Dec 17;21(12):e14420 [FREE Full text] [CrossRef] [Medline]
  22. Johnson NA, Kypri K, Saunders JB, Saitz R, Attia J, Latter J, et al. Effect of electronic screening and brief intervention on hazardous or harmful drinking among adults in the hospital outpatient setting: A randomized, double-blind, controlled trial. Drug Alcohol Depend 2018 Oct 01;191:78-85. [CrossRef] [Medline]
  23. Ganz T, Braun M, Laging M, Schermelleh-Engel K, Michalak J, Heidenreich T. Effects of a stand-alone web-based electronic screening and brief intervention targeting alcohol use in university students of legal drinking age: A randomized controlled trial. Addict Behav 2018 Feb;77:81-88. [CrossRef] [Medline]
  24. Nayak MB, Kaskutas LA, Mericle AA. Randomized trial of an innovative electronic screening and brief intervention for reducing drinking among women of childbearing age. J Addict Med 2019;13(6):450-459 [FREE Full text] [CrossRef] [Medline]
  25. Tang AM, Hamunime N, Adams RA, Kanyinga G, Fischer-Walker C, Agolory S, et al. Introduction of an alcohol-related electronic screening and brief intervention (eSBI) program to reduce hazardous alcohol consumption in Namibia's antiretroviral treatment (ART) program. AIDS Behav 2019 Nov;23(11):3078-3092 [FREE Full text] [CrossRef] [Medline]
  26. Goodness TM, Palfai TP. Electronic screening and brief intervention to reduce cannabis use and consequences among graduate students presenting to a student health center: A pilot study. Addict Behav 2020 Jul;106:106362. [CrossRef] [Medline]
  27. Jonas DE, Garbutt JC, Amick HR, Brown JM, Brownley KA, Council CL, et al. Behavioral counseling after screening for alcohol misuse in primary care: a systematic review and meta-analysis for the U.S. Preventive Services Task Force. Ann Intern Med 2012 Nov 06;157(9):645-654 [FREE Full text] [CrossRef] [Medline]
  28. Saitz R. Screening and brief intervention enter their 5th decade. Subst Abus 2007;28(3):3-6. [CrossRef] [Medline]
  29. Saitz R. 'SBIRT' is the answer? Probably not. Addiction 2015 Sep;110(9):1416-1417. [CrossRef] [Medline]
  30. Bickmore T, Gruber A. Relational agents in clinical psychiatry. Harv Rev Psychiatry 2010;18(2):119-130. [CrossRef] [Medline]
  31. Grekin ER, Beatty JR, McGoron L, Kugler KC, McClure JB, Pop DE, et al. Testing the efficacy of motivational strategies, empathic reflections, and lifelike features in a computerized intervention for alcohol use: A factorial trial. Psychol Addict Behav 2019 Sep;33(6):511-519 [FREE Full text] [CrossRef] [Medline]
  32. Prochaska JJ, Vogel EA, Chieng A, Baiocchi M, Maglalang DD, Pajarito S, et al. A randomized controlled trial of a therapeutic relational agent for reducing substance misuse during the COVID-19 pandemic. Drug Alcohol Depend 2021 Oct 01;227:108986 [FREE Full text] [CrossRef] [Medline]
  33. Emenyonu N, Kekibiina A, Woolf-King S, Kyampire C, Fatch R, Dawson-Rose C, et al. Digital health screening in people with HIV in Uganda to increase alcohol use reporting: qualitative study on the development and testing of the self-administered digital screener for health. JMIR Form Res 2022 Sep 01;6(9):e35015 [FREE Full text] [CrossRef] [Medline]


AOD: alcohol and other drugs
AUDIT: Alcohol Use Disorders Identification Test
CASI: computer-assisted self-interviewing
CES-D10: Center for Epidemiologic Studies Depression Scale 10
CSQ-8: Client Satisfaction Questionnaire
DDQ-R: Daily Drinking Questionnaire Revised
eSBI: electronic screening and brief intervention
GAD-7: Generalized Anxiety Disorder 7
GEE: generalized estimating equation
IAS: insertive anal sex
IRR: incidence rate ratio
MI: motivational interviewing
PrEP: pre-exposure prophylaxis
RAS: receptive anal sex
RR: relative risk
SAMHSA: Substance Abuse and Mental Health Services Administration
SBIRT: screening, brief intervention, and referral to treatment
STI: sexually transmitted infection
STTR: seek, test, treat, and retain
YMSM: young men who have sex with men
YTW: young transgender women


Edited by J Torous, G Eysenbach; submitted 19.10.22; peer-reviewed by S Naar, D Levine; comments to author 18.01.23; revised version received 16.02.23; accepted 02.03.23; published 29.03.23

Copyright

©Niranjan S Karnik, Lisa M Kuhns, Anna L Hotton, Natascha Del Vecchio, Moira McNulty, John Schneider, Geri Donenberg, Kristin Keglovitz Baker, Rose Diskin, Abigail Muldoon, Juan Rivera, Faith Summersett Williams, Robert Garofalo. Originally published in JMIR Mental Health (https://mental.jmir.org), 29.03.2023.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Mental Health, is properly cited. The complete bibliographic information, a link to the original publication on https://mental.jmir.org/, as well as this copyright and license information must be included.