This paper is in the following e-collection/theme issue:

Reviews in Digital Mental Health (243) Web-based and Mobile Health Interventions (3297) Digital Mental Health Interventions, e-Mental Health and Cyberpsychology (1514)

Published on in Vol 3, No 3 (2016): Jul-Sept

Effectiveness of Internet-Based Interventions for the Prevention of Mental Disorders: A Systematic Review and Meta-Analysis

Effectiveness of Internet-Based Interventions for the Prevention of Mental Disorders: A Systematic Review and Meta-Analysis

Effectiveness of Internet-Based Interventions for the Prevention of Mental Disorders: A Systematic Review and Meta-Analysis

Authors of this article:

Lasse Sander1, 2 Author Orcid Image ;   Leonie Rausch1 Author Orcid Image ;   Harald Baumeister3 Author Orcid Image
Article Authors Cited by (112) Tweetations (27) Metrics

    Original Paper

    1Institute of Psychology, Depatment of Rehabilitationpsychology and Psychotherapy, University of Freiburg, Freiburg, Germany

    2Medical Faculty, Department of Medical Psychology and Medical Sociology, University of Freiburg, Freiburg, Germany

    3Institute of Psychology and Education, Department of Clinical Psychology and Psychotherapy, University of Ulm, Ulm, Germany

    Corresponding Author:

    Lasse Sander, Dipl Psych

    Institute of Psychology

    Depatment of Rehabilitationpsychology and Psychotherapy

    University of Freiburg

    Engelberger Str. 41

    Freiburg, 79085

    Germany

    Phone: +49 7612033049

    Fax:+49 7612033040

    Email: lasse.sander@psychologie.uni-freiburg.de


    Related ArticleThis is a corrected version. See correction statement in: http://mental.jmir.org/2016/3/e41/

    Background: Mental disorders are highly prevalent and associated with considerable disease burden and personal and societal costs. However, they can be effectively reduced through prevention measures. The Internet as a medium appears to be an opportunity for scaling up preventive interventions to a population level.

    Objective: The aim of this study was to systematically summarize the current state of research on Internet-based interventions for the prevention of mental disorders to give a comprehensive overview of this fast-growing field.

    Methods: A systematic database search was conducted (CENTRAL, Medline, PsycINFO). Studies were selected according to defined eligibility criteria (adult population, Internet-based mental health intervention, including a control group, reporting onset or severity data, randomized controlled trial). Primary outcome was onset of mental disorder. Secondary outcome was symptom severity. Study quality was assessed using the Cochrane Risk of Bias Tool. Meta-analytical pooling of results took place if feasible.

    Results: After removing duplicates, 1169 studies were screened of which 17 were eligible for inclusion. Most studies examined prevention of eating disorders or depression or anxiety. Two studies on posttraumatic stress disorder and 1 on panic disorder were also included. Overall study quality was moderate. Only 5 studies reported incidence data assessed by means of standardized clinical interviews (eg, SCID). Three of them found significant differences in onset with a number needed to treat of 9.3-41.3. Eleven studies found significant improvements in symptom severity with small-to-medium effect sizes (d=0.11- d=0.76) in favor of the intervention groups. The meta-analysis conducted for depression severity revealed a posttreatment pooled effect size of standardized mean difference (SMD) =−0.35 (95% CI, −0.57 to −0.12) for short-term follow-up, SMD = −0.22 (95% CI, −0.37 to −0.07) for medium-term follow-up, and SMD = −0.14 (95% CI, -0.36 to 0.07) for long-term follow-up in favor of the Internet-based psychological interventions when compared with waitlist or care as usual.

    Conclusions: Internet-based interventions are a promising approach to prevention of mental disorders, enhancing existing methods. Study results are still limited due to inadequate diagnostic procedures. To be able to appropriately comment on effectiveness, future studies need to report incidence data assessed by means of standardized interviews. Public health policy should promote research to reduce health care costs over the long term, and health care providers should implement existing, demonstrably effective interventions into routine care.

    JMIR Ment Health 2016;3(3):e38

    doi:10.2196/mental.6061

    Keywords

    prevention; systematic review; meta-analysis; mental disorders; Internet and mobile-based 


    Mental disorders remain highly prevalent worldwide with lifetime prevalence rates varying between 12.0% in Nigeria and 47.4% in the United States [1]. In 2010, the largest contributor to years lived with disability were mental and behavioral disorders [2]. In addition to the high disease burden and premature mortality, mental disorders also represent a financial burden for both, people affected and society [3-5].

    Because care and treatment options and results remain limited [5], the focus should be on the reduction of the incidence by prevention measures.

    There are 3 different types of prevention. Universal prevention is focused on the general population (including those without special risk factors). The focus of selective prevention is on subgroups at risk of developing a (mental) disorder (increased risk compared with the average population), whereas indicated prevention targets subgroups who show subthreshold symptoms (ie, not fulfilling full diagnosis criteria) [6].

    Regardless of the type of prevention, prevention measures should lead to a substantial reduction in the incidence of the target mental disorder. Consequently, for assessing the effectiveness of preventive interventions, an initial disorder-free target population is needed. In addition, current incidence data collected by means of standardized interviews (eg, Structured Clinical Interview for DSM Disorders [SCID], MINI) are required [7,8]. Together, this allows for calculating the incidence rate ratios (IRRs) and number needed to treat (NNT). The NNT indicates how many people would have to receive an intervention to prevent one new case of the target mental disorder (“effort”), whereas the IRR is an indicator of the “impact” of a preventive intervention [9].

    Recent reviews and meta-analyses indicated that prevention of mental disorders is feasible and can lead to a substantial “impact,” that is, reduction of incidence rates of mental disorders [9-13].

    The Internet as medium for delivery has been identified as an appropriate way to scale up preventive interventions [14,15], needs less effort in provision, and has several additional advantages over traditional (ie, face-to-face) prevention settings. Internet- and mobile-based interventions (IMIs) are flexible (participants can integrate them easily in their daily lives and work at their own pace) and anonymity might be appealing for those fearing stigmatization [16]. Furthermore, in the setting of limited health care resources, IMIs have been found to be cost-effective [17-19]. A large number of people can be reached as a result of decreased personnel and infrastructure costs, especially those in remote areas without easy access to health care services [20]. Considering the worldwide rapid growth of Internet usage during the last decade [21], health care services and particularly mental health professionals could benefit from IMIs as an alternative or supplement to existing and traditional interventions [22].

    There are few reviews and meta-analyses to date summarizing empirical findings on IMIs for the prevention of mental disorders. The literature yields reviews on prevention of eating disorders (EDs) [23,24], and substance-related and addictive disorders [25-27] in adult populations. Regarding ED, the review by Schlegl et al [24] integrated a wide range of intervention and prevention trials. Concerning prevention, they presented a mixture of relapse prevention (2 studies), treatment of subthreshold ED (2 studies), and primary prevention trials. Unfortunately, the wide range of studies and outcome parameters did not allow for meta-analytical pooling. Beintner et al [23] focused on a single ED prevention program for students called StudentBodies.

    With regard to content, substance-related and addictive disorders prevention programs are often focused on health behaviors and health promotion, rather than on psychotherapeutic variables [28,29]. In summary, none of the previously mentioned reviews summarizes and evaluates the existing literature of Internet-based interventions for the prevention of mental disorders in general and with a clear reference to the previously mentioned statistical criteria (initial disorder-free target population, reporting of incidence data by means of standardized interviews). Consequently, health care providers and public health policy makers are unable to gain an overview of the effectiveness of IMIs for the prevention of mental disorders. This systematic review and meta-analysis fills this gap in research as understudied disorder groups, intervention types, and populations are detected. It aims to (1) describe existing studies on Internet-based preventive interventions, (2) assess the quality of included studies, (3) evaluate the intervention effectiveness, and (4) highlight understudied subfields of research (eg, certain disorder groups or intervention content).


    Registration and Study Protocol

    This systematic review has been registered in the PROSPERO register (registration number CRD42015026781). It was conducted according to the PRISMA guidelines [30]. A study protocol that describes trial details has been submitted on December 17, 2015 [31].

    Eligibility Criteria

    Population

    Studies were eligible for inclusion if they (1) focus on an adult target population, who (2) were without a diagnosis of the target mental disorder at baseline (primary prevention intervention). (3) Mental disorders had to be assessed by means of standardized interviews (eg, SCID [32]), validated self-reports (eg, Beck Depression Inventory-II [33]) or clinician-rated scales (eg, HAM-D [34] with normed cutoff points or diagnosed by health care professionals). Studies on the prevention of substance-related and addictive disorders have been excluded, as this represents a frequently-studied and already reviewed specific subgroup of prevention research [26,27].

    Intervention

    (4) Interventions needed to be based on psychological interventions. The definition of “psychological intervention” was taken from Kampling et al [35] and refers to cognitive behavioral therapy (CBT), psychodynamic psychotherapy, behavior therapy or behavior modification, systemic therapy, third wave cognitive behavioral therapies, humanistic therapies, integrative therapies, and other psychological-oriented interventions. (5) Interventions must be provided in an online setting, defined as online, Internet, Web, or mobile based. Interventions may vary concerning the amount of external guidance provided to participants. Self-help interventions will also be included. We excluded studies on the relapse prevention of mental disorder, as these treatment maintenance interventions differ substantially from preventive interventions focused on the first or recurrent onset of mental disorders [35].

    Comparison

    (6) Studies had to include a control group. This could be either (enhanced) usual care, wait-list control group, another intervention, or no treatment.

    Outcomes

    (7) Studies examining onset of disorder were included, defined as percentage of persons who developed the mental disorder under study from pre- to follow-up-assessment. In addition to data from standardized clinical interviews (eg, SCID-IV [7]), we included studies reporting only symptom severity scores, when validated rating scales with normed cutoff points (referencing onset of disorder or diagnosis) have been used. To be able to comment meaningfully on any postintervention reduction of incidence, studies had to (8) include a follow-up assessment at 3 months or longer after randomization.

    Study Type

    (9) Only randomized controlled trials (RCTs) that are available in full text will be eligible for this review. For an overview of the eligibility criteria, see Table 1.

    Table 1. Eligibility criteria.
    No.ItemInclusionExclusion
    1PopulationAdults (≥ 18 years)Children and adolescents (< 18 years)
    2PreventionUniversal, selective, or indicated preventionParts of the population already affected at baseline
    3AssessmentInstrument with standardized cut-offs for clinical significance or symptom severity (> moderate symptomatology)Descriptive symptom-oriented instruments without standardized cut-offs
    4Prevented disorderMental disorder other than substance-related/addictive disorderOther types of disorders; substance-related/addictive disorders
    5InterventionWeb-based, psychological, preventiveNot Web-based, no psychological principles, treatment rather than prevention
    6Control groupWaiting list, other treatment, placebo, care as usualNo control group
    7OutcomesOnset, Number Needed to Treat, Incidence Rate Ratio, severityOther outcomes (no statements possible about preventive effect)
    8Follow-upAt least 3 month follow-up assessmentNo or < 3-month follow-up assessment
    9Study designRandomized controlled trialNo randomized controlled trial (eg, cross-sectional studies, case studies, or case reports)

    Search Strategy

    A systematic database search was conducted. Databases included are The Cochrane Central Register of Controlled trials (CENTRAL), PsycINFO, and MEDLINE (search date August 17, 2015). A sensitive search strategy was developed and applied for each database [31]. The search was complemented by a review of reference lists from identified publications and a hand-search of the World Health Organization International Clinical Trials Registry Platform (ICTRP) to include ongoing trials.

    When indicated, study authors have been contacted to obtain further information to clarify study characteristics. When study protocols were identified without subsequent publication of results, authors have been contacted to obtain missing or unpublished data and determine eligibility for inclusion in this review.

    Study Selection

    The selection of papers was conducted by 2 independent reviewers (LS, LR). In the first step, authors screened all titles and abstracts yielded by the database search. In the second step, the full texts of the selected articles were retrieved and screened in terms of the aforementioned eligibility criteria. Reference lists of all articles included in the study were screened in the same way. Disagreement at both screening levels was resolved by discussion. Concurrent validity of the 2 reviewers was examined. Figure 1 shows a PRISMA flow chart to illustrate the study selection process and reasons for exclusion [30].

    ‎
    Figure 1. PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) flow chart of included studies.

    Data Extraction

    The following data items were extracted for each study: (1) study identification items (first author, year of publication), (2) study design characteristics (sample size, control group, type of assessments, length of follow-up assessments), (3) intervention characteristics (name, type, duration, level of human support or guidance), (4) prevention characteristics (type, prevented disorder), (5) dropout rate, (6) target population (eg, risk group), and (7) clinical outcomes (onset and/or severity of disorder including means, variances, as well as effect sizes). In case of deficient or missing outcome data, authors were contacted and data were requested. To ensure accuracy, a second reviewer rechecked the extracted data.

    Assessment of Methodological Quality

    To evaluate the quality of evidence, the risk of bias was assessed for each study according to the Cochrane Collaboration’s tool for assessing risk of bias in RCTs [36]. The assessment was rechecked by a second reviewer. As recommended, each study was reviewed for procedures in the following domains: (1) random sequence generation, (2) allocation concealment, (3) blinding (3a – of participants, 3b – of personnel, 3c – of outcome assessors), (4) incomplete outcome data (4a – dropout rate (≤ 20% for short-term follow-ups, ≤ 30% for long-term follow-ups), 4b – intention-to-treat analysis), (5) selective outcome reporting, and (6) other threats to validity (6a – similar groups at baseline, 6b – no or similar cointerventions between intervention and control groups, 6c – compliance, 6d – identical timing for outcome assessment). Studies were rated as showing a “low” or “high” risk of bias according to the aforementioned criteria. For studies with at least 6 fulfilled criteria and no serious flaws, the risk of bias was evaluated as being low according to Furlan et al [36]. Less than 6 fulfilled criteria or serious flaws yielded a rating of “high” risk of bias. Of note, in the implementation of psychological interventions, blinding of health care providers (if a guided intervention was provided) or patients concerning the treatment is not possible. This results in a “high” risk of bias rating on this criterion. However, outcome assessors can remain unaware of the treatment allocation of patients.

    Data Analysis

    If onset data were available, IRR and NNT were calculated. When there were at least 5 studies with available severity data within one disorder (as primary and secondary outcome), a meta-analytically pooled effect size was calculated, and effect sizes were illustrated in forest plots. Meta-analyses were conducted using Review Manager 5.3 (Cochrane Collaboration, 2014). Standardized mean differences (SMDs) with 95% CIs were computed for all continuous outcomes. Random-effects meta-analyses were performed to compute overall estimates of treatment outcome. The I2statistic was used to examine study heterogeneity [37]. Consistent with Sterne et al [38], a funnel plot examining publication bias was not examined due to the limited number of included studies. Follow-up periods were subgrouped into short-term (post assessment), medium-term (≤ 6 month), and long-term (> 6 month) follow-ups. Subgroup comparisons were not feasible due to the low number of studies included.


    Overview

    The systematic database search yielded 1600 hits. After removing duplicates, screening titles, abstracts, and full text papers for inclusion, conducting a reference search, searching trial registers for eligible studies and contacting authors, a total of 17 studies met eligibility criteria and were included in the review. The selected studies targeted the prevention of EDs, depression, anxiety, post-traumatic stress disorder, generalized anxiety disorder (GAD), or a combination of these mental disorders [39-56].

    Quality Assessment

    Five of 17 studies were classified as having a high risk of bias and the remaining 12 studies were classified as having a low risk of bias (Table 2). Sequence generation (1) was mostly met; only 3 studies were categorized as unclear. Allocation concealment (2) was met in almost half of the included studies, otherwise categorized as unclear as it was not sufficiently specified. Blinding of participants (3a) was met in 2 studies with active control groups [42,50]. Blinding of personnel (3b) was set on “no” without exception. As blinding of personnel is not possible for most psychological interventions, it must be considered a possible source of bias. However, outcome assessors remained unaware of the treatment allocation (3c) in 4 studies [40,42,43,51].

    Regarding dropout rate (4a), only 7 studies met the predetermined criterion (≤20% for short-term follow-ups, ≤ 30% for long-term follow-ups). Ten of the included studies reported the use of an intention-to-treat analysis (4b); the remaining studies were categorized as unclear. Two studies reported results incompletely [39,48]. (5) Particularly for Jacobi et al [39] this can be regarded as serious flaw, since results of a clinical interview (SCID) were not reported. About half of the studies reported similar groups at baseline (6a) in demographics and outcome measures. Some studies reported differences in one demographic variable, which was subsequently used as a covariate [54]; alternatively, if the manuscript did not address this variable, the study was categorized as unclear. Two serious flaws were catalogued on this category because of disregarded baseline differences in outcome measures [43,53]. There were no cointerventions (6b) in any study. Compliance with interventions (6c) was rated acceptable in two thirds of the included studies. One study [50] received a serious flaw because of a very low compliance and significant between groups difference (combined with a relatively high dropout rate). (6d) Outcome assessment was timed similarly for all groups except for 2 studies [43,46] that used a cohort design.

    To evaluate the risk of certain biases (selection, performance, detection, and attrition bias), the criteria can be grouped into randomization, blinding, outcome, and withdrawal criteria. Selection bias could only be ruled out in 3 studies [41,47,52] that fulfilled all 3 randomization criteria (1) sequence generation, (2) allocation concealment, (6a) similar groups.

    Performance bias could be present in every study. As mentioned previously, blinding was only insufficiently possible for all studies. Hence, criteria concerning expectation and performance effects (3a – blinding of participants, 3b – blinding of personnel, 6b – no cointerventions, 6c – compliance) were never completely fulfilled.

    Concerning detection bias, 3 studies [40,42,51] fulfilled both criteria of outcome assessment (3c – blinding of outcome assessors, 6d – identical timing for outcome assessments).

    Three studies [45,47,54] fulfilled both criteria concerning withdrawals from studies (4a – dropout, 4b – ITT); the remaining studies could be affected by attrition bias.

    Intervention Characteristics

    Many studies administered measures of a variety of mental disorders. Hereinafter included studies are arranged by their main focus. For an overview of all included studies, see Table 3.

    Table 2. Risk of bias assessment.
    StudySequence generationaAllocation concealmentcBlindingIncomplete
    outcome
    data    		Selective outcome reportingiOther threats to validityRisk of Biasn
    ParticipantsdPersonneleOutcome
    assessorsf    		DropoutgITThSimilar groupsjCointerventionskCompliancelTimingm
    Bantum et al [46]

    		YesbUnclearNoNoNoYesUnclearYesNoYesYesNoHigh
    Beatty et al [47]

    		YesYesUnclearNoNoYesYesYesYesYesNoYesLow
    Christensen et al [48]

    		YesYesUnclearNoNoNoYesNoNoYesYesYesLow
    Christensen et al [55]

    		YesYesNoNoYesNoYesYesYesYesYesYesLow
    Imamura et al [49]

    		YesYesNoNoNoNoYesYesUnclearYesNoYesLow
    Jacobi et al [39]

    		YesUnclearNoNoNoYesUnclearNoUnclearYesYesYesHigho
    Jacobi et al [40]

    		YesUnclearNoNoYesNoUnclearYesUnclearYesYesYesLow
    Mitchell et al [50]

    		YesYesYesNoNoNoYesYesUnclearYesNoYesHighp
    Mouthaan et al [51]

    		YesYesNoNoYesNoYesYesUnclearYesYesYesLow
    Musiat et al [41]

    		YesYesNoNoNoNoUnclearYesYesYesNoYesLow
    Powell et al [52]

    		YesYesNoNoNoNoYesYesYesYesNoYesLow
    Proudfoot et al [53]

    		YesYesNoNoNoNoYesYesNoYesNoYesHighq
    Stice et al [42]

    		YesUnclearYesNoYesYesUnclearYesYesYesYesYesLow
    Taylor et al [43]

    		YesUnclearNoNoYesYesUnclearYesNoYesYesNoHighr
    Thompson et al [54]

    		UnclearUnclearNoNoNoYesYesYesYesYesYesYesLow
    Winzelberg et al [44]

    		UnclearUnclearNoNoNoNoYesYesYesYesYesYesLow
    Zabinski et al [45]

    		UnclearUnclearNoNoNoYesYesYesYesYesYesYesLow

    aRandom unpredictable assignment sequence.

    bYes = Criterion has been met (low risk of bias); No = Criterion has not been met (high risk of bias)

    cAssignment generated by an independent person who is not responsible for determining the eligibility of participants.

    dIntervention and control group are indistinguishable for the participants.

    eIntervention and control group are indistinguishable for the care providers.

    fIntervention and control group are indistinguishable for the outcome assessors (for patient reported outcomes, it is adequate if patients are blinded).

    gDropout must be described and reasons must be given, for short term follow-ups (eg, 3 months) 20%, for long term follow-ups (eg, ≥ 6 months) 30% should not be exceeded.

    hITT: intention-to-treat; all randomized patients are reported and analyzed in the group they were allocated to by randomization.

    iResults of all pre-specified outcomes have to be adequately and completely reported.

    jGroups should not differ significantly at baseline regarding demographics and outcomes.

    kThere are no cointerventions or they are similar between intervention and control groups.

    lAcceptable compliance with the intervention (eg, intensity, duration, number, frequency of sessions).

    mIdentical timing of outcome assessments for intervention and control groups.

    n≥ 6 x “Yes” and no serious flaws indicates an overall low risk of bias; < 6 x “Yes” or serious flaws indicates an overall high risk of bias.

    oSerious flaw: Results of diagnostic interviews not reported.

    pSerious flaw: Very high dropout and very low compliance rate.

    qSerious flaw: Baseline differences between groups, very low compliance.

    rSerious flaw: Baseline differences between groups in several scales.

    Table 3. Characteristics of included studies
    StudyPrevention
    type    		Prevented
    disorder    		Targeted
    population    		Program
    name    		Intervention
    type
    (duration)    		ConditionsSample
    size (n)    		InstrumentFollow-up
    months    		Drop-outaITTb
    Bantum et al [46]

    		SelectiveDepressionAdult
    cancer
    survivors    		Surviving
    and
    Thriving
    with
    Cancer (STC)    		Assisted
    health
    behavior
    change
    program
    (6 weeks)    		1. STC
    2. Delayed treatment    		n=352
    (cohorts of n=20-25)    		PHQ-9c613.9%Unclear
     
    Beatty et al [47]

    		SelectivePTSDd
    Anxiety
    Depression    		Adult
    cancer
    patients    		Cancer
    Coping
    Online
    (CCO)    		Self-guided
    web-based
    CBTe
    (6 weeks)    		1. CCO
    2. Information only    		n1=30
    n2=30    		DASSf
    PSSg    		4.5
    7.5    		8.3%Yes
     
    Christensen et al [48]

    		IndicatedGADh
    Depression    		Young
    adults
    with mild
    GAD symptoms    		iChillActive website (CBT) + email
    (10 weeks)    		1. Active website
    2. Active +phone
    3. Active +email
    4. Control website
    5. Control +phone    		n1 = 111
    n2 = 110
    n3 = 113
    n4 = 113
    n5 = 111    		GAD-7i
    MINIj
    CES-Dk    		6
    12    		52.69%Yes
     
    Christensen et al [55]

    		Indicated
    and selective    		DepressionAdult
    Internet
    users with
    insomnia and
    subthreshold
    depression    		SHUTiModular
    insomnia
    website
    (6 weeks)    		1. SHUTi
    2. Placebo
    website
    (HealthWatch)    		n1=574
    n2=575    		PHQ-9
    MINI    		1.5
    6    		56.1%Yes
     
    Imamura et al [49]

    		IndicatedDepressionWorkers with
    subthreshold
    depression    		Internet CBT program (iCBT)Guided
    stress
    management
    training
    (manga)
    (6 weeks)    		1. iCBT
    2. Information only    		n1=381
    n2=381    		BDI-IIl
    WHO-CIDIm    		1232.9%Yes

     



     

    Jacobi et al [39]

    		SelectiveEating
    disorders    		Female
    university
    students    		StudentBodies (SB)Structured
    CBT +
    discussion
    group
    (8 weeks)
    		1. SB
    2. Waiting list    		n1=50
    n2=50    		EDE-Qn
    SCIDo
    EDI-2p    		36.00%Unclear
     
    Jacobi et al [40]

    		IndicatedEating
    disorders    		Women
    with subthreshold
    eating
    disorders
    		StudentBodies+
    (SB+)    		Structured CBT +
    symptom checklist/
    body image exercise
    (8 weeks)    		1. SB+
    2. Waiting list    		n1=64
    n2=62    		EDE-Q
    SCID    		618.3%Unclear
     
    Mitchell et al [50]

    		UniversalAnxiety
    Depression    		Adult
    Australian
    residents    		Strength-InterventionSelf-guided
    text- and
    graphic-based
    interactive
    program
    (3 weeks)
    		1. Strength-Intervention
    2. Placebo    		n1=48
    n2=54    		DASS378.4%Yes
     
    Mouthaan et al [51]

    		IndicatedPTSD
    Anxiety
    Depression    		Injury
    patients    		Trauma
    TIPS    		Self-guided Internet-based CBT
    (30 min)    		1. Trauma TIPS
    2. Care as usual    		n1=151
    n2=149    		HADSq
    CAPSr
    MINI    		1
    3
    6
    12    		53.7%Yes
     
     
    Musiat et al [41]

    		UniversalAnxiety
    Depression
    Eating
    disorders    		University studentsPersonality and
    Living of
    University
    Students
    (PLUS)
    		Automated transdiagnostic trait focused Web-based intervention
    (5x 20-40 min)
    		1. PLUS
    2. Placebo    		n1=519
    n2=528    		PHQ
    GAD-7
    EDDSs    		361.7%Unclear
     
     
     
     
     
     
    Powell et al [52]

    		UniversalGADUsers
    of the UK
    National
    Health
    Service    		MoodGYMSelf-directed
    CBT
    training
    (5 weeks)    		1.MoodGYM
    2. Waiting list    		n1=1534
    n2=1536    		CES-D
    GAD-7    		350.2%Yes
     
    Proudfoot et al [53]

    		IndicatedAnxiety
    Depression    		Adults
    with mild to
    moderate
    anxiety
    or
    depression
    		myCompassAutomated intervention +
    symptom self-monitoring
    (7 weeks)    		1. MyCompass
    2. Attention control
    3. Waiting list    		n1=242
    n2=248
    n3=230    		DASS351.4%Yes
     
     
    Stice et al [42]

    		SelectiveEating
    disorders
    Depression    		Female
    college
    student with
    body
    dissatisfaction    		eBody Project (eBP)Self-guided
    cognitive-
    behavioral program
    to change
    thin ideal
    (3 weeks)
    		1. eBP
    2. BP
    3. Video control
    4. Brochure control
    		n1=19
    n2=39
    n3=29
    n4=20    		BDIt
    EDDIu    		12
    24    		4.7%Unclear
     
     
    Taylor et al [43]

    		SelectiveEating
    disorders
    Depression    		College
    women
    with
    high
    weight/
    shape
    concerns
    		StudentBodies (SB)Structured
    CBT+
    discussion
    group
    (8 weeks)

    		1. SB
    2. Waiting list    		n1=244
    n2=236    		CES-D
    EDE-Iv
    EDE-Q    		12
    24
    36
    		12.3%Unclear
     
     
     
     
     
     
     
     
    Thompson et al [54]

    		IndicatedDepressionMild- to
    moderately
    depressed
    epilepsy
    patients    		Using
    Practice
    and Learning
    to Increase
    favorable thoughts
    (UPLIFT)    		Telephone-
    and Web-based
    mindfulness and
    cognitive therapy
    (8 weeks)    		1. UPLIFT
    2. Waiting list    		n1=64
    n2=64    		BDI
    mBDIw
    NDDI-Ex
    PHQ    		2
    4    		15.6%Yes
     
     
    Winzelberg et al [44]

    		SelectiveEating
    disorders    		Female
    university
    students    		Student
    Bodies (SB)    		Structured
    CBT+
    discussion
    group    		1. SB
    2. Waiting list    		n1=31
    n2=29    		EDE-Q326.7%Yes
     
    Zabinski et al [45]

    		SelectiveEating
    disorders    		College
    age women    		Chat roomPrivate chat
    room for
    moderated
    discussion
    (8 weeks)    		1. Chat room
    2. Waiting list    		n1=30
    n2=30    		EDE-Q4.53.3%Yes

    aDropout-rate from baseline to the longest available follow-up.

    bITT: Intention-to-treat-analysis

    cPHQ: Personal Health Questionnaire depression scale

    dPTSD: Posttraumatic Stress Disorder

    eCBT: Cognitive Behavioral Therapy

    fDASS: Depression Anxiety Stress Scale

    gPSS: PTSD Symptom Scale

    hGAD: Generalized Anxiety Disorder

    iGAD-7: Generalized Anxiety Disorder questionnaire – 7

    jMINI: Mini-International Neuropsychiatric Interview

    kCES-D: Center for Epidemiological Studies Depression scale

    lBDI-II: Beck Depression Inventory II

    mCIDI: WHO Composite International Diagnostic Interview (Web-based, self-administered version)

    nEDE-Q: Eating Disorder Examination Questionnaire

    oSCID: Structured Clinical Interview for DSM Disorders

    pEDI-2: Eating Disorder Inventory

    qHADS: Hospital Anxiety and Depression Scale

    rCAPS: Clinician-Administered PTSD Scale

    sEDDS: Eating Disorders Diagnostic Scale

    tBDI: Beck Depression Inventory

    uEDDI: Eating Disorder Diagnostic Interview

    vEDE-I: Eating Disorder Examination Interview

    wmBDI: Modified Beck Depression Inventory

    xNDDI-E: Neurological Disorders Depression Inventory in Epilepsy

    Eating Disorders

    The systematic search yielded 6 studies on eating disorders. Four evaluated the effectiveness of StudentBodies, an Internet-based intervention for young women at risk of developing an eating disorder or with subthreshold eating disorders. StudentBodies was originally developed and evaluated in the United States [43,44] and was later translated to the German language [39,40]. The program makes use of common CBT principles and includes a Web-based discussion group.

    Also inspired by StudentBodies, Zabinski et al [45] developed a moderated synchronous group intervention for college-age women, called Chat Room. The main difference to StudentBodies is the integration of a synchronous communication chat room that enables participants to communicate more directly with each other.

    Stice et al [42] developed and evaluated the eBody Project, an Internet-based version of a CBT-based eating disorder prevention group-program. eBody is a dissonance-based intervention encouraging young women to question the popular “thin” ideal.

    Depression

    The search yielded 3 prevention programs focused on the prevention of depression. Surviving and Thriving with Cancer [46] is an assisted Web-based education course aimed to foster positive health behaviors in cancer survivors. In addition to depression, intervention effects on health conditions as nutrition, exercise, and sleep were examined.

    The guided Internet-based CBT program (iCBT) by Imamura et al [49] conveys stress management skills to employees of 2 information technology (IT) companies with subthreshold depression. The intervention aims to prevent major depression episodes. It includes common CBT elements such as self-monitoring or relaxation techniques.

    Thompson et al [54] adapted a mindfulness-based prevention program (UPLIFT) for epilepsy patients with mild-to-moderate depressive symptoms [56]. The telephone- and Web-based intervention makes use of psychoeducative principles (eg, knowledge about depression, importance of reinforcement) and mindfulness-based tools (eg, monitoring of thoughts).

    The 6-week Web-based insomnia program SHUTi by Christensen et al [55] aims at the high co-occurrence of insomnia and depression. Overall, 1149 participants were recruited via the social network platform Facebook and randomized to either a CBT-based insomnia intervention or a control website (HealthWatch).

    Anxiety and Depression

    Two studies focused on combined anxiety and depression. A self-guided intervention promoting well-being in a general population was tested by Mitchell et al [50]. In 3 weekly sessions, users completed either an interactive program focusing on strengths (intervention 1, based on positive psychology principles) or problem-solving skills (intervention 2). Users received feedback and email reminders.

    MyCompass [53], a self-guided computer-delivered intervention, aims to foster self-management and self-monitoring skills in people with mild-to-moderate depression, anxiety, and stress symptoms. Content in the 12 modules was derived from CBT, interpersonal psychotherapy, problem-solving therapy, and positive psychology. Users are also provided with text messages or emails containing reminders and material on psychoeducation.

    Post-Traumatic Stress Disorder

    There were 2 studies that focused on post-traumatic stress. The self-guided Trauma TIPS [51] aims to prevent PTSD in injury patients. CBT techniques such as psychoeducation, stress management, and in vivo exposure are presented in the 30-minute program alongside contact information for professional help and a Web forum for peer support.

    Cancer Coping Online, a self-guided Web-based CBT program for reducing distress in patients currently receiving cancer treatment, was evaluated by Beatty et al [47]. The 6-session program mainly focuses on coping strategies taught via text, audios, and worksheets. Besides posttraumatic stress (cancer-specific distress), levels of depression and anxiety (general distress) were evaluated.

    Generalized Anxiety Disorder

    The search yielded 2 studies on GAD. MoodGYM [52] is a fully automated Internet-based program that teaches CBT skills (eg, psychoeducation, relaxation, or mediation techniques) to improve mental well-being in a general population. Besides well-being, depression and GAD data were gathered. Because the mean depression score of the participants exceeded a clinical cutoff (and thus did not fulfill inclusion criteria), only GAD data were included in this review. Christensen et al [48] evaluated the program iChill, which aims to prevent GAD in young adults with mild GAD symptoms. iChill is an active website. The intervention makes use of multiple CBT tools as psychoeducation, relaxation, or toolkits. Telephone reminders for participants without therapeutic purpose were included in one trial arm.

    Common Mental Health Disorders

    Musiat et al [41] developed a transdiagnostic trait-focused program (PLUS) aiming to prevent common mental disorders. Investigated disorders were depression, GAD, EDs, and alcohol misuse. The CBT-based program focuses on the identification of strengths and the consolidation of coping strategies and includes computerized feedback.

    Effectiveness

    Primary Outcome Onset

    Five studies reported incidence data allowing for the calculation of onset, IRR, and NNT (see Table 4). Christensen et al [48,55] did not observe significant group differences in onset. Imamura et al [49] reported a significant onset difference for the 12-month follow-up period (1.26% for the intervention group, 5.51% for the control group). Calculations yielded an IRR of 0.23 and a NNT of 23.48. Taylor et al [43] found an onset of 4.00% in the intervention group, compared with 6.60% in the control group. This yields an IRR of 0.63 and a NNT of 41.31. Thompson et al [54] found a 0% onset for the intervention group and a 10.70% onset for the control group. In accordance to the Cochrane Handbook for Systematic Reviews [57], a correction of 0.5 was added to the zero incidence in the intervention group, resulting an IRR of 0.09. The NNT was 9.33.

    Table 4. Incidence, onset, incidence rate ratio (IRR), number needed to be treated (NNT)
    StudyDisorderNumber of onsetsFollow-upIRRcNNTd
    IGaCGb
    Christensen et al [55]DepressionN=9
    NTotal= 224    		N=13
    NTotal= 280    		6 months0.87160
    Imamura et al [49]Depressionn=3
    NTotal= 239    		n=15
    NTotal= 272    		12 months0.2323.5
    Thompson et al [54]Depressionn=0e
    NTotal= 52    		n=6
    NTotal= 56    		2 months (pre–post)0.099.3
    Taylor et al [43]Eating Disordersn=8
    NTotal= 193    		n=13
    NTotal= 198    		12 months0.6341.3
    Christensen et al [48]GADfn=10
    NTotal= 171    		n=6
    NTotal= 132    		6 months1.29−76.8

    aIG: intervention group

    bCG: control group

    cIRR: incidence rate ratios

    dNNT: number needed to treat

    eA correction of 0.5 was added to the zero incidence in the intervention group for IRR calculation.

    fGAD: Generalized Anxiety Disorder

    Secondary Outcome: Severity

    Severity data were extracted for all included studies. Eleven studies found significant effects on symptom severity with small-to-large effect sizes (d=0.11 to d=0.76), indicating differential intervention effects on group, time, or interactions of both respectively [39-41,43,45,47,51-55].

    For the meta-analysis of depression interventions, we included studies with depression as a primary and secondary outcome. In cases of multiple active groups, only the main intervention sample was analyzed [48,50]. Results for short-, medium-, and long-term follow-up are presented in Figure 2,Figure 3, and Figure 4, respectively. In summary, pooled effect sizes, indicating a greater decrease in symptom severity for the intervention group, were small but significant.

    For short-term follow-up, our calculations yielded an effect size of SMD = −0.35 (95% CI, −0.57 to −0.12, P=.002). Test of heterogeneity was significant (P<.001; I2= 79%). Effect size for medium-term follow-up was SMD = −0.22 (95% CI, −0.37 to −0.07), P=.005. Heterogeneity was significant (P=.02; I2= 57%). For long-term follow-up, an effect SMD = −0.14 (95% CI −0.36 to 0.07, P=.18) was found. Heterogeneity was not significant (P=.17; I2= 38%). According to Higgins et al [58], overall level of heterogeneity was moderate to high.

    ‎
    Figure 2. The effects of preventive interventions on symptom severity of depression at short-term FU—comparison experimental versus control group.
    ‎
    Figure 3. The effects of preventive interventions on symptom severity of depression at medium-term FU—comparison experimental versus control group.
    ‎
    Figure 4. The effects of preventive interventions on symptom severity of depression at long-term FU—comparison experimental versus control group.

    Ongoing Mental eHealth Prevention Trials

    An ICTRP search for ongoing trials yielded 570 records for 560 trials (years 2005-2015). Sixty-two records were selected as likely being relevant. Most of those were planned studies on symptom severity as a secondary outcome and with different study purposes. Eleven records aimed to assess severity data and had an explicit preventive goal. Targeted conditions were mostly mood and anxiety disorders. Seven studies planned to use clinical interviews for diagnostics or to explicitly gather incidence data. Three studies of those studies were already published, one of them is included in this review [49] and 2 were excluded because of high symptom severity or diagnosis (inclusion criteria 2) at baseline [59,60]. Another planned study on depression had been withdrawn before enrolment because of missing funding (ClinicalTrials.gov, registration no. NCT01080105). Of the remaining 3 records, one study is planned on the prevention of psychosis for people with psychotic like experiences (Australian New Zealand Clinical Trials Registry, registration no. ACTRN12612000963820). The other one concerns the prevention of depression in people with complicated grief (UMIN Clinical Trials Registry, registration no. UMIN000007331). Our own research group also conducts a clinical trial on the prevention of depression in the risk-group of back pain patients with subthreshold depressive symptoms, which is registered at the German Clinical Trials Register (registration no. DRKS00007960). Inspection study protocols emerging from the data base search yielded ongoing trials for the prevention of depression [61-64] and PTBS [65].


    Principal Findings

    This review and meta-analysis systematically summarizes previous research on Internet-based interventions for the prevention of mental disorders. It therefore exceeds the informative value of existing reviews (eg, [23,67]) in terms of the range of included disorders and gives an extensive overview of the actual state of research.

    Seventeen RCTs were included in this review and described in detail. Results are in line with previous meta-analyses, showing that indicated and selective prevention is more common than universal prevention [13] and that CBT is a frequently (sometimes even exclusively) used Internet-based intervention type (eg, [24,66]).

    Quality assessment suggests that 5 included studies have a high risk of bias. Some biases are inevitable (eg, blinding not possible for psychological interventions). Others, such as biases due to inappropriate randomization, can and should be avoided. Of note, 3 studies were classified as having high risk of bias solely due to a serious flaw. Reasons for study classification as having a serious flaw included baseline differences between intervention and control groups [43,53], very low compliance with the intervention [50,53], and a very high dropout rate [50]. Concerning study dropout, the Cochrane guideline [36] provides a rather conservative appraisal when applied to IMIs [67]. When evaluating treatment dropout, a more differentiated perspective can be beneficial. In a recent meta-analysis, van Ballegooijen et al found that IMIs regularly have lower completer rates of total interventions when compared with face-to-face treatments (65.1% vs. 84.7%), but are equal in the percentage of average completed sessions (face-to-face CBT: 83.9% vs. iCBT: 80.8%) [68]. Above that, participants do not necessarily have to complete all sessions to benefit from IMIs. They may stop the treatment because they already obtained benefit, and therefore, these cases would represent a success, rather than a treatment dropout [69,70].

    Three of 5 studies reporting incidence data provided evidence for a preventive effect of the investigated interventions [43,49,54]. One study failed to report the results of a diagnostic interview, which would have allowed calculating incidence rates [39]. The remaining studies by Christensen et al [48,55] did not find effects on reduction of new cases. However, secondary outcome measures of anxiety and depression symptoms showed positive effects. The included incidence studies differed in the length of follow up-periods. Thompson et al [54] only had a pre-post comparison. For the remaining studies, incidence reduction could be observed over a 12-month follow-up period [43,49], suggesting that preventive interventions have the potential for incidence reduction in the long term.

    Nevertheless, severity data show positive effects of interventions in 11 of 17 studies with small-to-medium effect sizes. The best evidence was found for ED and depression. Beintner et al [23] previously conducted a meta-analytic review on most included ED studies, demonstrating mild-to-moderate effects on ED-related attitudes (d=0.15 to d=0.57). The only study not included in Beintners’ review [42] found similar effects. The Internet-based intervention was superior in the reduction of ED symptoms compared with the 2 control conditions (d=0.33 and d=0.19) at the long-term follow-up (1 year).

    Our meta-analysis on IMIs for depression showed an overall small but significant reduction in symptom severity. As mentioned before, this demonstrates an effect of IMIs on the treatment of subclinical depression; a subsequent reduction of incidence can only be assumed, as most included studies did not report incidence data. Because of moderate to high levels of heterogeneity, the actual effect size values should be interpreted with caution. Nevertheless, heterogeneity results from estimates showing the same direction of effect favoring interventions over control groups.

    In summary, evidence was found for effectiveness of interventions for EDs, depression, and anxiety. Internet-based interventions can be considered effective in reduction of subthreshold symptomatology and may also be suitable for preventing the onset of mental disorders over the long term. Depression and anxiety are of particular clinical relevance against the background of prevalence rates: as mentioned, anxiety disorders, insomnia, and major depression are the most common mental disorders in the European Union [5]. Although many IMIs include modules on sleep or relaxation (eg, [47,50]), Christensen et al [57] reported the first prevention RCT explicitly targeting insomnia resulting in a reduction in depressive symptomatology.

    Limitations

    A number of potential limitations and challenges regarding this study should be acknowledged. As usual for reviews and meta-analyses, publication bias [71] must be assumed. This review included several studies reporting not expected or nonsignificant results; nevertheless, publication bias cannot be precluded. Furthermore, the search might have been confounded by language bias because only English and German papers were included. Fortunately, in contrast to publication bias, this only minimally impacts conclusions [72].

    Another limitation concerns the inclusion of studies that reported mean scores only and did not clearly state that participants did not exceed clinical cutoffs at baseline (second exclusion criterion). This became evident after contacting authors to obtain raw data and subsequently computing incidence and onset rates if they had not already been reported. Four of those studies [73-76] had to be excluded because inspection of the raw data revealed that a considerable number of participants exceeded clinical cutoffs at baseline, even though the other eligibility criteria had been fulfilled. Unfortunately, only a few authors responded to our requests for additional information. Thus, it cannot be ruled out that this might also be the case for some included studies, that is, those which reported mean scores and did not provide raw data.

    One major challenge of this broad review was the handling of variability between studies. Although heterogeneity was expected, and even welcomed to map out the broad scope of existing e-mental health prevention interventions, it must be taken into account when interpreting the findings. There are several sources of heterogeneity. First, this review was not restricted to one mental disorder but included a number of clinical conditions. Second, methods to determine the clinical status of participants, such as structured clinical interviews or self-report questionnaires, differed between studies. Third, intervention contents were different. As mentioned previously, most interventions were based on CBT, but other intervention types were included as well. Fourth, study design caused heterogeneity, due to different types of control groups, varying follow-up assessment periods and different sample sizes. For the meta-analysis, pooled effect sizes were calculated for depression and grouped into 3 follow-up periods. Nevertheless, different sample sizes can lead to overweighting of the larger size studies.

    Future Research

    To gain insight into requirements for future research, limitations of the presented studies should be considered. First, the 5 included incidence studies were planned with preventive goals and used standardized clinical interviews for valid diagnosis. The remaining studies were often planned for other purposes (eg, improving well-being), and mental disorder symptoms were gathered by means of self-report questionnaires. Therefore, additional incidence studies using valid diagnostic instruments are needed, especially in light of the ICTRP search results, which revealed that very few incidence studies are planned in the near future.

    Second, the evidence base is limited to a handful of disorder groups specifically EDs, depression and anxiety. Research could expand to the missing subfields, for which Internet-based prevention could be applicable. It is noteworthy that one ongoing trial targets prevention of psychosis [77].

    Third, this is the first exhaustive review on Internet-based prevention for mental disorders in adults. One could expand the scope to additional domains and populations, for instance to relapse prevention in mentally ill persons. As there are already several studies on this topic (eg, [78,79]), a systematic review would be beneficial to provide an overview of the current state of research. Another potential field of study could be Internet-based prevention of mental disorders in children and adolescents. There is already one review on this topic [66], which is limited to depression and anxiety, but could be expanded to include other mental disorders.

    Fourth, most Internet-based interventions included in this review had no additional human support component (ie, unguided). Although this results in a reduction of initial costs, it is also accompanied by a reduction of effectiveness [80]. To date, there is no study investigating whether or not this reduced effectiveness translates into an increase in costs over the long term, due to (for example) increased health care utilization or work incapacity days.

    Conclusions

    Internet-based interventions can be effective in the primary prevention of mental disorders. The body of research is still limited to a few mental disorders (EDs, depression, anxiety disorders). Therefore, further high-quality studies are required, using standardized clinical interviews and gathering incidence data in long-term follow-ups. Because of the advantages of Internet-based interventions such as cost-effectiveness, availability, and flexibility [16,17], this can be a fruitful area for research. Content could be adapted for use with other disorders and populations. Furthermore, interventions that have been found to be effective in preventing certain mental disorders can and should be implemented into practice. Health care costs and personal, social, and financial burdens of the affected and society can consequently be reduced.

    Acknowledgments

    The authors would like to thank Yannik Terhorst for proofreading of the manuscript and Mary Wyman for language editing. The article processing charge was funded by the German Research Foundation (DFG) and the Albert Ludwigs University Freiburg in the funding program Open Access Publishing. Personnel resources granted Federal Ministry of Education and Research, Germany (project: Effectiveness of a guided web-based intervention for depression in back pain rehabilitation aftercare, grant number: 01GY1330A) supported the realization of this review. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

    Conflicts of Interest

    None declared.

    Authors' Contributions

    LS, LR, and HB were involved in the concept and design of the study. LS and LR had major contributions to data extraction and analysis. All authors had major contributions to the write-up and editing of the manuscript and read and approved the final manuscript.

    1. Kessler RC, Angermeyer M, Anthony JC, Demyttenaere K, Gasquet I, Gluzman S, et al. Lifetime prevalence and age-of-onset distributions of mental disorders in the World Health Organization's World Mental Health Survey Initiative. World Psychiatry. Oct 2007;6(3):168-176. [FREE Full text] [Medline]
    2. Vos T, Flaxman AD, Naghavi M, Lozano R, Michaud C, Ezzati M, et al. Years lived with disability (YLDs) for 1160 sequelae of 289 diseases and injuries 1990-2010: a systematic analysis for the Global Burden of Disease Study 2010. Lancet. Dec 15, 2012;380(9859):2163-2196. [CrossRef] [Medline]
    3. Walker ER, McGee RE, Druss BG. Mortality in mental disorders and global disease burden implications: a systematic review and meta-analysis. JAMA Psychiatry. Apr 2015;72(4):334-341. [FREE Full text] [CrossRef] [Medline]
    4. Gustavsson A, Svensson M, Jacobi F, Allgulander C, Alonso J, Beghi E, et al. CDBE2010Study Group. Cost of disorders of the brain in Europe 2010. Eur Neuropsychopharmacol. Oct 2011;21(10):718-779. [CrossRef] [Medline]
    5. Wittchen HU, Jacobi F, Rehm J, Gustavsson A, Svensson M, Jönsson B, et al. The size and burden of mental disorders and other disorders of the brain in Europe 2010. Eur Neuropsychopharmacol. Sep 2011;21(9):655-679. [CrossRef] [Medline]
    6. Gordon RS. An operational classification of disease prevention. Public Health Rep. Mar 1983;98(2):107-109. [FREE Full text] [Medline]
    7. First MB, Spitzer RL, Gibbon M, Williams JB. The Structured Clinical Interview for DSM-IV Axis I Disorders (SCID-I) and the Structured Clinical Interview for DSM-IV Axis II Disorders (SCID-II). Washington, DC. American Psychiatric Press; 2002.
    8. Sheehan DV, Lecrubier Y, Sheehan KH, Amorim P, Janavs J, Weiller E, et al. The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry. 1998;59 Suppl 20:22-33;quiz 34. [Medline]
    9. Cuijpers P. Prevention: an achievable goal in personalized medicine. Dialogues Clin Neurosci. 2009;11(4):447-454. [FREE Full text] [Medline]
    10. Cuijpers P, Van Straten A, Smit F. Preventing the incidence of new cases of mental disorders: a meta-analytic review. J Nerv Ment Dis. Feb 2005;193(2):119-125. [Medline]
    11. Cuijpers P, van Straten A, Smit F, Mihalopoulos C, Beekman A. Preventing the onset of depressive disorders: a meta-analytic review of psychological interventions. Am J Psychiatry. Oct 2008;165(10):1272-1280. [CrossRef] [Medline]
    12. Stice E, Shaw H, Marti CN. A meta-analytic review of eating disorder prevention programs: encouraging findings. Annu Rev Clin Psychol. 2007;3:207-231. [CrossRef] [Medline]
    13. van Zoonen K, Buntrock C, Ebert DD, Smit F, Reynolds CF3, Beekman AT, et al. Preventing the onset of major depressive disorder: a meta-analytic review of psychological interventions. Int J Epidemiol. Apr 2014;43(2):318-329. [FREE Full text] [CrossRef] [Medline]
    14. Muñoz RF, Cuijpers P, Smit F, Barrera AZ, Leykin Y. Prevention of major depression. Annu Rev Clin Psychol. 2010;6:181-212. [CrossRef] [Medline]
    15. Hayes JF, Maughan DL, Grant-Peterkin H. Interconnected or disconnected? Promotion of mental health and prevention of mental disorder in the digital age. Br J Psychiatry. Mar 2016;208(3):205-207. [CrossRef] [Medline]
    16. Cuijpers P, van Straten A, Warmerdam L, van Rooy MJ. Recruiting participants for interventions to prevent the onset of depressive disorders: possible ways to increase participation rates. BMC Health Serv Res. Jun 2010;10:181. [FREE Full text] [CrossRef] [Medline]
    17. Donker T, Blankers M, Hedman E, Ljótsson B, Petrie K, Christensen H. Economic evaluations of Internet interventions for mental health: a systematic review. Psychol Med. Dec 2015;45(16):3357-3376. [CrossRef] [Medline]
    18. Warmerdam L, Smit F, van Straten A, Riper H, Cuijpers P. Cost-utility and cost-effectiveness of internet-based treatment for adults with depressive symptoms: randomized trial. J Med Internet Res. 2010;12(5):e53. [FREE Full text] [CrossRef] [Medline]
    19. Titov N, Dear BF, Ali S, Zou JB, Lorian CN, Johnston L, et al. Clinical and cost-effectiveness of therapist-guided internet-delivered cognitive behavior therapy for older adults with symptoms of depression: a randomized controlled trial. Behav Ther. Mar 2015;46(2):193-205. [CrossRef] [Medline]
    20. Ybarra ML, Eaton WW. Internet-based mental health interventions. Ment Health Serv Res. Jun 2005;7(2):75-87. [Medline]
    21. Internet Society. URL: http://www.internetsociety.org/sites/default/files/Global_Internet_Report_2014.pdf [accessed 2016-08-03] [WebCite Cache]
    22. Barak A, Klein B, Proudfoot JG. Defining internet-supported therapeutic interventions. Ann Behav Med. Aug 2009;38(1):4-17. [CrossRef] [Medline]
    23. Beintner I, Jacobi C, Taylor CB. Effects of an Internet-based prevention programme for eating disorders in the USA and Germany--a meta-analytic review. Eur Eat Disord Rev. Jan 2012;20(1):1-8. [CrossRef] [Medline]
    24. Schlegl S, Bürger C, Schmidt L, Herbst N, Voderholzer U. The potential of technology-based psychological interventions for anorexia and bulimia nervosa: a systematic review and recommendations for future research. J Med Internet Res. 2015;17(3):e85. [FREE Full text] [CrossRef] [Medline]
    25. Rooke S, Thorsteinsson E, Karpin A, Copeland J, Allsop D. Computer-delivered interventions for alcohol and tobacco use: a meta-analysis. Addiction. Aug 2010;105(8):1381-1390. [CrossRef] [Medline]
    26. Champion KE, Newton NC, Barrett EL, Teesson M. A systematic review of school-based alcohol and other drug prevention programs facilitated by computers or the internet. Drug Alcohol Rev. Mar 2013;32(2):115-123. [CrossRef] [Medline]
    27. Tait RJ, Spijkerman R, Riper H. Internet and computer based interventions for cannabis use: a meta-analysis. Drug Alcohol Depend. Dec 1, 2013;133(2):295-304. [CrossRef] [Medline]
    28. Hustad JT, Barnett NP, Borsari B, Jackson KM. Web-based alcohol prevention for incoming college students: a randomized controlled trial. Addict Behav. Mar 2010;35(3):183-189. [FREE Full text] [CrossRef] [Medline]
    29. Paschall MJ, Antin T, Ringwalt CL, Saltz RF. Evaluation of an Internet-based alcohol misuse prevention course for college freshmen: findings of a randomized multi-campus trial. Am J Prev Med. Sep 2011;41(3):300-308. [FREE Full text] [CrossRef] [Medline]
    30. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gøtzsche PC, Ioannidis JP, et al. The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration. Ann Intern Med. 2009;151(4):W-65-W-94. [FREE Full text] [CrossRef]
    31. Sander L, Rausch L, Baumeister H. Effectiveness of Internet- and mobile-based psychological interventions for the prevention of mental disorders: a systematic review and meta-analysis protocol. Syst Rev. 2016;5:30. [FREE Full text] [CrossRef] [Medline]
    32. First MB, Gibbon M. The Structured Clinical Interview for DSM-IV Axis I Disorders (SCID-I)the Structured Clinical Interview for DSM-IV Axis II Disorders (SCID-II). In: Hilsenroth MJ, Segal DL, Hersen M, editors. Comprehensive Handbook of Psychological Assessment, Volume 2, Personality Assessment. US. John Wiley & Sons Inc; 2004:134-143.
    33. Beck AT, Steer RA, Brown GK. Manual for the Beck Depression Inventory-II. San Antonio, TX. Psychological Corporation; 1996.
    34. Hamilton M. A rating scale for depression. J Neurol Neurosurg Psychiatry. Feb 1960;23:56-62. [FREE Full text] [Medline]
    35. Kampling H, Baumeister H, Jäckel WH, Mittag O. Prevention of depression in chronically physically ill adults. Cochrane Database Syst Rev. Aug 01, 2014;(8):CD011246. [FREE Full text]
    36. Furlan AD, Pennick V, Bombardier C, van Tudler M, Editorial Board‚ Cochrane Back Review Group. 2009 updated method guidelines for systematic reviews in the Cochrane Back Review Group. Spine (Phila Pa 1976). Aug 15, 2009;34(18):1929-1941. [CrossRef] [Medline]
    37. Higgins JP, Thompson SG. Quantifying heterogeneity in a meta-analysis. Stat Med. Jun 15, 2002;21(11):1539-1558. [CrossRef] [Medline]
    38. Sterne JA, Sutton AJ, Ioannidis JP, Terrin N, Jones DR, Lau J, et al. Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials. BMJ. 2011;343:d4002. [Medline]
    39. Jacobi C, Morris L, Beckers C, Bronisch-Holtze J, Winter J, Winzelberg AJ, et al. Maintenance of internet-based prevention: a randomized controlled trial. Int J Eat Disord. Mar 2007;40(2):114-119. [CrossRef] [Medline]
    40. Jacobi C, Völker U, Trockel MT, Taylor CB. Effects of an Internet-based intervention for subthreshold eating disorders: a randomized controlled trial. Behav Res Ther. Feb 2012;50(2):93-99. [CrossRef] [Medline]
    41. Musiat P, Conrod P, Treasure J, Tylee A, Williams C, Schmidt U. Targeted prevention of common mental health disorders in university students: randomised controlled trial of a transdiagnostic trait-focused web-based intervention. PLoS One. 2014;9(4):e93621. [FREE Full text] [CrossRef] [Medline]
    42. Stice E, Durant S, Rohde P, Shaw H. Effects of a prototype Internet dissonance-based eating disorder prevention program at 1- and 2-year follow-up. Health Psychol. Dec 2014;33(12):1558-1567. [CrossRef] [Medline]
    43. Taylor CB, Bryson S, Luce KH, Cunning D, Doyle AC, Abascal LB, et al. Prevention of eating disorders in at-risk college-age women. Arch Gen Psychiatry. Aug 2006;63(8):881-888. [FREE Full text] [CrossRef] [Medline]
    44. Winzelberg AJ, Eppstein D, Eldredge KL, Wilfley D, Dasmahapatra R, Dev P, et al. Effectiveness of an Internet-based program for reducing risk factors for eating disorders. J Consult Clin Psychol. Apr 2000;68(2):346-350. [Medline]
    45. Zabinski MF, Wilfley DE, Calfas KJ, Winzelberg AJ, Taylor CB. An interactive psychoeducational intervention for women at risk of developing an eating disorder. J Consult Clin Psychol. Oct 2004;72(5):914-919. [CrossRef] [Medline]
    46. Bantum EO, Albright CL, White KK, Berenberg JL, Layi G, Ritter PL, et al. Surviving and thriving with cancer using a Web-based health behavior change intervention: randomized controlled trial. J Med Internet Res. 2014;16(2):e54. [FREE Full text] [CrossRef] [Medline]
    47. Beatty L, Koczwara B, Wade T. Evaluating the efficacy of a self-guided Web-based CBT intervention for reducing cancer-distress: a randomised controlled trial. Support Care Cancer. Mar 2016;24(3):1043-1051. [CrossRef] [Medline]
    48. Christensen H, Batterham P, Mackinnon A, Griffiths KM, Kalia HK, Kenardy J, et al. Prevention of generalized anxiety disorder using a web intervention, iChill: randomized controlled trial. J Med Internet Res. 2014;16(9):e199. [FREE Full text] [CrossRef] [Medline]
    49. Imamura K, Kawakami N, Furukawa TA, Matsuyama Y, Shimazu A, Umanodan R, et al. Does Internet-based cognitive behavioral therapy (iCBT) prevent major depressive episode for workers? A 12-month follow-up of a randomized controlled trial. Psychol Med. Jul 2015;45(9):1907-1917. [CrossRef] [Medline]
    50. Mitchell J, Stanimirovic R, Klein B, Vella-Brodrick D. A randomised controlled trial of a self-guided internet intervention promoting well-being. Comput Human Behav. 2009;25(3):749-760. [CrossRef]
    51. Mouthaan J, Sijbrandij M, de Vries G, Reitsma JB, van de Schoot R, Goslings JC, et al. Internet-based early intervention to prevent posttraumatic stress disorder in injury patients: randomized controlled trial. J Med Internet Res. 2013;15(8):e165. [FREE Full text] [CrossRef] [Medline]
    52. Powell J, Hamborg T, Stallard N, Burls A, McSorley J, Bennett K, et al. Effectiveness of a web-based cognitive-behavioral tool to improve mental well-being in the general population: randomized controlled trial. J Med Internet Res. Dec 2012;15(1):e2. [FREE Full text] [CrossRef] [Medline]
    53. Proudfoot J, Clarke J, Birch MR, Whitton AE, Parker G, Manicavasagar V, et al. Impact of a mobile phone and web program on symptom and functional outcomes for people with mild-to-moderate depression, anxiety and stress: a randomised controlled trial. BMC Psychiatry. 2013;13:312. [FREE Full text] [CrossRef] [Medline]
    54. Thompson NJ, Patel AH, Selwa LM, Stoll SC, Begley CE, Johnson EK, et al. Expanding the efficacy of Project UPLIFT: Distance delivery of mindfulness-based depression prevention to people with epilepsy. J Consult Clin Psychol. Apr 2015;83(2):304-313. [FREE Full text] [CrossRef] [Medline]
    55. Christensen H, Batterham PJ, Gosling JA, Ritterband LM, Griffiths KM, Thorndike FP, et al. Effectiveness of an online insomnia program (SHUTi) for prevention of depressive episodes (the GoodNight Study): a randomised controlled trial. The Lancet Psychiatry. Apr 2016;3(4):333-341. [CrossRef]
    56. Thompson NJ, Walker ER, Obolensky N, Winning A, Barmon C, Diiorio C, et al. Distance delivery of mindfulness-based cognitive therapy for depression: project UPLIFT. Epilepsy Behav. Nov 2010;19(3):247-254. [CrossRef] [Medline]
    57. Higgins J, Green S. The Cochrane Collaboration. 2011. URL: http://handbook.cochrane.org/ [accessed 2016-08-03] [WebCite Cache]
    58. Higgins JP, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta-analyses. BMJ. Sep 6, 2003;327(7414):557-560. [FREE Full text] [CrossRef] [Medline]
    59. Kersting A, Dölemeyer R, Steinig J, Walter F, Kroker K, Baust K, et al. Brief Internet-based intervention reduces posttraumatic stress and prolonged grief in parents after the loss of a child during pregnancy: a randomized controlled trial. Psychother Psychosom. 2013;82(6):372-381. [CrossRef] [Medline]
    60. van Ballegooijen W, Riper H, Klein B, Ebert DD, Kramer J, Meulenbeek P, et al. An Internet-based guided self-help intervention for panic symptoms: randomized controlled trial. J Med Internet Res. 2013;15(7):e154. [FREE Full text] [CrossRef] [Medline]
    61. Buntrock C, Ebert DD, Lehr D, Cuijpers P, Riper H, Smit F, et al. Evaluating the efficacy and cost-effectiveness of web-based indicated prevention of major depression: design of a randomised controlled trial. BMC Psychiatry. 2014;14:25. [FREE Full text] [CrossRef] [Medline]
    62. Almeida OP, MacLeod C, Ford A, Grafton B, Hirani V, Glance D, et al. Cognitive bias modification to prevent depression (COPE): study protocol for a randomised controlled trial. Trials. 2014;15:282. [FREE Full text] [CrossRef] [Medline]
    63. Jones BA, Griffiths KM, Christensen H, Ellwood D, Bennett K, Bennett A. Online cognitive behaviour training for the prevention of postnatal depression in at-risk mothers: a randomised controlled trial protocol. BMC Psychiatry. 2013;13:265. [FREE Full text] [CrossRef] [Medline]
    64. Klein JP, Berger T, Schröder J, Späth C, Meyer B, Caspar F, et al. The EVIDENT-trial: protocol and rationale of a multicenter randomized controlled trial testing the effectiveness of an online-based psychological intervention. BMC Psychiatry. 2013;13:239. [FREE Full text] [CrossRef] [Medline]
    65. Freedman SA, Dayan E, Kimelman YB, Weissman H, Eitan R. Early intervention for preventing posttraumatic stress disorder: an Internet-based virtual reality treatment. Eur J Psychotraumatol. 2015;6:25608. [FREE Full text] [Medline]
    66. Calear A, Christensen H. Review of internet-based prevention and treatment programs for anxiety and depression in children and adolescents. Med J Aust. Jun 7, 2010;192(11 Suppl):S12-S14. [Medline]
    67. Melville KM, Casey LM, Kavanagh DJ. Dropout from Internet-based treatment for psychological disorders. Br J Clin Psychol. Nov 2010;49(Pt 4):455-471. [CrossRef] [Medline]
    68. van Ballegooijen W, Cuijpers P, van Straten A, Karyotaki E, Andersson G, Smit JH, et al. Adherence to Internet-based and face-to-face cognitive behavioural therapy for depression: a meta-analysis. PLoS One. 2014;9(7):e100674. [FREE Full text] [CrossRef] [Medline]
    69. Hilvert-Bruce Z, Rossouw PJ, Wong N, Sunderland M, Andrews G. Adherence as a determinant of effectiveness of internet cognitive behavioural therapy for anxiety and depressive disorders. Behav Res Ther. Aug 2012;50(7-8):463-468. [CrossRef] [Medline]
    70. Clarke G, Kelleher C, Hornbrook M, Debar L, Dickerson J, Gullion C. Randomized effectiveness trial of an Internet, pure self-help, cognitive behavioral intervention for depressive symptoms in young adults. Cogn Behav Ther. 2009;38(4):222-234. [FREE Full text] [CrossRef] [Medline]
    71. Dickersin K. The existence of publication bias and risk factors for its occurrence. JAMA. Mar 9, 1990;263(10):1385-1389. [Medline]
    72. Wright RW, Brand RA, Dunn W, Spindler KP. How to write a systematic review. Clin Orthop Relat Res. Feb 2007;455:23-29. [CrossRef] [Medline]
    73. Bolier L, Haverman M, Kramer J, Westerhof GJ, Riper H, Walburg JA, et al. An Internet-based intervention to promote mental fitness for mildly depressed adults: randomized controlled trial. J Med Internet Res. 2013;15(9):e200. [FREE Full text] [CrossRef] [Medline]
    74. Eisma MC, Boelen PA, van den Bout J, Stroebe W, Schut HA, Lancee J, et al. Internet-Based Exposure and Behavioral Activation for Complicated Grief and Rumination: A Randomized Controlled Trial. Behav Ther. Nov 2015;46(6):729-748. [CrossRef] [Medline]
    75. Drozd F, Skeie LG, Kraft P, Kvale D. A web-based intervention trial for depressive symptoms and subjective well-being in patients with chronic HIV infection. AIDS Care. 2014;26(9):1080-1089. [CrossRef] [Medline]
    76. van der Houwen K, Schut H, van den Bout J, Stroebe M, Stroebe W. The efficacy of a brief internet-based self-help intervention for the bereaved. Behav Res Ther. May 2010;48(5):359-367. [CrossRef] [Medline]
    77. Stafford E, Hides L, Kavanagh DJ. The acceptability, usability and short-term outcomes of Get Real: A web-based program for psychotic-like experiences (PLEs). Internet Interventions. Sep 2015;2(3):266-271. [CrossRef]
    78. Fichter MM, Quadflieg N, Nisslmüller K, Lindner S, Osen B, Huber T, et al. Does internet-based prevention reduce the risk of relapse for anorexia nervosa? Behav Res Ther. Mar 2012;50(3):180-190. [CrossRef] [Medline]
    79. Holländare F, Johnsson S, Randestad M, Tillfors M, Carlbring P, Andersson G, et al. Randomized trial of Internet-based relapse prevention for partially remitted depression. Acta Psychiatr Scand. Oct 2011;124(4):285-294. [CrossRef] [Medline]
    80. Baumeister H, Reichler L, Munzinger M, Lin J. The impact of guidance on Internet-based mental health interventions — A systematic review. Internet Interv. 2014;1(4):205-215. [CrossRef]

    ‎
    CBT: cognitive behavioral therapy
    CENTRAL: Cochrane Central Register of Controlled Trials
    CG: control group
    ED: eating disorder
    GAD: generalized anxiety disorder
    ICTRP: International Clinical Trials Registry Platform
    IG: intervention group
    IMI: Internet- and mobile-based intervention
    IT: Information technology
    IRR: incidence rate ratio
    MD: mean difference
    MeSH: Medical Subject Heading
    NNT: number needed to be treated
    PRISMA: Preferred Reporting Items for Systematic Reviews and Meta-Analyses
    PTSD: post-traumatic stress disorder
    RCT: randomized controlled trial
    SCID: structured clinical interview for DSM disorders

    Edited by J Prescott; submitted 01.06.16; peer-reviewed by M Brown; accepted 22.06.16; published 17.08.16.

    Copyright

    ©Lasse Sander, Leonie Rausch, Harald Baumeister. Originally published in JMIR Mental Health (http://mental.jmir.org), 17.08.2016.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Mental Health, is properly cited. The complete bibliographic information, a link to the original publication on http://mental.jmir.org/, as well as this copyright and license information must be included.