This paper is in the following e-collection/theme issue:

Mobile Health in Psychiatry (399) Reviews in Digital Mental Health (225) Web-based and Mobile Health Interventions (3093) Anxiety and Stress Disorders (1002) Depression and Mood Disorders; Suicide Prevention (1272) Mobile Health (mhealth) (2748) e-Mental Health and Cyberpsychology (1387) mHealth for Wellness, Behavior Change and Prevention (2729) Quality Evaluation and Descriptive Analysis/Reviews of Multiple Existing Mobile Apps (362)

Published on in Vol 9, No 9 (2022): September

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/39454, first published .
Effectiveness and Minimum Effective Dose of App-Based Mobile Health Interventions for Anxiety and Depression Symptom Reduction: Systematic Review and Meta-Analysis

Effectiveness and Minimum Effective Dose of App-Based Mobile Health Interventions for Anxiety and Depression Symptom Reduction: Systematic Review and Meta-Analysis

Effectiveness and Minimum Effective Dose of App-Based Mobile Health Interventions for Anxiety and Depression Symptom Reduction: Systematic Review and Meta-Analysis

Authors of this article:

Sheng-Chieh Lu1 Author Orcid Image ;   Mindy Xu2 Author Orcid Image ;   Mei Wang3 Author Orcid Image ;   Angela Hardi4 Author Orcid Image ;   Abby L Cheng3, 5 Author Orcid Image ;   Su-Hsin Chang3 Author Orcid Image ;   Po-Yin Yen6, 7 Author Orcid Image
Article Authors Cited by (8) Tweetations (6) Metrics

    Review

    1Department of Symptom Research, University of Texas MD Anderson Cancer Center, Houston, TX, United States

    2Keck School of Medicine, University of Southern California, Los Angeles, CA, United States

    3Division of Public Health Sciences, Department of Surgery, Washington University in St Louis, St Louis, MO, United States

    4Becker Medical Library, Washington University in St Louis, St Louis, MO, United States

    5Division of Physical Medicine and Rehabilitation, Department of Orthopaedic Surgery, Washington University in St Louis, St Louis, MO, United States

    6Institute for Informatics, Washington University in St Louis, St Louis, MO, United States

    7Goldfarb School of Nursing, Barnes Jewish College, BJC HealthCare, St Louis, MO, United States

    Corresponding Author:

    Sheng-Chieh Lu, PhD

    Department of Symptom Research

    University of Texas MD Anderson Cancer Center

    6565 MD Anderson Blvd

    Houston, TX, 77030

    United States

    Phone: 1 7137944453

    Fax:1 7137453475

    Email: Slu4@mdanderson.org


    Background: Mobile health (mHealth) apps offer new opportunities to deliver psychological treatments for mental illness in an accessible, private format. The results of several previous systematic reviews support the use of app-based mHealth interventions for anxiety and depression symptom management. However, it remains unclear how much or how long the minimum treatment “dose” is for an mHealth intervention to be effective. Just-in-time adaptive intervention (JITAI) has been introduced in the mHealth domain to facilitate behavior changes and is positioned to guide the design of mHealth interventions with enhanced adherence and effectiveness.

    Objective: Inspired by the JITAI framework, we conducted a systematic review and meta-analysis to evaluate the dose effectiveness of app-based mHealth interventions for anxiety and depression symptom reduction.

    Methods: We conducted a literature search on 7 databases (ie, Ovid MEDLINE, Embase, PsycInfo, Scopus, Cochrane Library (eg, CENTRAL), ScienceDirect, and ClinicalTrials, for publications from January 2012 to April 2020. We included randomized controlled trials (RCTs) evaluating app-based mHealth interventions for anxiety and depression. The study selection and data extraction process followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. We estimated the pooled effect size using Hedge g and appraised study quality using the revised Cochrane risk-of-bias tool for RCTs.

    Results: We included 15 studies involving 2627 participants for 18 app-based mHealth interventions. Participants in the intervention groups showed a significant effect on anxiety (Hedge g=–.10, 95% CI –0.14 to –0.06, I2=0%) but not on depression (Hedge g=–.08, 95% CI –0.23 to 0.07, I2=4%). Interventions of at least 7 weeks’ duration had larger effect sizes on anxiety symptom reduction.

    Conclusions: There is inconclusive evidence for clinical use of app-based mHealth interventions for anxiety and depression at the current stage due to the small to nonsignificant effects of the interventions and study quality concerns. The recommended dose of mHealth interventions and the sustainability of intervention effectiveness remain unclear and require further investigation.

    JMIR Ment Health 2022;9(9):e39454

    doi:10.2196/39454

    Keywords

    mental health; mobile health; smartphone apps; intervention dose effectiveness; systematic review and meta-analysis 


    More than 250 million people worldwide have depression or anxiety, which are the 2 most common mental illnesses that contribute to the global burden of disease [1]. The recent coronavirus disease pandemic has further increased the numbers of people reporting symptoms of anxiety and depression [2]. Both psychological and pharmacological therapies have been reported to effectively reduce the symptoms of mental illness. Yet, depression and anxiety disorders are notably undertreated due to a variety of barriers, such as lack of access to treatments and reluctance to get treatments because of social stigma and unawareness of symptoms [3]. The ongoing pandemic resulting in restrictions on social and physical distancing has posed additional challenges to these individuals, worsening undertreatment [2].

    Mobile health (mHealth) apps leverage the ubiquity of mobile devices and the mobile-cellular telecommunication infrastructure and offer new opportunities to deliver psychological treatments for mental illness in an accessible, private format [4]. As the affordability and accessibility of smartphones are increasing, mobile apps are becoming the main component of many interventions promoting mental wellness and thus could be an exceptional tool to support mental health care delivery [5,6]. Research effort has been made to develop and examine mobile app-based interventions to improve patient engagement in symptom management and reduce mental illness symptoms. For instance, several smartphone apps are available for delivering self-directed cognitive behavioral therapy (CBT) for those with depression [7]. Other psychotherapies that are feasible to be facilitated by apps include acceptance and commitment therapy (ACT), problem-solving therapy (PST), and psychoeducation [8,9].

    Several previous systematic reviews and meta-analyses have supported the use of app-based mHealth interventions for anxiety and depression symptom management. Firth et al [10,11] have reported a small-to-moderate effect size for both anxiety and depression symptom reduction following interventions delivered fully or partially by smartphone compared to control groups (anxiety: Hedge g=.33, 95% CI 0.17-0.48, P<.01; depression: Hedge g=.38, 95% CI 0.24-0.52, P<.001). Another recent systematic review reported similar results supporting the use of stand-alone smartphone apps for depression (Hedge g=.34, 95% CI 0.18-0.49, P<.001) and anxiety (Hedge g=.43, 95% CI 0.19-0.66, P≤.001) symptom reduction [12] Nevertheless, although previous studies have examined intervention features and components to identify the most effective design for app-based mHealth interventions [10,12], due to the various study lengths (ie, 4 weeks, 6 weeks, 3 months, 6 months), it remains unclear how much or how long the minimum treatment “dose” is for an mHealth intervention to be effective.

    Just-in-time adaptive intervention (JITAI) has been introduced in the mHealth domain to facilitate behavior changes; it proposes the use of ongoing information (individuals’ changing status) to adapt the delivery of the intervention in its type, timing, or amount (intensity) [13]. The goal of JITAI is to increase an individual’s acceptance of the intervention as the intervention is delivered “at the moment and in the context that the person needs it most and is most likely to be receptive” [14]. Smartphones are an ideal platform to deliver JITAIs because individuals’ responses and their location can reveal whether the intervention is delivered and received at its maximum capacity. JITAI has been used to support health behaviors changes, such as physical activity [15,16], healthy diet [17,18], weight loss [19], and addiction [20-22]. A recent meta-analysis of 31 JITAI studies found significant effects of JITAI on improving health outcomes and enhancing study retention and intervention adherence [13,23,24]. JITAI emphasizes intervention tailoring to meet individual needs to achieve the best outcomes; thus, JITAI strategies regarding intervention dose (ie, type, amount, and timing of delivery) are positioned to guide the design of mHealth interventions with enhanced adherence and effectiveness.

    In this study, our primary goal was to evaluate and update the evidence of app-based mHealth interventions for anxiety and depression symptom reduction through a systematic review and meta-analysis. In addition, inspired by the JITAI framework, we examined the effective mHealth dose for anxiety and depression symptoms where information was available. In other words, what is the minimum amount of usage or exposure to an mHealth app to effectively reduce anxiety and depression symptoms? To the best of our knowledge, this is the first systematic review and meta-analysis to examine the effectiveness of mHealth in anxiety and depression from a dose perspective.


    Design

    We conducted this systematic review and meta-analysis and reported the results following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines [25].

    Search Strategy

    We searched the published literature using keywords and strategies designed by the team with the assistance of a medical librarian. These strategies were created using a combination of controlled vocabulary terms and plain keywords (Multimedia Appendix 1). Databases that were searched were Ovid MEDLINE, Embase, PsycInfo, Scopus, Cochrane Library (eg, CENTRAL), ScienceDirect, and ClinicalTrials. We limited the search to studies published from January 2012 to April 2020. All searches were completed on April 30, 2020.

    Study Selection

    Studies were included if they (1) evaluated an app-based mHealth intervention designed to treat anxiety or depression or both, (2) measured symptoms of anxiety or depression, (3) were published as original research/trials in peer-reviewed journals, and (4) were written in English. We included studies that examined interventions delivered in part via mobile apps (ie, smartphone + regular phone call). We excluded studies if they (1) evaluated interventions not delivered in real-world settings (eg, only delivered within a laboratory or clinical setting), (2) evaluated interventions not delivered through a hand-held/mobile device, (3) only measured intervention usability or adherence but not the intervention effect on anxiety or depression symptoms or outcomes, (4) only measured physical stress responses but not any psychological anxiety-related symptoms, (5) did not include a control group and an experimental/comparison group with a random allocation process, or (6) used a quasi-experimental or other study design without a random allocation process.

    Quality Appraisal

    We used the revised Cochrane risk-of-bias tool for randomized trials (RoB 2) [26] to assess each included study in 5 domains: (1) risk of bias arising from the randomization process, (2) risk of bias due to deviations from the intended interventions (effect of assignment to intervention), (3) risk of bias due to missing outcome data, (4) risk of bias in outcome measurement, and (5) risk of bias in selection of the reported result. The assessor rated each domain as “low risk of bias,” “some concerns,” or “high risk of bias,” which constituted an overall risk-of-bias judgment for the study. Every included study was assessed by at least 2 assessors; any discrepancies were resolved through a consensus discussion during our team meeting.

    Data Extraction

    We developed a Microsoft Excel spreadsheet to facilitate systematic data extraction through iterative discussions. We extracted the following data from the included studies: study details (authors, journal, year of publication, study purposes), study design (sample size, participant eligibility criteria, control type), interventions (theoretical foundations and app components), and outcomes, including data for calculating the effect size at study endpoints and follow-ups. In addition, we obtained intervention dose design information, if available, including frequency, duration, length, and timing of delivery, to examine the minimum effective intervention dose. For outcomes, we extracted primary outcomes relevant to anxiety and depression from the included studies. If a study did not indicate the primary outcome or had multiple primary outcome measures, we used data from the most used clinically validated instruments (ie, the State-Trait Anxiety Inventory [STAI] for anxiety and the Patient Health Questionnaire-9 [PHQ-9] for depression).

    Data Synthesis

    To pool the effect size of the interventions for each of the depression and anxiety measurements from the included studies with various measures, we computed Hedge g by taking the difference in the mean scores (1) between the intervention and control groups at each reported time point (between-group comparison) as well as (2) between the different time points following the interventions and the preintervention (ie, baseline) for the intervention groups (pre-post comparison). These time points included any reported time points during the interventions and during the follow-up after the conclusion of the interventions. For each comparison, we pooled and analyzed these Hedge g values for the target time point using both random-effect and fixed-effect models. The between-group and pre-post comparisons were also analyzed at the conclusion of the designed study intervention for depression and anxiety, respectively. Further, we used line graphs to visualize the pooled Hedge g values by time point, including follow-ups, to facilitate the analyses of dose-dependent effects and substantiality of the interventions.

    We evaluated heterogeneity between studies using I2, which measures the percentage of total variance that can be explained. Study heterogeneity is considered low when I2<25%, moderate when I2 ranges from 25%-75%, and high when I2>75% [27]. We also visually and statistically evaluated publication bias using funnel plots and the Egger test [28]. The pooled effect accounting for missing studies was assessed using the Duval and Tweedie trim-and-fill analysis [29]. In addition, we conducted subanalyses to compare the effect sizes generated from studies that targeted both depression and anxiety symptom reduction by pooling and analyzing Hedge g values at the end of the study.


    Study Selection and Characteristics

    Our search strategy yielded a total of 9837 citations from the 7 databases, including ClinicalTrials. After removing duplicates, we screened 3921 (39.9%) abstracts and excluded 3467 (88.4%) citations that did not meet our inclusion criteria. We then reviewed 454 (11.6%) full-text articles and further excluded 436 (96%) studies based on our exclusion criteria (Figure 1). Of the remaining 18 (4%) studies, 15 (83%) were included in the meta-analysis; 3 (17%) studies did not report the data for meta-analysis [30-44].

    ‎
    Figure 1. PRISMA flowchart for study selection. PRISMA: Preferred Reporting Items for Systematic Reviews and Meta-Analyses.
    View this figure

    We summarize the characteristics, interventions, and primary outcomes of the studies included in our meta-analysis (N=15) in Tables 1 and 2. A total of 1942 participants were included in the 15 studies. These studies were conducted in the United States (n=4, 26%) [32,34,38,40], Germany (n=2, 13%) [36,39], Sweden (n=2, 13%) [31,43], Australia (n=1, 7%) [35], Japan (n=1, 7%) [37], Korea (n=1, 7%) [44], Switzerland (n=1, 7%) [41], Taiwan (n=1, 7%) [42], and the United Kingdom (n=1, 7%) [33]; in addition, 1 (7%) study recruited participants worldwide (the total percentage is more than 100% due to rounding) [30].

    The most frequently targeted population was adults (age≥18 years) self-reporting anxiety or depression symptoms (n=6, 40%) [30,34,36,38,40,41]. Other examined populations included university students (n=2, 13%) [33,39]. Australian indigenous youth (n=1, 7%) [35], and people with a diagnosis of cancer (n=2, 13%) [32,44], social anxiety disorder (n=1, 7%) [31], major depressive disorder (n=2, 13%) [37,43], and general anxiety disorder (GAD; n=1, 7%) [31].

    A total of 18 mobile apps were examined in the studies, with 8 (44%) targeting depression symptom management, 4 (22%) targeting anxiety reduction, and 6 (34%) targeting both anxiety and depression (Table 2). The majority of the mHealth apps facilitated various CBTs (n=12, 67%) [31-33,35-39,41-44]. Other therapies included ACT (n=1, 6%) [35], mindfulness and breathing relaxation techniques (n=1, 6%) [30], self-esteem and acceptance of the present (n=1, 6%) [40], and attentional bias modification (n=1, 6%) [42]. The length of intervention ranged from 4 to 12 weeks, with 4 weeks being the most commonly used length (n=5, 28%) [30,33,36,40,42]. Most apps were designed to be used on a daily basis.

    Various instruments were used as primary outcome measurements. For depression, most studies used the Beck Depression Inventory-II (BDI-II) as their primary outcome measure (n=5, 33%) [38,41-44]. Other depression assessment tools included the PHQ-9 (n=4, 27%) [34-37] and the Center for Epidemiologic Studies Depression Scale (CES-D; n=2, 13%) [39,40]. There were no common anxiety assessment tools across the studies. There were a total of 8 different measurements used in the studies, including the STAI (n=2, 13%) [42,44], the 6-item short-form of the STAI (n=2, 13%) [33,39], GAD-7 (n=1, 7%) [30], the Hamilton Anxiety Rating Scale (HAM-A; n=1, 7%) [32], the Beck Anxiety Inventory (BAI; n=1, 7%) [43], the Liebowitz Social Anxiety Scale-Self Report (LSAS-SR; n=1, 7%) [31], and the Social Interaction Anxiety Scale (SIAS; n=1, 7%) [41].

    Table 1. Characteristics of the included studies (N=15).
    Author (year), countryStudy populations/eligibility criteriaSample sizeAge (years), mean (SD)Assessment time pointsOutcome measures



    		Intervention, nControl, n


    Anxiety

    		Pham (2016), globalAnxiety Sensitivity Index (ASI)-3≥16, Overall Anxiety Severity and Impairment Scale (OASIS)≥8, GAD-7a≥631Waitlist: 3218-34 (51)Baseline, week 2, week 4 end point (EP)GAD-7, ASI, OASIS

    		Boettcher (2018), SwedenDiagnosis of social anxiety disorder (SAD), LSAS-SRb≥3070Bibliotherapy: 70; waitlist: 69Intervention group (Txt): 35.4 (11.0); bibliotherapy: 35.9 (14.1); control group (Ctrl): 35.0 (11.6)Baseline, week 3, week 7 (EP), follow-up (FU) week 3, FU week 7, FU week 9, FU week 41LSAS-SR, PHQc-9, GAD-7

    		Greer (2019), United StatesdAge≥18 years, diagnosis of incurable solid tumor, Hospital Anxiety and Depression Scale (HADS) anxiety subscale>7, Eastern Cooperative Oncology Group (ECOG)=0-272Education control: 73Txt: 55.9 (12.4); Ctrl: 57.0 (10.1)Baseline, week 12 (EP)HAM-Ae, HADS, PHQ-9

    		Ponzo (2020), United KingdomdUniversity students, Depression Anxiety Stress Scales (DASS)-21 stress subscale>14 or DASS-21 anxiety subscale>772Waitlist: 74Txt: 19.9 (1.83); Ctrl: 19.8 (1.8)Baseline, week 2, week 4 (EP), FU week 2STAIf-S-6, PHQ-9, DASS-21
    Depression

    		Stile-Shields (2019), United StatesdAge≥18 years, PHQ-9>10, Quick Inventory of Depressive Symptoms (QIDS)>11Boost me=10; thought challenger=10Waitlist: 10N/RgBaseline, week 3, week 6 (EP), FU week 4PHQ-9

    		Tighe (2017), AustraliaAustralian indigenous youth (age 18-35 years), PHQ-9>10 or 10-item Kessler Psychological Distress Scale (K10)>2531Waitlist: 30Txt: 27.5 (9.5); Ctrl: 25.0 (6.3)Baseline, week 6 (EP)PHQ-9

    		Ludtke (2018), GermanySubjective need for a depression symptom reduction intervention44Waitlist: 44Txt: 41.2 (11.9); Ctrl: 44.6 (10.7)Baseline, week 4 (EP)PHQ-9

    		Mantani (2017), JapanAge 25-59 years, diagnosis of major depressive disorder, BDIh-II≥10, currently taking and resistant to 1 antidepressant81Medication change only: 83Txt: 40.2 (8.8); Ctrl: 41.6 (8.9)Baseline, week 5, week 9 (EP), FU week 8PHQ-9, BDI-II

    		Dahne (2019), United StatesdAge 18-65 years, PHQ-8>10Moodivate: 24; MoodKit: 19Treatment as usual (TAU): 9Moodivate: 43.8 (13.3); MoodKit: 44.7 (14.0); Ctrl: 43.1 (11.9)Week 2, week 3, week 4, week 5, week 6, week 7, week 8 (EP)BDI-II
    Both anxiety and depression

    		Harrer (2018), GermanyUniversity students, perceived stress posttreatment (PSS)-4≥875Waitlist: 75Txt: 24.0 (4.6); Ctrl: 24.2 (3.6)Baseline, week 7 (EP), FU week 5STAI-6, CES-Di

    		Roepke (2015), United StatesAge≥18 years, CES-D≥16General SB: 97; CBTj/positive psychotherapy SuperBetter (PPT SB): 93Waitlist: 93CBT/PPT SB: 42.3 (12.6); general SB: 38.0 (11.3); Ctrl: 40.3 (13.1)Baseline, week 2, week 4 (EP), FU week 2CES-D, GAD-7

    		Stolz (2018), SwitzerlandAge≥18 years, ≥cut-off score on SIASk or Social Phobia Scale (SPS), Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition (DSM-IV) diagnosis of SAD60Waitlist: 30Txt: 34.7 (9.9); Ctrl: 35.2 (12.1)Baseline, week 12 (EP), FU week 12SIAS, LSAS-SR, BDI-II

    		Teng (2019), TaiwanAge 25-35 years, PSWQ>60, DMS-IV diagnosis of GAD subscale30Placebo: 30; waitlist: 22Txt: 21.5 (2.2); placebo: 21.5 (1.6); waitlist: 21.5 (1.6)Baseline, week 2, week 3, week 4 (EP), FU week 4STAI-S, STAI-T, BDI-II, BAIl

    		Ly (2015), SwedenAge≥18 years, PHQ-9≥5, DMS-IV diagnosis of major depression46Face-to-face behavior activation therapy: 47Txt: 30.2 (11.9); Ctrl: 31.0 (11.0)Baseline, week 9 (EP), FU week 24BDI-II, PHQ-9, BAI

    		Ham (2019), KoreadAge 16-65 years, diagnosis of cancer, BDI-II≥16 or STAI>3928Waitlist: 26; attention control: 26Txt: 41.9 (11.3); attention control: 43.5 (10.4); waitlist control: 47.1 (11.2)Baseline, week 10 (EP)BDI-II, STAI-T, STAI-S

    aGAD-7: Generalized Anxiety Disorder-7.

    bLSAS-SR: Liebowitz Social Anxiety Scale-Self Report.

    cPHQ: Patient Health Questionnaire.

    dStudies were not included in the previous meta-analyses we identified.

    eHAM-A: Hamilton Anxiety Rating Scale.

    fSTAI: State-Trait Anxiety Inventory.

    gN/R: not reported.

    hBDI: Beck Depression Inventory.

    iCES-D: Center for Epidemiological Studies Depression Scale.

    jCBT: cognitive behavioral therapy.

    kSIAS: Social Interaction Anxiety Scale.

    lBAI: Beck Anxiety Inventory.

    Table 2. Intervention characteristics of the included studies (N=15).
    Author (year), countryApp contentsIntended doseLengthAdditional components
    Anxiety

    		Pham (2016), global
    • Flowy app: minigames for breathing retraining with reward feedback
      • ‎
    		N/Ra4 weeksN/Ab

    		Boettcher (2018), Sweden
    • CBTc with gamification and life skill challenges
      • ‎
    		Daily use6 weeksInternet-based CBT with 9 modules

    		Greer (2019), United Statesd
    • CBT with psychoeducation, activity planning, problem solving, staying present, thought creation, and summary/review
      • ‎
    		6 sessions (20-30 minutes each) with homework (10 -15 minutes each)10-12 weeksN/A

    		Ponzo (2020), United Kingdomd
    • BioBase: CBT and self-compassion-based psychoeducational content, mood tracking, and relaxation exercises
      • ‎
    		Daily use4 weeks“Biobeam” wristband for passive data collection (physical activity, sleep pattern, and heart rate)
    Depression

    		Stile-Shields (2019), United Statesd
    • Boost Me: behavioral activation (BA) with activity scheduling, aiming to increase rewarding activities and monitoring of mood
      • ‎
    • Thought Challenger: CBT involving identifying and apprising maladaptive thoughts and creating adaptive counter thoughts
      • ‎
    		N/R6 weeksWeekly coaching via phone or email to enhance intervention adherence

    		Tighe (2017), Australia
    • iBobbly: ACTe with identifying thoughts, feelings, and behaviors; learning distancing techniques; regulating emotions through mindfulness, acceptance, and self-soothing activities; and identifying values, goals, personalized action plans
      • ‎
    		N/R6 weeksN/A

    		Ludtke (2018), Germany
    • Good to Yourself: CBT with cognitive strategies, mindfulness, social competence skills, activating exercises
      • ‎
    		A few minutes per day4 weeksN/A

    		Mantani (2017), Japan
    • Kokoro: CBT, mood monitoring, BA, and homework
      • ‎
    		1 session/week with 20 minutes/session (not including homework)8 weeksAntidepressant switch to escitalopram (5-10 mg/day) or to sertraline (25-100 mg/day)

    		Dahne (2019), United Statesd
    • Moodivate: BA (psychoeducation, value identification, activity planning based on values, completion badges)
      • ‎
    • MoodKit: CBT (thought identification/modification, mood tracking, journaling, activity scheduling)
      • ‎
    		At least once per day8 weeksN/A
    Both anxiety and depression

    		Harrer (2018), Germany
    • CBT with social support, rumination, time management, procrastination, text anxiety, sleep, motivation, nutrition, exercise, mood diary, motivational messages, and online eCoach
      • ‎
    		30-90 minutes/module with 1-2 modules/week for 8 modules total7 weeksN/A

    		Roepke (2015), United States
    • SuperBetter: gamified app to increase drive to accomplish goals and build social support
      • ‎
    • SuperBetter“ version with CBT/positive psychotherapy (PPT): same app with additional CBT content adapted from PPT and 2 classic CBT (cognitive restructuring and behavioral activation)
      • ‎
    		10 minutes/day4 weeksN/A

    		Stolz (2018), Switzerland
    • CBT with motivational enhancement, psychoeducation, cognitive restructuring, self-focused attention, behavioral experiments, summary and repetition, healthy lifestyle and problem solving, and relapse prevention
      • ‎
    		1 module/week12 weeksWeekly feedback from a coach

    		Teng (2019), Taiwand
    • Home-delivered attentional bias modification (HD-ABM): administers attention training for which disgusted and neutral facial expressions are used as stimuli; target “probe” replacing only the neutral face
      • ‎
    		3 times/day4 weeksN/A

    		Ly (2015), Sweden
    • CBT with recall (statistics and summaries) and save important nondepressed behavior, a behavior activity database for providing suggestions, support, and inspiration; a bake-end system for therapists monitoring participants\' activities; and a messaging system for communication between participants and therapists
      • ‎
    		N/R9 weeksFace-to-face behavior activation therapy

    		Ham (2019), Koread
    • HARUToday: CBT with psychoeducation, BA, relaxation training, cognitive restructuring, problem solving, and point reward system
      • ‎
    		10-15 minutes/session with a quiz for 48 sessions10 weeksN/A

    aN/R: not reported.

    bN/A: not applicable.

    cCBT: cognitive behavioral therapy.

    dStudies were not included in the previous meta-analyses we identified.

    eACT: acceptance and commitment therapy

    Risk-of-Bias Assessment

    Most studies (n=10, 67%) [30-32,34-36,38,39,41,42] were rated as “some concerns” for bias, and 3 (20%) [33,40,44] were rated as “high risk of bias” (Figure 2). All studies reported adequate randomization sequence generation and allocation concealment. In addition, 3 (20%) studies [33,42,44] reported unclear information concerning their approaches adjusting the effects of intervention nonadherence on outcomes, and 2 (13%) studies had a high attrition rate and provided no information about their approaches addressing missing data. Blinding of outcome assessment was not possible for most included studies due to the use of self-reported outcome assessments; thus, the results of most studies (n=13, 87%) [30-34,36-41,43,44], although unlikely, may be influenced by the awareness of the intervention received. Concerning outcome reporting, we found no evidence to suspect selective reporting for all studies. There was no evidence of publication bias according to the funnel plots and Egger test (Multimedia Appendix 2).

    ‎
    Figure 2. Diagram summarizing the result of our risk-of-bias evaluation among the 15 included studies using the Cochrane risk-of-bias tool for RCTs. RCT: randomized control trial.
    View this figure

    Effectiveness of mHealth Apps in Anxiety and Depression

    Of the included 15 studies, 10 (67%) [30-33,40-42] examined the effectiveness of app-based mHealth interventions in anxiety management. When compared to the preintervention, at the conclusion of the interventions, participants receiving the interventions showed a statistically significant effect on anxiety symptoms (Hedge g=–.20, 95% CI –0.31 to –0.09, heterogeneity I2=0%, P=.79); see Figure 3a. Similarly, when compared to the control groups, at the conclusion of the interventions, participants receiving the interventions showed a statistically significant effect on anxiety symptoms (Hedge g=–.10, 95% CI –0.14 to –0.05, heterogeneity I2=0%, P>.99); see Figure 3b.

    Of the included 15 studies, 11 (73%) [32-36,39-44] evaluated the effectiveness of app-based mHealth interventions in depression management. When compared to the preintervention, at the conclusion of the interventions, participants receiving the interventions showed a statistically significant effect on depression symptoms (Hedge g=–.25, 95% CI –0.39 to –0.11, heterogeneity I2=3%, P=.42); see Figure 4a. However, when compared to the control groups, at the conclusion of the interventions, participants receiving the interventions did not show a statistically significant effect on depression symptoms (Hedge g=–.08, 95% CI –0.23 to 0.07, heterogeneity I2=4%, P=.41); see Figure 4b.

    ‎
    Figure 3. Pooled effect size of mHealth apps on anxiety symptom management at the conclusion of the intervention: (a) before-after comparison for the intervention groups and (b) comparison between intervention and control groups. BAI: Beck Anxiety Inventory; CBT: cognitive behavioral therapy; GAD: generalized anxiety disorder; HAM-A: Hamilton Anxiety Rating Scale; HD-ABM: home-delivered attentional bias modification; LSAS-SR: Liebowitz Social Anxiety Scale-Self Report; mHealth: mobile health; PPT: positive psychotherapy; STAI: State-Trait Anxiety Inventory; WL: waitlist.
    View this figure
    ‎
    Figure 4. Pooled between-group effectiveness of mHealth apps on depressive symptom management: (a) before-after comparison for the intervention groups and (b) comparison between intervention and control groups. BDI: Beck Anxiety Inventory; CBT: cognitive behavioral therapy; CES-D: Center for Epidemiological Studies Depression questionnaire; HD-ABM: home-delivered attentional bias modification; mHealth: mobile health; PHQ: Patient Health Questionnaire; PPT: positive psychotherapy; TAU: treatment-as-usual; WL: waitlist.
    View this figure

    Effects of mHealth Interventions on Depression vs Anxiety

    Our subgroup analysis included 8 (53%) studies [31,32,39-44] evaluating the effectiveness of their interventions in both depression and anxiety. The results indicated that the intervention groups showed a significant effect on both anxiety (Hedge g=–.23, 95% CI –0.36 to –0.10, heterogeneity I2=0%, P>.99) and depression (Hedge g=–.22, 95% CI –0.39 to –0.06, heterogeneity I2=15%, P=.31) compared to baseline (Figures 5a and 5b). However, compared to the control groups (waiting list), mHealth interventions showed a significant effect only on anxiety at the conclusion of the interventions (Figure 5c) but not on depression (Figure 5d). This shows that mHealth interventions are more likely to improve anxiety but not depression.

    ‎
    Figure 5. Subanalysis of pooled within-group and between-group effects of mHealth interventions on anxiety (upper panel) and depression (lower panel) from studies evaluating intervention effects on both anxiety and depression (n=8): (a) within-group comparison for the intervention groups for anxiety, (b) comparison between intervention and control groups for anxiety, (c) within-group comparison for the intervention groups for depression, and (d) comparison between intervention and control groups for depression. BAI: Beck Anxiety Inventory; BDI: Beck Anxiety Inventory; CBT: cognitive behavioral therapy; CES-D: Center for Epidemiological Studies Depression questionnaire; GAD: generalized anxiety disorder; HAM-A: Hamilton Anxiety Rating Scale; HD-ABM: home-delivered attentional bias modification; LSAS-SR: Liebowitz Social Anxiety Scale-Self Report; mHealth: mobile health; PHQ: Patient Health Questionnaire; PPT: positive psychotherapy; STAI: State-Trait Anxiety Inventory; TAU: treatment-as-usual; WL: waitlist.
    View this figure

    Dose-Dependent Effects of the mHealth Interventions

    When examining the dose-dependent effects of the mHealth interventions, interventions longer than 7 weeks had larger effect sizes on anxiety reduction, with a statistically significant effect size at week 7 (Figure 6a). In contrast, the pooled effects on depression fluctuated without a clear trend of dose-dependent effects (Figure 6b). Regarding the sustainability of intervention effects, the pooled effect sizes were not significant and reduced over time during follow-ups for both anxiety and depression (Figures 6c and 6d).

    ‎
    Figure 6. Pooled effects of the app-based mHealth intervention on anxiety (upper panel) and depression (lower panel) at different time points: (a) during the designed study intervention length and (b) during the follow-up after the designed study intervention. a: number of study arms; mHealth: mobile health.
    View this figure

    Principal Findings

    We conducted a systematic review and meta-analysis to examine the existing evidence on the effectiveness of app-based mHealth interventions for anxiety and depression symptom reduction. We included a total of 15 randomized controlled trials (RCTs), with many studies [32-34,38,44] published after previous reviews on a similar topic, providing an update to the current evidence. Our meta-analysis shows that app-based mHealth interventions have a modest but significant effect on anxiety reduction, consistent with previous reviews [4,11,12]. This finding adds confidence to the further development and implementation of smartphone apps to facilitate psychological treatments for anxiety symptom management [11]. In addition, our results suggest that a longer intervention (ie, 7 weeks or longer) is more likely to result in significant anxiety reduction. This finding may explain the restricted effects in studies with less than 7 weeks of app-based mHealth interventions. To the best of our knowledge, this is the first meta-analysis to assess the relationship between the app-based mHealth intervention length and the effect of the intervention. We encourage researchers to design a longer app-based mHealth intervention for anxiety symptom control and to verify our findings regarding the length of the intervention.

    With regard to depression, we found that participants receiving interventions for depression experienced little symptom reduction that was not statistically significant. The finding is inconsistent with other systematic reviews reporting that smartphone apps have small-to-moderate effect sizes on depression symptom reduction [4,10,12]. The inconsistency could result from the fact that we included 1 measure per outcome per study instead of averaging the data from studies using multiple measurements for an outcome. The inconsistency may also be because previous studies included both native smartphone and web-based apps [4,10]. Web-based apps have better accessibility by allowing participants to access the interventions via various platforms [45]. In addition, the long history of web app development led to optimal user interface design, contributing to better usability and usefulness. Usability, usefulness, and accessibility have been documented as the key factors leading to successful and effective apps for mental illness management [46]. Nevertheless, we decided to exclude web-based apps because most studies reported no information about the tools their participants used to access their apps, which diminishes the purpose of our analysis on mHealth apps.

    Another possible explanation of the consistency between the results of this and previous studies can be that we included 5 [32-34,38,44] studies published after previous reviews and all of them had insignificant effect sizes in our analysis. The effect sizes from the new evidence may neutralize the effect sizes from the studies included in the previous reviews. The intervention effect heterogeneity indicated that the optimal intervention content, format, and dose designs remain unclear. This is further supported by our dose-dependent analysis revealing that there is no clear relationship between the intervention length and the effect on depression, similar to a previous study [10].

    There were 3 RCTs that met our eligibility criteria but were excluded from our meta-analysis due to insufficient data reported for the analysis [47-49]. All 3 studies reported positive results toward the effects of smartphone apps facilitating CBT on mental illness. Li et al [47] conducted a 12-week RCT and reported that a CBT-based smartphone chatbot intervention is efficacious for depression symptom reduction for patients with HIV and depression at both 3 and 6 months [47]. Morbeg et al [48] conducted a 4-week RCT and found that adult people receiving a CBT-based smartphone app had significantly lower anxiety and depression symptoms. Lastly, Arean et al [49] examined 2 smartphone apps in a 4-week RCT for depression and found that both apps generated a greater reduction, although not significant, in the depression symptom score compared to the control. However, we excluded these 3 studies because they either reported statistics that cannot be used to compute Hedge g without transformation based on assumptions or did not report enough data for Hedge g calculation. Studies by Li et al [47] and Morbeg et al [48] were also not included in other previous systematic reviews. The study by Arean et al [49], after data transformation with assumptions, was included in previous reviews but showed inconsistent effects on depression symptom reduction. Therefore, it was unclear whether the inclusion of these studies would alter our results for depression. Further researchers and reviewers should emphasize the gold standard of reporting to enable better study comparison and synthesis [25,50].

    Consistent with previous reviews (eg, Lui et al [9]), the majority of the included studies used mobile apps to deliver CBT for anxiety or depression or both. Cognitive behavioral therapy has been delivered by computer or web apps for the treatment of various mental illnesses [51]. Our results did not suggest that smartphone apps are not useful for facilitating CBT. Rather, our results suggest that current evidence may be insufficient to guide the app-based mHealth intervention design for effective CBT-based mental illness intervention facilitation, thus requiring more research engagement. In addition, other psychotherapies, such as ACT, may also be effective in mental illness control but received relatively less attention. More studies are needed to uncover whether smartphone apps can facilitate other psychotherapies and how effective they are.

    One objective of our study was to evaluate the current dose design of existing app-based mHealth interventions for anxiety and depression for an understanding of the optimal mHealth treatment length. We found that most interventions were designed to be used on a daily basis and completed within 1.5 months [52]. However, most studies provided a paucity of information about how much time their participants were asked to spend on the interventions per day or per module/session of the interventions; in addition, most studies reported no data on how much time their participants actually spent on the interventions (the actual intervention exposure). As a result, we were only able to summarize the intervention effect by the designed intervention length and dose reported in the included studies.

    Limitations and Strengths

    Our review has several limitations that should be considered when interpreting the results. First, our literature search was restricted to English publications and resulted in a small amount of research available compared to other meta-analyses examining the evidence of smartphone-based interventions for mental illness. Second, the included studies used various outcome measures, and we extracted only the primary or secondary measures for anxiety and depression. Although this strategy was used in previous systematic reviews and meta-analyses on similar topics, we might have missed the effects detected by other measures. Both limitations might result in our findings of limited or nonexistent efficacy of the interventions and confidence reduction in our dose analysis results. Finally, we included 6 studies that delivered their interventions in part by smartphone. Although app components were the main parts of their interventions, our results may not represent the effects of stand-alone smartphone apps due to the inclusion of the studies. Nevertheless, we decided to include these studies because we considered these interventions were still app-based mHealth interventions. In addition, small effect sizes for 4 of the 6 studies suggest that the nonapp components do not seem to contribute to the primary effect. Further studies, including more studies for blended interventions (smartphone app + other intervention components), are needed to compare the effects of stand-alone smartphone apps and blended interventions on mental illness management.

    Despite the limitations, this review has many strengths. First, our included studies covered several publications that were published after 2019 [32-34,38,44] to reflect updated evidence, which can support future development and use of app-based mHealth interventions for anxiety and depression. Second, we conducted several analyses assessing pooled intervention effects at various study time points to understand the effective length of app-based mHealth interventions. Finally, we computed the pooled effect size of the mHealth interventions during the follow-up period to uncover the sustainability of the intervention effects on anxiety and depression reduction, which was not revealed in previous systematic reviews focusing on a similar topic [10-12]. These analyses provide innovative insights informing the future study design of app-based mHealth interventions assessing for anxiety and depression symptom reduction.

    Implications for Future Studies

    The dose design of app-based interventions has been suggested as an important aspect that profoundly influences intervention effects [13,24,53]. However, incomplete and inconsistent reporting of the intervention dose design and exposure in the existing studies impeded our quantitative analysis exploring the optimal intervention dose design for anxiety and depression. Future studies should explore the effect of app-based mHealth interventions with various dose designs and exposures for anxiety and depression symptom management. In addition, research efforts are needed to improve the reporting of intervention doses to enable comparable data for evidence evaluation and synthesis. The use of the JITAI framework to inform intervention design, evaluation, and reporting has potential to enable high-quality evidence for future app-based mHealth interventions for mental illness [13,24]. Finally, although most studies reported that their interventions sustained over follow-up compared to baseline, our analysis indicated that the pooled between-group effects of the interventions were not significant and rapidly reduced over time for both anxiety and depression. We recommend future studies to further explore the sustainability of symptom improvements from app-based mHealth interventions for anxiety and depression at various time points, including both during the study and after study completion (follow-up).

    Conclusion

    In summary, although there is some evidence in using app-based mHealth interventions for anxiety and depression symptom reduction, clinical use cannot be recommended based on this systematic review and meta-analysis due to the small to nonexistent pooled effects found in existing studies, not to mention concerns regarding study quality/reporting of the existing studies. The effects of app-based mHealth interventions may not yet be realized, as the optimal intervention dose is still unclear. Future research should consider (1) adopting a theoretical framework, such as JITAI, to inform intervention design, evaluation, and reporting to enable high-quality evidence for app-based mHealth interventions for anxiety and depression care; (2) improving the reporting of data to enable comparable data for evidence evaluation and synthesis; and (3) exploring the sustainability of treatment benefit from the mHealth interventions.

    Authors' Contributions

    SCL, MX, ALC, and PYY conceptualized and designed the study; AH conducted the literature search and reference management: SCL, MX, and PYY selected relevant studies and performed data collection and assembly; SCL, MW, PYY, and S-HC conducted data analysis and result interpretation; SCL, PYY, and S-HC drafted the manuscript; and PYY and S-HC jointly provided supervision, timeline control, and resource management of the study as senior authors. All authors participated in the revision of the manuscript and approved the final manuscript.

    Conflicts of Interest

    None declared.

    ‎
    Multimedia Appendix 1

    Search strategy for all reference databases used.

    DOCX File , 18 KB
    ‎
    Multimedia Appendix 2

    Results of the funnel plots and Egger test.

    DOCX File , 158 KB
    1. GBD 2017 Disease and Injury Incidence and Prevalence Collaborators. Global, regional, and national incidence, prevalence, and years lived with disability for 354 diseases and injuries for 195 countries and territories, 1990–2017: a systematic analysis for the Global Burden of Disease Study 2017. Lancet 2018 Nov 10;392(10159):1789-1858 [FREE Full text] [CrossRef] [Medline]
    2. Mental Health America (MHA). The State of Mental Health in America. 2021.   URL: https://mhanational.org/issues/state-mental-health-america [accessed 2022-08-26]
    3. McNair BG, Highet NJ, Hickie IB, Davenport TA. Exploring the perspectives of people whose lives have been affected by depression. Med J Aust 2002 May 20;176(10):S69-S76. [CrossRef] [Medline]
    4. Linardon J, Cuijpers P, Carlbring P, Messer M, Fuller-Tyszkiewicz M. The efficacy of app-supported smartphone interventions for mental health problems: a meta-analysis of randomized controlled trials. World Psychiatry 2019 Oct;18(3):325-336 [FREE Full text] [CrossRef] [Medline]
    5. Torous J, Roberts LW. Needed Innovation in Digital Health and Smartphone Applications for Mental Health: Transparency and Trust. JAMA Psychiatry 2017 May 01;74(5):437-438. [CrossRef] [Medline]
    6. Miralles I, Granell C, Díaz-Sanahuja L, Van Woensel W, Bretón-López J, Mira A, et al. Smartphone apps for the treatment of mental disorders: systematic review. JMIR Mhealth Uhealth 2020 Apr 02;8(4):e14897 [FREE Full text] [CrossRef] [Medline]
    7. Byambasuren O, Sanders S, Beller E, Glasziou P. Prescribable mHealth apps identified from an overview of systematic reviews. NPJ Digit Med 2018;1(1):1-12 [FREE Full text] [CrossRef] [Medline]
    8. Gratzer D, Strudwick G, Yeung A. Mental illness: is there an app for that? Fam Syst Health 2019 Dec;37(4):336-339. [CrossRef] [Medline]
    9. Lui JHL, Marcus DK, Barry CT. Evidence-based apps? A review of mental health mobile applications in a psychotherapy context. Professional Psychology: Research and Practice 2017 Jun;48(3):199-210. [CrossRef]
    10. Firth J, Torous J, Nicholas J, Carney R, Pratap A, Rosenbaum S, et al. The efficacy of smartphone-based mental health interventions for depressive symptoms: a meta-analysis of randomized controlled trials. World Psychiatry 2017 Oct;16(3):287-298 [FREE Full text] [CrossRef] [Medline]
    11. Firth J, Torous J, Nicholas J, Carney R, Rosenbaum S, Sarris J. Can smartphone mental health interventions reduce symptoms of anxiety? A meta-analysis of randomized controlled trials. J Affect Disord 2017 Aug 15;218:15-22 [FREE Full text] [CrossRef] [Medline]
    12. Weisel KK, Fuhrmann LM, Berking M, Baumeister H, Cuijpers P, Ebert DD. Standalone smartphone apps for mental health-a systematic review and meta-analysis. NPJ Digit Med 2019;2(1):1-10 [FREE Full text] [CrossRef] [Medline]
    13. Nahum-Shani I, Smith SN, Spring BJ, Collins LM, Witkiewitz K, Tewari A, et al. Just-in-Time Adaptive Interventions (JITAIs) in Mobile Health: Key Components and Design Principles for Ongoing Health Behavior Support. Ann Behav Med 2018 May 18;52(6):446-462 [FREE Full text] [CrossRef] [Medline]
    14. Spruijt-Metz D, Wen CKF, O'Reilly G, Li M, Lee S, Emken BA, et al. Innovations in the Use of Interactive Technology to Support Weight Management. Curr Obes Rep 2015 Dec;4(4):510-519 [FREE Full text] [CrossRef] [Medline]
    15. King AC, Hekler EB, Grieco LA, Winter SJ, Sheats JL, Buman MP, et al. Harnessing different motivational frames via mobile phones to promote daily physical activity and reduce sedentary behavior in aging adults. PLoS One 2013;8(4):e62613 [FREE Full text] [CrossRef] [Medline]
    16. Hardeman W, Houghton J, Lane K, Jones A, Naughton F. A systematic review of just-in-time adaptive interventions (JITAIs) to promote physical activity. Int J Behav Nutr Phys Act 2019 Apr 03;16(1):31 [FREE Full text] [CrossRef] [Medline]
    17. Brookie KL, Mainvil LA, Carr AC, Vissers MCM, Conner TS. The development and effectiveness of an ecological momentary intervention to increase daily fruit and vegetable consumption in low-consuming young adults. Appetite 2017 Jan 01;108:32-41. [CrossRef] [Medline]
    18. Heron KE, Smyth JM. Ecological momentary interventions: incorporating mobile technology into psychosocial and health behaviour treatments. Br J Health Psychol 2010 Mar;15(1):1-39 [FREE Full text] [CrossRef] [Medline]
    19. Svetkey LP, Stevens VJ, Brantley PJ, Appel LJ, Hollis JF, Loria CM, Weight Loss Maintenance Collaborative Research Group. Comparison of strategies for sustaining weight loss: the weight loss maintenance randomized controlled trial. JAMA 2008 Mar 12;299(10):1139-1148. [CrossRef] [Medline]
    20. Rodgers A, Corbett T, Bramley D, Riddell T, Wills M, Lin R, et al. Do u smoke after txt? Results of a randomised trial of smoking cessation using mobile phone text messaging. Tob Control 2005 Aug;14(4):255-261 [FREE Full text] [CrossRef] [Medline]
    21. Suffoletto B, Callaway C, Kristan J, Kraemer K, Clark DB. Text-message-based drinking assessments and brief interventions for young adults discharged from the emergency department. Alcohol Clin Exp Res 2012 Mar;36(3):552-560. [CrossRef] [Medline]
    22. Witkiewitz K, Desai SA, Bowen S, Leigh BC, Kirouac M, Larimer ME. Development and evaluation of a mobile intervention for heavy drinking and smoking among college students. Psychol Addict Behav 2014 Sep;28(3):639-650 [FREE Full text] [CrossRef] [Medline]
    23. Wang L, Miller LC. Just-in-the-moment adaptive interventions (JITAI): a meta-analytical review. Health Commun 2020 Nov 05;35(12):1531-1544. [CrossRef] [Medline]
    24. Goldstein SP, Evans BC, Flack D, Juarascio A, Manasse S, Zhang F, et al. Return of the JITAI: applying a just-in-time adaptive intervention framework to the development of m-Health solutions for addictive behaviors. Int J Behav Med 2017 Oct;24(5):673-682 [FREE Full text] [CrossRef] [Medline]
    25. Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ 2021 Mar 29;372:n71 [FREE Full text] [CrossRef] [Medline]
    26. Sterne JAC, Savović J, Page MJ, Elbers RG, Blencowe NS, Boutron I, et al. RoB 2: a revised tool for assessing risk of bias in randomised trials. BMJ 2019 Aug 28;366:l4898. [CrossRef] [Medline]
    27. Higgins JPT, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta-analyses. BMJ 2003 Oct 06;327(7414):557-560 [FREE Full text] [CrossRef] [Medline]
    28. Egger ST, Vetter S, Weniger G, Vandeleur C, Seifritz E, Müller M. The Use of the Health of the Nation Outcome Scales for Assessing Functional Change in Treatment Outcome Monitoring of Patients with Chronic Schizophrenia. Front Public Health 2016;4:220 [FREE Full text] [CrossRef] [Medline]
    29. Duval S, Tweedie R. Trim and fill: A simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics 2000 Jul;56(2):455-463. [CrossRef] [Medline]
    30. Pham Q, Khatib Y, Stansfeld S, Fox S, Green T. Feasibility and Efficacy of an mHealth Game for Managing Anxiety: "Flowy" Randomized Controlled Pilot Trial and Design Evaluation. Games Health J 2016 Mar;5(1):50-67. [CrossRef] [Medline]
    31. Boettcher J, Magnusson K, Marklund A, Berglund E, Blomdahl R, Braun U, et al. Adding a smartphone app to internet-based self-help for social anxiety: A randomized controlled trial. Computers in Human Behavior 2018 Oct;87(6):98-108. [CrossRef] [Medline]
    32. Greer JA, Jacobs J, Pensak N, MacDonald JJ, Fuh C, Perez GK, et al. Randomized Trial of a Tailored Cognitive-Behavioral Therapy Mobile Application for Anxiety in Patients with Incurable Cancer. Oncologist 2019 Aug;24(8):1111-1120 [FREE Full text] [CrossRef] [Medline]
    33. Ponzo S, Morelli D, Kawadler JM, Hemmings NR, Bird G, Plans D. Efficacy of the Digital Therapeutic Mobile App BioBase to Reduce Stress and Improve Mental Well-Being Among University Students: Randomized Controlled Trial. JMIR Mhealth Uhealth 2020 Apr 06;8(4):e17767 [FREE Full text] [CrossRef] [Medline]
    34. Stiles-Shields C, Montague E, Kwasny MJ, Mohr DC. Behavioral and cognitive intervention strategies delivered via coached apps for depression: Pilot trial. Psychol Serv 2019 May;16(2):233-238 [FREE Full text] [CrossRef] [Medline]
    35. Tighe J, Shand F, Ridani R, Mackinnon A, De La Mata N, Christensen H. Ibobbly mobile health intervention for suicide prevention in Australian Indigenous youth: a pilot randomised controlled trial. BMJ Open 2017 Jan 27;7(1):e013518 [FREE Full text] [CrossRef] [Medline]
    36. Lüdtke T, Westermann S, Pult LK, Schneider BC, Pfuhl G, Moritz S. Evaluation of a brief unguided psychological online intervention for depression: A controlled trial including exploratory moderator analyses. Internet Interventions 2018 Sep;13:73-81. [CrossRef]
    37. Mantani A, Kato T, Furukawa TA, Horikoshi M, Imai H, Hiroe T, et al. Smartphone Cognitive Behavioral Therapy as an Adjunct to Pharmacotherapy for Refractory Depression: Randomized Controlled Trial. J Med Internet Res 2017 Nov 03;19(11):e373 [FREE Full text] [CrossRef] [Medline]
    38. Dahne J, Lejuez CW, Diaz VA, Player MS, Kustanowitz J, Felton JW, et al. Pilot Randomized Trial of a Self-Help Behavioral Activation Mobile App for Utilization in Primary Care. Behav Ther 2019 Jul;50(4):817-827 [FREE Full text] [CrossRef] [Medline]
    39. Harrer M, Adam SH, Fleischmann RJ, Baumeister H, Auerbach R, Bruffaerts R, et al. Effectiveness of an Internet- and App-Based Intervention for College Students With Elevated Stress: Randomized Controlled Trial. J Med Internet Res 2018 Apr 23;20(4):e136 [FREE Full text] [CrossRef] [Medline]
    40. Roepke AM, Jaffee SR, Riffle OM, McGonigal J, Broome R, Maxwell B. Randomized Controlled Trial of SuperBetter, a Smartphone-Based/Internet-Based Self-Help Tool to Reduce Depressive Symptoms. Games Health J 2015 Jul;4(3):235-246. [CrossRef] [Medline]
    41. Stolz T, Schulz A, Krieger T, Vincent A, Urech A, Moser C, et al. A mobile app for social anxiety disorder: A three-arm randomized controlled trial comparing mobile and PC-based guided self-help interventions. J Consult Clin Psychol 2018 Jun;86(6):493-504. [CrossRef] [Medline]
    42. Teng M, Hou Y, Chang S, Cheng H. Home-delivered attention bias modification training via smartphone to improve attention control in sub-clinical generalized anxiety disorder: A randomized, controlled multi-session experiment. J Affect Disord 2019 Mar 01;246:444-451. [CrossRef] [Medline]
    43. Ly KH, Topooco N, Cederlund H, Wallin A, Bergström J, Molander O, et al. Smartphone-Supported versus Full Behavioural Activation for Depression: A Randomised Controlled Trial. PLoS One 2015;10(5):e0126559 [FREE Full text] [CrossRef] [Medline]
    44. Ham K, Chin S, Suh YJ, Rhee M, Yu E, Lee HJ, et al. Preliminary Results From a Randomized Controlled Study for an App-Based Cognitive Behavioral Therapy Program for Depression and Anxiety in Cancer Patients. Front Psychol 2019;10:1592 [FREE Full text] [CrossRef] [Medline]
    45. United States Census Bureau. Computer and Internet Use in the United States: 2018. 2021.   URL: https://www.census.gov/newsroom/press-releases/2021/computer-internet-use.html [accessed 2022-07-05]
    46. Chan S, Torous J, Hinton L, Yellowlees P. Towards a Framework for Evaluating Mobile Mental Health Apps. Telemed J E Health 2015 Dec;21(12):1038-1041. [CrossRef] [Medline]
    47. Li Y, Guo Y, Hong YA, Zhu M, Zeng C, Qiao J, et al. Mechanisms and Effects of a WeChat-Based Intervention on Suicide Among People Living With HIV and Depression: Path Model Analysis of a Randomized Controlled Trial. J Med Internet Res 2019 Nov 27;21(11):e14729 [FREE Full text] [CrossRef] [Medline]
    48. Moberg C, Niles A, Beermann D. Guided Self-Help Works: Randomized Waitlist Controlled Trial of Pacifica, a Mobile App Integrating Cognitive Behavioral Therapy and Mindfulness for Stress, Anxiety, and Depression. J Med Internet Res 2019 Jun 08;21(6):e12556 [FREE Full text] [CrossRef] [Medline]
    49. Arean PA, Hallgren KA, Jordan JT, Gazzaley A, Atkins DC, Heagerty PJ, et al. The Use and Effectiveness of Mobile Apps for Depression: Results From a Fully Remote Clinical Trial. J Med Internet Res 2016 Dec 20;18(12):e330 [FREE Full text] [CrossRef] [Medline]
    50. Agarwal S, LeFevre AE, Lee J, L'Engle K, Mehl G, Sinha C, WHO mHealth Technical Evidence Review Group. Guidelines for reporting of health interventions using mobile phones: mobile health (mHealth) evidence reporting and assessment (mERA) checklist. BMJ 2016 Mar 17;352:i1174. [CrossRef] [Medline]
    51. Musiat P, Tarrier N. Collateral outcomes in e-mental health: a systematic review of the evidence for added benefits of computerized cognitive behavior therapy interventions for mental health. Psychol. Med 2014 Feb 19;44(15):3137-3150. [CrossRef]
    52. Xiong S, Berkhouse H, Schooler M, Pu W, Sun A, Gong E, et al. Effectiveness of mHealth Interventions in Improving Medication Adherence Among People with Hypertension: a Systematic Review. Curr Hypertens Rep 2018 Aug 07;20(10):86. [CrossRef] [Medline]
    53. Evans W, Nielsen PE, Szekely DR, Bihm JW, Murray EA, Snider J, et al. Dose-response effects of the text4baby mobile health program: randomized controlled trial. JMIR Mhealth Uhealth 2015 Jan 28;3(1):e12 [FREE Full text] [CrossRef] [Medline]

    ‎
    ACT: acceptance and commitment therapy
    BAI: Beck Anxiety Inventory
    BDI: Beck Depression Inventory
    CBT: cognitive behavioral therapy
    CES-D: Center for Epidemiological Studies Depression questionnaire
    GAD-7: Generalized Anxiety Disorder-7
    HAM-A: Hamilton Anxiety Rating Scale
    JITAI: just-in-time adaptive intervention
    LSAS-SR: Liebowitz Social Anxiety Scale-Self Report
    mHealth: mobile health
    PHQ-9: Patient Health Questionnaire-9
    PRISMA: Preferred Reporting Items for Systematic Reviews and Meta-Analyses
    RCT: randomized controlled trial
    SIAS: Social Interaction Anxiety Scale
    STAI: State-Trait Anxiety Inventory

    Edited by J Torous; submitted 10.05.22; peer-reviewed by E Motrico, S Stewart-Brown, K Baker; comments to author 29.06.22; revised version received 07.08.22; accepted 11.08.22; published 07.09.22

    Copyright

    ©Sheng-Chieh Lu, Mindy Xu, Mei Wang, Angela Hardi, Abby L Cheng, Su-Hsin Chang, Po-Yin Yen. Originally published in JMIR Mental Health (https://mental.jmir.org), 07.09.2022.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Mental Health, is properly cited. The complete bibliographic information, a link to the original publication on https://mental.jmir.org/, as well as this copyright and license information must be included.