Published on in Vol 9, No 2 (2022): February

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/31116, first published .
eHealth Interventions for Treatment and Prevention of Depression, Anxiety, and Insomnia During Pregnancy: Systematic Review and Meta-analysis

eHealth Interventions for Treatment and Prevention of Depression, Anxiety, and Insomnia During Pregnancy: Systematic Review and Meta-analysis

eHealth Interventions for Treatment and Prevention of Depression, Anxiety, and Insomnia During Pregnancy: Systematic Review and Meta-analysis

Review

1Department of Psychology, University of Calgary, Calgary, AB, Canada

2Department of Community Health Sciences, Cumming School of Medicine, University of Calgary, Calgary, AB, Canada

3Women’s Mental Health Clinic, Foothills Medical Centre, Alberta Health Services, Calgary, AB, Canada

4Department of Anthropology and Archaeology, University of Calgary, Calgary, AB, Canada

5Department of Psychology and Pediatrics, University of Manitoba, Winnipeg, MB, Canada

6Children’s Hospital Research Institute of Manitoba, Winnipeg, MB, Canada

7Department of Radiology, Alberta Children’s Hospital Research Institute, Hotchkiss Brain Institute, Calgary, AB, Canada

8Alberta Children’s Hospital Research Institute, Calgary, AB, Canada

9Department of Pediatrics, University of Calgary, Calgary, AB, Canada

Corresponding Author:

Lianne M Tomfohr-Madsen, PhD

Department of Psychology

University of Calgary

2500 University Drive, NW

Calgary, AB, T2N 1N4

Canada

Phone: 1 403 220 2243

Email: ltomfohr@ucalgary.ca


Background: Pregnancy is associated with an increased risk for depression, anxiety, and insomnia. eHealth interventions provide a promising and accessible treatment alternative to face-to-face interventions.

Objective: The objective of this systematic review and meta-analysis is to determine the effectiveness of eHealth interventions in preventing and treating depression, anxiety, and insomnia during pregnancy. Secondary aims are to identify demographic and intervention moderators of effectiveness.

Methods: A total of 5 databases (PsycINFO, Medline, CINAHL, Embase, and Cochrane) were searched from inception to May 2021. Terms related to eHealth, pregnancy, randomized controlled trials (RCTs), depression, anxiety, and insomnia were included. RCTs and pilot RCTs were included if they reported an eHealth intervention for the prevention or treatment of depression, anxiety, or insomnia in pregnant women. Study screening, data extractions, and quality assessment were conducted independently by 2 reviewers from an 8-member research team (KAS, PRS, Hangsel Sanguino, Roshni Sohail, Jasleen Kaur, Songyang (Mark) Jin, Makayla Freeman, and Beatrice Valmana). Random-effects meta-analyses of pooled effect sizes were conducted to determine the effect of eHealth interventions on prenatal mental health. Meta-regression analyses were conducted to identify potential moderators.

Results: In total, 17 studies were included in this review that assessed changes in depression (11/17, 65%), anxiety (10/17, 59%), and insomnia (3/17, 18%). Several studies included both depression and anxiety symptoms as outcomes (7/17, 41%). The results indicated that during pregnancy, eHealth interventions showed small effect sizes for preventing and treating symptoms of anxiety and depression and a moderate effect size for treating symptoms of insomnia. With the exception of intervention type for the outcome of depressive symptoms, where mindfulness interventions outperformed other intervention types, no significant moderators were detected.

Conclusions: eHealth interventions are an accessible and promising resource for treating symptoms of anxiety, depression, and insomnia during pregnancy. However, more research is necessary to identify ways to increase the efficacy of eHealth interventions for this population.

Trial Registration: PROSPERO (International Prospective Register of Systematic Reviews) CRD42020205954; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=205954

JMIR Ment Health 2022;9(2):e31116

doi:10.2196/31116

Keywords



Background

Meta-analyses show high rates of depression [1] and anxiety disorders [2] during pregnancy. Sleep problems are also common during pregnancy; they increase as the pregnancy progresses and are often comorbid with other mental health problems [3-6]. Untreated antenatal mental health problems are associated with an increased risk for poor birth outcomes, such as miscarriage [7], preterm birth [2,8], and low birth weight [2,8]. Similarly, poor sleep during pregnancy is a predictor of poor birth outcomes [9], such as shorter gestational age in addition to increased risk for developing postpartum depression [6].

Symptoms of antenatal depression, anxiety, and insomnia, if left untreated, can persist long into the postpartum period as many symptoms postpartum begin antenatally [6,10,11]. Furthermore, the effects of psychological distress during pregnancy can have long-lasting developmental [12,13], emotional [14], behavioral [14], and cognitive impairments [14] on the child. Prenatal and postpartum maternal mental health concerns have been linked to altered brain structure in preschool children [15]. Together, these findings emphasize the importance of providing pregnant women with timely, accessible, and culturally safe interventions to better treat and support the mental health of all women or birth parents.

A confluence of evidence now shows that depression, anxiety, and insomnia can be effectively treated using in-person individual or group psychotherapy for the perinatal period [16,17]. On the basis of this evidence and the clear harm of untreated antenatal mental health problems, public health and medical agencies around the world are recommending routine screening and treatment for depression and anxiety during pregnancy [18-20]. Studies have found that women who are screened for depression during pregnancy, as opposed to the postpartum period, are more likely to follow up with treatment [21], which can lead to the prevention of further adverse outcomes [17].

Despite the strong arguments for antenatal screening and treatment of mental health problems, resources for the treatment of these concerns are limited, leaving mental health needs unrecognized and contributing to fetal risk along with persistent postpartum mental health problems [22]. Owing to the high rates of mental health and sleep problems during pregnancy, limited screening, and limited treatment resources, researchers and hospital administrators are increasingly looking to eHealth as a way to address unmet needs [23,24]. Screening alone, even without further treatment, has shown significant reductions in depression during the perinatal period [25]. Even in the presence of simple and effective screening tools, it is estimated that health care professionals detect only 25% of women with postpartum depression and even less with other perinatal mental health disorders [26] and up to 70% of pregnant or postpartum women will fail to seek treatment [27]. As a result, only 15% of women with a perinatal mental health disorder will receive evidence-based care [28] and these rates are lower in marginalized groups [29] and in fathers and partners [30].

eHealth is a new area in health care that focuses on the delivery of health services and information through web-based programs, remote monitoring, teleconsultation, and mobile device–supported care [31]. eHealth’s accessible nature aids in providing treatment to rural or remote areas, where patients otherwise would not have access to treatment and can involve lower intensity and more cost-effective delivery of services than in-person intervention, meaning that it may reach a larger number of patients [32].

The relevance of the use of eHealth interventions has only increased given that the COVID-19 pandemic has heightened psychological distress and sleep problems around the world. Pregnancy is already a period of vulnerability for mental health concerns [33-36] and a recent rapid review and meta-analysis of depression and anxiety during pregnancy during the COVID-19 pandemic reported that rates of depression and anxiety in pregnant women across the world are elevated compared with prepandemic levels [37]. The prevalence of insomnia has also increased during the COVID-19 pandemic [38], including during pregnancy. In addition to the need to investigate anxiety and depressive symptoms, insomnia is also important to be investigated as it is considered to be a transdiagnostic mechanism for various mental health concerns [39]. The elevation of mental health concerns during pregnancy has highlighted the need for accessible and timely solutions.

Although many eHealth interventions already exist, such as mobile health app for smartphones, very few are evidence-based [40,41]. Moreover, meta-analyses evaluating the effectiveness of eHealth interventions demonstrate mixed findings [42]. For example, prevention and treatment effects for depression appear to be small and dropout rates are high when there is no human monitoring and mood feedback. In contrast, moderate to large effect sizes are seen for eHealth interventions for insomnia [43,44]. The field of eHealth in the context of pregnancy is relatively new. Consequently, a systematic review and meta-analysis are needed to determine the effectiveness of eHealth interventions during pregnancy for the treatment of depression, anxiety, and insomnia symptoms.

Aims of the Study

This study is a systematic review and meta-analysis of the data from available randomized controlled trials (RCTs) published to date on eHealth interventions delivered during pregnancy to prevent or treat depression, anxiety, and insomnia. Meta-estimates are conducted separately for each outcome (anxiety, depression, and insomnia). A secondary goal of the review is to identify moderators of treatment effects. Potential moderators investigated include frequency of treatment (less frequent or more frequent), method of eHealth delivery (SMS text messaging, app, internet, and computer), treatment provider (health care provider, researcher, and self), risk of bias, type of control group (active and nonactive), treatment goal (treatment and prevention), baseline mental health symptoms (above or below clinical threshold), number of sessions, structure of the intervention (guided or unguided), and intervention type (hybrid or asynchronous). To clarify further, hybrid eHealth interventions refer to eHealth interventions where a component of the intervention was completed in person, if there was in-person contact. Asynchronous interventions refer to eHealth interventions, which were delivered completely via the web.


Search Strategy

A total of 5 electronic databases (ie, CINAHL with full text, PsycINFO, Medline or PubMed, Cochrane CENTRAL, and Embase) were searched using key terms to capture eHealth or digital interventions, RCTs, depression, anxiety, and insomnia during pregnancy to retrieve all relevant peer-reviewed articles from 1957 to May 2021. Subject headings were used in databases when appropriate. No filters or limits were applied to ensure that no articles were missed. Recognized articles were exported to a web-based systematic review program, Covidence (Veritas Health Innovation) [45] and duplicates were removed. This investigation followed the methods outlined by the Cochrane Collaboration Handbook [46] and the standards set by PRISMA (Preferred Reporting Items for Systematic Review and Meta-Analysis) [47,48]. The remaining articles were reviewed for inclusion using Covidence [45]. The study was registered with PROSPERO through the University of York Center for Reviews and Dissemination (CRD42020205186). The full search is available in Multimedia Appendix 1.

Study Selection

The initial abstract review was calibrated to ensure that the interrater reliability was >85%. Abstract eligibility was determined independently by each reviewer for all the identified articles. Conflicts were resolved by consensus with the first (KS) and second (PS) authors along with the research assistants (Roshni Sohail, Jasleen Kaur, Beatrice Valmana, Hangsel Sanguino, Makayla Freeman, and Songyang (Mark) Jin). Reference lists of the included articles and related review articles were inspected for any missed or relevant articles.

Inclusion and Exclusion Criteria

To be included in the review, studies had to be written in English and evaluate an eHealth intervention for anxiety, depression, or insomnia. eHealth interventions were defined and restricted to interventions that were delivered in an electronic capacity (eg, video therapy sessions, telephone, SMS text messaging, self-help interventions, and recorded therapy sessions). Studies had to be an RCT by study design. The intervention was required to occur before labor; however, the assessment of outcomes could occur in the postpartum period. Studies were excluded if (1) were not an RCT, (2) they did not have a control group, (3) they included a nonpregnant sample, (4) the interventions were not delivered electronically, (5) they were review articles, (6) they were case reports, (7) they used a previously included sample, or (8) they did not include continuous scores on a symptom measure of depression, anxiety, or insomnia. A flow chart of article inclusion and exclusion is shown in Figure 1.

Data Extraction

The remaining articles were divided and extracted independently by 2 reviewers from an 8-member research team (KAS, PRS, Hangsel Sanguino, Roshni Sohail, Jasleen Kaur, Songyang (Mark) Jin, Makayla Freeman, and Beatrice Valmana). Conflicts were resolved by consensus with the coders and the first and second authors. Extracted data included authors' names; publication year; country in which the research was conducted; sample demographics; pregnancy characteristics; intervention characteristics; administration details; and assessment information of depression, anxiety, or insomnia for all groups. Additional sample characteristics that were extracted when possible included sample size, age, gestational age during intervention baseline, ethnicity and race, sex, and gender breakdown of participants within the invention. The name of the intervention (when applicable), description, method of administration, degree of interaction and guidance from the provider (if applicable) during the intervention, and time spent by participants on the intervention were extracted. Information about depression, anxiety, and insomnia outcomes extracted included rates or effect sizes of all groups postintervention. Authors of included articles were contacted for additional information if studies had missing or incomplete data that precluded them from the analyses. If author contact was unsuccessful (ie, the author did not respond to an email request or no longer had access to data), the studies were excluded from the full-text review.

Data Analysis

Meta-analyses were conducted using the Comprehensive Meta-Analysis Software [49]. Sample sizes for each group (control and intervention), along with means and SDs of mental health symptoms for all study groups following the intervention (postintervention assessments, follow-ups, etc) were used to calculate meta-estimates of levels of depression, anxiety, or insomnia postintervention using random-effects meta-analyses. The overall meta-analysis computed a pooled Hedges g effect size, along with 95% CIs, for eHealth interventions across all included studies. A Hedges g of 0.20, 0.50, and 0.80 can be interpreted as small, moderate, and large effect sizes, respectively [50]. Stratified analyses were conducted according to the outcome (anxiety, depression, and insomnia). Separate meta-regression analyses with random-effects models were conducted when there were enough studies (3/17, 18%) that included at least one of the moderators of interest.

Quality Assessment

To assess the quality of the studies, the Cochrane Collaboration’s Risk of Bias Tool was used. The tool assesses seven criteria common to RCTs (random sequence generation, allocation concealment, selective reporting, blinding of participants and personnel, blinding of outcome assessment, incomplete outcome data, and other sources of bias) in which bias could occur. Quality indicators from the studies were extracted by 2 reviewers. Discrepancies in quality indicator scores were resolved by the first author (KS). Total scores ranged from 0 to 7, with higher scores indicating a greater risk of bias.


Study Selection

The search returned 5505 results, which were reduced to 2560 (46.50%) after duplicates were removed. Of the 2560 articles, 2367 (92.46%) articles were excluded after reviewing the titles and abstracts. At the full-text level, 7.54% (193/2560) of the articles were retrieved. From these 193 articles, 23 (11.9%) were included for extraction and, of them, 17 (89%) were included in this review. In all, 3 authors were contacted for additional information; 2 of whom replied and were included in the review. No additional articles were retrieved from additional searches of the reference lists. The article screening process is detailed in Figure 1.

Figure 1. PRISMA (Preferred Reporting Items for Systematic Review and Meta-Analysis) flow chart. RCT: randomized controlled trial.
View this figure

Characteristics of Included Studies

Full details of each study are presented in Table 1. Mean participant age ranged from 25.97 (SD 6.01) to 37.80 (SD 2.31) years and 100% of the participants were women. None of the included studies assessed fathers. Mean gestational age ranged from 15.9 (SD 6.3) to >30 weeks at the start of the trial. Of the 71% (12/17) of the studies where data about ethnicity were reported, 10 (83%) studies included 50-80% of participants who identified as White [51-60] and 6 (50%) studies had >80% of the total sample identified as White [51-56].

No studies required a formal diagnosis of anxiety, depression, or insomnia at baseline. Studies primarily delivered the eHealth intervention through the computer or internet (12/17, 71% of the included studies) [51-57,59-61,65,66]. Of these 12 studies, 4 (33%) were delivered via a mobile app on a smartphone [58,62-64] and 1 (8%) was delivered through SMS text messages [67]. It should be noted that although telephone-based studies were also eHealth interventions of interest, the review did not identify any telephone-based studies. Regarding the frequency at which the intervention was delivered, 12% (2/17) of the studies were considered to be low frequency (defined as an intervention that was accessed once, twice, or monthly) [52,66] and 88% (15/17) of the studies were considered to be high frequency (defined as an intervention that was delivered weekly or daily) [51,53-65,67]. In considering who delivered the intervention, treatment providers varied, as 12% (2/17) of the studies used health care [62,64] providers to deliver the intervention, 24% (4/17) of the studies used researchers to deliver the intervention [51,65-67], and 65% (11/17) of the studies used other means [52-57,59-61,63]. Other was subjectively defined as an intervention that was self-administered, but indirectly provided or developed by another organization, researcher, or clinician.

Interventions used to treat or prevent depression included cognitive behavioral therapy (CBT; 3/17, 18%) [54,56,65], psychoeducation (4/17, 24%) [52,55,59,62], mindfulness (3/17, 18%) [53,63,64], and attention bias modification training (1/17, 6%) [58].

Interventions used to treat or prevent anxiety included CBT (2/17, 12%) [51,54], general education about the perinatal period (2/17, 12%) [66,67], psychoeducation (2/17, 12%) [52,62], mindfulness (3/17, 18%) [53,63,64], and attention bias modification training (1/17, 6%) [58]. CBT for insomnia (CBT-I) was the only type of intervention used to improve symptoms of insomnia.

Symptoms of anxiety, depression, or insomnia were assessed by using validated questionnaires. Of the 17 included studies, 10 (59%) studies measured anxiety symptoms, 11 (65%) studies measured depressive symptoms, and 3 (18%) studies measured insomnia symptoms.

Of the 59% (10/17) studies that measured anxiety, 1 (10%) study measured anxiety using the Spielberger Trait Anxiety Inventory [51], 2 (20%) studies used the Depression Anxiety Stress Scale–Anxiety [58,62], 1 (10%) study used the Hamilton Anxiety Rating Scale [58], 1 (10%) study used the Visual Analogue Scale for Anxiety [66], 1 (10%) study used the Hospital Anxiety Depression Scale–Anxiety [52], 4 (40%) studies used the Generalized Anxiety Disorder-7 [53,54,63,64], and 1 (10%) study used an unspecified anxiety measure [67] (Table 2).

Table 1. Characteristics of included studies (N=17).
Study; countryName of interventionIntervention, N; control, NAge of sample (years), intervention, mean (SD); control, mean (SD)Gestational age (weeks)a, intervention, mean (SD); control, mean (SD)Type of control groupType of eHealthType of interventionOutcome
Cain et al [61]; United StatesGo To Sleep! internet-based CBT-Ib27; 2628.5 (5.8); 29.8 (5.3)19.6 (3.6); 22.8 (2.6)Waitlist conditionInternetCBTInsomnia
Felder et al [57]; United StatesSleepio: Big Health; digital CBT-I105; 10333.9 (3.38); 33.2 (4)17.1 (6.4); 18.1 (6.3)PsychoeducationInternetCBTInsomnia
Kalmbach et al [60]; United StatesSleepio: Big Health; digital CBT-I46; 4528.91 (4.21); 29.16 (4.11)N/AcPsychoeducationInternetCBTInsomnia
Heller et al [52]; Netherlands;MamaKits Onling: internet-based intervention79; 8032.08 (4.61); 31.94 (4.83)<30; <30TAUdInternetPsychoeducationAnxiety and depression
Chan et al [62]; ChinaiParent app330; 33031.3 (4.6); 31.2 (4.5)N/ATAUMobile appPsychoeducationAnxiety and depression
Duffecy et al [56]; United StatesSunnyside Cognitive Behavioral Therapy e-Intervention17; 630.5 (4.05; total sample)20-28eHealth intervention of reduced intensityInternetCBTDepression
Haga et al [55]; NorwayMamma Mia: web-based program678; 66431.0 (4.6); 31.1 (4.5)21-25TAUInternetPsychoeducationDepression
Yang et al [63]; ChinaWeChat (mobile) Messages: mobile app62; 6131.31 (4.87); 30.38 (3.91)25.52 (1.84); 26.33 (3.45)TAUMobile appMindfulnessAnxiety and depression
Krusche et al [53]; United KingdomBe Mindful: website107; 7832.7 (mode=34; total sample)>12Waitlist conditionInternetMindfulnessAnxiety and depression
Loughnan et al [54]; AustraliaMUMentum Pregnancy program: internet-delivered CBT36; 4131.69 (4.44); 31.54 (3.63)20.54 (6.01); 22.63 (5.76)TAUInternetCBTAnxiety and depression
Dennis-Tiwary et al [58]; United StatesABMTe15; 1434.67 (4.39); 31.14 (6.16)22.44 (2.43); 20-28Placebo conditionMobile appABMTAnxiety and depression
Sun et al [64]; ChinaWeChat (mobile) Messages; mobile app84; 8430.27 (3.80); 29.55 (4.21)13.82 (2.0); 14.41 (2.2)eHealth intervention of reduced intensityMobile appSpirits Healing app and mindfulnessAnxiety and depression
Forsell et al [65]; SwedenInternet-delivered CBT22; 2031.2 (3.7); 30.8 (5.3)15.9 (6.5); 18.6 (6.5)TAUInternetCBTDepression
Scherer et al [51]; SwitzerlandInternet-based cognitive behavioral stress management; internet31; 2732.90 (3.49); 31.11 (3.50)28.32 (2.96); 29.11 (2.47)Placebo conditionInternetCBTAnxiety
Barrera et al [59]; United StatesInternet-based mood management intervention57; 5429.81 (6.09); 30.59 (4.99)20.51 (10.37); 19.42 (10.42)eHealth intervention of reduced intensityInternetPsychoeducationDepression
Hanprasertpong et al [66]; ThailandComputer-assisted instruction157; 16437.8 (2.31); 37.5 (2.62)16-20; 16-20Paper version of the interventionComputer or internetGeneral educationAnxiety
Jareethum et al [67]; ThailandSMS text messaging intervention32; 2928.72 (4.9); 25.97 (6.1)<28; <28;TAUSMS text messageGeneral educationAnxiety

aThe deviation from mean (SD) format in few studies is owing to unavailability of data.

bCBT-I: cognitive behavioral therapy for insomnia.

cN/A: not applicable.

dTAU: treatment as usual.

eABMT: attention bias modification training.

Table 2. Anxiety outcome measures used by each study (N=10).
StudyAnxiety measure

STAIaDASS-AbHAMAcVASdHADSeGAD-7fUnspecified
Heller et al [52]





Chan et al [62]





Yang et al [63]





Krusche et al [53]





Loughnan et al [54]





Dennis-Tiwary et al [58]




Sun et al [64]





Scherer et al [51]





Hanprasertpong et al [66]





Jareethum et al [67]





aSTAI: State Trait Anxiety Inventory.

bDASS-A: Depression Anxiety Stress Scale–Anxiety.

cHAMA: Hamilton Anxiety Rating Scale.

dVAS: Visual Analogue Scale.

eHADS: Hospital Anxiety Depression Scale.

fGAD-7: Generalized Anxiety Disorder–7.

For symptoms of depression, of the 65% (11/17) of the studies, 7 (64%) studies used the Edinburgh Postnatal Depression Scale [52-55,62,64,65], 4 (36%) studies used the Patient Health Questionnaire-9 [53,54,56,63], 2 (18%) studies used the Center for Epidemiologic Studies Depression Scale [52,59], 1 (9%) study used the Hamilton Depression Rating Scale [56], 1 (9%) study used the Inventory of Depression and Anxiety Scale [56], 1 (9%) study used the Depression Anxiety Stress Scale–Depression [58], 1 (9%) study used the Montgomery-Asberg Depression Rating Scale [65], and 1 (9%) study used the Work and Social Adjustment Scale–Depression [65] (Table 3). For symptoms of insomnia, all 3 (100%) studies used the Pittsburgh Sleep Quality Index and the Insomnia Severity Index [57,60,61] (Table 4).

Table 3. Depression outcome measures used by each study (N=11).
StudyDepression measure

EPDSaPHQ-9bCES-DcHDRSdIDASeDASS-DdMADRSgWSASh
Heller et al [52]





Chan et al [62]






Duffecy et al [56]




Haga et al [55]






Yang et al [63]






Krusche et al [53]





Loughnan et al [54]





Dennis-Tiwary et al [58]






Sun et al [64]






Forsell et al [65]




Barrera et al [59]






aEPDS: Edinburgh Postnatal Depression Scale.

bPHQ-9: Patient Health Questionnaire-9.

cCES-D: Center for Epidemiologic Studies Depression Scale.

dHDRS: Hamilton Depression Rating Scale.

eIDAS: Inventory of Depression and Anxiety Scale.

fDASS-D: Depression Anxiety Stress Scale–Depression.

gMADRS: Montgomery-Asberg Depression Rating Scale.

hWSAS: Work and Social Adjustment Scale.

Table 4. Insomnia outcome measures used by each study (N=3).
StudyInsomnia measure

ISIaPSQIb
Cain et al [61]
Felder et al [57]
Kalmbach et al [60]

aISI: Insomnia Severity Index.

bPSQI: Pittsburgh Sleep Quality Index.

Of the 17 studies, 7 (41%) studies assessed both anxiety and depressive symptoms [52-54,58,62-64]. Most of the control conditions specified that control participants received treatment as usual (TAU) from their health care providers (7/17, 41%) [52,54,55,62,63,65,67]. Some studies defined their control group as a waitlist condition (2/17, 12%) [53,61], a placebo condition (2/17, 12%) [51,58], an eHealth intervention of reduced intensity (3/17, 18%) [56,59,64], a paper version of the intervention (1/17, 6%) [66], or psychoeducation (3/17, 18%) [57,60,63].

Risk of Bias in the Included RCTs

The results of bias assessments are shown in Table 5. Risk was rated as low for the 17 studies that were included. The most common risk of bias was owing to other biases, which were not explicitly mentioned in the quality assessment tool (ie, sampling bias). In general, the risk of selection, reporting, and attrition biases were low. The presence of other biases was judged as high in 10 (59%) of the 17 studies. Of the 17 included studies, 15 (88%) were judged to have a high risk of bias in at least one domain.

Table 5. Outcomes from included studies (N=17).
StudyOutcomeStudy quality ratingHedges gP valueIntervention effect
Cain et al [61]Insomnia30.576.06The study was marginally significant in reducing insomnia symptoms following the intervention for women in the CBT-Ia group.
Felder et al [57]Insomnia30.688<.001Results from the study found those who received digital CBT-I experienced significantly greater reductions in insomnia symptom severity compared with women in the control group.
Kalmbach et al [60]Insomnia10.403.06CBT-I patients reported lower insomnia symptoms on the ISIb and PSQIc after treatment than controls; however, this was marginally significant.
Heller et al [52]Anxiety and depression1Anxiety: 0.076; depression: –0.10Anxiety: .70; depression: .96No significant differences were found between the intervention group and the control group for both anxiety and depression.
Chan et al [62]Anxiety and depression1Anxiety: –0.045; depression: 0.219Anxiety: .56; depression: .02Scores of depression significantly decreased in the intervention group when compared with the control group; however, scores of anxiety did not significantly decrease when comparing the intervention group with the control group.
Duffecy et al [56]Depression30.696.29Study results participants in the web-based intervention had reduced scores of depression when compared with the control group; however, this was not significant.
Haga et al [55]Depression10.121.03At all 4 follow-up time points of this study, pregnant people participating in the Mamma Mia had significantly lower depressive scores in comparison with the control group.
Yang et al [63]Anxiety and depression2Anxiety: 0.868; depression: 0.933Anxiety: <.001; depression: <.001In comparison with the control group who had received in-person treatment, the participants belonging to the WeChat intervention reported significant reduction in anxiety and depressive scores.
Krusche et al [53]Anxiety and depression1Anxiety: 0.641; depression: 0.677Anxiety: .02; depression: .01There was a significant reduction in scores between intervention and waitlist groups, regarding anxiety and depressive symptoms.
Loughnan et al [54]Anxiety and depression0Anxiety: 0.588; depression: 0.300Anxiety: .01; depression: .19The analysis indicates that the iCBTd group demonstrated no significant group by time interactions for depression symptom reduction. However, the iCBT group showed significantly reduced anxiety symptoms.
Dennis-Tiwary et al [58]Anxiety and depression1Anxiety: –0.305; depression: 0.068Anxiety: .40; depression: .85Results found that individuals in the ABMTe group did not show significant improvements in anxiety and depression.
Sun et al [64]Anxiety and depression2Anxiety: 0.182; depression: 0.155Anxiety: .24; depression: .08Mindfulness training participants reported a decreased risk of positive depressive symptoms and anxiety symptoms in comparison with controls; however, this was not significant.
Forsell et al [65]Depression10.739.02Depression symptoms significantly decreased in the intervention group compared with the control group.
Scherer et al [51]Anxiety00.096.71Levels of stress and anxiety did not significantly decrease in the intervention group when compared with the control group.
Barrera et al [59]Depression3–0.425.16Following the intervention, depression scores in the intervention group did not statistically differ from the control group.
Hanprasertpong et al [66]Anxiety30.010.93Anxiety following the intervention was reduced significantly in both groups in comparison with baseline; however, no significant differences existed among groups after the intervention.
Jareethum et al [67]Anxiety30.624.02In comparison with the control group who received treatment as usual, women receiving SMS text messages during the antenatal period demonstrated significantly decreased levels of anxiety.

aCBT-I: cognitive behavioral therapy for insomnia.

bISI: Insomnia Severity Index.

cPSQI: Pittsburgh Sleep Quality Index.

diCBT: internet-based CBT.

eABMT: attention bias modification training.

Effectiveness of eHealth Interventions for Treatment of Depressive Symptoms During Pregnancy

Overview

A random-effects model was used to analyze the 65% (11/17) of the studies that assessed the effectiveness of eHealth interventions for the treatment of depressive symptoms. There were 2458 participants included in total (intervention: 1221, 49.67% and control: 1237, 50.32%). The pooled effect size reflected a significant effect of eHealth interventions on depressive symptoms with a small effect size (Hedges g=0.293, 95% CI 0.207-0.478; Z=3.090; P=.002; Figure 2). Significant heterogeneity was observed among the studies (Q=29.789; P=.001; I2=66.431). The test of asymmetry funnel plot is displayed in Figure 3. Egger regression test found no evidence of publication bias (b=1.02; t9=1.23; SE 0.831; P=.25). The Begg and Mazumdar rank correlation was nonsignificant (Kendall S statistic=9; Τ=0.163; Z=0.701; P=.48).

Figure 2. Depression–forest plot [52-56,58,59,62,64-66].
View this figure
Figure 3. Depression–funnel plot.
View this figure
Sensitivity Analyses

After systematically removing one study at a time, it was observed that 64% (7/11) of the studies affected the meta-estimate of the effect size of eHealth intervention during pregnancy by >5% [52,53,55,58,59,62,63]. Of the 11 studies, 5 (45%) studies affected the meta-estimate such that it made the estimate larger, however, a significant association was still noted without the studies included (P<.001-.009) [52,55,58,59,62]. Of the 11 studies, 2 (18%) studies affected the meta-estimate such that they made the estimate smaller; however, a significant association was still noted when each individual study was excluded (P=.004-.006) [53,63].

Effectiveness of eHealth Interventions for Treatment of Anxiety Symptoms During Pregnancy

Overview

A random-effects model was used to analyze the 59% (10/17) of the studies that assessed the effectiveness of eHealth interventions for the treatment of anxiety symptoms. There were 1668 participants included in total (intervention: 816, 48.92% and control: 852, 51.08%). The pooled effect size reflected a significant effect of eHealth interventions on anxiety symptoms with a small effect size (Hedges g=0.262, 95% CI 0.046-0.478; Z=2.379; P=.02; Figure 4). Significant heterogeneity was observed among the studies (Q=34.103; P<.001; I2=73.609). The test of asymmetry funnel plot is displayed in Figure 5. Egger regression test found no evidence of publication bias among the studies (b=2.33; t8=1.98; SE 1.18; P=.08). The Begg and Mazumdar rank correlation was nonsignificant (Kendall S statistic=9; Τ=0.200; Z=0.805; P=.42).

Figure 4. Anxiety–forest plot [51-54,58,61,64-67].
View this figure
Figure 5. Anxiety–funnel plot [57,60,63].
View this figure
Sensitivity Analyses

After systematically removing one study at a time, it was observed that all studies affected the meta-estimate of the effect size of eHealth interventions during pregnancy by >5%. Of the 10 studies, 6 (60%) studies affected the meta-estimate such that their removal made the estimate larger, where a significant association was noted when individual studies were excluded (P=.01-.03) [51,52,58,62,64,66]. Of the 10 studies, 3 (30%) studies affected the meta-estimate such that their (individual) removal made the estimate smaller; however, the effect of the intervention remained significant (P=.04) [53,54,67]. Of the 10 studies, 1 (10%) study affected the meta-estimate such that its removal made the estimate smaller and nonsignificant [62].

Effectiveness of eHealth Interventions for Treatment of Insomnia Symptoms During Pregnancy

Overview

A random-effects model was used to analyze the 18% (3/17) of the studies that assessed the effectiveness of eHealth interventions for the treatment of insomnia symptoms. There were 343 participants in total (intervention: 174, 50.7% and control: 169, 49.3%). The pooled effect size showed a significant effect of eHealth interventions on insomnia symptoms with a moderate effect size (Hedges g=0.595, 95% CI 0.379-0.811; Z=5.406; P<.001; Figure 6). No significant heterogeneity was observed among the studies (Q=1.259; P=.53; I2<0.001). The test of asymmetry funnel plot is displayed in Figure 7. Egger regression test found no evidence of publication bias among the studies (b=–1.27; t1=0.709; SE 1.80; P=.61). The Begg and Mazumdar rank correlation was nonsignificant (Kendall S statistic=–1; Τ=–0.33; Z=0.522; P=.60).

Figure 6. Insomnia–forest plot.
View this figure
Figure 7. Insomnia–funnel plot.
View this figure

Moderator Analyses

Using a meta-regression analysis, variables such as human monitoring (yes or no), risk of bias, type of control group used (active control vs nonactive control), treatment goal (treatment or prevention), baseline mental health symptoms (above or below), number of sessions, level of interactivity (web-based or hybrid), type of intervention (ie, CBT and mindfulness), structure (guided vs unguided), frequency (low or high), provider type (health care provider, researcher, or other), and eHealth type (internet or computer, text, and app) were noted as possible moderator variables for the observed effect sizes for both depressive and anxiety symptoms. Moderator analyses were not conducted for insomnia symptoms as there were not enough studies included to run the meta-regression. No significant moderators were detected for anxiety outcomes. However, for depressive outcomes, the meta-regression revealed that intervention type (mindfulness) significantly moderated depressive symptoms, where mindfulness interventions lead to better treatment outcomes in comparison with other intervention types (Tables 6 and 7).

Table 6. Moderators of eHealth intervention effectiveness on depressive symptoms using meta-regression analyses.
ModeratorDepression measure

NβSE95% CIZ valueQP value
Human monitoringa11.3170.201–0.077 to 0.7111.582.49.12
Risk of bias11–.0230.131–0.280 to –0.234–0.180.03.86
Type of control groupb11–.2540.248–0.741 to 0.232–1.021.05.31
Treatment goalc11.1040.234–0.358 to 0.5660.440.20.66
Baseline symptomsd11–.0180.228–0.465 to 0.429–0.080.01.94
Number of sessions9–.0060.010–0.026 to 0.014–0.570.33.57
Interactivity (web-based or hybrid)e11.2470.205–0.156 to 0.6491.201.44.23
Guided versus unguidedf11–.0890.233–0.544 to 0.367–0.380.15.70
Intervention typeg

ABMTh11–.01240.405–0.805 to 0.781–0.039.86.98

CBTi11.40650.229–0.042 to 0.8551.789.86.08

Mindfulness11.5100.1760.166 to 0.8541.919.86.004
Frequencyj11.3390.319–0.286 to 0.9641.061.13.39
Type of providerk

Health care provider11–.0300.250–0.520 to 0.460–0.121.21.90

Researcher11.4640.438–0.394 to 1.3221.061.21.29
eHealth typel

App11.1690.206–0.235 to 0.5730.820.67.41

aNo human monitoring was used as the reference group.

bNonactive control group was used as the reference group.

cPrevention was used as the reference group.

dBelow clinical cutoff was used as the reference group.

eWeb-based interactivity was used as the reference group.

fUnguided was used as the reference group.

gPsychoeducation was used as the reference group.

hABMT: attention bias modification training.

iCBT: cognitive behavioral therapy.

jLow frequency was used as the reference group.

kOther was used as the reference group.

lInternet was used as the reference group.

Table 7. Moderators of eHealth intervention effectiveness on anxiety symptoms using meta-regression analyses.
ModeratorAnxiety measure

NβSE95% CIZ ValueQP value
Human monitoringa10.1100.238–0.357 to 0.5770.460.21.64
Risk of bias10.0340.119–0.200 to 0.2670.280.08.78
Type of control groupb10–.2620.262–0.776 to 0.252–11.00.32
Treatment goalc10.1420.212–0.275 to 0.5580.670.44.51
Baseline symptomsd10.06450.289–0.501 to 0.6300.220.05.82
Number of sessions8.0170.020–0.022 to 0.0550.840.71.40
Interactivity (web-based or hybrid)e10–.0730.240–0.543 to 0.398–0.300.09.76
Guided versus unguidedf10–.2130.258–0.719 to 0.294–0.820.68.41
Intervention typeg

ABMTh10–.3110.504–1.299 to 0.677–0.625.06.54

CBTi10.3490.339–0.315 to 1.0121.035.06.30

Mindfulness10.5340.293–0.041 to 1.1091.825.06.07
General health10.2330.318–0.386 to 0.8610.755.06.46
Frequencyj10.2950.284–0.263 to 0.8521.041.08.30
Type of providerk

Health care provider10–.3700.263–0.885 to 0.145–1.412.11.16

Researcher10–.2250.254–0.722 to 0.272–0.892.11.38
eHealth typel

Smartphone app10–.0410.256–0.543 to 0.459–0.160.84.87

SMS text message10.3720.449–0.508 to 1.2520.830.84.41

aNo human monitoring was used as the reference group.

bNonactive control group was used as the reference group.

cPrevention was used as the reference group.

dBelow clinical cutoff was used as the reference group.

eWeb-based interactivity was used as the reference group.

fUnguided was used as the reference group.

gPsychoeducation was used as the reference group.

hABMT: attention bias modification training.

iCBT: cognitive behavioral therapy.

jLow frequency was used as the reference group.

kOther was used as the reference group.

lInternet was used as the reference group.


Principal Findings

This systematic review and meta-analysis found that eHealth interventions reduced symptoms of anxiety and depression during pregnancy; however, the effect sizes for the treatment of depression and anxiety symptoms were small. eHealth, specifically CBT-I, was associated with improved insomnia symptoms during pregnancy, with a moderate effect size. None of the moderators of treatment response that we investigated emerged as significant, with the exception of intervention type being a significant moderator for depressive outcomes.

Findings showing a small effect size across eHealth interventions are consistent with the findings of other meta-analyses in this area. For instance, a study on the effectiveness of computer-based CBT for the treatment of depressive and anxiety symptoms in adolescent populations reported small to moderate effect sizes [68]. Another meta-analysis that investigated the efficacy of smartphone-based mental health interventions [69] found a small positive effect for individuals within the general population with depressive symptoms. In a meta-analysis that observed eHealth interventions for depression and anxiety in the general population, the overall effect size between intervention and control for depression and anxiety outcomes was small [42]. The consistent findings of small effect sizes for eHealth interventions targeting anxiety and depressive symptoms highlight the need for additional modifications that could increase effectiveness.

The small effect sizes observed for the use of eHealth interventions may be owing to the lack of factors theorized to improve program impact, including human monitoring, mood feedback, and high dropout rates in eHealth studies [70]. In this study, only 29% (5/17) of the studies included used human monitoring [51,52,63,65,66]. Furthermore, studies reported moderate to high attrition rates, which were as high as 75% [59]. As noted during the sensitivity analysis for the anxiety meta-estimate, the removal of the study by Chan et al [62] made the meta-estimate nonsignificant. Part of what may differentiate the study by Chan et al [62] from the other studies included in this meta-analysis is that participants were sent multiple prompts via email if it was noticed that they were not logging into the app. Another helpful component noted in the study by Chan et al [62] was that participants could directly message their obstetrics and gynecology physicians for any questions that they may have—again highlighting the importance of reminders and human monitoring throughout eHealth interventions.

There was also variability in the type of control groups used across the included studies, where some studies used a TAU control group, some used a waitlist control group, and others used an active control group (where control participants receive some sort of intervention that differs from the actual treatment). For example, in some studies, participants assigned to the control group were provided psychoeducation [61,63]. Although the use of an active control tends to reduce the observed effect sizes, moderator analyses found that the type of comparison group did not moderate the effectiveness of eHealth interventions. Furthermore, it should be noted that most studies included in the review used control conditions that were TAU and comparing with TAU may inflate effect sizes, as any sort of intervention is expected to be more helpful than no intervention. eHealth interventions do not necessarily need to outperform pre-existing face-to-face visits for them to be implemented in regular practice and these findings show that they likely outperform TAU.

For depression, the type of intervention emerged as a significant moderator of treatment effect (b=0.510; P=.004). Specifically, studies using mindfulness eHealth interventions had significant treatment outcomes compared with other interventions including CBT, attention bias modification training, and psychoeducation. Other intervention types did not significantly moderate the treatment effect, though CBT was approaching significance (b=0.407; P=.08). This finding could suggest that mindfulness eHealth interventions are more effective than CBT eHealth interventions under certain circumstances. For example, a study comparing CBT and mindfulness-based cognitive therapy to treat anxiety and depression in a diabetic population found that individuals with higher educational attainment responded better to mindfulness-based cognitive therapy compared with CBT [71].

Regarding anxiety, results from the moderator analyses showed that none of the hypothesized moderators influenced the effectiveness of the eHealth intervention on anxiety symptoms. Potentially, the null results in this study may be owing to the small number of studies included, thus limiting the statistical power of the study. However, the overall lack of significant moderators in this review is similar to results from recent meta-analyses, which also found that risk of bias, number of sessions, and therapist guidance (guided or unguided) did not significantly moderate depression and anxiety outcomes in eHealth intervention [72]. In contrast, findings from other meta-analyses on eHealth interventions in the general population suggest that intervention-level variables such as whether the intervention was guided or unguided, number of sessions, and the type of comparison group chosen significantly influenced the outcome [73,74]. Future researchers should continue to examine the possibility of moderators that were not investigated in this review, which may moderate treatment outcomes. For instance, experiences of poverty, racism, medical system marginalization, and single parent status are all moderators, which are known to contribute to elevated risk for maternal–child outcomes [75,76]. For example, in a study by Giscombé and Lobel [76] the authors found that compared with European Americans, African American infants show disproportionately higher rates of low birth weight, preterm delivery, and death during the first year of life. The review of the literature reveals that these outcomes are explained partly by various factors including socioeconomic status, higher levels of stress in African American women, racism, and ethnic differences in certain stress-related processes [76]. Similarly, another review revealed higher odds of low birth weight, preterm birth, stillbirth, and infant mortality among various indigenous populations [77]. Consequently, these various types of experiences can have a negative impact on treatment outcome. As such, these experiences should be taken into consideration when generalizing treatment efficacy to a heterogeneous population of women of various racial and socioeconomic backgrounds.

The eHealth intervention treatment of antenatal insomnia produced the largest effect size. However, this finding should be interpreted with caution, because only 3 studies on insomnia were included in this analysis. However, all of the included insomnia studies were evidence-based psychological interventions and this finding is in line with the general CBT-I literature, which has shown moderate to large effect sizes when treatment is delivered digitally [78]. The moderate effect sizes observed in eHealth interventions treating insomnia in comparison with the small effect sizes for eHealth interventions treating anxiety and depression may be owing to the use of standardized and highly behavioral treatment protocols that are established to work in person. Presentation of anxiety and depression may arise owing to myriad factors (ie, genetics, work, social support, partner support, and socioeconomic status), some of which may not be adequately targeted through digital intervention.

Limitations

These findings should be interpreted in the context of several limitations. First, the sample sizes of the selected studies were small. In addition, most of the studies had moderate to high levels of participant attrition—a problem that is commonly identified in the eHealth literature [79]. High levels of attrition are attributed to the lack of human interactions in some eHealth interventions [80]. There was also high heterogeneity among interventions treating symptoms of anxiety and depression. Methodological variations within selected studies included variability in intervention, intervention intensity, duration of the intervention, and mode of eHealth delivery (ie, app, SMS text message, and internet). It should be noted that although telephone-based studies were also eHealth interventions of interest, the review did not identify any telephone-based studies, which may be owing to the rise in technology, which is supported by the fact that most of the interventions were delivered through the internet (12/17, 71%). Another limitation of this research is that most of the studies included in the review were conducted in the context of a high-income country rather than low-income countries, which may limit the generalizability of the findings. Fathers have significantly elevated rates of depression and anxiety during pregnancy and the postpartum period [81,82]; however, this meta-analysis found no studies that focused on men and partners during pregnancy, despite this having been an initial goal in the search. Research concerning fathers and partners during pregnancy is a future direction for eHealth research. Participants’ race and ethnicity were also rarely reported in the included studies, limiting our ability to examine moderation by race and ethnicity. This is a common limitation of RCTs and should be addressed in future studies [83,84].

Future Directions

The accessibility to rural or underserved areas and flexibility of eHealth interventions makes eHealth an important part of health care beyond the pandemic. Given that eHealth interventions can take the form of web-based programs, remote monitoring, teleconsultation, and mobile device–supported programs, eHealth interventions provide many potential avenues for pregnant women to receive care for mental health problems. Future eHealth trials should consider a stepped model for mental health interventions [85-87], whereby mild mental health symptoms can be matched with lower-resourced interventions, such as eHealth. More significant symptoms are matched with face-to-face intervention, longer sessions, and more clinician interaction [87]. eHealth could also be used to track patient symptoms, which could be a promising way to detect worsening mental health and prevent future symptom deterioration. In addition, partners and fathers are also subject to symptoms of anxiety and depression perinatally. As such, during pregnancy, fathers and partners may benefit from adapted eHealth treatments [81].

eHealth intervention trials should also consider implementing conditions that have asynchronous activities (ie, video modules) compared with synchronous activities (intensive guidance via the web) [86]. Comparison of these modes of delivery would indicate which mode successfully implements adherence to the app or intervention. This could inform future interventions for methods to decrease attrition and increase engagement.

In addition, further emphasis should be placed on understanding the potential that eHealth interventions may have for communities that have faced medical marginalization and maternal–child health disparities. It is important to consider that health disparities and inequities are often the result of adverse social determinants (including issues related to service access, racism, colonialism, and stigmatization) [88]. For example, research has found that indigenous women do not seek help owing to stigma, racism, fear of being blamed or labeled as a bad parent, and for fear of child apprehension [89]. As such, future research can investigate how eHealth interventions can be tailored to be more culturally sensitive, and thus, more appealing to marginalized groups.

Moreover, it should be noted that not everyone in Canada and other parts of the world have access to the means necessary to engage in eHealth interventions. For example, not everyone has reliable internet or access to computers, telephones, or smartphones. Therefore, health care systems should consider how to provide better support for infrastructure and equipment, specifically for those in rural, remote, and indigenous communities. For instance, only 24% of First Nation reserves in Canada have access to reliable internet [90]. Furthermore, in the United States, low-income Hispanics are the most digitally underserved population and this is not owing to a lack of interest in using internet health services [91]. Rather, this finding stems from barriers including low income, poor digital competence, and limited English proficiency [91]. Furthermore, often, devices are also shared among family members, which also limits internet access. Thus, research should focus on determining how eHealth interventions can be streamlined into the current health care system to increase accessibility to mental health services.

In addition, the finding that none of the included studies required a formal diagnosis of anxiety, depression, or insomnia at baseline is also common in the larger literature of nonspecialist-delivered interventions in high-income countries. This finding may be related to some of the barriers in the delivery of psychological treatment, which include the lack of skilled providers who can provide a formal diagnosis [92]. However, this barrier may be overcome if current trends in global mental health move toward transdiagnostic approaches, which focus on common elements of mental health rather than focusing on any 1 specific disorder [92]. This is because recent evidence suggests that targeting common elements including behavioral activation, communication, and problem solving can reduce the complexity of needing to learn diverse psychological treatment packages for specific clinical phenotypes (such as depression, anxiety, and stress‐related disorders) [92]. Moreover, we see that most of the included studies had interventions that were facilitated by clinicians and peers. However, recent research suggests that a potential solution to increasing accessibility of mental health services is to use nonspecialist providers (ie, nurse practitioners and nurses) and train them in the delivery of brief and low-intensity interventions, which has consistently been found to have moderate to strong effects in reducing distress associated with mental health concerns [23].

Finally, future research on eHealth can be directed toward determining how eHealth interventions can be smoothly integrated into the current health care system to streamline patient care and increase patient accessibility to mental health services.

Conclusions

In conclusion, this review demonstrated that eHealth interventions reduced symptoms of anxiety, depression, and insomnia in individuals during pregnancy in comparison with controls. eHealth interventions for anxiety, depression, and insomnia symptoms hold promise as adjuncts to other clinical approaches and as a component to stepped-care models of treatment for mental health problems [93,94].

Acknowledgments

This study was supported by the generous donors of the Alberta Children's Hospital Foundation, the Canadian Child Health Clinician Scientist Program, the Canadian Institute of Health Research, the Social Sciences and Humanities Research Council, and graduate and postdoctoral fellowships provided by the Social Sciences and Humanities Research Council. The authors thank the team of research assistants who contributed to data collection and extraction, including Roshni Sohail, Jasleen Kaur, Hangsel Sanguino, Beatrice Valmana, Songyang (Mark) Jin, and Makayla Freeman, who reviewed our initial search. Finally, the authors are thankful to the many authors who contributed supplementary data, which allowed them to include their manuscripts in this review.

Conflicts of Interest

None declared.

Multimedia Appendix 1

Search strategy used for the review.

PNG File , 244 KB

  1. Gavin NI, Gaynes BN, Lohr KN, Meltzer-Brody S, Gartlehner G, Swinson T. Perinatal depression. Obstetrics Gynecol 2005;106(5, Part 1):1071-1083. [CrossRef]
  2. Grigoriadis S, Graves L, Peer M, Mamisashvili L, Tomlinson G, Vigod SN, et al. Maternal anxiety during pregnancy and the association with adverse perinatal outcomes: systematic review and meta-analysis. J Clin Psychiatry 2018 Sep 04;79(5):17r12011 [FREE Full text] [CrossRef] [Medline]
  3. Roth T. Insomnia: definition, prevalence, etiology, and consequences. J Clin Sleep Med 2007 Aug 15;3(5 suppl):S7-10. [CrossRef]
  4. Sedov I, Anderson N, Dhillon A, Tomfohr-Madsen L. Insomnia symptoms during pregnancy: a meta-analysis. J Sleep Res 2021 Feb;30(1):e13207. [CrossRef] [Medline]
  5. Sedov ID, Cameron EE, Madigan S, Tomfohr-Madsen LM. Sleep quality during pregnancy: a meta-analysis. Sleep Med Rev 2018 Apr;38:168-176. [CrossRef] [Medline]
  6. Sedov ID, Tomfohr-Madsen LM. Trajectories of insomnia symptoms and associations with mood and anxiety from early pregnancy to the postpartum. Behav Sleep Med 2021;19(3):395-406. [CrossRef] [Medline]
  7. Qu F, Wu Y, Zhu Y, Barry J, Ding T, Baio G, et al. The association between psychological stress and miscarriage: a systematic review and meta-analysis. Sci Rep 2017 May 11;7(1):1731 [FREE Full text] [CrossRef] [Medline]
  8. Accortt EE, Cheadle AC, Dunkel Schetter C. Prenatal depression and adverse birth outcomes: an updated systematic review. Matern Child Health J 2015 Jun;19(6):1306-1337 [FREE Full text] [CrossRef] [Medline]
  9. Warland J, Dorrian J, Morrison JL, O'Brien LM. Maternal sleep during pregnancy and poor fetal outcomes: a scoping review of the literature with meta-analysis. Sleep Med Rev 2018 Oct;41:197-219. [CrossRef] [Medline]
  10. Ahmed A, Bowen A, Feng CX, Muhajarine N. Trajectories of maternal depressive and anxiety symptoms from pregnancy to five years postpartum and their prenatal predictors. BMC Pregnancy Childbirth 2019 Jan 14;19(1):26 [FREE Full text] [CrossRef] [Medline]
  11. Wisner KL, Sit DK, McShea MC, Rizzo DM, Zoretich RA, Hughes CL, et al. Onset timing, thoughts of self-harm, and diagnoses in postpartum women with screen-positive depression findings. JAMA Psychiatry 2013 May;70(5):490-498 [FREE Full text] [CrossRef] [Medline]
  12. Van den Bergh BR, Dahnke R, Mennes M. Prenatal stress and the developing brain: risks for neurodevelopmental disorders. Dev Psychopathol 2018 Aug 02;30(3):743-762. [CrossRef]
  13. Van den Bergh BR, van den Heuvel MI, Lahti M, Braeken M, de Rooij SR, Entringer S, et al. Prenatal developmental origins of behavior and mental health: the influence of maternal stress in pregnancy. Neurosci Biobehav Rev 2020 Oct;117:26-64. [CrossRef] [Medline]
  14. Glover V. Maternal depression, anxiety and stress during pregnancy and child outcome; what needs to be done. Best Pract Res Clin Obstet Gynaecol 2014 Jan;28(1):25-35. [CrossRef] [Medline]
  15. Lebel C, Walton M, Letourneau N, Giesbrecht GF, Kaplan BJ, Dewey D. Prepartum and postpartum maternal depressive symptoms are related to children's brain structure in preschool. Biol Psychiatry 2016 Dec 01;80(11):859-868. [CrossRef] [Medline]
  16. US Preventive Services Task Force, Curry SJ, Krist AH, Owens DK, Barry MJ, Caughey AB, et al. Interventions to prevent perinatal depression: US Preventive Services Task Force Recommendation Statement. JAMA 2019 Feb 12;321(6):580-587. [CrossRef] [Medline]
  17. Sockol LE. A systematic review of the efficacy of cognitive behavioral therapy for treating and preventing perinatal depression. J Affect Disord 2015 May 15;177:7-21. [CrossRef] [Medline]
  18. Mental health care in the perinatal period: Australian clinical practice guideline. Australian Government National Health and Medical Research Council.   URL: https:/​/www.​clinicalguidelines.gov.au/​portal/​2586/​mental-health-care-perinatal-period-australian-clinical-practice-guideline [accessed 2022-02-02]
  19. Bedrick AD. Guidelines for perinatal care. Arch Pediatr Adolesc Med 1984 Aug 01;138(8):748. [CrossRef]
  20. The perinatal mental health care pathways. NHS England.   URL: https://www.england.nhs.uk/publication/the-perinatal-mental-health-care-pathways/ [accessed 2022-02-02]
  21. Venkatesh KK, Nadel H, Blewett D, Freeman MP, Kaimal AJ, Riley LE. Implementation of universal screening for depression during pregnancy: feasibility and impact on obstetric care. Am J Obstet Gynecol 2016 Oct;215(4):517.e1-517.e8. [CrossRef] [Medline]
  22. San Martin Porter MA, Betts K, Kisely S, Pecoraro G, Alati R. Screening for perinatal depression and predictors of underscreening: findings of the Born in Queensland study. Med J Aust 2019 Jan;210(1):32-37. [CrossRef] [Medline]
  23. Singla DR, Lemberg-Pelly S, Lawson A, Zahedi N, Thomas-Jacques T, Dennis C. Implementing psychological interventions through nonspecialist providers and telemedicine in high-income countries: qualitative study from a multistakeholder perspective. JMIR Ment Health 2020 Aug 27;7(8):e19271 [FREE Full text] [CrossRef] [Medline]
  24. Torous J, Jän Myrick K, Rauseo-Ricupero N, Firth J. Digital mental health and COVID-19: using technology today to accelerate the curve on access and quality tomorrow. JMIR Ment Health 2020 Mar 26;7(3):e18848 [FREE Full text] [CrossRef] [Medline]
  25. O'Connor E, Rossom RC, Henninger M, Groom HC, Burda BU. Primary care screening for and treatment of depression in pregnant and postpartum women: evidence report and systematic review for the US preventive services task force. JAMA 2016 Jan 26;315(4):388-406. [CrossRef] [Medline]
  26. Coates AO, Schaefer CA, Alexander JL. Detection of postpartum depression and anxiety in a large health plan. J Behav Health Services Res 2004;31(2):117-133. [CrossRef]
  27. Reay R, Matthey S, Ellwood D, Scott M. Long-term outcomes of participants in a perinatal depression early detection program. J Affect Disord 2011 Mar;129(1-3):94-103. [CrossRef] [Medline]
  28. Bowen A, Bowen R, Butt P, Rahman K, Muhajarine N. Patterns of depression and treatment in pregnant and postpartum women. Can J Psychiatry 2012 Mar;57(3):161-167. [CrossRef] [Medline]
  29. Keefe RH, Brownstein-Evans C, Polmanteer RS. The challenges of idealized mothering. Affilia 2017 Dec 27;33(2):221-235. [CrossRef]
  30. Schuppan KM, Roberts R, Powrie R. Paternal perinatal mental health: at-risk fathers’ perceptions of help-seeking and screening. J Men’s Stud 2019 Feb 18;27(3):307-328. [CrossRef]
  31. World Health Organization. MHealth: New Horizons for Health Through Mobile Technologies. Geneva: World Health Organization; 2011.
  32. Kilo CM. Transforming care: medical practice design and information technology. Health Aff (Millwood) 2005;24(5):1296-1301. [CrossRef] [Medline]
  33. Bueno-Notivol J, Gracia-García P, Olaya B, Lasheras I, López-Antón R, Santabárbara J. Prevalence of depression during the COVID-19 outbreak: a meta-analysis of community-based studies. Int J Clin Health Psychol 2021;21(1):100196 [FREE Full text] [CrossRef] [Medline]
  34. Salari N, Hosseinian-Far A, Jalali R, Vaisi-Raygani A, Rasoulpoor S, Mohammadi M, et al. Prevalence of stress, anxiety, depression among the general population during the COVID-19 pandemic: a systematic review and meta-analysis. Global Health 2020 Jul 06;16(1):57 [FREE Full text] [CrossRef] [Medline]
  35. Okagbue HI, Adamu PI, Bishop SA, Oguntunde PE, Opanuga AA, Akhmetshin EM. Systematic review of prevalence of antepartum depression during the trimesters of pregnancy. Open Access Maced J Med Sci 2019 May 15;7(9):1555-1560 [FREE Full text] [CrossRef] [Medline]
  36. Biaggi A, Conroy S, Pawlby S, Pariante CM. Identifying the women at risk of antenatal anxiety and depression: a systematic review. J Affect Disord 2016 Feb;191:62-77 [FREE Full text] [CrossRef] [Medline]
  37. Tomfohr-Madsen LM, Racine N, Giesbrecht GF, Lebel C, Madigan S. Depression and anxiety in pregnancy during COVID-19: a rapid review and meta-analysis. Psychiatry Res 2021 Jun;300:113912. [CrossRef] [Medline]
  38. Yan H, Ding Y, Guo W. Mental health of pregnant and postpartum women during the coronavirus disease 2019 pandemic: a systematic review and meta-analysis. Front Psychol 2020;11:617001 [FREE Full text] [CrossRef] [Medline]
  39. Dolsen MR, Asarnow LD, Harvey AG. Insomnia as a transdiagnostic process in psychiatric disorders. Curr Psychiatry Rep 2014 Sep;16(9):471 [FREE Full text] [CrossRef] [Medline]
  40. Torous J. Creating a digital health smartphone app and digital phenotyping platform for mental health and diverse healthcare needs: an interdisciplinary and collaborative approach. J Technol Behav Sci 2019;4(2):73-85. [CrossRef]
  41. Neary M, Schueller SM. State of the field of mental health apps. Cogn Behav Pract 2018 Nov;25(4):531-537 [FREE Full text] [CrossRef] [Medline]
  42. Deady M, Choi I, Calvo RA, Glozier N, Christensen H, Harvey SB. eHealth interventions for the prevention of depression and anxiety in the general population: a systematic review and meta-analysis. BMC Psychiatry 2017 Aug 29;17(1):310 [FREE Full text] [CrossRef] [Medline]
  43. Soh HL, Ho RC, Ho CS, Tam WW. Efficacy of digital cognitive behavioural therapy for insomnia: a meta-analysis of randomised controlled trials. Sleep Med 2020 Nov;75:315-325. [CrossRef] [Medline]
  44. Seyffert M, Lagisetty P, Landgraf J, Chopra V, Pfeiffer PN, Conte ML, et al. Internet-delivered cognitive behavioral therapy to treat insomnia: a systematic review and meta-analysis. PLoS One 2016;11(2):e0149139 [FREE Full text] [CrossRef] [Medline]
  45. Covidence systematic review software. Veritas Health Innovation.   URL: https://www.covidence.org/ [accessed 2022-02-02]
  46. Higgins J, Altman DG, Gøtzsche PC, Jüni P, Moher D, Oxman AD, Cochrane Bias Methods Group, Cochrane Statistical Methods Group. The Cochrane Collaboration's tool for assessing risk of bias in randomised trials. BMJ 2011 Oct 18;343:d5928 [FREE Full text] [CrossRef] [Medline]
  47. Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, PRISMA-P Group. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev 2015 Jan 01;4:1 [FREE Full text] [CrossRef] [Medline]
  48. Page MJ, Moher D, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. PRISMA 2020 explanation and elaboration: updated guidance and exemplars for reporting systematic reviews. BMJ 2021 Mar 29;372:n160 [FREE Full text] [CrossRef] [Medline]
  49. Comprehensive meta-analysis version 3.0. Software Informer.   URL: https://comprehensive-meta-analysis.software.informer.com/3.3/ [accessed 2022-02-02]
  50. Cohen J. Statistical Power Analysis for the Behavioral Sciences. New York: Routledge; 1988.
  51. Scherer S, Alder J, Gaab J, Berger T, Ihde K, Urech C. Patient satisfaction and psychological well-being after internet-based cognitive behavioral stress management (IB-CBSM) for women with preterm labor: a randomized controlled trial. J Psychosom Res 2016 Jan;80:37-43. [CrossRef] [Medline]
  52. Heller HM, Hoogendoorn AW, Honig A, Broekman BF, van Straten A. The effectiveness of a guided internet-based tool for the treatment of depression and anxiety in pregnancy (MamaKits online): randomized controlled trial. J Med Internet Res 2020 Mar 23;22(3):e15172 [FREE Full text] [CrossRef] [Medline]
  53. Krusche A, Dymond M, Murphy SE, Crane C. Mindfulness for pregnancy: a randomised controlled study of online mindfulness during pregnancy. Midwifery 2018 Oct;65:51-57. [CrossRef] [Medline]
  54. Loughnan SA, Sie A, Hobbs MJ, Joubert AE, Smith J, Haskelberg H, et al. A randomized controlled trial of 'MUMentum Pregnancy': internet-delivered cognitive behavioral therapy program for antenatal anxiety and depression. J Affect Disord 2019 Jan 15;243:381-390. [CrossRef] [Medline]
  55. Haga SM, Drozd F, Lisøy C, Wentzel-Larsen T, Slinning K. Mamma Mia – A randomized controlled trial of an internet-based intervention for perinatal depression. Psychol Med 2018 Sep 7;49(11):1850-1858. [CrossRef]
  56. Duffecy J, Grekin R, Hinkel H, Gallivan N, Nelson G, O'Hara MW. A group-based online intervention to prevent postpartum depression (Sunnyside): feasibility randomized controlled trial. JMIR Ment Health 2019 May 28;6(5):e10778 [FREE Full text] [CrossRef] [Medline]
  57. Felder JN, Epel ES, Neuhaus J, Krystal AD, Prather AA. Efficacy of digital cognitive behavioral therapy for the treatment of insomnia symptoms among pregnant women: a randomized clinical trial. JAMA Psychiatry 2020 May 01;77(5):484-492 [FREE Full text] [CrossRef] [Medline]
  58. Dennis-Tiwary TA, Denefrio S, Gelber S. Salutary effects of an attention bias modification mobile application on biobehavioral measures of stress and anxiety during pregnancy. Biol Psychol 2017 Jul;127:148-156 [FREE Full text] [CrossRef] [Medline]
  59. Barrera AZ, Wickham RE, Muñoz RF. Online prevention of postpartum depression for Spanish- and English-speaking pregnant women: a pilot randomized controlled trial. Internet Interv 2015 Sep 01;2(3):257-265 [FREE Full text] [CrossRef] [Medline]
  60. Kalmbach DA, Cheng P, O'Brien LM, Swanson LM, Sangha R, Sen S, et al. A randomized controlled trial of digital cognitive behavioral therapy for insomnia in pregnant women. Sleep Med 2020 Aug;72:82-92 [FREE Full text] [CrossRef] [Medline]
  61. Cain MA, Brumley J, Louis-Jacques A, Drerup M, Stern M, Louis JM. A pilot study of a sleep intervention delivered through group prenatal care to overweight and obese women. Behav Sleep Med 2020;18(4):477-487. [CrossRef] [Medline]
  62. Chan KL, Leung WC, Tiwari A, Or KL, Ip P. Using smartphone-based psychoeducation to reduce postnatal depression among first-time mothers: randomized controlled trial. JMIR Mhealth Uhealth 2019 May 14;7(5):e12794 [FREE Full text] [CrossRef] [Medline]
  63. Yang M, Jia G, Sun S, Ye C, Zhang R, Yu X. Effects of an online mindfulness intervention focusing on attention monitoring and acceptance in pregnant women: a randomized controlled trial. J Midwifery Womens Health 2019 Jan;64(1):68-77. [CrossRef] [Medline]
  64. Sun Y, Li Y, Wang J, Chen Q, Bazzano AN, Cao F. Effectiveness of smartphone-based mindfulness training on maternal perinatal depression: randomized controlled trial. J Med Internet Res 2021 Jan 27;23(1):e23410 [FREE Full text] [CrossRef] [Medline]
  65. Forsell E, Bendix M, Holländare F, Szymanska von Schultz B, Nasiell J, Blomdahl-Wetterholm M, et al. Internet delivered cognitive behavior therapy for antenatal depression: a randomised controlled trial. J Affect Disord 2017 Oct 15;221:56-64 [FREE Full text] [CrossRef] [Medline]
  66. Hanprasertpong T, Rattanaprueksachart R, Janwadee S, Geater A, Kor-anantakul O, Suwanrath C, et al. Comparison of the effectiveness of different counseling methods before second trimester genetic amniocentesis in Thailand. Prenat Diagn 2013 Dec;33(12):1189-1193. [CrossRef] [Medline]
  67. Jareethum R, Titapant V, Chantra T, Sommai V, Chuenwattana P, Jirawan C. Satisfaction of healthy pregnant women receiving short message service via mobile phone for prenatal support: a randomized controlled trial. J Med Assoc Thai 2008 Apr;91(4):458-463. [Medline]
  68. Christ C, Schouten MJ, Blankers M, van Schaik DJ, Beekman AT, Wisman MA, et al. Internet and computer-based cognitive behavioral therapy for anxiety and depression in adolescents and young adults: systematic review and meta-analysis. J Med Internet Res 2020 Sep 25;22(9):e17831 [FREE Full text] [CrossRef] [Medline]
  69. Firth J, Torous J, Nicholas J, Carney R, Pratap A, Rosenbaum S, et al. The efficacy of smartphone-based mental health interventions for depressive symptoms: a meta-analysis of randomized controlled trials. World Psychiatry 2017 Oct;16(3):287-298 [FREE Full text] [CrossRef] [Medline]
  70. Torous J, Lipschitz J, Ng M, Firth J. Dropout rates in clinical trials of smartphone apps for depressive symptoms: a systematic review and meta-analysis. J Affect Disord 2020 Feb 15;263:413-419. [CrossRef] [Medline]
  71. Tovote KA, Schroevers MJ, Snippe E, Emmelkamp PM, Links TP, Sanderman R, et al. What works best for whom? Cognitive behavior therapy and mindfulness-based cognitive therapy for depressive symptoms in patients with diabetes. PLoS One 2017 Jun 29;12(6):e0179941 [FREE Full text] [CrossRef] [Medline]
  72. O'Connor M, Munnelly A, Whelan R, McHugh L. The efficacy and acceptability of third-wave behavioral and cognitive eHealth treatments: a systematic review and meta-analysis of randomized controlled trials. Behav Ther 2018 May;49(3):459-475. [CrossRef] [Medline]
  73. Reins J, Buntrock C, Zimmermann J, Grund S, Harrer M, Lehr D, et al. Efficacy and moderators of internet-based interventions in adults with subthreshold depression: an individual participant data meta-analysis of randomized controlled trials. Psychother Psychosom 2021;90(2):94-106 [FREE Full text] [CrossRef] [Medline]
  74. Riper H, Hoogendoorn A, Cuijpers P, Karyotaki E, Boumparis N, Mira A, et al. Effectiveness and treatment moderators of internet interventions for adult problem drinking: an individual patient data meta-analysis of 19 randomised controlled trials. PLoS Med 2018 Dec;15(12):e1002714 [FREE Full text] [CrossRef] [Medline]
  75. Nkansah-Amankra S, Dhawain A, Hussey JR, Luchok KJ. Maternal social support and neighborhood income inequality as predictors of low birth weight and preterm birth outcome disparities: analysis of South Carolina Pregnancy Risk Assessment and Monitoring System survey, 2000-2003. Matern Child Health J 2010 Sep;14(5):774-785. [CrossRef] [Medline]
  76. Giscombé CL, Lobel M. Explaining disproportionately high rates of adverse birth outcomes among African Americans: the impact of stress, racism, and related factors in pregnancy. Psychol Bull 2005 Sep;131(5):662-683 [FREE Full text] [CrossRef] [Medline]
  77. Shah PS, Zao J, Al-Wassia H, Shah V, Knowledge Synthesis Group on Determinants of Preterm/LBW Births. Pregnancy and neonatal outcomes of aboriginal women: a systematic review and meta-analysis. Womens Health Issues 2011;21(1):28-39. [CrossRef] [Medline]
  78. Zachariae R, Lyby MS, Ritterband LM, O'Toole MS. Efficacy of internet-delivered cognitive-behavioral therapy for insomnia - A systematic review and meta-analysis of randomized controlled trials. Sleep Med Rev 2016 Dec;30:1-10. [CrossRef] [Medline]
  79. Geraghty AW, Torres LD, Leykin Y, Pérez-Stable EJ, Muñoz RF. Understanding attrition from international Internet health interventions: a step towards global eHealth. Health Promot Int 2013 Sep;28(3):442-452 [FREE Full text] [CrossRef] [Medline]
  80. Mohr DC, Cuijpers P, Lehman K. Supportive accountability: a model for providing human support to enhance adherence to eHealth interventions. J Med Internet Res 2011 Mar 10;13(1):e30 [FREE Full text] [CrossRef] [Medline]
  81. Cameron EE, Sedov ID, Tomfohr-Madsen LM. Prevalence of paternal depression in pregnancy and the postpartum: an updated meta-analysis. J Affect Disord 2016 Dec;206:189-203. [CrossRef] [Medline]
  82. Philpott LF, Savage E, FitzGerald S, Leahy-Warren P. Anxiety in fathers in the perinatal period: a systematic review. Midwifery 2019 Sep;76:54-101. [CrossRef] [Medline]
  83. Polo AJ, Makol BA, Castro AS, Colón-Quintana N, Wagstaff AE, Guo S. Diversity in randomized clinical trials of depression: a 36-year review. Clin Psychol Rev 2019 Feb;67:22-35. [CrossRef] [Medline]
  84. Hussain-Gambles M, Atkin K, Leese B. Why ethnic minority groups are under-represented in clinical trials: a review of the literature. Health Soc Care Community 2004 Sep;12(5):382-388. [CrossRef] [Medline]
  85. Anderson J, O'Moore K, Faraj M, Proudfoot J. Stepped care mental health service in Australian primary care: codesign and feasibility study. Aust. Health Review 2020;44(6):873. [CrossRef]
  86. Mohr DC, Lattie EG, Tomasino KN, Kwasny MJ, Kaiser SM, Gray EL, et al. A randomized noninferiority trial evaluating remotely-delivered stepped care for depression using internet cognitive behavioral therapy (CBT) and telephone CBT. Behav Res Ther 2019 Dec;123:103485 [FREE Full text] [CrossRef] [Medline]
  87. Nicholas J, Ringland KE, Graham AK, Knapp AA, Lattie EG, Kwasny MJ, et al. Stepping Up: predictors of 'stepping' within an iCBT stepped-care intervention for depression. Int J Environ Res Public Health 2019 Nov 25;16(23):4689 [FREE Full text] [CrossRef] [Medline]
  88. Adler NE, Glymour MM, Fielding J. Addressing social determinants of health and health inequalities. JAMA 2016 Oct 25;316(16):1641-1642. [CrossRef] [Medline]
  89. Sharma S, Kolahdooz F, Launier K, Nader F, June Yi K, Baker P, et al. Canadian indigenous womens perspectives of maternal health and health care services: a systematic review. Divers Equal Health Care 2016;13(5):334-338. [CrossRef]
  90. Communications monitoring report. Canadian Radio-television and Telecommunications Commission.   URL: https://publications.gc.ca/site/eng/9.506067/publication.html [accessed 2022-02-02]
  91. Ginossar T, Nelson S. Reducing the health and digital divides: a model for using community-based participatory research approach to e-health interventions in low-income Hispanic communities. J Comput Mediated Commun 2010;15(4):a-551. [CrossRef]
  92. Singla DR, Raviola G, Patel V. Scaling up psychological treatments for common mental disorders: a call to action. World Psychiatry 2018 Jun;17(2):226-227 [FREE Full text] [CrossRef] [Medline]
  93. O'Donohue W, Draper C. The case for evidence-based stepped care as part of a reformed delivery system. In: Stepped Care and E-health: Practical Applications to Behavioral Disorders. Berlin/Heidelberg, Germany: Springer Science + Business Media; 2011.
  94. Clough BA, Casey LM. Technological adjuncts to increase adherence to therapy: a review. Clin Psychol Rev 2011 Jul;31(5):697-710. [CrossRef] [Medline]


CBT: cognitive behavioral therapy
CBT-I: cognitive behavioral therapy for insomnia
PRISMA: Preferred Reporting Items for Systematic Review and Meta-Analysis
PROSPERO: International Prospective Register of Systematic Reviews
RCT: randomized controlled trial
TAU: treatment as usual


Edited by J Torous; submitted 09.06.21; peer-reviewed by D Singla, N Subedi; comments to author 16.08.21; revised version received 08.10.21; accepted 05.11.21; published 21.02.22

Copyright

©Katherine A Silang, Pooja R Sohal, Katherine S Bright, Jennifer Leason, Leslie Roos, Catherine Lebel, Gerald F Giesbrecht, Lianne M Tomfohr-Madsen. Originally published in JMIR Mental Health (https://mental.jmir.org), 21.02.2022.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Mental Health, is properly cited. The complete bibliographic information, a link to the original publication on https://mental.jmir.org/, as well as this copyright and license information must be included.