This paper is in the following e-collection/theme issue:

Mobile Health in Psychiatry (403) JMIR Theme Issue: COVID-19 Special Issue (2392) Registered Report (520) Text-messaging (SMS, WeChat etc)-Based Interventions (622) Depression and Mood Disorders; Suicide Prevention (1283) JMH Theme Issue: COVID-19 and Mental Health: Impact and Interventions (374)

Published on in Vol 7, No 12 (2020): December

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/22423, first published .
Changes in Stress, Anxiety, and Depression Levels of Subscribers to a Daily Supportive Text Message Program (Text4Hope) During the COVID-19 Pandemic: Cross-Sectional Survey Study

Changes in Stress, Anxiety, and Depression Levels of Subscribers to a Daily Supportive Text Message Program (Text4Hope) During the COVID-19 Pandemic: Cross-Sectional Survey Study

Changes in Stress, Anxiety, and Depression Levels of Subscribers to a Daily Supportive Text Message Program (Text4Hope) During the COVID-19 Pandemic: Cross-Sectional Survey Study

Authors of this article:

Vincent Israel Ouoku Agyapong1 Author Orcid Image ;   Marianne Hrabok2 Author Orcid Image ;   Wesley Vuong3 Author Orcid Image ;   Reham Shalaby1 Author Orcid Image ;   Jasmine Marie Noble1 Author Orcid Image ;   April Gusnowski3 Author Orcid Image ;   Kelly J Mrklas4, 5 Author Orcid Image ;   Daniel Li3 Author Orcid Image ;   Liana Urichuk3 Author Orcid Image ;   Mark Snaterse3 Author Orcid Image ;   Shireen Surood3 Author Orcid Image ;   Bo Cao1 Author Orcid Image ;   Xin-Min Li1 Author Orcid Image ;   Russell Greiner1 Author Orcid Image ;   Andrew James Greenshaw1 Author Orcid Image
Article Authors Cited by (50) Tweetations (5) Metrics

    Original Paper

    1Department of Psychiatry, Faculty of Medicine and Dentistry, University of Alberta, Edmonton, AB, Canada

    2University of Calgary, Calgary, AB, Canada

    3Alberta Health Services, Edmonton, AB, Canada

    4Provincial Clinical Excellence, Alberta Health Services, Calgary, AB, Canada

    5Department of Community Health Sciences, Cumming School of Medicine, University of Calgary, Calgary, AB, Canada

    Corresponding Author:

    Vincent Israel Ouoku Agyapong, MD, PhD

    Department of Psychiatry

    Faculty of Medicine and Dentistry

    University of Alberta

    1E1 Walter Mackenzie Health Sciences Centre

    8440 112 St NW

    Edmonton, AB, T6G 2B7

    Canada

    Phone: 1 780 215 7771

    Email: agyapong@ualberta.ca


    Background: In addition to the obvious physical medical impact of COVID-19, the disease poses evident threats to people’s mental health, psychological safety, and well-being. Provision of support for these challenges is complicated by the high number of people requiring support and the need to maintain physical distancing. Text4Hope, a daily supportive SMS text messaging program, was launched in Canada to mitigate the negative mental health impacts of the pandemic among Canadians.

    Objective: This paper describes the changes in the stress, anxiety, and depression levels of subscribers to the Text4Hope program after 6 weeks of exposure to daily supportive SMS text messages.

    Methods: We used self-administered, empirically supported web-based questionnaires to assess the demographic and clinical characteristics of Text4Hope subscribers. Perceived stress, anxiety, and depression were measured with the 10-Item Perceived Stress Scale (PSS-10), the Generalized Anxiety Disorder–7 (GAD-7) scale, and the Patient Health Questionnaire–9 (PHQ-9) scale at baseline and sixth week time points. Moderate or high perceived stress, likely generalized anxiety disorder, and likely major depressive disorder were assessed using cutoff scores of ≥14 for the PSS-10, ≥10 for the GAD-7, and ≥10 for the PHQ-9, respectively. At 6 weeks into the program, 766 participants had completed the questionnaires at both time points.

    Results: At the 6-week time point, there were statistically significant reductions in mean scores on the PSS-10 and GAD-7 scales but not on the PHQ-9 scale. Effect sizes were small overall. There were statistically significant reductions in the prevalence rates of moderate or high stress and likely generalized anxiety disorder but not likely major depressive disorder for the group that completed both the baseline and 6-week assessments. The largest reductions in mean scores and prevalence rates were for anxiety (18.7% and 13.5%, respectively).

    Conclusions: Text4Hope is a convenient, cost-effective, and accessible means of implementing a population-level psychological intervention. This service demonstrated significant reductions in anxiety and stress levels during the COVID-19 pandemic and could be used as a population-level mental health intervention during natural disasters and other emergencies.

    International Registered Report Identifier (IRRID): RR2-10.2196/19292

    JMIR Ment Health 2020;7(12):e22423

    doi:10.2196/22423

    Keywords

    COVID-19; mobile technology; text; anxiety; depression; stress; outbreak; pandemic; mental health; outreach 


    COVID-19, an acute respiratory disease, was first reported in December 2019 in Wuhan, China. Since the outbreak was declared a pandemic by the World Health Organization [1,2], this disease has continued to have significant, unprecedented impacts on health and patterns of human life worldwide. These impacts include school and business closures as well as the ongoing psychological and social tolls of uncertainty, vigilance, and quarantine. In addition to the obvious physical medical impact of this disease [3,4], it poses evident threats to people’s mental health, psychological safety, and well-being [5-7], particularly given the risk of recurrent outbreaks [8].

    In multiple global jurisdictions, a series of mental health concerns have arisen, including increased stress, anxiety, depression, fear, insomnia, and obsessive-compulsive behaviors. Population-level studies have summarized these effects [9,10]. For example, in a study in China, over half of the respondents rated the psychological impact of COVID-19 as moderate or severe, with 29% reporting significant anxiety symptoms and 17% reporting significant depressive symptoms [11].

    The emergence of mental health issues during the COVID-19 pandemic was not entirely unexpected. There have been reports of increases in stress symptoms, confusion, anger, anxiety, and depression [12-15] as well as in problematic drug and alcohol use [7] related to previous pandemics. Stressors include long quarantine durations, infection fears, frustration, boredom, inadequate supplies, inadequate information, financial loss, and stigma. Quarantine, in particular, is associated with a number of negative psychological and social effects (eg, posttraumatic stress, anger, fear, financial loss, and stigma) [12].

    Although research has provided a description of the psychological impact of COVID-19 [16], the literature regarding interventions or guidelines for managing the mental health impacts of the virus is limited [17]. Countries that were impacted initially by the COVID-19 pandemic identified several problems that increased the difficulty of providing psychological interventions during the pandemic, including barriers to participation, limited efficiency of outreach, and limited capacity of frontline workers to provide support due to competing demands on their time and energy [18]. Provision of psychological support during this pandemic is further complicated by the high number of people requiring support and the need to maintain physical distancing.

    The COVID-19 pandemic has further reinforced the need and urgency of transforming the delivery of mental health services [19] to include telehealth, text messaging, and other digital platforms. Mobile health technologies offer a unique and innovative solution in this context. More specifically, SMS text messaging via mobile phones offers a convenient, cost-effective, and accessible means of implementing population-level interventions. In Canada, almost 90% of residents own a smartphone [20]. Additionally, SMS text messaging is embedded in 98% of mobile phones [21]. Texting is free to the majority of end users, does not require technical skill to use, and is included in most mobile plans. SMS text messages are also cost-effective for providers [22].

    Previous research examining the effectiveness of supportive text messages has demonstrated positive outcomes, including reduction of depressive symptoms and high user satisfaction [23-25]. For example, evaluation of Text4Mood, a text messaging intervention administered following large-scale forest fires in Fort McMurray, Alberta, found that supportive text messages helped subscribers feel more hopeful about managing issues (82%), in charge of managing their depression and anxiety (77%), and connected to a support system (75%); moreover, subscribers stated that the intervention improved their overall mental well-being (83%) [24]. Similar findings were observed in other studies, including Text4Baby, which sought to assist women by providing supportive and informative text messaging during pregnancy, and another text intervention aimed to support the mental health of impoverished women in Bangalore. Participants in both interventions indicated that receiving these text messages gave them a sense of reassurance and made them feel supported [26].

    On March 23, 2020, Alberta Health Services, along with the coauthors of this paper, initiated Text4Hope, a 3-month-long, supportive daily text messaging program using principles of cognitive behavioral therapy (CBT), as an additional mental health support for people living in Alberta during the COVID-19 pandemic [27]. The messages ultimately seek to reduce or inhibit negative thought patterns while suggesting and reinforcing the use of healthy self-coping mechanisms. This program was intended to complement existing addiction and mental health services that individuals might be accessing at the time of participation.

    This paper evaluates the impact of Text4Hope on measures of stress, anxiety, and depression symptoms and provides estimates of prevalence rates 6 weeks into the program.


    The Text4Hope Program

    This cross-sectional comparative study sought to assess the effectiveness of community implementation of a supportive SMS text message intervention program focused on reducing symptoms of stress, anxiety, and depression during the COVID-19 pandemic. The study protocol [28] was approved by the Research and Ethics Board of the University of Alberta (Pro00086163).

    In the Text4Hope program [29], individuals self-subscribe to receive daily supportive SMS text messages for three months by texting the word “COVID19HOPE” to a short code number. The messages are aligned with a cognitive behavioral framework, with content written by mental health professionals and coauthors of this paper (VIOA, MH). The messages were uploaded to a web-based platform, which delivered messages at 9 AM each day. The first message welcomed subscribers to the service and invited them to complete a web-based baseline survey that captured demographic and clinical information. At 6 weeks, subscribers were invited again via a text message link to complete a web-based follow-up survey. At baseline and at 6 weeks, we collected clinical information on stress, anxiety, and depression about each subject based on the 10-Item Perceived Stress Scale (PSS-10) [30], Generalized Anxiety Disorder-7 (GAD-7) scale [31], and the Patient Health Questionnaire-9 (PHQ-9) [32], respectively.

    Data Collection

    We were able to cross-reference clinical and demographic responses from individuals by asking clients to enter the mobile number they used for Text4Hope at the baseline and 6-week time points. No incentives were offered to respondents. Participation in the program was voluntary, and completing the survey was not required to receive the supportive SMS text messages. Subscribers could opt out at any time by texting “STOP” to the same sort code number used to enroll in the program. Baseline data collection occurred between March 23 and 30, 2020, and the sixth week follow-up data were collected between May 3 and 11, 2020. Figure 1 presents the subscriber flowchart, which indicates the number of subscribers who completed the web-based surveys at each time point. Furthermore, on May 11, 2020, there were 45,775 subscribers to the Text4Hope program, of which 6178 subscribers opted out of the program, giving a dropout rate of 13.5%.

    ‎
    Figure 1. Flowchart of subscriber participation from baseline to the sixth week.

    Outcome Measures

    Primary outcomes included the mean differences in scores on the PSS-10, GAD-7, and PHQ-9 scales at the sixth week versus baseline and the changes in the prevalence rates of self-reported moderate or high stress, likely generalized anxiety disorder (GAD), and likely major depressive disorder (MDD) at the sixth week from baseline.

    Hypothesis

    In a sixth-week evaluation report, 77% of subscribers to the related Text4Mood program indicated that the daily supportive text messages helped them to manage their depression and anxiety [24], which informed our decision to evaluate the Text4Hope program at the sixth week and to determine if subscribers generally had reduced anxiety and depression. Furthermore, a randomized controlled trial of daily supportive text messaging resulted in close to 25% additional improvement in mood (measured by the Beck Depression Inventory [BDI]) in the intervention group compared to the control group [23]. On this basis, we hypothesized that the Text4Hope intervention would result in >25% reduction in mean scores and prevalence rates in all 3 factors, the PSS-10, GAD-7, and PHQ-9 scales, at the sixth week versus baseline.

    Sample Size Considerations

    With a projection that daily supportive text messages would result in a 25% reduction in mean PSS-10, GAD-7, and PHQ-9 scores at the sixth week from baseline, a population variance of 5.0 for each scale mean score, a one-sided significance level α=.05, and an acceptable difference between sample mean and population mean score for each scale of zero (μ – μ0 = 0), we estimated that a sample size of 686 would be sufficient to detect mean differences between the baseline and 6-week PSS-10, GAD-7, and PHQ-9 scores with a power of 80% (β=.2).

    Statistical Analysis

    Data analysis was undertaken using SPSS for Windows version 26 (IBM Corporation) [33]. To assess the primary outcome measures for our intervention, we used the paired t test to assess the mean difference between the mean PSS-10, GAD-7, and PHQ-9 scale scores at baseline and the sixth week for subscribers who completed the instruments at both time points. In addition, we used the chi-square test to compare prevalence rates for perceived stress, likely GAD, and likely MDD at baseline and the sixth week. Moderate or high perceived stress, likely GAD, and likely MDD were assessed using cutoff scores of ≥14 on the PSS-10 [30], ≥10 on the GAD-7 [31], and ≥10 on the PHQ-9 [32], respectively. There was no imputation for missing data, and the total numbers reported represent the total responses recorded for each variable.


    Participant Demographics

    Of the 766 individuals who completed both the baseline and 6-week surveys, 73 (9.6%) identified as male, 678 (88.7%) identified as female, and 13 (1.7%) identified as other gender. Table 1 provides the distribution of the demographic characteristics by gender of subscribers who completed both the baseline and sixth week surveys. Table 1 summarizes the demographic characteristics of the respondents who completed both the baseline and 6-week surveys as n (%). The data presented in Table 1 suggest that the majority of the respondents were aged between 26 and 60 years (601/758, 79.3%), White (656/766, 85.9%), had a postsecondary education (678/764, 88.7%), were employed (555/764, 72.6%), were married, cohabiting, or partnered (507/763, 66.4%), and owned homes (521/760, 68.6%).

    Table 1. Demographic characteristics of respondents who completed both surveys by identified gender (N=766), n (%). Note that some category totals do not sum to N due to incomplete data.
    VariableMaleFemaleOtherTotal
    Age (years)

    		≤25 5 (6.9)53 (7.9)5 (38.5)

    		63 (8.3)

    		26-40

    		17 (23.6)207 (30.8)6 (46.2)230 (30.3)

    		41-6033 (45.8)337 (50.1)1 (7.7)371 (48.9)

    		6017 (23.6)76 (11.3)1 (7.7)94 (12.4)
    Ethnicity

    		White55 (75.3)590 (87.0)11 (84.6)656 (85.9)

    		Indigenous1 (1.4)16 (2.4)0 (0)17 (2.2)

    		Asian4 (5.5)18 (2.7)0 (0)22 (2.9)

    		Other13 (17.8)54 (8.0)2 (15.4)69 (9.0)
    Education

    		Less than high school diploma5 (6.8)14 (2.1)1 (7.7)20 (2.6)

    		High school diploma7 (9.6)53 (7.8)1 (7.7)61 (8.0)

    		Postsecondary education61 (83.6)606 (89.4)11 (84.6)678 (88.7)

    		Other education0 (0)5 (0.7)0 (0)5 (0.7)
    Employment status

    		Employed52 (71.2)496 (73.2)7 (53.8)555 (72.6)

    		Unemployed10 (13.7)79 (11.7)2 (15.4)91 (11.9)

    		Retired9 (12.3)58 (8.6)1 (7.7)68 (8.9)

    		Student2 (2.7)33 (4.9)3 (23.1)38 (5.0)

    		Other0 (0)12 (1.8)0 (0)12 (1.6)
    Relationship status

    		Married, cohabiting, or partnered49 (67.1)452 (66.8)6 (46.2)507 (66.4)

    		Separated or divorced6 (8.2)64 (9.5)1 (7.7)71 (9.3)

    		Widowed2 (2.7)16 (2.4)0 (0)18 (2.4)

    		Single15 (20.5)137 (20.2)6 (46.2)158 (20.7)

    		Other1 (1.4)8 (1.2)0 (0)9 (1.2)
    Housing status

    		Own a home49 (67.1)465 (69.0)

    		7 (53.8)521 (68.6)

    		Living with family7 (9.6)56 (8.3)3 (23.1)66 (8.7)

    		Renting16 (21.9)147 (21.8)2 (15.4)165 (21.7)

    		Other1 (1.4)6 (0.9)1 (7.7)8 (1.1)

    Outcome Measures

    Table 2 presents the changes in primary outcome measures after 6 weeks from baseline for subscribers who completed both the baseline and 6-week surveys. The data displayed in Table 2 indicate that for subscribers who completed both the baseline and 6-week surveys, the mean scores on the PSS-10 and GAD-7 scales were significantly lower at 6 weeks compared to the mean scores at baseline, suggesting improvement in stress and anxiety symptoms. The effect size as measured by Cohen d was small (<0.5) for both the stress and anxiety scales.

    There was a reduction in the mean score on the GAD-7 scale of 19.0% at the sixth week compared to the baseline scores. The reduction in the PSS-10 scores at six weeks compared to the baseline scores, although statistically significant, was much smaller (4.1%). There was no statistically significant within-subjects difference between the baseline and sixth week PHQ-9 mean scores (P>.05).

    Table 2. Comparison of the baseline and 6-week mean scores on the PSS-10, GAD-7, and PHQ-9 scales for subscribers who completed both the baseline and sixth week surveys (N=766).
    MeasureResponses, naScoresMean difference (95% CI)P valuet valueEffect size (Cohen d)
    Baseline score, mean (SD)Six-week score, mean (SD)Change from baseline, %
    PSS-10b68420.35 (6.7)19.51 (7.0)4.1–0.83 (0.42 to 1.24)<.0013.990.2
    PHQ-9c6308.94 (6.0)8.74 (5.8)

    		2.2–0.20 (–0.17 to 0.57).281.080.2
    GAD-7d6129.62 (5.6)7.82 (5.2)

    		18.7–1.80 (1.44 to 2.16)<.0019.860.4

    aNot all subscribers completed all three scales; therefore, n for each scale is less than the total N.

    bPSS-10: 10-Item Perceived Stress Scale.

    cPHQ-9: Patient Health Questionnaire-9.

    dGAD-7: Generalized Anxiety Disorder–7.

    Table 3 indicates that there were statistically significant reductions in the prevalence rates of moderate or high stress and likely GAD but not of likely MDD when comparing the baseline and 6-week assessments. The largest reduction in prevalence rates was for anxiety (13.5%).

    To assess the generalizability of our data, based on the mental health burden in our baseline samples, we examined the clinical parameters between people who only responded to the baseline survey versus those who responded to both surveys (baseline and sixth week) (Table 4 and Table 5). No statistical difference was elicited between the two groups (all P>.05), suggesting that at baseline, the mental health burden was similar between our study sample and subscribers who did not complete the 6-week survey.

    Table 3. Comparison of the baseline and 6-week prevalence of moderate or high stress, likely generalized anxiety disorder, and likely major depressive disorder.
    ConditionPrevalence, n/total responses (%)Change in prevalence rate (sixth week from baseline), %χ2 (df)P value

    		BaselineSixth week


    Moderate or high stressa642/748 (85.8)582/742 (80.4)–5.47.78 (1).01
    Likely major depressive disorderb288/723 (39.8)262/688 (38.1)–1.70.46 (1).50
    Likely generalized anxiety disorderc326/712 (45.8)220/682 (32.3)–13.526.76 (1)<.001

    aAssessed using a cutoff score of ≥14 on the 10-Item Perceived Stress Scale.

    bAssessed using a cutoff score of ≥10 on the Patient Health Questionnaire-9.

    cAssessed using a cutoff score of ≥10 on the Generalized Anxiety Disorder-7.

    Table 4. Comparison of the prevalence rates of moderate or high stress, likely generalized anxiety disorder, and likely major depressive disorder between subscribers who only completed the baseline survey and subscribers who completed both the baseline and 6-week surveys.
    ConditionPrevalence rate at baseline, n/total responses (%)χ2 (df)P value

    		Subscribers who completed the baseline assessment but not the 6-week assessmentSubscribers who completed both the baseline and 6-week assessments

    Moderate or high stress4065/4798 (84.7)642/748 (85.8)0.62 (1).43
    Likely major depressive disorder1848/4447 (41.6)288/723 (39.8)0.76 (1).38
    Likely generalized anxiety disorder2040/4364 (46.7)326/712 (45.8)0.23 (1).63
    Table 5. Comparison of the mean scores on the PSS-10, GAD-7, and PHQ-9 scales between subscribers who only completed the baseline survey and subscribers who completed both the baseline and 6-week surveys.
    ScaleScore at baseline, mean (SD)Independent t testP value

    		Subscribers who completed the baseline assessment but not the 6-week assessmentSubscribers who completed both the baseline and 6-week assessments

    PSS-10a20.55 (6.77)20.30 (6.71)0.96.34
    PHQ-9b9.03 (6.22)8.94 (6.0)0.35.73
    GAD-7c9.64 (5.93)9.56 (5.65)0.37.72

    aPSS-10: 10-Item Perceived Stress Scale.

    bPHQ-9: Patient Health Questionnaire-9.

    cGAD-7: Generalized Anxiety Disorder–7.

    Similarly, we examined the clinical parameters between subscribers who responded to the 6-week survey only and subscribers who responded to both surveys (Table 6 and Table 7). No statistical difference was elicited in prevalence of stress, anxiety, or depression symptoms between the two groups (P>.05), suggesting that after receiving the intervention for 6 weeks, the mental health burden was similar between our study sample and subscribers who only completed the 6-week survey.

    Table 6. Comparison of the prevalence rates of moderate or high stress, likely generalized anxiety disorder, and likely major depressive disorder between subscribers who completed both the baseline and 6-week surveys and subscribers who only completed the 6-week survey.
    ConditionPrevalence rate at sixth week, n/total responses (%)χ2 (df)P value

    		Subscribers who completed the 6-week assessment but not the baseline assessmentSubscribers who completed both the baseline and 6-week assessments

    Moderate or high stress1217/1518 (80.2)582/724 (80.4)0.01 (1).91
    Likely major depressive disorder

    		483/1378 (35.1)262/688 (38.1)1.83 (1).18
    Likely generalized anxiety disorder430/1361 (31.6)220/682 (32.3)0.09 (1).76
    Table 7. Comparison of the mean scores on the PSS-10, GAD-7, and PHQ-9 between subscribers who completed both the baseline and 6-week surveys and subscribers who only completed the 6-week survey.
    ScaleScore at sixth week, mean (SD)Independent t testP value

    		Subscribers who completed the sixth-week assessments but not the baseline assessmentsSubscribers who completed both the baseline and sixth week assessments

    PSS-14a19.36 (7.12)19.44 (7.05)–0.25.80
    PHQ-9b8.20 (5.79)8.69 (5.75)–1.79.07
    GAD-7c7.55 (5.40)7.71 (5.21)–0.66.51

    aPSS-10: 10-Item Perceived Stress Scale.

    bPHQ-9: Patient Health Questionnaire-9.

    cGAD-7: Generalized Anxiety Disorder–7.


    Principal Findings

    The Text4Hope program was provided as an intervention tool for the general population to support the mental well-being of individuals living in the Canadian province of Alberta during the global COVID-19 pandemic. Other technology-based interfaces have been deployed during the COVID-19 pandemic to track the disease spread in populations [34], to gather data related to the general knowledge, attitudes, and behavior of the public related to the pandemic [35,36], and to offer mental health support to the public during the pandemic [37-40]. To the best of our knowledge, this is the first study to assess the impact of a text-messaging intervention on self-reported symptoms of stress, anxiety, and depression experienced during the COVID-19 pandemic. Our study yielded interesting results regarding temporal changes in the self-reported severity and rates of symptomatology related to the three psychiatric health conditions under study. After receiving daily messages for 6 weeks, we observed significant reductions in the respondents’ mean scores on the GAD-7 (18.7%) and the PSS-10 (4.0%), suggesting that the program was effective in reducing anxiety and stress symptomatology in the respondents. There was no significant reduction in the mean PHQ-9 score at 6 weeks from baseline. In terms of prevalence rates, the largest significant reduction in prevalence rate was for likely GAD (13.5%), followed by moderate or high stress (4.1%). Again, there was no significant reduction in the prevalence rate of likely MDD at 6 weeks from baseline.

    The self-reported rates of anxiety symptoms in our study at baseline were higher than those reported in other studies [41,42]. However, the greatest improvement recorded after the provision of the Text4Hope program was for anxiety, with a 13.5% reduction in symptom prevalence rate and 19% improvement in GAD-7 score. Text4Hope achieved a small Cohen d effect size (0.4) in mitigating anxiety symptoms, which is comparable to the effect sizes found for an internet CBT program aimed at reducing anxiety symptoms [43]. Typically, interventions that do not include therapist support demonstrate lower effect size outcomes compared to those including therapists [44,45]. By contrast, our intervention reached thousands of individuals during the pandemic, and it aimed to provide a general population intervention rather than individual psychotherapy. The overall change in GAD-7 scores in our study (–1.8) appears to be consistent with the magnitude of score changes recorded after providing other remote health services. For example, adding a telephone service to computerized CBT in combating anxiety yielded a reduction of 1.18 in GAD-7 scores [46]. Again, the percentage of change in GAD-7 scores in our study after providing a daily text message for 6 weeks (19.0%) is consistent with the effect of medications on anxiety symptoms; in a very large randomized controlled trial in the United Kingdom, sertraline was evidently effective in reducing GAD-7 scores by 21% after 6 weeks, and this result was described as clinically important [47].

    Our findings indicate that there was a modest effect of the program on improving stress symptoms, with greater benefit than other internet-based cognitive behavioral theory (iCBT) platforms [48]. In a Japanese study, iCBT was used to alleviate anxiety, stress, and depressive symptoms in university students [48]. The most significant effect was mainly reported for anxiety, while stress symptoms did not show a difference between case and control group members after the intervention period [48].

    There was no significant change between baseline and 6-week mean scores for likely MDD. Comparing our results with other remotely delivered health services yielded variable results. Two meta-analyses found that the effectiveness of iCBT programs, including MoodGYM, in mitigating depressive symptoms showed small effect sizes, especially in short-term assessments [43,44,49]. On the other hand, a significant improvement in BDI-II score with moderate effect size was observed at 3 months in patients with depression and comorbid alcohol use disorder who received supportive SMS text messages twice daily compared to the control group, who only received a thank-you SMS text message every fortnight [23]. The Text4Hope program was primarily designed as a health promotion tool to support the general population in Alberta during the COVID-19 pandemic and to combat potential stress and anxiety symptoms that are usually associated with epidemics or global crises. Our study participants were members of the general population rather than a patient sample, which may account for the observed differences in results. Furthermore, in a previous randomized trial [23], participants received the intervention for 12 weeks compared to 6 weeks in our study, which may account for the observed differences in the effects. Another study examined the effect of sertraline, an antidepressant of the selective serotonin reuptake inhibitor class, in ameliorating depressive symptoms; this study reported only a 5% relative reduction (95% CI 7%-15%; P=.41) in the mean PHQ-9 score at week 6 [47], which is not vastly different from the apparent 2% improvement observed with our Text4Hope intervention.

    Three months after the launch of the Text4Hope program, the dropout rate was 13.5%. A high withdrawal rate is not uncommon for a texting service provided via SMS. When Bendsten and Bendsten [50] compared an SMS texting service to services provided via email, they found that people in the SMS group opted out at significantly higher rates than those in the email group (20.1% versus 5.2%, respectively). Additionally, in a review study on behavioral changing interventions provided via SMS text message, authors reported a wide range of withdrawal rates (0%-57%) among participants. [51]. They justified this result as being due to the untailored and unilateral nature of these texting programs, which may be less engaging and therefore may result in low retention rates [51].

    Limitations of the Study

    Our study has several limitations. For ethical reasons, we lacked a comparative control group that did not receive the Text4Hope intervention during the same phase of the pandemic against which the recorded changes in stress, anxiety, and depression levels could be compared. It is therefore possible that the reductions in stress, anxiety, and depression levels are not all attributable to the Text4Hope intervention. Second, we relied on self-rated scales to assess stress, anxiety, and depression symptomatology, which could potentially overestimate the levels of these mental disorders when compared with prevalence rates that would have been obtained using structured clinical interviews with the Diagnostic and Statistical Manual of Mental Disorders 5th Edition. Third, our results may not be generalizable to the general population and are at risk of participation bias, where individuals with pre-existing mental health conditions are characteristically more inclined to enroll in the Text4Hope program compared with individuals with no pre-existing mental health disorders. We did not ask subscribers about pre-existing mental disorders, which would have helped to distinguish new symptoms from pre-existing ones but may have resulted in limited enrolment; in our experience, subtle changes in signup processes for subscribers can result in marked decreases in participation. Finally, the sample size of subscribers who completed both the baseline and 6-week assessments was rather small, and it is possible that other subscribers had variable changes in their mental health parameters from baseline to the sixth week. This limitation notwithstanding, our sample size was larger than the projected 686 subscribers needed to detect mean differences between the baseline and 6-week PSS-10, GAD-7, and PHQ-9 scores with a power of 80%. In addition, the mental health burden in our sample at baseline and at the sixth week were not significantly different from those of subscribers who only completed the baseline survey and the subscribers who completed the 6-week survey, respectively (Tables 4 and 5). Furthermore, the demographic characteristics of subscribers who completed both the baseline and 6-week surveys mirror those of all 8267 subscribers who completed the baseline survey by July 12, 2020 [52]. Specifically, the proportions of the various demographic characteristics in our sample compared to the proportions of the same demographics in the larger sample of 8267 subscribers was as follows: female gender, 88.7% versus 87.1%, respectively; White, 85.9% versus 82.3%, respectively; postsecondary education, 88.7% versus 85.2%, respectively; employed, 72.6% versus 73.3%, respectively; married, cohabiting, or partnered, 66.4% versus 71.1%, respectively; and homeowner, 68.6% versus 65.9%, respectively [52]. These proportions support the generalizability of our results to all subscribers. Future studies using this style of intervention could attempt to minimize attrition by offering incentives for participation or by sending messages encouraging people to continue subscribing.

    Finally, the effect sizes in our study were relatively small, which may minimize the strength of the produced results. However, interventions that do not include therapists often report low effect sizes compared to those including therapists [44,45].

    Conclusion

    The Text4Hope program resulted in statistically significant reductions in mean scores on the PSS-10 and GAD-7 scales but not the PHQ-9 scale at the sixth week from baseline. The program also resulted in statistically significant reductions in subscribers’ prevalence rates of moderate or high stress and likely GAD but not of likely MDD. The largest reductions in the mean scores and prevalence rates were observed for anxiety symptoms. It should be noted this paper reports data from the midpoint of the Text4Hope program implementation, and the rates of change for outcomes for stress, anxiety, and depression may differ after the program ends at 3 months.

    The relatively large improvements in anxiety symptoms achieved in our sample after 6 weeks of receiving the intervention during the COVID-19 pandemic suggest that the Text4Hope program is a useful intervention that can be deployed during natural and humanitarian disasters to support individuals at the population level. Over half of Canadians have reported that their mental health needs are not fully met [53]. A commonly reported reason is the cost of services [53]. As such, free mobile-based services such as Text4Hope can help address financial barriers. In the Canadian context and in other global contexts, these services can also be delivered remotely, which helps maintain essential physical distancing requirements during pandemics but also provides a means of access for those at rural or remote locations with little or no capacity for accessing mental health support services. We did not differentiate urban from rural or remote subscribers, as the program was offered to everyone in the province; however, regardless of geographical region, the pattern of urban, rural, and remote subscribers’ locations is of interest in relation to understanding the full value of SMS text messaging in this context. This is an additional step that we are considering in evaluating this program approach.

    Acknowledgments

    Support for the project was received from Alberta Health Services and the University of Alberta. This study was supported by grants from the Mental Health Foundation, the Edmonton and Calgary Community Foundations, the Edmonton Civic Employees Foundation, the Calgary Health Trust, the University Hospital Foundation, the Alberta Children’s Hospital Foundation, the Royal Alexandra Hospital Foundation, and the Alberta Cancer Foundation. The funders had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; or decision to submit the manuscript for publication.

    Authors' Contributions

    VIOA conceived and designed the study, including the Text4Hope program. MH and RS drafted the initial manuscript with VIOA. AG, WV, and SS participated in data collection. All authors contributed to the study design and revised and approved the final draft of the manuscript.

    Conflicts of Interest

    None declared.

    1. Statement on the second meeting of the International Health Regulations (2005) Emergency Committee regarding the outbreak of novel coronavirus. World Health Organization. Jan 30, 2020. URL: https:/​/www.​who.int/​news-room/​detail/​30-01-2020-statement-on-the-second-meeting-of-the-international-health-regulations-(2005)-emergency-committee-regarding-the- outbreak-of-novel-coronavirus-(2019-ncov) [accessed 2020-04-17]
    2. Director-General's opening remarks at the media briefing on COVID-19. Mar 11, 2020. URL: https:/​/www.​who.int/​dg/​speeches/​detail/​who-director-general-s-opening-remarks-at-the-media-briefing-on-covid-19---11-march-2020 [accessed 2020-04-17]
    3. Poston JT, Patel BK, Davis AM. Management of Critically Ill Adults With COVID-19. JAMA. May 12, 2020;323(18):1839-1841. [CrossRef] [Medline]
    4. Guo Y, Cao Q, Hong Z, Tan Y, Chen S, Jin H, et al. The origin, transmission and clinical therapies on coronavirus disease 2019 (COVID-19) outbreak - an update on the status. Mil Med Res. Mar 13, 2020;7(1):11. [FREE Full text] [CrossRef] [Medline]
    5. COVID-19, Alcohol and Cannabis Use. Canadian Centre on Substance Use and Addiction. 2020. URL: https:/​/www.​ccsa.ca/​sites/​default/​files/​2020-05/​CCSA-COVID-19-Alcohol-Cannabis-Use-Infographic-2020-en.​pdf [accessed 2020-04-17]
    6. Uguen-Csenge E. Mental illness will be 'next wave' of COVID-19 pandemic, epidemiologist says. Canadian Broadcasting Corporation. Apr 04, 2020. URL: https://www.cbc.ca/news/canada/british-columbia/months-isolation-mental-health-covid-1.5521649 [accessed 2020-04-17]
    7. Canadians Under 54 Drinking More While at Home Due to COVID-19 Pandemic. Canadian Centre on Substance Use and Addiction. Apr 15, 2020. URL: https://www.ccsa.ca/canadians-under-54-drinking-more-while-home-due-covid-19-pandemic [accessed 2020-04-17]
    8. Xu C, Dong Y, Yu X, Wang H, Tsamlag L, Zhang S, et al. Estimation of reproduction numbers of COVID-19 in typical countries and epidemic trends under different prevention and control scenarios. Front Med. Oct 28, 2020;14(5):613-622. [FREE Full text] [CrossRef] [Medline]
    9. Chevance A, Gourion D, Hoertel N, Llorca P, Thomas P, Bocher R, et al. Ensuring mental health care during the SARS-CoV-2 epidemic in France: A narrative review. Encephale. Jun 2020;46(3):193-201. [FREE Full text] [CrossRef] [Medline]
    10. Torales J, O'Higgins M, Castaldelli-Maia JM, Ventriglio A. The outbreak of COVID-19 coronavirus and its impact on global mental health. Int J Soc Psychiatry. Jun 31, 2020;66(4):317-320. [CrossRef] [Medline]
    11. Wang C, Pan R, Wan X, Tan Y, Xu L, Ho CS, et al. Immediate Psychological Responses and Associated Factors during the Initial Stage of the 2019 Coronavirus Disease (COVID-19) Epidemic among the General Population in China. Int J Environ Res Public Health. Mar 06, 2020;17(5):1729. [FREE Full text] [CrossRef] [Medline]
    12. Brooks SK, Webster RK, Smith LE, Woodland L, Wessely S, Greenberg N, et al. The psychological impact of quarantine and how to reduce it: rapid review of the evidence. Lancet. Mar 2020;395(10227):912-920. [CrossRef]
    13. Marshall GN, Schell TL, Elliott MN, Rayburn NR, Jaycox LH. Psychiatric disorders among adults seeking emergency disaster assistance after a wildland-urban interface fire. Psychiatr Serv. Apr 2007;58(4):509-514. [CrossRef] [Medline]
    14. Van Bortel T, Basnayake A, Wurie F, Jambai M, Koroma AS, Muana AT, et al. Psychosocial effects of an Ebola outbreak at individual, community and international levels. Bull World Health Organ. Jan 21, 2016;94(3):210-214. [CrossRef]
    15. Agyapong V, Hrabok M, Juhas M, Omeje J, Denga E, Nwaka B, et al. Prevalence Rates and Predictors of Generalized Anxiety Disorder Symptoms in Residents of Fort McMurray Six Months After a Wildfire. Front Psychiatry. 2018;9:345. [CrossRef] [Medline]
    16. Rajkumar RP. COVID-19 and mental health: A review of the existing literature. Asian J Psychiatr. Aug 2020;52:102066. [FREE Full text] [CrossRef] [Medline]
    17. Khawam E, Khouli H, Pozuelo L. Treating acute anxiety in patients with COVID-19. Cleve Clin J Med. May 14, 2020. [FREE Full text] [CrossRef] [Medline]
    18. Li W, Yang Y, Liu Z, Zhao Y, Zhang Q, Zhang L, et al. Progression of Mental Health Services during the COVID-19 Outbreak in China. Int J Biol Sci. 2020;16(10):1732-1738. [FREE Full text] [CrossRef] [Medline]
    19. Wind TR, Rijkeboer M, Andersson G, Riper H. The COVID-19 pandemic: The 'black swan' for mental health care and a turning point for e-health. Internet Interv. Apr 2020;20:100317. [FREE Full text] [CrossRef] [Medline]
    20. Ibrahim D. Canadians’ experiences with emergencies and disasters, 2014. Statistics Canada. URL: https://www150.statcan.gc.ca/n1/pub/85-002-x/2016001/article/14469-eng.htm [accessed 2020-02-10]
    21. Terry M. Text messaging in healthcare: the elephant knocking at the door. Telemed J E Health. Aug 2008;14(6):520-524. [CrossRef] [Medline]
    22. Guerriero C, Cairns J, Roberts I, Rodgers A, Whittaker R, Free C. The cost-effectiveness of smoking cessation support delivered by mobile phone text messaging: Txt2stop. Eur J Health Econ. Oct 2013;14(5):789-797. [FREE Full text] [CrossRef] [Medline]
    23. Agyapong V, McLoughlin D, Farren C. 581 – 6-month outcomes of a single blind randomised trial of supportive text messaging for depression and comorbid alcohol use disorder. European Psychiatry. Jan 2013;28:1. [CrossRef]
    24. Agyapong V, Mrklas K, Juhás M, Omeje J, Ohinmaa A, Dursun SM, et al. Cross-sectional survey evaluating Text4Mood: mobile health program to reduce psychological treatment gap in mental healthcare in Alberta through daily supportive text messages. BMC Psychiatry. Nov 08, 2016;16(1):378. [FREE Full text] [CrossRef] [Medline]
    25. Agyapong VIO, Milnes J, McLoughlin DM, Farren CK. Perception of patients with alcohol use disorder and comorbid depression about the usefulness of supportive text messages. THC. Jan 01, 2013;21(1):31-39. [CrossRef]
    26. Chandra PS, Sowmya H, Mehrotra S, Duggal M. 'SMS' for mental health—feasibility and acceptability of using text messages for mental health promotion among young women from urban low income settings in India. Asian J Psychiatr. Oct 2014;11:59-64. [CrossRef] [Medline]
    27. Alberta Health Services. URL: https://www.albertahealthservices.ca/topics/Page17019.aspx [accessed 2020-11-04]
    28. Agyapong VH, Hrabok M, Vuong W, Gusnowski A, Shalaby R, Mrklas K, et al. Closing the Psychological Treatment Gap During the COVID-19 Pandemic With a Supportive Text Messaging Program: Protocol for Implementation and Evaluation. JMIR Res Protoc. Jun 22, 2020;9(6):e19292. [FREE Full text] [CrossRef] [Medline]
    29. Agyapong VIO. Coronavirus Disease 2019 Pandemic: Health System and Community Response to a Text Message (Text4Hope) Program Supporting Mental Health in Alberta. Disaster Med Public Health Prep. Apr 22, 2020:1-2. [FREE Full text] [CrossRef] [Medline]
    30. Cohen S, Kamarck T, Mermelstein R. A Global Measure of Perceived Stress. J Health Soc Behav. Dec 1983;24(4):385. [CrossRef]
    31. Spitzer RL, Kroenke K, Williams JBW, Löwe B. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med. May 22, 2006;166(10):1092-1097. [CrossRef] [Medline]
    32. Kroenke K, Spitzer RL, Williams JBW. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med. Sep 2001;16(9):606-613. [FREE Full text] [CrossRef] [Medline]
    33. Release Notes - IBM SPSS Statistics 26.0. IBM Corporation. 2019. URL: https://www.ibm.com/support/pages/release-notes-ibm%C2%AE-spss%C2%AE-statistics-260 [accessed 2020-08-25]
    34. Dong E, Du H, Gardner L. An interactive web-based dashboard to track COVID-19 in real time. Lancet Infect Dis. May 2020;20(5):533-534. [CrossRef]
    35. Kebede Y, Yitayih Y, Birhanu Z, Mekonen S, Ambelu A. Knowledge, perceptions and preventive practices towards COVID-19 early in the outbreak among Jimma university medical center visitors, Southwest Ethiopia. PLoS One. May 21, 2020;15(5):e0233744. [FREE Full text] [CrossRef] [Medline]
    36. Zhong B, Luo W, Li H, Zhang Q, Liu X, Li W, et al. Knowledge, attitudes, and practices towards COVID-19 among Chinese residents during the rapid rise period of the COVID-19 outbreak: a quick online cross-sectional survey. Int J Biol Sci. 2020;16(10):1745-1752. [FREE Full text] [CrossRef] [Medline]
    37. Liu S, Yang L, Zhang C, Xiang Y, Liu Z, Hu S, et al. Online mental health services in China during the COVID-19 outbreak. Lancet Psychiatry. Apr 2020;7(4):e17-e18. [CrossRef]
    38. Xiao C. A Novel Approach of Consultation on 2019 Novel Coronavirus (COVID-19)-Related Psychological and Mental Problems: Structured Letter Therapy. Psychiatry Investig. Feb 2020;17(2):175-176. [FREE Full text] [CrossRef] [Medline]
    39. Duan L, Zhu G. Psychological interventions for people affected by the COVID-19 epidemic. Lancet Psychiatry. Apr 2020;7(4):300-302. [CrossRef]
    40. Figueroa CA, Aguilera A. The Need for a Mental Health Technology Revolution in the COVID-19 Pandemic. Front Psychiatry. Jun 3, 2020;11:523. [CrossRef] [Medline]
    41. Huang Y, Zhao N. Generalized anxiety disorder, depressive symptoms and sleep quality during COVID-19 outbreak in China: a web-based cross-sectional survey. Psychiatry Res. Jun 2020;288:112954. [FREE Full text] [CrossRef] [Medline]
    42. Gao J, Zheng P, Jia Y, Chen H, Mao Y, Chen S, et al. Mental health problems and social media exposure during COVID-19 outbreak. PLoS One. Apr 16, 2020;15(4):e0231924. [FREE Full text] [CrossRef] [Medline]
    43. Twomey C, O'Reilly G. Effectiveness of a freely available computerised cognitive behavioural therapy programme (MoodGYM) for depression: Meta-analysis. Aust N Z J Psychiatry. Mar 11, 2017;51(3):260-269. [CrossRef] [Medline]
    44. Spek V, Cuijpers P, Nyklícek I, Riper H, Keyzer J, Pop V. Internet-based cognitive behaviour therapy for symptoms of depression and anxiety: a meta-analysis. Psychol Med. Nov 20, 2006;37(03):319. [CrossRef]
    45. Howell AN, Rheingold AA, Uhde TW, Guille C. Web-based CBT for the prevention of anxiety symptoms among medical and health science graduate students. Cogn Behav Ther. Sep 11, 2019;48(5):385-405. [FREE Full text] [CrossRef] [Medline]
    46. Brabyn S, Araya R, Barkham M, Bower P, Cooper C, Duarte A, et al. The second Randomised Evaluation of the Effectiveness, cost-effectiveness and Acceptability of Computerised Therapy (REEACT-2) trial: does the provision of telephone support enhance the effectiveness of computer-delivered cognitive behaviour therapy? A randomised controlled trial. Health Technol Assess. Nov 2016;20(89):1-64. [CrossRef] [Medline]
    47. Duffy L, Lewis G, Ades A, Araya R, Bone J, Brabyn S, et al. Antidepressant treatment with sertraline for adults with depressive symptoms in primary care: the PANDA research programme including RCT. Programme Grants Appl Res. Dec 2019;7(10):1-108. [CrossRef] [Medline]
    48. Shirotsuki K, Uehara S, Adachi S, Nakao M. Internet-Based Cognitive Behavior Therapy for Stress and Anxiety among Young Japanese Adults: A Preliminary Study. Psych. Jun 11, 2019;1(1):353-363. [CrossRef]
    49. Littlewood E, Duarte A, Hewitt C, Knowles S, Palmer S, Walker S, et al. REEACT Team. A randomised controlled trial of computerised cognitive behaviour therapy for the treatment of depression in primary care: the Randomised Evaluation of the Effectiveness and Acceptability of Computerised Therapy (REEACT) trial. Health Technol Assess. Dec 2015;19(101):viii, xxi-viii, 171. [CrossRef] [Medline]
    50. Bendtsen M, Bendtsen P. Feasibility and user perception of a fully automated push-based multiple-session alcohol intervention for university students: randomized controlled trial. JMIR mHealth uHealth. Jun 23, 2014;2(2):e30. [FREE Full text] [CrossRef] [Medline]
    51. Fjeldsoe BS, Marshall AL, Miller YD. Behavior change interventions delivered by mobile telephone short-message service. Am J Prev Med. Feb 2009;36(2):165-173. [CrossRef] [Medline]
    52. Nwachukwu I, Nkire N, Shalaby R, Hrabok M, Vuong W, Gusnowski A, et al. COVID-19 Pandemic: Age-Related Differences in Measures of Stress, Anxiety and Depression in Canada. Int J Environ Res Public Health. Sep 01, 2020;17(17):6366. [FREE Full text] [CrossRef] [Medline]
    53. Mental health care needs, 2018. Statistics Canada. Oct 07, 2019. URL: https://www150.statcan.gc.ca/n1/pub/82-625-x/2019001/article/00011-eng.htm [accessed 2020-06-17]

    ‎
    BDI: Beck Depression Inventory
    CBT: cognitive behavioral therapy
    GAD: generalized anxiety disorder
    GAD-7: Generalized Anxiety Disorder–7
    iCBT: internet-based cognitive behavioral therapy
    MDD: major depressive disorder
    PHQ-9: Patient Health Questionnaire–9
    PSS-10: 10-Item Perceived Stress Scale

    Edited by J Torous, G Eysenbach; submitted 11.07.20; peer-reviewed by C Son; comments to author 25.08.20; revised version received 28.09.20; accepted 30.11.20; published 18.12.20.

    Copyright

    ©Vincent Israel Ouoku Agyapong, Marianne Hrabok, Wesley Vuong, Reham Shalaby, Jasmine Marie Noble, April Gusnowski, Kelly J Mrklas, Daniel Li, Liana Urichuk, Mark Snaterse, Shireen Surood, Bo Cao, Xin-Min Li, Russell Greiner, Andrew James Greenshaw. Originally published in JMIR Mental Health (http://mental.jmir.org), 18.12.2020.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Mental Health, is properly cited. The complete bibliographic information, a link to the original publication on http://mental.jmir.org/, as well as this copyright and license information must be included.