Published on in Vol 11 (2024)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/51704, first published .
Incorporating a Stepped Care Approach Into Internet-Based Cognitive Behavioral Therapy for Depression: Randomized Controlled Trial

Incorporating a Stepped Care Approach Into Internet-Based Cognitive Behavioral Therapy for Depression: Randomized Controlled Trial

Incorporating a Stepped Care Approach Into Internet-Based Cognitive Behavioral Therapy for Depression: Randomized Controlled Trial

Original Paper

1Centre for Neuroscience Studies, Queen's University, Kingston, ON, Canada

2Department of Psychiatry, Queen's University, Kingston, ON, Canada

3Pastoral Studies, Toronto School of Theology (TST), Emmanuel College, University of Toronto, Toronto, ON, Canada

4Online Psychotherapy Tool, Toronto, ON, Canada

*these authors contributed equally

Corresponding Author:

Jasleen Kaur Jagayat, MSc

Centre for Neuroscience Studies

Queen's University

18 Stuart Street

Kingston, ON, K7L 3N6

Canada

Phone: 1 613 533 2600

Email: jasleenjagayat@gmail.com


Background: Depression is a hidden burden, yet it is a leading cause of disability worldwide. Despite the adverse effects of depression, fewer than one-third of patients receive care. Internet-based cognitive behavioral therapy (i-CBT) is an effective treatment for depression, and combining i-CBT with supervised care could make the therapy scalable and effective. A stepped care model is a framework for beginning treatment with an effective and low-intensity intervention while adapting care based on the patient’s needs.

Objective: This study investigated the efficacy of a stepped care i-CBT model for depression based on changes in self-reported depressive symptoms.

Methods: In this single-blinded, randomized controlled trial, participants were allocated to either the i-CBT–only group (28/56, 50%) or the i-CBT with stepped care group (28/56, 50%). Both groups received a 13-week i-CBT program tailored for depression. The i-CBT program was provided through a secure, online mental health clinic called the Online Psychotherapy Tool. Participants read through the sessions and completed the assignments related to each session. Participants in the stepped care group received additional interventions from their care provider based on standard questionnaire scores (ie, Patient Health Questionnaire–9 [PHQ-9], Quick Inventory of Depressive Symptomatology [QIDS], and Quality of Life Enjoyment and Satisfaction Questionnaire–Short Form) and their assignment responses. From lowest to highest intensity, the additional interventions included SMS text messages, phone calls, video calls, or a video call with a psychiatrist.

Results: For this study, 56 participants were recruited to complete an i-CBT program (n=28, 50%; mean age 37.9; SD 13.08 y; 7/28, 27% were men) or an i-CBT with stepped care program (n=28, 50%; mean age 40.6; SD 14.28 y; 11/28, 42% were men). The results of this study indicate that the i-CBT program was effective in significantly reducing depressive symptoms, as measured by the PHQ-9 (F4,80=9.95; P<.001) and QIDS (F2,28=5.73; P=.008); however, there were no significant differences in the reduction of depressive symptoms between the 2 groups (PHQ-9: F4,80=0.43; P=.78; QIDS: F2,28=3.05; P=.06). The stepped care group was not significantly better in reducing depressive symptoms than the i-CBT group (PHQ-9, P=.79; QIDS, P=.06). Although there were no significant differences observed between the number of participants who completed the program between the groups (χ21=2.6; P=.10), participants in the stepped care group, on average, participated in more sessions than those who prematurely terminated participation in the i-CBT group (t55=−2; P=.03; 95% CI –4.83 to –0.002).

Conclusions: Implementing a stepped care approach in i-CBT is an effective treatment for depression, and the stepped care model can assist patients to complete more sessions in their treatment.

Trial Registration: Clinicaltrials.gov NCT04747873; https://clinicaltrials.gov/study/NCT04747873

JMIR Ment Health 2024;11:e51704

doi:10.2196/51704

Keywords



Background and Rationale

Depression is a leading cause of disability, affecting approximately 3.8% of the population worldwide [1,2]. Major depressive disorder (MDD) is characterized by persistent feelings of sadness, negative mood, or loss of interest in life activities [3]. Detrimental and persistent changes in appetite, sleep, energy, and cognition may accompany these feelings. In addition to its deleterious impacts on mental health, depression is associated with increased morbidity, decreased quality of life, and reduced work productivity [4-6]. Despite the negative consequences of depression, only one-third of individuals receive treatment, and of those, only 3 in 5 people receive sufficient care [7,8].

Cognitive behavioral therapy (CBT) is an effective treatment for MDD [9-11]. It is a form of psychotherapy that focuses on cognitive restructuring strategies and behavioral activation techniques to help individuals with depression overcome their depressive symptoms and modify ineffective thinking patterns. Although effective, CBT on its own presents some challenges such as accessibility issues, lack of follow-ups, and increased costs [12-14]. Over the past 2 decades, issues of accessibility are being increasingly addressed through digital modalities, such as internet-based CBT (i-CBT) [11,15,16]. i-CBT allows for the delivery of CBT through digital media including computers and smartphones. It involves using web-based sessions with interactive components and practices to teach individuals ways to improve their mental health. Many studies have shown the efficacy of i-CBT for depression and anxiety, with results comparable with those of traditional in-person CBT [11,16-20]. The digital format allows for increased accessibility and convenience when delivering and receiving psychotherapy while remaining effective [21,22]; however, the digital format comes with limitations, including low adherence. Adherence rates are variable and can be affected by multiple factors including the digital modalities used and patient-therapist interactions [23-25]. Furthermore, attrition rates in CBT are the highest in patients with depression [26], and adherence can be compromised as disease severity increases [27]. With the benefit of being versatile and adaptable, i-CBT may be adapted to include support to address the issues of adherence.

The stepped care model is an approach to providing individuals with adaptable and effective care that is adjusted based on symptom severity [28-31]. This dynamic approach allows care to be adapted as required throughout an individual’s treatment plan to best tailor care to the individual’s needs. Stepped care models aim to provide the most effective and efficient care by minimizing resources and costs for care. The least intensive intervention, such as self-help materials or psychoeducation, is first provided to patients in a stepped care model. The patient may then advance to the next level of care, which may include more extensive interventions such as increased support or medication if they do not improve or just partially improve. Until the patient gets the desired result or reaches the highest level of care, this process is repeated. This stepped care model allows for efficient allocation of resources, increases access to care, can reduce wait times, can lower costs, and can increase versatility in treatment options [28,31]. This model is effective in treating mental health disorders including MDD and focuses on a patient-centered approach to care [21,31].

In the stepped care model, all patients receive some form of treatment for their symptoms, and based on the symptom severity and progress through treatment, additional care is added to their treatment plan. The addition of therapist-guided support to i-CBT has demonstrated high levels of patient satisfaction and a general decrease in symptom severity [32]. It is also noted that dropout rates decrease as increased therapeutic support is provided to patients. A meta-analysis that gathered dropout rates of CBT based on treatment support levels found that without support, the dropout rate was 74%; with administrative support, the dropout rate was 38%; and with therapeutic support, the patient dropout rate was 28% [16]. This suggests that the type of support provided to patients is important. Therapist-guided support in an i-CBT setting can also include text (ie, messaging and emails) or audio-based (ie, telephone and video) formats, and the mode of therapy may influence treatment outcome [22,33,34]. Incorporating text and call interventions into online therapy can provide an additional support outlet for patients throughout their treatment by providing an additional means of communication while remaining accessible [35]. Phone and video interventions have both been shown to be effective in reducing symptoms and maintaining patients in care compared with in-person care for mood disorders [36]. Phone calls may be more broadly accessible than video calls owing to inherent technological barriers; however, video calls allow for additional nonverbal cues to be assessed in care [36]. They can serve as check-ins, encouragement, and reminders and help monitor patient progress between treatment sessions. Through this additional support, a review of therapeutic concepts and words of encouragement are found to help decrease symptom severity and improve therapy completion [37]. This method can help with building therapist-patient rapport throughout treatment and act as a valuable tool in online therapy.

Objectives

This study was a single-blinded, randomized controlled trial exploring the efficacy of a stepped care model in an i-CBT program compared with an i-CBT–only program for adults with MDD. The i-CBT program for depression was provided through a secure, online mental health clinic called the Online Psychotherapy Tool (OPTT) [38]. The stepped care model considered the varying digital modalities of text-based, phone-based, and video-based interventions to help support individuals in their care.


Ethical Considerations

The research study was approved by the Health Sciences and Affiliated Teaching Hospitals Research Ethics Board (file number 6031992) at Queen’s University in Kingston, Ontario, Canada. The research study followed the CONSORT-EHEALTH (Consolidated Standards of Reporting Trials of Electronic and Mobile Health Applications and Online Telehealth) guidelines and can be viewed in Multimedia Appendix 1 [39].

No monetary compensation was provided to participants for participation in this study because they were provided with CBT treatment for their symptoms.

Data Privacy

To maintain participant confidentiality, each participant was assigned a randomized participant ID number. This ID was used to identify the participant for data analysis purposes. Only associated care providers had access to the participant’s identity owing to the nature of the CBT intervention. If any technical issues on OPTT arose, this ID was used to resolve the issues to maintain participant anonymity.

Participant information maintained online was password protected, including consent forms, identities, and CBT content. All encrypted files were stored on a safe server run by Queen’s University. Participant identities and consent forms are stored on-site at Queen’s University’s exclusive storage in Kingston, Ontario, Canada, for 5 years following the conclusion of the study because they are considered as medical records. Following the 5 years, the participant records will be destroyed. Participants were informed about the possibility to withdraw from the study at any time if they wished to do so. In upcoming plans for knowledge dissemination and publication of outcomes, participant identification will be secured and maintained anonymously.

The online platform used to deliver the i-CBT program, OPTT [38,40], serves as the repository for all data. OPTT complies with the Personal Information Protection and Electronic Documents Act, Health Insurance Portability and Accountability Act, and Service Organization Control–2. The cloud infrastructure of Amazon Web Service Canada is used to host all servers and databases, and Medstack manages it to ensure compliance with all the local, state, and federal privacy and security laws. For privacy reasons, OPTT does not gather any identifying personal data or IP addresses. Only anonymous metadata were gathered by OPTT to enhance the quality of its services and provide the care provider team access to participant analytics (ie, interaction with the OPTT platform). No OPTT employee had direct access to participant data owing to data encryption procedures (ie, participant ID). All encrypted backups are stored at Queen’s University.

Outcome Evaluation

Patient Health Questionnaire–9

The Patient Health Questionnaire–9 (PHQ-9) is a self-assessment questionnaire designed to examine a participant’s depression severity through a 9-item questionnaire, with an additional question about functional health [41]. Each of the 9 items is scored from 0 (not at all) to 3 (nearly every day) and corresponds to the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition criteria for MDD symptoms [3]. Each item is then scored for a total to indicate depression severity from none to severe, ranging from 0 to 27. High scores indicate high depression.

Quick Inventory of Depressive Symptomatology Questionnaire

The Quick Inventory of Depressive Symptomatology (QIDS) questionnaire is a self-assessment questionnaire designed to screen for depression and measure depression severity based on 16 items [42]. Each item correlates with the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition criteria for MDD symptoms and is scored using a 4-point scale (0-3), for a total score ranging between 0 and 27 [3]. To calculate the final score, the questions are summed using the highest response in the following domains: sleep patterns (questions 1-4), sad mood (questions 5), change in appetite (questions 6-9), concentration and decision-making (questions 10), self-view (questions 11), suicidal thoughts (questions 12), general interest (questions 13), energy level (questions 14), and psychomotor effects (questions 15 and 16). High scores indicate high depression severity.

Quality of Life Enjoyment and Satisfaction Questionnaire–Short Form

The Quality of Life Enjoyment and Satisfaction Questionnaire–Short Form (Q-LES-Q) is a self-assessment questionnaire designed to collect information about the level of enjoyment and satisfaction in various aspects of daily functioning through a series of 16 items [43]. Each item is rated on a scale from 1 (very poor) to 5 (very good). Of the 16 items, only the first 14 items are summed for a total raw score ranging from 14 to 70. High scores indicate great quality of life.

Measured Outcomes

The primary outcomes measured in this study included changes in depressive symptoms, as measured by the PHQ-9 and QIDS. Using the Q-LES-Q to measure changes in the participant’s quality of life was also a primary outcome that was evaluated. Participants completed the PHQ-9 every 3 weeks (weeks 1, 4, 7, 10, and 13) and the QIDS and Q-LES-Q at 3 time points (weeks 1, 7, and 13) throughout the program. All the 3 questionnaires are intended to be completed at the 3-, 6-, 9-, and 12-month follow-up periods during the 1-year follow-up phase (Textbox 1). Pretreatment and posttreatment changes in depressive symptoms (ie, PHQ-9 and QIDS) and quality of life (Q-LES-Q) between the control and experimental groups were compared. The number of sessions completed by each participant was a secondary measure that was considered when evaluating compliance with the i-CBT program between the 2 groups.

Textbox 1. Schedule of the assigned clinical questionnaires sent to participants, including the 1-year follow-up period.

Session 1

  • Patient Health Questionnaire–9 (PHQ-9), Quality of Life Enjoyment and Satisfaction Questionnaire–Short Form (QIDS), Quick Inventory of Depressive Symptomatology (Q-LES-Q), and demographic survey

Session 2

  • No questionnaires are provided during these sessions.

Session 3

  • No questionnaires are provided during these sessions.

Session 4

  • PHQ-9 and initial stepped care assessment (if the participant is in the stepped care group, an intervention decision will be made at the end of every session, starting at session 4. Interventions will be implemented, beginning from session 5)

Session 5

  • Interventions begin as needed (if the participant is in the stepped care group, an intervention decision will be made at the end of every session, starting at session 4; Interventions will be implemented, beginning from session 5)

Session 6

  • No questionnaires are provided during these sessions.

Session 7

  • PHQ-9, QIDS, and Q-LES-Q

Session 8

  • No questionnaires are provided during these sessions.

Session 9

  • No questionnaires are provided during these sessions.

Session 10

  • PHQ-9

Session 11

  • No questionnaires are provided during these sessions.

Session 12

  • No questionnaires are provided during these sessions.

Session 13

  • PHQ-9, QIDS, and Q-LES-Q

Follow-up 1

  • PHQ-9, QIDS, and Q-LES-Q

Follow-up 2

  • PHQ-9, QIDS, and Q-LES-Q

Follow-up 3

  • PHQ-9, QIDS, and Q-LES-Q

Follow-up 4

  • PHQ-9, QIDS, and Q-LES-Q

Participants

This study was registered at ClinicalTrial.gov (NCT04747873). Participants were recruited from the Providence Care outpatient psychiatry clinic and Kingston Health Sciences Center sites (Hotel Dieu Hospital and Kingston General Hospital), both of which are located in Kingston, Ontario, Canada. Physicians familiar with the Queen’s Online Psychotherapy Lab (QUOPL) research team were also informed about the study and directed patients who may benefit from CBT toward the study when considered appropriate. Self-referrals were also accepted for this study. Recruitment was managed by the laboratory manager who was the initial point of contact for all participants.

Eligibility Criteria

Individuals interested in the research study were provided with a letter of information and consent form to understand the study design before beginning the eligibility process. Following the informed consent process (written or verbal), a trained research assistant at QUOPL screened the individual based on the eligibility criteria. Individuals were eligible for the study if they met the following criteria: (1) aged ≥18 years, (2) met the criteria of MDD by a trained research assistant according to the Mini International Neuropsychiatric Interview (MINI) [44], (3) showed competence to consent to participate, (4) fluent in English because the i-CBT program was provided in English only, and (5) had consistent and reliable access to the internet. For the MINI assessment, individuals were first assessed by a trained research assistant to support a diagnosis of MDD. This MINI assessment was completed through a secure Microsoft Teams video call. Participants were ineligible for the research study if they presented with active psychosis, acute mania, severe alcohol or substance use disorder, or active suicidal or homicidal ideation. If a participant received or was receiving CBT in the past year at the time of beginning the study, they were excluded from the study to avoid confounding effects on the efficacy of this i-CBT program.

Following the consent and eligibility screening process, participants were randomized in a 1:1 allocation ratio to either the i-CBT group (control group) or the i-CBT with stepped care group (experimental group). Randomization was computer generated in Microsoft Excel using the RANDBETWEEN function. This method returned an integer at random that indicated either 1 (designated as the i-CBT group) or 2 (for the stepped care group). This integer was used to determine the group allocation for the participant.

Using G*Power (version 3.1.9.7 [45]), a priori power analysis was performed to determine the minimum sample size required to test the study hypothesis. The average PHQ-9 score decreased from 16.2 before i-CBT to 11.48 (combined SD 5.45) after 12 sessions in our previous clinical trials and data collection regarding i-CBT for depression [46]. These figures led to an effect size (Hedge g of 0.86). A paired sample t test (1-tailed) would require 14 individuals to detect a significant impact, given the effect size and a power of 0.8. For online CBT programs, compliance and care adherence are common challenges; therefore, we predict 50% dropout rate based on previous clinical trials conducted in our laboratory [47,48]. Consequently, considering the proposed sample size calculation accounted for this dropout rate, we aimed to recruit 28 participants in each group. With the 2 treatment arms, our total sample size was expected to be 56 participants. Figure 1 summarizes the study design in a flow chart.

Figure 1. A flowchart providing an overview of the study design. i-CBT: internet-based cognitive behavioral therapy; MINI: Mini International Neuropsychiatric Interview; RCT: randomized controlled trial.

Care Providers

Participants were assigned a primary care provider to help build rapport through assigning sessions, providing feedback, and providing additional interventions as needed. All care providers were trained in psychotherapy by the lead psychiatrist who is a licensed psychotherapist and expert in internet-based psychotherapy. Each participant was assigned a care team that consisted of a care provider and a psychiatrist with extensive experience in i-CBT. Care providers were research assistants recruited and trained by the team psychiatrist. Their role was to provide participants with feedback about weekly homework and act as a point of contact for any questions that the participants may have regarding the study design. The care providers included master’s degree students studying in the field of neuroscience and psychology, associated with QUOPL, and research assistants who have completed a medical degree. Through training, all care providers were well experienced in internet-based psychotherapy, with a specific focus on CBT techniques. They were all taught the standard care pathway and the aim, and content of each therapeutic session. They also continued receiving specialized training through webinars, CBT workshops led by a psychiatrist trained in CBT, and exercises with feedback during the study. Moreover, they were provided predesigned feedback templates tailored to each session to be used when writing the weekly feedback. The feedback templates helped standardize the feedback by providing a basic structure that ensured all aspects of the homework were acknowledged and that the newly presented CBT concepts were reviewed. Feedback templates varied between sessions, and care providers personalized each template for each participant’s homework. The use of feedback templates that were drafted by the team psychiatrist trained in online psychotherapy allowed some control over treatment consistency across sessions and participants. Before submission to the participant, feedback was always reviewed by another care provider (MSc candidate) trained in psychotherapy and overlooked by a psychiatrist to ensure the quality of the feedback. The team psychiatrist fulfilled the role to overlook the feedback; manage any crisis events if necessary; and provide support in the stepped care model, specifically the highest-intensity intervention, step 4.

Intervention

i-CBT Program

All participants (56/56, 100%) were provided with the same 13-week i-CBT program designed for MDD through OPTT—a secure, cloud-based, digital mental health platform [38]. This i-CBT program, titled “Electronic Cognitive Behavioural Therapy (e-CBT) For Depression,” is a set of predesigned modules created to address depressive symptoms through various CBT techniques to work on cognitive restructuring [46,49-51]. This specific program has undergone validation through previous studies and has been shown to significantly decrease depressive symptoms [47,49]. The program was intended to imitate in-person, standard CBT for MDD in an asynchronous format. In this study, 1 module was assigned to participants on the same day of each week. A module included 20 to 30 slides of CBT content and took approximately 45 to 50 minutes to view (Multimedia Appendix 2). Each module focused on 1 CBT technique (Table 1). Each module followed a similar outline, beginning with an introduction to the topic for the week, an overview of the technique with examples, and concluding with homework related to the weekly technique [50]. The homework consisted of a few questions based on a stressful event that occurred in the participant’s life in the past week and provided participants with the practice of the new CBT technique. Participants were provided with 4 days to asynchronously review the module and submit their homework to their assigned care provider on the OPTT platform. Participant answers were then reviewed by the assigned care provider over 3 days who provided participants with feedback about their answers along with their next session on the assigned day of the week.

Table 1. A brief description of each session for the internet-based cognitive behavioral therapy (i-CBT) program, titled “Electronic Cognitive Behavioural Therapy (e-CBT) For Depression,” on the Online Psychotherapy Tool platform.
ModuleTitleDescription
1What is depression?
  • Introduced i-CBT and discussed common depressive symptoms while setting expectations for the course
2The 5-Part Model
  • Described the 5-Part Model: connections and interactions between a situation, thoughts, feelings, physical reactions, and behaviors
3Sleep hygiene
  • Focused on how to improve rest through sleep habits and offered a variety of techniques
4Strategies for stressful situations
  • Provided a general review of practical strategies that can be applied under difficult circumstances, including breathing techniques and activities
5Thoughts, feelings, behavior, physical reactions, and environment
  • Explained the 5-Part Model in detail and how modifications to 1 part can influence the remaining 4 parts
6The thought record
  • Featured the first 3 columns of the thought record: a tool for challenging ineffective thoughts
  • The first 3 columns included the situation, feelings, and automatic thoughts associated with the situation
7Automatic thoughts
  • Explored the function of automatic thoughts and how they affect emotions
  • This included learning how to recognize automatic thoughts and the “hot thought”
  • Common cognitive errors were also discussed
8Activity scheduling
  • Described the activity record: a tool for recording weekly activities and finding connections between activities and associated moods
9Evidence
  • Back to the thought record, the fourth and fifth columns were explained, which included looking at evidence for and against the most intense thought
10Alternative and balanced thinking
  • Concluded the 5-Part Model with the final 2 columns outlining alternative or balanced thinking and rerating feelings
11Experiments
  • Introduced a behavioral activation technique of experiments to promote belief in alternative or balanced thinking
12Action plans
  • Promoted working on the identified problems using a structured tool called the action plan
13Review
  • Reviewed the 12 modules in the program and summarized the key tools and techniques

The feedback was based on predesigned feedback templates created by the lead psychiatrist and i-CBT expert at QUOPL. The feedback for each session followed a similar structure and was delivered as a letter addressed to the participant. The feedback template mirrored the following structure: (1) addressed the participant and thanked them for their work over the week while acknowledging any adverse events that occurred; (2) commented about their mood and sleep quality in the previous week; (3) summarized the content of the module, highlighting the main concepts; (4) summarized the participant’s answers; (5) empathized with the participant based on their shared experiences and encouraged them to use the learned CBT techniques; and (6) thanked them again for their time and provided the participant with a brief introduction about the next module’s content (Multimedia Appendix 3—sample feedback template for session 1). Overall, the feedback itself focused on the participant’s mood and sleep patterns over the week, progress on their weekly goals, and their understanding of CBT concepts. The care providers personalized the feedback template based on the participant’s responses.

The OPTT platform provided participants and care providers with a modality to communicate asynchronously regarding the availability of the next module and any questions or concerns regarding the OPTT operations or the study design. These questions and concerns were limited to the study design and technical issues, rather than personal or therapy-related concerns. Care providers viewed and replied to these OPTT messages at least once a week. For concerns regarding the OPTT platform and technical issues, participants were redirected to OPTT’s technical support team.

i-CBT With Stepped Care

Although all participants (56/56, 100%) had access to the i-CBT program, a designated care provider, and weekly feedback, only participants in the stepped care group received additional interventions as per the proposed stepped care model. The stepped care interventions were provided by their care provider or the team psychiatrist associated with their care as required. The structure of the stepped care model used in this study followed the 4 identified steps of a preventative stepped care model based on 10 randomized controlled trials [52]. These four steps included the following: (1) watchful waiting, (2) self-help psychotherapy, (3) face-to-face psychotherapy, and (4) referral to specialists. The intervention that participants received was dictated by the participant’s care team: the care provider and the team psychiatrist. This model initiated all participants at the lowest intervention of i-CBT beginning at session 1 and provided additional interventions beginning at session 5 after monitoring their progress through the first 4 sessions and obtaining 2 PHQ-9 scores as a quantitative assessment measure, to help with the decision (Textbox 1). Subsequently, an intervention could be added or changed in each session by the care team, following session 5. Beginning stepped care at session 5 allowed for a watchful waiting period as the initial step to understand the patient’s symptoms better, as seen in preventative stepped care models for anxiety and depressive disorders [52]. The first 3 interventions, steps 1 to 3, are similar in content and care provider, but the delivery modality varies. These first 3 steps included varying intensities to care and effort required by the care provider. Step 4 differed from the first 3 steps in that the team psychiatrist was involved and the content of care in this intervention was different. Details of each step in the intervention are provided in the following sections.

Step 0: i-CBT Only

This intervention was considered to have the lowest intensity because the participant was provided with an i-CBT program for depression that is effective in treating MDD [49]. This was also known as the starting point for all participants. All participants began at step 0, which included completing the i-CBT program. In this step, no intervention was added to the participants’ care, which allows for patient monitoring during a watchful waiting phase as they receive a low-intensity treatment [52]. Furthermore, many studies have control groups that encompass waitlist groups; however, more studies should focus on implementing i-CBT treatments as the control group for a wholesome review of the effects of stepped care models placed in these i-CBT programs. Therefore, step 0 mimics the procedure for the control group to allow for comparable effects between the 2 groups.

Step 1: i-CBT With Messaging

This intervention was the first added intervention following step 0 and included the addition of asynchronous check-in messages to the participant from their care provider on the OPTT platform. When the care provider sent the next session, they also sent a personalized message based on the message templates for that weekly session (Multimedia Appendix 3—sample message template). The message focused on addressing the participant and checking in with them by asking them how their week was so far. This intervention was a brief exchange between the participant and their care provider and a way to add active human support to the participant’s care through direct messaging [53,54]. Upon receiving the participant’s response, care providers acknowledged their experiences and reminded them to complete their next session.

Step 2: i-CBT With a Telephone Call

This intervention included a brief telephone call from the care provider for live, verbal support [55-57]. The call is limited to one 15 to 20–minute call during the week [58]. After sending the weekly session, care providers called the participant before the next session. The telephone call focused on asking participants how their week was and acknowledging the participant’s experience (Multimedia Appendix 3—sample call template). Care providers also asked for updates regarding module completion for the week and reminded participants to submit their weekly homework. This template was similar to that of step-1 messages, except that it included direct verbal encouragement.

Step 3: i-CBT With a Video Call

This intervention included a brief, secure, Microsoft Teams video call from the care provider for live support and visual contact between the participant and care provider, in addition to verbal cues. The video call is limited to one 20 to 30–minute call during the week [22,59]. Care providers set up a video call with the participant before the next session. The video call focused on the participant’s experience over the past week and how they are doing (Multimedia Appendix 3—sample message template). Care providers also encouraged participants to submit their weekly homework if they had not submitted yet. This template was similar to that of step-2 telephone calls and included direct, live encouragement in hopes to mimic a face-to-face setting.

Step 4: i-CBT With Psychiatrist Call

This intervention was the highest-intensity intervention provided in the stepped care model. This intervention included a web-based, one-on-one psychiatrist appointment with the team psychiatrist using Microsoft Teams. The psychiatrist discussed the participant’s current challenges and potential options for the participant. This may include the possibility of adding medication to the participant’s care based on the severity of the case. The selection of medication was based on the Canadian Network for Mood and Anxiety Treatments guidelines, and these guidelines were referenced to decide the first or second line of treatment for each participant [60].

When deciding the appropriate intervention, a participant’s care was not always increased sequentially; instead, a participant who exhibited severe symptoms by the end of session 4 was provided a high step as opposed to step 1. The decision about which intervention the participant would receive was dependent on a few factors considered by the care providers. These included (1) changes in participant’s PHQ-9 scores, (2) engagement with treatment, (3) progress in weekly goals, and (4) homework submission.

Changes in PHQ-9 Scores

PHQ-9 scores for each participant were collected every 3 weeks (ie, weeks 1, 4, 7, 10, and 13). The initial step-up decision was based on the first 2 PHQ-9 scores collected at weeks 1 and 4. If the participant’s PHQ-9 score at week 4 increased by >2 points compared with week 1, the participant was stepped up in their care to either step 1 (message) or step 2 (phone call). During the subsequent weeks, changes in the subsequent PHQ-9 scores were compared with the previous week’s score (ie, increase of >2 points) to determine whether an additional intervention was required [61].

Treatment Engagement

A systematic review including 35 studies showed that great treatment engagement significantly improved postintervention mental health outcomes [62]. Thus, participant engagement with treatment through the OPTT platform was another factor that was considered when determining which intervention would be most suitable for the participant. If the participant exhibited limited interaction with the platform (eg, read receipts for messages indicating that messages were not seen when notifying participants about session availability) or expressed difficulties in navigating the platform, the participant was provided with the step-2 (phone call) intervention. This limited engagement indicated that step 1 (messages) would be ineffective because the participant was not viewing the intervention. Therefore, the step-2 (phone call) intervention was identified as a more effective modality than the step-1 (messages) intervention. In addition, if participants did not respond to step-1 (messages) intervention, step-2 (phone call) interventions were provided as a follow-up.

Homework Submission

Participants’ answers to weekly homework were also considered as a factor when deciding their care intensity [63]. If participants indicated ongoing depressive symptoms that have not changed within the past 2 sessions, they were stepped up in care intensity. Similarly, if depressive symptoms did not improve within the past 2 weeks and if they did not find the current intervention of steps 1, 2, or 3 helpful, step 4 (psychiatrist support) was provided to the participant. Finally, if the care provider sensed any form of suicidal or homicidal ideation or any severe depressive behavior at any point, step 4 (psychiatrist support) was referred to the participant.

Goal Progress

Beginning in session 1, participants were encouraged to set a goal that they would like to achieve by the end of the program. Each week, participants were prompted to complete a small step toward the goal to help them achieve it. The weekly progress toward this goal rather than absolute achievement was used as another indication of whether a step-up in intervention was required [64]. Studies have shown some support for goal planning in positive treatment outcomes for mental health care through assisting the therapeutic relationship by building rapport and allowing for open communication [65,66]. If participants struggled with the progression in their weekly small step for >2 consecutive sessions, they were stepped up in their intervention.

Data Analysis

A combination of descriptive statistics, independent t tests, and ANOVA were used to determine any difference between the primary outcomes across the 2 groups. All analyses were performed at a 1-tailed significance level of α=.05. To determine any significant difference in the clinical questionnaire scores between the 2 groups, ANOVA was used. A 2×5 repeated-measures ANOVA was conducted for PHQ-9 scores, and a 2×3 repeated-measures ANOVA was performed for Q-LES-Q and QIDS scores. The time points at which meaningful differences appear were examined using the Bonferroni post hoc method. If Mauchly test of sphericity was significant, a Huynh-Feldt correction was applied. A chi-square test was conducted to compare treatment compliance across the 2 groups based on the number of participants completing all 13 sessions of the program. An independent samples t test was also performed to compare the number of sessions completed by participants in the 2 groups. In addition, an intention-to-treat (ITT) analysis was completed to assess the clinical outcomes of treatment on participants who withdrew prematurely. No intermediate analyses were performed, and all statistical analyses were completed after the trial. IBM SPSS Statistics (version 28) was used to conduct all analyses [67].


Participants

Recruitment was initiated in May 2021 after receiving approval from the Queen’s University Health Sciences and Affiliated Teaching Hospitals Research Ethics Board. Recruitment was conducted between May 2021 and June 2022, and 69 individuals were found to be eligible for this study. Table 2 displays the participant demographics. Of the 69 eligible individuals, 34 (49%) were randomized to the control group and only 28 (41%) initiated treatment. Of the 28 participants in the control group, 9 (32%) completed the full round of therapy (ie, 13 sessions of i-CBT). Of the 35 individuals randomized to the stepped care group, 28 (80%) initiated treatment. In the stepped care group, only 54% (15/28) of the participants completed all 13 sessions of the i-CBT program. Unfortunately, owing to some data collection errors, some questionnaire scores were not collected during the program, leading to some gaps in pretreatment, midtreatment, or posttreatment scores. These scores were treated as missing and were not imputed during data analysis. Figure 2 shows the participant flow.

Participants in the stepped care group were allocated to the stepped care intervention as follows: step 0 (8/28, 29%), step 1 (message; 2/28, 7%), step 2 (phone call; 15/28, 54%), step 3 (video call; 1/28, 4%), step 4 (psychiatrist consultation; 2/28, 7%). Overall, of the 28 participants, a total of 20 (71%) participants were stepped up in their care. This includes participants who dropped out prematurely and those who completed all 13 sessions. Of the 15 participants who completed all 13 sessions, 12 (80%) participants were stepped up in their care at some point during the program. Table 3 provides information regarding the number of occurrences of each step, and Table 4 provides a summary of each participant’s progression in the stepped care program throughout the treatment, beginning at session 5. Currently, the 1-year follow-up period is ongoing, in which PHQ-9, QIDS, and Q-LES-Q scores are collected at the 3-, 6-, 9-, and 12-month follow-up periods after the treatment. The follow-up period is expected to be completed in November 2023.

Table 2. Demographics and characteristics of the participants who began treatment, categorized based on treatment group: internet-based cognitive behavioral therapy (i-CBT) and i-CBT with stepped care.
Characteristicsi-CBT (n=28)Stepped care (n=28)
Age (y), mean (SD)37.88 (13.08)40.57 (14.28)
Baseline PHQ-9a score, mean (SD)16.63 (4.40)17.75 (5.33)
Sex, n (%)

Female17 (61)17 (61)

Male7 (25)11 (39)

Other2 (7)0 (0)

Missing2 (7)0 (0)
Ethnicity, n (%)

Asian1 (4)1 (4)

Hispanic1 (4)0 (0)

White7 (25)7 (25)

Other17 (61)20 (71)

Missing2 (7)0 (0)
First language, n (%)

English24 (86)26 (93)

Hebrew0 (0)1 (4)

Hindi0 (0)1 (4)

Cantonese1 (4)0 (0)

Spanish1 (4)0 (0)

Missing2 (7)0 (0)
Immigration status, n (%)

Born in Canada12 (43)13 (46)

Immigrated to Canada3 (11)2 (7)

Missing13 (46)13 (46)
Employment, n (%)

Full time13 (46)15 (54)

Part time3 (11)4 (14)

Unemployed6 (21)8 (29)

Student4 (14)1 (4)

Missing2 (7)0 (0)
Marital status, n (%)

Married7 (25)10 (36)

Never married14 (50)13 (36)

Divorced1 (4)2 (46)

Widowed2 (7)1 (7)

Other2 (7)2 (4)

Missing2 (7)0 (0)
Children, n (%)

Yes5 (18)13 (46)

No21 (75)15 (54)

Missing2 (7)0 (0)
Income (CAD $; CAD $1=US 0.74), n (%)

<20,0007 (25)6 (21)

20,000-34,9995 (18)3 (11)

35,000-49,9995 (18)8 (29)

50,000-74,9994 (14)6 (21)

75,000-99,9990 (0)2 (7)

>100,0003 (11)3 (11)

Missing4 (14)0 (0)

aPHQ-9: Patient Health Questionnaire–9.

Figure 2. CONSORT (Consolidated Standards of Reporting Trials) flow diagram of participant flow through the study. i-CBT: internet-based cognitive behavioral therapy; MINI: Mini International Neuropsychiatric Interview; PHQ-9: Patient Health Questionnaire–9; QIDS: Quick Inventory of Depressive Symptomatology; Q-LES-Q: Quality of Life Enjoyment and Satisfaction Questionnaire–Short Form.
Table 3. Sample size of the highest intervention provided for participants in the stepped care group, sorted based on completion and dropout from the internet-based cognitive behavioral therapy (i-CBT) program.
Stepped care interventionsStep 0: i-CBT only, n (%)Step 1: message, n (%)Step 2: phone call, n (%)Step 3: video call, n (%)Step 4: psychiatrist, n (%)
Dropout (n=13)5 (38)1 (8)6 (46)0 (0)1 (8)
Completed (n=15)3 (20)1 (7)9 (60)1 (7)1 (7)
Total (n=28)8 (29)2 (7)15 (54)1 (4)2 (7)
Table 4. The number of participants provided with each stepped care intervention for each session, from session 5 to session 13 (n=28).
StepSession 5, n (%)Session 6, n (%)Session 7, n (%)Session 8, n (%)Session 9, n (%)Session 10, n (%)Session 11, n (%)Session 12, n (%)Session 13, n (%)
N/Aa3 (11)5 (18)6 (21)6 (21)8 (29)9 (32)11 (39)13 (46)13 (46)
016 (57)17 (61)16 (57)15 (54)12 (43)15 (54)10 (36)12 (43)8 (29)
14 (14)1 (4)2 (7)1 (4)4 (14)0 (0)3 (11)1 (4)2 (7)
25 (18)5 (18)4 (14)6 (21)4 (14)2 (7)2 (7)1 (4)3 (11)
30 (0)0 (0)0 (0)0 (0)0 (0)2 (7)1 (4)1 (4)1 (4)
40 (0)0 (0)0 (0)0 (0)0 (0)0 (0)1 (4)0 (0)0 (0)

aN/A: not applicable.

Measured Outcomes

PHQ-9 Score

At baseline, for the participants who initiated the i-CBT program, the mean PHQ-9 score was 16.63 (SD 4.40; 27/28, 96%) for the control group and 17.75 (SD 5.33; 28/28, 100%) for the stepped care group, showing no statistically significant difference in pretreatment scores between the 2 groups (t53=−0.85; P=.40; 95% CI −3.77 to –1.53). A 2×5 repeated-measures ANOVA determined that the mean PHQ-9 scores differed significantly between time points (F4,80=9.95; P<.001; Figure 3), but there was no significant difference at different time points between the 2 groups (F4,80=0.43; P=.78; Figure 4). Post hoc analysis with Bonferroni adjustment revealed that PHQ-9 scores significantly decreased from pretreatment period (week 1) to the second time point (week 4; 4.554, 95% CI 1.264-7.843; P=.003), from pretreatment period (week 1) to the third time point (week 7; 4.973, 95% CI 1.904-8.042; P<.001), from pretreatment period (week 1) to the fourth time point (week 10; 4.384, 95% CI 0.862-7.906; P=.008), and from pretreatment period (week 1) to posttreatment period (week 13; 5.357, 95% CI 2.169-8.546; P<.001). All between–time point scores were statistically significant (Figure 3). A detailed breakdown of the results are summarized in Multimedia Appendix 4.

Figure 3. Estimated marginal means of Patient Health Questionnaire–9 (PHQ-9) scores at 5 treatment time intervals corresponding to sessions 1, 4, 7, 10, and 13, including both groups—internet-based cognitive behavioral therapy (i-CBT) only and i-CBT with stepped care. Error bars depict –2 or +2 SE.
Figure 4. Estimated marginal means of Patient Health Questionnaire–9 (PHQ-9) scores at 5 intervals of treatment (sessions 0, 4, 7, 10, and 13), in both internet-based cognitive behavioral therapy (i-CBT; blue) and i-CBT with stepped care (green) treatment conditions. Error bars depict –2 or +2 SE.
QIDS Score

At baseline, for the participants who initiated the i-CBT program, the mean QIDS score was 14.62 (SD 4.64; 21/28, 75%) for the control group and 16.83 (SD 4.43; 23/28, 82%) for the stepped care group, showing no statistical significance in pretreatment scores between the 2 groups (t42=−1.61; P=.11; 95% CI −4.97 to 0.55; independent samples t test). A 2×3 repeated-measures ANOVA determined that the mean QIDS scores differed significantly between time points (F2,28=5.73; P=.008; Figure 5), but there was no significant difference at different time points between the 2 groups (F2,28=3.05; P=.06; Figure 6). Post hoc analysis with Bonferroni adjustment revealed that QIDS scores significantly decreased from pretreatment period (week 1) to posttreatment period (week 13; 4.12, 95% CI 0.76-7.47; P=.02). There was no significant difference between pretreatment period (week 1) and midtreatment period (week 7; 2.08, 95% CI −1.10 to 5.26; P=.29) or between midtreatment period (week 7) and posttreatment period (week 13; 2.03, 95% CI −1.34 to 5.41; P=.37; Figure 5). A detailed breakdown of the results are summarized in Multimedia Appendix 4.

Figure 5. Estimated marginal means of Quick Inventory of Depressive Symptomatology (QIDS) scores at 3 treatment time intervals corresponding to sessions 1, 7, and 13, including both groups—internet-based cognitive behavioral therapy (i-CBT) only and i-CBT with stepped care. Error bars depict –2 or +2 SE.
Figure 6. Estimated marginal means of Quick Inventory of Depressive Symptomatology (QIDS) scores at 3 intervals of treatment (sessions 0, 7, and 13), in both internet-based cognitive behavioral therapy (i-CBT; blue) and i-CBT with stepped care (green) treatment conditions. Error bars depict –2 or +2 SE.
Q-LES-Q Score

At baseline, for the participants who initiated the i-CBT program, the mean Q-LES-Q score was 36.88 (SD 7.80; 26/28, 93%) for the control group and 36.25 (SD 7.81; 28/28, 100%) for the stepped care group, showing no statistical significance in pretreatment scores between the 2 groups (t52=0.30; P=.77; 95% CI −3.63 to 4.90; independent samples t test). A 2×3 repeated-measures ANOVA determined that the mean Q-LES-Q scores differed significantly between time points (F2,38=4.18; P=.02; Figure 7), but there was no significant difference at different time points between the 2 groups (F2,38=0.19; P=.83; Figure 8). Post hoc analysis with Bonferroni adjustment revealed that Q-LES-Q scores significantly increased from pretreatment period (week 1) to midtreatment period (week 7; −5.50, 95% CI −10.91 to –0.94; P=.045). There were no significant differences between pretreatment period (week 1) and posttreatment period (week 13; −4.77, 95% CI −11.03 to 1.49; P=.18) and between midtreatment period (week 7) and posttreatment period (week 13; 0.73, 95% CI −5.18 to 3.72; P=.99; Figure 7). A detailed breakdown of the results are summarized in Multimedia Appendix 4.

Figure 7. Estimated marginal means of Quality of Life Enjoyment and Satisfaction Questionnaire–Short Form (Q-LES-Q) scores at 3 treatment time intervals corresponding to sessions 1, 7, and 13, including both groups—internet-based cognitive behavioral therapy (i-CBT) only and i-CBT with stepped care. Error bars depict –2 or +2 SE.
Figure 8. Estimated marginal means of Quality of Life Enjoyment and Satisfaction Questionnaire–Short Form (Q-LES-Q) scores at 3 intervals of treatment (sessions 0, 7, and 13), in both internet-based cognitive behavioral therapy (i-CBT; blue) and i-CBT with stepped care (green) treatment conditions. Error bars depict –2 or +2 SE.

Treatment Compliance

The proportion of participants completing the full round of therapy (ie, 13 sessions) was 32% (9/28) in the i-CBT–only group and 54% (15/28) in the stepped care group. There was no significant difference between the 2 groups regarding completion of the i-CBT program for depression (χ21=2.6; P=.10; chi-square test). An independent samples t test was conducted to determine whether there was a difference in the number of completed sessions between the i-CBT group and the stepped care group for the individuals who had begun the program. The results indicate significant difference between the average number of sessions completed by participants in the i-CBT–only group (mean 7, SD 4.64; 28/28, 100%) and stepped care group (mean 9.41, SD 4.44; 28/28, 100%; t55=−2; P=.03; 95% CI −4.83 to −0.002; independent samples t test). Multimedia Appendix 5 shows the distribution of the sessions completed in each group.

ITT Analysis

A linear mixed model analysis was used to conduct the intent-to-treat analysis for each participant across the program. The group (i-CBT or stepped care) and evaluation time points were indicated as fixed factors. This analysis included participants who did not complete the full program and dropped out of the study before completion. As seen previously, there was significant change in PHQ-9 scores across the time points (F4,48.79=10.98; P<.001), but there was no significant difference between the 2 groups (F1,107.07=2.79; P=.10). In addition, for the QIDS scores, there was significant change in scores across the time points (F2,41.08=8.53; P<.001), but no significant difference between the 2 groups (F1,54.44=2.72; P=.10). Q-LES-Q scores imitated a similar pattern, with significant difference in scores across the time points (F2,44.99=9.36; P<.001), but no significant difference between the 2 groups (F1,60.75=3.28; P=.08).


Principal Findings

This study evaluated the effectiveness of an i-CBT program with and without stepped care for depression among adults. The results of this study indicate that the proposed stepped care model was not significantly better in reducing depressive symptoms, as measured by PHQ-9 and QIDS, than the i-CBT program alone. Some previous studies have also found no significant differences between stepped care treatments and care as usual in improving depressive symptoms [52,68]. Ho et al [52], who reviewed stepped care for both depressive and anxiety disorders, found that stepped care treatment was significantly better in improving anxiety symptoms but did not find any significant difference in reducing depressive symptoms. This suggests some differences in the populations and the sensitivity of the stepped care structure in addressing different mental health issues. When viewing the results of both groups together, this study indicated that the i-CBT program itself was effective in significantly reducing depressive symptoms from pretreatment period to posttreatment period, as measured by the PHQ-9 and QIDS; however, there were no significant differences in the reduction of depressive symptoms between the 2 groups. The stepped care group did not show to be significantly better in reducing depressive symptoms than the i-CBT group. This finding is consistent with other studies of i-CBT programs, which show improvements in depressive symptoms for mild to moderate depression [69,70]. This also reinforces the efficacy of the i-CBT program for depression on OPTT used in this study, based on similar results from previous clinical trials using this program [47,49].

Furthermore, the results suggest that the i-CBT program indicated significant difference in the quality of life, as measured by Q-LES-Q; however, post hoc analysis revealed that overall, there were no significant differences before and after treatment in improving the quality of life. Significant difference was observed between pretreatment period and midtreatment period, which may suggest that the i-CBT program had the greatest impact on improving quality of life in the early stages of the program. No significant differences were observed between the i-CBT and stepped care groups. A systematic review and meta-analysis reviewed 3 studies of the effects of i-CBT on the quality of life and found inconclusive evidence of i-CBT compared with in-person outcomes [71]. We found no significant difference between the effects of i-CBT with stepped care and i-CBT without stepped care on the quality of life.

Although the completion rates between the 2 groups were not significantly different, participants in the stepped care group significantly completed, on average, 2 more sessions of therapy than those in the i-CBT group. The increase in the number of completed sessions may have been caused by the added support offered in the stepped care group. This is consistent with previous studies that report improvement in treatment adherence in mental health treatment with additional interventions in care [21,28,63]. Specifically, phone and video calls assist with keeping patients in care compared with in-person treatment [36]. Compared with in-person treatment, receiving care for depression over the phone [56,72] or via video [22] is associated with high completion rates and few dropouts. Further studies are required to decipher whether the stepped care group’s high completion rate of sessions is associated with better treatment outcomes than the i-CBT group.

Furthermore, Multimedia Appendix 5 shows that although participant dropout occurs uniformly across the first 10 sessions in the stepped care group, most participants (19/28, 68%) in the i-CBT group dropped out in the first half of the program (ie, first 7 sessions): 25% (7/28) of participants in the stepped care group dropped out of the program before the midpoint of treatment (ie, session 7) and 68% (19/28) of participants in the i-CBT group. Previous studies have noted that most patients drop out of treatment programs after 2 to 4 sessions [16,31,73]. During this time, participants were provided with i-CBT care only in both groups (additional interventions for the stepped care group were introduced at session 5 after monitoring their PHQ-9 scores and interaction with the i-CBT program); however, introducing a possibility of intervention soon in the stepped care group may have helped participants who were indicated as an early dropout (ie, before session 5) complete more sessions. Concurrently, it is noteworthy that the i-CBT program’s 13 sessions were not completed by several participants (32/56, 57%) in both groups. This is consistent with previous studies that reveal high dropout rates in depression i-CBT programs. Compliance is generally a challenge for i-CBT programs, with dropout rates averaging approximately 32% and ranging between 0% and 75% [26,37], whereas traditional CBT dropout rates are approximately 25% on average, ranging between 0% and 68% [74]. However, another study found that additional human support results in a large effect size regarding the efficacy of i-CBT (g=0.673) than providing no additional support (g=0.239) [34]. Thus, it was expected that the stepped care group would exhibit significant improvements following treatment, but this was not observed in this study. This may be owing to the nature of the study design, as the i-CBT group received some support during the treatment through the homework feedback and did not encompass a truly no-support intervention. Upon reviewing participant progression in the stepped care model (Table 4), it was seen that on average, most participants (13/28, 46%) spent their time in step 0 of the stepped care model, which mimics the control group (i-CBT only). This may be a factor in the observed nonsignificant differences between the 2 groups because not many participants were stepped up in their care across treatment. Moreover, the small sample size may have influenced the outcomes. A previous study has shown that patients who terminate CBT prematurely show high symptom severity compared with patients who complete therapy, but the 2 groups did not vary in the rate of symptom change [75]. This suggests that the increase in symptom severity may arise from completing few sessions of treatment in the dropout group compared with the completer group and explains the differing results observed between the 2 groups as dropout was high. Given the effectiveness of i-CBT treatment and the high dropout rates, it is important to assist patients in completing more sessions by providing sufficient resources and care. Our proposed stepped care model assisted participants in completing a great number of sessions. Stepped care has been associated with high treatment satisfaction, which may have assisted in participants completing more sessions in this group [68,76]. Future studies should examine the variables that may be responsible for treatment attrition in i-CBT programs and devise methods to raise the rates of treatment engagement and completion.

Limitations

It is important to consider further limitations of this study. This includes the relatively small sample size; observed sex imbalance, with 61% (34/56) women in the study (approximately 15% more women in the i-CBT group compared with the stepped care group); and lack of long-term follow-up, which is currently ongoing. It is important to note that the sample size for analysis of the i-CBT group was smaller than that of the stepped care group. In addition, the participants in this study may not be representative of the general population, as they were predominantly women, English speaking (owing to the limitations of the i-CBT program), employed full time, and recruited from a specific clinical setting of self-referrals and clinics limited to Kingston, Ontario (Table 2). Missing data were also a challenge that affected the total sample size. A large portion of the data was unavailable owing to collection errors and dropouts (Figure 2). We attempted to address this issue by using ITT analysis and observed similar results with no significant differences between groups but observed significant differences across various time points for PHQ-9, QIDS, and Q-LES-Q scores.

This study was not specifically designed to investigate the effects of the different treatment interventions in the stepped care group and how they influenced the results. In hindsight, using 4 different factors to decide about the stepped intervention results in increased variability in the stepped care decision and limits our ability to decipher the effectiveness of the approach. Most stepped care models use clinical questionnaire scores, such as the PHQ-9 score, to decide when to step up or step down care [68,76-78]; however, our study did not include strict cutoff guidelines and instead adopted a subjective monitoring approach of PHQ-9 scores as one of the evaluating factors. Changes in PHQ-9 scores (scale ranging from 0-27) and homework submission (submitted or not submitted) can be quantized predictors for stepped care; however, monitoring engagement with the OPTT platform and goal progression are variables that are multifactorial and are subject to interpretation. This design prevented us from making conclusions about a best-fit intervention model. Furthermore, beginning the stepped care interventions in session 5 allowed for a watchful waiting period that allowed reflection about patient status to determine the correct intensity of care if they did not improve with a low-resource intervention (ie, i-CBT). However, this may be a limitation of the proposed stepped care model, as the waiting period may be harmful because it may delay optimal treatment [68]. With a small sample size, it is difficult to analyze the effects of these deciding factors. Future studies need to be conducted to explore the effects of the individual stepped interventions provided in this study and any potential relationships among the modalities of care.

Therapeutic alliance in psychotherapy is another significant factor in predicting treatment outcomes [79-81]. The i-CBT–only group had limited interaction with their assigned care provider, and the ability to build rapport with participants was limited. In the stepped care group, participants were potentially able to gain a deep connection with their care provider, beginning in session 5, based on the intervention provided to them. Therapeutic alliance follows two important phases: (1) initial alliance development, usually occurring within the first 5 sessions, and (2) challenging the patient more actively, which can cause strain to the therapeutic relationship [79]. With stepped care interventions being provided in session 5, the first phase seems to be neglected and may affect the potential relationship, thus the structure of the program hinders participants from achieving the desired treatment outcome and reducing their depressive symptoms. Some studies demonstrate that a positive outcome is more predictive by the quality of the alliance rather than the type of the intervention [79,82-84]. In this case, the quality of the alliance was affected by the limited interaction with the care provider and may reflect one of the limitations of online therapy. Some studies found that building therapeutic alliances face to face is significantly more effective than online psychological treatments [85-89]. In contrast, other studies have found the opposite and report no correlation between the therapeutic alliance and treatment outcomes in digital interventions [90-93]. Further studies are required to better understand the characteristics of therapeutic alliance in digital contexts [25,94]. It would also be interesting to assess participant and care provider opinions about their therapeutic alliance during the study to better understand this limitation.

Conclusions

This study provides further evidence that i-CBT is effective for treating depressive symptoms. However, the study showed no significant evidence that the proposed stepped care model was more effective than i-CBT alone. The stepped care model allowed participants to complete 2 more sessions on average than the i-CBT–only group, indicating that stepped care is an effective method for guiding patients to treatment completion. Future studies should examine the long-term effects of such interventions and the efficacy of specific stepped care interventions in large and more diverse groups. To improve the design and implementation of such a model, studies might also investigate the processes through which stepped care interventions reduce depression symptoms and enhance the quality of life.

Acknowledgments

The authors would like to thank all the care providers involved in this program for ensuring that participants were supported throughout the study. The authors are also grateful to the participants of this study who provided their time and trust in the process to help the authors complete and further investigate this online cognitive behavioral therapy approach.

Data Availability

The data sets generated during and analyzed during this study are available from the corresponding author on reasonable request.

Conflicts of Interest

NA and MO have cofounded Online Psychotherapy Tool (OPTT), the platform used to provide care to participants. They have ownership stakes in OPTT Inc.

Multimedia Appendix 1

CONSORT-eHEALTH checklist (V 1.6.1).

PDF File (Adobe PDF File), 7464 KB

Multimedia Appendix 2

Sample of the e–cognitive behavioral therapy program for depression used in the study, showcasing session 5.

PDF File (Adobe PDF File), 3875 KB

Multimedia Appendix 3

Feedback templates for e–cognitive behavioral therapy used throughout the study by care providers including feedback for session homework and live interactions between the care provider and participants.

DOCX File , 20 KB

Multimedia Appendix 4

Statistical analysis results.

DOCX File , 31 KB

Multimedia Appendix 5

The frequency of participants’ last completed sessions organized by 2 groups—internet-based cognitive behavioral therapy (i-CBT) only and i-CBT with stepped care.

PNG File , 62 KB

  1. GBD results. Institute for Health Metrics and Evaluation. URL: https://vizhub.healthdata.org/gbd-results [accessed 2023-09-25]
  2. Vos T, Lim SS, Abbafati C, Abbas KM, Abbasi M, Abbasifard M. Global burden of 369 diseases and injuries in 204 countries and territories, 1990-2019: a systematic analysis for the Global Burden of Disease Study 2019. Lancet. Oct 2020;396(10258):1204-1222. [FREE Full text] [CrossRef]
  3. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders: DSM-5. 5th edition. Washington, DC. American Psychiatric Association; 2013.
  4. Cho Y, Lee JK, Kim DH, Park JH, Choi M, Kim HJ, et al. Factors associated with quality of life in patients with depression: a nationwide population-based study. PLoS One. Jul 2019;14(7):e0219455. [FREE Full text] [CrossRef] [Medline]
  5. Engel L, Chen G, Richardson J, Mihalopoulos C. The impact of depression on health-related quality of life and wellbeing: identifying important dimensions and assessing their inclusion in multi-attribute utility instruments. Qual Life Res. Nov 2018;27(11):2873-2884. [FREE Full text] [CrossRef] [Medline]
  6. Heu U, Bogren M, Wang AG, Brådvik L. Aspects of additional psychiatric disorders in severe depression/melancholia: a comparison between suicides and controls and general pattern. Int J Environ Res Public Health. Jun 21, 2018;15(7):1299. [FREE Full text] [CrossRef] [Medline]
  7. Lake J, Turner MS. Urgent need for improved mental health care and a more collaborative model of care. Perm J. 2017;21:17-024. [FREE Full text] [CrossRef] [Medline]
  8. Mekonen T, Chan GC, Connor JP, Hides L, Leung J. Estimating the global treatment rates for depression: a systematic review and meta-analysis. J Affect Disord. Dec 01, 2021;295:1234-1242. [FREE Full text] [CrossRef] [Medline]
  9. Karyotaki E, Riper H, Twisk J, Hoogendoorn A, Kleiboer A, Mira A, et al. Efficacy of self-guided internet-based cognitive behavioral therapy in the treatment of depressive symptoms: a meta-analysis of individual participant data. JAMA Psychiatry. Apr 01, 2017;74(4):351-359. [FREE Full text] [CrossRef] [Medline]
  10. Myhr G, Payne K. Cost-effectiveness of cognitive-behavioural therapy for mental disorders: implications for public health care funding policy in Canada. Can J Psychiatry. Sep 2006;51(10):662-670. [FREE Full text] [CrossRef] [Medline]
  11. Webb CA, Rosso IM, Rauch SL. Internet-based cognitive-behavioral therapy for depression: current progress and future directions. Harv Rev Psychiatry. May 2017;25(3):114-122. [FREE Full text] [CrossRef] [Medline]
  12. Coombs NC, Meriwether WE, Caringi J, Newcomer SR. Barriers to healthcare access among U.S. adults with mental health challenges: a population-based study. SSM Popul Health. Sep 2021;15:100847. [FREE Full text] [CrossRef] [Medline]
  13. Mental health care needs, 2018. Government of Canada. 2019. URL: https://www150.statcan.gc.ca/n1/pub/82-625-x/2019001/article/00011-eng.htm [accessed 2022-02-06]
  14. Levesque JF, Harris MF, Russell G. Patient-centred access to health care: conceptualising access at the interface of health systems and populations. Int J Equity Health. Mar 11, 2013;12:18. [FREE Full text] [CrossRef] [Medline]
  15. Gratzer D, Khalid-Khan F. Internet-delivered cognitive behavioural therapy in the treatment of psychiatric illness. CMAJ. Mar 01, 2016;188(4):263-272. [FREE Full text] [CrossRef] [Medline]
  16. Richards D, Richardson T. Computer-based psychological treatments for depression: a systematic review and meta-analysis. Clin Psychol Rev. Jun 2012;32(4):329-342. [FREE Full text] [CrossRef] [Medline]
  17. Andersson G, Cuijpers P. Internet-based and other computerized psychological treatments for adult depression: a meta-analysis. Cogn Behav Ther. 2009;38(4):196-205. [FREE Full text] [CrossRef] [Medline]
  18. Musiat P, Tarrier N. Collateral outcomes in e-mental health: a systematic review of the evidence for added benefits of computerized cognitive behavior therapy interventions for mental health. Psychol Med. Nov 2014;44(15):3137-3150. [CrossRef] [Medline]
  19. Saddichha S, Al-Desouki M, Lamia A, Linden IA, Krausz M. Online interventions for depression and anxiety - a systematic review. Health Psychol Behav Med. Jan 01, 2014;2(1):841-881. [FREE Full text] [CrossRef] [Medline]
  20. Sztein DM, Koransky CE, Fegan L, Himelhoch S. Efficacy of cognitive behavioural therapy delivered over the Internet for depressive symptoms: a systematic review and meta-analysis. J Telemed Telecare. Sep 2018;24(8):527-539. [CrossRef] [Medline]
  21. Mohr DC, Lattie EG, Tomasino KN, Kwasny MJ, Kaiser SM, Gray EL, et al. A randomized noninferiority trial evaluating remotely-delivered stepped care for depression using internet cognitive behavioral therapy (CBT) and telephone CBT. Behav Res Ther. Dec 2019;123:103485. [FREE Full text] [CrossRef] [Medline]
  22. Shabahang R, Aruguete MS, McCutcheon L. Video-based cognitive-behavioral intervention for COVID-19 anxiety: a randomized controlled trial. Trends Psychiatry Psychother. Apr 2021;43(2):141-150. [FREE Full text] [CrossRef] [Medline]
  23. Kelders SM, Kok RN, Ossebaard HC, Van Gemert-Pijnen JE. Persuasive system design does matter: a systematic review of adherence to web-based interventions. J Med Internet Res. Nov 14, 2012;14(6):e152. [FREE Full text] [CrossRef] [Medline]
  24. Sigurðardóttir S, Helgadóttir FD, Menzies RE, Sighvatsson MB, Menzies RG. Improving adherence to a web-based cognitive-behavioural therapy program for social anxiety with group sessions: a randomised control trial. Internet Interv. Apr 2022;28:100535. [FREE Full text] [CrossRef] [Medline]
  25. Tremain H, McEnery C, Fletcher K, Murray G. The therapeutic alliance in digital mental health interventions for serious mental illnesses: narrative review. JMIR Ment Health. Aug 07, 2020;7(8):e17204. [FREE Full text] [CrossRef] [Medline]
  26. Fernandez E, Salem D, Swift JK, Ramtahal N. Meta-analysis of dropout from cognitive behavioral therapy: magnitude, timing, and moderators. J Consult Clin Psychol. Dec 2015;83(6):1108-1122. [CrossRef] [Medline]
  27. Christensen H, Griffiths KM, Farrer L. Adherence in internet interventions for anxiety and depression: systematic review. J Med Internet Res. Apr 24, 2009;11(2):e13. [FREE Full text] [CrossRef] [Medline]
  28. Bower P, Gilbody S. Stepped care in psychological therapies: access, effectiveness and efficiency. narrative literature review. Br J Psychiatry. Jan 2005;186:11-17. [FREE Full text] [CrossRef] [Medline]
  29. Cross SP, Hickie I. Transdiagnostic stepped care in mental health. Public Health Res Pract. Apr 27, 2017;27(2):2721712. [FREE Full text] [CrossRef] [Medline]
  30. Delgadillo J, Ali S, Fleck K, Agnew C, Southgate A, Parkhouse L, et al. Stratified care vs stepped care for depression: a cluster randomized clinical trial. JAMA Psychiatry. Feb 01, 2022;79(2):101-108. [FREE Full text] [CrossRef] [Medline]
  31. Nicholas J, Ringland KE, Graham AK, Knapp AA, Lattie EG, Kwasny MJ, et al. Stepping up: predictors of 'stepping' within an iCBT stepped-care intervention for depression. Int J Environ Res Public Health. Nov 25, 2019;16(23):4689. [FREE Full text] [CrossRef] [Medline]
  32. Kobak KA, Wolitzky-Taylor K, Craske MG, Rose RD. Therapist training on cognitive behavior therapy for anxiety disorders using internet-based technologies. Cognit Ther Res. Apr 2017;41(2):252-265. [FREE Full text] [CrossRef] [Medline]
  33. Applebaum AJ, DuHamel KN, Winkel G, Rini C, Greene PB, Mosher CE, et al. Therapeutic alliance in telephone-administered cognitive-behavioral therapy for hematopoietic stem cell transplant survivors. J Consult Clin Psychol. Oct 2012;80(5):811-816. [FREE Full text] [CrossRef] [Medline]
  34. Wright JH, Owen JJ, Richards D, Eells TD, Richardson T, Brown GK, et al. Computer-assisted cognitive-behavior therapy for depression: a systematic review and meta-analysis. J. Clin. Psychiatry. Mar 19, 2019;80(2):18r12188. [FREE Full text] [CrossRef]
  35. Dedert E, McDuffie JR, Swinkels C, Shaw R, Fulton J, Allen KD, et al. Computerized cognitive behavioral therapy for adults with depressive or anxiety disorders. Department of Veterans Affairs, Government of US. 2013. URL: https://www.ncbi.nlm.nih.gov/books/NBK269001/pdf/Bookshelf_NBK269001.pdf [accessed 2024-01-18]
  36. Chen PV, Helm A, Caloudas SG, Ecker A, Day G, Hogan J, et al. Evidence of phone vs video-conferencing for mental health treatments: a review of the literature. Curr Psychiatry Rep. Oct 2022;24(10):529-539. [FREE Full text] [CrossRef] [Medline]
  37. Schmidt ID, Forand NR, Strunk DR. Predictors of dropout in internet-based cognitive behavioral therapy for depression. Cognit Ther Res. Jun 2019;43(3):620-630. [FREE Full text] [CrossRef] [Medline]
  38. Stephenson C, Moghimi E, Gutierrez G, Jagayat J, Layzell G, Patel C, et al. User experiences of an online therapist-guided psychotherapy platform, OPTT: a cross-sectional study. Internet Interv. Apr 2023;32:100623. [FREE Full text] [CrossRef] [Medline]
  39. Eysenbach G, CONSORT-EHEALTH Group. CONSORT-EHEALTH: improving and standardizing evaluation reports of Web-based and mobile health interventions. J Med Internet Res. Dec 31, 2011;13(4):e126. [FREE Full text] [CrossRef] [Medline]
  40. Omrani M, Alavi N, Rivera M, Khalid-Khan S. Online clinic, a new method of delivering psychotherapy. Eur Psychiatry. 2017;41(S1):S148. [FREE Full text] [CrossRef]
  41. Kroenke K, Spitzer RL. The PHQ-9: a new depression diagnostic and severity measure. Psychiatric Annals. Sep 2002;32(9):509-515. [FREE Full text] [CrossRef]
  42. Rush AJ, Trivedi MH, Ibrahim HM, Carmody TJ, Arnow B, Klein DN, et al. The 16-Item Quick Inventory of Depressive Symptomatology (QIDS), clinician rating (QIDS-C), and self-report (QIDS-SR): a psychometric evaluation in patients with chronic major depression. Biol Psychiatry. Sep 01, 2003;54(5):573-583. [FREE Full text] [CrossRef] [Medline]
  43. Endicott J, Nee J, Harrison W, Blumenthal R. Quality of life enjoyment and satisfaction questionnaire: a new measure. Psychopharmacol Bull. 1993;29(2):321-326. [Medline]
  44. Sheehan DV, Lecrubier Y, Sheehan KH, Amorim P, Janavs J, Weiller E, et al. The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry. 1998;59 Suppl 20:22-57. [Medline]
  45. Faul F, Erdfelder E, Lang AG, Buchner A. G*Power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav Res Methods. May 2007;39(2):175-191. [FREE Full text] [CrossRef] [Medline]
  46. Alavi N, Stephenson C, Yang M, Kumar A, Shao Y, Miller S, et al. Feasibility and efficacy of delivering cognitive behavioral therapy through an online psychotherapy tool for depression: protocol for a randomized controlled trial. JMIR Res Protoc. Jun 16, 2021;10(6):e27489. [FREE Full text] [CrossRef] [Medline]
  47. Alavi N, Hirji A, Sutton C, Naeem F. Online CBT is effective in overcoming cultural and language barriers in patients with depression. J Psychiatr Pract. Jan 2016;22(1):2-8. [CrossRef] [Medline]
  48. Alavi N, Hirji A. The efficacy of powerpoint-based CBT delivered through email: breaking the barriers to treatment for generalized anxiety disorder. J Psychiatr Pract. Mar 2020;26(2):89-100. [CrossRef] [Medline]
  49. Alavi N, Moghimi E, Stephenson C, Gutierrez G, Jagayat J, Kumar A, et al. Comparison of online and in-person cognitive behavioral therapy in individuals diagnosed with major depressive disorder: a non-randomized controlled trial. Front Psychiatry. Apr 28, 2023;14:1113956. [FREE Full text] [CrossRef] [Medline]
  50. Alavi N, Omrani M. Online Cognitive Behavioral Therapy: An e-Mental Health Approach to Depression and Anxiety. Cham, Switzerland. Springer; 2019.
  51. Hoffmann TC, Glasziou PP, Boutron I, Milne R, Perera R, Moher D, et al. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ. Mar 07, 2014;348(mar07 3):g1687. [FREE Full text] [CrossRef] [Medline]
  52. Ho FY, Yeung WF, Ng TH, Chan CS. The efficacy and cost-effectiveness of stepped care prevention and treatment for depressive and/or anxiety disorders: a systematic review and meta-analysis. Sci Rep. Jul 05, 2016;6:29281. [FREE Full text] [CrossRef] [Medline]
  53. Aguilera A, Muñoz RF. Text messaging as an adjunct to CBT in low-income populations: a usability and feasibility pilot study. Prof Psychol Res Pr. Dec 01, 2011;42(6):472-478. [FREE Full text] [CrossRef] [Medline]
  54. Alfonsson S, Englund J, Parling T. Tailored text message prompts to increase therapy homework adherence: a single-case randomised controlled study. Behav Change. Apr 11, 2019;36(3):180-191. [FREE Full text] [CrossRef]
  55. Corruble E, Swartz HA, Bottai T, Vaiva G, Bayle F, Llorca PM, et al. Telephone-administered psychotherapy in combination with antidepressant medication for the acute treatment of major depressive disorder. J Affect Disord. Jan 15, 2016;190:6-11. [FREE Full text] [CrossRef] [Medline]
  56. Fann JR, Bombardier CH, Vannoy S, Dyer J, Ludman E, Dikmen S, et al. Telephone and in-person cognitive behavioral therapy for major depression after traumatic brain injury: a randomized controlled trial. J Neurotrauma. Jan 01, 2015;32(1):45-57. [FREE Full text] [CrossRef] [Medline]
  57. Simon GE, Ludman EJ, Tutty S, Operskalski B, Von Korff MV. Telephone psychotherapy and telephone care management for primary care patients starting antidepressant treatment: a randomized controlled trial. JAMA. Aug 25, 2004;292(8):935-942. [FREE Full text] [CrossRef] [Medline]
  58. Ho FY, Chung KF, Yeung WF, Ng TH, Cheng SK. Weekly brief phone support in self-help cognitive behavioral therapy for insomnia disorder: relevance to adherence and efficacy. Behav Res Ther. Dec 2014;63:147-156. [FREE Full text] [CrossRef] [Medline]
  59. Ciuca AM, Berger T, Crişan LG, Miclea M. Internet-based treatment for panic disorder: a three-arm randomized controlled trial comparing guided (via real-time video sessions) with unguided self-help treatment and a waitlist control. PAXPD study results. J Anxiety Disord. May 2018;56:43-55. [FREE Full text] [CrossRef] [Medline]
  60. Kennedy SH, Lam RW, McIntyre RS, Tourjman SV, Bhat V, Blier P, et al. CANMAT Depression Work Group. Canadian Network for Mood and Anxiety Treatments (CANMAT) 2016 clinical guidelines for the management of adults with major depressive disorder: section 3. Pharmacological treatments. Can J Psychiatry. Sep 2016;61(9):540-560. [FREE Full text] [CrossRef] [Medline]
  61. Simon GE, Rutter CM, Peterson D, Oliver M, Whiteside U, Operskalski B, et al. Does response on the PHQ-9 depression questionnaire predict subsequent suicide attempt or suicide death? Psychiatr Serv. Dec 01, 2013;64(12):1195-1202. [FREE Full text] [CrossRef] [Medline]
  62. Gan DZ, McGillivray L, Han J, Christensen H, Torok M. Effect of engagement with digital interventions on mental health outcomes: a systematic review and meta-analysis. Front Digit Health. Nov 4, 2021;3:764079. [FREE Full text] [CrossRef] [Medline]
  63. Haller E, Watzke B. The role of homework engagement, homework-related therapist behaviors, and their association with depressive symptoms in telephone-based CBT for depression. Cogn Ther Res. Jul 22, 2020;45(2):224-235. [FREE Full text] [CrossRef]
  64. Knittle K, Gellert P, Moore C, Bourke N, Hull V. Goal achievement and goal-related cognitions in behavioral activation treatment for depression. Behav Ther. Sep 2019;50(5):898-909. [FREE Full text] [CrossRef] [Medline]
  65. Stewart V, McMillan SS, Hu J, Ng R, El-Den S, O'Reilly C, et al. Goal planning in mental health service delivery: a systematic integrative review. Front Psychiatry. Dec 19, 2022;13:1057915. [FREE Full text] [CrossRef] [Medline]
  66. Jacob J, Stankovic M, Spuerck I, Shokraneh F. Goal setting with young people for anxiety and depression: what works for whom in therapeutic relationships? A literature review and insight analysis. BMC Psychol. Jul 13, 2022;10(1):171. [FREE Full text] [CrossRef] [Medline]
  67. IBM SPSS Statistics for Windows. IBM Corp. 2021. URL: https://www.ibm.com/support/pages/downloading-ibm-spss-statistics-21 [accessed 2024-01-18]
  68. Apil SR, Hoencamp E, Judith Haffmans PM, Spinhoven P. A stepped care relapse prevention program for depression in older people: a randomized controlled trial. Int J Geriatr Psychiatry. Jun 2012;27(6):583-591. [FREE Full text] [CrossRef] [Medline]
  69. DiNapoli EA, Pierpaoli CM, Shah A, Yang X, Scogin F. Effects of home-delivered cognitive behavioral therapy (CBT) for depression on anxiety symptoms among rural, ethnically diverse older adults. Clin Gerontol. 2017;40(3):181-190. [FREE Full text] [CrossRef] [Medline]
  70. López-López JA, Davies SR, Caldwell DM, Churchill R, Peters TJ, Tallon D, et al. The process and delivery of CBT for depression in adults: a systematic review and network meta-analysis. Psychol Med. Sep 2019;49(12):1937-1947. [FREE Full text] [CrossRef] [Medline]
  71. Luo C, Sanger N, Singhal N, Pattrick K, Shams I, Shahid H, et al. A comparison of electronically-delivered and face to face cognitive behavioural therapies in depressive disorders: a systematic review and meta-analysis. EClinicalMedicine. Jul 2020;24:100442. [FREE Full text] [CrossRef] [Medline]
  72. Mohr DC, Ho J, Duffecy J, Reifler D, Sokol L, Burns MN, et al. Effect of telephone-administered vs face-to-face cognitive behavioral therapy on adherence to therapy and depression outcomes among primary care patients: a randomized trial. JAMA. Jun 06, 2012;307(21):2278-2285. [FREE Full text] [CrossRef] [Medline]
  73. Meyer B, Berger T, Caspar F, Beevers CG, Andersson G, Weiss M. Effectiveness of a novel integrative online treatment for depression (Deprexis): randomized controlled trial. J Med Internet Res. May 11, 2009;11(2):e15. [FREE Full text] [CrossRef] [Medline]
  74. Hans E, Hiller W. Effectiveness of and dropout from outpatient cognitive behavioral therapy for adult unipolar depression: a meta-analysis of nonrandomized effectiveness studies. J Consult Clin Psychol. Feb 2013;81(1):75-88. [FREE Full text] [CrossRef] [Medline]
  75. Zieve GG, Persons JB, Yu LA. The relationship between dropout and outcome in naturalistic cognitive behavior therapy. Behav Ther. Jan 2019;50(1):189-199. [FREE Full text] [CrossRef] [Medline]
  76. Davidson KW, Rieckmann N, Clemow L, Schwartz JE, Shimbo D, Medina V, et al. Enhanced depression care for patients with acute coronary syndrome and persistent depressive symptoms: coronary psychosocial evaluation studies randomized controlled trial. Arch Intern Med. Apr 12, 2010;170(7):600-608. [FREE Full text] [CrossRef] [Medline]
  77. Schueller SM, Kwasny MJ, Dear BF, Titov N, Mohr DC. Cut points on the Patient Health Questionnaire (PHQ-9) that predict response to cognitive-behavioral treatments for depression. Gen Hosp Psychiatry. 2015;37(5):470-475. [FREE Full text] [CrossRef] [Medline]
  78. van Straten A, Hill JJ, Richards DA, Cuijpers P. Stepped care treatment delivery for depression: a systematic review and meta-analysis. Psychol Med. Jan 2015;45(2):231-246. [CrossRef] [Medline]
  79. Ardito RB, Rabellino D. Therapeutic alliance and outcome of psychotherapy: historical excursus, measurements, and prospects for research. Front Psychol. Oct 2011;2:270. [FREE Full text] [CrossRef] [Medline]
  80. Arnow BA, Steidtmann D, Blasey C, Manber R, Constantino MJ, Klein DN, et al. The relationship between the therapeutic alliance and treatment outcome in two distinct psychotherapies for chronic depression. J Consult Clin Psychol. Aug 2013;81(4):627-638. [FREE Full text] [CrossRef] [Medline]
  81. Baier AL, Kline AC, Feeny NC. Therapeutic alliance as a mediator of change: a systematic review and evaluation of research. Clin Psychol Rev. Dec 2020;82:101921. [FREE Full text] [CrossRef] [Medline]
  82. Karver MS, Handelsman JB, Fields S, Bickman L. Meta-analysis of therapeutic relationship variables in youth and family therapy: the evidence for different relationship variables in the child and adolescent treatment outcome literature. Clin Psychol Rev. Jan 2006;26(1):50-65. [FREE Full text] [CrossRef] [Medline]
  83. Martin DJ, Garske JP, Davis MK. Relation of the therapeutic alliance with outcome and other variables: A meta-analytic review. J Consult Clin Psychol. 2000;68(3):438-450. [FREE Full text] [CrossRef]
  84. Shirk SR, Karver M. Prediction of treatment outcome from relationship variables in child and adolescent therapy: a meta-analytic review. J Consult Clin Psychol. Jun 2003;71(3):452-464. [FREE Full text] [CrossRef] [Medline]
  85. Andersson E, Ljótsson B, Hedman E, Enander J, Kaldo V, Andersson G, et al. Predictors and moderators of internet-based cognitive behavior therapy for obsessive–compulsive disorder: results from a randomized trial. J Obsessive Compuls Relat Disord. Jan 2015;4:1-7. [FREE Full text] [CrossRef]
  86. Herbst N, Franzen G, Voderholzer U, Thiel N, Knaevelsrud C, Hertenstein E, et al. Working alliance in internet-based cognitive-behavioral therapy for obsessive-compulsive disorder. Psychother Psychosom. 2016;85(2):117-118. [FREE Full text] [CrossRef] [Medline]
  87. Mercadal Rotger J, Cabré V. Therapeutic alliance in online and face-to-face psychological treatment: comparative study. JMIR Ment Health. May 02, 2022;9(5):e36775. [FREE Full text] [CrossRef] [Medline]
  88. Nordgren LB, Hedman E, Etienne J, Bodin J, Kadowaki A, Eriksson S, et al. Effectiveness and cost-effectiveness of individually tailored internet-delivered cognitive behavior therapy for anxiety disorders in a primary care population: a randomized controlled trial. Behav Res Ther. Aug 2014;59:1-11. [FREE Full text] [CrossRef] [Medline]
  89. Wagner B, Brand J, Schulz W, Knaevelsrud C. Online working alliance predicts treatment outcome for posttraumatic stress symptoms in Arab war-traumatized patients. Depress Anxiety. Jul 2012;29(7):646-651. [FREE Full text] [CrossRef] [Medline]
  90. Andersson E, Enander J, Andrén P, Hedman E, Ljótsson B, Hursti T, et al. Internet-based cognitive behaviour therapy for obsessive–compulsive disorder: a randomized controlled trial. Psychol. Med. Feb 21, 2012;42(10):2193-2203. [FREE Full text] [CrossRef]
  91. Don FJ, Driessen E, Peen J, Spijker J, DeRubeis RJ, Blankers M, et al. The temporal associations of therapeutic alliance and manual adherence with depressive symptom change in cognitive behavioral therapy for adult outpatient major depression. Front Psychiatry. Jan 13, 2020;11:602294. [FREE Full text] [CrossRef] [Medline]
  92. Hadjistavropoulos HD, Pugh NE, Hesser H, Andersson G. Therapeutic alliance in internet-delivered cognitive behaviour therapy for depression or generalized anxiety. Clin Psychol Psychother. Mar 2017;24(2):451-461. [FREE Full text] [CrossRef] [Medline]
  93. Preschl B, Maercker A, Wagner B. The working alliance in a randomized controlled trial comparing online with face-to-face cognitive-behavioral therapy for depression. BMC Psychiatry. Dec 06, 2011;11:189. [FREE Full text] [CrossRef] [Medline]
  94. Wehmann E, Köhnen M, Härter M, Liebherz S. Therapeutic alliance in technology-based interventions for the treatment of depression: systematic review. J Med Internet Res. Jun 11, 2020;22(6):e17195. [FREE Full text] [CrossRef] [Medline]


CBT: cognitive behavioral therapy
CONSORT-EHEALTH: Consolidated Standards of Reporting Trials of Electronic and Mobile Health Applications and Online Telehealth
i-CBT: internet-based cognitive behavioral therapy
ITT: intention-to-treat
MDD: major depressive disorder
MINI: Mini International Neuropsychiatric Interview
OPTT: Online Psychotherapy Tool
PHQ-9: Patient Health Questionnaire–9
Q-LES-Q: Quality of Life Enjoyment and Satisfaction Questionnaire–Short Form
QIDS: Quick Inventory of Depressive Symptomatology
QUOPL: Queen’s Online Psychotherapy Lab


Edited by J Torous; submitted 21.08.23; peer-reviewed by D Adler, A AL-Asadi; comments to author 23.10.23; revised version received 28.11.23; accepted 13.12.23; published 09.02.24.

Copyright

©Jasleen Kaur Jagayat, Anchan Kumar, Yijia Shao, Amrita Pannu, Charmy Patel, Amirhossein Shirazi, Mohsen Omrani, Nazanin Alavi. Originally published in JMIR Mental Health (https://mental.jmir.org), 09.02.2024.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Mental Health, is properly cited. The complete bibliographic information, a link to the original publication on https://mental.jmir.org/, as well as this copyright and license information must be included.