This paper is in the following e-collection/theme issue:

Methods and New Tools in Mental Health Research (428) Web-based and Mobile Health Interventions (3128) e-Mental Health and Cyberpsychology (1411) Telehealth and Telemonitoring (1575) Transdiagnostic Mental Health Interventions (122) Innovations in Mental Health Systems (371)

Published on in Vol 11 (2024)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/50977, first published .
Patient Satisfaction With a Coach-Guided, Technology-Based Mental Health Treatment: Qualitative Interview Study and Theme Analysis

Patient Satisfaction With a Coach-Guided, Technology-Based Mental Health Treatment: Qualitative Interview Study and Theme Analysis

Patient Satisfaction With a Coach-Guided, Technology-Based Mental Health Treatment: Qualitative Interview Study and Theme Analysis

Authors of this article:

Ashley Helm Smith1, 2 Author Orcid Image ;   Hilary Touchett1, 2, 3 Author Orcid Image ;   Patricia Chen1, 3 Author Orcid Image ;   Terri Fletcher1, 2, 4 Author Orcid Image ;   Jennifer Arney5 Author Orcid Image ;   Julianna Hogan1, 2, 4 Author Orcid Image ;   Miryam Wassef1, 2, 4 Author Orcid Image ;   Marylene Cloitre6 Author Orcid Image ;   Jan A Lindsay1, 2, 4, 7 Author Orcid Image
Article Authors Cited by (1) Tweetations (4) Metrics

    Original Paper

    1Houston Veteran Affairs Health Services Research and Development Center for Innovations in Quality, Effectiveness and Safety, Michael E DeBakey Veteran Affairs Medical Center, Houston, TX, United States

    2South Central Mental Illness Research, Education and Clinical Center, Houston, TX, United States

    3Department of Medicine, Baylor College of Medicine, Houston, TX, United States

    4Menninger Department of Psychiatry and Behavioral Sciences, Baylor College of Medicine, Houston, TX, United States

    5Department of Sociology, College of Human Sciences and Humanities, University of Houston Clear Lake, Houston, TX, United States

    6National Center for Post-Traumatic Stress Disorder Dissemination and Training Division, Veteran Affairs Palo Alto Health Care System, Palo Alto, CA, United States

    7Rice University’s Baker Institute for Public Policy, Houston, TX, United States

    Corresponding Author:

    Ashley Helm Smith, MA

    Houston Veteran Affairs Health Services Research and Development Center for Innovations in Quality, Effectiveness and Safety

    Michael E DeBakey Veteran Affairs Medical Center

    2002 Holcombe Blvd. (152)

    Houston, TX, 77030

    United States

    Phone: 1 713 794 8601

    Email: ashley.smith30@va.gov


    Background: Technology-based mental health interventions address barriers rural veterans face in accessing care, including provider scarcity and distance from the hospital or clinic. webSTAIR is a 10-module, web-based treatment based on Skills Training in Affective and Interpersonal Regulation, designed to treat posttraumatic stress disorder and depression in individuals exposed to trauma. Previous work has demonstrated that webSTAIR is acceptable to participants and effective at reducing symptoms of posttraumatic stress disorder and depression when delivered synchronously or asynchronously (over 5 or 10 sessions).

    Objective: This study explored factors that lead to greater patient satisfaction with webSTAIR, a web-based, coach-guided intervention.

    Methods: We analyzed qualitative interview data to identify themes related to patient satisfaction with webSTAIR delivered with synchronous video-based coaching.

    Results: Four themes emerged from the data: (1) coaching provides accountability and support, (2) self-pacing offers value that meets individual needs, (3) participants like the comfort and convenience of the web-based format, and (4) technical issues were common but not insurmountable.

    Conclusions: We conclude that participants valued the accountability, flexibility, and convenience of tech-based interventions with video-delivered coaching.

    JMIR Ment Health 2024;11:e50977

    doi:10.2196/50977

    Keywords

    coaching; digital treatment; interview; mental health; patient satisfaction; PTSD; qualitative assessment; qualitative methods; sentiment analysis; technology-based; telehealth; trauma; veterans; video telehealth; web-based treatment 


    More than 1.7 million US veterans receive mental health care through the Veterans Health Administration (VHA) annually [1]. However, US veterans underuse mental health care and often experience barriers that impact access, such as provider scarcity [2], distance to clinic [3], inability to take off from work or school, and dependent care responsibilities [4-6]. Veterans living in rural areas make up about 24% of all veterans in the United States [7], and they have similar mental health care needs as urban veterans; however, rural veterans experience access barriers at higher rates [8,9]. Technology-based mental health interventions are a potential solution to address some of the barriers that rural veterans in the United States face.

    Technology-based mental health interventions can be accessed from a smart phone or tablet. They range from fully automated to therapist-guided in person or by video, telephone, or SMS text messages [10-13]. Technology-based mental health interventions have demonstrated effectiveness in clinical trials, with moderate-to-high effect sizes [14-17]. However, satisfaction with a treatment plays a significant role in treatment effectiveness. Patient satisfaction with treatment is linked to greater adherence [18,19] and greater perceived improvement in clinical status [20,21]. Even when adherence to treatment is controlled for, satisfied patients benefit more from care than less satisfied patients [22,23]. In mental health settings, a strong therapeutic alliance is linked to greater patient satisfaction [24]. Further understanding of factors that contribute to patient satisfaction is critical to designing future tech-based interventions that demonstrate better engagement and retention and greater clinical benefit [25,26].

    Studying satisfaction with mental health treatments is complex. There are a number of variables that can influence patient satisfaction with mental health treatment, such as patient, disease, provider, therapy, and environmental factors (eg, technology-mediated treatments) [22,27,28]. Although many teams evaluate overall satisfaction by collecting survey data and compiling ratings to quantify patients’ levels of satisfaction, qualitative data provides a nuanced and contextualized understanding of satisfaction [22]. In 2 recent studies, our team found that having therapist support and the convenience of being able to access treatment on the web contributed to patient satisfaction with technology-based mental health interventions [29,30]. This study uses qualitative interviews with patients who completed an internet-based mental health treatment to explore factors that lead to greater patient satisfaction in such a program. This study builds on previous findings by exploring the benefits of using a coach and the ways web-based formats provide comfort and convenience, as well as increased access in some cases.


    Study Design

    webSTAIR is an internet-based intervention adapted from Skills Training in Affective and Interpersonal Regulation (STAIR), a treatment for trauma-exposed individuals with symptoms of posttraumatic stress disorder (PTSD) and depression [31]. The program was developed to engage rural women veterans, who have been found to be underrepresented in mental health services [32]. However, male veterans were also enrolled if they were interested and met the study criteria. webSTAIR offers 10 web-based modules of self-directed skills training on emotion regulation (eg, emotional awareness, emotional management, and distress tolerance) and interpersonal skills (eg, assertiveness, flexibility, and compassion for oneself and others).

    In addition to the asynchronously delivered web-based content, participants were offered 5 or 10 synchronous video coaching sessions, which took place using video-telehealth, after the completion of 1 or 2 modules. Coaches were licensed Veterans Affairs (VA) mental health providers who underwent training in the intervention and attended weekly supervision with a certified STAIR trainer. Sessions with the coach lasted approximately 45-50 minutes and involved reviewing module content, discussing the applicability of concepts in the veteran’s life, and strategizing on how to integrate skills into daily practice. The webSTAIR program was delivered as routine care in mental health outpatient clinics at 9 sites serving rural patients within the VHA. The qualitative data presented were collected as part of a naturalistic evaluation of the program.

    Recruitment and Sample

    Participants in the webSTAIR program were US veterans recruited from 9 VHA facilities across the country that serve rural patients. Referrals were either clinician- or self-initiated. Participants completed the program between September 2018 and March 2020. Eligibility for the study was determined based on an initial telephone screening. Patients were considered eligible if they reported a history of trauma exposure and screened positive on the Primary Care PTSD Screen (PC-PTSD; positive on 3 of 5 items [33]) or the 2-item Patient Health Questionnaire (PHQ-2; positive on 1 of 2 items [34]), indicating clinically significant symptoms of PTSD or depression. The following resulted in ineligibility for enrollment: cognitive impairment or psychosis, mania, primary drug or alcohol abuse, current domestic violence, concurrent trauma-focused treatment, residential care for PTSD within 1 year, or an inability to attend telemental health appointments by video.

    Measures and Data Collection

    Demographic information for all patients in the program was collected at the initial intake phase of the study. The qualitative data for this study were collected during a 1-time interview conducted following the completion of the webSTAIR program. Patients who completed the program were sent a letter explaining the purpose of the interview and study details. This letter also included a contact number that patients could call to decline participation. All patients who did not actively call to decline were then contacted by study staff and asked if they would like to participate. Study staff made at least 3 attempts to contact participants. Outreach resulted in a response rate of 30%, with 74 participants agreeing to participate. The demographic information of interviewees was linked using a study ID number.

    The interview guide was piloted and refined during the pilot intervention phase of the study [30,35]. It contained both categorical and open-ended questions. One member of the study staff conducted the interview, while 1-2 staff members took detailed notes during the interview. While the study team did not record or transcribe interviews, note-takers were often able to capture responses nearly verbatim. Quotes in this paper are drawn from these notes.

    Participants were asked questions about their experience working through the program and about their satisfaction with the intervention. Interviews were conducted by telephone by study staff, including the first author (AHS) and second author (HT), as well as other members of the study team (MW). Interviews lasted approximately 60 minutes. At the conclusion of the interview, the interview notes were consolidated, and the finalized interview notes were entered into a database. Interview protocols were reviewed by the principal investigator’s affiliated institutions’ institutional review board, designated as “quality improvement.”

    Data Analysis

    Interview data were analyzed using strategies from qualitative content analysis and thematic analysis [36-39]. The interview notes for each participant were entered into a matrix in Microsoft Excel (Microsoft Corp) and organized by interview question. A list of the interview questions used in the analysis for this study can be found in Multimedia Appendix 1. Data coding and analysis were conducted by a master’s-level researcher with extensive qualitative experience who also functioned as a research assistant on the study (AHS) and a postdoctoral nurse trained in qualitative methods (HT). A codebook was developed based on interview guide questions and refined based on emergent findings. The second author (HT) reviewed the codes assigned by the first author, either agreeing or disagreeing. Coders met to resolve any disagreements until consensus was reached. The themes were analyzed and further defined to describe participants’ satisfaction with the intervention. The data are presented here by satisfaction with the web-based, coach-guided format of webSTAIR.

    Ethical Considerations

    Study procedures were reviewed and found to be exempt by the institutional review board for Baylor College of Medicine and Affiliated Hospitals. Data were collected under a quality improvement designation. Participant confidentiality was upheld with the use of a randomized participant ID number.


    Sample

    The exit interview was completed by 74 participants, the majority of whom were rural (46/74, 62%), White or Caucasian (48/74, 65%), female (42/74, 57%), aged between 35 and 44 years (25/74, 34%), and had some college or a 2-year college degree (32/74, 44%). A detailed list of participant characteristics can be found in Table 1.

    Table 1. Participant demographics.
    DemographicsCoach 5 (n=43), n (%)Coach 10 (n=31), n (%)Total (N=74), n (%)
    Sex

    		Male14 (33)17 (55)31 (42)

    		Female29 (67)13 (42)42 (57)

    		Transgender0 (0)1 (3)1 (1)
    Age (years)

    		25-348 (19)5 (16)13 (18)

    		35-4416 (37)9 (29)25 (34)

    		45-548 (19)7 (23)15 (20)

    		55-649 (21)7 (23)16 (22)

    		65-742 (4)3 (9)5 (6)
    Rurality

    		Urban16 (37)12 (39)28 (38)

    		Rural27 (63)19 (61)46 (62)
    Race

    		White or Caucasian24 (56)24 (78)48 (65)

    		Black or African American6 (14)2 (6)8 (11)

    		Hispanic or Latino4 (9)2 (6)6 (8)

    		American Indian1 (2)1 (4)2 (2)

    		Mixed race or ethnicity8 (19)2 (6)10 (14)
    Employment status

    		Full-time12 (28)13 (42)25 (34)

    		Part-time6 (13)4 (13)10 (13)

    		Not currently working for pay11 (26)5 (16)16 (22)

    		Retired14 (33)9 (29)23 (31)
    Educational level

    		Some high school1 (2)0 (0)1 (1)

    		Earned high school degree4 (9)4 (13)8 (11)

    		Some college or 2-year degree20 (47)12 (39)32 (44)

    		Earned 4-year degree14 (33)10 (32)24 (32)

    		Postgraduate3 (7)5 (16)8 (11)

    		Missing1 (2)0 (0)1 (1)

    Themes

    Participants responded to categorical questions that they were generally satisfied with the webSTAIR program; that is, the majority of interview participants felt that webSTAIR met their needs and that they would use a similar program again in the future. Four themes emerged from the open-ended responses and are detailed below: (1) coaching provides accountability and support, (2) self-pacing offers value that meets individual needs, (3) participants like the comfort and convenience of the web-based format, and (4) technical issues were common but not insurmountable. Table 2 presents quotations exemplifying each theme.

    Table 2. Domains and illustrative quotes.
    ThemesIllustrative quotes
    Theme 1: coaching provides accountability and support
    • Because she was so good at bringing back the tools you get out of webSTAIR. Website tells you to apply it, but it\'s nice to hear it differently and she brings it back to my situation. That was really helpful for me (35-44–year-old White female).
    • Seemed like sessions were the practice/reiteration part. She really provided the application, tying it together and making it stick. Would stress this a lot. It really helped and challenged me. (35-44–year-old White male)
    Theme 2: self-pacing offers value that meets individual needs
    • It allowed me to go at my own pace. I had time to consider my answers and think about what I wanted to say. (55-64–year-old White male)
    • When you\'re meeting in person, you often are bobble heading even if you\'re not getting what they\'re telling you. Reading for yourself and being able to go over it and process… gives you time to process. (55-64–year-old mixed-race female)
    • Some lessons needed more time to practice and to mentally digest. I\'m still going over them because I printed them out, but I feel like I needed more time... (45-54–year-old White female)
    Theme 3: participants like the comfort and convenience of the web-based format
    • I work, helped me not be stressed about getting appointments without taking off work. (25-34–year-old African American female)
    • With PTSD, I don’t sleep well. To not have to get up and drive. Closest facility is 45 min-1 hour away…To not have to drive is great. I live in the country on purpose. I wouldn’t go to therapy without webSTAIR. (35-44–year-old mixed-race female)
    • I liked that it was online and for whatever reason felt like a safer environment than sitting face to face with someone. (25-34–year-old White female)
    • It\'s easy to get complacent too, catch 22 at your home. Easy to get distracted, too comfortable at home so easily distracted. (25-34–year-old White male)
    Theme 4: technical issues are common but not insurmountable
    • If you\'re working on something and push the back button you delete everything you did. You have to start over. (35-44–year-old African American female)
    • I didn\'t like the fact the info I wrote down in the modules, therapist couldn\'t see, so when we were reviewing, I would have to go back in and start from the beginning. It would be helpful if she could see what I wrote. (35-44–year-old African American female)
    • Sometimes couldn\'t hear each other or it would freeze. Normal facetime issues. More issues with computer, iPad or iPhone crystal clear, perfect. (35-44–year-old American Indian or Alaskan Native female)

    Theme 1: Coaching Provides Accountability and Support

    The presence of regular check-ins with a coach kept participants accountable and motivated them to do the work and stay on track by providing guidance as to when they should complete the next module. Only 1 participant noted that the regular check-ins with their coach and expectations about content completion each week felt like too much pressure, but this was uncommonly reported. Most respondents indicated they appreciated check-ins.

    I knew that we were going to have our sessions. So it helped with accountability – like actually doing the work because we’re going to talk about it. And she keeps me on track because she tells me this is when you’re going to do the next module.
    [35-44-year-old Black or African-American female]

    Coaches provided emotional support and helped participants understand and apply the webSTAIR content to their own lives. Participants often noted a good rapport with their coach, and many would have liked to talk to them more simply because they enjoyed talking with them. As a mixed-race male in his early 30s commented, “She was awesome. She always remembered what was going on with me. She helped with materials.”

    The majority of participants were satisfied with the number of sessions with their coach, regardless of the number of coaching sessions they received. Those that did express a preference for more sessions cited a variety of reasons, most commonly the desire for more emotional support and clarification about the content. Participants perceived coaching sessions as a time to process their feelings and better understand how content applied to their individual situation. The coaching sessions were considered an essential component of webSTAIR and were highly valued.

    Theme 2: Self-Pacing Offers Value That Meets Individual Needs

    Participants generally liked the format of webSTAIR, which allowed them to take their time and interact with and respond to the web-based content. Having time between reviewing the material and meeting with their coach helped participants feel less pressure and less rushed than standard face-to-face psychotherapy using evidence-based psychotherapy protocols, as in “No pressure to feel like you get an answer right or wrong or in a hurry to get it done” (35-44–year-old White male). They were able to reflect on and practice the skills webSTAIR aimed to teach them. In many cases, this led to more thoughtful reactions to the content, which informed meetings with their coach and made them more productive. A White male in his mid-forties commented:

    It made you use your mind and think about stuff. You can go to counseling all day long and you don’t get as much accomplished in an hour... [I] think on your own time, allows you to think outside the box.
    [35-44–year-old White male]

    In contrast to those who liked the self-paced format, a small number of participants reported they would have liked the pace to be more personalized or more self-paced. For example, a few participants would have liked to speed through some of the content that they felt they did not need or take more time (eg, more time in between video coaching sessions) to go deeper into the content they thought they needed most without feeling rushed. However, the desire for the pace to be more personalized did not impact their satisfaction with the program.

    A minority of participants noted difficulty understanding or remembering the content between sessions.

    By the time I got to the second module, I would forget about the first one. I would forget notes I had for my coach and was often unable to write down my questions. I would forget before next time.
    [45-54-year-old White female]

    Some participants successfully prepared for coaching sessions by taking detailed notes about the content and their questions, or by reviewing the webSTAIR content immediately before meeting with their coach. This strategy was acceptable for some webSTAIR participants, but others found it tedious or “annoying” to have to refresh between sessions to avoid forgetting the content, though this was uncommonly reported.

    Theme 3: Comfort and Convenience of the Web-Based Format Made it Easier to Access Care

    Participants liked the convenience of the coach-guided, web-based format, which allowed flexible scheduling and reduced travel time. The ability to meet on the web allowed veterans to engage in care they may not have otherwise engaged in due to distance or other logistical factors, such as difficulty scheduling around work or childcare obligations. A Hispanic male in his late 30s explained how and why the web-based format was more convenient:

    Able to do it from home. I cannot take advantage of many mental health services at the VA; VA is 30-40 minutes from my home. I was glad I was able to take advantage of this.

    In addition to the logistical benefits, participants liked that they did not have to confront crowded waiting rooms at their facility. Instead, they could participate in the program from home, where they felt most comfortable and, in some cases, where they felt most safe. A minority of participants found it more difficult to find privacy in their own homes, away from the people they lived with, and others found themselves more prone to distractions at home. According to 1 participant, a White female in her mid-forties, “…the same thing that made it nice also made it not so nice.” However, privacy issues or distractions at home were not commonly reported.

    Theme 4: Technical Issues Are Common but not Insurmountable

    The majority of participants experienced some technical challenges with the video coaching sessions, and almost half experienced difficulty with the website. Participants spontaneously reported that about a third of all the technical challenges they experienced occurred only 1 or 2 times throughout the entire program. For issues that did not resolve on their own, participants were able to troubleshoot, either independently or with their coach, to complete their sessions and web-based content. In cases where coaches were able to help solve problems or troubleshoot, their guidance seemed to ameliorate the negative impact on patient satisfaction.

    [Had] difficulties quite a few times, but she always made it work.
    [35–44-year-old Hispanic female]

    Technical issues included being unable to hear the other person, issues with the link to the video session, and difficulty with the video freezing or closing unexpectedly. Sometimes the issue resolved quickly on its own and occurred infrequently. Other times, the issue could be attributed to a recent update or a setting that needed to be changed on their device. Strategies that were frequently used by coaches to help troubleshoot included pivoting to the phone for audio, sending different pieces of equipment to use, and offering emotional support that someone would help them resolve the issue. A White female in her mid-forties said:

    One time we [experienced video issues]; [we] just turned off the audio, [and] video was still there and [we] used phone for audio. Work around; it worked just fine.

    Only 1 participant spontaneously reported having had to reschedule a session with their coach due to connection issues. More often, participants shared that they were still able to meet on the web with their coach despite issues with the video connection, in part because of their coach’s persistence.

    It didn't connect twice but she worked hard to get it connected, so we still had our sessions.
    [35–44-year-old African American female]

    Participants reported a wide range of issues with the website, including trouble accessing the tools or videos, glitches such as issues with the “back” or “next” button, difficulty with the website kicking them out or freezing up, and issues with the equipment that made accessing all the content from the modules difficult. Several participants spontaneously reported that they resolved the issue with the website through independent troubleshooting, usually by closing and reopening the browser: “Sometimes the role play [exercise] wasn't working right. Closed out the browser and then it would work fine” (35-44–year-old Hispanic female). In at least 1 case, an issue with the website was resolved when the coach sent the participant a VA iPad (Apple Inc). Issues that were most easily resolved included the website or web content freezing up and issues with the “back” button not working.

    More persistent issues with the website included typed responses not saving, being unable to access program materials, such as worksheets or role plays, and difficulty printing. There was only 1 case in which a participant spontaneously shared that they had to reschedule a session due to technical issues with the website and an inability to access program materials. More often, participants found workarounds, like taking screenshots instead of printing and writing down their responses.

    Typing info into forms/worksheets. Happened 2 times, then I quit. I started writing it down.
    [45–54–year-old White female]

    Principal Results

    This study contributes to the literature on satisfaction with web-based mental health treatments by qualitatively exploring mechanisms that lead to better or worse patient experiences with technology-based mental health tools, in addition to satisfaction with the patient-provider relationship. Results from this study may help clinicians and researchers tailor interventions in a way that increases satisfaction with web-based mental health treatments. Our chief findings were as follows: (1) the presence of a coach or therapist to help guide a web-based intervention was vital for accountability and support; (2) a flexible, self-paced format enabled participants to fit the treatment into their schedule more easily and give them time to reflect on the content in between sessions; (3) participants liked the comfort and convenience of the web-based format, as it decreased travel time and opened up access to mental health services that may otherwise have been too difficult to obtain; and, (4) despite most participants experiencing technical difficulties, a common issue with web-based treatments, participants in our sample were able to troubleshoot those issues and complete the program and it did not appear to impact their overall satisfaction. Although participants generally reported positive responses to the intervention, some reported a desire to have more control over the pacing of modules based on their individual mastery of the module’s content.

    Comparison With Previous Work

    Consistent with the literature, the coach-guided support contributed to the high level of satisfaction observed in this study. Participants noted the importance of the coach for their support and accountability. Coaches helped keep participants on track, knowing that they are going to discuss the module in their next session. Coaching helped participants apply the content to their own lives and made it relatable, enhancing the program’s value for patients. Consistent with previous work by this team, participants in this study often noted a high level of satisfaction with their coach, and many commented on the likeability or effectiveness of their coach [40]. Previous work suggests that engagement and efficacy in technology-based mental health interventions are often low without therapist support [41], which may be why the value of coaching was such a prevalent theme in our exploration of satisfaction in this study. Like participants in other coach-guided, internet-based studies, webSTAIR participants experienced excellent relationships with their coaches, and they were able to achieve this over video [30,42-44].

    Previous studies of technology-based mental health interventions suggest that the most frequently reported reason for dissatisfaction is related to intervention pacing that moves too quickly [45]. Participants in this study often noted the benefit of the self-paced format of webSTAIR, as it allows more time and space to reflect on, practice, and absorb the content compared to standard, synchronous, evidence-based psychotherapy sessions in which participants may feel pressure to respond and process material in the moment. Additional time to review the material between professionally guided sessions contributed to the considerable satisfaction that we have observed in this study.

    Participants in this study generally appreciated the comfort and convenience of the web-based format. Approximately 62% (46/74) of our participants were rural, so decreasing drive time to their provider, in some cases, may have enabled participants to receive care they would not have otherwise been able to access. About 57% (42/74) of our participants were women, and all had a history of trauma. This may have contributed to why participants felt more comfortable receiving their care in their own homes and why they appreciated avoiding crowded VHA waiting rooms. These findings echo previous studies that found similar benefits of telehealth for patients with obsessive-compulsive disorder and veterans receiving mental health care over video telehealth [29,46].

    When using video telehealth, about a third of participants noted they only encountered 1-2 technical issues, which they were able to resolve with minimal interruption. Others with more significant interruptions were able to troubleshoot on their own or with their coach to eventually get connected or access the web-based material. Since this study describes the experiences of participants who completed webSTAIR, we can presume that they were able to navigate technical issues and complete the program. Given these findings, we can infer that if a technical issue is eventually resolved, the presence of the technical issue may not impact overall satisfaction. For this reason, resilience, supportive troubleshooting, and having a backup plan (eg, using the phone for sound when audio does not work) may contribute to greater satisfaction and the successful completion of internet-based interventions.

    Limitations

    The primary limitation of our study is selection bias. Our interview sample consisted of participants who completed the webSTAIR program and were prescreened to have adequate access to video telehealth. These factors may result in more positive experiences with the program, as reflected in the data. The 37% (74/202) response rate may have further exacerbated selection bias and resulted in more positive feedback. These patients were more likely to have the time and motivation to participate in an interview. The experiences of those who may not have felt the program’s impact or did not feel inclined to participate in an interview were not captured. Additionally, the study was not randomized, and we do not have a control group to compare satisfaction among those who dropped out of the study. However, as a qualitative study, our aim was to provide a detailed description of participant experiences and explore how common themes across experiences may be relevant to clinicians and researchers interested in web-based mental health treatments.

    Conclusions

    Our findings suggest that a combination of self-paced, web-based content and a coach-guided intervention may integrate the best of both worlds, that is, the convenience and flexibility of a web-based modality and the structure, guidance, and accountability of a traditional psychotherapy approach. Our results indicate that providers and researchers should design tech-based interventions that are sensitive to individual differences and that integrate coaching support, as participants highly value coaching support for their digital interventions. Future research should focus on the impact of satisfaction on engagement, retention, and the therapeutic benefits of web-based mental health interventions.

    Acknowledgments

    The authors would like to acknowledge the South Central Mental Illness Research, Education, and Clinical Center (MIRECC) and the Center for Innovations in Quality, Effectiveness, and Safety (IQuESt, CIN13-413), which provided facility and resource support, as well as the Veterans Affairs (VA) Palo Alto National Center for PTSD, which assisted in the design, collection of data, and preparation and editing of the manuscript. The opinions expressed are those of the authors and do not necessarily reflect those of the Department of Veterans Affairs, the US government, or Baylor College of Medicine.

    Conflicts of Interest

    None declared.

    Multimedia Appendix 1

    Interview questions.

    DOCX File , 14 KB
    1. Office of research and development. U.S. Department of Veterans Affairs. URL: https://www.research.va.gov/topics/mental_health.cfm [accessed 2023-01-18]
    2. Health Resources and Services Administration. Designated health professional shortage area statistics: first quarter of fiscal year 2023. Bureau of Health Workforce Health Resources and Services Administration (HRSA) US Department of Health and Human Services. URL: https://data.hrsa.gov/Default/GenerateHPSAQuarterlyReport [accessed 2023-12-23]
    3. Elnitsky CA, Andresen EM, Clark ME, McGarity S, Hall CG, Kerns RD. Access to the US Department of Veterans Affairs Health System: self-reported barriers to care among returnees of operations enduring freedom and iraqi freedom. BMC Health Serv Res. 2013;13:498. [FREE Full text] [CrossRef] [Medline]
    4. Marshall V, Stryczek KC, Haverhals L, Young J, Au DH, Ho PM, et al. The focus they deserve: improving women veterans' health care access. Womens Health Issues. 2021;31(4):399-407. [FREE Full text] [CrossRef] [Medline]
    5. Godier-McBard LR, Wood A, Kohomange M, Cable G, Fossey M. Barriers and facilitators to mental healthcare for women veterans: a scoping review. J Ment Health. 2023;32(5):951-961. [CrossRef] [Medline]
    6. Possemato K, Wray LO, Johnson E, Webster B, Beehler GP. Facilitators and barriers to seeking mental health care among primary care veterans with posttraumatic stress disorder. J Trauma Stress. 2018;31(5):742-752. [CrossRef] [Medline]
    7. Teich J, Ali MM, Lynch S, Mutter R. Utilization of mental health services by veterans living in rural areas. J Rural Health. 2017;33(3):297-304. [CrossRef] [Medline]
    8. Douthit N, Kiv S, Dwolatzky T, Biswas S. Exposing some important barriers to health care access in the rural USA. Public Health. 2015;129(6):611-620. [CrossRef] [Medline]
    9. Weeks WB, Kazis LE, Shen Y, Cong Z, Ren XS, Miller D, et al. Differences in health-related quality of life in rural and urban veterans. Am J Public Health. 2004;94(10):1762-1767. [FREE Full text] [CrossRef] [Medline]
    10. Büscher R, Sander LB, Nuding M, Baumeister H, Teismann T. Blending video therapy and digital self-help for individuals with suicidal ideation: intervention design and a qualitative study within the development process. JMIR Form Res. 2023;7:e49043. [FREE Full text] [CrossRef] [Medline]
    11. Wong HW, Lo B, Shi J, Hollenberg E, Abi-Jaoude A, Johnson A, et al. Postsecondary student engagement with a mental health app and online platform (thought spot): qualitative study of user experience. JMIR Ment Health. 2021;8(4):e23447. [FREE Full text] [CrossRef] [Medline]
    12. Shalaby R, Vuong W, Eboreime E, Surood S, Greenshaw AJ, Agyapong VIO. Patients' expectations and experiences with a mental health-focused supportive text messaging program: mixed methods evaluation. JMIR Form Res. 2022;6(1):e33438. [FREE Full text] [CrossRef] [Medline]
    13. Venville A, O'Connor S, Roeschlein H, Ennals P, McLoughlan G, Thomas N. Mental health service user and worker experiences of psychosocial support via telehealth through the COVID-19 pandemic: qualitative study. JMIR Ment Health. 2021;8(8):e29671. [FREE Full text] [CrossRef] [Medline]
    14. Lange A, Rietdijk D, Hudcovicova M, van de Ven JP, Schrieken B, Emmelkamp PMG. Interapy: a controlled randomized trial of the standardized treatment of posttraumatic stress through the internet. J Consult Clin Psychol. 2003;71(5):901-909. [CrossRef] [Medline]
    15. Lattie EG, Adkins EC, Winquist N, Stiles-Shields C, Wafford QE, Graham AK. Digital mental health interventions for depression, anxiety, and enhancement of psychological well-being among college students: systematic review. J Med Internet Res. 2019;21(7):e12869. [FREE Full text] [CrossRef] [Medline]
    16. Griffiths KM, Christensen H. Review of randomised controlled trials of internet interventions for mental disorders and related conditions. Clinical Psychologist. 2007;10(1):16-29. [CrossRef]
    17. Andrews G, Basu A, Cuijpers P, Craske MG, McEvoy P, English CL, et al. Computer therapy for the anxiety and depression disorders is effective, acceptable and practical health care: an updated meta-analysis. J Anxiety Disord. 2018;55:70-78. [FREE Full text] [CrossRef] [Medline]
    18. Chiolero A, Burnier M, Santschi V. Improving treatment satisfaction to increase adherence. J Hum Hypertens. 2016;30(5):295-296. [CrossRef] [Medline]
    19. Wade SL, Cassedy AE, Sklut M, Taylor HG, McNally KA, Kirkwood MW, et al. The relationship of adolescent and parent preferences for treatment modality with satisfaction, attrition, adherence, and efficacy: the Coping with Head Injury Through Problem-Solving (CHIPS) Study. J Pediatr Psychol. 2019;44(3):388-401. [FREE Full text] [CrossRef] [Medline]
    20. Ong JJ. Parental satisfaction and perception of progress in influencing the practice of complementary health approaches in children with autism: a cross sectional survey from Negeri Sembilan, Malaysia. BMC Complement Altern Med. 2019;19(1):250. [FREE Full text] [CrossRef] [Medline]
    21. Peyrot M, Rubin RR. How does treatment satisfaction work?: modeling determinants of treatment satisfaction and preference. Diabetes Care. 2009;32(8):1411-1417. [FREE Full text] [CrossRef] [Medline]
    22. Priebe S, Miglietta E. Assessment and determinants of patient satisfaction with mental health care. World Psychiatry. 2019;18(1):30-31. [FREE Full text] [CrossRef] [Medline]
    23. Swift JK, Callahan JL. The impact of client treatment preferences on outcome: a meta-analysis. J Clin Psychol. 2009;65(4):368-381. [CrossRef] [Medline]
    24. Kim SC, Kim S, Boren D. The quality of therapeutic alliance between patient and provider predicts general satisfaction. Mil Med. 2008;173(1):85-90. [FREE Full text] [CrossRef] [Medline]
    25. Vuori H. Patient satisfaction—an attribute or indicator of the quality of care? QRB Qual Rev Bull. 1987;13(3):106-108. [CrossRef] [Medline]
    26. Johansson P, Oléni M, Fridlund B. Patient satisfaction with nursing care in the context of health care: a literature study. Scand J Caring Sci. 2002;16(4):337-344. [CrossRef] [Medline]
    27. Pauselli L, Galletti C, Verdolini N, Paolini E, Gallucci D, Balducci PM, et al. Predictors of client satisfaction with outpatient mental health clinic services in Italy and New York. Community Ment Health J. 2018;54(5):562-570. [CrossRef] [Medline]
    28. Mazziotti R, Rutigliano G. Tele-mental health for reaching out to patients in a time of pandemic: provider survey and meta-analysis of patient satisfaction. JMIR Ment Health. 2021;8(7):e26187. [FREE Full text] [CrossRef] [Medline]
    29. Fletcher TL, Boykin DM, Helm A, Dawson DB, Ecker AH, Freshour J, et al. A pilot open trial of video telehealth-delivered exposure and response prevention for obsessive-compulsive disorder in rural Veterans. Military Psychology. 2021;34(1):83-90. [CrossRef]
    30. Fletcher TL, Amspoker AB, Wassef M, Hogan JB, Helm A, Jackson C, et al. Increasing access to care for trauma-exposed rural veterans: a mixed methods outcome evaluation of a web-based skills training program with telehealth-delivered coaching. J Rural Health. 2022;38(4):740-747. [CrossRef] [Medline]
    31. Cloitre M, Cohen LR, Ortigo KM, Jackson C, Koenen KC. Treating Survivors of Childhood Abuse and Interpersonal Trauma: STAIR Narrative Therapy. New York, NY, US. Guilford Publications; 2020.
    32. Brooks E, Dailey N, Bair B, Shore J. Rural women veterans demographic report: defining VA users' health and health care access in rural areas. J Rural Health. 2014;30(2):146-152. [CrossRef] [Medline]
    33. Prins A, Ouimette P, Kimerling R, Camerond RP, Hugelshofer DS, Shaw-Hegwer J, et al. The primary care PTSD screen (PC-PTSD): development and operating characteristics. Prim Care Psych. 2004;9(1):9-14. [CrossRef]
    34. Kroenke K, Spitzer RL, Williams JBW. The patient health questionnaire-2: validity of a two-item depression screener. Med Care. 2003;41(11):1284-1292. [CrossRef] [Medline]
    35. Bauer A, Amspoker AB, Fletcher TL, Jackson C, Jacobs A, Hogan J, et al. A resource building virtual care programme: improving symptoms and social functioning among female and male rural veterans. Eur J Psychotraumatol. 2021;12(1):1860357. [FREE Full text] [CrossRef] [Medline]
    36. Elo S, Kyngäs H. The qualitative content analysis process. J Adv Nurs. 2008;62(1):107-115. [CrossRef] [Medline]
    37. Lindgren BM, Lundman B, Graneheim UH. Abstraction and interpretation during the qualitative content analysis process. Int J Nurs Stud. 2020;108:103632. [CrossRef] [Medline]
    38. Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3(2):77-101. [CrossRef]
    39. Vaismoradi M, Turunen H, Bondas T. Content analysis and thematic analysis: implications for conducting a qualitative descriptive study. Nurs Health Sci. 2013;15(3):398-405. [FREE Full text] [CrossRef] [Medline]
    40. Roddy MK, Chen PV, Fletcher TL, Wassef M, Lindsay JA, Cloitre M, et al. Coaching with internet-based mental health program: patient and coach experiences. Telemed J E Health. 2023;29(12):1853-1861. [CrossRef] [Medline]
    41. Mohr DC, Cuijpers P, Lehman K. Supportive accountability: a model for providing human support to enhance adherence to eHealth interventions. J Med Internet Res. 2011;13(1):e30. [FREE Full text] [CrossRef] [Medline]
    42. Chen PV, Helm A, Caloudas SG, Ecker A, Day G, Hogan J, et al. Evidence of phone vs video-conferencing for mental health treatments: a review of the literature. Curr Psychiatry Rep. 2022;24(10):529-539. [FREE Full text] [CrossRef] [Medline]
    43. Donaghy E, Atherton H, Hammersley V, McNeilly H, Bikker A, Robbins L, et al. Acceptability, benefits, and challenges of video consulting: a qualitative study in primary care. Br J Gen Pract. 2019;69(686):e586-e594. [FREE Full text] [CrossRef] [Medline]
    44. Agha Z, Schapira RM, Laud PW, McNutt G, Roter DL. Patient satisfaction with physician-patient communication during telemedicine. Telemed J E Health. 2009;15(9):830-839. [CrossRef] [Medline]
    45. Olthuis JV, Watt MC, Bailey K, Hayden JA, Stewart SH. Therapist-supported internet cognitive behavioural therapy for anxiety disorders in adults. Cochrane Database Syst Rev. 2015(3):CD011565. [FREE Full text] [CrossRef] [Medline]
    46. Lindsay JA, Day SC, Amspoker AB, Fletcher TL, Hogan J, Day G, et al. Personalized implementation of video telehealth. Psychiatr Clin North Am. 2019;42(4):563-574. [CrossRef] [Medline]

    ‎
    PC-PTSD: Primary Care PTSD Screen
    PHQ-2: 2-item Patient Health Questionnaire
    PTSD: posttraumatic stress disorder
    STAIR: Skills Training in Affective and Interpersonal Regulation
    VA: Veterans Affairs
    VHA: Veterans Health Administration

    Edited by J Torous; submitted 18.07.23; peer-reviewed by S Rennick-Egglestone, K Possemato; comments to author 06.09.23; revised version received 20.10.23; accepted 21.10.23; published 02.02.24.

    Copyright

    ©Ashley Helm Smith, Hilary Touchett, Patricia Chen, Terri Fletcher, Jennifer Arney, Julianna Hogan, Miryam Wassef, Marylene Cloitre, Jan A Lindsay. Originally published in JMIR Mental Health (https://mental.jmir.org), 02.02.2024.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Mental Health, is properly cited. The complete bibliographic information, a link to the original publication on https://mental.jmir.org/, as well as this copyright and license information must be included.