Abstract
Background: Mental health issues like occupational stress and burnout, compounded with the after-effects of COVID-19, have affected health care professionals (HCPs) around the world. Digital mental health interventions (DMHIs) can be accessible and effective in supporting well-being among HCPs. However, low engagement rates of DMHIs are frequently reported, limiting the potential effectiveness. More evidence is needed to reveal the factors that impact HCPs’ decision to adopt and engage with DMHIs.
Objective: This study aims to explore HCPs’ motivation to engage with DMHIs and identify key factors affecting their engagement. Amongst these, we include cultural factors impacting DMHI perception and engagement among HCPs.
Methods: We used a mixed method approach, with a cross-sectional survey (n=438) and semistructured interviews (n=25) with HCPs from the United Kingdom and China. Participants were recruited from one major public hospital in each country.
Results: Our results demonstrated a generally low engagement rate with DMHIs among HCPs from the 2 countries. Several key factors that affect DMHI engagement were identified, including belonging to underrepresented cultural and ethnic groups, limited mental health knowledge, low perceived need, lack of time, needs for relevance and personal-based support, and cultural elements like self-stigma. The results support recommendations for DMHIs for HCPs.
Conclusions: Although DMHIs can be an ideal alternative mental health support for HCPs, engagement rates among HCPs in China and the United Kingdom are still low due to multiple factors and barriers. More research is needed to develop and evaluate tailored DMHIs with unique designs and content that HCPs can engage from various cultural backgrounds.
doi:10.2196/67190
Keywords
Introduction
Health care professionals (HCPs) are one of the most vulnerable groups to occupational stress and burnout []. Burnout among medical staff has gradually increased over time and worsened during COVID-19 [,]. More studies have focused on digital mental health interventions (DMHIs) to alleviate HCPs’ stress and burnout, as they offer accessible and cost-effective solutions that circumvent many barriers commonly associated with traditional interventions [-]. Research in countries like the United States, Australia, and Europe has provided evidence that DMHIs based on mobile apps, websites, and virtual reality are accepted and can be efficacious among nurses, physicians, and medical trainees [,-]. The majority of the literature has focused on apps and websites, with evidence on digital cognitive behavioral therapy, mindfulness interventions, mind-body and resilience skill training, and psychoeducational sessions delivered by mobile apps and websites [,]. Besides, virtual reality–based interventions have also begun to garner research focus, with recent preliminary studies demonstrating the effectiveness and high engagement among HCPs [,].
Despite the growing evidence of the effectiveness of DMHIs, lack of engagement was frequently reported in trials and studies [,]. Many recent reviews have shown that low engagement is a ubiquitous problem among DMHIs [-]. Plus, user engagement is considerably lower in naturalistic settings than in empirical studies [-]. To illustrate this, a review of 59 off-the-shelf mental health apps reported a median uptake rate of 4.0% and a 15-day retention rate of only 3.9% []. How to facilitate user engagement has become a priority in DMHI research [], as a “sufficient dosage” is essential for DMHIs to achieve the intended outcomes [,,].
Previous research has investigated the factors that impact user perception and engagement with DMHIs. Elements like help-seeking beliefs, therapist involvement, mental health, and digital literacy have been identified to affect the use of DMHIs [,]. Cultural-bounded factors like norms, beliefs, and stigma can also play a significant role in user engagement [,,]. However, most studies on DMHI engagement were directed at patients and the general public [,,]. Little research has focused on HCPs, who represent a unique population with distinct working contexts and are experiencing increasing levels of distress and burnout [,,]. The level of engagement with DMHIs among HCPs and the factors that impact their engagement remain unclear.
This study aimed to address this research gap with a twofold objective: (1) to investigate HCPs’ engagement with and perceptions of DMHIs, (2) to identify key factors influencing HCPs’ engagement with DMHIs. In this study, we revealed several common factors among HCPs while exploring distinct cultural aspects that could affect DMHI engagement by investigating HCPs from 2 diverse countries: China and the United Kingdom. We also provide design and research implications for future studies on DMHIs for HCPs that could effectively engage end users and generate positive outcomes.
Methods
We used a mixed method approach and collected qualitative (from semistructured interviews and open-ended questions in the survey) and quantitative data (from the survey).
Recruitment
The study was carried out across 2 hospitals in China and the United Kingdom. The first hospital, West China Hospital, is in Chengdu, southwest China. The other is Chelsea and Westminster Hospital in London, UK. Both hospitals are publicly funded, and are among the largest ones in the local regions, providing comprehensive medical care to a high volume of patients, making them representative of large urban health care institutions in their respective countries. Although health care systems in China and the United Kingdom operate differently, some systematic challenges across the 2 hospitals are similar, such as staff shortages, increasing workload, and high burnout levels [-].
A volunteer sampling method was used for the survey. The link to the survey was spread to HCPs via email and group chats in WhatsApp and WeChat. To be eligible for the study, participants had to be over 18 years old and employed as staff members (both clinical and administrative) in one of the hospitals where the study was taking place.
Interview participants were recruited via the questionnaire. An option to enter their email address to be contacted for the interview; a separate interview information sheet and consent form were then emailed to participants.
Study Design
Survey Design
The survey was designed to obtain demographic data and staff’s experience with and perception of DMHIs. The questions are tailored by the research team to the study objectives and focus on the following categories:
- Demographic information, including gender, age, job role, and time being an HCP.
- Mental health knowledge and help-seeking experience: single-item questions with text entries to swiftly assess if participants have knowledge of burnout and its interventions and if they have sought mental health support before.
- Previous engagement with DMHIs: single-item questions to gauge participants’ experience with DMHIs, with text entry on DMHIs they have used before.
- Willingness to engage with DMHIs: single-item question asking participants’ willingness to adopt DMHIs, with text entry asking their reason if unwilling to.
Before disseminating, the questions were reviewed by hospital administrators, mental health professionals, and digital health and HCI researchers to ensure the clarity, relevance, and appropriateness. A small group of 14 (6 in China and 8 in the United Kingdom) HCPs completed the survey as part of the pilot testing, and their feedback was used to refine the wording and structure of items to enhance comprehension and response accuracy.
Interview Design
The interview was planned to acquire deeper insights into the staff’s attitude and reason behind their amotivation to use DMHIs. Following a semistructured design, the interview questions covered the following topics:
- Knowledge and perceptions of DMHIs.
- Previous engagement with DMHIs and thoughts on the experience.
- Motivation of uptaking DMHIs in the future and reasons behind it.
- Suggestions and thoughts about their ideal DMHIs.
- General thoughts on the topics covered (such as DMHIs, mental health, and technology).
Data Collection and Analysis
The web-based survey was collected and managed via Qualtrics and WJX (both are web-based survey platforms). Participants were explicitly informed about the survey content, data security measures, and their right to withdraw any time before entering the question page. All data were recorded anonymously. The data were securely extracted and analyzed using IBM SPSS Statistics for Mac software (version 26; IBM Corporation). Binary logistic regression was used to explore the contributing factors to HCPs’ past engagement with DMHIs, while t tests and χ² tests were used to investigate variances of groups. The level of significance was set at P<.05.
Interviews were carried out by the first author, who was trained in design and user study, via both face-to-face and web-based platforms (Zoom and Teams). Each interview lasted around 30 minutes. Participants were briefed about the study’s aim at the beginning of the interview. They were also informed of the data security measures of the study, and their right to withdraw from the study without any reason given. No relationship was established before the study commencement. No repeat interview was carried out. The authors identified and discussed data saturation, after which no further interview was scheduled.
Qualitative data were extracted from the audio transcription of the interviews and answers from open-text entries in the survey. Two bilingual researchers worked on extracting textual data. An inductive thematic analysis approach was used to collect the qualitative data from the interviews []. Two rounds of inductive thematic analysis were conducted by 2 bilingual researchers using NVivo for Mac (version 12; QSR International Pty Ltd). The qualitative data from each hospital were coded separately to preserve context-specific insights. Then, the research team compared and synthesized the codes to identify unique findings and shared themes across both hospitals.
Ethical Considerations
The research has 2 parts in China and the United Kingdom. Studies in the 2 sites were approved by the Research Integrity and Ethics Committee of Imperial College London (22IC7803 and 22IC7585). The Ethics Committee on Biomedical Research of West China Hospital granted local ethics clearance for the research in China. Ethics approval was granted for the study in Chelsea and Westminster Hospital by the Health Research Authority of the National Health Service in the United Kingdom (reference number: 316935). Informed consent was obtained from participants before starting the survey and interviews. Participants were fully informed about the study's objectives, procedures, and potential risks. All data collected in the study was anonymized, and no personally identifiable information was linked to participant responses. No compensation was provided for completing the survey. However, participants completed the interview received a £5 voucher of appreciation for their time.
Results
Survey Findings
Demographics and Participant Characteristics
We gathered survey responses from 438 participants, 220 participants in China and 218 participants in the United Kingdom (
Table 1). Given the diversity of the National Health Service workforce in the United Kingdom, we also inquired about ethnicity among the respondents. The ethnicity question was excluded as more than 98% of the workforce in the Chinese hospital is Han Chinese [].
| China (n=220) | United Kingdom (n=218) | Statistical comparison | P value | ||
| χ² (df) | t test (df) | ||||
| Sex, n (%) | 10.90 (3) | —a | .01 | ||
| 186 (85) | 159 (73) | ||||
| 34 (15) | 55 (25) | ||||
| 0 (0) | 4 (2) | ||||
| Age (years), mean (SD) | 35.78 (8.26) | 35.16 (11.25) | — | 0.64 (410) | .53 |
| Experience (years), mean (SD) | 12.95 (8.88) | 11.21 (10.27) | — | 1.89 (437) | .06 |
| Ethnicity, n (%) | |||||
| — | 107 (49) | — | — | — | |
| — | 64 (29) | — | — | — | |
| — | 25 (12) | — | — | — | |
| — | 22 (10) | — | — | — | |
| Job sector, n (%) | 18.78 (2) | — | <.001 | ||
| 107 (38) | 64 (30) | ||||
| 84 (49) | 103 (47) | ||||
| 29 (13) | 51 (23) | ||||
| Use of mobile phones at work, n (%) | 27.05 (4) | — | <.001 | ||
| 39 (18) | 21 (10) | ||||
| 38 (17) | 31 (14) | ||||
| 40 (18) | 49 (23) | ||||
| 53 (24) | 53 (24) | ||||
| 50 (23) | 64 (29) | ||||
| Use of computers at work, n (%) | 274.15 (4) | — | <.001 | ||
| 15 (7) | 8 (4) | ||||
| 17 (8) | 3 (1) | ||||
| 14 (6) | 15 (7) | ||||
| 49 (22) | 22 (10) | ||||
| 125 (57) | 170 (78) | ||||
| Know about burnout, n (%) | 104 (47) | 169 (78) | 42.67 (1) | — | <.001 |
| Know about burnout interventions, n (%) | 66 (30) | 142 (65) | 55.65 (1) | — | <.001 |
| Have sought mental health support before, n (%) | 58 (26) | 92 (42) | 12.20 (1) | — | <.001 |
| Have used DMHIsb before, n (%) | 14 (6) | 62 (28) | 37.21 (1) | — | <.001 |
| Consider using DMHIs in the future, n (%) | 184 (84) | 155 (71) | 9.83 (1) | — | .002 |
aNot applicable.
bDMHI: digital mental health intervention.
According to the χ² test results, significantly more HCPs in the United Kingdom had knowledge of burnout (χ²1=42.67, P<.001), its interventions (χ²1=55.65, P<.001), and had sought help on mental health before (χ²1=12.20, P<.001). Meanwhile, only 6% (14 out of 220) of Chinese participants reported having used DMHIs before, compared with 28% (62 out of 218) in the United Kingdom. This demonstrates a significantly higher past engagement with DMHIs among the UK cohort (χ²1=37.21, P<.001).
Factors That Predict HCPs’ Engagement With DMHIs
The results of the binary logistic regression are shown in . In the UK sample, the regression model was statistically significant (χ²11=31.52, P<.001), indicating a good fit with the data (Nagelkerke R²=0.22, Hosmer and Lemeshow χ²8=4.61, P=.80). The results indicate that ethnicity was a significant predictor of DMHI engagement. Compared with HCPs identifying as white, those identifying as Asian (B=-1.69, P=.04, Exp(B)=0.18) and Black (B=-1.15, P=.01, Exp(B)=0.32) were significantly less likely to engage with DMHIs. Additionally, the odds of engaging with DMHIs were over twice as high for HCPs who had sought mental health support before (B=0.73, P=.045, Exp(B)=2.07) compared with those who had not. Furthermore, knowing about burnout interventions was a significant predictor of DMHI uptake (B=1.21, P=.02, Exp(B)=3.35). In the Chinese sample, the regression model was statistically significant (χ²8=15.57, P=.003), with Nagelkerke R²=0.18, Hosmer and Lemeshow χ²8=3.19 (P=.92). Having sought mental health support before significantly predicted HCPs’ prior DMHI use, with an odds ratio of 3.41 (B=0.89, P=.04).
To further explore the impact of mental health knowledge on DMHI engagement, we conducted χ² tests. In the Chinese sample, knowing about burnout interventions (χ²1 [n=220]=5.47, P=.02) and having sought mental health support (χ²1 [N=220]=7.30, P<.001) were significantly correlated with increased DMHI engagement. Although knowing about burnout is marginally significant (χ²1 [n=220]=3.50, P=.06). In the UK sample, knowing about burnout (χ²1 [n=218]=8.15, P=.004), knowing about burnout interventions (χ²1 [N=218]=13.39, P<.001), and having sought mental health support (χ²1 [N=218]=10.85, P<.001) were all significantly associated with higher DMHI engagement.
Attitudes Towards DMHIs
Only 6% (14 out of 220) of HCPs in China had engaged with DMHIs before, compared with 28% (62 out of 218) in the United Kingdom. Moreover, among the 6% of respondents in China, the “DMHIs” they mentioned using were often web-based mental health content published on WeChat, TikTok, and Bilibili (similar to YouTube).
Regarding their willingness to adopt DMHIs in the future, 16% (36 out of 220) of participants in China and 29% (63 out of 218) in the United Kingdom expressed a lack of willingness. It is notable that UK-based staff, although more experienced with DMHIs, were significantly less motivated to use DMHIs again (t=3.17, P<.001). Their reasons for unwillingness to use DMHIs were summarised and shown in 
Textbox 1, including low perceived need and usefulness, needing a break from screens, and negative prior experiences with DMHIs.
In China (n=36)
- I don’t think it’s necessary (39%, n=14)
- I need a screen-break (19%, n=7)
- I can relieve my own stress (14%, n=5)
- I don’t know where to find suitable tools (14%, n=5)
- I worry about personal information leak (11%, n=4)
- Others (3%, n=1)
In the United Kingdom (n=63)
- I need a screen-break (22%, n=14)
- It not useful / doesn’t solve the real problem (21%, n=13)
- Phones distractive and can bring more stress (16%, n=10)
- It lacks a human touch (13%, n=8)
- I don’t think it’s necessary (9%, n=6)
- DMHIs I used were boring and not engaging (8%, n=5)
- Others (11%, n=7)
Interview Findings
Overview
A total of 41 HCPs opted in for the interviews after finishing the survey. A total of 10 participants in China (comprising 3 doctors, 6 nurses, and 1 admin, with 7 females and 3 males) and 15 participants in the United Kingdom (4 doctors, 7 nurses, and 4 admins, with 10 females and 5 males, 7 identified themselves as White, 4 as Black, 3 as Asian, 1 as Mixed) finished the interview. A total of 16 staff members (6 in China and 10 in the United Kingdom) did not reply to follow-up messages or could not participate due to their intense schedules. Participants were anonymized and referred to in the form of “country - job type (D for doctors, N for nurses, and A for admins) – number” (eg, UK-D-01).
The themes covered HCPs’ personal, contextual, and program-related factors. All quotes are included in and referred to by the quote numbers. Theme 1‐3 were shaped equally by qualitative data from both hospitals. Theme 4 reflected disparities between the 2 cohorts, with unique contributions from participants of each hospital.
Theme 1: No Problem, No Need
One common theme is a lack of perceived need to engage with DMHIs, with 2 primary causes as summarized below.
Subtheme 1.1: The Normalization of Burnout
Participants who were less aware of burnout mentioned getting accustomed to the extra pressure and stress in their daily work and having normalized such negative feelings as a common part of their job as HCPs (quotes 2 and 3 in ). As alluded to by a participant (quote 2 in ), such normalization of burnout is why many HCPs sought minimum support and believed support tools were unnecessary as they could handle stress and burnout by themselves.
Subtheme 1.2: Burnout Is Less Severe and Urgent
On the other hand, even those with a general understanding of burnout tended to underestimate its negative impact and thus deemed engaging with DMHIs unnecessary. This can be illustrated by participants who compared burnout with other psychological and physical conditions (quotes 3‐6 in ). For example, participants mentioned it is more necessary for colleagues or themselves who were undergoing difficult situations like a change of sex (quote 3 in ), PTSD (quote 4 in ), pregnancy (quote 5 in ), and depression (quote 6 in ) to use mental health apps. Burnout and other workplace issues were considered less problematic and less urgent (quotes 3 and 6 in ). Therefore, the perceived need for using DMHIs was relatively low.
Theme 2: No Place for DMHIs
Subtheme 2.1: Lack of Time or Space to Use DMHIs
Due to their intense and unpredictable schedules and limited opportunities for breaks, participants mentioned it’s hard for them to use DMHIs routinely (quotes 7 and 8 in ), and they had to put much effort into finding a time and space to use DMHIs (quote 9 in ).
Furthermore, using DMHIs off work was less welcomed, and many preferred to leave work-related issues like stress and burnout at work (quotes 10 and 12 in ). Participants strongly valued work-life balance, preventing them from using DMHIs in their personal time (quotes 11 and 12 in ).
Subtheme 2.2: We Have a Lot of Screens Already
A big part of the participants (10 out of 25) mentioned the impact of hospital digitisation and its impact on their work (as represented by quotes 13‐15 in ). They recalled the extra stress and workload (quotes 13 and 14 in ) and a sense of losing control over their work (quotes 13 in ) due to the introduction of new digital tools in the health care system. The negative experience with digital systems could lead to extra hesitation when HCPs adopt DMHIs. Besides, the ubiquity of digital systems in the hospital led to HCPs’ need for a screen break, which participants highlighted as a hindrance to their motivation to use DMHIs (as represented by quote 15 in ).
Theme 3: Mixed Perceptions of DMHIs
Subtheme 3.1: DMHIs Are Good for Relaxation and Psychoeducation
When asked about their expectations of DMHIs, most participants (17 out of 25) desired the destress and relaxation sessions offered by DMHIs. Participants generally praised the potential of DMHIs for quick relaxation and stress relief (as represented by quotes 16 and 17 in ). Several participants also mentioned their preference for psychoeducational content, such as mental health tips, assessment, skill training, and general wellbeing suggestions (quotes 18 and 19 in ).
Subtheme 3.2: Need for Relevant and Reliable Content
Participants in China mentioned their generally negative experiences with mental health tools and web-based platforms (as represented by quotes 20 and 21 in ). They recalled getting mental health information via social media platforms, like WeChat, Douyin (TikTok) and Zhihu (similar to Quora). Due to the complex and unverified sources of information, such content was often not trustworthy (quote 20 in ) and superficial (quote 21 in ).
Meanwhile, participants in both sites highlighted that many DMHIs they encountered failed to address the specific and complex needs of HCPs (as represented by quotes 21‐24 in ). Participants were dissatisfied that many DMHIs only offered broad and generic support (quotes 23 and 24 in ). They emphasized the need for more personalized and relevant solutions tailored for HCPs (quotes 22 and 24 in ).
Subtheme 3.3: Desire for a Human Touch
A majority of interviewees (11 out of 15) in the United Kingdom highlighted their preference for a human touch in mental health support. Lack of human support emerged as a critical hindrance in their motivation to use DMHIs. For instance, one participant mentioned their preference for interacting with a real human being and being able to vocalize their thoughts rather than only focusing on their phones (quote 25 in ). Other participants mentioned similar points and further elaborated on the significance of persons who genuinely understand the daily situations of HCPs and can immediately relate to their problems (quotes 26 and 27 in ).
The need for a personal touch was less brought up by Chinese participants. Two participants briefly mentioned the need for expert support to “suggest on whether I have a mental situation” [CN-N-04], and “give personalized guidance and stress relief suggestions” [CN-N-02].
Theme 4: Culture and Stigma
Subtheme 4.1: Self-Stigma and the Moral Obligation Among Chinese HCPs
The impact of self-stigma on DMHI engagement was apparent among Chinese participants. For example, one participant thought DMHIs were unnecessary because HCPs should be able to address their own problems (quote 28 in ). Other participants displayed similar attitudes and associated personal and professional virtues with mental well-being (quotes 30 and 31 in ). Such moral attribution was shared by other participants who used terms like “not strong enough” (CN-N-06) and “not trying hard enough” (CN-N-01) to describe HCPs struggling with stress, anxiety, and burnout.
Furthermore, as described by participants (quotes 29‐31 in ), participants in the Chinese hospital often share a moral obligation to improve themselves and stay strong and resilient despite experiencing high levels of stress and burnout. As reflected by the quotes, such moral commitments can contribute to their resilience while leading to their focus on self-improvement rather than seeking external support.
Subtheme 4.2: Individualism and Collectivism, Reversed
As conceptualized by Hofstede [], in individualistic countries like the United Kingdom, people tend to prioritize self-care over seeking help from in-group members [,]. In contrast, in a collectivist culture, collective growth and harmony are prioritized []. However, in this study, we identified the opposite trends regarding preferences for DMHIs among participants. Specifically, more participants in the UK-based-hospital preferred community support and human involvement in DMHIs (as represented by quotes 32 and 33 in ). They were generally open to seeking support from their local community (quote 32 in ), and work community (quote 33 in ), and deemed providing such support opportunities a valuable feature of DMHIs.
In the Chinese hospital, however, few participants expressed similar interests in community support. One participant described a reluctance to community support and team building among younger generations of HCPs (quote 34 in ). Other participants strongly preferred personal support, self-care, and self-improvement (as represented by quotes 29 and 35 in ). Regarding social support, they preferred to seek help within their personal support network instead of from broader groups and communities (quotes 35‐37 in ). As revealed by quotes 36 and 37 in , when asked about community support options facilitated by DMHIs, Chinese participants often envisioned situations where they needed to disclose sensitive and private information, which was less favored.
Discussion
Principal Findings
To our knowledge, this is one of the first studies investigating HCPs’ use and factors impacting their engagement with DMHIs. Based on their feedback, we identified demographical, personal, occupational, and cultural factors that impacted their engagement with DMHIs and provided implications for future research on DMHIs for HCPs. In the following sections, we elaborate on the engagement factors, compare our findings with prior works on DMHI engagement among other populations, and provide design implications.
Furthermore, building on the findings of this study and evidence from previous literature, we developed detailed design heuristics and practical recommendations for DMHIs targeted at HCPs, as outlined in .
Demographic Factors: Lack of Engagement Among Underrepresented Groups
In this study, we identified substantial differences in HCPs’ engagement with DMHIs across cultures and ethnicities. Specifically, only 6% of HCPs in China had previously used DMHIs, compared with 28% of staff in the United Kingdom. Furthermore, within the UK sample, HCPs belonging to ethnic minority groups, specifically Asian and Black, were significantly less likely to engage with DMHIs. This concerning gap in DMHI engagement among ethnic minorities and people from low- and middle-income countries aligns with findings from previous studies [,]. One fundamental cause of such lack of engagement is that most mental health apps and platforms are developed in high-income countries for the majority of the White population [,,]. This poses barriers and challenges for users from underrepresented groups to engage. In our study, HCPs in China struggled to find available DMHIs and were frustrated by the lack of quality of the existing products and platforms (subtheme 3.2). Such inequality in resources, along with language barriers and cultural incompatibility, were major factors identified in previous studies that hinder engagement from underrepresented populations [,,]. More efforts are strongly needed to develop tailored interventions [] and conduct cultural adaptation on existing DMHIs for underrepresented populations [,,] to overcome this inequality and facilitate engagement among underrepresented groups.
Personal Factors: Mental Health Literacy and Low Perceived Need
Lack of mental health knowledge and low perceived need emerged as interconnected factors hindering DMHI engagement in both samples. Our results showed that knowledge of burnout interventions and a help-seeking history significantly predicted HCPs’ engagement with DMHIs. Many HCPs, without adequate knowledge and recognition of burnout, had normalized burnout symptoms in their work experiences (subtheme 1.1) and found it less necessary to adopt DMHIs for burnout as it is less severe and urgent (subtheme 1.2). Indeed, without essential literacy and awareness, motivating users to adopt DMHIs can be challenging []. This is especially true among HCPs in various stages of burnout. Previous studies have shown that the need to alleviate acute symptoms is a crucial motivation for users to engage with DMHIs [,,]. For HCPs experiencing burnout, however, such motivation is often lacking, as burnout tends to gradually deteriorate over time rather than present acute issues requiring immediate relief [,]. Hence, to facilitate early recognition of burnout and motivate HCPs to seek support, systematic psychoeducation for staff is recommended for health care institutions, which was also called for by other studies [,]. Moreover, consistent with the design heuristics proposed by Peters [], we recommend future studies on DMHIs for HCPs to provide adequate information on the necessity and benefits of interventions across various stages of user experiences. This can help form a meaningful rationale among HCPs who are hesitant about engaging or just started using DMHIs, which can effectively motivate them to increase and sustain their engagement [,].
Occupational Factors: Demanding Jobs and Overwhelming Digitization
As revealed by previous literature, engagement is critical for effective DMHIs [,,]. However, this can be challenging for HCPs as their schedules are intense and unpredictable. HCPs in China and the United Kingdom were reported to undergo issues like staff shortages, increasing workload, and work pressures [,]. This is also reflected in this study, HCPs struggled to allocate a set time to engage with DMHIs (subtheme 2.1). For them, structured push notifications, a common engagement strategy applied by prior studies [-], may be less effective. However, just-in-time notifications, that is, adaptive and personalized notifications based on user behavior patterns or their locations [], demonstrated better engagement outcomes [,] and can be an ideal engagement facilitator for HCPs. Although HCPs’ schedules vary significantly, certain times (morning brief, between shifts, lunch breaks, etc) can be suitable for specific cohorts. Furthermore, as HCPs’ work is highly location-based, we suggest using context-based reminders to facilitate engagement. For instance, just-in-time notifications that prompt when HCPs enter spaces used for relaxation and on-site visual cues like posters and stickers placed within common spaces could be effective nudges for DMHI engagement. Similar to the design strategies proposed by previous studies that support establishing an engagement routine [], such context-based reminders could promote the integration of HCPs’ existing routines with DMHI engagement.
Digitization in health care systems is another factor that cannot be ignored. Our quantitative data revealed that a considerable proportion of participants (88% in China and 79% in the United Kingdom) reported using computers frequently (at least once an hour) in their jobs. Being immersed in a highly digitized workplace, participants in both countries reflected on the additional effort and learning curve entailed by systems like the electronic health record. They demonstrated hesitance and reluctance to engage with more digital systems like DMHIs, with a strong need for a “screen break” (as shown in the survey feedback and Subtheme 2.2). This is consistent with recent studies on digital stress and overload among HCPs [], often caused by digital systems like electronic health records that have been ubiquitously applied in health care settings [-]. Concerns of being further overwhelmed and complicated by technology contribute to their hesitation and lack of motivation towards DMHIs. Therefore, we suggest that future work apply best practices for usability and accessibility to avoid causing an extra burden on HCPs’ work experience, a point also advocated by other researchers [,,]. We also recommend that researchers and designers consider HCPs’ digital literacy (especially for older, non-tech-savvy staff, as suggested by prior studies [,] and deliver DMHIs via technologies familiar to the targeted cohort of HCPs.
Intervention-Based Factors: Relevance and Human Support
Many participants indicated that DMHIs often lacked relevance to health care workers and their struggle with job burnout. Similar observations have been made in other studies, where users strongly valued personal relevance, highlighting the importance of tailoring to DMHIs [,]. To provide relevant content and design for HCPs, we recommend incorporating language and daily scenarios that staff are familiar with. Moreover, using participatory design methodologies [] to involve HCPs and relevant stakeholders throughout the developing process is also recommended to ensure the final outcome embodies the values and needs of HCPs, a perspective shared by many DMHI researchers [-].
Besides, staff also mentioned a need for human-based support, highlighting the importance of feeling understood and related to their experiences with DMHIs (subtheme 3.3). Prior studies also suggested the benefits of providing human-based support or guidance, like expert consultation and coaching, to promote user engagement [,,,,]. DMHIs with certain levels of human support generally result in better engagement and clinical outcomes than self-guided DMHIs, as reported by recent reviews [,]. However, expert guidance and regular meetings with trained practitioners are less accessible and scalable, especially for large populations like HCPs []. We suggest future studies probe the potential of accessible human support and guidance, like text-based, asynchronized human support, or human-like interactions supported by conversational AI. Indeed, DMHIs using chatbots and embodied conversational agents have the potential to facilitate user engagement by providing personalized and empathic interactions [,]. Nonetheless, more studies are needed to address the ethical and methodological shortfalls [,] and tailor the algorithms for unique cohorts like HCPs.
Cultural Factors: Stigma, Moral Obligation, and Varying Preferences for Community Support
Cultural differences are influential to HCPs’ engagement with DMHIs, as revealed by our qualitative data. Stigma on burnout and mental health issues was commonly identified among Chinese participants, echoing research evidence on the prevalence of stigma in China [,]. The self-stigma among Chinese participants affected their willingness to admit mental health issues or adopt DMHIs for support (subtheme 4.1). Previous studies among culturally diverse populations also emphasized the impact of self-stigma on DMHI acceptability and engagement [,]. Furthermore, Chinese HCPs in this study often attributed mental health conditions to personal and moral virtues, demonstrating a moral obligation to remain resilient at work and to do their best to avoid being affected by stress and burnout (subtheme 4.1). Such moral experiences are closely intertwined with culturally rooted mental health stigma and are commonly observed within Chinese communities and other cultural groups [,]. Maintaining the ability to work is a crucial coping strategy among Chinese populations against mental health stigma and sociocultural discrimination, as work serves as a key factor in preserving social status and fulfilling familial and moral obligations [,]. We suggest future projects for stigmatized populations establish nonjudgmental feedback mechanisms and reframe DMHIs as tools for enhancing well-being, occupational resilience, or improving professional abilities and skills, a strategy also indicated by a recent study on DMHIs []. Although researchers suggested shifting focus away from the dichotomous categorization of wellness and health within digital mental health technologies [], we argue that strategically labeling DMHIs can be beneficial in a stigmatized context.
Peer support and community-based elements in DMHIs could facilitate user engagement by fostering a sense of collective care and support []. However, as suggested by our findings, this must be executed cautiously, particularly in environments where mental health is still stigmatized and less discussed openly. Similar to Chinese HCPs in this study, stigmatized users are often reluctant to participate in community support activities [,], due to sociocultural factors like public stigma, lack of mental health education, and traditional cultural values [-]. We suggest designers build meaningful connections among users while not imposing pressure to share or disclose personal information, which is crucial for nurturing social connectedness and support [,]. Maintaining a certain level of anonymity and taking extra caution with user privacy is also advisable.
Limitation
This study involved 2 major hospitals in key cities in China and the United Kingdom. Given the differences between hospitals of various sizes and geographical locations [], our findings may not fully represent other medical populations in these countries. Our sample sizes for the survey and interview (around 5% of survey respondents) are relatively small, which may limit the generalizability of our findings. Besides, the gender imbalance between the 2 cohorts (χ²3=10.907, P=.01) may have also impacted our findings, as gender can be an impactful factor on DMHI engagement [].
The volunteer sampling method we employed could also introduce a source of response bias. HCPs interested in mental health and DMHIs may have been more likely to take part. This may lead to the study results not being fully generalizable to the broader population of HCPs in China and the United Kingdom. However, the triangulation of surveys and interviews helps somewhat mitigate this potential bias. Furthermore, as a cross-cultural study, we only investigated HCPs in 2 countries. Future studies should broaden the scope to include participants from other countries and regions to enhance the robustness of the evidence.
Participants were asked about DMHIs as a general, nonspecific concept rather than specific digital tools (eg, apps, web-based platforms, mixed-reality). This was intentional, as our focus was on overall engagement with various DMHIs. However, this broad framing may be less effective in helping HCPs navigate different DMHI concepts. More studies on engagement with specific types of technologies could be beneficial.
Another limitation of this study is the use of single-item questions assessing some constructs like engagement with DMHIs and willingness to adopt them. Although such questions were adopted to ensure the time-efficiency of the survey as HCPs are known to have hectic work schedules, they may lack psychometric stability on measures like motivation and willingness. Future research should consider using multi-item scales to enhance the robustness of measurement.
Conclusions
This study used a mixed method approach to explore HCPs’ level of engagement with DMHIs and identified key factors that impact their attitudes and engagement. We found that there is a considerable gap in DMHI engagement among ethnic and cultural minority groups, potentially due to the lack of availability and content quality of DMHIs for minority groups. Lack of time to use DMHIs, lack of mental health literacy, low perceived need, lack of perceived relevance, and lack of human-based support were common factors impeding HCPs’ engagement with DMHIs. Cultural elements like stigma and moral attributions also impacted HCPs’ engagement and preference for DMHIs. Overall, this study contributed to the limited evidence on the experience and engagement with DMHIs among HCPs and shed light on how future efforts can design and deliver DMHIs that are accepted and engaged by HCPs.
Acknowledgments
CW+ Charity and the Chinese Scholarship Council funded this study. We would also like to thank the participants from the 2 sites for their involvement in the study.
Conflicts of Interest
Since July 2023, RAC has been a scientific advisor for Head Shed App Ltd and Haven VR Ltd.
Multimedia Appendix 1
Logistic regression analysis of digital mental health intervention engagement among health care professionals in China and the United Kingdom.
DOCX File, 19 KBReferences
- De Hert S. Burnout in healthcare workers: prevalence, impact and preventative strategies. Local Reg Anesth. 2020;13:171-183. [CrossRef] [Medline]
- Macaron MM, Segun-Omosehin OA, Matar RH, et al. A systematic review and meta analysis on burnout in physicians during the COVID-19 pandemic: a hidden healthcare crisis. Front Psychiatry. 2023;13:1071397. [CrossRef]
- Rossi MF, Gualano MR, Magnavita N, Moscato U, Santoro PE, Borrelli I. Coping with burnout and the impact of the COVID-19 pandemic on workers’ mental health: a systematic review. Front Psychiatry. 2023;14:1139260. [CrossRef]
- Hersch RK, Cook RF, Deitz DK, et al. Reducing nurses’ stress: a randomized controlled trial of a web-based stress management program for nurses. Appl Nurs Res. Nov 2016;32:18-25. [CrossRef] [Medline]
- Solomon D, Proudfoot J, Clarke J, Christensen H. e-CBT (myCompass), antidepressant medication, and face-to-face psychological treatment for depression in Australia: a cost-effectiveness comparison. J Med Internet Res. 17(11):e255. [CrossRef]
- Adam D, Berschick J, Schiele JK, et al. Interventions to reduce stress and prevent burnout in healthcare professionals supported by digital applications: a scoping review. Front Public Health. 2023;11:1231266. [CrossRef] [Medline]
- Counson I, Bartholomew A, Crawford J, et al. Development of the shift smartphone app to support the emotional well-being of junior physicians: design of a prototype and results of usability and acceptability testing. JMIR Form Res. Dec 2, 2021;5(12):e26370. [CrossRef] [Medline]
- Deady M, Choi I, Calvo RA, Glozier N, Christensen H, Harvey SB. eHealth interventions for the prevention of depression and anxiety in the general population: a systematic review and meta-analysis. BMC Psychiatry. Dec 2017;17(1):310. [CrossRef]
- Dyrbye LN, West CP, Richards ML, Ross HJ, Satele D, Shanafelt TD. A randomized, controlled study of an online intervention to promote job satisfaction and well-being among physicians. Burn Res. Sep 2016;3(3):69-75. [CrossRef]
- Pospos S, Young IT, Downs N, et al. Web-based tools and mobile applications to mitigate burnout, depression, and suicidality among healthcare students and professionals: a systematic review. Acad Psychiatry. Feb 2018;42(1):109-120. [CrossRef] [Medline]
- Shanafelt TD, Kaups KL, Nelson H, et al. An interactive individualized intervention to promote behavioral change to increase personal well-being in US surgeons. Ann Surg. Jan 2014;259(1):82-88. [CrossRef] [Medline]
- Wood AE, Prins A, Bush NE, et al. Reduction of burnout in mental health care providers using the provider resilience mobile application. Community Ment Health J. May 2017;53(4):452-459. [CrossRef]
- López-Del-Hoyo Y, Fernández-Martínez S, Pérez-Aranda A, et al. Effects of eHealth interventions on stress reduction and mental health promotion in healthcare professionals: a systematic review. J Clin Nurs. Sep 2023;32(17-18):5514-5533. [CrossRef] [Medline]
- Ferrer Costa J, Moran N, Garcia Marti C, Colmenares Hernandez LJ, Radu Ciorba Ciorba F, Ciudad MJ. Immediate impact of an 8-week virtual reality educational program on burnout and work engagement among health care professionals: pre-post pilot study. JMIR XR Spatial Comput. 2024;1:e55678. [CrossRef]
- Beverly E, Hommema L, Coates K, et al. A tranquil virtual reality experience to reduce subjective stress among COVID-19 frontline healthcare workers. In: Afrashtehfar KI, editor. PLoS ONE. 2022;17(2):e0262703. [CrossRef]
- Borghouts J, Eikey E, Mark G, et al. Barriers to and facilitators of user engagement with digital mental health interventions: systematic review. J Med Internet Res. Mar 24, 2021;23(3):e24387. [CrossRef] [Medline]
- Fisher A, Corrigan E, Cross S, et al. Decision-making about uptake and engagement with digital mental health services: a qualitative exploration of service user perspectives. Clin Psychol (Aust Psychol Soc). Jan 2, 2024;28(1):37-48. [CrossRef]
- Lipschitz JM, Van Boxtel R, Torous J, et al. Digital mental health interventions for depression: scoping review of user engagement. J Med Internet Res. Oct 14, 2022;24(10):e39204. [CrossRef] [Medline]
- Lattie EG, Stiles-Shields C, Graham AK. An overview of and recommendations for more accessible digital mental health services. Nat Rev Psychol. Feb 2022;1(2):87-100. [CrossRef] [Medline]
- Fleming T, Bavin L, Lucassen M, Stasiak K, Hopkins S, Merry S. Beyond the trial: systematic review of real-world uptake and engagement with digital self-help interventions for depression, low mood, or anxiety. J Med Internet Res. 2018;20(6):e199. [CrossRef]
- Jardine J, Nadal C, Robinson S, Enrique A, Hanratty M, Doherty G. Between rhetoric and reality: real-world barriers to uptake and early engagement in digital mental health interventions. ACM Trans Comput Hum Interact. Apr 30, 2024;31(2):1-59. [CrossRef]
- Baumel A, Muench F, Edan S, Kane JM. Objective user engagement with mental health apps: systematic search and panel-based usage analysis. J Med Internet Res. 2019;21(9):e14567. [CrossRef]
- Michie S, Yardley L, West R, Patrick K, Greaves F. Developing and evaluating digital interventions to promote behavior change in health and health care: recommendations resulting from an international workshop. J Med Internet Res. 2017;19(6):e232. [CrossRef]
- Callahan C, Kimber J, Hu E, Tanner L, Kunkle S. The real-world impact of app-based mindfulness on headspace members with moderate and severe perceived stress: observational study. JMIR Mhealth Uhealth. Mar 4, 2024;12:e52968. [CrossRef] [Medline]
- Spanhel K, Balci S, Feldhahn F, Bengel J, Baumeister H, Sander LB. Cultural adaptation of internet- and mobile-based interventions for mental disorders: a systematic review. NPJ Digit Med. Aug 25, 2021;4(1):128. [CrossRef] [Medline]
- Chen R, Sun C, Chen JJ, et al. A large-scale survey on trauma, burnout, and posttraumatic growth among nurses during the COVID-19 pandemic. Int J Ment Health Nurs. Feb 2021;30(1):102-116. [CrossRef] [Medline]
- Gemine R, Davies GR, Tarrant S, Davies RM, James M, Lewis K. Factors associated with work-related burnout in NHS staff during COVID-19: a cross-sectional mixed methods study. BMJ Open. Jan 28, 2021;11(1):e042591. [CrossRef] [Medline]
- Lo D, Wu F, Chan M, Chu R, Li D. A systematic review of burnout among doctors in China: a cultural perspective. Asia Pac Fam Med. 2018;17(1):3. [CrossRef] [Medline]
- Morgan B. NHS staffing shortages. Why do politicians struggle to give the NHS the staff it needs? The King’s Fund and Engage Britain; 2022.
- Zhang H, Luo D, Lu Y, Zhu H, Zhang G, Li M. Growth and challenges of China’s nursing workforce from 1998 to 2018: a retrospective data analysis. Int J Nurs Stud. Dec 2021;124:104084. [CrossRef] [Medline]
- Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. Jan 2006;3(2):77-101. [CrossRef]
- Our hospital awarded the model collective for ethnic unity and progress in sichuan province. West China Hospital, Sichuan University. URL: https://www.wchscu.cn/comprehensive/53331.html [Accessed 2025-03-30]
- Hofstede G. Dimensionalizing cultures: the Hofstede model in context. Online Read Psychol Cult. 2011;2(1). [CrossRef]
- Hofstede GH, Hofstede GJ, Minkov M. Cultures and Organizations: Software of the Mind: Intercultural Cooperation and Its Importance for Survival. 3rd ed. McGraw-Hill; 2010.
- Zhou X. Cultural dimensions and framing the internet in China: a cross-cultural study of newspapers’ coverage in Hong Kong, Singapore, the US and the UK. Int Commun Gaz. 2008;70(2):117-136. [CrossRef]
- Karyotaki E, Ebert DD, Donkin L, et al. Do guided internet-based interventions result in clinically relevant changes for patients with depression? An individual participant data meta-analysis. Clin Psychol Rev. Jul 2018;63:80-92. [CrossRef] [Medline]
- Zhou ES, Ritterband LM, Bethea TN, Robles YP, Heeren TC, Rosenberg L. Effect of culturally tailored, internet-delivered cognitive behavioral therapy for insomnia in black women: a randomized clinical trial. JAMA Psychiatry. Jun 1, 2022;79(6):538-549. [CrossRef] [Medline]
- Eisenstadt M, Liverpool S, Infanti E, Ciuvat RM, Carlsson C. Mobile apps that promote emotion regulation, positive mental health, and well-being in the general population: systematic review and meta-analysis. JMIR Ment Health. Nov 8, 2021;8(11):e31170. [CrossRef] [Medline]
- Arjadi R, Nauta MH, Chowdhary N, Bockting CLH. A systematic review of online interventions for mental health in low and middle income countries: a neglected field. Glob Ment Health. 2015;2:e12. [CrossRef]
- Shroff A, Roulston C, Fassler J, et al. A digital single-session intervention platform for youth mental health: cultural adaptation, evaluation, and dissemination. JMIR Ment Health. 2023;10:e43062. [CrossRef]
- Sit HF, Ling R, Lam AIF, Chen W, Latkin CA, Hall BJ. The cultural adaptation of step-by-step: an intervention to address depression among Chinese young adults. Front Psychiatry. 2020;11:650. [CrossRef]
- Saad F, Eisenstadt M, Liverpool S, Carlsson C, Vainieri I. Self-guided mental health apps targeting racial and ethnic minority groups: scoping review. JMIR Ment Health. Dec 6, 2023;10:e48991. [CrossRef] [Medline]
- Marwaha JS, Kvedar JC. Cultural adaptation: a framework for addressing an often-overlooked dimension of digital health accessibility. NPJ Digit Med. Oct 1, 2021;4(1):143. [CrossRef] [Medline]
- Naderbagi A, Loblay V, Zahed IUM, et al. Cultural and contextual adaptation of digital health interventions: narrative review. J Med Internet Res. Jul 9, 2024;26:e55130. [CrossRef] [Medline]
- Fisher A, Corrigan E, Cross S, et al. Decision-making about uptake and engagement among digital mental health service users: a qualitative exploration of therapist perspectives. Clin Psychol (Aust Psychol Soc). May 4, 2023;27(2):171-185. [CrossRef]
- Donkin L, Glozier N. Motivators and motivations to persist with online psychological interventions: a qualitative study of treatment completers. J Med Internet Res. Jun 22, 2012;14(3):e91. [CrossRef] [Medline]
- Dalky HF, Abu-Hassan HH, Dalky AF, Al-Delaimy W. Assessment of mental health stigma components of mental health knowledge, attitudes and behaviors among Jordanian healthcare providers. Community Ment Health J. Apr 2020;56(3):524-531. [CrossRef] [Medline]
- Hao Y, Wu Q, Luo X, et al. Mental health literacy of non-mental health nurses: a mental health survey in four general hospitals in Hunan Province, China. Front Psychiatry. 2020;11:507969. [CrossRef]
- Peters D. Wellbeing supportive design – research-based guidelines for supporting psychological wellbeing in user experience. Int J Hum Comput Interact. Aug 27, 2023;39(14):2965-2977. [CrossRef]
- Peters D, Calvo RA, Ryan RM. Designing for motivation, engagement and wellbeing in digital experience. Front Psychol. 2018;9:797. [CrossRef]
- Amagai S, Pila S, Kaat AJ, Nowinski CJ, Gershon RC. Challenges in participant engagement and retention using mobile health apps: literature review. J Med Internet Res. Apr 26, 2022;24(4):e35120. [CrossRef] [Medline]
- Gan DZQ, McGillivray L, Larsen ME, Christensen H, Torok M. Technology-supported strategies for promoting user engagement with digital mental health interventions: a systematic review. Digit HEALTH. 2022;8:20552076221098268. [CrossRef] [Medline]
- Freyne J, Yin J, Brindal E, Hendrie GA, Berkovsky S, Noakes M. Push notifications in diet apps: influencing engagement times and tasks. Int J Hum Comput Interact. Oct 3, 2017;33(10):833-845. [CrossRef]
- Saleem M, Kühne L, De Santis KK, Christianson L, Brand T, Busse H. Understanding engagement strategies in digital interventions for mental health promotion: scoping review. JMIR Ment Health. Dec 20, 2021;8(12):e30000. [CrossRef] [Medline]
- van Mierlo T, Rondina R, Fournier R. Nudges and prompts increase engagement in self-guided digital health treatment for depression and anxiety: results from a 3-arm randomized controlled trial. JMIR Form Res. Apr 9, 2024;8:e52558. [CrossRef] [Medline]
- Jakob R, Harperink S, Rudolf AM, et al. Factors influencing adherence to mHealth apps for prevention or management of noncommunicable diseases: systematic review. J Med Internet Res. May 25, 2022;24(5):e35371. [CrossRef] [Medline]
- Bell L, Garnett C, Bao Y, et al. How notifications affect engagement with a behavior change app: results from a micro-randomized trial. JMIR Mhealth Uhealth. Jun 9, 2023;11:e38342. [CrossRef] [Medline]
- Sporrel K, Wang S, Ettema DDF, et al. Just-in-time prompts for running, walking, and performing strength exercises in the built environment: 4-week randomized feasibility study. JMIR Form Res. Aug 1, 2022;6(8):e35268. [CrossRef] [Medline]
- Suh J, Howe E, Lewis R, et al. Toward tailoring just-in-time adaptive intervention systems for workplace stress reduction: exploratory analysis of intervention implementation. JMIR Ment Health. Sep 12, 2024;11:e48974. [CrossRef] [Medline]
- Szinay D, Perski O, Jones A, Chadborn T, Brown J, Naughton F. Perceptions of factors influencing engagement with health and well-being apps in the United Kingdom: qualitative interview study. JMIR Mhealth Uhealth. 2021;9(12):e29098. [CrossRef]
- Bernburg M, Tell A, Groneberg DA, Mache S. Digital stressors and resources perceived by emergency physicians and associations to their digital stress perception, mental health, job satisfaction and work engagement. BMC Emerg Med. 2024;24(1):31. [CrossRef]
- Jedwab RM, Hutchinson AM, Manias E, et al. Nurse motivation, engagement and well-being before an electronic medical record system implementation: a mixed methods study. Int J Environ Res Public Health. Mar 8, 2021;18(5):2726. [CrossRef] [Medline]
- Mosaly PR, Mazur LM, Yu F, et al. Relating task demand, mental effort and task difficulty with physicians’ performance during interactions with electronic health records (EHRs). Int J Hum Comput Interact. May 4, 2018;34(5):467-475. [CrossRef]
- Tissera S, Jedwab R, Calvo R, et al. Older nurses’ perceptions of an electronic medical record implementation. In: Honey M, Ronquillo C, Lee TT, Westbrooke L, editors. Studies in Health Technology and Informatics. IOS Press; 2021. [CrossRef]
- Tajirian T, Stergiopoulos V, Strudwick G, et al. The influence of electronic health record use on physician burnout: cross-sectional survey. J Med Internet Res. 2020;22(7):e19274. [CrossRef]
- Torous J, Nicholas J, Larsen ME, Firth J, Christensen H. Clinical review of user engagement with mental health smartphone apps: evidence, theory and improvements. Evid Based Ment Health. Aug 2018;21(3):116-119. [CrossRef] [Medline]
- Pywell J, Vijaykumar S, Dodd A, Coventry L. Barriers to older adults’ uptake of mobile-based mental health interventions. Digit HEALTH. 2020;6:2055207620905422. [CrossRef] [Medline]
- Björgvinsson E, Ehn P, Hillgren PA. Participatory design and “democratizing innovation”. Presented at: PDC ’10: Proceedings of the 11th Biennial Participatory Design Conference; Nov 29 to Dec 3, 2010; Sydney, Australia. [CrossRef]
- Ospina-Pinillos L, Davenport T, Mendoza Diaz A, Navarro-Mancilla A, Scott EM, Hickie IB. Using participatory design methodologies to co-design and culturally adapt the Spanish version of the mental health eClinic: qualitative study. J Med Internet Res. Aug 2, 2019;21(8):e14127. [CrossRef] [Medline]
- Peters D, Deady M, Glozier N, Harvey S, Calvo RA. Worker preferences for a mental health app within male-dominated industries: participatory study. JMIR Ment Health. Apr 25, 2018;5(2):e30. [CrossRef] [Medline]
- Smith KA, Blease C, Faurholt-Jepsen M, et al. Digital mental health: challenges and next steps. BMJ Ment Health. Feb 2023;26(1):e300670. [CrossRef] [Medline]
- O’Sullivan S, van Berkel N, Kostakos V, et al. Understanding what drives long-term engagement in digital mental health interventions: secondary causal analysis of the relationship between social networking and therapy engagement. JMIR Ment Health. May 22, 2023;10:e44812. [CrossRef] [Medline]
- Perret S, Alon N, Carpenter-Song E, et al. Standardising the role of a digital navigator in behavioural health: a systematic review. Lancet Digit Health. Dec 2023;5(12):e925-e932. [CrossRef] [Medline]
- Bérubé C, Schachner T, Keller R, et al. Voice-based conversational agents for the prevention and management of chronic and mental health conditions: systematic literature review. J Med Internet Res. Mar 29, 2021;23(3):e25933. [CrossRef] [Medline]
- He Y, Yang L, Qian C, et al. Conversational agent interventions for mental health problems: systematic review and meta-analysis of randomized controlled trials. J Med Internet Res. 2023;25:e43862. [CrossRef]
- Blease C, Torous J. ChatGPT and mental healthcare: balancing benefits with risks of harms. BMJ Ment Health. Nov 2023;26(1):e300884. [CrossRef] [Medline]
- Jabir AI, Martinengo L, Lin X, Torous J, Subramaniam M, Tudor Car L. Evaluating conversational agents for mental health: scoping review of outcomes and outcome measurement instruments. J Med Internet Res. Apr 19, 2023;25:e44548. [CrossRef] [Medline]
- Ran MS, Hall BJ, Su TT, et al. Stigma of mental illness and cultural factors in Pacific Rim region: a systematic review. BMC Psychiatry. Jan 7, 2021;21(1):8. [CrossRef] [Medline]
- Xu X, Li XM, Zhang J, Wang W. Mental health-related stigma in China. Issues Ment Health Nurs. Feb 2018;39(2):126-134. [CrossRef]
- Yang LH. Application of mental illness stigma theory to Chinese societies: synthesis and new directions. Singapore Med J. Nov 2007;48(11):977-985. [Medline]
- Yang LH, Chen FP, Sia KJ, et al. “What matters most:” a cultural mechanism moderating structural vulnerability and moral experience of mental illness stigma. Soc Sci Med. Feb 2014;103:84-93. [CrossRef] [Medline]
- Torous J, Firth J, Goldberg SB. Digital mental health’s unstable dichotomy-wellness and health. JAMA Psychiatry. Jun 1, 2024;81(6):539-540. [CrossRef] [Medline]
- Liverpool S, Mota CP, Sales CMD, et al. Engaging children and young people in digital mental health interventions: systematic review of modes of delivery, facilitators, and barriers. J Med Internet Res. 2020;22(6):e16317. [CrossRef]
- Fekih-Romdhane F, Jahrami H, Stambouli M, et al. Cross-cultural comparison of mental illness stigma and help-seeking attitudes: a multinational population-based study from 16 Arab countries and 10,036 individuals. Soc Psychiatry Psychiatr Epidemiol. Apr 2023;58(4):641-656. [CrossRef]
- Pendse SR, Niederhoffer K, Sharma A. Cross-cultural differences in the use of online mental health support forums. Proc ACM Hum Comput Interact. Nov 7, 2019;3(CSCW):1-29. [CrossRef]
- Ran MS, Zhang TM, Wong IYL, et al. Internalized stigma in people with severe mental illness in rural China. Int J Soc Psychiatry. Feb 2018;64(1):9-16. [CrossRef]
- Duan C. Culture and mental health counseling: a reflective view based on observations in China. AJSS. Jan 1, 2019;6(1):71-88. [CrossRef]
- Gearing RE, Brewer KB, Leung P, et al. Mental health help-seeking in China. J Ment Health. Dec 2024;33(6):731-738. [CrossRef] [Medline]
- Xu W, Pan Z, Li Z, Lu S, Zhang L. Job burnout among primary healthcare workers in rural China: a multilevel analysis. Int J Environ Res Public Health. Jan 22, 2020;17(3):727. [CrossRef] [Medline]
Abbreviations
| DMHI: digital mental health intervention |
| HCP: health care professional |
Edited by John Torous; submitted 04.10.24; peer-reviewed by Honey Yadav, Lingfeng Xue, Merlin Kelly, Weijie Wang; final revised version received 22.02.25; accepted 05.03.25; published 04.04.25.
Copyright© Zheyuan Zhang, Sijin Sun, Laura Moradbakhti, Andrew Hall, Celine Mougenot, Juan Chen, Rafael A Calvo. Originally published in JMIR Mental Health (https://mental.jmir.org), 4.4.2025.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Mental Health, is properly cited. The complete bibliographic information, a link to the original publication on https://mental.jmir.org/, as well as this copyright and license information must be included.