This paper is in the following e-collection/theme issue:

Users' and Patients' Needs for Mental Health Services (378)

Published on in Vol 6, No 11 (2019): November

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/15373, first published .
Determinant Factors of Public Acceptance of Stress Management Apps: Survey Study

Determinant Factors of Public Acceptance of Stress Management Apps: Survey Study

Determinant Factors of Public Acceptance of Stress Management Apps: Survey Study

Authors of this article:

Jennifer Apolinário-Hagen1 Author Orcid Image ;   Severin Hennemann2 Author Orcid Image ;   Lara Fritsche3 Author Orcid Image ;   Marie Drüge4 Author Orcid Image ;   Bernhard Breil5 Author Orcid Image
Article Authors Cited by (37) Tweetations (7) Metrics

    Original Paper

    1Institute of Occupational, Social and Environmental Medicine, Faculty of Medicine, Centre for Health and Society, Heinrich Heine University Düsseldorf, Düsseldorf, Germany

    2Department of Clinical Psychology, Psychotherapy and Experimental Psychopathology, Institute of Psychology, University of Mainz, Mainz, Germany

    3Department of Health Psychology, Faculty of Psychology, University of Hagen, Hagen, Germany

    4Psychotherapy Research, Department of Clinical Psychology, Institute of Psychology, University of Zurich, Zurich, Switzerland

    5Faculty of Health Care, Niederrhein University of Applied Sciences, Krefeld, Germany

    Corresponding Author:

    Jennifer Apolinário-Hagen, PhD

    Institute of Occupational, Social and Environmental Medicine

    Faculty of Medicine, Centre for Health and Society

    Heinrich Heine University Düsseldorf

    17.11 Bldg, University Hospital Düsseldorf

    Moorenstraße 5

    Düsseldorf, 40225

    Germany

    Phone: 49 211 81 06477

    Email: jennifer.apolinario.hagen@uni-duesseldorf.de


    Background: Chronic stress is a major public health concern. Mobile health (mHealth) apps can help promote coping skills in daily life and prevent stress-related issues. However, little is known about the determinant factors of public acceptance of stress management in relation to preferences for psychological services.

    Objective: The aim of this survey study was to (1) assess determinant factors of public acceptance (behavioral use intention) of stress management apps based on an adapted and extended version of the Unified Theory of Acceptance and Use of Technology (UTAUT) model and (2) explore preferences for mHealth apps compared with other mental health services.

    Methods: Using convenience sampling, participants completed a multiscale 54-item Web-based survey. Based on significant correlations with acceptance, hierarchical stepwise regression analysis was performed within three blocks: (1) background and stress-related control variables, (2) beliefs and attitudes toward using mHealth, and (3) the core UTAUT determinants. The preference for mHealth apps in comparison with nine other mental health services (operationalized as readiness to use) was analyzed using paired t tests.

    Results: Of 141 participants, nearly half (69/141, 48.9%) indicated prior mHealth use. Acceptance of stress coping apps was moderate (mean 3.10, SD 1.03, range 1-5). Hierarchical stepwise regression including four of 11 variables (R2=.62; P=.01, f2=1.63) identified positive attitudes toward using mHealth for stress coping (beta=0.69, P<.001, 46% R2 increase above block 1, f2=0.85), skepticism/perceived risks (beta=−0.14, P=.01, f2=0.16), and stress symptoms (beta=0.12, P=.03, f2=0.14) as significant predictors of acceptance. UTAUT determinants added no predictive contribution beyond attitudes (all P>.05, R2 increase of 1%), whereas post hoc analysis showed significant R2 increases of attitudes and skepticism/perceived risks beyond UTAUT determinants (all P<.001, R2 increase of 13%). The readiness to use apps was equivalent to or significantly higher than most service types, but lower than information websites.

    Conclusions: Attitudes may be at least as predictive for the acceptance of stress management apps as for more elaborated outcome beliefs. Efforts aimed at improving the public adoption of mHealth could put more emphasis on the pleasant aspects of app use, address misconceptions, offer stress screening tools on health websites, and increase options to try high-quality apps.

    JMIR Ment Health 2019;6(11):e15373

    doi:10.2196/15373

    Keywords

    mental health; eHealth; mHealth; attitude to computers; acceptability of health care; stress, psychological; mobile apps 


    Background

    Chronic stress represents a tremendous health risk [1-3] and is a key contributor to the global burden of mental illness, which results in high economic costs on a societal level [4]. Therefore, from a public health perspective, it is vital to invest in the prevention of stress-related health problems. In this paper, stress is to be understood according to the Transactional Stress Model by Lazarus and Folkman [5], according to which subjective stress and coping appraisals caused by an event can result in further problem-focused or emotion-focused coping strategies.

    These strategies are the centerpiece of efficacious cognitive behavioral and multimodal stress management interventions, which are commonly provided in group settings [6]. Beyond group interventions, e-mental health services that can be delivered via mHealth apps may increase public access to interventions for the prevention of mental health problems [7]. Utilization rates in target groups in the field of workplace health promotion may also increase [8-10] by providing effective occupational e-mental health interventions for employees [11-13].

    Meta-analyses have demonstrated that high-quality mental health apps are efficacious in reducing the symptoms of anxiety [14], depression [15], and stress [16]. There are evidence-based digital stress management programs for nonclinical target groups, such as employees (eg, GET.ON [17-20]) and university students (eg, StudiCare [21-23]).

    Common content or behavior change techniques of available stress management apps involve problem-focused strategies, such as time management, goal setting, and planning social support. Emotion-focused strategies often include relaxation techniques, such as breathing exercises, mindfulness, or meditation and autogenic training [24].

    Although more than 10,000 mental health apps are publicly available, very few have been evaluated scientifically [25]. Health policy is necessary to ensure the structural requirements for the dissemination of high-quality, safe, and effective apps. To date, only a few stand-alone mHealth apps have been evaluated in randomized controlled trials (RCTs) and meet the criteria for becoming prescribable in medical contexts [26].

    In 2018, the German National Association of Statutory Health Insurance Funds made it possible to cover the costs of certified digital self-help programs for insured persons [27]. Furthermore, with the recently passed draft of the Digital Healthcare Act (Digitale-Versorgung-Gesetz [28]), the German Federal Ministry of Health set the course for the prescription of quality-approved mHealth apps.

    Despite increasing efforts to promote the diffusion of e-mental health worldwide, there is a remarkable discrepancy between the interest in and real-world uptake of mental health apps [29,30]. A comprehensive understanding of user characteristics, as described in the behavior change model for internet interventions [31] (eg, demographic and health-related variables as well as attitudes and beliefs), represents an essential first step to create persuasive digital interventions [31-33].

    Assessment of the Acceptance of Stress Management Apps

    Hennemann et al [34] acknowledged the confounding with intervention satisfaction as a major methodological weakness of the commonly practiced retrospective assessment of acceptance of e-mental health services, which does not allow for exploring genuine attitudes or reasons for use or nonuse.

    Predictive models of acceptance of information technology, such as the Unified Theory of Acceptance and Use of Technology (UTAUT) [35], operationalize acceptance as the strength of one’s behavioral intention to use a novel technology [36-38].

    Given that the assessment of technology acceptance is in many ways context-sensitive [34], the operationalization of UTAUT predictors has to be adapted to the respective type or purpose of the intervention [39], health outcome, or target population [40]. A growing body of research has used the UTAUT framework to investigate eHealth acceptance in various contexts, such as disease management apps for chronic illness [41,42] and Web-based interventions for depression [43,44], chronic pain [45], and occupational stress [34,46]. A low-to-moderate acceptance was indicated across all studies.

    In view of our scope on mHealth for health promotion and stress reduction, we expected a moderate or slightly higher acceptance of mHealth for stress coping in a sample of internet users compared with surveys of patients in health care settings.

    Determinants of the Acceptance of Stress Management Apps

    According to the generic UTAUT model, performance expectancy (eg, perceived usefulness), effort expectancy (eg, ease of use), and social influence (eg, subjective norm) are predictors of the intention to use an innovative technology, whereas facilitating conditions (eg, perceived behavioral control) and behavioral intention are hypothesized as direct determinants of actual use [35].

    Generally, most research on the UTAUT model point to performance expectancy as the strongest driver of technology acceptance across different contexts and innovations [47-49], including eHealth services [34,46,50-52].

    Beyond core UTAUT determinants, several additional predictors of technology acceptance have been suggested, particularly attitude [48], which was excluded as a key determinant from the UTAUT model [35].

    Attitudes can be defined as cognitive or affective evaluative judgments of psychological objects, for instance, in terms of one’s positive or negative feelings toward performing a behavior [36,53-55]. These attitudes are often associated with outcomes of health interventions [56,57]. As positive perception of and satisfaction with using a health technology [58], attitudes have been proposed as an essential precondition for the adoption of e-mental health services [59-62]. Recent meta-analyses support the integration of attitudes and UTAUT beliefs in technology acceptance models [48] and the way that beliefs about the usefulness and ease of use strongly influence attitudes, which positively affect behavioral intentions to use mHealth apps [63].

    In turn, negative attitudes could play a more relevant role for the poor uptake of e-mental health interventions than structural barriers [34]. Negative attitudes can involve skepticism and perceptions of risks of e-mental health interventions [61]. For example, data security or privacy concerns represent common reasons for not using the internet or mobile phones for mental health purposes [30,34,64-66], whereas anxiety toward using technology can negatively affect behavioral intention to use mHealth [50].

    Hence, we assumed a positive influence of attitudes (as a driver) and negative influences of skepticism and related negative beliefs (as barriers) on the acceptance of using mHealth for stress coping.

    Also, low awareness of mHealth apps and deficient mHealth literacy represent barriers to adoption [67,68]. Studies indicate a positive influence of experience with health-related internet or mobile phone use [32,34,46] on the acceptance of e-mental health services [32] and the real-world adoption of mHealth apps [69]. Although mHealth app users were found to be younger [70,71], more highly educated, and healthier than nonusers (eg, [71]), findings regarding demographic variables on the acceptance of e-mental health services are less consistent. More favorable views on e-mental health services were found among young adults [34,62,72], women [62,73], and adults with higher education [34,62,72,73], whereas other studies found no gender difference [34,64].

    Remarkably, the motivating influence of current needs (eg, for support in stressful situations) on intentions to use e-mental health services has not been consistently clarified. On the one hand, there is evidence for an association between stress perceptions and attitudes toward using e-mental health treatments [33,74] and a higher interest in using stress management apps [75]. On the other hand, there is evidence for “digital stress” caused by online multitasking and overload (eg, [76]). A recent study showed an association between intense media use for social networking and relaxation/entertainment and emotional stress [77]. Also, stress due to permanent online availability has been demonstrated as a barrier for inpatients’ acceptance of Web-based aftercare [34].

    In view of the inconsistent or limited findings on the role of background variables, as well as stress and coping appraisals on the acceptance of mHealth, we proposed influences of these constructs on acceptance in terms of control variables.

    Another influencing factor for the adoption of mHealth apps could be the way they are described to consumers in app stores. Huang and Bashir [78] found positive associations of information cues (reviews, ratings in app stores) with the number of downloads of mental health apps for anxiety. In contrast, Healey et al [79] identified no impact of expert and user testimonials on registrations for an unguided, Web-based depression intervention (MoodGym). Another RCT investigating public attitudes toward e-mental health treatments [59] observed a positive influence of information supplemented with scientific claims on an exemplary e-mental health service on attitudes, but not on intentions of use. In clinical contexts, there is also evidence of a positive impact of psychoeducational information on patients’ acceptance of e-mental health treatments [43,44]. However, the heterogeneous evidence base demonstrates the need for further research on the relevance of information cues in app descriptions for the uptake in the relevant target.

    Based on what is already known from other contexts, we expected a positive influence of scientific claims on stress coping apps on general acceptance.

    Preference for and Readiness to Use Mobile Health for Stress Coping

    The outcomes of psychological services are associated with individual preferences [80]. Concerning mHealth, a German panel survey showed that 53.29% of participants were not considering using apps for consultation or treatment [81]. Moreover, research points to a clear public preference for face-to-face treatment over e-mental health treatment services [32,34,62,65,82,83]. A study on the public acceptability of e-mental health treatments found the lowest likelihood for using mHealth apps, whereas the readiness to use Web-based interventions and self-help books were equivalent [83]. Another study found differences in the likelihood of using traditional services (eg, psychologist) and digital services (eg, information website) between people who either preferred or did not prefer e-mental health, but not for self-help books or medical treatment (general practitioner, prescribed medication) [82]. In addition, studies conducted in Germany showed a high interest in using health information websites and a low-to-moderate acceptance of mHealth apps and Web-based programs for dealing with stress [34,84].

    In contrast to surveys, real-world self-help activities can hardly be condensed into a forced-choice format because services are often used simultaneously (eg, app and website search). Hence, it would be interesting to learn more about patterns of preferences for apps versus other available or prototypical mental health services. This would help to integrate findings on mHealth acceptance in a greater practice-oriented context and enable practitioners to tailor their recommendations of mental health services to clients’ needs and preferences.

    Based on these considerations in the context of health promotion, we assumed a preference for using digital self-help services (apps, websites) and psychological support over medical help for dealing with everyday stress.

    Goals of This Study

    The primary aim of this survey study was to assess the determinants of public acceptance of mHealth stress coping apps in an online sample of adults. We expected a positive influence of mHealth-related attitudes and beliefs and a negative influence of skepticism or perceived risks on the acceptance of stress management apps. Furthermore, in direct relation to the primary outcome, we were interested in the potential differences in acceptance and its determinants based on information cues in the description of a sample stress coping app (either with or without scientific claims).

    Another purpose was to assess preferences for mHealth apps compared with other psychological services for dealing with stress to set the main findings in a greater context of the general readiness to use stress prevention services.


    Study Design and Data Collection

    Data for this cross-sectional 54-item survey applying a descriptive predictive research design were collected anonymously at the University of Hagen in Germany between May 25, 2017, and June 16, 2017, using Unipark (Enterprise Feedback Suite survey, version summer 2017, Questback, Germany). All items were only available in the German language. The average completion time was 10 to 15 minutes.

    Participants were informed about the study’s objective and procedure beforehand (eg, health psychological research project in terms of a survey the general acceptance of and preferences for digital solutions for stress reduction) and were required to give an informed consent online (click-to-agree) following the recommendations of the German Psychological Association [85].

    As part of a research agenda with different subprojects, this survey was the pilot study for a follow-up project with an equivalent objective and methodology (public acceptance of certified stress management programs), which has received ethical approval by the recently founded institutional review board/local EC of the new Faculty of Psychology at the University of Hagen, Germany (reference: EA_85_2019).

    To establish a consistent understanding of the type of mHealth under study (stress management app), participants were presented a brief description of a sample or hypothetical app (similar to plain lay product information for consumers on websites or in app stores) before answering acceptance-related questions. The hypothetical app in our study was described as a digital solution that helps consumers cope with stress in everyday life or at work.

    The text for the description of the sample app was adapted and modified from the German website of the digital program StudiCare Stress/Fernstudierende [23] that provided information relevant for study participation in an evidence-based digital stress coping program for distance-learning students in 2017. The idea behind describing a hypothetical app was to avoid advertising a specific app and adding a potentially confounding influence of experience with the use of real apps. The information for both groups was provided in relation to this hypothetical stress coping app (using two vignettes, as shown in Textbox 1). Therefore, participants were aware of being asked to imagine which expectations they would have regarding a fictional app, which was later confirmed by feedback from participants through online contact. The approach of implementing vignettes to describe prototypical or exemplary services in this research field is established and has been applied in several other studies (eg, [43,59,82,86-88]).

    To assess whether scientific claims would contribute to greater acceptance compared with basic information, participants were randomly assigned (50:50 allocation) to one of two information groups that contained the description of the hypothetical app either with or without supplemented scientific claims (Textbox 1).

    Textbox 1. Randomized subsection of the survey with text from a sample stress coping app with or without supplemented information on scientific claims.
    • Both information groups 1 and 2 received the same following basic information (basic vignette):

    “Stress can be triggered by different situations in daily life. If stress becomes a permanent condition, it can seriously endanger one’s physical and mental health. ‘COPE—Computer-gestützte, Online-basierte personalisierte Entspannung [Computer-aided, online-based, personalized relaxation],’ is an app that helps you to better cope with stress, especially in everyday/working life, and to support you flexibly in terms of time.”

    • Scientific claims were only visible for the participants randomized to group 2 (supplemented vignette):

    “Efficacy studies have shown that ‘COPE’ has an excellent effect and reduces stress sensations even after one year of training. There are also reports of fewer depressive symptoms, emotional exhaustion, and anxiety. The app was developed by leading international scientists in the field of stress and e-mental health research.”

    • Finally, both information groups received this instruction:

    “Imagine if you would own this app—what expectations would you have?”

    Participants and Recruitment

    Using convenience sampling, an online sample of German-speaking adults was recruited via social media websites (eg, Facebook) and personal contacts of the study team. Exclusion criteria were age younger than 18 years and a decline or withdrawal of consent. A summary of aggregated findings was offered as compensation for participation. Participants could contact the study team via email in case of having questions or any feedback.

    An a priori power analysis using G*Power [89], version 3.1 (linear multiple regression, F tests, fixed model, R2 increase) resulted in a required sample size of at least N=135 to determine a minimum moderate effect size of f2=0.15 [90] (alpha=.05, power=.85; noncentrality parameter=20.25, critical F11,123=1.87). The effect size was justified based on similar research on e-mental health acceptance [34,46].

    Measures

    Primary Outcome: Determinants of Acceptance of Stress Management Apps

    Measures of the adapted and extended predictive mHealth acceptance study model (Figure 1) are presented in Table 1. Multimedia Appendix 1 (Table S1) contains a full overview of the content and reference studies of UTAUT-related items; we slightly adapted to the context of mHealth for stress coping based on face validity.

    ‎
    Figure 1. Conceptual study model using an adapted and extended UTAUT model for the assessment of acceptance of mHealth apps for stress coping. mHealth: mobile health; UTAUT: Unified Theory of Acceptance and Use of Technology.
    Table 1. Summary of constructs, measures, and scales for the assessment of determinants of acceptance of mobile health for stress coping.
    ConstructMeasureItems, nCronbach alpha
    Dependent variable



    		Acceptance of mHealtha for stress managementUTAUTb: behavioral use intentionc,d,e3.88
    Core UTAUT determinants



    		Performance expectancyUTAUT4.91

    		Effort expectancyUTAUT4.84

    		Social influenceUTAUT3.82

    		Facilitating conditionsUTAUT2.86
    Extended UTAUT determinants



    		Attitudes toward use of technology (positive affect toward using apps)UTAUTf4.90

    		Anxiety toward use of mHealthUTAUT4.83

    		Skepticism and perceived risks (negative attitudes)APOIc,e,g3.67
    Control variables



    		eHealth literacyG-eHEALSe,h8.91

    		Permanent smartphone availabilitySelf-constructed (single item)e,iN/AjN/A

    		Stress due to overload (past 3 months)i,kSCI: stress scalesl,m7.76

    		Stress symptoms (severity, past 6 months)i,lSCI: stress scalesk13.86

    		Positive thinkingk,nSCI: coping scalesk,n4.71

    		Active copingk,nSCI: coping scales3.87

    		Social supportk,nSCI: coping scales4.88

    		Cigarettes and alcohol consumptionk,nSCI: coping scales4.74

    		Demographic/descriptive variablesAge (metric), gender, experience with using a smartphone (yes/no; filter question: frequency), educational level, suffering from a chronic illness or enduring/recurrent complaints for more than 3 weeks (yes/no; filter question: category of illness), experience with use of any kind of mHealth app (yes/no; filter questions: frequency and duration of use), awareness of and experience with internet-based psychotherapy (each with 1 item; yes/no)oN/AN/A

    amHealth: mobile health.

    bUTAUT: Unified Theory of Acceptance and Use of Technology.

    cAdapted to mHealth for stress management/coping (Multimedia Appendix 1, Table S1).

    dGerman Unified Theory of Acceptance and Use of Technology (GUTAUT) measure for Web-based aftercare by Hennemann et al [34], which the test authors developed based on prior work [43-45,91].

    eAssessed on a 5-point Likert scale ranging from 1 (fully disagree) to 5 (fully agree).

    fAdapted from the original UTAUT questionnaire by Venkatesh et al [35], dropped scale in the final UTAUT model.

    gAssessed with three suitable items of the 4-item subscale “skepticism and perception of risks” of the Attitudes toward Psychological Online Interventions questionnaire (APOI) [61].

    hMeasured using the 8-item German eHealth literacy scale (G-eHEALS) [92].

    iBased on prior research [34], we constructed a single-item scale (“Do you feel stressed when you are always available via your mobile phone or smartphone?”).

    jN/A: Not Applicable.

    kWe used two scales (20 items) out of five stress scales (originally 34 items) and further 15 items from four out five coping-scales (originally 20 items) of the German 54-item/10-scale Stress and Coping Inventory (SCI) by Satow [93]. The SCI measures everyday stress perceptions in different areas of life and general coping strategies. It is possible to select scales of interest instead of using the full instrument.

    lThe 7-item-scale SCI (Stress and Coping Inventory)-stress subscale [93] “stress due to overload” related to seven events (eg, item 1: debts or financial issues) concerning the past 3 months was assessed on a 7-point Likert scale ranging from 1 (not overloaded) to 7 (very overloaded).

    mThe 13-items SCI-stress subscale [93] “stress symptoms” covered physical and psychological stress sensations (eg, item 1: “I sleep badly”) concerning the past 6 months was assessed on a five-point Likert scale ranging from 1 (fully disagree) to 5 (fully agree).

    nOf the coping-scale of the SCI [93], we included four of five subscales, which we assessed on a four-point Likert scale ranging from 1 (fully disagree) to 4 (fully agree). “Active coping” was assessed with three items (originally four items). The scale “support in religion” was dismissed due to questionable relevance.

    oWe evaluated the awareness of and experience with internet-based psychotherapy, each with one item (yes/no). These questions were contributed by the first author to the German Socio-Economic Panel Innovation Sample in the fall 2016 wave [94].

    Secondary Outcome: Preference for and Readiness to Use Mobile Health for Stress Coping

    Based on a help-seeking questionnaire [95] and research on “e-preference” [82,87], the readiness or likelihood to use mHealth apps (strength of preferring mHealth apps over other services) was assessed with a self-constructed 10 item-scale on a five-point response scale ranging from 1 (very unlikely) to 5 (very likely). The question was: “If you would feel distressed, how likely would you use the following services?” The service types were as follows: app versus information website, online self-help training, online counseling, self-help literature, psychologist, psychiatrist, general practitioner (GP), prescribed medication, and on-site group training (face-to-face). Cronbach alpha was good (Cronbach alpha=.80).

    Statistical Analysis

    Only completed surveys were entered in the data analysis using SPSS version 24 (IBM Analytics). Based on prior research [34], the mean score of acceptance was categorized as low (1-2.34), moderate (2.35-3.67), or high (3.68-5). The Stress and Coping Inventory (SCI) [93] is not designed as a diagnostic instrument; therefore, no cut-off scores or indexes for stress outcomes are provided.

    Following significant zero-order correlation testing, predictors of acceptance were selected to enter a hierarchical stepwise regression analysis. Based on theoretical considerations (eg, [35,36,53-55]) and empirical research (eg, [34,46,61]), we chose three blocks for the stepwise order for entering of predictors. Block 1 contained sociodemographic, mHealth-related variables, and stress-related variables (control variables); block 2 contained attitudes and beliefs related to mHealth (UTAUT extension regarding the affective component; R2 increase beyond control variables); and block 3 contained the core UTAUT determinants (elaborated beliefs of classic UTAUT; R2 increase after accounting for the influence of attitudes).

    Differences in mean scores for acceptance and its determinants between the two information groups (see Textbox 1) were assessed using t tests or Welch F tests in case of variance inhomogeneity, respectively.

    To assess the preference for mHealth apps for stress coping, differences between mean scores of the likelihood of future use of mHealth apps compared with nine other mental health service types were analyzed using paired t tests. Effect sizes were classified based on Cohen’s criteria [90,96]. The significance level for the hypotheses was alpha<.05.


    Sample Characteristics

    Descriptive data on the 141 participants are presented in Table 2. Multimedia Appendix 2 (Table S2 ) contains an overview of self-reported chronic complaints, which were most often upper or lower back pain with 14.2% (20/141).

    Table 2. Sample characteristics (N=141).
    VariablesParticipants
    Gender, n (%)

    		Female86 (61.0)

    		Male55 (39.0)

    		Other0 (0)
    Age (years)

    		Mean (SD)34.84 (11.09)

    		Median (range)31.00 (19-76)
    Educationlevel, n (%)

    		No certificate of education (pupil or left school without certificate)4 (2.8)

    		Certificate of secondary educationa6 (4.3)

    		General certificate of secondary educationb21 (14.9)

    		Advanced technical college entrance qualificationc6 (4.3)

    		General qualification for university entranced17 (12.1)

    		University degree (bachelor level)42 (29.8)

    		University degree (master level)41 (29.1)

    		Postdoctoral degree (doctorate or habilitation)4 (2.8)
    Stress- and technology-related variables

    		Having chronic complaints, n (%)41 (29.1)

    		Smartphone use (familiarity with use), n (%)136 (96.5)

    		mHealthe app use experience (filter question), n (%)


    		No71 (51.1)


    		Yes69 (48.9)

    		Frequency of mHealth app use, n (%)


    		Daily15 (10.6)


    		Several times a week14 (9.9)


    		Weekly4 (2.8)


    		Several times a month11 (7.8)


    		Once a month or less25 (17.7)

    		Duration of mHealth app use, n (%)


    		More than 2 years37 (26.2)


    		Less than 2 years32 (17.4)

    		Awareness of Internet therapies (filter question), n (%)


    		Yes30 (21.3)


    		No111 (78.7)

    		Prior use of internet therapies, n (%)


    		Yes5 (3.5)


    		No25 (17.7)

    aGerman “Hauptschulabschluss” as basic school qualification.

    bGerman secondary school level I certificate (“Mittlere Reife”).

    cGerman “Fachhochschulreife” or “Fachabitur”.

    dGerman “Allgemeine Hochschulreife” (“Abitur” or A-Level).

    emHealth: mobile health.

    Preliminary Analyses

    Acceptance of using mHealth for stress coping was moderate on average (mean 3.10, SD 1.02; range 1-5). Nearly half of participants could be categorized as reporting a moderate (46.8%, 66/141) acceptance; 29.1% (41/141) reported a low acceptance and 24.1% (34/141) reported a high acceptance.

    Based on significant zero-order correlations with acceptance, 11 of 25 variables were selected for the hierarchical stepwise regression analysis (Textbox 2). The highest correlations with acceptance were found for attitudes toward using mHealth (r=.77) and performance expectancy (r=.64), as shown in Multimedia Appendix 2 (Table S3).

    Textbox 2. Predictors of mobile health (mHealth) acceptance investigated in the stepwise regression analysis.

    The order for the stepwise entering of 11 variables in three blocks was as follows:

    Block 1 (control variables):

    1. mHealth app use (dummy-coded)

    2. Having a chronic illness or enduring complaints (dummy-coded)

    3. Stress symptoms

    4. Stress due to overload

    Block 2 (mHealth-related attitudes/affect):

    5. mHealth-related attitudes

    6. Skepticism/perceived risks

    7. Anxiety toward use

    Block 3 (classic UTAUT (Unified Theory of Acceptance and Use Technology) determinants):

    8. Performance expectancy

    9. Effort expectancy

    10. Social influence

    11. Facilitating conditions

    Main Results

    Primary Outcome: Determinants of the Acceptance of Stress Management Apps

    The significant hierarchical stepwise regression model (Table 3) included 4 of 11 eligible variables from two of three blocks in four steps (F4,136=56.28, P<.001). There was no sign of severe multicolinearity (Durbin-Watson statistic=1.91). The explained variance was 62% in the final step 4 (R2=.62, F1,136=6.26, P=.01, f2=1.63), whereas attitude entered in block 2 (step 3, Table 3) alone added 46% (large effect of f2=0.85) after accounting for the influence of the control variables of block 1 (steps 1 and 2, Table 2). Effect sizes for R2 increase were small to moderate for stress symptoms (f2=0.12) and skepticism/perceived risk (f2=0.16).

    As shown in Table 4, three of four predictors of acceptance remained significant in final step 4: attitude toward using mHealth was the strongest predictor (step 3, beta=0.69, P<.001) followed by skepticism/perceived risks (step 4, beta=−0.14, P=.01) and stress symptoms (step 2, beta=0.12, P=.03). Prior use of mHealth apps became insignificant (beta=0.04, P=.54) after accounting for the influence of skepticism/perceived risks. None of the UTAUT predictors (entered as block 3) added a predictive contribution to acceptance after accounting for the influence of attitudes (entered in block 2). Group differences in acceptance ratings based on mHealth use experience are presented in Textbox S1 of Multimedia Appendix 2.

    Figure 2 shows a summary of the main findings of the primary outcome.

    Table 3. Model summary of the hierarchical stepwise regression analysis on predictors of the acceptance of stress management apps (N=141).
    Model 1aRR2Adjusted R2SEChange in R2Change in F (df1,df2)P value
    Step 1b.32a.10.10.98.1016.18 (1,139)<.001
    Step 2c.38b.14.13.96.046.23 (1,138).01
    Step 3d.78c.61.60.65.46161.04 (1,137)<.001
    Step 4e.79d.62.61.64.026.26 (1,136).01

    aDependent variable: acceptance of mobile health (mHealth; behavioral use intention). Model 1 refers to the main model according to the statistical plan in distinction to post hoc analyses. (Models 2 and 3 as presented in Multimedia Appendix 2).

    bPredictors: (constant), mHealth app use (entered in block 1).

    cPredictors: (constant), mHealth app use, stress symptoms (block 1).

    dPredictors: (constant), mHealth app use, stress symptoms (block 1), attitude toward using mHealth (block 2).

    ePredictors: (constant), mHealth app use, stress symptoms (block 1), attitude toward using mHealth, skepticism/perceived risks (block 2). The UTAUT determinants (entered as block 3) added no further significant predictive contribution and were thus excluded.

    Table 4. Coefficients of the hierarchical stepwise regression analysis (N=141).
    Model 1 and stepaUnstandardized coefficient B (SE)Standardized beta (β)P value95% CI
    Step 1
    (Constant)2.78 (0.12)—b<.0012.55, 3.01
    Use of mHealthc apps (yes)0.66 (0.17)0.32<.0010.34, 0.99
    Step 2
    (Constant)2.13 (0.28)—<.0011.57, 2.69
    Use of mHealth apps (yes)0.59 (0.16)0.29<.0010.26, 0.91
    Stress symptoms0.35 (0.14)0.20.010.07, 0.62
    Step 3
    (Constant)−0.10 (0.26)—.72−0.61, 0.42
    Use of mHealth apps (yes)0.10 (0.12)0.05.42−0.14, 0.33
    Stress symptoms0.18 (0.10)0.10.06−0.01, 0.37
    Attitude toward mHealth0.84 (0.07)0.73<.0010.71, 0.97
    Step 4
    (Constant)0.52 (0.36)—.14−0.18, 1.22
    Use of mHealth apps (yes)0.07 (0.12)0.04.54−0.16, 0.30
    Stress symptoms0.21 (0.09)0.12.030.03, 0.40
    Attitude toward mHealth0.78 (0.07)0.69<.0010.65, 0.92
    Skepticism/perceived risks−0.17 (0.07)-0.14.01−0.31, −0.04

    aDependent variable: acceptance of mHealth (behavioral use intention). Model 1 refers to the main model according to the statistical plan in distinction to post hoc analyses. (Models 2 and 3 as presented in Multimedia Appendix 1).

    bNot applicable.

    cmHealth: mobile health.

    ‎
    Figure 2. Main findings of the stepwise regression model on the determinants of the acceptance of stress management apps. mHealth: mobile health; UTAUT: Unified Theory of Acceptance and Use of Technology.

    Additionally, a post hoc hierarchical analysis with all 11 variables (see Textbox 2) was performed, with the inclusion method instead of the stepwise method for entering the variables. When all 11 predictors (Multimedia Appendix 2, Tables S4 and S5, model 2) were included, the total R2 or explained variance was at 64% and thus marginally higher (2%) than for the study model with four variables or steps (62%, see Table 3). In this overall significant post hoc model (F11,129=20.75, P<.001), the increase of explained variance of 1% (R2=.01) added by the four UTAUT variables in block 3 was not significant (P=.59).

    Another post hoc hierarchical stepwise regression analysis showed the added predictive value of both positive and negative attitude constructs beyond the UTAUT variables. In contrast to the insignificant contribution UTAUT variables and their exclusion from model 1 as block 3 (Table 3), attitudes and skepticism/perceived risks significantly added explained variance (R2 increase=.13) when entered as block 3 (Multimedia Appendix 2, Table S6, model 3) beyond three significant UTAUT variables (performance expectancy, facilitating conditions, and social influence). This post hoc model was significant (F7,133=32.48, P<.001). It included seven variables or steps and explained 1% more total variance (R2=.63) than the study model with four variables or steps (R2=.62, Table 3). The increase of explained variance of the UTAUT variables after accounting for the control variables was 35% (performance expectancy with 28% as step 3, facilitating conditions with 4% and social influence with 3%) and therefore lower than for attitudes alone (46% R2 increase) in the study model (see model 1 in Table 3). With the inclusion of attitudes in step 6, all UTAUT variables became insignificant (P>.05) and remained so in the final step 7 after entering skepticism/perceived risks (Multimedia Appendix 2, Table S7, models 1-3). Table S8 of Multimedia Appendix 2 shows a summary of all three regression models.

    Research Question: Influence of Scientific Claims on Mobile Health Acceptance Ratings

    The t test showed no significant differences in acceptance between participants who read the app description both with (group 1: 70/141, 49.6%; mean 3.37, SD 0.95) and without (group 2: 71/141, 50.4%; mean 3.32, SD 0.86) supplemented scientific claims (t139=0.31, P=.80; Cohen d=0.06). Furthermore, there were no significant differences between the two information groups regarding the four UTAUT determinants, attitudes, skepticism/perceived risks, and anxiety (all P>.05).

    Secondary Outcome: Preference for and Readiness to Use Mobile Health for Stress Coping

    As shown in Table 5, mHealth apps were preferred over medication, a psychiatrist, online counseling, online self-help training, and face-to-face group courses. No differences in the likelihood of future use were identified between mHealth apps versus self-help literature, psychologists, and GPs. Only health information websites were preferred over mHealth apps (P<.001).

    Table 5. Preference for mobile health (mHealth): the likelihood of future use of mHealth apps for stress-related purposes in comparison with other mental health service types (N=141). Dependent variable: likelihood of future use in case of emotional distress (range: 1=very unlikely to 5=very likely).
    Service typeMean (SD)Mean difference versus mHealth apps (SD)SE of mean difference95% CIt (df)P value
    mHealth apps2.67 (1.26)—a————
    Health information website3.07 (1.29)−0.40 (1.12)0.09−0.58, −0.21−4.21 (140)<.001
    Online self-help training (ie, computer- and internet-based)2.45 (1.26)0.22 (1.18)0.100.02, 0.422.21 (140).03
    Online counseling2.20 (1.17)0.48 (1.11)0.090.29, 0.665.10 (140)<.001
    Self-help literature2.73 (1.40)−0.06 (1.60)0.13−0.31, 0.19−0.45 (140).65
    Psychologist (therapist or counselor)2.67 (1.31)0.01 (1.75)0.15−0.28, 0.300.05 (140).96
    Psychiatrist2.13 (1.07)0.54 (1.60)0.130.27, 0.814.01 (140)<.001
    General practitioner2.67 (1.27)0.00 (1.66)0.14−0.28, 0.280.00 (140)>.99
    Medication-assisted treatment1.90 (1.10)0.77 (1.43)0.120.54, 1.016.41 (140)<.001
    On-site group course (face-to-face)2.16 (1.18)0.51 (1.33)0.110.29, 0.734.54 (140)<.001

    aNot applicable.


    Principal Results

    This study explored the determinants of public acceptance of stress management apps before their integration into statutory health services and the general preferences for mHealth apps compared to other mental health services.

    This study indicates a moderate public acceptance of stress management apps in an online sample of German-speaking adults. Considering the relatively early stage of the adoption of e-mental health services in German health care [97], acceptance of mHealth apps probably varies largely based on individual experiences and target populations. The sampling method in this study and the focus on health promotion instead of treatment or aftercare need to be considered as potential reasons for higher acceptance of e-mental health services compared with research in more heterogeneous patient populations [34,44,45] and similar earlier online surveys with nonclinical samples [33,82,83].

    Determinants of the Acceptance of Stress Management Apps

    As a main finding, we identified positive affect or attitude toward using mHealth, skepticism or perceived risk of mHealth (negative cognitive attitudes), and the severity of stress symptoms as significant determinants of the acceptance of mHealth for stress coping. The high magnitude of explained variance of 62% according to Cohen criteria [90,96] is equivalent to other studies on the acceptance of e-mental health services focusing on classic UTAUT determinants, which did not consider attitudes (eg, [34]).

    Our main results substantiate research evidence on the key role of attitudes in shaping eHealth and mHealth service acceptance in particular [58,63,98]. Post hoc analysis showed that attitudes and skepticism still added explained variance beyond the control variables and UTAUT determinants, whereas the more elaborated beliefs of UTAUT determinants failed to add a predictive contribution beyond attitudes. This finding can be interpreted in the context of other research on attitude formation and behavioral intentions, which indicated that different levels of elaboration likelihood among end users should be taken into account in early stages of mHealth adoption [99]. For instance, Chen et al [99] showed a moderating effect of privacy concerns on the influence of both perceived usefulness (central route) and trust (peripheral route) on the continuance intention of mHealth apps in a developing market. In our study, the uncertain motivation (low stress levels) and insufficient abilities or knowledge to evaluate mHealth-related questions (nearly half of our sample did not have any mHealth experience) could have yielded a lower elaboration likelihood (peripheral route) reflected by rather undecided views (moderate ratings, tendency toward the middle) and skepticism. In other words, positive attitudes in the sense of an early affective form of opinion formation (regardless of specific knowledge or experience) may be a more relevant initial precondition of acceptance than elaborated cognitive beliefs on usefulness or usability.

    Attitudes toward using mobile phones for mental health purposes can differ regarding specific design features or functions [64]; therefore, upcoming surveys could investigate relationships between attitudes, beliefs, and acceptance with respect to distinct components and functionalities of available stress management apps. Among other components, perceived value by users, visual design, usability, the potential to improve user engagement, tailoring and personalization, gratification, and information and content have been suggested as key drivers of the real-world uptake and user retention in eHealth and mHealth interventions (eg, [100-103]). These cannot be evaluated with the predictive acceptance model we applied. Nonetheless, our results on the major role of attitudes in mHealth acceptance provide implications on aspects to consider in practice. For instance, future efforts aiming at improving the adoption of e-mental health services could put emphasis on the pleasant or joyful aspects of using apps. For example, the yet not fully utilized potential of gamification for supporting the acquisition of behavior change techniques could be promoted as a clear benefit of mobile versus Web-based stress management programs [104].

    Effective interventions to increase user retention in mental health services usually involve a comprehensive approach targeting attitudes, knowledge, needs, and barriers [105]. As a relevant barrier, our findings confirmed the negative influence of skepticism and perceptions for stress management apps, which complements findings from clinical settings (eg, [61]) and a recent meta-analysis [63], showing that both attitudes and perceived risks are determinants of the behavioral intention to use mHealth apps. Trustworthiness, data security, and privacy are main issues raised by consumers [102] and health professionals [106]. It is important to address concerns and misconceptions with acceptance-facilitating interventions, as effectively demonstrated by RCTs in different German health care settings (eg, [43,45]). Fostering positive attitudes toward mHealth would also be important in the context of the workplace, which is a common source of stress and stress-related disorders [107]. In accordance with social influences on the acceptance of health services, research indicates a higher interest in using apps for workplace health promotion among leaders with positive attitudes [9]. Therefore, health professionals and other multipliers and stakeholders should be involved in the dissemination of mental health apps.

    Furthermore, personal relevance and mental health needs may affect the acceptance of mHealth apps; therefore, public health initiatives on mHealth could highlight the benefits of preventive innovations that tend to diffuse very slowly (delay of reward after adoption), as proposed by Rogers [108]. Although our results correspond to findings on the relationship between stress and interest in using mHealth for stress management [75], it is important to mention that self-reported stress severity in our sample was low to moderate. Considering that the main target group for primary prevention and health promotion in Germany is healthy adults [109], such apps may have the highest potential to reach populations that are already rather privileged in terms of having the necessary resources and knowledge to efficiently use mental health services, as was the case in our sample. The challenge is to increase the uptake of self-help tools in populations that are traditionally hard to reach and among those with mental health needs who are unlikely to use psychological services [32,62].

    Considering the positive influence of personal experience (with mobile phones [110] and/or mHealth [69,100]) on the acceptability or uptake of mHealth apps, our findings support the suggestion to increase the availability of expert-guided possibilities for consumers or patients to try quality-approved apps. This would require making mental health professionals familiar with such services since prior research has shown personal use experience as a driver for use in their practice [111].

    Influence of Information Cues in an Exemplary App Description

    Beyond the identification of determinants of acceptance, to our knowledge, our study was one of the first to explore the influence of scientific claims on consumer acceptance of a hypothetical app. Keeping the elaboration likelihood model in mind, the fact that we found no difference to the group receiving basic information only is somewhat consistent with the major role of attitudes in our study, the very low awareness of e-mental health treatments, and the moderate level of mHealth experience. However, it is also possible that vague scientific claims were not persuasive for a selective, overall well-educated sample of mobile phone users, considering that the reputation or credibility of the source of information cues were shown as a relevant factor in the formation of attitudes and use intentions of e-mental health and mHealth services (eg, [59,99]). Overall, the main issues may be that the text we used for both vignettes was created based on modified information from a website on a digital stress coping program for university students (academic audience) and the variances between both vignettes (content and length) were too small to find a significant difference.

    Accordingly, quality of content and validity of information have been identified as important domains for the real-world uptake of mHealth apps [102]. However, the evidence base for the quality and efficacy of most mental health apps is limited [112], even among those mental health apps that claim to be effective [113]. Importantly, a study by Schueller et al [69] showed that perceived usefulness of mental health apps rated by consumers is not necessarily equivalent to what the research evidence suggests. The influence of perceived credibility by users could be another option for surveys on the acceptance of e-mental health studies [88,114].

    Preference for and Readiness to Use Mobile Health for Stress Coping

    Another aim was to assess the preference of mHealth for stress coping. We identified preferences for mHealth apps over face-to-face group training, Web-based self-help programs, medication, and consulting psychiatrists. This points to an additional potential of digital or app-based courses versus traditional face-to-face group courses in primary prevention in reaching further populations that are not severely stressed and are familiar with using mobile phones. Wahbeh et al [115] showed a preference for a Web-based over group format for mindfulness interventions. That study and our findings show that online recruitment should be considered as a potential reason for a higher preference of e-mental health services compared to more diverse samples in health care. However, the lower interest in using Web-based than app-delivered self-help programs contrasts with findings from an Australian study by Batterham and Calear [62]. A possible explanation is that our study was conducted in an environment where eHealth or mHealth availability in German routine care—and thus adoption—is still in an earlier stage than in other European countries such as Sweden (eg, [116-118]). In contrast, mHealth apps can be downloaded by everyone and used outside of health care. Hence, we assume that our online sample of German-speaking participants was overall less familiar because German-speaking countries (ie, Germany, Austria and some regions in Switzerland) less often have openly accessible Web-based psychological programs available than publicly available mHealth apps. In comparison, countries such as Australia (eg, [119]) have such Web-based programs already established and available for the public. This issue is reflected by the very low awareness of e-mental health therapies (21%) in our sample and in other online surveys [33,59,74] and a German panel survey (SOEP-IS innovative modules, internet-based psychotherapy, [94] written communication with Apolinário-Hagen J, unpublished raw data, 2016). Another reason might be that, for health promotion purposes, app-delivered programs may be seen as more convenient to use in daily life [83].

    Contrary to prior research considering clinically relevant mental health issues (eg, [83,86]), we found no difference in the readiness to use mHealth apps in comparison with services provided by psychologists and self-help literature for stress-related purposes. Potentially, participants in our study viewed stress as a usual, rather mild issue that can be better addressed through different ways of self-help (with or without psychological support) than with clinical interventions or through medical support.

    Consequently, the highest likelihood of use was found for health information websites for stress-related purposes, as already shown in other German studies [34,84]. A possible reason is that health information websites are self-help options with the lowest barrier to access because they can be retrieved publicly with several devices (eg, desktop computer, tablet, mobile phone), are usually free of cost and do not require downloading another app and/or any registration. In this sense, “Dr. Google” enables tailored advice for mental health purposes on demand, which may explain their high acceptance [86]. Likewise, a qualitative study [120] showed that employees characterized an optimal e-mental health intervention as a website with interactive elements that involve temporarily unlimited access to state-of-the-art information and advice.

    There are several initiatives providing guidance on e-mental health and mHealth quality criteria and certification (eg, [27,103]), but such information should be connected with certified services and brought to the awareness of more consumers and health professionals. Information websites in the sense of a low-threshold public health service could provide evidence-based information on stress prevention, stress screening tools, and access to mHealth apps. Psychoeducational information could be used to improve e-mental health literacy, which would help improve help-seeking intentions and behavior [121] or could be integrated into a stepped care prevention approach [122]. Textbox 3 shows the main findings and implications of our study.

    Textbox 3. Summary of key findings and novel insights.

    What this study shows that was already known:

    • Attitudes are a key determinant of behavioral intention to use mobile health (mHealth)
    • The low rates of awareness and use of electronic mental (e-mental) health treatments in our sample are in line with findings from other online surveys and panel surveys from Germany
    • Skepticism and perception of risks (eg, privacy) are important barriers for e-mental health and mHealth acceptance
    • Perceived stress needs further consideration in mHealth acceptance models
    • Preference is for information websites over (less accessible) mental health services for stress prevention, including mHealth apps and face-to-face group interventions

    Which novel implications and insights this study adds to the research evidence:

    • Moderate and slightly higher acceptance of mental health apps and e-mental health services compared with other online surveys with community samples and studies with patient populations (implication: scope on health promotion and stress prevention rather than on treatment with disorder-specific focus or clinical wording for e-mental health programs)
    • Unified Theory of Acceptance and Use Technology (UTAUT) studies on acceptance of mental health apps should consider attitudes and more elaborated beliefs (implication: adaptations of predictive acceptance models across stages of diffusion of mHealth adoption)
    • Preference for mHealth over Web-based programs and state-of-the-art group stress management programs (implication: outline specific benefits of mHealth for stress management to use in daily life, but also educate about the potentials of Web-based and face-to-face courses)
    • Comparable preferences for mHealth and traditional psychological services (implication: provide a set of choices tailored to individual needs and preferences)

    Limitations

    The exploratory nature of our study has several limitations to be considered when interpreting the findings.

    First, the online recruitment and sample size limit the generalizability of our results; therefore, we cannot draw conclusions for the general German population. Also, the focus of this study on the public acceptance of stress coping apps and health promotion, and the necessary slight adaptations of some scales to the mHealth context, impede the comparability with most studies in this field that targeted e-mental health treatments [33,82,83] or specific mental disorders, such as depression [43,123,124]. In addition, due to the absence of norm values, we classified acceptance as moderate based on prior work [34]; therefore, it is debatable whether the acceptance was really moderate (external validity).

    Second, the subjective stress level in this sample was relatively low, with a mean sum score of 26.63 (SD 7.71) compared with the norm sample in the SCI test manual (mean 34.07, SD 7.96, possible range 13-65). Also, the selective sample of 96% mobile phone users of mostly young and higher educated adults (more than 60% with academic degree) may further explain the moderate acceptance of mHealth. A next step could be to compare the acceptance of e-mental health services in samples with different stress levels. To overcome the self-selection bias, recruitment in primary care with referrals from GPs could be an option.

    Third, the lack of a passive control condition makes it impossible to state whether the information about an exemplary app may have biased the acceptance ratings toward more positive ratings (eg, [59]). Future studies should control for the impact of information about real, well-known apps on acceptance using a pre-post design and a manipulation or intervention check before implementation. We have also applied a similar, but more elaborated, approach with text-based information on two existing evidence-based programs for stress coping (StudiCare for students and GET-ON for employees) in winter 2018 and found that the majority did not know these programs [88]. Therefore, it is debatable whether it would have made a difference to name an existing program in our sample. Potentially, as previously outlined, it would be another option to test our hypotheses with freely available commercial apps with the highest download rates, although this would impede the assessment of the general acceptance of mHealth apps.

    Fourth, formulating expectations on a fictional app was likely to be difficult compared with rating an app that is known to the participants or has been used already, as the feedback from our participants suggested. Furthermore, of 230 participants who started the survey, 89 dropped out (half of them after the first UTAUT questions). In addition, the differences between both vignettes were a few abstract sentences including vague information on the effectiveness of a hypothetical app. Since the text of both vignettes was adapted from a website that recruited distance-learning students for a RCT on the effectiveness of an evidence-based digital stress intervention, the content may have been rather academic or too abstract for the broader population targeted in our study. Therefore, this experimental approach may have been too artificial (eg, questionable content validity) and be the main reason for finding no group differences.

    Fifth, the readiness to use mHealth was assessed without standardized information on service types, similar to “real-world” help-seeking situations. In addition, we did not ask for what the participants understood under each service. Finally, similar to most UTAUT studies [49,125], we used a cross-sectional study design with acceptance as the dependent variable. This cannot address the well-known problem of the intention-behavior gap (eg, [126]), in which attitude strength related to personal relevance and experience has been suggested as a factor to bridge this gap in technology use [127]. Hence, our findings should be seen as preliminary and interpreted with caution.

    Conclusions

    Attitudes may play a pivotal role in shaping public acceptance toward stress management apps in an early stage of the adoption of e-mental health services. Concerns regarding the use of apps for stress management purposes could be addressed through health information websites and public health campaigns that can help increase knowledge about the benefits of stress prevention and information on mental health services.

    Acknowledgments

    We thank Simone Kocur, Maya Fliegel, Nadine Breumair, and Michael Stamminger for their valuable support in planning, organizing, recruiting of participants and collecting data for the Web-based survey under the supervision of the first author at the University of Hagen. We also thank Olenka Dworakowski, University of Zurich, for proofreading, and her highly constructive comments on the manuscript. The first author has changed her affiliation from the University of Hagen, where the study was conducted, to the University of Düsseldorf during the review process of this paper.

    Conflicts of Interest

    None declared.

    Multimedia Appendix 1

    Methods supplementary data.

    PDF File (Adobe PDF File), 736 KB
    Multimedia Appendix 2

    Results supplementary data.

    PDF File (Adobe PDF File), 1084 KB
    1. Schneiderman N, Ironson G, Siegel SD. Stress and health: psychological, behavioral, and biological determinants. Annu Rev Clin Psychol. 2005;1:607-628. [FREE Full text] [CrossRef] [Medline]
    2. Yaribeygi H, Panahi Y, Sahraei H, Johnston TP, Sahebkar A. The impact of stress on body function: a review. EXCLI J. 2017;16:1057-1072. [FREE Full text] [CrossRef] [Medline]
    3. Gradus JL. Prevalence and prognosis of stress disorders: a review of the epidemiologic literature. Clin Epidemiol. 2017;9:251-260. [FREE Full text] [CrossRef] [Medline]
    4. Hassard J, Teoh KR, Visockaite G, Dewe P, Cox T. The cost of work-related stress to society: a systematic review. J Occup Health Psychol. Jan 2018;23(1):1-17. [CrossRef] [Medline]
    5. Lazarus RS, Folkman S. Stress, Appraisal, And Coping. New York. Springer Publishing Company; 1984.
    6. Richardson KM, Rothstein HR. Effects of occupational stress management intervention programs: a meta-analysis. J Occup Health Psychol. Jan 2008;13(1):69-93. [CrossRef] [Medline]
    7. Ebert DD, Cuijpers P, Muñoz RF, Baumeister H. Prevention of mental health disorders using internet- and mobile-based interventions: a narrative review and recommendations for future research. Front Psychiatry. 2017;8:116. [FREE Full text] [CrossRef] [Medline]
    8. Bregenzer A, Wagner-Hartl V, Jiménez P. Who uses apps in health promotion? A target group analysis of leaders. Health Informatics J. Sep 2019;25(3):1038-1052. [CrossRef] [Medline]
    9. Dunkl A, Jiménez P. Using smartphone-based applications (apps) in workplace health promotion: the opinion of German and Austrian leaders. Health Informatics J. Mar 2017;23(1):44-55. [CrossRef] [Medline]
    10. Jimenez P, Bregenzer A. Integration of eHealth tools in the process of workplace health promotion: proposal for design and implementation. J Med Internet Res. Feb 23, 2018;20(2):e65. [FREE Full text] [CrossRef] [Medline]
    11. Lehr D, Geraedts A, Persson Asplund R, Khadjesari Z, Heber E, de Bloom J, et al. Occupational e-Mental health: current approaches and promising perspectives for promoting mental health in workers. In: Wiencke M, Cacace M, Fischer S, editors. Healthy At Work: Interdisciplinary Perspectives. Heidelberg. Springer; 2016:257-281.
    12. Lehr D, Boß L. Occupational e-Mental Health - eine Übersicht zu Ansätzen, Evidenz und Implementierung. In: Badura B, Ducki A, Schröder H, editors. Fehlzeiten Report 2019. Digitalisierung - gesundes Arbeiten ermöglichen. Berlin. Springer; 2019:155-178.
    13. Stratton E, Lampit A, Choi I, Calvo RA, Harvey SB, Glozier N. Effectiveness of eHealth interventions for reducing mental health conditions in employees: a systematic review and meta-analysis. PLoS One. 2017;12(12):e0189904. [FREE Full text] [CrossRef] [Medline]
    14. Firth J, Torous J, Nicholas J, Carney R, Rosenbaum S, Sarris J. Can smartphone mental health interventions reduce symptoms of anxiety? A meta-analysis of randomized controlled trials. J Affect Disord. Aug 15, 2017;218:15-22. [FREE Full text] [CrossRef] [Medline]
    15. Firth J, Torous J, Nicholas J, Carney R, Pratap A, Rosenbaum S, et al. The efficacy of smartphone-based mental health interventions for depressive symptoms: a meta-analysis of randomized controlled trials. World Psychiatry. Oct 2017;16(3):287-298. [FREE Full text] [CrossRef] [Medline]
    16. Heber E, Ebert DD, Lehr D, Cuijpers P, Berking M, Nobis S, et al. The benefit of web- and computer-based interventions for stress: a systematic review and meta-analysis. J Med Internet Res. Feb 17, 2017;19(2):e32. [FREE Full text] [CrossRef] [Medline]
    17. Ebert DD, Heber E, Berking M, Riper H, Cuijpers P, Funk B, et al. Self-guided internet-based and mobile-based stress management for employees: results of a randomised controlled trial. Occup Environ Med. May 2016;73(5):315-323. [CrossRef] [Medline]
    18. Ebert DD, Lehr D, Heber E, Riper H, Cuijpers P, Berking M. Internet- and mobile-based stress management for employees with adherence-focused guidance: efficacy and mechanism of change. Scand J Work Environ Health. Sep 01, 2016;42(5):382-394. [FREE Full text] [CrossRef] [Medline]
    19. Ebert DD, Lehr D, Smit F, Zarski A, Riper H, Heber E, et al. Efficacy and cost-effectiveness of minimal guided and unguided internet-based mobile supported stress-management in employees with occupational stress: a three-armed randomised controlled trial. BMC Public Health. Aug 07, 2014;14:807. [FREE Full text] [CrossRef] [Medline]
    20. Heber E, Lehr D, Ebert DD, Berking M, Riper H. Web-based and mobile stress management intervention for employees: a randomized controlled trial. J Med Internet Res. Jan 27, 2016;18(1):e21. [FREE Full text] [CrossRef] [Medline]
    21. Fleischmann R, Harrer M, Zarski A, Baumeister H, Lehr D, Ebert D. Patients' experiences in a guided Internet- and app-based stress intervention for college students: a qualitative study. Internet Interv. Jun 2018;12:130-140. [FREE Full text] [CrossRef] [Medline]
    22. Harrer M, Adam SH, Fleischmann RJ, Baumeister H, Auerbach R, Bruffaerts R, et al. Effectiveness of an internet- and app-based intervention for college students with elevated stress: randomized controlled trial. J Med Internet Res. Apr 23, 2018;20(4):e136. [FREE Full text] [CrossRef] [Medline]
    23. Harrer M, Apolinário-Hagen J, Fritsche L, Drüge M, Krings L, Beck K, et al. Internet- and app-based stress intervention for distance-learning students with depressive symptoms: protocol of a randomized controlled trial. Front Psychiatry. May 21, 2019;10:361. [FREE Full text] [CrossRef] [Medline]
    24. Christmann CA, Hoffmann A, Bleser G. Stress management apps with regard to emotion-focused coping and behavior change techniques: a content analysis. JMIR Mhealth Uhealth. Feb 23, 2017;5(2):e22. [FREE Full text] [CrossRef] [Medline]
    25. Torous J, Andersson G, Bertagnoli A, Christensen H, Cuijpers P, Firth J, et al. Towards a consensus around standards for smartphone apps and digital mental health. World Psychiatry. Feb 2019;18(1):97-98. [FREE Full text] [CrossRef] [Medline]
    26. Byambasuren O, Sanders S, Beller E, Glasziou P. Prescribable mHealth apps identified from an overview of systematic reviews. NPJ Digit Med. 2018;1:12. [FREE Full text] [CrossRef] [Medline]
    27. Zentrale Prüfstelle Prävention, Deutschland [Central Audit Body Prevention, Germany]. Information für Anbieterinnen und Anbieter von IKT-basierten Selbstlernprogrammen nach § 20 SGB V [Information for providers of ICT-based self-learn programs according to § 20 SGB V]. 2019. URL: https://www.zentrale-pruefstelle-praevention.de/admin/download.php?dl=pruefung_online_angebote [accessed 2019-06-26]
    28. Federal Ministry of Health, Germany. Referentenentwurf des Bundesministeriums für Gesundheit, Entwurf eines Gesetzes für eine bessere Versorgung durch Digitalisierung und Innovation (Digitale Versorgung-Gesetz-DVG) [Draft bill of the German Federal Ministry of Health on Digital Healthcare Law]. May 15, 2019. URL: https:/​/www.​bundesgesundheitsministerium.de/​fileadmin/​Dateien/​3_Downloads/​Gesetze_und_Verordnungen/​GuV/​D/​Digitale_Versorgung_Gesetz_-_RefEntwurf.​pdf [accessed 2019-06-06] [WebCite Cache]
    29. Kern A, Hong V, Song J, Lipson SK, Eisenberg D. Mental health apps in a college setting: openness, usage, and attitudes. Mhealth. 2018;4:20. [FREE Full text] [CrossRef] [Medline]
    30. Torous J, Nicholas J, Larsen ME, Firth J, Christensen H. Clinical review of user engagement with mental health smartphone apps: evidence, theory and improvements. Evid Based Ment Health. Aug 2018;21(3):116-119. [CrossRef] [Medline]
    31. Ritterband LM, Thorndike FP, Cox DJ, Kovatchev BP, Gonder-Frederick LA. A behavior change model for internet interventions. Ann Behav Med. Aug 2009;38(1):18-27. [CrossRef] [Medline]
    32. March S, Day J, Ritchie G, Rowe A, Gough J, Hall T, et al. Attitudes toward e-Mental health services in a community sample of adults: online survey. J Med Internet Res. Feb 19, 2018;20(2):e59. [FREE Full text] [CrossRef] [Medline]
    33. Apolinário-Hagen J, Harrer M, Kählke F, Fritsche L, Salewski C, Ebert DD. Public attitudes toward guided internet-based therapies: web-based survey study. JMIR Ment Health. May 15, 2018;5(2):e10735. [FREE Full text] [CrossRef] [Medline]
    34. Hennemann S, Beutel ME, Zwerenz R. Drivers and barriers to acceptance of web-based aftercare of patients in inpatient routine care: a cross-sectional survey. J Med Internet Res. Dec 23, 2016;18(12):e337. [FREE Full text] [CrossRef] [Medline]
    35. Venkatesh V, Morris MG, Davis GB, Davis FD. User acceptance of information technology: toward a unified view. MIS Quarterly. 2003;27(3):425-478. [CrossRef]
    36. Davis FD, Bagozzi RP, Warshaw PR. User acceptance of computer technology: a comparison of two theoretical models. Manage Sci. Aug 1989;35(8):982-1003. [CrossRef]
    37. Holden RJ, Karsh B. The technology acceptance model: its past and its future in health care. J Biomed Inform. Feb 2010;43(1):159-172. [FREE Full text] [CrossRef] [Medline]
    38. Lai P. The literature review of technology adoption models and theories for the novelty technology. JISTEM. Apr 30, 2017;14(1):21-38. [CrossRef]
    39. Morrison LG, Geraghty AW, Lloyd S, Goodman N, Michaelides DT, Hargood C, et al. Comparing usage of a web and app stress management intervention: an observational study. Internet Interv. Jun 2018;12:74-82. [FREE Full text] [CrossRef] [Medline]
    40. Lin J, Ebert DD, Lehr D, Berking M, Baumeister H. [Internet based cognitive behavioral interventions: state of the art and implementation possibilities in rehabilitation]. Rehabilitation (Stuttg). Jun 2013;52(3):155-163. [CrossRef] [Medline]
    41. Apolinário-Hagen J, Menzel M, Hennemann S, Salewski C. Acceptance of mobile health apps for disease management among people with multiple sclerosis: web-based survey study. JMIR Form Res. Dec 12, 2018;2(2):e11977. [FREE Full text] [CrossRef] [Medline]
    42. Breil B, Kremer L, Hennemann S, Apolinário-Hagen J. Acceptance of mHealth apps for self-management among people with hypertension. Stud Health Technol Inform. Sep 03, 2019;267:282-288. [CrossRef] [Medline]
    43. Ebert DD, Berking M, Cuijpers P, Lehr D, Pörtner M, Baumeister H. Increasing the acceptance of internet-based mental health interventions in primary care patients with depressive symptoms. A randomized controlled trial. J Affect Disord. May 01, 2015;176:9-17. [CrossRef] [Medline]
    44. Baumeister H, Nowoczin L, Lin J, Seifferth H, Seufert J, Laubner K, et al. Impact of an acceptance facilitating intervention on diabetes patients' acceptance of Internet-based interventions for depression: a randomized controlled trial. Diabetes Res Clin Pract. Jul 2014;105(1):30-39. [CrossRef] [Medline]
    45. Baumeister H, Seifferth H, Lin J, Nowoczin L, Lüking M, Ebert D. Impact of an acceptance facilitating intervention on patients' acceptance of internet-based pain interventions: a randomized controlled trial. Clin J Pain. Jun 2015;31(6):528-535. [CrossRef] [Medline]
    46. Hennemann S, Witthöft M, Bethge M, Spanier K, Beutel ME, Zwerenz R. Acceptance and barriers to access of occupational e-mental health: cross-sectional findings from a health-risk population of employees. Int Arch Occup Environ Health. Apr 2018;91(3):305-316. [CrossRef] [Medline]
    47. Taiwo A, Downe AG. The theory of user acceptance and use of technology (UTAUT): a meta-analytic review of empirical findings. J Theor Appl Inform Technol. 2013;49(1):48-58. [FREE Full text]
    48. Dwivedi YK, Rana NP, Jeyaraj A, Clement M, Williams MD. Re-examining the Unified Theory of Acceptance and Use of Technology (UTAUT): towards a revised theoretical model. Inf Syst Front. Jun 8, 2017;21(3):719-734. [CrossRef]
    49. Williams MD, Rana NP, Dwivedi YK. The Unified Theory of Acceptance and Use of Technology (UTAUT): a literature review. J Enterp Info Manage. Apr 13, 2015;28(3):443-488. [CrossRef]
    50. Hoque R, Sorwar G. Understanding factors influencing the adoption of mHealth by the elderly: an extension of the UTAUT model. Int J Med Inform. May 2017;101:75-84. [CrossRef] [Medline]
    51. Apolinário-Hagen J, Menzel M, Hennemann S, Salewski C. Acceptance of mobile health apps for disease management among people with multiple sclerosis: web-based survey study. JMIR Form Res. Dec 12, 2018;2(2):e11977. [FREE Full text] [CrossRef] [Medline]
    52. Hennemann S, Beutel ME, Zwerenz R. Ready for eHealth? Health professionals' acceptance and adoption of ehealth interventions in inpatient routine care. J Health Commun. Mar 2017;22(3):274-284. [CrossRef] [Medline]
    53. Ajzen I. Nature and operation of attitudes. Annu Rev Psychol. 2001;52:27-58. [CrossRef] [Medline]
    54. Fishbein M, Ajzen I. Belief, Attitude, Intention, And Behavior: An Introduction To Theory And Research. Reading, MA. Addison-Wesley Pub Co; 1975.
    55. Ajzen I. The theory of planned behavior. Organ Behav Hum Dec. Dec 1991;50(2):179-211. [CrossRef]
    56. Schulte D. Patients' outcome expectancies and their impression of suitability as predictors of treatment outcome. Psychother Res. Jul 2008;18(4):481-494. [CrossRef] [Medline]
    57. Sheeran P, Maki A, Montanaro E, Avishai-Yitshak A, Bryan A, Klein WM, et al. The impact of changing attitudes, norms, and self-efficacy on health-related intentions and behavior: a meta-analysis. Health Psychol. Nov 2016;35(11):1178-1188. [CrossRef] [Medline]
    58. Kim J, Park H. Development of a health information technology acceptance model using consumers' health behavior intention. J Med Internet Res. Oct 01, 2012;14(5):e133. [FREE Full text] [CrossRef] [Medline]
    59. Apolinário-Hagen J, Fritsche L, Bierhals C, Salewski C. Improving attitudes toward e-mental health services in the general population via psychoeducational information material: A randomized controlled trial. Internet Interv. Jun 2018;12:141-149. [FREE Full text] [CrossRef] [Medline]
    60. Schröder J, Berger T, Meyer B, Lutz W, Hautzinger M, Späth C, et al. Attitudes towards internet interventions among psychotherapists and individuals with mild to moderate depression symptoms. Cogn Ther Res. Apr 22, 2017;41(5):745-756. [CrossRef]
    61. Schröder J, Sautier L, Kriston L, Berger T, Meyer B, Späth C, et al. Development of a questionnaire measuring Attitudes towards Psychological Online Interventions-the APOI. J Affect Disord. Nov 15, 2015;187:136-141. [CrossRef] [Medline]
    62. Batterham PJ, Calear AL. Preferences for internet-based mental health interventions in an adult online sample: findings from an online community survey. JMIR Ment Health. Jun 30, 2017;4(2):e26. [FREE Full text] [CrossRef] [Medline]
    63. Zhao Y, Ni Q, Zhou R. What factors influence the mobile health service adoption? A meta-analysis and the moderating role of age. Int J Inform Manage. Dec 2018;43:342-350. [CrossRef]
    64. Proudfoot J, Parker G, Hadzi Pavlovic D, Manicavasagar V, Adler E, Whitton A. Community attitudes to the appropriation of mobile phones for monitoring and managing depression, anxiety, and stress. J Med Internet Res. Dec 19, 2010;12(5):e64. [FREE Full text] [CrossRef] [Medline]
    65. Wallin EE, Mattsson S, Olsson EM. The preference for internet-based psychological interventions by individuals without past or current use of mental health treatment delivered online: a survey study with mixed-methods analysis. JMIR Ment Health. Jun 14, 2016;3(2):e25. [FREE Full text] [CrossRef] [Medline]
    66. Deng Z, Hong Z, Ren C, Zhang W, Xiang F. What predicts patients' adoption intention toward mHealth services in China: empirical study. JMIR Mhealth Uhealth. Aug 29, 2018;6(8):e172. [FREE Full text] [CrossRef] [Medline]
    67. Peng W, Kanthawala S, Yuan S, Hussain SA. A qualitative study of user perceptions of mobile health apps. BMC Public Health. Nov 14, 2016;16(1):1158. [FREE Full text] [CrossRef] [Medline]
    68. Lin TT, Bautista JR. Understanding the relationships between mHealth Apps' characteristics, trialability, and mHealth literacy. J Health Commun. Apr 2017;22(4):346-354. [CrossRef] [Medline]
    69. Schueller SM, Neary M, O'Loughlin K, Adkins EC. Discovery of and interest in health apps among those with mental health needs: survey and focus group study. J Med Internet Res. Jun 11, 2018;20(6):e10141. [FREE Full text] [CrossRef] [Medline]
    70. Rahman MS, Hanifi S, Khatun F, Iqbal M, Rasheed S, Ahmed T, et al. Knowledge, attitudes and intention regarding mHealth in generation Y: evidence from a population based cross sectional study in Chakaria, Bangladesh. BMJ Open. Nov 15, 2017;7(11):e016217. [FREE Full text] [CrossRef] [Medline]
    71. Carroll JK, Moorhead A, Bond R, LeBlanc WG, Petrella RJ, Fiscella K. Who uses mobile phone health apps and does use matter? A secondary data analytics approach. J Med Internet Res. Apr 19, 2017;19(4):e125. [FREE Full text] [CrossRef] [Medline]
    72. Apolinário-Hagen J, Kemper J, Stürmer C. Public Acceptability of e-Mental health treatment services for psychological problems: a scoping review. JMIR Ment Health. Apr 03, 2017;4(2):e10. [FREE Full text] [CrossRef] [Medline]
    73. Crisp DA, Griffiths KM. Participating in online mental health interventions: who is most likely to sign up and why? Depress Res Treat. 2014;2014:790457. [FREE Full text] [CrossRef] [Medline]
    74. Apolinário-Hagen J, Vehreschild V, Alkoudmani RM. Current views and perspectives on e-Mental health: an exploratory survey study for understanding public attitudes toward internet-based psychotherapy in Germany. JMIR Ment Health. Feb 23, 2017;4(1):e8. [FREE Full text] [CrossRef] [Medline]
    75. Ervasti M, Kallio J, Määttänen I, Mäntyjärvi J, Jokela M. Influence of personality and differences in stress processing among Finnish students on interest to use a mobile stress management app: survey study. JMIR Ment Health. May 13, 2019;6(5):e10039. [FREE Full text] [CrossRef] [Medline]
    76. Reinecke L, Aufenanger S, Beutel ME, Dreier M, Quiring O, Stark B, et al. Digital stress over the life span: the effects of communication load and internet multitasking on perceived stress and psychological health impairments in a German probability sample. Media Psychol. Mar 21, 2016;20(1):90-115. [CrossRef]
    77. Khalili-Mahani N, Smyrnova A, Kakinami L. To each stress its own screen: a cross-sectional survey of the patterns of stress and various screen uses in relation to self-admitted screen addiction. J Med Internet Res. Apr 02, 2019;21(4):e11485. [FREE Full text] [CrossRef] [Medline]
    78. Huang H, Bashir M. Users' adoption of mental health apps: examining the impact of information cues. JMIR Mhealth Uhealth. Jun 28, 2017;5(6):e83. [FREE Full text] [CrossRef] [Medline]
    79. Healey BJ, Griffiths KM, Bennett K. The effect of programme testimonials on registrations for an online cognitive behaviour therapy intervention: a randomised trial. Digit Health. 2017;3:2055207617729937. [FREE Full text] [CrossRef] [Medline]
    80. Williams R, Farquharson L, Palmer L, Bassett P, Clarke J, Clark DM, et al. Patient preference in psychological treatment and associations with self-reported outcome: national cross-sectional survey in England and Wales. BMC Psychiatry. Jan 15, 2016;16:4. [FREE Full text] [CrossRef] [Medline]
    81. Paslakis G, Fischer-Jacobs J, Pape L, Schiffer M, Gertges R, Tegtbur U, et al. Assessment of use and preferences regarding internet-based health care delivery: cross-sectional questionnaire study. J Med Internet Res. May 16, 2019;21(5):e12416. [FREE Full text] [CrossRef] [Medline]
    82. Klein B, Cook S. Preferences for e-mental health services amongst an online Australian sample? EJAP. May 25, 2010;6(1). [CrossRef]
    83. Musiat P, Goldstone P, Tarrier N. Understanding the acceptability of e-mental health--attitudes and expectations towards computerised self-help treatments for mental health problems. BMC Psychiatry. Apr 11, 2014;14:109. [FREE Full text] [CrossRef] [Medline]
    84. Wildauer M, Apolinário-Hagen J. Untersuchung der Wirksamkeit von psychoedukativem Informationsmaterial zur Förderung der Akzeptanz von Gesundheits-Apps und E-Mental-Health-Angeboten zur Stressbewältigung im Fernstudium. e-beratungsjournal.net-Fachzeitschrift für Onlineberatung und computervermittelte Kommunikation. 2018;14(2):38-58.
    85. Deutsche Gesellschaft für Psychologie. Ethisches Handeln in der psychologischen Forschung. Göttingen. Hogrefe Verlag; 2016.
    86. Eichenberg C, Wolters C, Brähler E. The internet as a mental health advisor in Germany--results of a national survey. PLoS One. 2013;8(11):e79206. [FREE Full text] [CrossRef] [Medline]
    87. Casey LM, Joy A, Clough BA. The impact of information on attitudes toward e-mental health services. Cyberpsychol Behav Soc Netw. Aug 2013;16(8):593-598. [CrossRef] [Medline]
    88. Wopperer J, Apolinário-Hagen J, Wals F, Harrer M, Kemper J, Salewski C, et al. Exploring the usefulness of testimonials as a tool to improve the acceptance of e-mental health interventions among university students: preliminary results of a pilot RCT (poster presentation). 2019. Presented at: ESRII 2019; September 5, 2019; Copenhagen, Denmark. URL: https://www.esrii2019.org/programme
    89. Faul F, Erdfelder E, Lang A, Buchner A. G*Power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav Res Methods. May 2007;39(2):175-191. [Medline]
    90. Cohen J. Statistical Power Analysis For The Behavioral Sciences. 2nd Edition. Hillsdale, NJ. Routledge; 1988.
    91. Liu L, Miguel Cruz A, Rios Rincon A, Buttar V, Ranson Q, Goertzen D. What factors determine therapists' acceptance of new technologies for rehabilitation–a study using the Unified Theory of Acceptance and Use of Technology (UTAUT). Disabil Rehabil. 2015;37(5):447-455. [CrossRef] [Medline]
    92. Soellner R, Huber S, Reder M. The eoncept of eHealth literacy and its measurement. J Media Psychol. Jan 2014;26(1):29-38. [CrossRef]
    93. Satow L. Stress and Coping Inventory (SCI). 2012. URL: https://www.drsatow.de/tests/stress-und-coping-inventar/ [accessed 2019-10-02]
    94. Goebel J, Liebig S, Richter D, Schröder C, Schupp J, Wenzig K. SOEP-Innovationssample (SOEP-IS), Daten der Jahre 1998-2016. Berlin. DIW; 2018.
    95. Wilson C, Deane F, Ciarrochi J, Rickwood D. Measuring help-seeking intentions: properties of the general help seeking questionnaire. Can J Couns. 2005;39(1):15-28. [FREE Full text] [CrossRef]
    96. Cohen J. A power primer. Psychol Bull. 1992;112(1):155-159. [CrossRef]
    97. Topooco N, Riper H, Araya R, Berking M, Brunn M, Chevreul K, et al. E-COMPARED Consortium. Attitudes towards digital treatment for depression: a European stakeholder survey. Internet Interv. Jun 2017;8:1-9. [FREE Full text] [CrossRef] [Medline]
    98. Harst L, Lantzsch H, Scheibe M. Theories predicting end-user acceptance of telemedicine use: systematic review. J Med Internet Res. May 21, 2019;21(5):e13117. [FREE Full text] [CrossRef] [Medline]
    99. Chen Y, Yang L, Zhang M, Yang J. Central or peripheral? Cognition elaboration cues' effect on users' continuance intention of mobile health applications in the developing markets. Int J Med Inform. Aug 2018;116:33-45. [CrossRef] [Medline]
    100. Baumel A, Kane JM. Examining predictors of real-world user engagement with self-guided eHealth interventions: analysis of mobile apps and websites using a novel dataset. J Med Internet Res. Dec 14, 2018;20(12):e11491. [FREE Full text] [CrossRef] [Medline]
    101. Couper MP, Alexander GL, Zhang N, Little RJ, Maddy N, Nowak MA, et al. Engagement and retention: measuring breadth and depth of participant use of an online intervention. J Med Internet Res. Nov 18, 2010;12(4):e52. [FREE Full text] [CrossRef] [Medline]
    102. Vo V, Auroy L, Sarradon-Eck A. Patients' perceptions of mHealth apps: meta-ethnographic review of qualitative studies. JMIR Mhealth Uhealth. Jul 10, 2019;7(7):e13817. [FREE Full text] [CrossRef] [Medline]
    103. Nouri R, R Niakan Kalhori S, Ghazisaeedi M, Marchand G, Yasini M. Criteria for assessing the quality of mHealth apps: a systematic review. J Am Med Inform Assoc. Aug 01, 2018;25(8):1089-1098. [CrossRef] [Medline]
    104. Hoffmann A, Christmann CA, Bleser G. Gamification in stress management apps: a critical app review. JMIR Serious Games. Jun 07, 2017;5(2):e13. [FREE Full text] [CrossRef] [Medline]
    105. Greene JA, Bina R, Gum AM. Interventions to increase retention in mental health services: a systematic review. Psychiatr Serv. May 01, 2016;67(5):485-495. [CrossRef] [Medline]
    106. Safi S, Thiessen T, Schmailzl KJ. Acceptance and resistance of new digital technologies in medicine: qualitative study. JMIR Res Protoc. Dec 04, 2018;7(12):e11072. [FREE Full text] [CrossRef] [Medline]
    107. Stansfeld S, Candy B. Psychosocial work environment and mental health-a meta-analytic review. Scand J Work Environ Health. Dec 2006;32(6):443-462. [FREE Full text] [CrossRef] [Medline]
    108. Rogers E. Diffusion of Innovations. 5th Edition. New York. Free Press; 2003.
    109. Apitz R, Winter SF. [Potentials of and approaches to prevention. Current developments in Germany]. Internist (Berl). Feb 2004;45(2):139-147. [CrossRef] [Medline]
    110. Payne HE, Lister C, West JH, Bernhardt JM. Behavioral functionality of mobile apps in health interventions: a systematic review of the literature. JMIR Mhealth Uhealth. Feb 26, 2015;3(1):e20. [FREE Full text] [CrossRef] [Medline]
    111. van der Vaart R, Atema V, Evers AW. Guided online self-management interventions in primary care: a survey on use, facilitators, and barriers. BMC Fam Pract. Mar 09, 2016;17:27. [FREE Full text] [CrossRef] [Medline]
    112. Chandrashekar P. Do mental health mobile apps work: evidence and recommendations for designing high-efficacy mental health mobile apps. Mhealth. 2018;4:6. [FREE Full text] [CrossRef] [Medline]
    113. Larsen ME, Huckvale K, Nicholas J, Torous J, Birrell L, Li E, et al. Using science to sell apps: evaluation of mental health app store quality claims. NPJ Digit Med. 2019;2:18. [FREE Full text] [CrossRef] [Medline]
    114. Apolinário-Hagen J, Wopperer J, Wals F, Harrer M, Ebert DD. User testimonials to improve attitudes toward digital stress coping interventions among university students: preliminary results of a pilot RCT. 2019. Presented at: 1st Conference of the Norwegian Society for Research on Internet Interventions (NORSII); May 14, 2019; Bergen, Norway.
    115. Wahbeh H, Svalina MN, Oken BS. Group, one-on-one, or internet? Preferences for mindfulness meditation delivery format and their predictors. Open Med J. 2014;1:66-74. [FREE Full text] [CrossRef] [Medline]
    116. Kemmeren LL, van Schaik A, Smit JH, Ruwaard J, Rocha A, Henriques M, et al. Unraveling the black box: exploring usage patterns of a blended treatment for depression in a multicenter study. JMIR Ment Health. Jul 25, 2019;6(7):e12707. [FREE Full text] [CrossRef] [Medline]
    117. Titov N, Dear B, Nielssen O, Staples L, Hadjistavropoulos H, Nugent M, et al. ICBT in routine care: a descriptive analysis of successful clinics in five countries. Internet Interv. Sep 2018;13:108-115. [FREE Full text] [CrossRef] [Medline]
    118. Hedman E, Ljótsson B, Kaldo V, Hesser H, El Alaoui S, Kraepelien M, et al. Effectiveness of Internet-based cognitive behaviour therapy for depression in routine psychiatric care. J Affect Disord. Feb 2014;155:49-58. [CrossRef] [Medline]
    119. Titov N, Dear BF, Staples LG, Bennett-Levy J, Klein B, Rapee RM, et al. MindSpot clinic: an accessible, efficient, and effective online treatment service for anxiety and depression. Psychiatr Serv. Oct 2015;66(10):1043-1050. [CrossRef] [Medline]
    120. Carolan S, de Visser RO. Employees' perspectives on the facilitators and barriers to engaging with digital mental health interventions in the workplace: qualitative study. JMIR Ment Health. Jan 19, 2018;5(1):e8. [FREE Full text] [CrossRef] [Medline]
    121. Brijnath B, Protheroe J, Mahtani KR, Antoniades J. Do web-based mental health literacy interventions improve the mental health literacy of adult consumers? Results from a systematic review. J Med Internet Res. Jun 20, 2016;18(6):e165. [FREE Full text] [CrossRef] [Medline]
    122. Ho FY, Yeung W, Ng TH, Chan CS. The efficacy and cost-effectiveness of stepped care prevention and treatment for depressive and/or anxiety disorders: a systematic review and meta-analysis. Sci Rep. Jul 05, 2016;6:29281. [FREE Full text] [CrossRef] [Medline]
    123. Rost T, Stein J, Löbner M, Kersting A, Luck-Sikorski C, Riedel-Heller SG. User acceptance of computerized cognitive behavioral therapy for depression: systematic review. J Med Internet Res. Sep 13, 2017;19(9):e309. [FREE Full text] [CrossRef] [Medline]
    124. Dockweiler C, Kupitz A, Palmdorf S, Hornberg C. [Online therapy for depressive disorders: an acceptance-based analysis from the perspective of therapists]. Nervenarzt. Jun 04, 2019. [CrossRef] [Medline]
    125. Khechine H, Lakhal S, Ndjambou P. A meta-analysis of the UTAUT model: eleven years later. Can J Adm Sci. Jun 06, 2016;33(2):138-152. [CrossRef]
    126. Gollwitzer P, Sheeran P. Implementation intentions and goal achievement: a meta-analysis of effects and processes. Adv Exp Soc Psychol. 2006;38:69-119. [CrossRef]
    127. Bhattacherjee A, Sanford C. The intention–behaviour gap in technology usage: the moderating role of attitude strength. Behav Inform Technol. Jul 2009;28(4):389-401. [CrossRef]

    ‎
    GP: general practitioner
    mHealth: mobile health
    RCT: randomized controlled trial
    SCI: Stress and Coping Inventory
    UTAUT: Unified Theory of Acceptance and Use Technology

    Edited by J Torous, G Eysenbach; submitted 05.07.19; peer-reviewed by P Klainin-Yobas, N Khalili-Mahani, C Reis, H Devan, S Pezaro, P Jimenez, B Greer; comments to author 24.07.19; revised version received 12.09.19; accepted 11.10.19; published 07.11.19.

    Copyright

    ©Jennifer Apolinário-Hagen, Severin Hennemann, Lara Fritsche, Marie Drüge, Bernhard Breil. Originally published in JMIR Mental Health (http://mental.jmir.org), 07.11.2019.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Mental Health, is properly cited. The complete bibliographic information, a link to the original publication on http://mental.jmir.org/, as well as this copyright and license information must be included.