This paper is in the following e-collection/theme issue:

Users' and Patients' Needs for Mental Health Services (378) Innovations in Mental Health Systems (370) Anxiety and Stress Disorders (1002)

Published on in Vol 5, No 2 (2018): Apr-Jun

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/10735, first published .
Public Attitudes Toward Guided Internet-Based Therapies: Web-Based Survey Study

Public Attitudes Toward Guided Internet-Based Therapies: Web-Based Survey Study

Public Attitudes Toward Guided Internet-Based Therapies: Web-Based Survey Study

Authors of this article:

Jennifer Apolinário-Hagen1 Author Orcid Image ;   Mathias Harrer2 Author Orcid Image ;   Fanny Kählke2 Author Orcid Image ;   Lara Fritsche1 Author Orcid Image ;   Christel Salewski1 Author Orcid Image ;   David Daniel Ebert2 Author Orcid Image
Article Authors Cited by (71) Tweetations (94) Metrics

    Original Paper

    1Institute of Psychology, Department of Health Psychology, University of Hagen, Hagen, Germany

    2Department of Clinical Psychology and Psychotherapy, Alexander-University Erlangen-Nuremberg, Erlangen, Germany

    Corresponding Author:

    Jennifer Apolinário-Hagen, Dipl-Psych, PhD

    Institute of Psychology

    Department of Health Psychology

    University of Hagen

    Universitätsstraße 33

    Hagen, 58097

    Germany

    Phone: 49 2331 987 2272

    Fax:49 2331 987 1047

    Email: jennifer.apolinario-hagen@fernuni-hagen.de


    Background: Internet interventions have been proposed to improve the accessibility and use of evidence-based psychological treatments. However, little is known about attitudes toward such treatments, which can be an important barrier to their use.

    Objective: This study aimed to (1) determine attitudes toward guided internet interventions, (2) assess its acceptability compared with other internet-based formats, and (3) explore predictors of acceptance.

    Methods: A convenience-sample Web-based survey (N=646) assessed attitudes toward guided internet therapies (ie, perceived usefulness and helpfulness, and advantage relative to face-to-face therapy), preferences for delivery modes (ie, e-preference: guided internet interventions, unguided internet interventions, or videoconferencing psychotherapy), and potential predictors of attitudes and preferences: sociodemographics, help-seeking–related variables, attachment style, and perceived stress.

    Results: Although most participants perceived internet interventions as useful or helpful (426/646, 65.9%), a few indicated their advantage relative to face-to-face therapy (56/646, 8.7%). Most participants preferred guided internet interventions (252/646, 39.0%) over videoconferencing psychotherapy (147/646, 22.8%), unguided internet interventions (124/646, 19.2%), and not using internet interventions (121/646, 18.8%; missing data: 1/646, 0.2%). Attachment avoidance and stress were related to e-preference (all P<.05). Moreover, preference for therapist-guided internet interventions was higher for individuals who were aware of internet-based treatment (χ26=12.8; P=.046).

    Conclusions: Participants assessed therapist-guided internet interventions as helpful, but not equivalent to face-to-face therapies. The vast majority (523/646, 81.0%) of the participants were potentially willing to use internet-based approaches. In lieu of providing patients with only one specific low-intensity treatment, implementation concepts should offer several options, including guided internet interventions, but not limited to them. Conversely, our results also indicate that efforts should focus on increasing public knowledge about internet interventions, including information about their effectiveness, to promote acceptance and uptake.

    JMIR Ment Health 2018;5(2):e10735

    doi:10.2196/10735

    Keywords

    mental health; eHealth; attitude to computers; patient preference; cognitive therapy; acceptability of health care; stress, psychological; object attachment 


    Background

    With 12-month prevalences ranging across countries from 9.8% to 19.1% [1], mental health disorders are widespread. Mental health disorders constitute one of the leading causes of disability [2] and are associated with low quality of life, increased risk of developing chronic physical conditions and related mortality [3,4], and an immense economic burden leading to productivity losses and substantial societal costs [5,6]. Yet fewer than half of individuals affected by mental health disorders are detected and receive professional treatment [7]. Untreated mental illness is estimated to account for 13% of the total global burden of disease [8]. Structural barriers such as limited access to treatment have been named as a reason for the insufficient uptake of individuals with mental health disorders [7]. Additionally, attitudinal barriers, such as personal stigma [9] or preferring to solve problems on one’s own, may be decisive in explaining insufficient treatment rates [10].

    Using the internet as a delivery mode for self-help treatments has thus been discussed as a promising chance to inform the dissemination of professional treatment, as electronic mental health services (eMHSs) allow for mass deliverance of anonymous, low-threshold treatment options that may reach individuals for whom traditional face-to-face approaches are not an option [11,12]. In recent years, a large number of randomized controlled trials have shown that internet interventions can effectively treat various mental health disorders, such as depression [13,14], anxiety [15-17], insomnia [18], alcohol use disorder [19], comorbid mental health problems in chronic somatic diseases [20,21], and psychosomatic disorders [22]. The largest evidence base exists for the effectiveness of guided interventions [22,23], and research has shown that such approaches can be effective when delivered under routine care conditions [24-26]. In addition to guided or unguided internet interventions, videoconferencing psychotherapy (VCP) is considered as a further option to overcome regional barriers for a variety of patient populations [27]. However, the poor adoption of eMHSs worldwide indicates that low acceptability and intention to use might constitute a barrier in reaching the full potential of internet-based approaches (cf, [28-32]).

    Public Acceptance Indicators for E-Mental Health Services

    Determinants of intentions to use eMHSs are not well understood [28,29]. Yet there are indicators commonly discussed as influential for help-seeking intentions and acceptance of eMHSs, such as attitudes [33-35] and “e-preferences” [28].

    Attitudes

    Positive public attitudes could be an indicator of acceptance and adoption of internet interventions. Generally, attitudes can be characterized as an aggregate of subjective assessments about an object, ranging, for example, from harmful to helpful [36].

    The theory of planned behavior [37] proposes that attitudes, among other factors, shape individuals’ intentions, which then lead to a certain behavior. Individuals’ personal expectancies are assumed to shape such attitudes and to thereby influence behavioral intentions [37]. In accordance with the unified theory of acceptance and use of technology [38], performance expectancy (ie, how useful an individual perceives an intervention to be for reaching a specific goal) might thus play an important role in the adoption and acceptance of internet interventions [39,40] and provide a guideline in overcoming the limitations in the acceptability of eMHSs [34,39,41,42].

    E-Preference

    Technology acceptance of eMHS can be operationalized by intentions to use these services [39], which can be affected by the individual preference for a specific delivery mode [28]. Treatment preference means to choose a treatment in favor of an alternative option. Research evidence suggests that considering patients’ preferences for a psychological treatment is associated with improved clinical outcomes [43]. However, little is known about preferences for specific delivery modes, such as therapist-guided treatment, unguided internet interventions, and VCP, and their impact on the willingness to use eMHSs. Some studies identified a preference for traditional (face-to-face) over internet-based treatment (eg, [28,29,31,44-47]) and for therapist-guided over unguided eMHSs (eg, [28,29,33]).

    Determinants of Attitudes Toward and Preferences for Internet-Based Therapies

    Potential determinants of attitudes and preferences for eMHS include sociodemographics such as age, region [45], or professional background [48-50]. Regarding health-related and help-seeking variables, using the internet for mental health information [45,51], previous use of eMHSs [31], a history of mental illness and help-seeking experience such as undergoing psychotherapy [29], knowledge about eMHSs or awareness of electronic therapies (“e-awareness”) [33,41,42], personality traits [28], and perceived stress [42,52] have been reported as predictors. Regarding the role of symptom severity, a recent study [12] illustrated a help-seeking behavior paradox in students, where individuals’ readiness to seek help from face-to-face services declined with increased perceived stress. In contrast, the same study also demonstrated a positive association between distress and seeking help online.

    Attachment style may be a further predictor of eMHS uptake [52], since attachment theory [53] has been applied to predict intentions to use face-to-face help services (eg, [54]). Based on early infant-caregiver interactions, relatively stable internal working models of the self and others in terms of mental representations of close relationships are built. These implicit expectations regarding self-efficacy and reliance on significant others in stressful situations are manifested in adulthood [53]. Adult attachment style can play a role in preferences and attitudes toward seeking help in the context of emotionally relevant relationships, such as in mental health care [52,54]. While a secure attachment style (low attachment anxiety and avoidance; ie, positive models of the self and others) is associated with functional coping strategies, insecure attachment styles were identified as a global vulnerability factor for mental health [55,56] and are related to altered stress responses, symptom reporting, and less use of health care resources [57,58]. However, the role of attachment styles in the readiness to use eMHSs remains unclear [52], especially concerning different delivery modes of internet interventions that vary in the degree of human support.

    Taken together, the identification of determinants of attitudes toward and preferences for eMHSs is at an early stage [34]. This study addressed this research gap.

    Objective

    The purpose of this study was to (1) explore attitudes toward guided internet interventions and to (2) assess the acceptability of guided internet interventions compared with other formats of internet-based delivery (ie, e-preference: unguided self-help interventions and VCP vs not using eMHSs in case of emotional problems). Another goal was to (3) identify determinants of the public acceptability of eMHSs by exploring associations between attitudes toward guided internet interventions, preferences for a specific delivery mode of eMHSs, and participant characteristics (ie, sociodemographics, help-seeking–related variables, attachment style, and perceived stress).


    Study Design and Participants

    We conducted a cross-sectional Web-based survey using a quasi-experimental study design. Data were collected between November 2015 and June 2016 using Unipark software (Enterprise Feedback Suite survey, version 10.6, Questback). We obtained a convenience sample (N=646) via the virtual laboratory and Moodle of the University of Hagen, Hagen, Germany, and social media websites (Facebook, Facebook Inc; and Xing, Xing AG). No ethical approval was required. Inclusion criteria were self-reported age over 18 years and written informed consent. Psychology students could receive credits for their participation.

    Measures

    Attitudes Toward Guided Internet Interventions

    We used a modified 17-item version of an e-therapy attitudes measure (ETAM) [42] containing statements about typically cited benefits of internet therapy and its comparability with face-to-face psychotherapy, as well as subjective beliefs (eg, about data security). Participants were asked to rate their agreement with each statement on a 5-point rating scale ranging from 0 (“strongly disagree”) to 4 (“strongly agree”). To ensure comparability, participants were instructed to rate items regarding guided internet interventions (see Textbox 1). Based on previous exploratory factor analysis, we identified two factors, which we termed perceived usefulness and helpfulness, and advantage relative to face-to-face therapy. Multimedia Appendix 1 provides detailed information about the exploratory factor analysis. For classification of attitudes, we used predefined cutoffs in line with previous work using the ETAM [41,42]: mean scores <1.5 (a median score of 0 or 1) were defined as negative, values between 1.5 and 2.49 (median score of 2) as neutral, and scores ≥2.5 (median scores of 3 or 4) as positive attitudes toward guided internet interventions. Cronbach alpha was excellent in this survey (alpha=.92).

    Preference for Internet Interventions (E-Preference)

    We operationalized preference (see Textbox 1) by assessing help-seeking intentions for different delivery modes of internet interventions (e-preference, options 1-3) in contrast to the disinclination to use internet interventions in case of emotional problems (non–e-preference, option 4).

    Determinants of Attitudes Toward and Preferences for Internet Interventions
    Sociodemographics and Help-Seeking–Related Variables

    Sociodemographic characteristics were sex, age, marital status, native language, region, country of residence, educational level, employment status, and work in health care or the social sector.

    Textbox 1. Preference for internet therapies illustrated by case vignettes. Options 1-3: internet therapies differentiated by the degree of professional support. The instruction was adapted and translated from German.

    Internet-based psychotherapies include a broad spectrum of types of treatments for relatively well treatable, mild to moderate forms of depression and anxiety disorders. The following 3 examples illustrate distinct types of internet therapies:

    1. Unguided internet-based self-help treatment programs: The patient follows a Web-based, structured self-help treatment program, including problem-specific tasks, exercises, and tutorials, via mobile phone or computer for several weeks without individual feedback.
    2. Therapist-guided internet-based self-help treatment programs: The patient follows a Web-based, structured self-help treatment program with therapist guidance. Communication with the therapist consists of text-based feedback via email or chat provided on demand.
    3. Videoconferencing psychotherapy: The communication is mediated by a webcam. As with face-to-face psychotherapy, the treatment takes place within specified sessions with immediate verbal and nonverbal feedback.

    In case of emotional problems, which of the described interventions would you most likely personally use? Please choose the internet therapy form you prefer most based on your current expectations.

    1. Unguided internet-based self-help treatment
    2. Therapist-guided internet-based self-help treatment
    3. Videoconferencing psychotherapy
    4. I would not use any internet therapy at all

    We investigated participants’ awareness of electronic therapy (e-awareness) by asking them whether they had ever heard or read about internet-based therapies. We also asked participants to assess their subjective health status, experiences with online counseling or conventional inpatient or outpatient psychotherapy, and their frequency of seeking health information online.

    Attachment Style

    We considered attachment style as a potential determinant of the acceptance of guided internet interventions, since previous work indicated a connection between individual needs for interpersonal proximity versus distance in case of emotional problems and help-seeking intentions (cf, [54]). We measured adult attachment using the Experiences in Close Relationships-Relationship Structures questionnaire [59] 9-item global version to assess attachment anxiety and avoidance [60]. Participants were asked to rate the extent to which they believed each statement best described their feelings about close relationships on a 7-point Likert scale ranging from 1 (“strongly disagree”) to 7 (“strongly agree”). The intercorrelation of dimensions (ρ(646)=.272, P<.001) was comparable with other studies [61]. Cronbach alpha was good for attachment avoidance (alpha=.88) and excellent for attachment anxiety (alpha=.91).

    Assessment of Stress Perceptions
    Current Stress Level

    We used a visual analog scale [62] to assess current perceived stress level on a scale with 2 end points: 0 (“not at all”) and 10 (“maximum”).

    Perceived Stress (Past Month)

    To measure stress perceptions during the past 4 weeks, the we used the Perceived Stress Questionnaire 20-item short version (PSQ-20) [63]. Participants were asked to indicate how often statements applied to themselves on a 4-point Likert scale ranging from 1 (“almost never”) to 4 (“usually”). Cronbach alpha was poor (alpha=.55).

    Procedure

    After entering the Web-based survey, participants were provided with the study information and consent form. Next, they were asked sociodemographic and help-seeking questions. Then, preference for specific forms of internet interventions, attitudes toward guided internet interventions, stress perceptions, and attachment style were assessed. The average completion time ranged from 10 to 15 minutes.

    Statistical Analysis

    We considered only completed surveys for data analyses. To ensure data quality, data validation checks were performed independently by 2 researchers prior to the statistical analyses. Descriptive analyses were used to classify attitudes toward and preference for a specific delivery mode of internet therapies. Regarding predictors of attitudes, we explored differences in variance (analysis of variance) in attitudes (overall mean score) based on sociodemographics, health variables, and e-preference. Due to the scarce theory base and questionable multivariate normal distribution, we used Spearman rank correlation (ρ coefficient) instead of multiple regression analysis to identify associations between attitudes, attachment style, and stress perceptions. Moreover, we explored differences using 1-way analysis of variance and Pearson chi-square tests in preferences based on the same predictors as for attitudes. Pairwise comparisons (post hoc tests) to examine mean differences (Mdiff) were conducted using Bonferroni adjustments in case of variance homogeneity (Levene test, P>.05) or Dunnett C test in case of variance heterogeneity. Statistical tests for significance (2-tailed hypotheses with alpha level of .05) were performed using IBM SPSS version 24 (IBM Analytics).


    Descriptive Analyses

    Of 1300 respondents who accessed the platform, 778 provided informed consent, with 1 person declining and thus being excluded. We consequently analyzed the responses of 646 respondents who completed the survey. Tables 1 and 2 summarize the sample’s characteristics.

    Attitudes Toward Guided Internet Interventions

    Analysis of attitudes toward guided internet interventions indicated an overall moderate acceptance (ETAM overall mean score, Table 3). As Table 4 shows, descriptive analyses further showed that, although most participants (426/646, 65.9%) perceived internet approaches as useful or helpful, only a few participants (56/646, 8.7%) also indicated that guided internet-based approaches had a relative advantage over or comparability with conventional face-to-face approaches.

    Overall, participants agreed with 7 of the 17 positive statements about internet interventions made in ETAM items (Table 3). Those positively attributed beliefs about internet therapies involved modernity (item 1), compatibility with everyday life (item 3), accessibility (item 5), coverage of costs by health insurance providers (item 6), helpfulness (item 12), anonymity (item 14), and a chance to get help earlier (item 15).

    Furthermore, 7 of the 17 items were classified as negative. Participants rather disagreed with the possibility of replacing face-to-face therapies (item 2), the equivalence of delivery modes (item 4), comparability of effectiveness (item 7) and therapeutic relationships (item 8), preference for internet therapy over face-to-face therapy (item 11), data security (item 13) and suitability for diverse populations (item 17).

    Participants classified 3 items as neutral or undecided. These statements addressed internet therapies as an alternative to face-to-face therapies (item 9), willingness to use internet therapies (item 10), and the occurrence of misunderstandings (item 16).

    Preference for Different Delivery Modes

    As Figure 1 shows, most respondents indicated that they preferred guided internet interventions (252/646, 39.0%) over VCP (147/646, 22.8%), unguided internet interventions (124/646, 19.2%), or no Web-based treatment (121/646, 18.8%; missing data: 1/646, 0.2%). Thus, the vast majority were “e-preferers” (523/646, 81.0%).

    Table 1. Sociodemographic characteristics (N=646).
    VariablesData
    Age (years)

    		Mean (SD)31.18 (10.08)

    		Range (median)18-64 (29)
    Sex, n (%)

    		Female493 (76.3)

    		Male147 (22.8)

    		Other3 (0.5)

    		Missing data3 (0.5)
    Native language, n (%)

    		German568 (87.9)

    		Bilingual including German40 (6.2)

    		Other than German37 (5.7)

    		Missing data1 (0.2)
    Marital status, n (%)

    		Single327 (50.6)

    		Married or living in a close relationship288 (44.6)

    		Divorced or living separated26 (4.0)

    		Other3 (0.5)

    		Missing data2 (0.3)
    Employment statusa, n (%)

    		Employed177 (27.4)

    		University student, part-time or full-time345 (53.4)

    		Employee in trainingb14 (2.2)

    		Self-employed46 (7.1)

    		Unemployed11 (1.7)

    		Parental leave15 (2.3)

    		Retired8 (1.2)

    		Current work incapability3 (0.5)

    		Other employment (commentary section)27 (4.2)
    Employment in health care or social sector, n (%)

    		No493 (76.3)

    		Yes, in a therapeutic field57 (8.8)

    		Yes, in a nontherapeutic field96 (14.9)
    Education level attained, n (%)

    		No school certificate3 (0.5)

    		Basic school qualificationc10 (1.5)

    		Secondary school (Mittlere Reife)d57 (8.8)

    		German Abitur or Fachabiture329 (50.9)

    		University degree (Bachelor level)86 (13.3)

    		University degree (Masters level)143 (22.1)

    		Postgraduate or postdoctoral degree9 (1.4)

    		Other degree (commentary section)9 (1.4)
    Country of residence, n (%)

    		Germany585 (90.6)

    		Other countryf60 (9.3)

    		Missing data1 (0.2)
    Region of residence, n (%)

    		Village or small town, with <5000 inhabitants100 (15.5)

    		Provincial town, with 5000-19,999 inhabitants99 (15.3)

    		Medium-sized city, with 20,000-100,000 inhabitants124 (19.2)

    		Big city or metropolis, with >100,000 habitants322 (49.8)

    		Missing data1 (0.2)

    aThe main employment was requested (if respondents had multiple roles, they were asked to choose in which role they spent most of their working time at the time of participation in this survey).

    bGerman dual system: occupational trainee or pupil (secondary education).

    cBasic school qualification with usually 9 school years of education in Germany (German Hauptschule).

    dSecondary school (German Mittlere Reife), or 10 years of education in Germany.

    eGerman Abitur or Fachabitur with 12-13 years of education in Germany. This education is necessary to get access to a college or university.

    fMost of the subgroup of non-Germany residents indicated they lived in Austria (35/646, 5.5%).

    Determinants of Attitudes

    Sociodemographic Variables

    Attitudes and age were significantly and positively correlated (ρ(643)=.079, P=.045), with older participants displaying more favorable attitudes than younger participants toward internet-based guided self-help. Unemployed participants (mean 2.30, SD 0.69) showed more positive attitudes than employees in training (mean 1.37, SD 0.37, Mdiff 0.93, SE 0.288, 95% CI 0.003-1.85). We found no significant differences in attitudes for sex, marital status, region, native language, education level, or work in the health care or social sector (all P>.05).

    Help-Seeking–Related Variables

    Frequency of seeking health information online was associated with differences in internet intervention attitudes (F4,641=6.675; P<.001, ηp2=.040), with more positive attitudes reported by individuals who sought information weekly (mean 2.01, SD 0.61, Mdiff –0.36, SE 0.112, 95% CI –0.67 to –0.04), several times a month (mean 2.11, SD 0.78, Mdiff –0.45, SE 0.097, 95% CI –0.72 to –0.18), or rarely (mean 1.91, SD=0.59, Mdiff –0.26, SE 0.080, 95% CI –0.48 to –0.04; all P<.05) than by those who never did (mean 1.66, SD 0.59). This was not the case for participants who reported seeking information daily (mean 1.46, SD 0.99); both groups (never, daily) expressed rather negative attitudes. There was a significant positive correlation between attitudes toward guided internet interventions and perceived stress on the PSQ-20 (ρ(643)=.092, P=.020). No significant differences in attitudes were identified for any of the other help-seeking–related variables (eg, e-awareness, attachment style, all P>.05).

    Determinants of E-Preference

    Sociodemographic Variables

    We found no significant differences in e-preferences (preference for guided or unguided internet interventions and VCP) based on age, sex, marital status, region, native language, education level, employment status, or work in the health care or social sector (all P>.05).

    Help-Seeking–Related Variables

    E-awareness significantly predicted a preference for different forms of internet-based therapy (χ26=12.8; P=.046). Individuals who were aware of internet therapies (97/214, 45.5%) or not sure (40/87, 46.0%) were more likely to prefer guided internet interventions than were those who were not aware (115/343, 33.5%).

    We found differences in e-preference based on experience with online counseling (χ23=13.8; P=.003); persons with experience were less likely to prefer unguided interventions (7/68, 10.6%) than were those without (117/578, 20.2%).

    Experience with psychotherapy also predicted e-preference (χ29=21.6; P=.01). A preference for guided internet interventions was most common among persons without experience who were currently seeking a therapist (20/35, 57.1%) and persons with experience with psychotherapy (99/228, 43.4%). All subgroups were nonetheless most likely to prefer guided internet interventions.

    Table 2. Sample characteristics (N=646).
    Help-seeking–related variablesData
    Subjective health status, n (%)

    		Healthy or relatively healthy492 (76.2)

    		Acute illness39 (6.0)

    		Chronic illness83 (12.8)

    		Other (commentary section)30 (4.6)

    		Missing data2 (0.3)
    Experience with online counseling, n (%)

    		No, no experience with online counseling578 (89.6)

    		Yes, experience with online counseling67 (10.4)

    		Missing data1 (0.2)
    Experience with psychotherapya, n (%)

    		No, I have no experience and I have also no need for psychotherapeutic help303 (46.9)

    		No, I have no experience, but I am seeking psychotherapeutic help from a therapist35 (5.4)

    		Yes, I am in therapy79 (12.2)

    		Yes, in the past (experience with psychotherapy)228 (35.3)

    		Missing data1 (0.2)
    Web-based health information use (frequency), n (%)

    		Daily15 (2.3)

    		Several times a week49 (7.6)

    		Several times a month146 (22.6)

    		Rarely or occasionally369 (57.1)

    		Very rare or never67 (10.4)
    E-awareness (awareness of the existence of electronic therapies), n (%)

    		No (not aware)343 (53.1)

    		Yes (aware)214 (33.1)

    		Not sure87 (13.8)

    		Missing data2 (0.4)
    Attachment style (ECR-RSb), mean (SD), median, range

    		Attachment avoidance3.61 (1.38), 3.50 (1.00-7.17)

    		Attachment anxiety3.46 (1.77), 3.33 (0.00-7.00)
    Stress perceptions, mean (SD), median (range)

    		Current stress (visual analog scale)5.67 (2.96), 6.0 (0-10)

    		Perceived stress (Perceived Stress Questionnaire 20-item short version)47.00 (19.60), 46.67 (3.33-95.00)

    aExperience with psychotherapy or current need or demand for professional psychological help.

    bECR-RS: Experiences in Close Relationships-Relationships Structures questionnaire.

    Table 3. Summary of attitude assessment results with the e-therapy attitudes measurea (ETAM; N=646).
    ETAMMean (SD)MedianRange
    Overall score attitude assessment (ETAM mean score)1.93 (0.72)1.940-4
    Perceived usefulness and helpfulness (PU) scale2.72 (0.79)2.860-4
    Relative advantage and comparability (RA) scale1.37 (0.78)1.330-4
    Scale itemb

    		1./PUInternet-based therapies are modern and in line with our modern times.2.84 (1.04)3.00-4

    		2./RAInternet-based therapies will replace conventional face-to-face psychotherapy in the future.0.94 (0.93)1.00-4

    		3./PUInternet-based therapy is more compatible with work and private life than conventional face-to-face therapy.2.73 (1.05)3.00-4

    		4./RAIt makes no difference to me whether psychotherapy is conducted through the internet or in a psychotherapy practice in a clinic.0.69 (0.96)0.00-4

    		5./PUInternet-based therapies will reach more individuals with mental health problems.2.77 (1.09)3.00-4

    		6./PUHealth insurance companies should cover the costs for internet-based therapies.2.77 (1.16)3.00-4

    		7./RAInternet-based therapy programs are as effective as conventional face-to-face psychotherapies.1.39 (0.99)1.00-4

    		8./RATrust in a therapist can be just as easily built on the internet as in conventional face-to-face psychotherapy.1.39 (1.14)1.00-4

    		9./RAInternet-based therapies are an appropriate alternative to conventional face-to-face psychotherapy.1.82 (1.10)2.00-4

    		10./RAIn case of mental health problems, I would attend an internet-based therapy.1.70 (1.34)2.00-4

    		11./RAI would prefer an internet-based therapy to a conventional face-to-face psychotherapy.1.03 (1.16)1.00-4

    		12./PUInternet-based therapies will reach more patients and help them.2.55 (1.10)3.00-4

    		13./RAI’m not particularly worried about data security in internet therapies.1.29 (1.33)1.00-4

    		14./PUThe anonymity in internet therapies decreases the threshold to speak openly and honestly about important issues.2.69 (1.19)3.00-4

    		15./PUThrough the dissemination of internet therapies, persons will get professional help earlier.2.75 (1.04)3.00-4

    		16./RAMisunderstandings occur in internet therapies as often as in conventional psychotherapies.1.96 (1.23)2.00-4

    		17./RAInternet therapies are suitable for most patients, regardless of their personal background (age, sex, education, etc).1.54 (1.18)1.00-4

    aThe ETAM rating scale ranged from 0 (“strongly disagree”) to 4 (“strongly agree”).

    bAll items were translated from German to English. Item 1 refers to expectations and can be interpreted best in connection to other attitudinal items (compared with the previous version with 14 items, items 1-12 remained and items 13-17 are novel items of the 17-item version).

    Table 4. Classification of attitudes toward guided internet interventions assessed by the e-therapy attitudes measure (ETAM; N=646).
    ETAMClassification of ETAM scoresa

    		Low acceptance, negative
    attitude, n (%)    		Moderate acceptance, neutral
    attitude, n (%)    		High acceptance, positive
    attitude, n (%)
    Overall mean score (attitudes)168 (26.0)324 (50.2)124 (23.8)
    Perceived usefulness and helpfulness44 (6.8)175 (27.1)426 (65.9)
    Relative advantage and comparability364 (56.3)226 (35.0)56 (8.7)

    aLow acceptance, negative attitude: scale mean score range 0-1.49; moderate acceptance, neutral attitude: scale mean score range 1.5-2.49; high acceptance, positive attitude: scale mean score range 2.5-4.0.

    ‎
    Figure 1. Participants' stated preference for a specific delivery mode of internet interventions (N=646).
    Attachment Style

    Attachment avoidance significantly predicted e-preference (F3,640=6.315; P<.001, ηp2=.029). Participants with higher attachment avoidance were less likely to prefer VCP than other formats (unguided internet interventions: Mdiff –0.579, SE 0.166, 95% CI –1.020 to –0.139; guided internet interventions: Mdiff –0.426, SE 0.142, 95% CI –0.801 to –0.051; non–e-preference: Mdiff –0.651, SE 0.166, 95% CI –1.095 to –0.208). There was no significant association between preference and attachment anxiety (F3,640=2.247; P=.08).

    Perceived Stress

    Current perceived stress was associated with e-preference (visual analog scale: F3,640=3.855; P=.009, ηp2=.018), with participants who experienced higher stress being more likely to prefer guided interventions than VCP (Mdiff 0.86, SE 0.277, 95% CI 0.13-1.60). Scores for current stress were lowest in non–e-preferers (mean 5.26, SD 2.80) and highest in those who preferred guided internet intervention (mean 5.90, SD 2.60). Another significant difference between the preference groups was shown for perceived stress in the past month (PSQ-20: F3,638=2.943; P=.03, ηp2=.014). Pairwise comparisons were not significant. PSQ-20 scores were lowest for non–e-preference (mean 44.39, SD 20.81) and highest for therapist-guided intervention preference (mean 49.67, SD=19.14).

    The other help-seeking–related variables were not associated with significant differences in preferences (all P>.05).


    Principal Findings

    Attitudes Toward Guided Internet Interventions

    This study identified an overall moderate public acceptance, or moderately positive attitudes, toward guided internet interventions in a German sample. This tendency is in line with another study on a psychoeducational intervention using an adapted ETAM version [41]. Participants supported health care insurance coverage of costs for guided internet-based therapies and endorsed the helpfulness of such approaches, their perceived anonymity, and the chance to receive help earlier compared with traditional health care. At the same time, participants disagreed with the supposed comparability of guided internet interventions with face-to-face psychotherapy, for example, with regard to their effectiveness and possibility to develop a good therapeutic relationship. Our findings are, furthermore, consistent with earlier research with respect to a general preference for face-to-face therapies over internet interventions [28,29,44], data security concerns [64,65], and perceived higher compatibility of internet interventions with everyday life [11,29].

    We found no relevant differences for sociodemographics as predictors of attitudes toward internet-based guided self-help. Interestingly, neither education level nor sex was associated with attitudes. These results are in line with a study on the acceptance of internet-based interventions in chronic pain [66]. Replication of this finding might indicate that the often-reported overrepresentation of woman and highly educated participants in randomized controlled trials evaluating internet interventions [13,67-72] might not be due to lower acceptance of digital health interventions in general, but due to other relevant barriers such as lower willingness to seek help. Future research should try to shed light on low utilization rates among persons with low education and men.

    Moreover, participants with higher levels of perceived stress in the past month tended to express a more positive attitude toward internet interventions, which is consistent with a prior study using the same instrument to assess attitudes [42]. This might point to improved acceptance of such guided internet interventions among participants in a stressful situation with an actual need for support.

    Preference for Specific Delivery Formats

    This study identified a clear preference for guided over unguided internet interventions, which only few studies have investigated before [34]. Interestingly, guided internet interventions were also preferred over VCP. Approximately four-fifths of the participants were willing to use internet-based approaches for emotional problems, indicating a broad applicability of internet interventions for mental health care.

    High e-awareness was associated with a preference for guided internet interventions. Overall, e-awareness in our sample was low (33.1%), which could be, for instance, seen in context of the early stage of implementation of eMHSs in Germany [50,73] and might rise further in the future. This is supported by previous German surveys reporting even lower rates of e-awareness (14.0%-27.3%; [42,52,64]), including a representative socioeconomic panel (SOEP-Innovation Modules 2016, N=4802) showing 24.4% e-awareness (D Richter, written communication, May 2017). Experience with seeking psychological help formats was also a determinant of preferences, which is consistent with other studies [29,31]. Results also suggest that attachment avoidance was associated with a higher preference for guided and unguided self-help via internet interventions, and very low preference for VCP. This finding contributes to research on links between attachment styles and face-to-face health care use readiness [52,57,58] and might indicate that internet-based (guided) self-help approaches could help to reach individuals for whom attitudinal and other psychological barriers such as attachment avoidance might be a drawback for use of an intervention [74].

    Furthermore, participants with higher levels of perceived stress showed a higher preference for internet-based guided self-help than for VCP. This might indicate that individuals with stressful lives have problems adhering to fixed synchronous therapy sessions, and that providing asynchronous treatments might help them to get access to psychological treatments, which they would otherwise not use. Such an assumption is supported by studies that found high proportions of first-time help seekers in internet-based stress management programs [75-79]. However, future research is needed to confirm such an assumption.

    Implications

    This study provides several important implications for research and practice.

    Providing Asynchronous Treatment Formats to Increase Health Care Utilization

    First, results indicate that, although internet-based approaches are not an option for some individuals, a large proportion of participants in this study were potentially inclined to use eMHSs for treatment. However, e-preference rates were lowest for VCP, which, as a synchronous delivery format, is the most similar to conventional face-to-face psychotherapy [27]. Results also indicated that individuals with high attachment avoidance were least inclined to use this synchronous format to seek help, but were more willing to use asynchronous internet-based interventions. Perceived stigma and a preference for managing mental health problems on one’s own are known barriers to seeking synchronous treatment [10], and personal characteristics such as attachment style may contribute [57,58]. This suggests that provision of asynchronous treatment options, such as guided or unguided internet interventions, could be a feasible way to reach larger proportions of the general population, especially individuals who would not use synchronous options such as face-to-face psychotherapy or VCP. Matched-care models have been proposed before (cf, [80]), allocating internet-based or face-to-face treatment based on symptom severity; findings in this study, however, pointed out that various asynchronous as well as synchronous treatment formats should be provided simultaneously to reach as many individuals affected by mental health problems as possible.

    Second, these results also suggested that offering guidance alongside internet-based self-help internet interventions in routine care could, from a public health perspective, have a major influence on their effects on a population level. Whether to offer guided or unguided interventions in routine care has been debated in the literature since internet-based self-help has emerged. This discussion has since predominately focused on potential differences in adherence, effects, and costs [22,81-83]. Meta-analytic findings clearly indicate that stand-alone guided self-help interventions can be effective in the prevention and treatment of a range of mental health problems, including depression [68], anxiety [72], and stress [77]. However, although more patients could potentially be treated for the same costs using unguided self-help, a basic prerequisite to exploiting the potential of any effective treatment is that affected individuals are willing to use it [84]. This study showed that approximately twice as many participants preferred guided interventions over unguided interventions. Thus, with evidence showing guided interventions to be comparable with face-to-face psychotherapy, for example for depression and anxiety [17,85], and with large effect sizes of guided formats when delivered under routine care conditions [25,86-88], preference should be given at the moment, whenever possible, to guided self-help in routine care. However, it should also be acknowledged that almost 20% of participants preferred unguided self-help; hence, future studies should clarify whether offering both guided and unguided interventions could lead to greater effects on a population level due to higher overall utilization rates, compared with offering only one of the two options.

    Raising E-Awareness and Knowledge

    Awareness about internet-based treatment was rather low in this sample, but was positively associated with higher preference for guided internet interventions. Furthermore, participants did not find internet interventions to be equal in effectiveness and therapeutic relationship to face-to-face therapies. Previous research, however, has shown that the effects of guided internet interventions are comparable with face-to-face therapies [17,85] and that therapeutic relationships are of the same quality as in conventional treatment [1-4]. This finding points to the importance of developing measures to increase awareness of and knowledge about the efficacy of internet-based treatment in the public to raise its acceptance. Acceptance-facilitating interventions using brief, highly scalable educational videos have been shown to be a valid strategy to enhance the acceptability of internet interventions in clinical practice [66,71,84]. As acceptance-facilitating interventions may be easily disseminated through official health care information channels, they might be an auspicious approach to increase e-awareness and knowledge concerning internet interventions, and thus raise their public acceptance.

    Limitations

    First, the early stage of validation of the ETAM and the application of a heuristic rule to classify attitudes are a limitation that might have biased results regarding the categorization of attitudes with mainly neutral or undecided views. Future efforts should try to develop data-based cutoff values using representative samples. Second, the prior presentation of the case vignette regarding e-preferences might have led to more positive attitudes toward internet interventions, considering that a previous study using the ETAM without this case vignette revealed overall negative views [42]. Hence, these results might only be generalizable to situations in which potential participants receive minimal information about internet interventions. Third, we investigated determinants of attitudes toward and preferences for internet therapies based on self-reports, with most respondents (492/646, 75.2%) rating themselves as relatively healthy. It may be the case that attitudes toward digital mental health approaches change with current symptomatology, help-seeking wishes, and the availability of other formats for preferable treatments in routine care. Since the study was conducted in Germany, results may only be applicable to countries with similar economies or health care systems. Fourth, e-preferences were operationalized only regarding preferences for a specific treatment, and we do not know whether patients were nevertheless willing to use an alternative treatment format, if their preference would not be available in routine care, which should be tested in future studies. Moreover, with regard to non–e-preferers, we only assessed whether somebody would not prefer guided and unguided self-help or VCP, but we did not assess preference for face-to-face psychotherapy and pharmacotherapy, which should also be tested in subsequent studies.

    Conclusions

    This study revealed moderately positive attitudes toward guided internet interventions and a clear public preference for guided over unguided internet-based treatment and VCP. Results of this survey indicated that increasing awareness about the existence of effective internet-based treatment options should be a key priority to raise their acceptability, and that guided internet-based programs should be implemented in routine care along with conventional face-to-face treatment to account for different patient preferences and help-seeking characteristics.

    Acknowledgments

    We thank Viktor Vehreschild, MSc, Dipl-Math, for advice regarding data analyses and Melanie Allerding, MSc, for assistance in recruiting participants.

    Conflicts of Interest

    None declared.

    ‎

    Multimedia Appendix 1

    Exploratory factor analysis for the e-therapy attitudes measure (including pattern and structure matrices).

    PDF File (Adobe PDF File), 65KB
    1. Kessler RC, Aguilar-Gaxiola S, Alonso J, Chatterji S, Lee S, Ormel J, et al. The global burden of mental disorders: an update from the WHO World Mental Health (WMH) surveys. Epidemiol Psichiatr Soc. 2009;18(1):23-33. [FREE Full text] [Medline]
    2. Whiteford HA, Degenhardt L, Rehm J, Baxter AJ, Ferrari AJ, Erskine HE, et al. Global burden of disease attributable to mental and substance use disorders: findings from the Global Burden of Disease Study 2010. Lancet. Nov 09, 2013;382(9904):1575-1586. [CrossRef] [Medline]
    3. Saarni SI, Suvisaari J, Sintonen H, Pirkola S, Koskinen S, Aromaa A, et al. Impact of psychiatric disorders on health-related quality of life: general population survey. Br J Psychiatry. Apr 2007;190:326-332. [FREE Full text] [CrossRef] [Medline]
    4. Cuijpers P, Smit F. Excess mortality in depression: a meta-analysis of community studies. J Affect Disord. Dec 2002;72(3):227-236. [Medline]
    5. Smit F, Cuijpers P, Oostenbrink J, Batelaan N, de GR, Beekman A. Costs of nine common mental disorders: implications for curative and preventive psychiatry. J Ment Health Policy Econ. Dec 2006;9(4):193-200. [Medline]
    6. Greenberg PE, Birnbaum HG. The economic burden of depression in the US: societal and patient perspectives. Expert Opin Pharmacother. Mar 2005;6(3):369-376. [CrossRef] [Medline]
    7. Kohn R, Saxena S, Levav I, Saraceno B. The treatment gap in mental health care. Bull World Health Organ. Nov 2004;82(11):858-866. [FREE Full text] [Medline]
    8. World Health Organization Executive Board. Global burden of mental disorders and the need for a comprehensive, coordinated response from health and social sectors at the country level: Report by the Secretariat. Geneva, Switzerland. WHO; 2012. URL: http://apps.who.int/gb/ebwha/pdf_files/EB130/B130_9-en.pdf [accessed 2018-05-07] [WebCite Cache]
    9. Clement S, Schauman O, Graham T, Maggioni F, Evans-Lacko S, Bezborodovs N, et al. What is the impact of mental health-related stigma on help-seeking? A systematic review of quantitative and qualitative studies. Psychol Med. Jan 2015;45(1):11-27. [CrossRef] [Medline]
    10. Andrade LH, Alonso J, Mneimneh Z, Wells JE, Al-Hamzawi A, Borges G, et al. Barriers to mental health treatment: results from the WHO World Mental Health surveys. Psychol Med. Apr 2014;44(6):1303-1317. [FREE Full text] [CrossRef] [Medline]
    11. Musiat P, Tarrier N. Collateral outcomes in e-mental health: a systematic review of the evidence for added benefits of computerized cognitive behavior therapy interventions for mental health. Psychol Med. Nov 2014;44(15):3137-3150. [CrossRef] [Medline]
    12. Ryan ML, Shochet IM, Stallman HM. Universal online interventions might engage psychologically distressed university students who are unlikely to seek formal help. Adv Ment Health. Dec 17, 2014;9(1):73-83. [CrossRef]
    13. Josephine K, Josefine L, Philipp D, David E, Harald B. Internet- and mobile-based depression interventions for people with diagnosed depression: a systematic review and meta-analysis. J Affect Disord. Dec 01, 2017;223:28-40. [CrossRef] [Medline]
    14. Richards D, Richardson T. Computer-based psychological treatments for depression: a systematic review and meta-analysis. Clin Psychol Rev. Jun 2012;32(4):329-342. [CrossRef] [Medline]
    15. Ebert DD, Zarski A, Christensen H, Stikkelbroek Y, Cuijpers P, Berking M, et al. Internet and computer-based cognitive behavioral therapy for anxiety and depression in youth: a meta-analysis of randomized controlled outcome trials. PLoS One. 2015;10(3):e0119895. [FREE Full text] [CrossRef] [Medline]
    16. Hedman E, Ljótsson B, Lindefors N. Cognitive behavior therapy via the Internet: a systematic review of applications, clinical efficacy and cost-effectiveness. Expert Rev Pharmacoecon Outcomes Res. Dec 2012;12(6):745-764. [CrossRef] [Medline]
    17. Olthuis JV, Watt MC, Bailey K, Hayden JA, Stewart SH. Therapist-supported Internet cognitive behavioural therapy for anxiety disorders in adults. Cochrane Database Syst Rev. Mar 05, 2015;(3):CD011565. [CrossRef] [Medline]
    18. Zachariae R, Lyby MS, Ritterband LM, O'Toole MS. Efficacy of internet-delivered cognitive-behavioral therapy for insomnia – a systematic review and meta-analysis of randomized controlled trials. Sleep Med Rev. Dec 2016;30:1-10. [CrossRef] [Medline]
    19. Riper H, Blankers M, Hadiwijaya H, Cunningham J, Clarke S, Wiers R, et al. Effectiveness of guided and unguided low-intensity internet interventions for adult alcohol misuse: a meta-analysis. PLoS One. 2014;9(6):e99912. [FREE Full text] [CrossRef] [Medline]
    20. Ebert DD, Nobis S, Lehr D, Baumeister H, Riper H, Auerbach RP, et al. The 6-month effectiveness of Internet-based guided self-help for depression in adults with type 1 and 2 diabetes mellitus. Diabet Med. Dec 2017;34(1):99-107. [CrossRef] [Medline]
    21. van Bastelaar KMP, Pouwer F, Cuijpers P, Riper H, Snoek FJ. Web-based depression treatment for type 1 and type 2 diabetic patients: a randomized, controlled trial. Diabetes Care. Feb 2011;34(2):320-325. [FREE Full text] [CrossRef] [Medline]
    22. Andersson G, Cuijpers P, Carlbring P, Riper H, Hedman E. Guided Internet-based vs. face-to-face cognitive behavior therapy for psychiatric and somatic disorders: a systematic review and meta-analysis. World Psychiatry. Oct 2014;13(3):288-295. [FREE Full text] [CrossRef] [Medline]
    23. Baumeister H, Reichler L, Munzinger M, Lin J. The impact of guidance on internet-based mental health interventions — a systematic review. Internet Intervent. Oct 2014;1(4):205-215. [CrossRef]
    24. El Alaoui S, Hedman E, Ljótsson B, Lindefors N. Long-term effectiveness and outcome predictors of therapist-guided internet-based cognitive-behavioural therapy for social anxiety disorder in routine psychiatric care. BMJ Open. Jun 23, 2015;5(6):e007902. [FREE Full text] [CrossRef] [Medline]
    25. Hedman E, Ljótsson B, Kaldo V, Hesser H, El Alaoui S, Kraepelien M, et al. Effectiveness of Internet-based cognitive behaviour therapy for depression in routine psychiatric care. J Affect Disord. Feb 2014;155:49-58. [CrossRef] [Medline]
    26. Hedman E, Ljótsson B, Rück C, Bergström J, Andersson G, Kaldo V, et al. Effectiveness of internet-based cognitive behaviour therapy for panic disorder in routine psychiatric care. Acta Psychiatr Scand. Dec 2013;128(6):457-467. [CrossRef] [Medline]
    27. Backhaus A, Agha Z, Maglione ML, Repp A, Ross B, Zuest D, et al. Videoconferencing psychotherapy: a systematic review. Psychol Serv. May 2012;9(2):111-131. [CrossRef] [Medline]
    28. Klein B, Cook S. Preferences for e-mental health services amongst an online Australian sample? Electron J Appl Psychol. May 25, 2010;6(1):27-38. [CrossRef]
    29. Musiat P, Goldstone P, Tarrier N. Understanding the acceptability of e-mental health--attitudes and expectations towards computerised self-help treatments for mental health problems. BMC Psychiatry. Apr 11, 2014;14:109. [FREE Full text] [CrossRef] [Medline]
    30. Wahbeh H, Svalina MN, Oken BS. Group, one-on-one, or internet? Preferences for mindfulness meditation delivery format and their predictors. Open Med J. 2014;1:66-74. [FREE Full text] [CrossRef] [Medline]
    31. Wallin EEK, Mattsson S, Olsson EMG. The preference for internet-based psychological interventions by individuals without past or current use of mental health treatment delivered online: a survey study with mixed-methods analysis. JMIR Ment Health. Jun 14, 2016;3(2):e25. [FREE Full text] [CrossRef] [Medline]
    32. Mohr DC, Riper H, Schueller SM. A solution-focused research approach to achieve an implementable revolution in digital mental health. JAMA Psychiatry. Feb 01, 2018;75(2):113-114. [CrossRef] [Medline]
    33. Casey LM, Joy A, Clough BA. The impact of information on attitudes toward e-mental health services. Cyberpsychol Behav Soc Netw. Aug 2013;16(8):593-598. [CrossRef] [Medline]
    34. Apolinário-Hagen J, Kemper J, Stürmer C. Public acceptability of e-mental health treatment services for psychological problems: a scoping review. JMIR Ment Health. Apr 03, 2017;4(2):e10. [FREE Full text] [CrossRef] [Medline]
    35. March S, Day J, Ritchie G, Rowe A, Gough J, Hall T, et al. Attitudes toward e-mental health services in a community sample of adults: online survey. J Med Internet Res. Feb 19, 2018;20(2):e59. [FREE Full text] [CrossRef] [Medline]
    36. Ajzen I. Nature and operation of attitudes. Annu Rev Psychol. 2001;52:27-58. [CrossRef] [Medline]
    37. Ajzen I. The theory of planned behavior. Organ Behav Hum Decis Processes. Dec 1991;50(2):179-211. [CrossRef]
    38. Venkatesh, Morris, Davis, Davis. User acceptance of information technology: toward a unified view. MIS Q. 2003;27(3):425. [CrossRef]
    39. Hennemann S, Beutel ME, Zwerenz R. Drivers and barriers to acceptance of web-based aftercare of patients in inpatient routine care: a cross-sectional survey. J Med Internet Res. Dec 23, 2016;18(12):e337. [FREE Full text] [CrossRef] [Medline]
    40. Dockweiler C, Kupitz A, Hornberg C. [Acceptance of online-based therapy by patients with light to moderate depressive disorders]. Gesundheitswesen. Nov 10, 2017. (forthcoming). [CrossRef] [Medline]
    41. Apolinário-Hagen J, Fritsche L, Bierhals C, Salewski C. Improving attitudes toward e-mental health services in the general population via psychoeducational information material: a randomized controlled trial. Internet Intervent. Jan 5, 2018. [FREE Full text] [CrossRef]
    42. Apolinário-Hagen J, Vehreschild V, Alkoudmani RM. Current views and perspectives on e-mental health: an exploratory survey study for understanding public attitudes toward internet-based psychotherapy in Germany. JMIR Ment Health. Feb 23, 2017;4(1):e8. [FREE Full text] [CrossRef] [Medline]
    43. Williams R, Farquharson L, Palmer L, Bassett P, Clarke J, Clark DM, et al. Patient preference in psychological treatment and associations with self-reported outcome: national cross-sectional survey in England and Wales. BMC Psychiatry. Jan 15, 2016;16:4. [FREE Full text] [CrossRef] [Medline]
    44. Kayrouz R, Dear BF, Johnston L, Keyrouz L, Nehme E, Laube R, et al. Intergenerational and cross-cultural differences in emotional wellbeing, mental health service utilisation, treatment-seeking preferences and acceptability of psychological treatments for Arab Australians. Int J Soc Psychiatry. Aug 2015;61(5):484-491. [CrossRef] [Medline]
    45. Eichenberg C, Wolters C, Brähler E. The internet as a mental health advisor in Germany--results of a national survey. PLoS One. 2013;8(11):e79206. [FREE Full text] [CrossRef] [Medline]
    46. Choi I, Sharpe L, Li S, Hunt C. Acceptability of psychological treatment to Chinese- and Caucasian-Australians: internet treatment reduces barriers but face-to-face care is preferred. Soc Psychiatry Psychiatr Epidemiol. Jan 2015;50(1):77-87. [CrossRef] [Medline]
    47. Mohr DC, Siddique J, Ho J, Duffecy J, Jin L, Fokuo JK. Interest in behavioral and psychological treatments delivered face-to-face, by telephone, and by internet. Ann Behav Med. Aug 2010;40(1):89-98. [FREE Full text] [CrossRef] [Medline]
    48. Wells M, Mitchell KJ, Finkelhor D, Becker-Blease KA. Online mental health treatment: concerns and considerations. Cyberpsychol Behav. Jun 2007;10(3):453-459. [CrossRef] [Medline]
    49. Wangberg SC, Gammon D, Spitznogle K. In the eyes of the beholder: exploring psychologists' attitudes towards and use of e-therapy in Norway. Cyberpsychol Behav. Jun 2007;10(3):418-423. [CrossRef] [Medline]
    50. Topooco N, Riper H, Araya R, Berking M, Brunn M, Chevreul K, et al. Attitudes towards digital treatment for depression: a European stakeholder survey. Internet Intervent. Jun 2017;8:1-9. [CrossRef]
    51. Weaver JB, Mays D, Weaver SS, Hopkins GL, Eroglu D, Bernhardt JM. Health information-seeking behaviors, health indicators, and health risks. Am J Public Health. Aug 2010;100(8):1520-1525. [CrossRef] [Medline]
    52. Apolinário-Hagen J, Trachsel DA, Anhorn A, Holsten B, Werner V, Krebs S. Exploring individual differences in online and face-to-face help-seeking intentions in case of impending mental health problems: the role of adult attachment, perceived social support, psychological distress and self-stigma. J Health Soc Sci. 2016;1(3):223-240. [FREE Full text] [CrossRef]
    53. Bowlby J. Attachment and Loss. New York, NY. Basic Books; 1980.
    54. Vogel DL, Wei M. Adult attachment and help-seeking intent: the mediating roles of psychological distress and perceived social support. J Couns Psychol. Jul 2005;52(3):347-357. [CrossRef]
    55. Maunder RG, Hunter JJ. Attachment and psychosomatic medicine: developmental contributions to stress and disease. Psychosom Med. 2001;63(4):556-567. [Medline]
    56. Wulf M, Machado AJ, Tress W. [The influence of the attachment dimensions “anxiety” and “avoidance” on psychosomatic complaints]. Z Psychosom Med Psychother. 2012;58(4):374-384. [CrossRef] [Medline]
    57. Ciechanowski PS, Walker EA, Katon WJ, Russo JE. Attachment theory: a model for health care utilization and somatization. Psychosom Med. 2002;64(4):660-667. [Medline]
    58. Maunder RG, Hunter JJ. Assessing patterns of adult attachment in medical patients. Gen Hosp Psychiatry. 2009;31(2):123-130. [CrossRef] [Medline]
    59. Fraley RC, Heffernan ME, Vicary AM, Brumbaugh CC. The Experiences in Close Relationships-Relationship Structures questionnaire: a method for assessing attachment orientations across relationships. Psychol Assess. Sep 2011;23(3):615-625. [CrossRef] [Medline]
    60. Fraley C. Relationship Structures (ECR-RS) Questionnaire. Aug 2014. URL: http://internal.psychology.illinois.edu/~rcfraley/measures/relstructures.htm [accessed 2017-08-03] [WebCite Cache]
    61. Ehrenthal JC, Dinger U, Lamla A, Funken B, Schauenburg H. [Evaluation of the German version of the attachment questionnaire “Experiences in Close Relationships--Revised” (ECR-RD)]. Psychother Psychosom Med Psychol. Jun 2009;59(6):215-223. [CrossRef] [Medline]
    62. Bond A, Lader M. The use of analogue scales in rating subjective feelings. Br J Med Psychol. 1974;47(3):211-218. [CrossRef]
    63. Fliege H, Rose M, Arck P, Levenstein S, Klapp BF. Validierung des “Perceived Stress Questionnaire“ (PSQ) an einer deutschen Stichprobe. Diagnostica. Jul 2001;47(3):142-152. [CrossRef]
    64. Apolinário-Hagen J, Groenewold SD, Fritsche L, Kemper J, Krings L, Salewski C. Die Gesundheit Fernstudierender stärken. Präv Gesundheitsf. Oct 17, 2017;13(2):151-158. [CrossRef]
    65. Gieselmann A, Böckermann M, Pietrowsky R. Internetbasierte Gesundheitsinterventionen. Psychotherapeut. Jun 20, 2015;60(5):433-440. [CrossRef]
    66. Baumeister H, Seifferth H, Lin J, Nowoczin L, Lüking M, Ebert D. Impact of an acceptance facilitating intervention on patients’ acceptance of internet-based pain interventions: a randomized controlled trial. Clin J Pain. Jun 2015;31(6):528-535. [CrossRef] [Medline]
    67. Kuester A, Niemeyer H, Knaevelsrud C. Internet-based interventions for posttraumatic stress: a meta-analysis of randomized controlled trials. Clin Psychol Rev. Feb 2016;43:1-16. [CrossRef] [Medline]
    68. Karyotaki E, Riper H, Twisk J, Hoogendoorn A, Kleiboer A, Mira A, et al. Efficacy of self-guided internet-based cognitive behavioral therapy in the treatment of depressive symptoms: a meta-analysis of individual participant data. JAMA Psychiatry. Apr 01, 2017;74(4):351-359. [CrossRef] [Medline]
    69. Melioli T, Bauer S, Franko DL, Moessner M, Ozer F, Chabrol H, et al. Reducing eating disorder symptoms and risk factors using the internet: a meta-analytic review. Int J Eat Disord. Jan 2016;49(1):19-31. [CrossRef] [Medline]
    70. Späth C, Hapke U, Maske U, Schröder J, Moritz S, Berger T, et al. Characteristics of participants in a randomized trial of an internet intervention for depression (EVIDENT) in comparison to a national sample (DEGS1). Internet Intervent. Sep 2017;9:46-50. [CrossRef]
    71. Baumeister H, Nowoczin L, Lin J, Seifferth H, Seufert J, Laubner K, et al. Impact of an acceptance facilitating intervention on diabetes patients' acceptance of Internet-based interventions for depression: a randomized controlled trial. Diabetes Res Clin Pract. Jul 2014;105(1):30-39. [CrossRef] [Medline]
    72. Olthuis JV, Watt MC, Bailey K, Hayden JA, Stewart SH. Therapist-supported Internet cognitive behavioural therapy for anxiety disorders in adults. Cochrane Database Syst Rev. Mar 12, 2016;3:CD011565. [CrossRef] [Medline]
    73. Baumeister H, Lin J, Ebert DD. Internet- and mobile-based approaches: psycho-social diagnostics and treatment in medical rehabilitation. Bundesgesundheitsblatt Gesundheitsforschung Gesundheitsschutz. Apr 2017;60(4):436-444. [CrossRef] [Medline]
    74. Ebert D, Van Daele T, Nordgreen T, Karekla M, Compare T, Zarbo C, on behalf of the EFPA E-Health Taskforce, et al. Internet and mobile-based psychological interventions: applications, efficacy and potential for improving mental health: a report of the EFPA e-health taskforce. Eur Psychol. 2018. (forthcoming).
    75. Ebert DD, Lehr D, Smit F, Zarski A, Riper H, Heber E, et al. Efficacy and cost-effectiveness of minimal guided and unguided internet-based mobile supported stress-management in employees with occupational stress: a three-armed randomised controlled trial. BMC Public Health. Aug 07, 2014;14:807. [FREE Full text] [CrossRef] [Medline]
    76. Ebert DD, Heber E, Berking M, Riper H, Cuijpers P, Funk B, et al. Self-guided internet-based and mobile-based stress management for employees: results of a randomised controlled trial. Occup Environ Med. May 2016;73(5):315-323. [CrossRef] [Medline]
    77. Heber E, Ebert DD, Lehr D, Cuijpers P, Berking M, Nobis S, et al. The benefit of web- and computer-based interventions for stress: a systematic review and meta-analysis. J Med Internet Res. Feb 17, 2017;19(2):e32. [FREE Full text] [CrossRef] [Medline]
    78. Heber E, Lehr D, Ebert DD, Berking M, Riper H. Web-based and mobile stress management intervention for employees: a randomized controlled tria. J Med Internet Res. Jan 27, 2016;18(1):e21. [FREE Full text] [CrossRef] [Medline]
    79. Harrer M, Adam SH, Fleischmann RJ, Baumeister H, Auerbach R, Bruffaerts R, et al. Effectiveness of an internet- and app-based intervention for college students with elevated stress: results of a randomized controlled trial. J Med Internet Res. Apr 23, 2018;20(4):e136. [FREE Full text] [CrossRef] [Medline]
    80. van Straten A, Hill J, Richards DA, Cuijpers P. Stepped care treatment delivery for depression: a systematic review and meta-analysis. Psychol Med. Jan 2015;45(2):231-246. [CrossRef] [Medline]
    81. Muñoz RF. Using evidence-based internet interventions to reduce health disparities worldwide. J Med Internet Res. Dec 17, 2010;12(5):e60. [FREE Full text] [CrossRef] [Medline]
    82. Andrews G, Basu A, Cuijpers P, Craske MG, McEvoy P, English CL, et al. Computer therapy for the anxiety and depression disorders is effective, acceptable and practical health care: an updated meta-analysis. J Anxiety Disord. Apr 2018;55:70-78. [FREE Full text] [CrossRef] [Medline]
    83. Christensen H, Griffiths KM, Mackinnon AJ, Brittliffe K. Online randomized controlled trial of brief and full cognitive behaviour therapy for depression. Psychol Med. Dec 2006;36(12):1737-1746. [CrossRef] [Medline]
    84. Ebert DD, Berking M, Cuijpers P, Lehr D, Pörtner M, Baumeister H. Increasing the acceptance of internet-based mental health interventions in primary care patients with depressive symptoms. A randomized controlled trial. J Affect Disord. May 1, 2015;176:9-17. [CrossRef] [Medline]
    85. Carlbring P, Andersson G, Cuijpers P, Riper H, Hedman-Lagerlöf E. Internet-based vs. face-to-face cognitive behavior therapy for psychiatric and somatic disorders: an updated systematic review and meta-analysis. Cogn Behav Ther. Jan 2018;47(1):1-18. [CrossRef] [Medline]
    86. Newby JM, Mewton L, Williams AD, Andrews G. Effectiveness of transdiagnostic Internet cognitive behavioural treatment for mixed anxiety and depression in primary care. J Affect Disord. Aug 2014;165:45-52. [CrossRef] [Medline]
    87. Nordgreen T, Gjestad R, Andersson G, Carlbring P, Havik OE. The implementation of guided Internet-based cognitive behaviour therapy for panic disorder in a routine-care setting: effectiveness and implementation efforts. Cogn Behav Ther. Jan 2018;47(1):62-75. [CrossRef] [Medline]
    88. Titov N, Dear BF, Staples LG, Bennett-Levy J, Klein B, Rapee RM, et al. MindSpot Clinic: an accessible, efficient, and effective online treatment service for anxiety and depression. Psychiatr Serv. Oct 2015;66(10):1043-1050. [CrossRef] [Medline]

    ‎
    ECR-RS: Experiences in Close Relationships-Relationships Structures questionnaire
    eMHS: electronic mental health service
    ETAM: e-therapy attitudes measure
    Mdiff: mean difference
    PSQ-20: Perceived Stress Questionnaire 20-item short version
    PU: perceived usefulness and helpfulness
    RA: relative advantage and comparability
    SOEP: socioeconomic panel
    VCP: videoconferencing psychotherapy

    Edited by G Eysenbach; submitted 09.04.18; peer-reviewed by B Arnoldussen, M Medich, MIK Almani; comments to author 02.05.18; revised version received 03.05.18; accepted 03.05.18; published 15.05.18.

    Copyright

    ©Jennifer Apolinário-Hagen, Mathias Harrer, Fanny Kählke, Lara Fritsche, Christel Salewski, David Daniel Ebert. Originally published in JMIR Mental Health (http://mental.jmir.org), 15.05.2018.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Mental Health, is properly cited. The complete bibliographic information, a link to the original publication on http://mental.jmir.org/, as well as this copyright and license information must be included.