Background: Internet interventions have been proposed to improve the accessibility and use of evidence-based psychological treatments. However, little is known about attitudes toward such treatments, which can be an important barrier to their use.
Objective: This study aimed to (1) determine attitudes toward guided internet interventions, (2) assess its acceptability compared with other internet-based formats, and (3) explore predictors of acceptance.
Methods: A convenience-sample Web-based survey (N=646) assessed attitudes toward guided internet therapies (ie, perceived usefulness and helpfulness, and advantage relative to face-to-face therapy), preferences for delivery modes (ie, e-preference: guided internet interventions, unguided internet interventions, or videoconferencing psychotherapy), and potential predictors of attitudes and preferences: sociodemographics, help-seeking–related variables, attachment style, and perceived stress.
Results: Although most participants perceived internet interventions as useful or helpful (426/646, 65.9%), a few indicated their advantage relative to face-to-face therapy (56/646, 8.7%). Most participants preferred guided internet interventions (252/646, 39.0%) over videoconferencing psychotherapy (147/646, 22.8%), unguided internet interventions (124/646, 19.2%), and not using internet interventions (121/646, 18.8%; missing data: 1/646, 0.2%). Attachment avoidance and stress were related to e-preference (all P<.05). Moreover, preference for therapist-guided internet interventions was higher for individuals who were aware of internet-based treatment (χ26=12.8; P=.046).
Conclusions: Participants assessed therapist-guided internet interventions as helpful, but not equivalent to face-to-face therapies. The vast majority (523/646, 81.0%) of the participants were potentially willing to use internet-based approaches. In lieu of providing patients with only one specific low-intensity treatment, implementation concepts should offer several options, including guided internet interventions, but not limited to them. Conversely, our results also indicate that efforts should focus on increasing public knowledge about internet interventions, including information about their effectiveness, to promote acceptance and uptake.
With 12-month prevalences ranging across countries from 9.8% to 19.1% , mental health disorders are widespread. Mental health disorders constitute one of the leading causes of disability [ ] and are associated with low quality of life, increased risk of developing chronic physical conditions and related mortality [ , ], and an immense economic burden leading to productivity losses and substantial societal costs [ , ]. Yet fewer than half of individuals affected by mental health disorders are detected and receive professional treatment [ ]. Untreated mental illness is estimated to account for 13% of the total global burden of disease [ ]. Structural barriers such as limited access to treatment have been named as a reason for the insufficient uptake of individuals with mental health disorders [ ]. Additionally, attitudinal barriers, such as personal stigma [ ] or preferring to solve problems on one’s own, may be decisive in explaining insufficient treatment rates [ ].
Using the internet as a delivery mode for self-help treatments has thus been discussed as a promising chance to inform the dissemination of professional treatment, as electronic mental health services (eMHSs) allow for mass deliverance of anonymous, low-threshold treatment options that may reach individuals for whom traditional face-to-face approaches are not an option [, ]. In recent years, a large number of randomized controlled trials have shown that internet interventions can effectively treat various mental health disorders, such as depression [ , ], anxiety [ - ], insomnia [ ], alcohol use disorder [ ], comorbid mental health problems in chronic somatic diseases [ , ], and psychosomatic disorders [ ]. The largest evidence base exists for the effectiveness of guided interventions [ , ], and research has shown that such approaches can be effective when delivered under routine care conditions [ - ]. In addition to guided or unguided internet interventions, videoconferencing psychotherapy (VCP) is considered as a further option to overcome regional barriers for a variety of patient populations [ ]. However, the poor adoption of eMHSs worldwide indicates that low acceptability and intention to use might constitute a barrier in reaching the full potential of internet-based approaches (cf, [ - ]).
Public Acceptance Indicators for E-Mental Health Services
Determinants of intentions to use eMHSs are not well understood [, ]. Yet there are indicators commonly discussed as influential for help-seeking intentions and acceptance of eMHSs, such as attitudes [ - ] and “e-preferences” [ ].
Positive public attitudes could be an indicator of acceptance and adoption of internet interventions. Generally, attitudes can be characterized as an aggregate of subjective assessments about an object, ranging, for example, from harmful to helpful .
The theory of planned behavior  proposes that attitudes, among other factors, shape individuals’ intentions, which then lead to a certain behavior. Individuals’ personal expectancies are assumed to shape such attitudes and to thereby influence behavioral intentions [ ]. In accordance with the unified theory of acceptance and use of technology [ ], performance expectancy (ie, how useful an individual perceives an intervention to be for reaching a specific goal) might thus play an important role in the adoption and acceptance of internet interventions [ , ] and provide a guideline in overcoming the limitations in the acceptability of eMHSs [ , , , ].
Technology acceptance of eMHS can be operationalized by intentions to use these services , which can be affected by the individual preference for a specific delivery mode [ ]. Treatment preference means to choose a treatment in favor of an alternative option. Research evidence suggests that considering patients’ preferences for a psychological treatment is associated with improved clinical outcomes [ ]. However, little is known about preferences for specific delivery modes, such as therapist-guided treatment, unguided internet interventions, and VCP, and their impact on the willingness to use eMHSs. Some studies identified a preference for traditional (face-to-face) over internet-based treatment (eg, [ , , , - ]) and for therapist-guided over unguided eMHSs (eg, [ , , ]).
Determinants of Attitudes Toward and Preferences for Internet-Based Therapies
Potential determinants of attitudes and preferences for eMHS include sociodemographics such as age, region , or professional background [ - ]. Regarding health-related and help-seeking variables, using the internet for mental health information [ , ], previous use of eMHSs [ ], a history of mental illness and help-seeking experience such as undergoing psychotherapy [ ], knowledge about eMHSs or awareness of electronic therapies (“e-awareness”) [ , , ], personality traits [ ], and perceived stress [ , ] have been reported as predictors. Regarding the role of symptom severity, a recent study [ ] illustrated a help-seeking behavior paradox in students, where individuals’ readiness to seek help from face-to-face services declined with increased perceived stress. In contrast, the same study also demonstrated a positive association between distress and seeking help online.
Attachment style may be a further predictor of eMHS uptake , since attachment theory [ ] has been applied to predict intentions to use face-to-face help services (eg, [ ]). Based on early infant-caregiver interactions, relatively stable internal working models of the self and others in terms of mental representations of close relationships are built. These implicit expectations regarding self-efficacy and reliance on significant others in stressful situations are manifested in adulthood [ ]. Adult attachment style can play a role in preferences and attitudes toward seeking help in the context of emotionally relevant relationships, such as in mental health care [ , ]. While a secure attachment style (low attachment anxiety and avoidance; ie, positive models of the self and others) is associated with functional coping strategies, insecure attachment styles were identified as a global vulnerability factor for mental health [ , ] and are related to altered stress responses, symptom reporting, and less use of health care resources [ , ]. However, the role of attachment styles in the readiness to use eMHSs remains unclear [ ], especially concerning different delivery modes of internet interventions that vary in the degree of human support.
Taken together, the identification of determinants of attitudes toward and preferences for eMHSs is at an early stage . This study addressed this research gap.
The purpose of this study was to (1) explore attitudes toward guided internet interventions and to (2) assess the acceptability of guided internet interventions compared with other formats of internet-based delivery (ie, e-preference: unguided self-help interventions and VCP vs not using eMHSs in case of emotional problems). Another goal was to (3) identify determinants of the public acceptability of eMHSs by exploring associations between attitudes toward guided internet interventions, preferences for a specific delivery mode of eMHSs, and participant characteristics (ie, sociodemographics, help-seeking–related variables, attachment style, and perceived stress).
Study Design and Participants
We conducted a cross-sectional Web-based survey using a quasi-experimental study design. Data were collected between November 2015 and June 2016 using Unipark software (Enterprise Feedback Suite survey, version 10.6, Questback). We obtained a convenience sample (N=646) via the virtual laboratory and Moodle of the University of Hagen, Hagen, Germany, and social media websites (Facebook, Facebook Inc; and Xing, Xing AG). No ethical approval was required. Inclusion criteria were self-reported age over 18 years and written informed consent. Psychology students could receive credits for their participation.
Attitudes Toward Guided Internet Interventions
We used a modified 17-item version of an e-therapy attitudes measure (ETAM)  containing statements about typically cited benefits of internet therapy and its comparability with face-to-face psychotherapy, as well as subjective beliefs (eg, about data security). Participants were asked to rate their agreement with each statement on a 5-point rating scale ranging from 0 (“strongly disagree”) to 4 (“strongly agree”). To ensure comparability, participants were instructed to rate items regarding guided internet interventions (see ). Based on previous exploratory factor analysis, we identified two factors, which we termed perceived usefulness and helpfulness, and advantage relative to face-to-face therapy. provides detailed information about the exploratory factor analysis. For classification of attitudes, we used predefined cutoffs in line with previous work using the ETAM [ , ]: mean scores <1.5 (a median score of 0 or 1) were defined as negative, values between 1.5 and 2.49 (median score of 2) as neutral, and scores ≥2.5 (median scores of 3 or 4) as positive attitudes toward guided internet interventions. Cronbach alpha was excellent in this survey (alpha=.92).
Preference for Internet Interventions (E-Preference)
We operationalized preference (see) by assessing help-seeking intentions for different delivery modes of internet interventions (e-preference, options 1-3) in contrast to the disinclination to use internet interventions in case of emotional problems (non–e-preference, option 4).
Determinants of Attitudes Toward and Preferences for Internet Interventions
Sociodemographics and Help-Seeking–Related Variables
Sociodemographic characteristics were sex, age, marital status, native language, region, country of residence, educational level, employment status, and work in health care or the social sector.
Preference for internet therapies illustrated by case vignettes. Options 1-3: internet therapies differentiated by the degree of professional support. The instruction was adapted and translated from German.
Internet-based psychotherapies include a broad spectrum of types of treatments for relatively well treatable, mild to moderate forms of depression and anxiety disorders. The following 3 examples illustrate distinct types of internet therapies:
- Unguided internet-based self-help treatment programs: The patient follows a Web-based, structured self-help treatment program, including problem-specific tasks, exercises, and tutorials, via mobile phone or computer for several weeks without individual feedback.
- Therapist-guided internet-based self-help treatment programs: The patient follows a Web-based, structured self-help treatment program with therapist guidance. Communication with the therapist consists of text-based feedback via email or chat provided on demand.
- Videoconferencing psychotherapy: The communication is mediated by a webcam. As with face-to-face psychotherapy, the treatment takes place within specified sessions with immediate verbal and nonverbal feedback.
In case of emotional problems, which of the described interventions would you most likely personally use? Please choose the internet therapy form you prefer most based on your current expectations.
- Unguided internet-based self-help treatment
- Therapist-guided internet-based self-help treatment
- Videoconferencing psychotherapy
- I would not use any internet therapy at all
We investigated participants’ awareness of electronic therapy (e-awareness) by asking them whether they had ever heard or read about internet-based therapies. We also asked participants to assess their subjective health status, experiences with online counseling or conventional inpatient or outpatient psychotherapy, and their frequency of seeking health information online.
We considered attachment style as a potential determinant of the acceptance of guided internet interventions, since previous work indicated a connection between individual needs for interpersonal proximity versus distance in case of emotional problems and help-seeking intentions (cf, ). We measured adult attachment using the Experiences in Close Relationships-Relationship Structures questionnaire [ ] 9-item global version to assess attachment anxiety and avoidance [ ]. Participants were asked to rate the extent to which they believed each statement best described their feelings about close relationships on a 7-point Likert scale ranging from 1 (“strongly disagree”) to 7 (“strongly agree”). The intercorrelation of dimensions (ρ(646)=.272, P<.001) was comparable with other studies [ ]. Cronbach alpha was good for attachment avoidance (alpha=.88) and excellent for attachment anxiety (alpha=.91).
Assessment of Stress Perceptions
Current Stress Level
We used a visual analog scale  to assess current perceived stress level on a scale with 2 end points: 0 (“not at all”) and 10 (“maximum”).
Perceived Stress (Past Month)
To measure stress perceptions during the past 4 weeks, the we used the Perceived Stress Questionnaire 20-item short version (PSQ-20) . Participants were asked to indicate how often statements applied to themselves on a 4-point Likert scale ranging from 1 (“almost never”) to 4 (“usually”). Cronbach alpha was poor (alpha=.55).
After entering the Web-based survey, participants were provided with the study information and consent form. Next, they were asked sociodemographic and help-seeking questions. Then, preference for specific forms of internet interventions, attitudes toward guided internet interventions, stress perceptions, and attachment style were assessed. The average completion time ranged from 10 to 15 minutes.
We considered only completed surveys for data analyses. To ensure data quality, data validation checks were performed independently by 2 researchers prior to the statistical analyses. Descriptive analyses were used to classify attitudes toward and preference for a specific delivery mode of internet therapies. Regarding predictors of attitudes, we explored differences in variance (analysis of variance) in attitudes (overall mean score) based on sociodemographics, health variables, and e-preference. Due to the scarce theory base and questionable multivariate normal distribution, we used Spearman rank correlation (ρ coefficient) instead of multiple regression analysis to identify associations between attitudes, attachment style, and stress perceptions. Moreover, we explored differences using 1-way analysis of variance and Pearson chi-square tests in preferences based on the same predictors as for attitudes. Pairwise comparisons (post hoc tests) to examine mean differences (Mdiff) were conducted using Bonferroni adjustments in case of variance homogeneity (Levene test, P>.05) or Dunnett C test in case of variance heterogeneity. Statistical tests for significance (2-tailed hypotheses with alpha level of .05) were performed using IBM SPSS version 24 (IBM Analytics).
Of 1300 respondents who accessed the platform, 778 provided informed consent, with 1 person declining and thus being excluded. We consequently analyzed the responses of 646 respondents who completed the survey.and summarize the sample’s characteristics.
Attitudes Toward Guided Internet Interventions
Analysis of attitudes toward guided internet interventions indicated an overall moderate acceptance (ETAM overall mean score,). As shows, descriptive analyses further showed that, although most participants (426/646, 65.9%) perceived internet approaches as useful or helpful, only a few participants (56/646, 8.7%) also indicated that guided internet-based approaches had a relative advantage over or comparability with conventional face-to-face approaches.
Overall, participants agreed with 7 of the 17 positive statements about internet interventions made in ETAM items (). Those positively attributed beliefs about internet therapies involved modernity (item 1), compatibility with everyday life (item 3), accessibility (item 5), coverage of costs by health insurance providers (item 6), helpfulness (item 12), anonymity (item 14), and a chance to get help earlier (item 15).
Furthermore, 7 of the 17 items were classified as negative. Participants rather disagreed with the possibility of replacing face-to-face therapies (item 2), the equivalence of delivery modes (item 4), comparability of effectiveness (item 7) and therapeutic relationships (item 8), preference for internet therapy over face-to-face therapy (item 11), data security (item 13) and suitability for diverse populations (item 17).
Participants classified 3 items as neutral or undecided. These statements addressed internet therapies as an alternative to face-to-face therapies (item 9), willingness to use internet therapies (item 10), and the occurrence of misunderstandings (item 16).
Preference for Different Delivery Modes
Asshows, most respondents indicated that they preferred guided internet interventions (252/646, 39.0%) over VCP (147/646, 22.8%), unguided internet interventions (124/646, 19.2%), or no Web-based treatment (121/646, 18.8%; missing data: 1/646, 0.2%). Thus, the vast majority were “e-preferers” (523/646, 81.0%).
|Mean (SD)||31.18 (10.08)|
|Range (median)||18-64 (29)|
|Sex, n (%)|
|Missing data||3 (0.5)|
|Native language, n (%)|
|Bilingual including German||40 (6.2)|
|Other than German||37 (5.7)|
|Missing data||1 (0.2)|
|Marital status, n (%)|
|Married or living in a close relationship||288 (44.6)|
|Divorced or living separated||26 (4.0)|
|Missing data||2 (0.3)|
|Employment statusa, n (%)|
|University student, part-time or full-time||345 (53.4)|
|Employee in trainingb||14 (2.2)|
|Parental leave||15 (2.3)|
|Current work incapability||3 (0.5)|
|Other employment (commentary section)||27 (4.2)|
|Employment in health care or social sector, n (%)|
|Yes, in a therapeutic field||57 (8.8)|
|Yes, in a nontherapeutic field||96 (14.9)|
|Education level attained, n (%)|
|No school certificate||3 (0.5)|
|Basic school qualificationc||10 (1.5)|
|Secondary school (Mittlere Reife)d||57 (8.8)|
|German Abitur or Fachabiture||329 (50.9)|
|University degree (Bachelor level)||86 (13.3)|
|University degree (Masters level)||143 (22.1)|
|Postgraduate or postdoctoral degree||9 (1.4)|
|Other degree (commentary section)||9 (1.4)|
|Country of residence, n (%)|
|Other countryf||60 (9.3)|
|Missing data||1 (0.2)|
|Region of residence, n (%)|
|Village or small town, with <5000 inhabitants||100 (15.5)|
|Provincial town, with 5000-19,999 inhabitants||99 (15.3)|
|Medium-sized city, with 20,000-100,000 inhabitants||124 (19.2)|
|Big city or metropolis, with >100,000 habitants||322 (49.8)|
|Missing data||1 (0.2)|
aThe main employment was requested (if respondents had multiple roles, they were asked to choose in which role they spent most of their working time at the time of participation in this survey).
bGerman dual system: occupational trainee or pupil (secondary education).
cBasic school qualification with usually 9 school years of education in Germany (German Hauptschule).
dSecondary school (German Mittlere Reife), or 10 years of education in Germany.
eGerman Abitur or Fachabitur with 12-13 years of education in Germany. This education is necessary to get access to a college or university.
fMost of the subgroup of non-Germany residents indicated they lived in Austria (35/646, 5.5%).
Determinants of Attitudes
Attitudes and age were significantly and positively correlated (ρ(643)=.079, P=.045), with older participants displaying more favorable attitudes than younger participants toward internet-based guided self-help. Unemployed participants (mean 2.30, SD 0.69) showed more positive attitudes than employees in training (mean 1.37, SD 0.37, Mdiff 0.93, SE 0.288, 95% CI 0.003-1.85). We found no significant differences in attitudes for sex, marital status, region, native language, education level, or work in the health care or social sector (all P>.05).
Frequency of seeking health information online was associated with differences in internet intervention attitudes (F4,641=6.675; P<.001, ηp2=.040), with more positive attitudes reported by individuals who sought information weekly (mean 2.01, SD 0.61, Mdiff –0.36, SE 0.112, 95% CI –0.67 to –0.04), several times a month (mean 2.11, SD 0.78, Mdiff –0.45, SE 0.097, 95% CI –0.72 to –0.18), or rarely (mean 1.91, SD=0.59, Mdiff –0.26, SE 0.080, 95% CI –0.48 to –0.04; all P<.05) than by those who never did (mean 1.66, SD 0.59). This was not the case for participants who reported seeking information daily (mean 1.46, SD 0.99); both groups (never, daily) expressed rather negative attitudes. There was a significant positive correlation between attitudes toward guided internet interventions and perceived stress on the PSQ-20 (ρ(643)=.092, P=.020). No significant differences in attitudes were identified for any of the other help-seeking–related variables (eg, e-awareness, attachment style, all P>.05).
Determinants of E-Preference
We found no significant differences in e-preferences (preference for guided or unguided internet interventions and VCP) based on age, sex, marital status, region, native language, education level, employment status, or work in the health care or social sector (all P>.05).
E-awareness significantly predicted a preference for different forms of internet-based therapy (χ26=12.8; P=.046). Individuals who were aware of internet therapies (97/214, 45.5%) or not sure (40/87, 46.0%) were more likely to prefer guided internet interventions than were those who were not aware (115/343, 33.5%).
We found differences in e-preference based on experience with online counseling (χ23=13.8; P=.003); persons with experience were less likely to prefer unguided interventions (7/68, 10.6%) than were those without (117/578, 20.2%).
Experience with psychotherapy also predicted e-preference (χ29=21.6; P=.01). A preference for guided internet interventions was most common among persons without experience who were currently seeking a therapist (20/35, 57.1%) and persons with experience with psychotherapy (99/228, 43.4%). All subgroups were nonetheless most likely to prefer guided internet interventions.
|Subjective health status, n (%)|
|Healthy or relatively healthy||492 (76.2)|
|Acute illness||39 (6.0)|
|Chronic illness||83 (12.8)|
|Other (commentary section)||30 (4.6)|
|Missing data||2 (0.3)|
|Experience with online counseling, n (%)|
|No, no experience with online counseling||578 (89.6)|
|Yes, experience with online counseling||67 (10.4)|
|Missing data||1 (0.2)|
|Experience with psychotherapya, n (%)|
|No, I have no experience and I have also no need for psychotherapeutic help||303 (46.9)|
|No, I have no experience, but I am seeking psychotherapeutic help from a therapist||35 (5.4)|
|Yes, I am in therapy||79 (12.2)|
|Yes, in the past (experience with psychotherapy)||228 (35.3)|
|Missing data||1 (0.2)|
|Web-based health information use (frequency), n (%)|
|Several times a week||49 (7.6)|
|Several times a month||146 (22.6)|
|Rarely or occasionally||369 (57.1)|
|Very rare or never||67 (10.4)|
|E-awareness (awareness of the existence of electronic therapies), n (%)|
|No (not aware)||343 (53.1)|
|Yes (aware)||214 (33.1)|
|Not sure||87 (13.8)|
|Missing data||2 (0.4)|
|Attachment style (ECR-RSb), mean (SD), median, range|
|Attachment avoidance||3.61 (1.38), 3.50 (1.00-7.17)|
|Attachment anxiety||3.46 (1.77), 3.33 (0.00-7.00)|
|Stress perceptions, mean (SD), median (range)|
|Current stress (visual analog scale)||5.67 (2.96), 6.0 (0-10)|
|Perceived stress (Perceived Stress Questionnaire 20-item short version)||47.00 (19.60), 46.67 (3.33-95.00)|
aExperience with psychotherapy or current need or demand for professional psychological help.
bECR-RS: Experiences in Close Relationships-Relationships Structures questionnaire.
|Overall score attitude assessment (ETAM mean score)||1.93 (0.72)||1.94||0-4|
|Perceived usefulness and helpfulness (PU) scale||2.72 (0.79)||2.86||0-4|
|Relative advantage and comparability (RA) scale||1.37 (0.78)||1.33||0-4|
|1./PU||Internet-based therapies are modern and in line with our modern times.||2.84 (1.04)||3.0||0-4|
|2./RA||Internet-based therapies will replace conventional face-to-face psychotherapy in the future.||0.94 (0.93)||1.0||0-4|
|3./PU||Internet-based therapy is more compatible with work and private life than conventional face-to-face therapy.||2.73 (1.05)||3.0||0-4|
|4./RA||It makes no difference to me whether psychotherapy is conducted through the internet or in a psychotherapy practice in a clinic.||0.69 (0.96)||0.0||0-4|
|5./PU||Internet-based therapies will reach more individuals with mental health problems.||2.77 (1.09)||3.0||0-4|
|6./PU||Health insurance companies should cover the costs for internet-based therapies.||2.77 (1.16)||3.0||0-4|
|7./RA||Internet-based therapy programs are as effective as conventional face-to-face psychotherapies.||1.39 (0.99)||1.0||0-4|
|8./RA||Trust in a therapist can be just as easily built on the internet as in conventional face-to-face psychotherapy.||1.39 (1.14)||1.0||0-4|
|9./RA||Internet-based therapies are an appropriate alternative to conventional face-to-face psychotherapy.||1.82 (1.10)||2.0||0-4|
|10./RA||In case of mental health problems, I would attend an internet-based therapy.||1.70 (1.34)||2.0||0-4|
|11./RA||I would prefer an internet-based therapy to a conventional face-to-face psychotherapy.||1.03 (1.16)||1.0||0-4|
|12./PU||Internet-based therapies will reach more patients and help them.||2.55 (1.10)||3.0||0-4|
|13./RA||I’m not particularly worried about data security in internet therapies.||1.29 (1.33)||1.0||0-4|
|14./PU||The anonymity in internet therapies decreases the threshold to speak openly and honestly about important issues.||2.69 (1.19)||3.0||0-4|
|15./PU||Through the dissemination of internet therapies, persons will get professional help earlier.||2.75 (1.04)||3.0||0-4|
|16./RA||Misunderstandings occur in internet therapies as often as in conventional psychotherapies.||1.96 (1.23)||2.0||0-4|
|17./RA||Internet therapies are suitable for most patients, regardless of their personal background (age, sex, education, etc).||1.54 (1.18)||1.0||0-4|
aThe ETAM rating scale ranged from 0 (“strongly disagree”) to 4 (“strongly agree”).
bAll items were translated from German to English. Item 1 refers to expectations and can be interpreted best in connection to other attitudinal items (compared with the previous version with 14 items, items 1-12 remained and items 13-17 are novel items of the 17-item version).
|ETAM||Classification of ETAM scoresa|
|Low acceptance, negative |
attitude, n (%)
|Moderate acceptance, neutral |
attitude, n (%)
|High acceptance, positive |
attitude, n (%)
|Overall mean score (attitudes)||168 (26.0)||324 (50.2)||124 (23.8)|
|Perceived usefulness and helpfulness||44 (6.8)||175 (27.1)||426 (65.9)|
|Relative advantage and comparability||364 (56.3)||226 (35.0)||56 (8.7)|
aLow acceptance, negative attitude: scale mean score range 0-1.49; moderate acceptance, neutral attitude: scale mean score range 1.5-2.49; high acceptance, positive attitude: scale mean score range 2.5-4.0.
Attachment avoidance significantly predicted e-preference (F3,640=6.315; P<.001, ηp2=.029). Participants with higher attachment avoidance were less likely to prefer VCP than other formats (unguided internet interventions: Mdiff –0.579, SE 0.166, 95% CI –1.020 to –0.139; guided internet interventions: Mdiff –0.426, SE 0.142, 95% CI –0.801 to –0.051; non–e-preference: Mdiff –0.651, SE 0.166, 95% CI –1.095 to –0.208). There was no significant association between preference and attachment anxiety (F3,640=2.247; P=.08).
Current perceived stress was associated with e-preference (visual analog scale: F3,640=3.855; P=.009, ηp2=.018), with participants who experienced higher stress being more likely to prefer guided interventions than VCP (Mdiff 0.86, SE 0.277, 95% CI 0.13-1.60). Scores for current stress were lowest in non–e-preferers (mean 5.26, SD 2.80) and highest in those who preferred guided internet intervention (mean 5.90, SD 2.60). Another significant difference between the preference groups was shown for perceived stress in the past month (PSQ-20: F3,638=2.943; P=.03, ηp2=.014). Pairwise comparisons were not significant. PSQ-20 scores were lowest for non–e-preference (mean 44.39, SD 20.81) and highest for therapist-guided intervention preference (mean 49.67, SD=19.14).
The other help-seeking–related variables were not associated with significant differences in preferences (all P>.05).
Attitudes Toward Guided Internet Interventions
This study identified an overall moderate public acceptance, or moderately positive attitudes, toward guided internet interventions in a German sample. This tendency is in line with another study on a psychoeducational intervention using an adapted ETAM version . Participants supported health care insurance coverage of costs for guided internet-based therapies and endorsed the helpfulness of such approaches, their perceived anonymity, and the chance to receive help earlier compared with traditional health care. At the same time, participants disagreed with the supposed comparability of guided internet interventions with face-to-face psychotherapy, for example, with regard to their effectiveness and possibility to develop a good therapeutic relationship. Our findings are, furthermore, consistent with earlier research with respect to a general preference for face-to-face therapies over internet interventions [ , , ], data security concerns [ , ], and perceived higher compatibility of internet interventions with everyday life [ , ].
We found no relevant differences for sociodemographics as predictors of attitudes toward internet-based guided self-help. Interestingly, neither education level nor sex was associated with attitudes. These results are in line with a study on the acceptance of internet-based interventions in chronic pain . Replication of this finding might indicate that the often-reported overrepresentation of woman and highly educated participants in randomized controlled trials evaluating internet interventions [ , - ] might not be due to lower acceptance of digital health interventions in general, but due to other relevant barriers such as lower willingness to seek help. Future research should try to shed light on low utilization rates among persons with low education and men.
Moreover, participants with higher levels of perceived stress in the past month tended to express a more positive attitude toward internet interventions, which is consistent with a prior study using the same instrument to assess attitudes . This might point to improved acceptance of such guided internet interventions among participants in a stressful situation with an actual need for support.
Preference for Specific Delivery Formats
This study identified a clear preference for guided over unguided internet interventions, which only few studies have investigated before . Interestingly, guided internet interventions were also preferred over VCP. Approximately four-fifths of the participants were willing to use internet-based approaches for emotional problems, indicating a broad applicability of internet interventions for mental health care.
High e-awareness was associated with a preference for guided internet interventions. Overall, e-awareness in our sample was low (33.1%), which could be, for instance, seen in context of the early stage of implementation of eMHSs in Germany [, ] and might rise further in the future. This is supported by previous German surveys reporting even lower rates of e-awareness (14.0%-27.3%; [ , , ]), including a representative socioeconomic panel (SOEP-Innovation Modules 2016, N=4802) showing 24.4% e-awareness (D Richter, written communication, May 2017). Experience with seeking psychological help formats was also a determinant of preferences, which is consistent with other studies [ , ]. Results also suggest that attachment avoidance was associated with a higher preference for guided and unguided self-help via internet interventions, and very low preference for VCP. This finding contributes to research on links between attachment styles and face-to-face health care use readiness [ , , ] and might indicate that internet-based (guided) self-help approaches could help to reach individuals for whom attitudinal and other psychological barriers such as attachment avoidance might be a drawback for use of an intervention [ ].
Furthermore, participants with higher levels of perceived stress showed a higher preference for internet-based guided self-help than for VCP. This might indicate that individuals with stressful lives have problems adhering to fixed synchronous therapy sessions, and that providing asynchronous treatments might help them to get access to psychological treatments, which they would otherwise not use. Such an assumption is supported by studies that found high proportions of first-time help seekers in internet-based stress management programs [- ]. However, future research is needed to confirm such an assumption.
This study provides several important implications for research and practice.
Providing Asynchronous Treatment Formats to Increase Health Care Utilization
First, results indicate that, although internet-based approaches are not an option for some individuals, a large proportion of participants in this study were potentially inclined to use eMHSs for treatment. However, e-preference rates were lowest for VCP, which, as a synchronous delivery format, is the most similar to conventional face-to-face psychotherapy . Results also indicated that individuals with high attachment avoidance were least inclined to use this synchronous format to seek help, but were more willing to use asynchronous internet-based interventions. Perceived stigma and a preference for managing mental health problems on one’s own are known barriers to seeking synchronous treatment [ ], and personal characteristics such as attachment style may contribute [ , ]. This suggests that provision of asynchronous treatment options, such as guided or unguided internet interventions, could be a feasible way to reach larger proportions of the general population, especially individuals who would not use synchronous options such as face-to-face psychotherapy or VCP. Matched-care models have been proposed before (cf, [ ]), allocating internet-based or face-to-face treatment based on symptom severity; findings in this study, however, pointed out that various asynchronous as well as synchronous treatment formats should be provided simultaneously to reach as many individuals affected by mental health problems as possible.
Second, these results also suggested that offering guidance alongside internet-based self-help internet interventions in routine care could, from a public health perspective, have a major influence on their effects on a population level. Whether to offer guided or unguided interventions in routine care has been debated in the literature since internet-based self-help has emerged. This discussion has since predominately focused on potential differences in adherence, effects, and costs [, - ]. Meta-analytic findings clearly indicate that stand-alone guided self-help interventions can be effective in the prevention and treatment of a range of mental health problems, including depression [ ], anxiety [ ], and stress [ ]. However, although more patients could potentially be treated for the same costs using unguided self-help, a basic prerequisite to exploiting the potential of any effective treatment is that affected individuals are willing to use it [ ]. This study showed that approximately twice as many participants preferred guided interventions over unguided interventions. Thus, with evidence showing guided interventions to be comparable with face-to-face psychotherapy, for example for depression and anxiety [ , ], and with large effect sizes of guided formats when delivered under routine care conditions [ , - ], preference should be given at the moment, whenever possible, to guided self-help in routine care. However, it should also be acknowledged that almost 20% of participants preferred unguided self-help; hence, future studies should clarify whether offering both guided and unguided interventions could lead to greater effects on a population level due to higher overall utilization rates, compared with offering only one of the two options.
Raising E-Awareness and Knowledge
Awareness about internet-based treatment was rather low in this sample, but was positively associated with higher preference for guided internet interventions. Furthermore, participants did not find internet interventions to be equal in effectiveness and therapeutic relationship to face-to-face therapies. Previous research, however, has shown that the effects of guided internet interventions are comparable with face-to-face therapies [, ] and that therapeutic relationships are of the same quality as in conventional treatment [ - ]. This finding points to the importance of developing measures to increase awareness of and knowledge about the efficacy of internet-based treatment in the public to raise its acceptance. Acceptance-facilitating interventions using brief, highly scalable educational videos have been shown to be a valid strategy to enhance the acceptability of internet interventions in clinical practice [ , , ]. As acceptance-facilitating interventions may be easily disseminated through official health care information channels, they might be an auspicious approach to increase e-awareness and knowledge concerning internet interventions, and thus raise their public acceptance.
First, the early stage of validation of the ETAM and the application of a heuristic rule to classify attitudes are a limitation that might have biased results regarding the categorization of attitudes with mainly neutral or undecided views. Future efforts should try to develop data-based cutoff values using representative samples. Second, the prior presentation of the case vignette regarding e-preferences might have led to more positive attitudes toward internet interventions, considering that a previous study using the ETAM without this case vignette revealed overall negative views . Hence, these results might only be generalizable to situations in which potential participants receive minimal information about internet interventions. Third, we investigated determinants of attitudes toward and preferences for internet therapies based on self-reports, with most respondents (492/646, 75.2%) rating themselves as relatively healthy. It may be the case that attitudes toward digital mental health approaches change with current symptomatology, help-seeking wishes, and the availability of other formats for preferable treatments in routine care. Since the study was conducted in Germany, results may only be applicable to countries with similar economies or health care systems. Fourth, e-preferences were operationalized only regarding preferences for a specific treatment, and we do not know whether patients were nevertheless willing to use an alternative treatment format, if their preference would not be available in routine care, which should be tested in future studies. Moreover, with regard to non–e-preferers, we only assessed whether somebody would not prefer guided and unguided self-help or VCP, but we did not assess preference for face-to-face psychotherapy and pharmacotherapy, which should also be tested in subsequent studies.
This study revealed moderately positive attitudes toward guided internet interventions and a clear public preference for guided over unguided internet-based treatment and VCP. Results of this survey indicated that increasing awareness about the existence of effective internet-based treatment options should be a key priority to raise their acceptability, and that guided internet-based programs should be implemented in routine care along with conventional face-to-face treatment to account for different patient preferences and help-seeking characteristics.
We thank Viktor Vehreschild, MSc, Dipl-Math, for advice regarding data analyses and Melanie Allerding, MSc, for assistance in recruiting participants.
Conflicts of Interest
Multimedia Appendix 1
Exploratory factor analysis for the e-therapy attitudes measure (including pattern and structure matrices).PDF File (Adobe PDF File), 65KB
- Kessler RC, Aguilar-Gaxiola S, Alonso J, Chatterji S, Lee S, Ormel J, et al. The global burden of mental disorders: an update from the WHO World Mental Health (WMH) surveys. Epidemiol Psichiatr Soc 2009;18(1):23-33 [FREE Full text] [Medline]
- Whiteford HA, Degenhardt L, Rehm J, Baxter AJ, Ferrari AJ, Erskine HE, et al. Global burden of disease attributable to mental and substance use disorders: findings from the Global Burden of Disease Study 2010. Lancet 2013 Nov 09;382(9904):1575-1586. [CrossRef] [Medline]
- Saarni SI, Suvisaari J, Sintonen H, Pirkola S, Koskinen S, Aromaa A, et al. Impact of psychiatric disorders on health-related quality of life: general population survey. Br J Psychiatry 2007 Apr;190:326-332 [FREE Full text] [CrossRef] [Medline]
- Cuijpers P, Smit F. Excess mortality in depression: a meta-analysis of community studies. J Affect Disord 2002 Dec;72(3):227-236. [Medline]
- Smit F, Cuijpers P, Oostenbrink J, Batelaan N, de GR, Beekman A. Costs of nine common mental disorders: implications for curative and preventive psychiatry. J Ment Health Policy Econ 2006 Dec;9(4):193-200. [Medline]
- Greenberg PE, Birnbaum HG. The economic burden of depression in the US: societal and patient perspectives. Expert Opin Pharmacother 2005 Mar;6(3):369-376. [CrossRef] [Medline]
- Kohn R, Saxena S, Levav I, Saraceno B. The treatment gap in mental health care. Bull World Health Organ 2004 Nov;82(11):858-866 [FREE Full text] [Medline]
- World Health Organization Executive Board. Global burden of mental disorders and the need for a comprehensive, coordinated response from health and social sectors at the country level: Report by the Secretariat. Geneva, Switzerland: WHO; 2012. URL: http://apps.who.int/gb/ebwha/pdf_files/EB130/B130_9-en.pdf [accessed 2018-05-07] [WebCite Cache]
- Clement S, Schauman O, Graham T, Maggioni F, Evans-Lacko S, Bezborodovs N, et al. What is the impact of mental health-related stigma on help-seeking? A systematic review of quantitative and qualitative studies. Psychol Med 2015 Jan;45(1):11-27. [CrossRef] [Medline]
- Andrade LH, Alonso J, Mneimneh Z, Wells JE, Al-Hamzawi A, Borges G, et al. Barriers to mental health treatment: results from the WHO World Mental Health surveys. Psychol Med 2014 Apr;44(6):1303-1317 [FREE Full text] [CrossRef] [Medline]
- Musiat P, Tarrier N. Collateral outcomes in e-mental health: a systematic review of the evidence for added benefits of computerized cognitive behavior therapy interventions for mental health. Psychol Med 2014 Nov;44(15):3137-3150. [CrossRef] [Medline]
- Ryan ML, Shochet IM, Stallman HM. Universal online interventions might engage psychologically distressed university students who are unlikely to seek formal help. Adv Ment Health 2014 Dec 17;9(1):73-83. [CrossRef]
- Josephine K, Josefine L, Philipp D, David E, Harald B. Internet- and mobile-based depression interventions for people with diagnosed depression: a systematic review and meta-analysis. J Affect Disord 2017 Dec 01;223:28-40. [CrossRef] [Medline]
- Richards D, Richardson T. Computer-based psychological treatments for depression: a systematic review and meta-analysis. Clin Psychol Rev 2012 Jun;32(4):329-342. [CrossRef] [Medline]
- Ebert DD, Zarski A, Christensen H, Stikkelbroek Y, Cuijpers P, Berking M, et al. Internet and computer-based cognitive behavioral therapy for anxiety and depression in youth: a meta-analysis of randomized controlled outcome trials. PLoS One 2015;10(3):e0119895 [FREE Full text] [CrossRef] [Medline]
- Hedman E, Ljótsson B, Lindefors N. Cognitive behavior therapy via the Internet: a systematic review of applications, clinical efficacy and cost-effectiveness. Expert Rev Pharmacoecon Outcomes Res 2012 Dec;12(6):745-764. [CrossRef] [Medline]
- Olthuis JV, Watt MC, Bailey K, Hayden JA, Stewart SH. Therapist-supported Internet cognitive behavioural therapy for anxiety disorders in adults. Cochrane Database Syst Rev 2015 Mar 05(3):CD011565. [CrossRef] [Medline]
- Zachariae R, Lyby MS, Ritterband LM, O'Toole MS. Efficacy of internet-delivered cognitive-behavioral therapy for insomnia – a systematic review and meta-analysis of randomized controlled trials. Sleep Med Rev 2016 Dec;30:1-10. [CrossRef] [Medline]
- Riper H, Blankers M, Hadiwijaya H, Cunningham J, Clarke S, Wiers R, et al. Effectiveness of guided and unguided low-intensity internet interventions for adult alcohol misuse: a meta-analysis. PLoS One 2014;9(6):e99912 [FREE Full text] [CrossRef] [Medline]
- Ebert DD, Nobis S, Lehr D, Baumeister H, Riper H, Auerbach RP, et al. The 6-month effectiveness of Internet-based guided self-help for depression in adults with type 1 and 2 diabetes mellitus. Diabet Med 2017 Dec;34(1):99-107. [CrossRef] [Medline]
- van Bastelaar KMP, Pouwer F, Cuijpers P, Riper H, Snoek FJ. Web-based depression treatment for type 1 and type 2 diabetic patients: a randomized, controlled trial. Diabetes Care 2011 Feb;34(2):320-325 [FREE Full text] [CrossRef] [Medline]
- Andersson G, Cuijpers P, Carlbring P, Riper H, Hedman E. Guided Internet-based vs. face-to-face cognitive behavior therapy for psychiatric and somatic disorders: a systematic review and meta-analysis. World Psychiatry 2014 Oct;13(3):288-295 [FREE Full text] [CrossRef] [Medline]
- Baumeister H, Reichler L, Munzinger M, Lin J. The impact of guidance on internet-based mental health interventions — a systematic review. Internet Intervent 2014 Oct;1(4):205-215. [CrossRef]
- El Alaoui S, Hedman E, Ljótsson B, Lindefors N. Long-term effectiveness and outcome predictors of therapist-guided internet-based cognitive-behavioural therapy for social anxiety disorder in routine psychiatric care. BMJ Open 2015 Jun 23;5(6):e007902 [FREE Full text] [CrossRef] [Medline]
- Hedman E, Ljótsson B, Kaldo V, Hesser H, El Alaoui S, Kraepelien M, et al. Effectiveness of Internet-based cognitive behaviour therapy for depression in routine psychiatric care. J Affect Disord 2014 Feb;155:49-58. [CrossRef] [Medline]
- Hedman E, Ljótsson B, Rück C, Bergström J, Andersson G, Kaldo V, et al. Effectiveness of internet-based cognitive behaviour therapy for panic disorder in routine psychiatric care. Acta Psychiatr Scand 2013 Dec;128(6):457-467. [CrossRef] [Medline]
- Backhaus A, Agha Z, Maglione ML, Repp A, Ross B, Zuest D, et al. Videoconferencing psychotherapy: a systematic review. Psychol Serv 2012 May;9(2):111-131. [CrossRef] [Medline]
- Klein B, Cook S. Preferences for e-mental health services amongst an online Australian sample? Electron J Appl Psychol 2010 May 25;6(1):27-38. [CrossRef]
- Musiat P, Goldstone P, Tarrier N. Understanding the acceptability of e-mental health--attitudes and expectations towards computerised self-help treatments for mental health problems. BMC Psychiatry 2014 Apr 11;14:109 [FREE Full text] [CrossRef] [Medline]
- Wahbeh H, Svalina MN, Oken BS. Group, one-on-one, or internet? Preferences for mindfulness meditation delivery format and their predictors. Open Med J 2014;1:66-74 [FREE Full text] [CrossRef] [Medline]
- Wallin EEK, Mattsson S, Olsson EMG. The preference for internet-based psychological interventions by individuals without past or current use of mental health treatment delivered online: a survey study with mixed-methods analysis. JMIR Ment Health 2016 Jun 14;3(2):e25 [FREE Full text] [CrossRef] [Medline]
- Mohr DC, Riper H, Schueller SM. A solution-focused research approach to achieve an implementable revolution in digital mental health. JAMA Psychiatry 2018 Feb 01;75(2):113-114. [CrossRef] [Medline]
- Casey LM, Joy A, Clough BA. The impact of information on attitudes toward e-mental health services. Cyberpsychol Behav Soc Netw 2013 Aug;16(8):593-598. [CrossRef] [Medline]
- Apolinário-Hagen J, Kemper J, Stürmer C. Public acceptability of e-mental health treatment services for psychological problems: a scoping review. JMIR Ment Health 2017 Apr 03;4(2):e10 [FREE Full text] [CrossRef] [Medline]
- March S, Day J, Ritchie G, Rowe A, Gough J, Hall T, et al. Attitudes toward e-mental health services in a community sample of adults: online survey. J Med Internet Res 2018 Feb 19;20(2):e59 [FREE Full text] [CrossRef] [Medline]
- Ajzen I. Nature and operation of attitudes. Annu Rev Psychol 2001;52:27-58. [CrossRef] [Medline]
- Ajzen I. The theory of planned behavior. Organ Behav Hum Decis Processes 1991 Dec;50(2):179-211. [CrossRef]
- Venkatesh, Morris, Davis, Davis. User acceptance of information technology: toward a unified view. MIS Q 2003;27(3):425. [CrossRef]
- Hennemann S, Beutel ME, Zwerenz R. Drivers and barriers to acceptance of web-based aftercare of patients in inpatient routine care: a cross-sectional survey. J Med Internet Res 2016 Dec 23;18(12):e337 [FREE Full text] [CrossRef] [Medline]
- Dockweiler C, Kupitz A, Hornberg C. [Acceptance of online-based therapy by patients with light to moderate depressive disorders]. Gesundheitswesen 2017 Nov 10 (forthcoming). [CrossRef] [Medline]
- Apolinário-Hagen J, Fritsche L, Bierhals C, Salewski C. Improving attitudes toward e-mental health services in the general population via psychoeducational information material: a randomized controlled trial. Internet Intervent 2018 Jan 5 (forthcoming) [FREE Full text] [CrossRef]
- Apolinário-Hagen J, Vehreschild V, Alkoudmani RM. Current views and perspectives on e-mental health: an exploratory survey study for understanding public attitudes toward internet-based psychotherapy in Germany. JMIR Ment Health 2017 Feb 23;4(1):e8 [FREE Full text] [CrossRef] [Medline]
- Williams R, Farquharson L, Palmer L, Bassett P, Clarke J, Clark DM, et al. Patient preference in psychological treatment and associations with self-reported outcome: national cross-sectional survey in England and Wales. BMC Psychiatry 2016 Jan 15;16:4 [FREE Full text] [CrossRef] [Medline]
- Kayrouz R, Dear BF, Johnston L, Keyrouz L, Nehme E, Laube R, et al. Intergenerational and cross-cultural differences in emotional wellbeing, mental health service utilisation, treatment-seeking preferences and acceptability of psychological treatments for Arab Australians. Int J Soc Psychiatry 2015 Aug;61(5):484-491. [CrossRef] [Medline]
- Eichenberg C, Wolters C, Brähler E. The internet as a mental health advisor in Germany--results of a national survey. PLoS One 2013;8(11):e79206 [FREE Full text] [CrossRef] [Medline]
- Choi I, Sharpe L, Li S, Hunt C. Acceptability of psychological treatment to Chinese- and Caucasian-Australians: internet treatment reduces barriers but face-to-face care is preferred. Soc Psychiatry Psychiatr Epidemiol 2015 Jan;50(1):77-87. [CrossRef] [Medline]
- Mohr DC, Siddique J, Ho J, Duffecy J, Jin L, Fokuo JK. Interest in behavioral and psychological treatments delivered face-to-face, by telephone, and by internet. Ann Behav Med 2010 Aug;40(1):89-98 [FREE Full text] [CrossRef] [Medline]
- Wells M, Mitchell KJ, Finkelhor D, Becker-Blease KA. Online mental health treatment: concerns and considerations. Cyberpsychol Behav 2007 Jun;10(3):453-459. [CrossRef] [Medline]
- Wangberg SC, Gammon D, Spitznogle K. In the eyes of the beholder: exploring psychologists' attitudes towards and use of e-therapy in Norway. Cyberpsychol Behav 2007 Jun;10(3):418-423. [CrossRef] [Medline]
- Topooco N, Riper H, Araya R, Berking M, Brunn M, Chevreul K, et al. Attitudes towards digital treatment for depression: a European stakeholder survey. Internet Intervent 2017 Jun;8:1-9. [CrossRef]
- Weaver JB, Mays D, Weaver SS, Hopkins GL, Eroglu D, Bernhardt JM. Health information-seeking behaviors, health indicators, and health risks. Am J Public Health 2010 Aug;100(8):1520-1525. [CrossRef] [Medline]
- Apolinário-Hagen J, Trachsel DA, Anhorn A, Holsten B, Werner V, Krebs S. Exploring individual differences in online and face-to-face help-seeking intentions in case of impending mental health problems: the role of adult attachment, perceived social support, psychological distress and self-stigma. J Health Soc Sci 2016;1(3):223-240 [FREE Full text] [CrossRef]
- Bowlby J. Attachment and Loss. New York, NY: Basic Books; 1980.
- Vogel DL, Wei M. Adult attachment and help-seeking intent: the mediating roles of psychological distress and perceived social support. J Couns Psychol 2005 Jul;52(3):347-357. [CrossRef]
- Maunder RG, Hunter JJ. Attachment and psychosomatic medicine: developmental contributions to stress and disease. Psychosom Med 2001;63(4):556-567. [Medline]
- Wulf M, Machado AJ, Tress W. [The influence of the attachment dimensions “anxiety” and “avoidance” on psychosomatic complaints]. Z Psychosom Med Psychother 2012;58(4):374-384. [CrossRef] [Medline]
- Ciechanowski PS, Walker EA, Katon WJ, Russo JE. Attachment theory: a model for health care utilization and somatization. Psychosom Med 2002;64(4):660-667. [Medline]
- Maunder RG, Hunter JJ. Assessing patterns of adult attachment in medical patients. Gen Hosp Psychiatry 2009;31(2):123-130. [CrossRef] [Medline]
- Fraley RC, Heffernan ME, Vicary AM, Brumbaugh CC. The Experiences in Close Relationships-Relationship Structures questionnaire: a method for assessing attachment orientations across relationships. Psychol Assess 2011 Sep;23(3):615-625. [CrossRef] [Medline]
- Fraley C. Relationship Structures (ECR-RS) Questionnaire. 2014 Aug. URL: http://internal.psychology.illinois.edu/~rcfraley/measures/relstructures.htm [accessed 2017-08-03] [WebCite Cache]
- Ehrenthal JC, Dinger U, Lamla A, Funken B, Schauenburg H. [Evaluation of the German version of the attachment questionnaire “Experiences in Close Relationships--Revised” (ECR-RD)]. Psychother Psychosom Med Psychol 2009 Jun;59(6):215-223. [CrossRef] [Medline]
- Bond A, Lader M. The use of analogue scales in rating subjective feelings. Br J Med Psychol 1974;47(3):211-218. [CrossRef]
- Fliege H, Rose M, Arck P, Levenstein S, Klapp BF. Validierung des “Perceived Stress Questionnaire“ (PSQ) an einer deutschen Stichprobe. Diagnostica 2001 Jul;47(3):142-152. [CrossRef]
- Apolinário-Hagen J, Groenewold SD, Fritsche L, Kemper J, Krings L, Salewski C. Die Gesundheit Fernstudierender stärken. Präv Gesundheitsf 2017 Oct 17;13(2):151-158. [CrossRef]
- Gieselmann A, Böckermann M, Pietrowsky R. Internetbasierte Gesundheitsinterventionen. Psychotherapeut 2015 Jun 20;60(5):433-440. [CrossRef]
- Baumeister H, Seifferth H, Lin J, Nowoczin L, Lüking M, Ebert D. Impact of an acceptance facilitating intervention on patients’ acceptance of internet-based pain interventions: a randomized controlled trial. Clin J Pain 2015 Jun;31(6):528-535. [CrossRef] [Medline]
- Kuester A, Niemeyer H, Knaevelsrud C. Internet-based interventions for posttraumatic stress: a meta-analysis of randomized controlled trials. Clin Psychol Rev 2016 Feb;43:1-16. [CrossRef] [Medline]
- Karyotaki E, Riper H, Twisk J, Hoogendoorn A, Kleiboer A, Mira A, et al. Efficacy of self-guided internet-based cognitive behavioral therapy in the treatment of depressive symptoms: a meta-analysis of individual participant data. JAMA Psychiatry 2017 Apr 01;74(4):351-359. [CrossRef] [Medline]
- Melioli T, Bauer S, Franko DL, Moessner M, Ozer F, Chabrol H, et al. Reducing eating disorder symptoms and risk factors using the internet: a meta-analytic review. Int J Eat Disord 2016 Jan;49(1):19-31. [CrossRef] [Medline]
- Späth C, Hapke U, Maske U, Schröder J, Moritz S, Berger T, et al. Characteristics of participants in a randomized trial of an internet intervention for depression (EVIDENT) in comparison to a national sample (DEGS1). Internet Intervent 2017 Sep;9:46-50. [CrossRef]
- Baumeister H, Nowoczin L, Lin J, Seifferth H, Seufert J, Laubner K, et al. Impact of an acceptance facilitating intervention on diabetes patients' acceptance of Internet-based interventions for depression: a randomized controlled trial. Diabetes Res Clin Pract 2014 Jul;105(1):30-39. [CrossRef] [Medline]
- Olthuis JV, Watt MC, Bailey K, Hayden JA, Stewart SH. Therapist-supported Internet cognitive behavioural therapy for anxiety disorders in adults. Cochrane Database Syst Rev 2016 Mar 12;3:CD011565. [CrossRef] [Medline]
- Baumeister H, Lin J, Ebert DD. Internet- and mobile-based approaches: psycho-social diagnostics and treatment in medical rehabilitation. Bundesgesundheitsblatt Gesundheitsforschung Gesundheitsschutz 2017 Apr;60(4):436-444. [CrossRef] [Medline]
- Ebert D, Van Daele T, Nordgreen T, Karekla M, Compare T, Zarbo C, on behalf of the EFPA E-Health Taskforce, et al. Internet and mobile-based psychological interventions: applications, efficacy and potential for improving mental health: a report of the EFPA e-health taskforce. Eur Psychol 2018 (forthcoming).
- Ebert DD, Lehr D, Smit F, Zarski A, Riper H, Heber E, et al. Efficacy and cost-effectiveness of minimal guided and unguided internet-based mobile supported stress-management in employees with occupational stress: a three-armed randomised controlled trial. BMC Public Health 2014 Aug 07;14:807 [FREE Full text] [CrossRef] [Medline]
- Ebert DD, Heber E, Berking M, Riper H, Cuijpers P, Funk B, et al. Self-guided internet-based and mobile-based stress management for employees: results of a randomised controlled trial. Occup Environ Med 2016 May;73(5):315-323. [CrossRef] [Medline]
- Heber E, Ebert DD, Lehr D, Cuijpers P, Berking M, Nobis S, et al. The benefit of web- and computer-based interventions for stress: a systematic review and meta-analysis. J Med Internet Res 2017 Feb 17;19(2):e32 [FREE Full text] [CrossRef] [Medline]
- Heber E, Lehr D, Ebert DD, Berking M, Riper H. Web-based and mobile stress management intervention for employees: a randomized controlled tria. J Med Internet Res 2016 Jan 27;18(1):e21 [FREE Full text] [CrossRef] [Medline]
- Harrer M, Adam SH, Fleischmann RJ, Baumeister H, Auerbach R, Bruffaerts R, et al. Effectiveness of an internet- and app-based intervention for college students with elevated stress: results of a randomized controlled trial. J Med Internet Res 2018 Apr 23;20(4):e136 [FREE Full text] [CrossRef] [Medline]
- van Straten A, Hill J, Richards DA, Cuijpers P. Stepped care treatment delivery for depression: a systematic review and meta-analysis. Psychol Med 2015 Jan;45(2):231-246. [CrossRef] [Medline]
- Muñoz RF. Using evidence-based internet interventions to reduce health disparities worldwide. J Med Internet Res 2010 Dec 17;12(5):e60 [FREE Full text] [CrossRef] [Medline]
- Andrews G, Basu A, Cuijpers P, Craske MG, McEvoy P, English CL, et al. Computer therapy for the anxiety and depression disorders is effective, acceptable and practical health care: an updated meta-analysis. J Anxiety Disord 2018 Apr;55:70-78 [FREE Full text] [CrossRef] [Medline]
- Christensen H, Griffiths KM, Mackinnon AJ, Brittliffe K. Online randomized controlled trial of brief and full cognitive behaviour therapy for depression. Psychol Med 2006 Dec;36(12):1737-1746. [CrossRef] [Medline]
- Ebert DD, Berking M, Cuijpers P, Lehr D, Pörtner M, Baumeister H. Increasing the acceptance of internet-based mental health interventions in primary care patients with depressive symptoms. A randomized controlled trial. J Affect Disord 2015 May 1;176:9-17. [CrossRef] [Medline]
- Carlbring P, Andersson G, Cuijpers P, Riper H, Hedman-Lagerlöf E. Internet-based vs. face-to-face cognitive behavior therapy for psychiatric and somatic disorders: an updated systematic review and meta-analysis. Cogn Behav Ther 2018 Jan;47(1):1-18. [CrossRef] [Medline]
- Newby JM, Mewton L, Williams AD, Andrews G. Effectiveness of transdiagnostic Internet cognitive behavioural treatment for mixed anxiety and depression in primary care. J Affect Disord 2014 Aug;165:45-52. [CrossRef] [Medline]
- Nordgreen T, Gjestad R, Andersson G, Carlbring P, Havik OE. The implementation of guided Internet-based cognitive behaviour therapy for panic disorder in a routine-care setting: effectiveness and implementation efforts. Cogn Behav Ther 2018 Jan;47(1):62-75. [CrossRef] [Medline]
- Titov N, Dear BF, Staples LG, Bennett-Levy J, Klein B, Rapee RM, et al. MindSpot Clinic: an accessible, efficient, and effective online treatment service for anxiety and depression. Psychiatr Serv 2015 Oct;66(10):1043-1050. [CrossRef] [Medline]
|ECR-RS: Experiences in Close Relationships-Relationships Structures questionnaire|
|eMHS: electronic mental health service|
|ETAM: e-therapy attitudes measure|
|Mdiff: mean difference|
|PSQ-20: Perceived Stress Questionnaire 20-item short version|
|PU: perceived usefulness and helpfulness|
|RA: relative advantage and comparability|
|SOEP: socioeconomic panel|
|VCP: videoconferencing psychotherapy|
Edited by G Eysenbach; submitted 09.04.18; peer-reviewed by B Arnoldussen, M Medich, MIK Almani; comments to author 02.05.18; revised version received 03.05.18; accepted 03.05.18; published 15.05.18Copyright
©Jennifer Apolinário-Hagen, Mathias Harrer, Fanny Kählke, Lara Fritsche, Christel Salewski, David Daniel Ebert. Originally published in JMIR Mental Health (http://mental.jmir.org), 15.05.2018.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Mental Health, is properly cited. The complete bibliographic information, a link to the original publication on http://mental.jmir.org/, as well as this copyright and license information must be included.