This paper is in the following e-collection/theme issue:

Interventions and Support for Informal Caregivers of People with Mental Illness (96) Psychotic Disorders (160) Digital Mental Health Interventions, e-Mental Health and Cyberpsychology (1514) Peer-to-Peer Support and Online Communities (636) Bipolar Disorders (56)

Published on in Vol 9, No 10 (2022): October

This is a member publication of Lancaster University (Jisc)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/35837, first published .
Use of an Online Forum for Relatives of People With Psychosis and Bipolar Disorder: Mixed Methods Study

Use of an Online Forum for Relatives of People With Psychosis and Bipolar Disorder: Mixed Methods Study

Use of an Online Forum for Relatives of People With Psychosis and Bipolar Disorder: Mixed Methods Study

Authors of this article:

Steven Jones1 Author Orcid Image ;   Dimitrinka Atanasova2 Author Orcid Image ;   Susanna Dodd3 Author Orcid Image ;   Susan Flowers1 Author Orcid Image ;   Anna Rosala-Hallas3 Author Orcid Image ;   Heather Robinson1 Author Orcid Image ;   Elena Semino4 Author Orcid Image ;   Fiona Lobban1 Author Orcid Image
Article Authors Cited by (4) Tweetations (9) Metrics

    Original Paper

    1Spectrum Centre for Mental Health Research, Division of Health Research, Lancaster University, Lancaster, United Kingdom

    2DisTex - Discourse and Text Research Group, Lancaster University, Lancaster, United Kingdom

    3Department of Biostatistics, Clinical Trials Research Centre, University of Liverpool, Liverpool, United Kingdom

    4Department of Linguistics and English Language, Lancaster University, Lancaster, United Kingdom

    Corresponding Author:

    Steven Jones, BSc, MSc, PhD

    Spectrum Centre for Mental Health Research

    Division of Health Research

    Lancaster University

    Health Innovation 1

    Sir John Fisher Drive

    Lancaster, LA1 4AT

    United Kingdom

    Phone: 44 1525 593382

    Email: s.jones7@lancaster.ac.uk


    Background: Relatives of people with psychosis or bipolar disorder experience high levels of distress but are typically not offered the support they need. Online peer forums may offer a solution, but knowledge about who uses them, how, and why is limited. This study reported on online forum use during the Relatives Education and Coping Toolkit (REACT) trial.

    Objective: We aimed to report who used the forum and why; how sociodemographic factors are associated with participation; the relationship among frequency, type of use, and outcomes; and how the forum was used.

    Methods: The relationships between key sociodemographic characteristics, levels of forum use, and distress were statistically analyzed. We used thematic and semantic analyses to understand the reasons for relatives joining the forum and the key topics initiated by them. We also used the University Centre for Computer Corpus Research on Language Semantic Analysis System to compare how relatives and REACT supporters (moderators) used the forum.

    Results: A total of 348 participants with full forum use data from REACT were included in this study. The forum was accessed by 59.4% (207/348) of the relatives across the entire age range, with no significant associations between sociodemographic factors and forum participation, or between level or type of use and relatives’ distress levels. Relatives joined the forum primarily to find people in similar circumstances, express concerns, and talk about stressful events. Relatives were most concerned about recent events, negative emotions linked to caring, experiences of conflict or threat, and concerns about suicide. These posts underscored both the challenges the relatives were facing and the fact that they felt safe sharing them in this context.

    Conclusions: Although only a proportion of REACT participants engaged actively with its forum, they were widely distributed across age and other sociodemographic groupings. Relatives used the forum for information, support, and guidance and to offer detailed information about their experiences. The topics raised highlighted the burden carried by relatives and the potential value of easy-access, moderated, peer-supported forums in helping relatives to manage the challenges they faced.

    JMIR Ment Health 2022;9(10):e35837

    doi:10.2196/35837

    Keywords

    psychosis; bipolar disorder; relative; carer; mental health; forum; online; digital health; Relatives Education and Coping Toolkit; REACT; trial 


    Background

    Psychosis and bipolar disorder (BD) are severe mental health problems affecting 2% to 4% of the global population, respectively [1,2], with a cost of £9.2 billion (US $10.1 billion) per year to the English economy [3]. Relatives of individuals with these conditions deliver vital but unpaid care [4]. However, this caring role often comes at a huge cost to the relatives themselves in terms of burden and distress [5,6].

    There is increasing awareness of the need to support relatives of people with mental health problems [7]. The National Institute for Health and Care Excellence [8] recommends that relatives receive education, information, and support [9]. With support, relatives have better health outcomes [10].

    Despite this, most relatives receive little support [11-13]. Furthermore, most evidence is for face-to-face interventions, which have not been widely adopted. This reflects a lack of provision of family interventions across the United Kingdom as well as some relatives not taking up such approaches when offered. The Royal College of Psychiatrists Report of the Early Intervention in Psychosis Audit, for instance, indicated that of more than 1901 families in early intervention services, only 31% were offered family intervention, of whom 38% took up this offer [14]. A crucial question is how support for relatives can be delivered accessibly and cost-effectively at scale. Web-based interventions have been established for several mental health conditions, including depression and anxiety [15,16], with increasing evidence for the benefits for people with severe mental health problems [17] and their relatives [12,18]. Online forums offer an accessible space where users can connect anonymously [19], with growing evidence of the benefits of forum engagement [20]. However, the use of forums by relatives has been largely ignored, with some exceptions [21-24], especially for relatives of people with mental health difficulties.

    Objectives

    This paper aimed to report on forum use from a large national UK digital mental health trial (Relatives Education and Coping Toolkit [REACT]) [24-26]. The REACT trial found that the intervention was inexpensive and acceptable, and was a safe method of delivering support for relatives of people with psychosis and BD. Both the REACT intervention and access to a digital resource directory were associated with significant increases in carer well-being and reduction in distress; however, there was no difference between the 2 trial arms in these outcomes at either 12 or 24 weeks of follow-up. Of the 800 participants in the REACT trial, 399 (49.8%) were in the active intervention arm, with access to a peer-supported moderated forum. Here, we report on their patterns of REACT forum use during the trial. Specifically, we aimed to explore (1) who used the forum and why; (2) how sociodemographic characteristics are associated with participation, taking into consideration previous research on patterns of use of digital resources linked to age, sex, education, and employment or income [27]; (3) the relationship among frequency, type of use, and outcomes; and (4) how the forum was used.


    The REACT Forum and Trial

    REACT was originally developed as a printed toolkit or web page and reduces relatives’ distress [26]. To increase access and flexibility, REACT was adapted into an internet-based digital intervention [25] built in WordPress (Automattic Inc.) with a number of plug-ins. These included bbPress (Automattic Inc.) to run the REACT group forum. The content of the toolkit was informed by family intervention models for people with psychosis [11]. The key components of the toolkit were as follows: 12 information modules, a comprehensive resource directory, a group forum, and a confidential direct messaging service. A meet the team page ensured that relatives were fully informed about who was delivering the content of the site. Mytoolbox offered users a confidential space to save links to any information they might keep. A blog page offered a flexible space for additional communication with site users, edited by the REACT supporters. The screenshots in Figure 1 show the look and feel of the REACT website.

    REACT users were offered support through confidential direct messaging with REACT supporters and peer support through a moderated online forum. The REACT supporters were available on the site from Monday to Friday, from 9 AM to 4:30 PM, excluding bank holidays and university holiday closures. Their key role was to provide emotional support and to guide relatives to relevant parts of the toolkit or other resources, as appropriate.

    ‎
    Figure 1. Screenshots of Relatives Education and Coping Toolkit (REACT).
    View this figure

    Training REACT Supporters From the REACT Trial

    The REACT supporters had experience of caring for someone with BD or psychosis, but were otherwise not required to have any other educational or clinical experience. REACT supporters were trained to moderate the online REACT forum and to respond to direct confidential messages. The training was provided by the clinical supervisor (SJ) and the chief investigator (FL) before the launch of REACT and focused on providing empathetic support and guiding relatives to use the toolkit in the best way to help them with their concerns. The supporters were not formally clinically trained, as their focus was on providing support and specifically not on providing advice. This preparatory work included group discussions on the nature of the work and the distinctions between support and advice. REACT supporters also reviewed vignettes of possible forum posts to gain practice in response options in advance of the REACT site going live. Potential responses were reviewed with SJ. REACT supporters then received regular supervision from SJ, covering issues raised on the forum and any risk concerns, as well as supporter well-being and ensuring forum coverage during periods of leave. These sessions occurred 1.8 times per month on 1-2 times per month across the duration of the trial. SJ was also available for ad hoc meetings, when required. The IT support lead (Andrew Walker) provided technical training to ensure that the supporters were very familiar with the whole of the REACT site and with how to access the automated emails informing them about posts. The REACT supporters were also provided with, and helped develop, several written documents: a training document regarding supporter roles and the site; a REACT Supporter Manual that included examples of posts and risk emails; a thorough Risk Protocol and Matrix that outlined what to do in the event of risk being identified on the site; and several documents regarding the use of the site, for example, how to search for a forum post and how to hide inappropriate content.

    REACT supporters were required to check the forum at least three times a day, from Monday to Friday. They identified dangerous behaviors or concerns, categorizing them as low or high risk. Low risk was defined as no indication of immediate or serious threat of severe harm or risk to life but the presence of either clear evidence of high levels of distress or concerns for risk of harm or abuse toward participants or others (safeguarding risks). Where high distress was identified, REACT supporters responded with a standardized email. Where a safeguarding issue was identified, REACT supporters consulted their clinical supervisor and National Health Service trust safeguarding team. High risk was defined as the presence of clear evidence of immediate and serious risk to life or child welfare. If an immediate risk was identified, the REACT supporters called the police or social services, depending on the risk. Risk was identified based on participants’ post content rather than on their post frequency. REACT supporters also monitored the forum for inappropriate posts and could hide them if necessary. All risks and inappropriate posts were discussed during clinical supervision or at an earlier meeting if needed.

    REACT also contained an extensive resource directory. The REACT trial was a web-based, 2-arm, pragmatic randomized controlled trial comparing the REACT intervention to only providing access to the resource directory. Outcomes were assessed at baseline, the 12-week follow-up, and the 24-week follow-up. The primary outcome was relatives’ distress, assessed using the General Health Questionnaire (GHQ)-28 [28]. Participants were recruited to the REACT trial from April 22, 2016, to September 30, 2017. A range of web-based (Facebook, Twitter, and charity websites) and offline recruitment strategies (clinical services and third sector providers) were used, all directing potential participants to the study home page.

    Participants

    Participants in this study comprised 348 individuals randomized into the REACT intervention arm. From the original 399 participants allocated to REACT, 51 (12.8%) were excluded because their complete web use data were not recorded.

    The inclusion criteria were (more details are presented in the trial paper by Lobban et al [24]) the following:

    • Aged ≥16 years
    • Living in the United Kingdom
    • Relative or close friend of someone with psychosis or BD
    • Currently experiencing distress
    • Currently seeking help (self-identified)
    • Having access to the internet
    • Sufficient English fluency to comprehend the intervention and forum content

    Participants were identified as “currently experiencing distress” because of their relative or close friend, by their selecting “rather more than usual” or “much more than usual” on the GHQ-28 item “Have you been feeling nervous and strung up all the time?” This was included to avoid a floor effect on levels of distress at baseline, and this item was used because it correlated most highly with the GHQ-28 score in the REACT feasibility trial [26]. An age cutoff of ≥16 years was used as this is the legal age of consent, and the REACT intervention aimed to be inclusive of all carers of people with psychosis or bipolar; many carers were aged 16 to 18 years.

    Analysis

    Overview

    Participants’ forum activity was recorded from randomization until the date of their primary outcome assessment (GHQ-28 score at 24 weeks) or, if the assessment was not completed, the date on which it would have taken place. Participants were classified based on their use levels as nonusers (did not access forum at all), observers (accessed the forum but did not post), or users (accessed and posted on the forum at least once). Analyses were conducted using Stata (StataCorp; version 14). A Cronbach α level of P<.05 was used as a general indicator of statistical significance. A complete case analysis approach was adopted. Use levels of the forum were identified based on participant IDs. As there were a number of exploratory analyses, all results have been interpreted cautiously.

    Who Used the Forum and for What Reasons

    To outline who used the forum, descriptive statistics were calculated based on the level of use and different demographic factors (age, gender, highest education level, and employment status).

    To explore why relatives started using the forum, 2 coauthors (DA and ES) classified the functions of relatives’ first posts by adapting the Rohr [29] coding scheme. The Rohr coding scheme is based on the concept of “discursive moves” defined as the kinds of contributions that entries make to the ongoing interchange, in turn based on the Locher [30] and Morrow [31] catalog of discursive moves. All functions were retained from the Rohr coding scheme except functions associated with the moderators’ posts (eg, “official welcome,” described as users being welcomed to the forum by a moderator). We inductively added the category “other” for posts discussing technical aspects of the forum’s use. Initially, a small random subsample of first posts was examined to ensure that they would be categorized into the same theme by the 2 coauthors. A standardized procedure for coding agreement such as interrater reliability was not adopted because a reflexive approach to thematic analysis was used. As Braun and Clarke [32] write, “this approach fully embraces qualitative research values and the subjective skills the researcher brings to the process—a research team is not required for quality.”

    The analysis focused on the messages written by 19.2% (67/348) of the relatives, which is a sample of participants who had complete web use data available. One first post could be coded for more than one function.

    Sociodemographic Factors Associated With Participation

    Associations between sociodemographic factors (age, gender, education level, and employment status) and forum use levels were compared using Fisher exact tests, split according to no active participation (no posts), low active participation (up to five forum posts), and high active participation (>5 forum posts). A total of 5 forum posts were chosen as a cutoff based on a consensus team decision that 5 posts is the minimum number to be actively engaged with the forum; the 5-post cutoff identified the top one-third of the posters.

    Relationship Among Frequency, Type of Use, and Outcomes

    We calculated the mean GHQ-28 scores (the primary outcome of the REACT trial) at each time point (baseline, 12 weeks, and 24 weeks) and for each forum use level (nonuser, observer, and user). Spearman correlation coefficients were used to assess the relationship between the number of forum posts and GHQ-28 scores.

    How Was the Forum Used?

    To explore how relatives and REACT supporters used the forum differently, 2 data sets were created, consisting of the following categories:

    • Topics initiated by relatives (“User Topics”): 33,201 words
    • Topics initiated by supporters (“Supporter Topics”): 335,819 words

    To explore potential differences between the 2 data sets, the University Centre for Computer Corpus Research on Language Semantic Analysis System (USAS) was used in the web-based software Wmatrix [33].

    USAS is a tagging program that automatically assigns a semantic category label (or semantic tag) to every word or phrase in a linguistic data set, or “corpus.” The category scheme consists of 21 general semantic domains (eg, “Emotion”) and 232 more specific subdomains (eg, “Sad” as a subdomain of “Emotion”). Unlike other types of content analysis systems such as Linguistic Inquiry and Word Count [34], the USAS tagger takes into account the meaning of a word or phrase in context to assign an appropriate tag. A central aspect of this contextual disambiguation is the tagger’s ability to assign single tags to phrases or multiword expressions, including phrasal verbs (eg, “look after”) and proper names (eg, “Milton Keynes”). The tool has been shown to have a level of accuracy of approximately 91% [35].

    We used the web-based concordancer, Wmatrix, which applies the USAS semantic tagger to any text loaded into the system, to compare topics initiated by relatives with topics initiated by REACT supporters in terms of the relative frequencies of the 232 specific semantic domains to establish which semantic domains are “key” or “overused” in the former compared with the latter, according to the following 2 statistical measures:

    • LogRatio: a measure of effect size, that is, the binary log of the ratio of relative frequencies in the 2 data sets [36].
    • Log Likelihood: a measure of statistical significance that is sensitive to the size of the evidence that a difference exists [29].

    We set a minimum LogRatio score of 0.5, meaning that the relevant semantic domain is 50% more frequent in the target corpus (relatives) than in the reference corpus (supporters) and a minimum Log Likelihood threshold of 6.63, providing a confidence measure equivalent to P=.01 [37].

    Ethics Approval

    All procedures contributing to this work comply with the ethical standards of the relevant national and institutional committees on human experimentation and with the Helsinki Declaration of 1975, as revised in 2008. All participants provided written informed consent, and all procedures were approved by the Lancaster National Research Ethics Service Committee (15/NW/0732).


    Who Used the Forum and for What Reasons

    Active forum use was distributed across all age bands of the trial, except for those aged ≥70 years. For this age group, participants were either nonusers or only observers (Table 1). Most forum participants were considered observers. The users were aged 40 to 69 years. Overall, more women than men participated in the REACT forum, with a higher percentage of women in the observer and user groups. There were few differences in education, except for a suggestion that users were more likely to have engaged with higher education. No meaningful differences were observed in terms of employment, which was similarly distributed across no paid employment, part-time employment, and full-time employment for all 3 groups.

    Table 1. Demographic characteristics of forum users (N=348).
    CharacteristicNonuser (never logged in; N=141), n (%)Observer (no posts; N=140), n (%)User (at least one post; N=67), n (%)Total
    Age (years)

    		<3019 (13)13 (9)3 (4)35

    		30-3918 (13)15 (11)12 (18)45

    		40-4939 (28)30 (21)13 (19)82

    		50-5931 (22)45 (32)21 (31)97

    		60-6925 (18)31 (22)18 (27)74

    		≥709 (6)6 (4)0 (0)15
    Sex

    		Female99 (70)114 (81)58 (87)271

    		Male42 (30)26 (19)9 (13)77
    Highest education level

    		School level25 (18)25 (18)7 (10)57

    		Further (UK college level)41 (29)39 (28)18 (27)98

    		Higher (UK university level)75 (53)76 (54)42 (63)193
    Employment status

    		None or unpaid54 (38)59 (42)25 (37)138

    		Part-time32 (23)32 (23)16 (24)80

    		Full-time55 (39)49 (35)26 (39)130

    The total word count of the first 67 posts was 14,070. Posts varied between 25 and 866 words, with a mean of 210 words. Posts were manually coded for the following functions to capture patterns in content and interactional characteristics.

    • greeting: a formal opening move (eg, “Hello”)
    • meta-comment: a comment on the experience of using the forum (eg, “New here so just finding my way about”)
    • background information: provide information about oneself or the issue at hand (eg, “My wife suffers some severe symptoms, has many triggers”)
    • request for advice or information or support: asking for guidance (eg, “So is there any advice or techniques anyone can suggest”)
    • provision of advice or information or support: providing guidance (eg, “So if you have a crisis team, I would recommend contacting them”)
    • thank: thank in anticipation of the advice or information or support, or for writing or reading (eg, “Thank you,” “Thanks for sharing this”)
    • well-wishing: wish someone well (eg, “All the very best for the future”)
    • farewell: a formal closing move (eg, “Regards”)

    A total of 22 (32.8%) posts began with a greeting; 21 (31.3%) made a meta-comment about using the forum; 64 (95.5%) provided background information about the relative or the issue that prompted them to post on the forum; 14 (20.9%) included a request for advice, information, and support; 13 (19.4%) provided advice about possible courses of action; 11 (16.4%) expressed gratitude to others for advice or simply for writing and reading posts; 3 (4.5%) included well-wishes; and 1 (1.5%) ended with a formal farewell.

    Most posts (53/67, 79.1%) provided information about the posters’ circumstances, without requests for advice or information. This suggests that the forum was primarily used to find people in similar circumstances, express concerns, and talk about stressful events. Some contributors made this explicit, with comments such as “Hello, I am so happy I have found this link! All your messages are deeply resonating in me.”

    Are Sociodemographic Factors Associated With Participation?

    We looked at the distribution of the total number of forum posts across all participants except for a single outlier (who posted in the forum 205 times) to show the distribution of lower values more clearly. This revealed a significant negative skew, with 81% (281/348) of the sample not posting at all and 93% (325/348) of the sample posting ≤5 times. The average number of posts, with outliers excluded, was 6.8 (SD 9.3).

    Participants were classified as having “highly participated” if they were in the top one-third of active forum users, that is, those who posted >5 times in the forum (Table 2). There were no statistically significant relationships indicated among age, gender, education or employment, and level of forum use. Numerically there was an indication that the high-use group had a preponderance of participants aged 50 to 59 years, but the association between high or low use was not significant.

    Table 2. Demographic characteristics of relatives according to amount of forum use (N=348).
    CharacteristicNo active participation (no posts; N=281), n (%)Low active participation (1-5 posts; N=44), n (%)High active participation (>5 posts; N=23), n (%)TotalFisher exact test, P value
    Age (years).27

    		<3032 (11)3 (7)0 (0)35

    		30-3933 (12)8 (18)4 (17)45

    		40-4969 (25)9 (20)4 (17)82

    		50-5976 (27)11 (25)10 (43)97

    		60-6956 (20)13 (30)5 (22)74

    		≥7015 (5)0 (0)0 (0)15
    Sex.18

    		Female213 (76)38 (86)20 (87)271

    		Male68 (24)6 (14)3 (13)77
    Highest education level.64

    		School level50 (18)4 (9)3 (13)57

    		Further (UK college level)80 (28)12 (27)6 (26)98

    		Higher (UK university level)151 (54)28 (64)14 (61)193
    Employment status.94

    		None or unpaid113 (40)15 (34)10 (43)138

    		Part-time64 (23)11 (25)5 (22)80

    		Full-time104 (37)18 (41)8 (35)130

    Relationships Among Frequency, Type of Use, and Outcomes

    The primary outcome for the REACT trial was the GHQ-28 scores. Therefore, we explored the relationship between this and forum use based on the nonuser, observer, and user categories. The mean levels of GHQ scores at each time point are very similar for each use group (Table 3).

    Spearman correlations were calculated for those who used the forum to explore any relationships between forum use and GHQ-28 scores. As Table 4 indicates, all these correlations were small and nonsignificant.

    Table 3. General Health Questionnaire-28 (GHQ-28) scores of relatives by time and level of forum use.
    ValuesGHQ-28 at baselineGHQ-28 at 12 weeksGHQ-28 at 24 weeks

    		Nonuser (n=141)Observer (n=140)User (n=67)Nonuser (n=77)Observer (n=108)User (n=60)Nonuser (n=83)Observer (n=110)User (n=59)
    Value, mean (SD)40.9 (15.6)39.8 (13.4)41.2 (16.0)29.9 (16.3)31.8 (17.0)29.9 (12.3)30.2 (17.8)30.7 (16.0)28.7 (16.2)
    Value, median (IQR)39 (29-51)39 (29-49)38 (29-53)26 (17-42)29 (19.5-39)28 (22-35.5)26 (16-43)28 (18-41)26 (17-37)
    Value, range5-8318-8317-764-735-803-632-766-785-79
    Missing, n (%)0 (0)0 (0)0 (0)64 (45)32 (23)7 (10)58 (41)30 (21)8 (12)
    Table 4. Correlations between forum use and General Health Questionnaire-28 (GHQ-28) scores at each assessment point.
    Assessment point for GHQ-28 scoreSpearman correlation coefficient (P value) for forum users onlySpearman correlation coefficient (P value) for forum users only (outlier removed)Spearman correlation coefficient (P value) for all REACTa participants (outlier removed)
    Baseline−0.003 (.98)0.005 (.96)0.006 (.91)
    12 weeks−0.113 (.38)−0.071 (.59)0.005 (.94)
    24 weeks−0.091 (.49)−0.054 (.68)−0.034 (.58)

    aREACT: Relatives Education and Coping Toolkit.

    How Was the Forum Used?

    Only REACT supporters could start a new thread (eg, include “happiness and wellbeing,” “treatment services,” “all things legal,” and “dealing with difficult behaviour”), but relatives could start a new topic within an existing forum, which is something they did 131 times. These relative-initiated topics (and their descriptions) totaled 33,201 words (User Topics), in contrast with supporter-initiated topics, which totaled 335,819 words (Supporter Topics).

    Table 5 lists the 21 semantic domains statistically overused in User Topics than in Supporter Topics. The rightmost column gives examples of the words included under each semantic domain.

    The 21 overused domains include the following major themes:

    • Time, including beginnings, endings, age, and recency
    • Negative emotions, including fear, depression, and anxiety
    • Conflict and abuse, including anger, threats, and abuse
    • Illness and hospitalization, including psychosis and discharge
    • Death and suicide

    Overall, this suggests that users typically initiated topics to talk about particularly acute problems relating to their relative’s condition and, therefore, their own situation. These problems sometimes involve actual, feared, or threatened violence or suicide, and have often worsened before the decision to write on the forum. Some examples are given in Table 6, which indicate both the extent of the challenges experienced by these relatives and their frankness about them on the forum.

    Table 5. Semantic domains used more by relatives than supporters.
    CodeRaw frequency Corpus 1Relative frequency Corpus 1Raw frequency Corpus 2Relative frequency Corpus 2LLaLogRatioLabelExample words
    X7-170.05200.0210.791.63UnwantedRubbishb, rejected
    A13.4630.20900.0829.581.35Degree: ApproximatorsAbout, almost
    T3480.15700.0621.731.32Time: Old, new and young; ageAge, one, aged
    T1.1660.211020.0926.801.23Time: GeneralAppointment or appointments
    M3540.17860.0820.661.19Vehicles and transport on landCar, drive
    A1.7-350.11570.0512.791.16No constraintDischarge or dishcarged, escape
    T3-270.09470.048.511.06Time: New and youngRecently
    E5-590.191030.0918.481.06Fear or shockScared, fear, terrified
    H4650.211180.1018.531.00ResidenceHome, live
    E4.1-1010.321920.1725.550.93SadDepression, depressed
    L2280.09540.056.810.91Living creatures: animals, birds, etcDog, cat or cats
    L1-310.10600.057.470.91DeadSuicide, death, died, suicidal
    T1.1.11500.473110.2729.450.81Time: PastLast year, yesterday
    T3-540.171210.118.110.70Time: New and youngNew
    E3-910.292040.1813.650.70Violent or AngryAngry, abuse, anger, threatening
    T1.1.22080.664860.4226.500.64Time: Present; simultaneousNow, today, at the moment, currently
    T2-890.282130.1910.230.60Time: EndingStop, ended up
    B2-3100.987470.6534.580.59DiseasePsychosis, symptoms, unwell, disorder, ill
    N42090.665200.4520.070.54Linear orderThen, first, last, finally
    T2+880.282220.197.880.52Time: BeginningStarted, start, finally
    E6-1600.514070.3513.730.51WorryAnxiety, worry, stress, worried

    aLL: Log Likelihood.

    bItalicized text represents example words.

    Table 6. Themes illustrating how relatives used the forum.
    ThemeTitleText
    Time, including beginnings, endings, age and recencyHow to get supported housing“Just over a month ago my husband was diagnosed as having BD. Last Thursday after a very violent outburst with police involved and trip to hospital my eldest son who is 35 has been diagnosed with borderline personality disorder. He was off work last week with a physical problem, but today is hiding under the bedcovers having not slept with worrying.”
    Negative emotions, including fear, depression, and anxietyStarting a family“I\'m really struggling at the moment, and no one really to talk to, and even when I do they don\'t really seem to understand... It’s so exhausting keeping up with the switches and changes, the rejection and lack of empathy...”
    Conflict and abuse, including anger, threats, and abuseHow to deal with verbal abuse and aggression“I was wondering if anyone had any suggestions on how to handle abusive behaviour? My husband is hypomanic at the moment and this unfortunately involves aggressive and abusive behaviour—shouting, bullying, demeaning, berating, controlling...”
    Illness and hospitalization, including psychosis and dischargeHow to get supported housing“Good morning all. I need some advice on how to get some help for my son. He is currently living in a general purpose housing association flat. He...has schizophrenia, with alcohol and gambling addictions. [...] His life is absolutely chaotic... [...] I have talked to his care coordinator but she seems to have no time to help us...Has anyone any advice?”
    Death and suicideHow can we support him?“He has a history of attempting suicide and we are so scared that we will lose him and that is his ultimate threat. His Dad and I are at the point that we can\'t support him at this level any more.”

    Principal Findings

    This paper drew on data from a national trial examining the effectiveness of interactive digital support for relatives of people with psychosis or BD. Using detailed forum data, this paper explored who used the forum and why; how sociodemographic characteristics were associated with participation; the relationship among frequency, type of use, and outcomes; and how the forum was used.

    In terms of who used the forum and why, it was found that there were no differences in sociodemographic variables among users, observers, and nonusers. Relatives who accessed the forum covered the whole age range; those aged ≥70 years did not include active forum participants but did include observers. There was a range of reasons behind participants’ first use of the forum. Typically, relatives’ first posts indicated a desire to connect with others in similar circumstances and share experiences rather than specific requests for advice or information.

    It was found there were no associations between patterns of use and sociodemographic variables. Women and participants who had engaged with higher education were more likely to be users, but the differences were small. This contrasts with prior research on the use of digital resources in general and may be linked to the level of need for support in this group of carers [27].

    Previous research has indicated that the 1% rule (90% of social media users observe but do not participate, 9% contribute in a limited way, and 1% contribute substantially [38,39]) applies to a number of digital social networks for mental health. In contrast to this, in this study, 59% (207/348) of the people accessed the forum and of those who did, 33% (67/207) posted. This level of engagement may reflect the lack of other support available to the relatives in this study. Levels of use were not significantly associated with relatives’ well-being at any of the assessment points in the study. This may reflect previous research indicating that observers can benefit from reading posts without posting themselves [40].

    To determine how the forum was used, patterns of relative-initiated and REACT supporter–initiated posts were compared. Relatives engaged more strongly with domains linked to acute issues with their relatives and their own personal situation. These spanned across themes of time, negative emotions, conflict and abuse, and death and suicide. The details provided in posts of these types highlight the scale of the challenges experienced by relatives and the fact that they felt safe to share extensive and often painful personal details in this context. This is consistent with qualitative interviews with REACT participants, which highlighted the crucial importance of peer support through both REACT supporters and through sharing with other relatives [25].

    Comparisons With Prior Work

    The reasons relatives joined the forum mainly consisted of a desire to connect with others and share their experiences, with relatives identifying the value of peer support and information sharing in their posts. This is consistent with the wider literature on mental health that indicates that people with lived experiences are often successful in promoting hope, empowerment, and social inclusion in peers by sharing personal experiences [41]. Relatives felt that they were able to offer detailed information about their experiences, possibly aided by the anonymity of the platform. Anonymity was confirmed to be important in qualitative interviews with the participants, published in the study by Lobban et al [25].

    Previous research has suggested that older people do not use forums [42]; however, our findings suggest that older people do use forums, but they may be less active. Previous research has also suggested that digital resources might better serve people with higher levels of education [43], which is a finding that, this study supports, as people with higher levels of education tended to use the forums more.

    Previous research on forum use by relatives has been extremely limited. Smith-Merry et al [22] conducted qualitative interviews with relatives and people living with psychosis from the Schizophrenia a National Emergency Australia forums. Consistent with this study, participants highlighted the importance of social connections, information, and practical advice, although it was not possible to identify the priorities of relatives. Terbeck and Chesterman [22] explored posts in 5 different forums by parents of children with suspected attention-deficit or hyperactivity disorder. Their content analysis indicated that parents typically received empathic and supportive responses to their initial posts, predominantly regarding dissatisfaction with professionals. This led the authors to suggest that such forums may decrease faith in health services and lead to “doctor shopping.” This was not the dominant pattern in the REACT forum data. Some participants did post about service limitations, but this was part of a range of topics that went beyond clinical care. Mazur and Mickle [23] explored web-based forum posts of parents of children with attention-deficit or hyperactivity disorder, BD, and depressive and anxiety disorders across 4 different forums. Content analysis indicated the importance of advice seeking and addressing feelings of helplessness across parents as well as concerns regarding verbal or physical conflict in relation to their child. Similar themes arose in this study, particularly around concerns regarding conflicts and abuse in relation to one’s relatives.

    Limitations

    Although this paper provides important insights into forum use among relatives of people with serious mental illness, caution is needed when generalizing the results to the general population of relatives. This study was based on users of the REACT forum, all of whom were highly distressed and were taking part in the REACT trial. They may differ from those not experiencing high levels of distress or not actively involved in research and in seeking support because of their caring role. Furthermore, people from ethnic minority backgrounds were underrepresented in this study, as the overwhelming majority (331/348, 95%) of participants were from a White ethnic background. Future studies would benefit from a more diverse sample.

    Conclusions

    Overall, this study indicates that, although only a proportion of users of digital support interventions for relatives engage actively with the forums, they are widely distributed across age and other sociodemographic groupings. Sociodemographic variables were not linked to levels of use. Relatives used the forums for information, support, and guidance and felt that they were able to offer detailed information about their experiences, possibly aided by the anonymity of the platform. Anonymity was confirmed as important in qualitative interviews with the participants, published in the study by Lobban et al [25]. Given that some common themes emerged, which may be useful for other forum user groups, development of good practice guidance across user groups is important for future studies to provide an understanding of forum use and the associated benefits and challenges at a larger scale. The topics raised highlight the extent of the burden carried by relatives and the potential value of easy-access, moderated, peer-supported forums in helping relatives to manage the challenges in their lives.

    Acknowledgments

    The Relatives Education and Coping Toolkit randomized controlled trial was funded by a National Institutes for Health Research Health Technology Assessment grant (14/49/34). The funding source had no role in study design, data collection, data analysis, data interpretation, or writing of the manuscript. The corresponding author had full access to all the data in the study and had final responsibility for the decision to submit for publication. The Relatives Education and Coping Toolkit randomized controlled trial was sponsored by Lancaster University (HRM7891). The sponsor had no role in the review or approval of this manuscript for publication. The authors wish to acknowledge the help of Zoe Glossop in helping finalize the formatting of the manuscript.

    Authors' Contributions

    SJ was a grant holder on the Relatives Education and Coping Toolkit (REACT) trial and led the writing of this paper; FL was the chief investigator for the REACT trial. All other authors are listed alphabetically. DA and ES led the linguistic analysis of the forum data, and SD and ARH led the statistical analysis of the forum data. HR was the trial manager for the REACT trial. SF was a REACT supporter and moderator of the forum. All authors contributed to the writing of the manuscript and approved the final version.

    Conflicts of Interest

    FL and SJ were part of the team that developed the Relatives Education and Coping Toolkit intervention, so this is not an independent evaluation.

    1. McGrath JJ, Saha S, Al-Hamzawi AO, Alonso J, Andrade L, Borges G, et al. Age of onset and lifetime projected risk of psychotic experiences: cross-national data from the world mental health survey. Schizophr Bull 2016 Jul 02;42(4):933-941 [FREE Full text] [CrossRef] [Medline]
    2. Merikangas KR, Akiskal HS, Angst J, Greenberg PE, Hirschfeld RM, Petukhova M, et al. Lifetime and 12-month prevalence of bipolar spectrum disorder in the National Comorbidity Survey replication. Arch Gen Psychiatry 2007 May 01;64(5):543-552 [FREE Full text] [CrossRef] [Medline]
    3. McCrone P. Paying the Price The Cost of Mental Health Care in England to 2026. London, United Kingdom: King's Fund; 2008.
    4. Valuing Carers 2011: calculating the value of carers’ support. Carers UK. 2011 Jun 1.   URL: https:/​/www.​carersuk.org/​for-professionals/​policy/​policy-library/​valuing-carers-2011-calculating-the-value-of-carers-support [accessed 2022-08-15]
    5. Lowyck B, De Hert M, Peeters E, Wampers M, Gilis P, Peuskens J. A study of the family burden of 150 family members of schizophrenic patients. Eur Psychiatry 2004 Nov 16;19(7):395-401. [CrossRef] [Medline]
    6. Perlick D, Clarkin JF, Sirey J, Raue P, Greenfield S, Struening E, et al. Burden experienced by care-givers of persons with bipolar affective disorder. Br J Psychiatry 1999 Jul 03;175(1):56-62. [CrossRef] [Medline]
    7. Care Act 2014. legislation.gov.uk. 2014.   URL: https://www.legislation.gov.uk/ukpga/2014/23/contents/enacted [accessed 2021-03-23]
    8. Bipolar Disorder: the Assessment and Management of Bipolar Disorder in Adults, Children and Young People in Primary and Secondary Care. London, United Kingdom: The Royal College of Psychiatrists; 2014.
    9. Psychosis and Schizophrenia in Adults: Prevention and Management. London: National Institute for Health and Clinical Excellence; 2014.
    10. Sin J, Gillard S, Spain D, Cornelius V, Chen T, Henderson C. Effectiveness of psychoeducational interventions for family carers of people with psychosis: a systematic review and meta-analysis. Clin Psychol Rev 2017 Aug;56:13-24 [FREE Full text] [CrossRef] [Medline]
    11. Lobban F, Postlethwaite A, Glentworth D, Pinfold V, Wainwright L, Dunn G, et al. A systematic review of randomised controlled trials of interventions reporting outcomes for relatives of people with psychosis. Clin Psychol Rev 2013 Apr;33(3):372-382 [FREE Full text] [CrossRef] [Medline]
    12. Sin J, Henderson C, Spain D, Cornelius V, Chen T, Gillard S. eHealth interventions for family carers of people with long term illness: a promising approach? Clin Psychol Rev 2018 Mar;60:109-125 [FREE Full text] [CrossRef] [Medline]
    13. Lorca-Cabrera J, Grau C, Martí-Arques R, Raigal-Aran L, Falcó-Pegueroles A, Albacar-Riobóo N. Effectiveness of health web-based and mobile app-based interventions designed to improve informal caregiver's well-being and quality of life: a systematic review. Int J Med Inform 2020 Feb;134:104003. [CrossRef] [Medline]
    14. Early Intervention in Psychosis Audit report. Healthcare Quality Improvement Partnership. 2016 Jul 4.   URL: https://www.hqip.org.uk/resource/early-intervention-in-psychosis-audit-report/#.YzsGMXZBzIV [accessed 2022-10-03]
    15. Arnberg FK, Linton SJ, Hultcrantz M, Heintz E, Jonsson U. Internet-delivered psychological treatments for mood and anxiety disorders: a systematic review of their efficacy, safety, and cost-effectiveness. PLoS One 2014 May 20;9(5):e98118 [FREE Full text] [CrossRef] [Medline]
    16. Teesson M, Newton NC, Slade T, Chapman C, Birrell L, Mewton L, et al. Combined prevention for substance use, depression, and anxiety in adolescence: a cluster-randomised controlled trial of a digital online intervention. Lancet Digital Health 2020 Feb;2(2):e74-e84. [CrossRef]
    17. Alvarez-Jimenez M, Alcazar-Corcoles M, González-Blanch C, Bendall S, McGorry P, Gleeson J. Online, social media and mobile technologies for psychosis treatment: a systematic review on novel user-led interventions. Schizophr Res 2014 Jun;156(1):96-106. [CrossRef] [Medline]
    18. Barbeito S, Sánchez-Gutiérrez T, Becerra-García JA, González Pinto A, Caletti E, Calvo A. A systematic review of online interventions for families of patients with severe mental disorders. J Affect Disord 2020 Feb 15;263:147-154. [CrossRef] [Medline]
    19. Kummervold PE, Gammon D, Bergvik S, Johnsen JK, Hasvold T, Rosenvinge JH. Social support in a wired world: use of online mental health forums in Norway. Nord J Psychiatry 2002 Jul 12;56(1):59-65. [CrossRef] [Medline]
    20. Kendal S, Kirk S, Elvey R, Catchpole R, Pryjmachuk S. How a moderated online discussion forum facilitates support for young people with eating disorders. Health Expect 2017 Feb 03;20(1):98-111 [FREE Full text] [CrossRef] [Medline]
    21. Smith-Merry J, Goggin G, Campbell A, McKenzie K, Ridout B, Baylosis C. Social connection and online engagement: insights from interviews with users of a mental health online forum. JMIR Ment Health 2019 Mar 26;6(3):e11084 [FREE Full text] [CrossRef] [Medline]
    22. Terbeck S, Chesterman LP. Parents, ADHD and the internet. Atten Defic Hyperact Disord 2012 Sep 27;4(3):159-166. [CrossRef] [Medline]
    23. Mazur E, Mickle CL. Online discourse of the stressors of parenting children with mental health disorders. J Child Fam Stud 2017 Oct 16;27(2):569-579. [CrossRef]
    24. Lobban F, Akers N, Appelbe D, Chapman L, Collinge L, Dodd S, et al. Clinical effectiveness of a web-based peer-supported self-management intervention for relatives of people with psychosis or bipolar (REACT): online, observer-blind, randomised controlled superiority trial. BMC Psychiatry 2020 Apr 14;20(1):160 [FREE Full text] [CrossRef] [Medline]
    25. Lobban F, Akers N, Appelbe D, Iraci Capuccinello R, Chapman L, Collinge L, et al. A web-based, peer-supported self-management intervention to reduce distress in relatives of people with psychosis or bipolar disorder: the REACT RCT. Health Technol Assess 2020 Jun;24(32):1-142 [FREE Full text] [CrossRef] [Medline]
    26. Lobban F, Glentworth D, Chapman L, Wainwright L, Postlethwaite A, Dunn G, et al. Feasibility of a supported self-management intervention for relatives of people with recent-onset psychosis: REACT study. Br J Psychiatry 2013 Nov;203(5):366-372. [CrossRef] [Medline]
    27. Elena-Bucea A, Cruz-Jesus F, Oliveira T, Coelho P. Assessing the role of age, education, gender and income on the digital divide: evidence for the European Union. Inf Syst Front 2020 May 19;23(4):1007-1021 [FREE Full text] [CrossRef]
    28. Goldberg D, Hillier V. A scaled version of the General Health Questionnaire. Psychol Med 1979 Feb;9(1):139-145. [CrossRef] [Medline]
    29. Rudolf von Rohr MT. “You will be glad you hung onto this quit”: Sharing information and giving support when stopping smoking online. In: Meeting Health Information Needs Outside Of Healthcare: Opportunities and Challenges. Waltham, MA: Chandos Publishing; 2015.
    30. Locher MA. Advice Online Advice-giving in an American Internet Health Column. Amsterdam, Netherlands: John Benjamins Publishing Company; 2006.
    31. Morrow P. Telling about problems and giving advice in an Internet discussion forum: some discourse features. Discourse Stud 2006;8(4):531-548.
    32. Braun V, Clarke V. One size fits all? What counts as quality practice in (reflexive) thematic analysis? Qual Res Psychol 2020 Aug 12;18(3):328-352. [CrossRef]
    33. Semantic Tagger Framework. UCREL Semantic Analysis System (USAS).   URL: http://ucrel.lancs.ac.uk/usas/ [accessed 2022-10-06]
    34. Tausczik Y, Pennebaker JW. The psychological meaning of words: LIWC and computerized text analysis methods. J Language Social Psychol 2009 Dec 08;29(1):24-54. [CrossRef]
    35. Rayson P, Archer DE, Piao S, Mcenery T. The UCREL semantic analysis system. In: Proceedings of the Workshop: Beyond Named Entity Recognition Semantic Labeling for NLP Tasks in LREC'04. 2004 Presented at: Workshop: Beyond Named Entity Recognition Semantic Labeling for NLP Tasks in LREC'04; Jan, 2004; Lisbon, Portugal.
    36. Hardie A. Log Ratio – an informal introduction. ESRC Centre for Corpus Approaches to Social Science. 2014 Apr 28.   URL: http://cass.lancs.ac.uk/log-ratio-an-informal-introduction/ [accessed 2022-10-11]
    37. Dunning T. Accurate methods for the statistics of surprise and coincidence. Computational Linguistics 1993 Mar;19(1):61-74.
    38. Nielsen J. The 90-9-1 Rule for Participation Inequality in Social Media and Online Communities. Nielsen Norman Group. 2006 Oct 8.   URL: http://www.nngroup.com/articles/ [accessed 2013-09-18]
    39. van Mierlo T. The 1% rule in four digital health social networks: an observational study. J Med Internet Res 2014 Feb 04;16(2):e33 [FREE Full text] [CrossRef] [Medline]
    40. Nonnecke B, Preece J. Why lurkers lurk. In: Proceedings of the Americas Conference on Information Systems 2001. 2001 Presented at: Americas Conference on Information Systems 2001; Aug 3-5, 2001; Boston, Massachusetts, USA.
    41. Repper J, Carter T. A review of the literature on peer support in mental health services. J Ment Health 2011 Aug;20(4):392-411. [CrossRef] [Medline]
    42. Dosani S, Harding C, Wilson S. Online groups and patient forums. Curr Psychiatry Rep 2014 Nov 2;16(11):507 [FREE Full text] [CrossRef] [Medline]
    43. Nguyen A, Mosadeghi S, Almario CV. Persistent digital divide in access to and use of the internet as a resource for health information: results from a California population-based study. Int J Med Inform 2017 Jul;103:49-54. [CrossRef] [Medline]

    ‎
    BD: bipolar disorder
    GHQ: General Health Questionnaire
    REACT: Relatives Education and Coping Toolkit
    USAS: University Centre for Computer Corpus Research on Language Semantic Analysis System

    Edited by J Torous; submitted 20.12.21; peer-reviewed by C Henderson, B Johnson, P Wicks; comments to author 03.02.22; revised version received 28.06.22; accepted 17.08.22; published 20.10.22

    Copyright

    ©Steven Jones, Dimitrinka Atanasova, Susanna Dodd, Susan Flowers, Anna Rosala-Hallas, Heather Robinson, Elena Semino, Fiona Lobban. Originally published in JMIR Mental Health (https://mental.jmir.org), 20.10.2022.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Mental Health, is properly cited. The complete bibliographic information, a link to the original publication on https://mental.jmir.org/, as well as this copyright and license information must be included.