Published on in Vol 10 (2023)

Preprints (earlier versions) of this paper are available at, first published .
Moderated Online Social Therapy for Carers of Early Psychosis Clients in Real-World Settings: Cluster Randomized Controlled Trial

Moderated Online Social Therapy for Carers of Early Psychosis Clients in Real-World Settings: Cluster Randomized Controlled Trial

Moderated Online Social Therapy for Carers of Early Psychosis Clients in Real-World Settings: Cluster Randomized Controlled Trial

Original Paper

1Healthy Brain and Mind Research Centre, School of Behavioural and Health Sciences, Australian Catholic University, Fitzroy, Australia

2University of Western Australia, Nedlands, Australia

3Melbourne School of Psychological Sciences, The University of Melbourne, Parkville, Australia

4Alfred Health, Melbourne, Australia

5School of Computing and Information Systems, Faculty of Engineering and Information Technology, The University of Melbourne, Parkville, Australia

6Orygen, Parkville, Australia

7Centre for Youth Mental Health, The University of Melbourne, Parkville, Australia

8University Hospital of Child and Adolescent Psychiatry and Psychotherapy, University of Bern, Bern, Switzerland

Corresponding Author:

John Gleeson, BA (Hons), MPsych, PhD

Healthy Brain and Mind Research Centre

School of Behavioural and Health Sciences

Australian Catholic University

Level 5, Daniel Mannix Building

Young Street

Fitzroy, 3065


Phone: 61 39953 3108


Background: Family carers of youth recovering from early psychosis experience significant stress; however, access to effective family interventions is poor. Digital interventions provide a promising solution.

Objective: Our objective was to evaluate across multiple Australian early psychosis services the effectiveness of a novel, web-based early psychosis intervention for carers.

Methods: In this cluster randomized controlled trial conducted across multiple Australian early psychosis services, our digital moderated online social therapy for carers (Altitudes) plus enhanced family treatment as usual (TAU) was compared with TAU alone on the primary outcome of perceived stress and secondary outcomes including mental health symptoms and family variables at the 6-month follow-up.

Results: Eighty-six caregivers were randomized and data were available for 74 young people in their care. Our primary hypothesis that carers randomized to Altitudes+TAU would report greater improvements in perceived stress at follow-up compared with carers randomized to TAU alone was not supported, with the TAU alone group showing more improvement. For secondary outcomes, the TAU alone group showed improved mindfulness over time. Regardless of group assignment, we observed improvements in satisfaction with life, quality of life, emotional overinvolvement, and burden of care. In contrast, hair cortisol concentration increased. Post hoc analyses revealed more contact with early psychosis services in the intervention group compared to TAU alone and that improvements in perceived stress and social support were associated with use of the intervention in the Altitudes+TAU group. In this study, 80% (12/15) reported a positive experience with Altitudes and 93% (14/15) would recommend it to others.

Conclusions: Our trial did not show a treatment effect for Altitudes in perceived stress. However, our post hoc analysis indicated that the amount of use of Altitudes related to improvements in stress and social support. Additional design work is indicated to continue users’ engagement and to significantly improve outcomes in problem-solving, communication, and self-care.

Trial Registration: Australian and New Zealand Clinical Trials Registry ACTRN12617000942358;

JMIR Ment Health 2023;10:e47722



Psychotic disorders most often develop during late adolescence. In most cases acute positive psychotic symptoms, namely, hallucinations, delusions, and thought disorder, are responsive to treatment [1]. However, the recovery phase is often accompanied by deficits in psychosocial functioning (ie, lack of engagement with social relationships and vocational or educational pathways) [2] and secondary mental health symptoms [3-5]. In more than 50% of cases, psychotic relapse occurs during the first 3 years after onset of a first episode of a psychotic disorder [6].

Formal treatments for early psychosis are provided within treatment systems that prioritize early detection and comprehensive biopsychosocial interventions, with antipsychotic medication as the cornerstone [7]. Psychosocial interventions focus on recovery of psychosocial functioning via cognitive behavior therapy, vocational rehabilitation, and cognitive remediation [7]. Given the age of onset, families are the mainstay of informal care in early psychosis. A warm family environment is an important protective factor during recovery [8]; however, the burden of caring for a family member with early psychosis is associated with elevated distress [9].

As highlighted by the World Health Organization (WHO), the impacts upon caregivers warrant the dissemination of these effective family interventions for the benefit of both carers and the young person experiencing psychosis [10]. Meta-analytic evidence supports the effectiveness of family interventions in reducing relapse rates in early psychosis as compared to treatment as usual (TAU) [11]. However, access to family interventions is poor [10], resulting in missed opportunities for prevention [12]. This study is aimed at addressing poor accessibility via the provision of a family intervention using digital technology.

Digital mental health interventions provide a promising solution for poor accessibility [13]. Developed in partnership with carers and based on our Moderated Online Social Therapy (MOST) framework [14-17], our Altitudes intervention integrates evidence-based psychoeducation, peer-to-peer social networking, and web-based moderation in a single digital application [18].

We recently evaluated Altitudes via a cluster randomized controlled trial (ACTRN12616000968471). We compared Altitudes plus specialist first-episode family TAU with specialist first-episode family TAU alone within a single flagship early psychosis program [19,20]. At the 6-month follow-up, carers in both groups significantly improved on the primary outcome of stress in addition to a range of secondary outcomes, including mental health symptoms, carer self-efficacy, and expressed emotion [20]. In addition, there were significantly fewer visits to emergency departments by patients with early psychosis from the Altitudes group [20]. However, the trial was conducted at the Early Psychosis Prevention and Intervention Centre—a long-established, flagship early psychosis program in Melbourne, Australia, embedded in an academic research program that may have resulted in enriched background treatments [21]. This left open the question of whether Altitudes could add significant benefit for carers attending real-world early psychosis programs. Testing the feasibility of providing Altitudes across multiple early psychosis sites based across different cities was also a critical additional step in assessing its scalability.

Our aim in this trial was to evaluate whether a digital intervention (Altitudes), which uses MOST, improved perceived stress at the 6-month follow-up in carers with a relative receiving treatment for early psychosis, when added to real-world early psychosis services (ACTRN12617000942358).

The primary hypothesis was that carers randomized to the Altitudes web-based application+enhanced family TAU would report significantly greater improvements in perceived stress at the 6-month follow-up compared with carers randomized to enhanced TAU alone. The secondary hypothesis was that carers randomized to Altitudes+TAU would experience reduced activity of the hypothalamic-pituitary adrenal (HPA) axis—one of the major stress response systems of the human body—as well as improved positive coping, self-efficacy, depression, and perceived social support compared with carers randomized to TAU alone at 6 months follow-up.


The East-West Altitudes trial was a single-blinded, cluster randomized controlled trial with clusters comprising individual families. A cluster design, with family as the unit of randomization, was selected to ensure that members of the same family were randomized to the same condition. It would have been infeasible to have family members participating concurrently in different treatment groups. The 2 treatment conditions included Altitudes plus enhanced treatment as usual (TAU) and enhanced TAU alone. The assessment time points were baseline (prior to randomization), 3 months (for the primary outcome only), and 6 months. The clinical sites were in Melbourne and Perth on Australia’s southeast and west coasts, respectively.


Recruitment of the trial participants was undertaken at 13 sites across Melbourne and Perth between October 2018 and October 2019 including 1 clinical service in Melbourne (headspace early psychosis; hEP) and 2 in Perth (hEP and Western Australia Department of Health Early Intervention in Psychosis Services). Follow-up was completed in July 2020. The Melbourne hEP was managed by Alfred Health and consisted of a hub and spokes model across 5 sites (Bentleigh [hub], Elsternwick, Frankston, Dandenong, and Narre Warren). The Perth hEP consisted of the hub and spoke model of Joondalup, Osbourne Park, and Midland. The Western Australia Department of Health Early Intervention in Psychosis Services included coordinated sites, namely, Bentley, Fremantle, Peel, Rockingham, and Kwinana.

The research assistant (RA) met with potential participants face-to-face at the early psychosis service or in a location convenient to the carer. The RA presented the information regarding the study in writing and orally and invited prospective participants to ask any questions about any aspect of the study before obtaining signed informed consent.

Ethics Approval

Ethics approval for Victorian sites was granted by the Alfred Hospital Human Research Ethics Committee (project No 298/17) and by Western Australia Department of Health (PRN: RGS0000000416) and University of Western Australia (RA/4/20/4245) for Western Australian sites.

Participants and Setting

Eligible participants included carers who were aged ≥18 years (namely parents, grandparents, siblings, and partners) of young people who were currently receiving treatment at an early psychosis service (n=86). Up to 4 family members were eligible to participate from each family. For hEP services, eligibility criteria for the clients were (1) age 12-25 years; (2) a diagnosis of a first episode of psychotic disorder or at ultrahigh risk for developing psychosis [22]; and (3) no more than 12 months of continuous care upon presentation. For Western Australia Health, early psychosis services eligibility criteria for clients were (1) age between 16 and 40 years; (2) the client presented with early psychosis (no diagnosis required); (3) no more than 12 months of continual care upon presentation; and (4) duration of untreated psychosis ≤3 years.

Carers who did not have sufficient English to provide informed consent were excluded. We determined our target sample size based on an a priori power analysis, for which we assumed a moderate treatment effect (Cohen d=0.5) for our primary outcome of perceived stress at the 6-month follow-up [23]. Setting α at .05 (2-tailed), we determined that a sample size of 64 per group was required to achieve 80% power (G*Power Release; version; Heinrich Heine Univeritat Dusseldorf). Adjusting for the design effect (equal to 1.05), this equated to 68 per group or a total of 136 participants.



The Altitudes+TAU condition involved participation in our digital application [18]. TAU comprised the usual array of services for carers at each service in addition to a psychoeducation booklet. Altitudes, powered by our MOST software framework [14], integrated within 1 web-based application: evidence-based psychoeducation, peer-to-peer social networking, and expert and peer web-based moderation. Each user could log on 24 hours per day for the duration of the trial.

Altitudes Interactive Psychoeducation

The web-based psychoeducation was developed to target carer stress. New users were given an introductory welcome to Altitudes which highlighted ways to optimize their use of the system and how to access system help. Users were invited to complete, at their own convenience, a series of 8 web-based modules (known as “pathways”) which addressed themes of self-care, understanding psychosis, early warning signs and prevention of relapse, understanding their personal strengths as a carer, communicating with their relative, dealing with unhelpful thinking, self-compassion, and mindfulness. These pathways were divided into thematically-related psychoeducation “steps” to maximize the usability of the material. Each step was designed to be completed within 5-20 minutes (see Multimedia Appendix 1 for details for each step). The content of these steps comprised text, illustrations, and audio tracks and were designed to improve carer stress, for example, by encouraging self-care and by targeting problematic appraisals known to increase carer stress. In addition, the content of steps was influenced by social cognition concepts of “agency” and self-efficacy in family life [24]. The steps and pathways entailed regular prompts to users to share their reactions to material with other users through a series of “talking points.” Users’ responses populated the content of the social networking newsfeed. To facilitate the process of reflection on the content by participants, moderators could also contribute to the talking points. In addition, users could indicate their preference for material through “like” buttons, share content with other users, and keep track of which users had completed specific pathways and which users shared their specific personal strengths.

Altitudes Social Networking Features

The Altitudes social network enabled users to develop a web-based profile, communicate via posts with other users and web-based moderators, and comment on the web-based psychoeducation material. The application was hosted on a secure University of Melbourne web server. In addition, the web application included measures to secure the application and database against unauthorized access. Privacy and web-based safety were managed in accordance with the Online Social Networking Guidelines published by Cybersmart, a national cybersafety and cybersecurity education program managed by the Australian Communications and Media Authority.

Role of Moderators

In contrast to web-based self-help without human support, the guidance provided by moderators was integral to Altitudes. The model of web-based moderation was informed by the Supportive Accountability Framework of eHealth interventions, which emphasizes the importance of human support for engagement in eHealth systems [25].

Expert moderators were clinical psychologists with specialist family work experience. Their role was to optimize engagement, suggest specific content, facilitate joint problem-solving, and monitor safety daily. If the engagement was low, moderators would prompt participants via follow-up phone calls.

Peer moderators, with lived experience of caring for a relative with psychosis, modeled the use of the system and facilitated web-based interactions. At weekly supervision sessions with author JFMG, moderators reviewed progress and system engagement.

Enhanced Family TAU

All participating carers received a psychoeducation booklet that included information about psychosis and treatment, helpful contacts, as well as coping skills and suggestions for ways to assist and communicate with their relative. Additional carer services potentially included meetings with their relative’s case manager, psychiatrist, family peer worker, or carer consultant, as well as access to carer support groups. These differed by service.


Primary Outcome

Perceived stress in carers over the preceding month was measured by the Perceived Stress Scale (PSS) [26]—a valid and reliable 10-item measure rated on a Likert scale ranging from 0 (never) to 4 (very often).

Secondary Outcomes

Hair cortisol is a biomarker of basal HPA axis activity [27]. The advantages of this measure are the validity as an index of long-term systemic cortisol levels, its reliability across repeated assessments, and its relative robustness to a range of potential confounding influences [28]. To assess potential changes of this biological stress response system, mean baseline HPA system activity during the last month was measured by a validated procedure for measuring hair cortisol [27]. Carer depressive symptoms were measured via the Centre for Epidemiological Studies Depression Scale—Revised [29]and substance use via the Alcohol, Smoking and Substance Involvement Screening Test [30]. Worry was measured via the Penn State Worry Questionnaire [31], loneliness via the UCLA (University of California, Los Angeles) Loneliness Scale [32], and social support via the Medical Outcomes Study Social Support Survey (MOS-SSS) [33]. The Me as a Parent Questionnaire was used to measure parental self-efficacy [34], coping was assessed via the Ways of Coping Scale [35,36], and personal strengths use via the Strengths Use Scale [37]. Self-compassion was measured via the Self-Compassion Scale Short Form [38] and mindfulness using the Mindful Attention Awareness Scale [39]. Satisfaction with life was assessed by the Satisfaction With Life Scale (SWLS) [40] and emotional, psychological, and social well-being via the Mental Health Continuum Short Form (MHC-SF) [41]. Quality of life (QoL) was measured by the Assessment of Quality of Life-8 dimensions [42].

Patient and Family Characteristics

Carer demographic variables included age, living situation, years of education completed, employment and marital status, country of birth, and source of income. Relevant family-level variables were measured including expressed emotion measured via the Family Questionnaire [43], and the degree of openness and extent of problems in family communication using the Parent-Adolescent Communication (PAC) scale [44]. Carer burden was assessed via the Experience of Care-giving Inventory [45]. The demographic characteristics of the young person were collected from carers.

A Resource Use Questionnaire was used to determine resource and treatment use by carers and young people. The use of services provided by the early psychosis service was documented via a self-report survey.

Altitude-Specific Measures

The use of Altitudes was continuously monitored across the study intervention period via frequency of log-ons. At 6 months, Altitudes users completed a self-report measure of their perception of Altitudes moderation [46] and a self-report usability measure [47,48].


RAs attended clinical team meetings across sites to promote the study. Participating carers were asked if their young relative could be approached to seek their consent to access data from their medical record. The young person was contacted by the study RA. The RAs undertaking the follow-up assessments were kept blind to treatment allocation. The participants were not blinded to their treatment allocation, and they were aware that Altitudes was the intervention of interest.

Randomization occurred after each baseline assessment. An independent statistician created the randomization sequence, which included permutated blocks. The block sizes and randomization sequence were concealed from the study coordinator, RAs, and investigators. The study coordinator randomized the family via a secure web-based clinical trials management system with stratification by state (Victoria or Western Australia). The system generated an email to the RA who telephoned the participant to let the family know which group they had been allocated to.

The primary and secondary outcomes were measured prior to randomization and repeated at the 6-month follow-up. The PSS was completed at 3 months using a telephone-administered version.

To enable analysis of hair cortisol, a single hair sample (at least 3 cm long, approximately 0.5 cm in diameter) was taken from a posterior vertex region on the head and stored at an ambient temperature. Screening prior to collection of the hair sample was used to determine factors that may affect the analysis of cortisol, such as hair products used. The hair cortisol analysis procedures included repeated washing of hair samples with isopropanol, drying, weighing (weight: 7.5, SD 0.5 mg), steroid extraction with methanol, evaporation of methanol (at 50 °C), and cortisol determination [27]. This analysis provided a total pg/mg value of cortisol in the hair corresponding to approximately one month prior to sampling.

Statistical Analysis

Statistical analyses were conducted using Stata (version 16.1; StataCorp). Statistical analyses are presented in terms of the CONSORT (Consolidated Standards of Reporting Trials) extension pertaining to cluster analyses [49] and the International Conference on Harmonization Topic E9 Statistical Principals for Clinical Trials. Descriptive statistics were used to describe the total cohort as well as separately for the Altitudes+TAU and TAU alone groups. Baseline differences between the groups were not analyzed using inferential statistics as recommended in CONSORT guidelines [50]. Because of the randomization process, any baseline difference between 2 treatment groups is the result of chance and not due to external factors impacting treatment allocation [51]. Therefore, it is considered to be absurd to test for such differences and there have been calls for such practices to be eliminated [52]. Inferential statistics were used to compare baseline differences between caregivers who did and did not have follow-up data. For intent-to-treat analysis (ITT), all cases were included in the analyses, regardless of whether they had follow-up data.

For the primary outcome variable, the PSS, between group differences were examined using mixed effects repeated measures (MMRM) models [53]. In MMRM models, all observed information is used to derive the models (including estimation but not imputation of missing data). They are considered the preferred method for ITT analyses in clinical trials [54]. For these models, individual timepoint measures are considered nested within individual carers, who may be considered nested within families. For the main analysis, the parameters included group, time (includes baseline, 3 and 6 months), and the group x time interaction. All cases with at least 1 observation were included in the ITT. The default independence covariance structure was modeled in these models. As per protocol, analyses were also conducted with participants who had completed the intervention induction and had follow-up data. For resource use data, group differences were examined using either chi-square or Fisher exact test. Simple Pearson correlations were calculated for the association between parameters of intervention usage and outcomes in the Altitudes group.

Participant Characteristics

There were 86 caregivers that participated in the study, with most being female and a mother of the young person (see Table 1). Caregivers ranged in age from 18 to 76 years (mean 51.2, SD 9.9 years). Most of the cohort were in married or de facto relationships and lived in their own house or flat. Just over 50% (n=46) of caregivers were born in Australia. Of those born overseas, 37% (n=15) were from European countries. Just over three-quarters of caregivers had completed their secondary school education and most had full-time employment. There were 46 caregivers from Victoria and 40 from Western Australia.

In the study, there were 74 young people. For 85% (n=63) of the young people, there was 1 caregiver in the study, 13% (n=10) had 2 caregivers and 1 young person had 3 caregivers. The mean cluster size was therefore 1.16 (SD 0.41). The characteristics of the young people are detailed in Table 2.

Table 1. Baseline demographic characteristics of the total cohort of caregivers (N=86) as well as separately for the Altitudes plus treatment as usual and only treatment as usual groups.
VariableTotal cohort (N=8)Altitudes (n=43)TAUa (n=43)
Female (gender), n (%)71 (83)35 (81)36 (84)
Age (years), mean (SD)51.2 (9.9)51.6 (10.8)50.8 (9.2)
Relationship to the young person, n (%)

Mother65 (76)31 (72)34 (79)

Father13 (15)8 (19)5 (12)

Other8 (9)4 (9)4 (9)
Married or de facto married, n (%)59 (69)35 (81)24 (57)
Children (n), mean (SD)2.7 (1.6)2.7 (1.5)2.8 (1.6)
Accommodation, n (%)

Rented flat or room19 (22)8 (19)11 (26)

Own flat or house61 (71)31 (72)30 (70)

Other6 (7)4 (9)2 (5)
Born in Australia, n (%)46 (53)26 (60)20 (46)
Born outside Australia, n (%)40 (46)17 (39)23 (53)

Oceania and Antarctica7 (17)3 (18)4 (17)

Europe15 (37)6 (35)9 (39)

North Africa and Middle East2 (5)2 (12)0 (0)

Asia5 (12)2 (12)3 (13)

Sub-Saharan Africa11 (27)4 (23)7 (30)
English main language spoken, n (%)81 (94)40 (93)41 (95)
Command of English, n (%)

Good10 (12)6 (14)4 (9)

Native speaker76 (88)37 (86)39 (91)
Highest level of education year 12, n (%)65 (76)31 (72)34 (81)
Additional qualifications, n (%)

No further education10 (12)6 (14)4 (9)

Trade or technical training31 (36)16 (37)15 (36)

Tertiary degree26 (31)12 (28)14 (33)

Postgraduate degree18 (21)9 (21)9 (21)
Currently in paid work, n (%)69 (80)31 (72)38 (88)

Full-time work37 (54)12 (39)25 (66)
Annual income, n (%)

Aus $20,799b or less16 (19)12 (29)4 (10)

Aus $28,000-51,99923 (28)14 (33)9 (22)

Aus $52,000-77,99920 (24)7 (17)13 (32)

Aus $78,000-103,99911 (13)2 (5)9 (22)

Aus $104,000 or more13 (16)7 (17)6 (15)

aTAU: treatment as usual.

bAt time of study commencement on October 1, 2018, the conversation rate was Aus $1=US $0.7200.

Table 2. Demographic characteristics of the young people receiving treatment at an early psychosis service (N=86) with Altitudes plus treatment as usual or only treatment as usual.
VariableTotal cohort (N=74)Altitudes (n=36)TAUa (n=38)
Female (gender), n (%)28 (38)10 (28)18 (47)
Age (years), mean (SD)21.1 (3.5)20.9 (3.8)21.3 (3.3)
Accommodation, n (%)

House with family of origin60 (81)29 (81)31 (82)
Born in Australia, n (%)56 (76)29 (81)27 (71)
English main language spoken, n (%)71 (96)35 (97)36 (95)
Studying status, n (%)

Not studying45 (61)23 (64)22 (58)

Studying part-time13 (18)8 (22)5 (13)

Studying full-time16 (22)5 (14)11 (29)
Highest level of education year 12, n (%)39 (53)16 (44)23 (62)
Currently in paid work, n (%)22 (30)13 (36)9 (24)

Full-time work6 (27)3 (23)3 (33)

aTAU: treatment as usual.

Participant Flow

Figure 1 shows a CONSORT diagram of the participant flow through the study. Sixty-nine caregivers had data at follow-up, indicating that missing data at follow-up were 20% (n=17). The percentage of caregivers in TAU alone that had follow-up data (n=38, 88%) did not significantly differ from caregivers in Altitudes+TAU (n=31, 72%; χ21=3.6; P=.06). Those who did not have follow-up data were more likely to have been born in Australia (χ21=4.5; P=.03). No other differences were found between the groups with respect to caregiver variables.

Figure 1. CONSORT (Consolidated Standards of Reporting Trials) flow diagram. TAU: treatment as usual.

Primary Outcome—Perceived Stress

Figure 2 displays the differences between the groups with respect to PSS across baseline, at 3 and 6 months. The variance associated with family cluster was close to 0, therefore, the models were rerun with the caregiver as the unit of analysis. For the PSS, there was a significant interaction between group and time (z=−2.14; P=.03), with TAU alone showing more change (ie, improvement in PSS) from baseline to follow-up, particularly between 3 and 6 months.

Figure 2. Estimated mean (95% CI) from the MMRMs for the 2 carer groups across the 3 points on the PSS. MMRMs: mixed effects repeated measures; PSS: Perceived Stress Scale; TAU: treatment as usual.

Secondary Outcomes

Table 3 comprises the adjusted means and SEs for the 2 carer groups on the secondary outcome measures. There was a significant interaction between group and time for mindfulness (z=2.04, P=.04), with the TAU alone group showing an increase over time (see Table 3). There was also a significant interaction between group and time for carer burden associated with problems with services, with the TAU alone group experiencing significantly less burden in this domain, whereas Altitudes+TAU group remained relatively stable over time (z=−2.10; P=.04; see Table 4).

With respect to changes over time regardless of group, there were significant improvements in satisfaction with life (z=2.02; P=.04; higher scores were indicative of greater satisfaction), and QoL (z=−2.08; P=.04; lower scores indicated better QoL). Both groups also improved over time with respect to emotional overinvolvement (z=−2.52; P=.01) and dependency (z=−2.79; P=.01).

Table 3. Estimated marginal mean (SE) for baseline and follow-up from MMRMS for secondary outcome measures for Altitudes plus treatment as usual or only treatment as usual.
VariablePre, mean (SE)Post (6 months), mean (SE)Interaction

Altitudes (n=43)TAUa (n=43)Altitudes (n=31)TAU (n=38)Estimate, β (SE)P value
Secondary outcomes

UCLAb Loneliness Scale-325.4 (0.8)26.9 (0.8)26.6 (0.9)26.3 (0.9)−1.66 (−4.27 to 0.95).21

CESD-Rc12.8 (1.8)12.4 (1.8)14.8 (2.0)12.5 (1.9)−1.83 (−6.32 to 2.64).42

SUSd59.1 (1.8)63.2 (1.8)61.1 (2.0)64.1 (1.9)−1.04 (−5.75 to 3.66).66

SCS-SFe3.3 (0.1)3.3 (0.1)3.4 (0.1)3.6 (0.1).22 (−0.05 to 0.50).11

SWLSf19.0 (1.1)22.1 (1.1)21.3 (1.2)22.6 (1.1)−1.66 (−4.59 to 1.28).27

PSWQg50.9 (2.0)50.2 (2.0)48.9 (2.2)46.9 (2.0)−1.35 (−5.85 to 3.15).56

MaaPh50.1 (1.1)49.8 (1.1)49.7 (1.3)52.2 (1.2)2.79 (−0.89 to 6.47).14

Mindful Attention Awareness Scale4.0 (0.1)3.9 (0.1)3.9 (0.2)4.2 (0.1).36 (0.01 to 0.71).04

MOS-SSSi70.8 (2.9)71.0 (2.9)72.6 (3.2)74.8 (3.0)2.02 (−4.26 to 8.31).53

MHC-SFj46.2 (2.1)45.7 (2.1)45.6 (2.4)46.0 (2.2).89 (−4.37 to 6.16).74
Ways of Coping Scale

Confrontive coping0.9 (0.1)0.9 (0.1)1.0 (0.1)1.0 (0.1)−.03 (−0.30 to 0.23).80

Self-controlling (sc)1.2 (0.1)1.4 (0.1)1.2 (0.1)1.3 (0.1)−.07 (−0.34 to 0.21).64

Self-controlling (ss)1.2 (0.1)1.3 (0.1)1.3 (0.1)1.2 (0.1)−.23 (−0.61 to 0.14).22

Distancing0.8 (0.1)1.1 (0.1)0.8 (0.1)0.9 (0.1)−.13 (−0.37 to 0.10).26

Escape avoidance0.7 (0.1)0.8 (0.1)0.8 (0.1)0.7 (0.1)−.23 (−0.49 to 0.02).07

Planful problem-solving1.3 (0.1)1.5 (0.1)1.3 (0.1)1.6 (0.1)0 (−0.33 to 0.34).98
Alcohol, Smoking and Substance Involvement Screening Test

Tobacco3.1 (1.1)4.1 (1.1)2.6 (1.2)4.9 (1.2)1.37 (−0.24 to 2.98).10

Alcohol7.5 (1.0)6.5 (1.0)7.9 (1.0)6.4 (1.0)−.56 (−2.68 to 1.56).60

Cannabis0.6 (0.3)0.4 (0.3)0.6 (0.3)0.1 (0.3)−.24 (−0.72 to 0.23).32
AQoLk70.4 (1.6)73.4 (1.6)73.3 (1.7)75.5 (1.6)−.77 (−4.41 to 25.86).68

aTAU: treatment as usual.

bUCLA: University of California, Los Angeles, Loneliness Scale (total 20-80).

cCESD-R: Centre for Epidemiological Studies Depression Scale—Revised (range 0-60).

dSUS: Strengths Use Scale.

eSCS-SF: Self-Compassion Short Form (1-5).

fSWLS: Satisfaction With Life Scale (5-35).

gPSWQ: Penn State Worry Questionnaire (16-80).

hMaaP: Me as a Parent Questionnaire (subscales 4-20; total 16-80).

iMOS-SSS: Medical Outcomes Study Social Support Survey (0-100).

jMHC-SF: Mental Health Continuum Short Form (0-70).

kAQoL: Assessment of Quality of Life (0-100).

Table 4. Estimated marginal means (SE) for baseline and follow-up from MMRM for the Family Questionnaire and Experience of Caregiving Scale for Altitudes plus treatment as usual or only treatment as usual.
VariablePre, mean (SE)Post (6 months), mean (SE)Interaction

Altitudes (n=43)TAUa (n=43)Altitudes (n=31)TAU (n=38)Estimate, β (SE)P value
Family questionnaire

Critical comments13.8 (1.0)12.3 (1.0)12.0 (1.1)11.2 (1.1).68 (−1.80 to 3.16).59

Emotional overinvolvement17.5 (0.9)17.7 (0.9)15.5 (1.0)15.3 (1.0)−.45 (−2.45 to 1.54).66
Experience of caregiving

Difficult behaviors14.5 (1.2)13.7 (1.2)13.0 (1.4)11.1 (1.3)−1.21 (−4.06 to 2.28).50

Negative symptoms13.5 (1.0)14.3 (1.0)12.4 (1.1)12.2 (1.1)−.93 (−3.76 to 1.91).52

Stigma7.8 (0.7)7.8 (0.7)6.7 (0.8)5.4 (0.7)−1.27 (−3.16 to 0.62).19

Problem with services10.1 (1.0)11.6 (1.0)9.4 (1.1)8.2 (1.0)−2.76 (−5.33 to −0.19).04

Effects on family11.7 (0.9)11.7 (0.9)11.5 (1.0)10.6 (1.0)−.96 (−3.25 to 1.34).42

Need to back up11.8 (0.8)10.2 (0.8)10.9 (0.8)9.2 (0.8)−.05 (−1.91 to 1.81).96

Dependency11.1 (0.7)11.3 (0.7)9.6 (0.8)9.6 (0.7)−.08 (−1.55 to 1.39).92

Loss12.0 (0.9)13.1 (0.9)11.2 (1.0)11.2 (0.9)−1.21 (−3.46 to 1.04).29

Positive personal experiences16.5 (1.0)17.6 (1.0)17.1 (1.1)17.5 (1.0)−.74 (−3.14 to 1.67).55

Good aspect of the relationship13.2 (0.7)13.8 (0.7)12.7 (0.7)13.4 (0.7).09 (−1.70 to 1.88).92

aTAU: treatment as usual.

Hair Cortisol

At baseline 66 caregivers had hair cortisol data and 34 had data at follow-up. One case had very high cortisol levels with values >145 pg/mg of hair cortisol both at baseline and at follow-up. This case was an extreme outlier and distorted the estimated means, therefore was excluded from the analyses. Figure 3 details the estimated means (with 95% CI) for the hair cortisol data. The interaction between group and time was not significant (z=−1.46; P=.14); however, the time main effect was significant (z=2.04; P=.04), demonstrating a moderate increase in cortisol concentration overall and regardless of intervention. The analyses were rerun with age as a covariate, and these findings were upheld. There was no relationship between change scores on hair cortisol and the PSS (r=0.07; P=.70).

Figure 3. Estimated marginal mean (95% CI) for baseline and follow-up from MMRM for hair cortisol. MMRM: mixed effects repeated measure; TAU: treatment as usual.

Resource Use

As shown in Table 4 there was a significant difference between the caregiver groups with respect to early psychosis services used by the caregiver with the Altitudes group having significantly higher use of services (Fisher exact test; P=.01). There were no differences between the caregiver groups with respect to medication use, including use of psychotropic medications over the previous 6 months.

Data were available on resource usage for 57 young people at follow-up (see Table 5). There were no differences between groups with respect to young people’s use of emergency services and hospitalizations in the previous 6 months (see Table 5).

Table 5. Resource usage data in caregivers and young people.

Altitudes, n (%)Controls, n (%)P value

Use of early psychosis service over past 6 months28 (93)25 (66).01

Services from early psychosis service contact

Case managers23 (77)22 (58).08

Psychiatrists13 (43)13 (34).30

Family peer worker (lived experience)5 (17)10 (26).26

Family worker or carer consultant2 (7)5 (13).32

Written psychoeducation11 (37)11 (29).34

Community or private health services30 (100)36 (95).31

Any medications28 (93)32 (84).22

Psychotropic medications10 (33)12 (32).54
Young personb

Emergency presentation over past 6 months6 (26)5 (15).23

Hospitalization over past 6 months4 (17)6 (18).63

aFor Altitudes and control groups: n=30 and n=38, respectively.

bFor Altitudes and control groups: n=23 and n=34, respectively.

Per Protocol Analyses

There were 7 caregivers in the Altitudes+TAU treatment arm who did not receive the Altitudes intervention. Three of these cases never received the intervention or had follow-up data. One case was lost to follow-up and did not complete the intervention induction and had no follow-up data. Three cases could not be contacted, and the intervention induction was not started but they did have follow-up data. These 7 cases were excluded from per protocol analyses. There were some differences between ITT and per protocol analyses. With per protocol analyses, the interaction for PSS over the 3 time points was no longer significant (z=−1.73; P=.08); however, parental self-efficacy was significant, that is, there was a greater increase in the TAU alone group (z=2.01; P=.04). The interactions between group and time were no longer significant for mindfulness (z=1.86; P=.06) and carer burden related to problems with services (z=−1.63; P=.10).

The per protocol analyses indicated that the Altitudes+TAU group (n=22, 81%) were more likely to be in contact with the young person’s case manager than the TAU alone group (n=22, 58%; χ21=4; P=.04).

Altitudes Specific Measures and Outcomes

The median duration of engagement with Altitudes was 7.5 (range 1-36) weeks with median number of logins 13.5 (range 1-96); 39% (n=14) remained active for more than 11 weeks. Two participants logged on only once. The number of newsfeed posts ranged from 0 to 31 with a mean of 3.56 (SD 6.19). In relation to the carers’ perceived support for autonomy needs from web-based moderators (n=16), the mean was 5.5 (SD 1.38) on the 7-point scale. Our post hoc analysis of the relationship between activity in Altitudes and outcomes revealed that the total number of logins (r=0.49; P=.01) and the weeks of logins (r=0.47; P=.01) were both moderately and significantly correlated with improvement in PSS scores from baseline to 6 months. The number of logins (r=−0.46; P=.02) and the weeks of logins (r=−0.42; P=.03) were both moderately and negatively correlated with change from baseline to 6 months on the MOS-SSS. In relation to usability data (n=15), 80% (n=12) reported a positive and constructive experience with Altitudes and 93% (n=14) would recommend it to others.

There were no known privacy breaches or outages of Altitudes during the trial and there were no serious adverse events.

Principal Results

The primary hypothesis that carers randomized to Altitudes plus family TAU would report significantly greater reductions in stress at the 6-month follow-up compared to TAU alone was not supported, with no significant change over time in self-reported severity of carer stress in the Altitudes+TAU group. The secondary hypothesis, that carers randomized to Altitudes+TAU would experience reduced hair cortisol, improved positive coping, self-efficacy, depression, and perceived social support compared with carers randomized to TAU alone at the 6-month follow-up, was also not supported. There was no improvement over 6 months on hair cortisol, mental health symptoms, loneliness, social support, self-efficacy, coping, personal strengths use, and self-compassion in the Altitudes+TAU group compared to TAU alone. There was an effect for time on stress and mindfulness with group interactions favoring the TAU alone group which was not upheld in the per protocol analysis excluding participants that did not use Altitudes. In addition, there was a group by time interaction for problems with services with TAU alone carers experiencing less burden over time which was not upheld in the per protocol analysis. There was an improvement over time, regardless of group, in satisfaction with life, QoL, emotional overinvolvement, and burden of care associated with dependency. The per-protocol analysis indicated a significant group by time interaction for parental self-efficacy with an increase for the TAU alone group.

There was no suggestion that the findings could be accounted for by the Altitudes+TAU group receiving less support outside of the intervention compared with the TAU alone group. Conversely, the Altitudes+TAU group had a higher use of services and findings from the per protocol analysis showed that the Altitudes+TAU group was more likely to be in contact with the young person’s case manager.

Comparison With Prior Work

We have previously shown that stress appraisal improves in first-episode psychosis family caregivers through a face-to-face first-episode psychosis family intervention [55] and via bibliotherapy [56]. The current findings suggest that when added to an enhanced TAU in standard early psychosis services Altitudes did not confer benefits in relation to reducing stress, other mental health symptoms, or improving family related outcomes such as expressed emotion and perceived burden of caregiving over a the 6-month period. However, our post hoc analysis revealed significant correlations between log-ins and improvement in perceived stress and social support within the Altitudes+TAU group suggesting that with adequate engagement Altitudes may confer benefits to carers.

The stage of recovery in young patients with early psychosis may be important in the interpretation of the current findings. The greater level of contact with services and a higher level of perceived problems with services in the Altitudes+TAU group suggests that the young people in their care were experiencing more complex recoveries from the acute phase of early psychosis treatments compared to the TAU alone group. It is also possible that Altitudes led to contact with mental health services for young people. Consistent with the former interpretation, more use of Altitudes was associated with decreased stress in carers and there were no outcomes favoring TAU in our initial trial in a flagship service [20].

The median duration of engagement in Altitudes was 11 weeks (approximately 77 days) compared with 119 days in our initial trial. Given the moderate correlation between log-ins and reduced stress, it is possible that this lower level of engagement may account for the overall lack of treatment effect.

The current findings leave open the question of how the effective components of carer interventions can be translated into an accessible and effective digital version. It is probable that the mechanisms of change in effective carer interventions were not adequately targeted through Altitudes. We developed Altitudes with text- and audio-based psychoeducation; however, the format may not have adequately engaged the target skills. Educational instructional design frameworks for a digital mode may be required to ensure that continued learning outcomes are achieved [57,58]. Compared with typical behavioral family interventions [59], the duration of engagement with Altitudes was relatively brief. Continued skill development may require longer and more intensive engagement with monitoring and structured feedback on skill acquisition. Recently, bibliotherapy for early psychosis caregivers based on problem-solving, adapted for delivery via smartphone, has shown superior outcomes on carer burden, caregiving experiences, and problem-solving at the 6-month follow-up compared with either a psychoeducation family group or usual care [60]. Importantly, this intervention included repeated structured practice of problem-solving skills. Other recent findings support the incorporation of acceptance and commitment therapy principles and practice for the amelioration of burnout symptoms for early psychosis caregivers which may also have benefits for perceived stress [60].

Carers in this study overall showed improvements over time in satisfaction with life, QoL, and emotional overinvolvement. However, the trends in the proportion reporting high levels of stress and being prescribed psychotropics were notable along with increased cortisol levels potentially highlighting continued activation of the stress response system in these carers’ lives.

Strengths and Limitations

We demonstrated that it is feasible to conduct Altitudes across sites in real-world early psychosis settings and maintain a supportive web-based environment providing highly specialized support. There were multiple measures of stress with a robust study design. The major limitation of the current study was the smaller sample size than planned, which was a consequence of a lower rate of recruitment than projected due to the unexpected complexity of recruiting carers into a research study from hub and spoke service structures. This resulted in an underpowered study which makes findings more difficult to interpret [61]. Additional limitations were the limited data regarding the young people’s mental health, which reduced the confidence in the equivalency of participant characteristics at baseline, and the exclusion of non-English speaking carer participants. Young people may have differed across groups and it was difficult to fully characterize the use of informal supports across services.


This study comprised the first randomized controlled trial to investigate the effectiveness of a MOST intervention for early psychosis carers recruited from multiple real-world early psychosis programs. Altitudes was based upon our MOST which was associated with reduced emergency department visits for young people recovering from early psychosis [15]. While we did not find specific treatment effects, there were significant improvements across both treatment conditions on emotional overinvolvement, QoL, satisfaction with life, and aspects of caregiver burden and greater usage of Altitudes among carers randomized to the treatment group was associated with improvements in stress and social support. It was evident that early psychosis carers outside of flagship programs experienced levels of stress that warrant further innovations. We are currently modifying the Altitudes content to better engage mechanisms of change.

As early psychosis programs expand globally, the goal of delivering effective and accessible family interventions for carers remains an important research and clinical priority. The solid empirical foundations of effective family interventions for psychosis will continue to provide a source of inspiration for this important unmet global need.


This trial was funded by the Australian Catholic University Research Fund. We acknowledge Black Swan Health and Youth Focus who are lead agencies of the Western Australia headspace early psychosis sites. MAJ was supported by an investigator grant (APP1177235) from the National Health and Medical Research Council and a Dame Kate Campbell Fellowship from the University of Melbourne.

Conflicts of Interest

None declared.

Multimedia Appendix 1

Altitudes Steps.

XLSX File (Microsoft Excel File), 21 KB

Multimedia Appendix 2

CONSORT-EHEALTH checklist (V 1.6.1).

PDF File (Adobe PDF File), 2859 KB

  1. Emsley R, Oosthuizen PP, Kidd M, Koen L, Niehaus DJH, Turner HJ. Remission in first-episode psychosis: predictor variables and symptom improvement patterns. J Clin Psychiatry 2006 Nov;67(11):1707-1712 [CrossRef] [Medline]
  2. Santesteban-Echarri O, Paino M, Rice S, González-Blanch C, McGorry P, Gleeson J, et al. Predictors of functional recovery in first-episode psychosis: A systematic review and meta-analysis of longitudinal studies. Clin Psychol Rev 2017 Dec;58:59-75 [CrossRef] [Medline]
  3. Wilson RS, Yung AR, Morrison AP. Comorbidity rates of depression and anxiety in first episode psychosis: A systematic review and meta-analysis. Schizophr Res 2020 Feb;216:322-329 [CrossRef] [Medline]
  4. Archie S, Rush BR, Akhtar-Danesh N, Norman R, Malla A, Roy P, et al. Substance use and abuse in first-episode psychosis: prevalence before and after early intervention. Schizophr Bull 2007 Nov;33(6):1354-1363 [] [CrossRef] [Medline]
  5. Sin GL, Abdin E, Lee J, Poon LY, Verma S, Chong SA. Prevalence of post-traumatic stress disorder in first-episode psychosis. Early Interv Psychiatry 2010 Nov;4(4):299-304 [CrossRef] [Medline]
  6. Alvarez-Jimenez M, Priede A, Hetrick SE, Bendall S, Killackey E, Parker AG, et al. Risk factors for relapse following treatment for first episode psychosis: a systematic review and meta-analysis of longitudinal studies. Schizophr Res 2012 Aug;139(1-3):116-128 [CrossRef] [Medline]
  7. Royal AustralianNew Zealand College of Psychiatrists Clinical Practice Guidelines Team for the Treatment of SchizophreniaRelated Disorders. Royal Australian and New Zealand College of Psychiatrists clinical practice guidelines for the treatment of schizophrenia and related disorders. Aust N Z J Psychiatry 2005;39(1-2):1-30 [CrossRef] [Medline]
  8. Lee G, Barrowclough C, Lobban F. Positive affect in the family environment protects against relapse in first-episode psychosis. Soc Psychiatry Psychiatr Epidemiol 2014 Mar;49(3):367-376 [CrossRef] [Medline]
  9. Jansen JE, Gleeson J, Cotton S. Towards a better understanding of caregiver distress in early psychosis: a systematic review of the psychological factors involved. Clin Psychol Rev 2015 Feb;35:56-66 [CrossRef] [Medline]
  10. Eckardt JP. Barriers to WHO Mental Health Action Plan updates to expand family and caregiver involvement in mental healthcare. Gen Psychiatr 2022;35(2):e100784 [] [CrossRef] [Medline]
  11. Camacho-Gomez M, Castellvi P. Effectiveness of family intervention for preventing relapse in first-episode psychosis until 24 months of follow-up: A systematic review with meta-analysis of randomized controlled trials. Schizophr Bull 2020 Jan 04;46(1):98-109 [] [CrossRef] [Medline]
  12. Eassom E, Giacco D, Dirik A, Priebe S. Implementing family involvement in the treatment of patients with psychosis: a systematic review of facilitating and hindering factors. BMJ Open 2014 Oct 03;4(10):e006108 [] [CrossRef] [Medline]
  13. Onwumere J, Kuipers E. Does the internet have a role in helping families of people with psychosis? Psychiatr Serv 2017 Apr 01;68(4):419-420 [CrossRef] [Medline]
  14. Lederman R, Wadley G, Gleeson J, Bendall S, Álvarez-Jiménez M. Moderated online social therapy: designing and evaluating technology for mental health. ACM Trans Comput Hum Interact 2014;21(1):1-26 [CrossRef]
  15. Alvarez-Jimenez M, Koval P, Schmaal L, Bendall S, O'Sullivan S, Cagliarini D, et al. The Horyzons project: a randomized controlled trial of a novel online social therapy to maintain treatment effects from specialist first-episode psychosis services. World Psychiatry 2021 Jun;20(2):233-243 [] [CrossRef] [Medline]
  16. Alvarez-Jimenez M, Gleeson JF, Bendall S, Penn DL, Yung AR, Ryan RM, et al. Enhancing social functioning in young people at Ultra High Risk (UHR) for psychosis: A pilot study of a novel strengths and mindfulness-based online social therapy. Schizophr Res 2018 Dec;202:369-377 [CrossRef] [Medline]
  17. Rice S, Gleeson J, Davey C, Hetrick S, Parker A, Lederman R, et al. Moderated online social therapy for depression relapse prevention in young people: pilot study of a 'next generation' online intervention. Early Interv Psychiatry 2018 Aug;12(4):613-625 [CrossRef] [Medline]
  18. Gleeson J, Lederman R, Koval P, Wadley G, Bendall S, Cotton S, et al. Moderated online social therapy: A model for reducing stress in carers of young people diagnosed with mental health disorders. Front Psychol 2017;8:485 [] [CrossRef] [Medline]
  19. Gleeson J, Lederman R, Herrman H, Koval P, Eleftheriadis D, Bendall S, et al. Moderated online social therapy for carers of young people recovering from first-episode psychosis: study protocol for a randomised controlled trial. Trials 2017 Jan 17;18(1):27 [] [CrossRef] [Medline]
  20. Gleeson JFM, Koval P, Zyphur M, Lederman R, Herrman H, Eleftheriadis D, et al. A randomized controlled trial of moderated online social therapy for family carers of first-episode psychosis patients in a specialist treatment setting. Schizophr Res 2023 May;255:203-212 [CrossRef] [Medline]
  21. McGorry PD, Edwards J, Mihalopoulos C, Harrigan SM, Jackson HJ. EPPIC: an evolving system of early detection and optimal management. Schizophr Bull 1996;22(2):305-326 [CrossRef] [Medline]
  22. Yung AR, Nelson B, Stanford C, Simmons MB, Cosgrave EM, Killackey E, et al. Validation of "prodromal" criteria to detect individuals at ultra high risk of psychosis: 2 year follow-up. Schizophr Res 2008 Oct;105(1-3):10-17 [CrossRef] [Medline]
  23. Cohen J. A power primer. Psychol Bull 1992 Jul;112(1):155-159 [CrossRef] [Medline]
  24. Bandura A, Caprara GV, Barbaranelli C, Regalia C, Scabini E. Impact of family efficacy beliefs on quality of family functioning and satisfaction with family life. Appl Psychol 2011;60(3):421-448 [CrossRef]
  25. Mohr DC, Cuijpers P, Lehman K. Supportive accountability: a model for providing human support to enhance adherence to eHealth interventions. J Med Internet Res 2011 Mar 10;13(1):e30 [] [CrossRef] [Medline]
  26. Cohen S, Williamson GM. Perceived stress in a probability sample of the United-States. In: Spacapan S, Oskamp S, editors. Social Psychology of Health. Norderstedt, Germany: Books on Demand; 1988:31-67
  27. Davenport MD, Tiefenbacher S, Lutz CK, Novak MA, Meyer JS. Analysis of endogenous cortisol concentrations in the hair of rhesus macaques. Gen Comp Endocrinol 2006 Jul;147(3):255-261 [CrossRef] [Medline]
  28. Stalder T, Kirschbaum C. Analysis of cortisol in hair--state of the art and future directions. Brain Behav Immun 2012 Oct;26(7):1019-1029 [CrossRef] [Medline]
  29. Eaton WW. Center for Epidemiologic Studies Depression Scale-Revised (CESD-R). Sarasota, FL: Professional Resource Press/Professional Resource Exchange; 2001.
  30. WHO ASSIST Working Group. The Alcohol, Smoking and Substance Involvement Screening Test (ASSIST): development, reliability and feasibility. Addiction 2002 Sep;97(9):1183-1194 [] [CrossRef] [Medline]
  31. Meyer TJ, Miller ML, Metzger RL, Borkovec TD. Development and validation of the Penn State Worry Questionnaire. Behav Res Ther 1990;28(6):487-495 [CrossRef] [Medline]
  32. Russell DW. UCLA Loneliness Scale (Version 3): reliability, validity, and factor structure. J Pers Assess 1996 Feb;66(1):20-40 [CrossRef] [Medline]
  33. Sherbourne CD, Stewart AL. The MOS social support survey. Soc Sci Med 1991;32(6):705-714 [CrossRef] [Medline]
  34. Hamilton VE, Matthews JM, Crawford SB. Development and preliminary validation of a Parenting Self-Regulation Scale: “Me as a Parent”. J Child Fam Stud 2014 Dec 13;24(10):2853-2864 [CrossRef]
  35. Folkman S, Lazarus RS, Dunkel-Schetter C, DeLongis A, Gruen RJ. Dynamics of a stressful encounter: cognitive appraisal, coping, and encounter outcomes. J Pers Soc Psychol 1986 May;50(5):992-1003 [CrossRef] [Medline]
  36. MacCarthy B, Brown R. Psychosocial factors in Parkinson's disease. Br J Clin Psychol 1989 Feb;28(1):41-52 [CrossRef] [Medline]
  37. Wood AM, Linley PA, Maltby J, Kashdan TB, Hurling R. Using personal and psychological strengths leads to increases in well-being over time: A longitudinal study and the development of the strengths use questionnaire. Pers Individ Dif 2011 Jan;50(1):15-19 [CrossRef]
  38. Raes F, Pommier E, Neff KD, Van Gucht D. Construction and factorial validation of a short form of the Self-Compassion Scale. Clin Psychol Psychother 2011;18(3):250-255 [CrossRef] [Medline]
  39. Brown KW, Ryan RM. The benefits of being present: mindfulness and its role in psychological well-being. J Pers Soc Psychol 2003 Apr;84(4):822-848 [CrossRef] [Medline]
  40. Diener E, Emmons RA, Larsen RJ, Griffin S. The Satisfaction With Life Scale. J Pers Assess 1985 Feb;49(1):71-75 [CrossRef] [Medline]
  41. Keyes CLM, Wissing M, Potgieter JP, Temane M, Kruger A, van Rooy S. Evaluation of the mental health continuum-short form (MHC-SF) in Setswana-speaking South Africans. Clin Psychol Psychother 2008;15(3):181-192 [CrossRef] [Medline]
  42. Richardson J, Iezzi A, Khan MA, Maxwell A. Validity and reliability of the Assessment of Quality of Life (AQoL)-8D multi-attribute utility instrument. Patient 2014;7(1):85-96 [] [CrossRef] [Medline]
  43. Wiedemann G, Rayki O, Feinstein E, Hahlweg K. The Family Questionnaire: development and validation of a new self-report scale for assessing expressed emotion. Psychiatry Res 2002 Apr 15;109(3):265-279 [CrossRef] [Medline]
  44. Barnes HL, Olson DH. Parent-adolescent communication and the circumplex model. Child Dev 1985 Apr;56(2):438 [CrossRef]
  45. Szmukler GI, Burgess P, Herrman H, Benson A, Colusa S, Bloch S. Caring for relatives with serious mental illness: the development of the Experience of Caregiving Inventory. Soc Psychiatry Psychiatr Epidemiol 1996 Jun;31(3-4):137-148 [CrossRef] [Medline]
  46. Williams GC, Grow VM, Freedman ZR, Ryan RM, Deci EL. Motivational predictors of weight loss and weight-loss maintenance. J Pers Soc Psychol 1996 Jan;70(1):115-126 [CrossRef] [Medline]
  47. Alvarez-Jimenez M, Bendall S, Lederman R, Wadley G, Chinnery G, Vargas S, et al. On the HORYZON: moderated online social therapy for long-term recovery in first episode psychosis. Schizophr Res 2013 Jan;143(1):143-149 [CrossRef] [Medline]
  48. Bargas-Avila JA, Hornbæk K. Old wine in new bottles or novel challenges: a critical analysis of empirical studies of user experience. 2011 Presented at: CHI '11: SIGCHI Conference on Human Factors in Computing Systems; May 7-12, 2011; Vancouver, BC p. 2689-2698 [CrossRef]
  49. Campbell MK, Piaggio G, Elbourne DR, Altman DG, CONSORT Group. Consort 2010 statement: extension to cluster randomised trials. BMJ 2012 Sep 04;345:e5661 [CrossRef] [Medline]
  50. Moher D, Hopewell S, Schulz KF, Montori V, Gøtzsche PC, Devereaux PJ, Consolidated Standards of Reporting Trials Group. CONSORT 2010 explanation and elaboration: Updated guidelines for reporting parallel group randomised trials. J Clin Epidemiol 2010 Aug;63(8):e1-37 [] [CrossRef] [Medline]
  51. Altman DG. Comparability of randomised groups. Statistician 1985;34(1):125-136 [CrossRef]
  52. de Boer MR, Waterlander WE, Kuijper LDJ, Steenhuis IHM, Twisk JWR. Testing for baseline differences in randomized controlled trials: an unhealthy research behavior that is hard to eradicate. Int J Behav Nutr Phys Act 2015 Jan 24;12:4 [] [CrossRef] [Medline]
  53. Gueorguieva R, Krystal JH. Move over ANOVA: progress in analyzing repeated-measures data and its reflection in papers published in the Archives of General Psychiatry. Arch Gen Psychiatry 2004 Mar;61(3):310-317 [CrossRef] [Medline]
  54. Mallinckrodt CH, Clark SWS, Carroll RJ, Molenbergh G. Assessing response profiles from incomplete longitudinal clinical trial data under regulatory considerations. J Biopharm Stat 2003 May;13(2):179-190 [CrossRef] [Medline]
  55. Gleeson JFM, Cotton SM, Alvarez-Jimenez M, Wade D, Crisp K, Newman B, et al. Family outcomes from a randomized control trial of relapse prevention therapy in first-episode psychosis. J Clin Psychiatry 2010 Apr;71(4):475-483 [CrossRef] [Medline]
  56. McCann TV, Lubman DI, Cotton SM, Murphy B, Crisp K, Catania L, et al. A randomized controlled trial of bibliotherapy for carers of young people with first-episode psychosis. Schizophr Bull 2013 Nov;39(6):1307-1317 [] [CrossRef] [Medline]
  57. Keller JM. Development and use of the ARCS model of instructional design. J Instr Dev 1987 Sep;10(3):2-10 [CrossRef]
  58. Noetel M, Griffith S, Delaney O, Harris NR, Sanders T, Parker P, et al. Multimedia design for learning: an overview of reviews with meta-meta-analysis. Rev Educ Res 2021;92(3):413-454 [CrossRef]
  59. Pilling S, Bebbington P, Kuipers E, Garety P, Geddes J, Orbach G, et al. Psychological treatments in schizophrenia: I. Meta-analysis of family intervention and cognitive behaviour therapy. Psychol Med 2002 Jul;32(5):763-782 [CrossRef] [Medline]
  60. Chien WT, Bressington D, Lubman DI, Karatzias T. A randomised controlled trial of a caregiver-facilitated problem-solving based self-learning program for family carers of people with early psychosis. Int J Environ Res Public Health 2020;17(24):9343 [] [CrossRef] [Medline]
  61. Kapur S, Munafò M. Small sample sizes and a false economy for psychiatric clinical trials. JAMA Psychiatry 2019 Jul 01;76(7):676-677 [CrossRef] [Medline]

hEP: headspace early psychosis
HPA: hypothalamic-pituitary adrenal
ITT: intent-to-treat
MHC-SF: Mental Health Continuum Short Form
MMRM: mixed effects repeated measures
MOS-SSS: Medical Outcomes Study Social Support Survey
MOST: moderated online social therapy
PAC: Parent-Adolescent Communication
PSS: Perceived Stress Scale
PSWQ: Penn State Worry Questionnaire
QoL: quality of life
RA: research assistant
SCS-SF: Self-Compassion Short Form
SUS: Strengths Use Scale
SWLS: Satisfaction With Life Scale
TAU: treatment as usual
UCLA: University of California, Los Angeles
WHO: World Health Organization

Edited by J Torous; submitted 03.04.23; peer-reviewed by A Hudon, A AL-Asadi; comments to author 10.05.23; revised version received 31.05.23; accepted 19.06.23; published 06.09.23


©John Gleeson, Ashleigh Lin, Peter Koval, Liza Hopkins, Paul Denborough, Reeva Lederman, Helen Herrman, Sarah Bendall, Dina Eleftheriadis, Sue Cotton, Yael Perry, Michael Kaess, Mario Alvarez-Jimenez. Originally published in JMIR Mental Health (, 06.09.2023.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Mental Health, is properly cited. The complete bibliographic information, a link to the original publication on, as well as this copyright and license information must be included.