Published on 04.12.19 in Vol 6, No 12 (2019): December
Preprints (earlier versions) of this paper are available at http://preprints.jmir.org/preprint/14866, first published May 30, 2019.
Moderated Online Social Therapy: Viewpoint on the Ethics and Design Principles of a Web-Based Therapy System
The modern omnipresence of social media and social networking sites (SNSs) brings with it a range of important research questions. One of these concerns the impact of SNS use on mental health and well-being, a question that has been pursued in depth by scholars in the psychological sciences and the field of human-computer interaction. Despite this attention, the design choices made in the development of SNSs and the notion of well-being employed to evaluate such systems require further scrutiny. In this viewpoint paper, we examine the strategic design choices made in our development of an enclosed SNS for young people experiencing mental ill-health in terms of ethical and persuasive design and in terms of how it fosters well-being. In doing so, we critique the understanding of well-being that is used in much of the existing literature to make claims about the impact of a given technology on well-being. We also demonstrate how the holistic concept of eudaimonic well-being and ethical design of SNSs can complement one another.
JMIR Ment Health 2019;6(12):e14866
The modern omnipresence of social media and social networking sites (SNSs) brings with it a range of important research questions. One of these concerns the impact of SNS use on psychological well-being, a question that has been pursued in depth by scholars in the psychological sciences and the field of human-computer interaction (HCI) [- ]. Despite growing multidisciplinary academic attention being devoted to questions concerning, for example, the “mental health outcomes associated with Facebook use” [ ] over the course of the last decade, a related question concerning the design of social networking platforms remains underexamined, that is, how do the design choices made by SNS programmers and related specialists contribute to the enhancement or the deterioration of a person’s psychological well-being? It is the goal of this paper to discuss not only certain strategic design choices in our development of an enclosed social networking platform for young people experiencing mental ill-health but also to critique the understanding of well-being that is used in much of the existing literature to make claims about the impact of a given technology on well-being. We will argue that the conception of well-being used to evaluate the effects of a given technology is oftentimes limited and inconsistent and may impair rather than enhance our understanding of how SNSs impact individuals. We will demonstrate how the holistic concept of eudaimonic well-being and ethical design of SNSs can complement one another.
As researchers who study persuasive technologies and design SNSs for mental health, we recognize that we can contribute in playing “a watchdog role for the human computer interaction community in particular and the broader community” (p 230)  of consumers in general. This role includes the following 4 categories of action, as proposed by the persuasive technology pioneer Fogg [ ]:
- Identify artifacts and techniques: identify persuasive technologies and the persuasive techniques a researcher uses.
- Examine effectiveness and effects: assess the effectiveness (intended impact) and the effects (unintended side effects) of persuasive technologies or strategies.
- Disclose findings: those who study persuasive technologies have an obligation to disclose their findings.
- If necessary, take or advocate social action: if a computer or artifact is deemed harmful or ethically questionable, a researcher should either take social action or advocate that others do so.
We will begin this paper by defining the term social network before proceeding with an overview of persuasive technology design and some associated ethical issues. Next, we will discuss the tendency in the existing literature to evaluate the effects of a given technology in relation to a limited concept of well-being that aligns with what researchers term subjective well-being (SWB) or evaluation well-being . We will argue that the concept of SWB tells us very little about “what constitutes a well-lived life” [ ] and, in turn, provides us with a narrow understanding of how SNSs impact individuals. Huang emphasized these difficulties in a 2010 meta-analysis, observing across 40 studies that well-being was inconsistently represented “by numerous psychological constructs, such as loneliness, depression, self-esteem, and life satisfaction,” making it very difficult to draw any conclusions across the studies and contributing to mixed findings regarding the topic [ ]. In this section, we will contrast SWB with what Ryff terms “a eudaimonic approach to psychological wellbeing” [ ] and argue that the depth and breadth of this concept make it a valuable framework to evaluate the effects of an SNS platform and to guide the design and development of SNSs in youth mental health in particular. From here, we will provide an overview of the Moderated Online Social Therapy (MOST) platform we have developed and analyze it in terms of ethical persuasive design and eudaimonic well-being before outlining some new developments and discussing them in terms of the themes of this paper. Later topics covered include how MOST promotes a balance in online/offline activity and the incorporation of gamification.
The aims of this paper are in line with Fogg’s categories of action as outlined above, focusing primarily on the first 2, that is, identifying artifacts and techniques that may render our technology persuasive and examining their effects and effectiveness, which involves assessing both the intended and unintended effects of our strategies. Disclosing our findings and advocating social action are, incidentally, actions performed in the writing and dissemination of this paper.
What Is a Social Network Site?
Scholars Boyd and Ellison differentiate between a social network site and a SNS. They define a social network site as :
A web based service that allows people to 1) construct a public or semi-public profile within a bounded system; 2) articulate a list of others users with whom they share a connection; 3) view and traverse their list of connections and those made by others within the bounded system.
They prefer the term social network site because these Web-based platforms are primarily designed to “enable users to articulate and make visible their [existing] social networks” (p 211) . Put differently, they are not about making new friends or networks but about tending to their existing ones.
Networking, on the contrary, “emphasizes relationship initiation, often between strangers” (p 211) . It is in this sense, however, that MOST is an SNS. Thus, adapting from Boyd and Ellison’s definition, MOST is an SNS best conceived as a Web-based service that allows people to construct a public or semipublic profile within a bounded system and to initiate relationships generally between strangers. The vast majority of users who join the MOST SNS platforms for mental health do not know each other before use. Therefore, one of the primary goals of the interventions is for users to connect with others who share a similar lived experience but do not necessarily share a similar or the same offline social networks.
Persuasive Technology Design
The study of computers as persuasive technologies has roots in Fogg’s seminal work and his coinage of the term captology from the acronym Computers as Persuasive Technologies [, ]. According to Fogg, “a persuasive computing technology is a computing system, device, or application intentionally designed to change a person’s attitudes or behavior in a predetermined way” [ ]. Work in the field of persuasive technology design is particularly useful as a foundation for the development of digital technologies for behavior change and psychological well-being (PWB). Informed by Fogg’s conceptualization of persuasive technology, Oinas-Kukkonen and Harjumaa [ ] have developed a more concrete framework that transforms persuasive design principles into software requirements and system features. According to their Persuasive Systems Design model, there are 4 categories for persuasive system principles:
- Primary task: The design principles in this category support the carrying out of the user’s primary task and consist of reduction, tunneling, tailoring, personalization, self-monitoring, simulation, and rehearsal.
- Dialog: The design principles in this category are about the feedback an interactive system provides to its users to help them move toward their goal or a target behavior. This category consists of praise, rewards, reminders, suggestion, similarity, liking, and social role.
- System credibility: The design principles in this category describe how to design a system so that it is more credible and thus more persuasive. The category consists of trustworthiness, expertise, surface credibility, real-world feel, authority, third-party endorsements, and verifiability.
- Social support: The design principles in this category describe how to design the system so that it motivates users by leveraging social influence. The category consists of social facilitation, social comparison, normative influence, social learning, cooperation, competition, and recognition.
In his earliest expositions of captology, Fogg brought attention to the fact that “adopting an ethical perspective in this domain is vital because the topic of computers and the topic of persuasion both raise important issues about ethics and values” . In the environment of the World Wide Web, social media, and ubiquitous personal devices such as smartphones, this topical theme takes on pressing significance.
Motivated primarily by commercial and advertising interests, many websites and apps incorporate features that are intentionally designed to hook users in, maximizing their attention and usage time without due regard for the quality or benefits to well-being of this usage. A movement has recently emerged to counter this phenomenon, colloquially termed brain hacking, by promoting the development of technology that is ethical and humane rather than addictive or of little genuine benefit. Founded by Tristan Harris, a former student of Fogg, the Center for Humane Technology (CHT)  is raising awareness of the issues associated with certain SNSs and smartphone technologies. The CHT writes that [ ]:
Facebook, Twitter, Instagram, and Google have produced amazing products that have benefited the world enormously. But these companies are also caught in a zero-sum race for our finite attention, which they need to make money. Constantly forced to outperform their competitors, they must use increasingly persuasive techniques to keep us glued. They point AI-driven news feeds, content, and notifications at our minds, continually learning how to hook us more deeply—from our own behavior.
The CHT is “creating humane design standards, policy, and business models that more deeply align with our humanity and how we want to live” . The establishment of app design guidelines offers a simple and effective way to influence app architects by positively shaping the design and development of their systems. For example, the following is a selection of pertinent principles taken from a list published by the CHT that have been applied to the MOST platform [ ]:
- Does your product honor both on- and off-screen possibilities?
- Does your product enhance relationships or keep people isolated?
- Does your product land specific, net positive benefits in people’s lives?
- Does your product eliminate detours and distractions?
In our subsequent discussion of the MOST system, we will examine how it adheres to or embodies such persuasive design principles. Let us now discuss how well-being is traditionally conceptualized in the existing literature and provide the rationale for why we have chosen to evaluate the MOST system in terms of a eudaimonic conception of well-being.
What Are We Talking About When We Talk About Well-Being?
In a systematic review on the “Impact of the Use of Social Network Sites on Users’ Psychological Wellbeing,” Erafni and Abedin  argue that research on psychological well-being has historically been aligned with 3 perspectives: the hedonic view, the eudaimonic view, and life satisfaction (also known as the evaluation well-being view). The hedonic and evaluation well-being views are frequently referred to as PWB in the literature and are rarely differentiated as different kinds of well-being. However, these distinctions, which we will discuss in a moment, are nontrivial, for when several measures of well-being are grouped beneath the broad umbrella term PWB, it becomes difficult to understand precisely what is impacted by a given technology.
SWB  concerns “moods and emotions [...] together labelled affect [and] represents people’s on-line evaluations of the events that occur in their lives” (p 277) [ ]. SWB consists of 3 components: “life satisfaction, the presence of positive mood, and the absence of negative mood, together often summarized as happiness” (p 144) [ ]. Ryan and Deci argue that aligning well-being with happiness has a long history, dating back to the Greek philosopher Aristippus in the fourth century Before Christ. Thomas Hobbes, DeSade, and Jeremy Bentham followed in Aristippus’s thinking and later enlarged this early philosophical hedonism [ ]. The prevailing view present among hedonic psychologists today, Ryan and Deci argue, is the idea that well-being “consists of subjective happiness […] the experience of pleasure versus displeasure broadly construed [and] all judgements about the good/bad elements of life” (p 144) [ ]. To illustrate how prevalent the concept of SWB is in discussions of SNSs, Erafni’s and Abedin’s analysis indicates that of 22 studies that met their criteria for inclusion, 15 used the measure of life satisfaction, 3 used the measure of affect or happiness, and 1 used the components we normally associate with eudaimonic well-being: autonomy, personal mastery, personal growth, positive relations, purpose in life, and self-acceptance [ ]. However, it has been debated whether the SWB construct offers an adequate evaluation of a person’s psychological wellness [ , ].
Carol Ryff has argued that prevailing concepts of SWB must be challenged as the construct’s narrow focus on “assessments of feeling good, contentment and life-satisfaction” (p 13)  neglects “aspects of positive functioning such as purposeful engagement in life, realization of personal talents and capacities, and enlightened self-knowledge” [ ]. Self-Determination Theory (SDT) pioneers Ryan and Deci have also challenged the SWB construct of well-being through their adoption of the concept of eudaimonia in their broader consideration of well-being and “what it means to actualize the self and how that can be accomplished” (p 146) [ ]. SDT recognizes that 3 fundamental psychological needs are essential for the fulfillment of psychological growth. These include the need for autonomy, competence, and relatedness. For SDT, the fulfillment of these 3 basic needs is both the “natural aim of human life” and “typically fosters SWB as well as eudaimonic wellbeing” (p 147) [ ]. In fact, a recent study on designing digital systems for motivation, engagement, and well-being shows how satisfying the 3 basic needs of SDT can increase these desired outcomes of user experience [ ].
Ryff argues that SWB surfaced because of a mistranslation of the Aristotelian concept of eudaimonia. She writes that eudaimonia, when translated by Bradburn and other utilitarian philosophers of the 19th century, was taken to mean happiness . Ryff argues that the trouble with this assumption is that it equates hedonia with eudaimonia, “something that was deeply contrary to Aristotle’s distinction between the satisfaction of right and wrong desires” [ ]. Furthermore, this conflation leaves out the essence of Aristotle’s eudaimonia: “the striving towards excellence based on one’s unique potential” [ ]. Ryan and Deci too argue that Aristotle thought hedonic happiness and the pursuit thereof to be a vulgar idea. In their view, Aristotle believed that true happiness was to be found in “the expression of virtue” or “in doing what is worth doing” [ ]. Therefore, Ryff’s project has been to articulate a conception of PWB that is informed by and aligned with what she perceives to be the original essence of Aristotle’s eudaimonia. Ryff’s concept of PWB, the construct on which we will base our assessment of the MOST digital intervention for mental health, is concerned with 6 core components: self-acceptance, autonomy, personal growth, positive relationships, environmental mastery, and purpose in life [ ].
It is evident then that SWB and PWB, although both aimed at understanding the greater question of what makes a good life, are underpinned by radically different value judgments about what that is. From the hedonic viewpoint of SWB, well-being is “equated with happiness and is formally defined as more positive affect, less negative affect and greater life satisfaction” . PWB or eudaimonic well-being, as characterized by Ryff’s construct, in contrast, conceives of well-being as a broad and complex concept consisting of 6 intersecting variables (as above) and has little to do with the pursuit of pleasure and a diminishment of negative affect. PWB recognizes that the pursuit of well-being is frequently characterized by periods of negative affect, especially when one pursues a meaningful and difficult goal.
What this discussion of SWB and PWB reveals is that the construct of well-being is controversial and unresolved . For that reason, it is less than straightforward to interpret claims made about how technology impacts individual well-being. Furthermore, the overreliance of SWB measures to assess the impact of technology suggests that we are ascertaining a very narrow understanding of technology’s impact. An additional point worth emphasizing is that psychology as a discipline has for the last century been concerned with “the amelioration of psychopathology” and not with the enhancement of well-being and individual growth [ ]. Therefore, PWB is central in our discussion of the nexus between mental health and SNSs because the focus for psychology as a discipline has shifted, and we are now witnessing an increased focus on recovery in the fuller sense, including social and economic participation. We want to now bring these focal changes to bear on SNS design in particular. In the section to follow, we turn to a discussion of the MOST system in terms of ethical persuasive design and well-being considerations, showing how MOST fosters this broader sense of PWB or eudaimonic well-being.
Moderated Online Social Therapy
The MOST project, based at eOrygen (the digital mental health division of Australia's Orygen youth mental health centre), has been researching and developing online social therapy systems for mental health since 2010. Consisting of a multidisciplinary team of clinical psychologists, computing and information systems researchers, software developers, creative writers, illustrators, and peer workers, MOST has been primarily concerned with evaluating the efficacy of online therapy and developing engaging digital technologies for young people experiencing mental ill-health. Trials have also been adapted to nonyouth cohorts, specifically the families/carers of such young people.
The result of this work has been an online social therapy framework powered by the MOST Web platform (or MOSTware), which integrates Facebook-style social networking, specialized therapy units, and a forum-like feature where users can pose and cooperatively crowdsource solutions to common problems [- ]. All of this occurs within a clinical and peer-moderated environment.
As will be detailed later on, the MOST framework has been inspired by the field of positive psychology. Thus, on this basis, it technologically embodies an approach that balances a traditional focus on psychopathology with an emphasis on positive human development and flourishing [, ]. Together with a participatory design approach involving the users of our systems (young people and their carers) [ ], “we became aware of evidence highlighting that a focus on deficits in online systems can lead to demoralization and disengagement and so we began to specifically draw upon positive psychology frameworks” [ ]. More generally, MOST, as a technology that supports well-being and flourishing, aligns with the field of positive computing, which is itself informed by positive psychology and provides a foundational framework for the “design and development of technology to support psychological wellbeing and human potential” [ ].
By tailoring therapy content to target the treatment of specific conditions and adding any required code customizations, the flexible MOST platform enables the setting up of individual sites for a variety of mental health cohorts. To date, MOSTware has powered several successful studies, including the following:
- Rebound, a pilot trial for relapse prevention of major depressive disorder in young people [ ].
- Meridian, a pilot trial for carers of young people diagnosed with depression and anxiety [ ].
- Momentum, a pilot trial for young people at ultrahigh risk for psychosis [ ].
- Altitudes, a 2-year randomized controlled trial (RCT) of MOST for carers of young people with psychosis [ ].
- Horyzons, a 5-year RCT of MOST for relapse prevention following a first episode of psychosis [ ]. This trial will be used throughout this paper for illustration of the MOST platform.
- Generation, a public trial for general help-seeking youth, in collaboration with the eheadspace [ ] electronic mental health service [ ].
System credibility (as described in the section Persuasive Technology Design) within these interventions is ensured by several factors and measures taken:
- Therapy content is created by expert psychologists, young people with a lived experience of mental ill-health, writers, and illustrators.
- System moderation is conducted by qualified clinical psychologists and youth workers.
- Peer moderation is conducted by young people with a lived experience of mental ill-health who model system usage and interact with clients.
- Clinical trials are conducted with established protocols and within a framework of formal ethics approval.
In the social network newsfeed section of the system otherwise known as The Café (), users can contribute posts and comments, share experiences and interests, give and obtain support, gain new perspectives, and search for job opportunities and information in the Job Zone. The newsfeed feature is such that all users see the same newsfeed (ie, same ordered list of posts), though new developments will see the introduction of an algorithmically driven newsfeed tailored to each individual user. In Team Up, a relatively new feature to be discussed in more depth later, users can set a challenge for themselves that others can also participate in or follow as members of a cheer squad. MOST also contains an instant messenger service for communication between users, though this is only activated in the social network section of the site so as not to distract users with message popups while they are engaging with other parts of the site, particularly therapy content that requires deep attention. This design choice aligns with the CHT principle concerning the elimination of product detours and distractions.
Steps and Actions
The 2 types of therapy units offered in the MOST system are Steps and Actions. Steps are psychoeducational therapy modules that assist people with developing psychological skills, such as self-compassion and mindfulness, and core components of eudaimonic well-being or PWB, such as purpose in life, autonomy, personal growth, environmental mastery, positive relationships, and self-acceptance. Although there is still a case to be made for helping users to regulate unnecessary and pointless suffering by reducing or moderating unhelpful and oftentimes distressing emotional states, the ultimate aim of Steps and Actions is to foster PWB, particularly in relation to autonomy and self-acceptance. These standalone therapy units can also be found and sequentially completed within themed Step collections called Pathways. Steps are delivered as engaging content, including low-literacy comics, and have been developed collaboratively by clinical psychologists, creative writers, young people, and graphic designers. In terms of dialog support , as introduced in the section Persuasive Technology Design, therapy content has been developed to imitate its users with relatable material and suitable language for the target cohort (similarity) with an appropriate look and feel (liking). illustrates an example Step, How to flourish, which is primarily concerned with supporting young people to locate purposeful activities and meaning in their lives.
illustrates part of another example Step, Everyday mindfulness, in the newer comic format.
Social interaction is embedded within Steps through Talking Points, which are focused questions that invite young people to discuss and share their own experiences.shows a Talking Point within the Step How to flourish.
Actions are bite-sized behavioral activities or tasks that users can do to apply mindfulness, self-compassion, and personal strengths to relevant real-world situations. The use of context-specific, action-based suggestions through online interventions has been recommended to change behavior, develop skills, and increase practice and generalization of these skills to real-life situations . Users are responsible for completing the action in their own time and are encouraged to report back to others with their progress. Through choosing relevant and personally meaningful actions, the intention is that users come to recognize that they have the capacity to shift things in their lives for the better. Put differently, actions aim to foster a sense of environmental mastery through autonomy by urging users to recognize and indeed experience the degree of control they have over many of the circumstances of their lives. Certain Actions are embedded within the Steps to which they are relevant, so that once a Step is completed, users can do an Action to reinforce what they have learned ( shows an Action that is embedded in the Step Everyday mindfulness). Users can also engage with Actions through the Strengths to which they are connected; if an Action is connected to a Strength, then doing that Action will help to promote that Strength.
Upon joining the system, users have the option to complete an initial exercise where they choose 5, out of 24, character strengths that they believe best apply to them. Although they are free to partake in activities associated with any of the Strengths, content associated with the Strengths a user selects will be promoted by the MOST system and used to guide the user through the experience over time. An illustration of the Strengths page after completion of this initial exercise is given in.
The set of Strengths available in the MOST platform is not fixed and can be customized according to the purpose of a particular intervention. The most representative set of Strengths, found in interventions such as Horyzons, consists of 24 strengths drawn from the field of positive psychology . In addition to those illustrated in , others include fairness, forgiveness, gratitude, and honesty.
Connected with the ideas and frameworks discussed in the earlier section on well-being, the positive psychology movement is defined as “the scientific study of positive human functioning and flourishing on multiple levels that include the biological, personal, relational, institutional, cultural, and global dimensions of life” . A complement rather than replacement for traditional areas of psychology, positive psychology is concerned with human flourishing, a doctrine where the concept of eudaimonia, that is, “the striving towards excellence based on one’s unique potential” [ ], is deemed central to a life lived well. Positive psychology understands the good life as that in which one uses their “signature strengths every day to produce authentic happiness and abundant gratification” [ ]. The 24 Strengths drawn from positive psychology and embedded in the MOST system correspond neatly with the building blocks of eudaimonic well-being. By encouraging users to identify strengths they currently possess and those they wish to build, the system strives to promote self-acceptance, self-competence, and personal growth. For instance, users come to recognize and identify their current positive attributes (self-acceptance). An invitation that may be infrequently offered in the offline world, users also come to value personal growth through the recognition that their personal circumstances are not fixed; rather they can indeed grow or develop strengths that they do not currently believe they possess.
Thus, the positive psychology–inspired Strengths and therapy features of MOST naturally align with eudaimonia and Ryff’s concept of PWB. Although MOST interventions strive to maintain or improve levels of SWB, they also ultimately aim to promote eudaimonic or PWB.
Talk It Out
The Talk It Out (TIO) feature is a space where users can nominate problems or difficulties that they are seeking to discuss with other users. TIO is based on an evidence-based cognitive behavioral therapy social problem-solving framework developed by Nezu et al . Once a user has nominated a problem and framed it together with a peer worker, they brainstorm solutions together with others and discuss the pros and cons of each suggestion. Those moderating the process then synthesize the content and wrap it up. Apart from the role each of these TIO discussions play at the time in providing an active forum to help a person navigate their way through a problem, the overall result is an invaluable user-generated knowledge base repository that can be searched and referred back to by users at any time.
Environmental mastery is perhaps the most pertinent aspect of eudaimonic well-being fostered by TIO. Through the various phases, participants learn how to approach problem solving in a systematic and thoughtful way . They learn how to clearly and unemotionally define the problem they are facing, and in doing so, they are better positioned to ask for help and others are more likely to provide help that is relevant to their particular problem. The second phase of the TIO, brainstorming, further contributes to a sense of environmental mastery as it helps participants to recognize that when they perceive that there are multiple ways to solve a well-defined problem, they become less stressed and feel more control over their lives, safer, and more hopeful about locating a solution [ ]. Finally, brainstorming contributes to a sense of environmental mastery by inviting people to externalize their problem [ ]. Thus, rather than ruminating on their own thoughts, brainstorming removes the isolation that may accompany an internalized problem and supports participants to recognize that by externalizing a problem to others (or a network of other people like them) they can feel more in control of locating a solution.
In line with the CHT guidelines listed in section Persuasive Technology Design, TIO has been developed to foster connectivity and to help counter isolation while also promoting a sense of autonomy. The TIO feature is nonhierarchical—there is no patient and there is no expert. Rather, all participants are invited to be the experts on their own lives. This setup aims to foster a sense of autonomy as it removes the need to defer to a clinician when seeking a solution to an everyday problem. Through the TIO, participants can come to recognize that their lived experience is valuable and can be used, whether they are in a formal role as a peer worker or not, to support others. Therefore, TIO should bring people together and empower them to both contribute to and seek social support.
Unlike other social media and networking sites, the MOST platform has been specifically developed for the online treatment of mental ill-health. Naturally, therefore, a paramount consideration is the clinical efficacy and HCI of its specialized system components, such as the TIO forums, Steps and Actions therapy units, and moderator involvement. However, beyond these technical and clinical considerations and in concert with them, we must be mindful of the following:
- Ensure that the system in general is not detrimental to well-being and that features and components of little value or those that have a negative impact on psychological health are avoided.
- Develop content and features that promote mental health and well-being and that users are motivated to use for good reasons.
In describing the MOST system throughout this section, we have covered how some of these considerations have been incorporated into its design. We now turn to discuss some new MOST developments as they relate to the themes of this paper.
Balance Between Online and Offline Activities
- A website should encourage and facilitate offline activity outside of the site.
- Online activity should be promoted within the site insofar as it is something that is beneficial and inherent to the site or can genuinely only be mediated/facilitated by the site.
This approach ties in with the CHT design principle “does your product honor both on and off-screen possibilities” and helps to deter social media and networking addiction [, ]. We posit that it also accords with the eudaimonic conceptualization of well-being in the sense that the good life cannot be one confined to the digital realm. The resulting design philosophy is embodied in several existing and upcoming features and functionalities associated with the MOST system.
The Team Up feature is a relatively recent addition to the MOST platform, and a minimum viable implementation has been tried out on a select few trials. Team Up begins with a user nominating a challenge or goal that they want to achieve by a certain date. Other users can join the challenge either as a fellow participant or a supportive follower. An example Team Up challenge, “I want to exercise twice per week,” is captured in. As can be seen, Team Up embodies several social support persuasive system principles [ ]:
- Social learning: A person will be more motivated to perform a target behavior if (s)he can use a system to observe others performing the behavior.
- Social facilitation: System users are more likely to perform target behavior if they discern via the system that others are performing the behavior along with them.
- Recognition: By offering public recognition for an individual or group, a system can increase the likelihood that a person/group will adopt a target behavior.
However, other social support design principles such as competition and normative influence or peer pressure seem inappropriate given the type of supportive atmosphere being fostered in MOST.
Team Up demonstrates a commitment to ensuring that the systems strike a balance between online and offline activity. This simple feature drives an activity loop whereby users initiate their intention within the MOST system, and they then proceed to carry out activity in the offline world. They then return online to the MOST system to report their progress, and this cycle can continue. Crucially, without some activity in the offline world, there is no point in using the online feature, and thus, it encourages healthy activity offline, promotes social support and interaction within the online community, and uses the site only to facilitate these 2 things. Support and validation are offered to the Team Up challenger by other challengers and supporters joining, and this in turn promotes and encourages the completion of a beneficial goal. Interestingly, in a review of persuasive design in internet-based psychological therapy systems for adolescent depression , it is claimed that “persuasive design features that leverage social support to motivate users were rarely, if ever, reported features.” Such opportunities should not be missed, and the Team Up feature is one such example.
Online and Offline Therapy
The complete therapy experience in MOST consists of both online and offline units. Steps, which can be considered the digital counterpart to traditional face-to-face therapy, are engaged with and contained within the online MOST platform; users read the content and rate, share, and comment on screen.
However, Actions, which are often embedded within the Steps they are related to, generally involve doing an offline exercise to reinforce skills, especially those covered in the Step. Once a Step is completed by the user online, relevant Action suggestions populate the bottom of the Step screen, thus offering choices that send the user off the screen, as per the guidelines offered by the CHT.
The fact that Actions are embedded and confined within the MOST platform does, however, present a certain limitation to their utilization. This is because although access to the library of Actions is presently confined to the MOST Web app via standard access points such as lists and a search bar, they generally involve activity that is done offline and outside of the platform in relevant real-world scenarios. To remove these online to offline barriers and facilitate Action engagement, a new Action delivery system in the spirit of just-in-time adaptive interventions is in development . The idea is to respectfully use smartphone sensors to determine information about a user’s present psychological states and/or their current situation or location and then use this information to deliver to them, using push notifications contextually relevant and helpful Actions they can do in situ, in real time [ ].
For example, the Action “Mindfulness: deepening your awareness practice” () contains an audio guide on mindfulness with the suggestion that it be done outside in a park. Mobile phone geolocation data could be used to determine if a user is spending time in a park and deliver such an Action suggestion. As another simple example, the detection of a bout of nocturnal phone activity that deviates from one’s standard usage times or is at odds with their indicated chronotype could lead to the suggestion of an exercise for insomnia.
Given such a system, a user could gain therapy benefits without having to log into the MOST platform. The aim is for such a system to reduce entry barriers into therapy completion and increase motivation and the number of Actions a user fulfills. Thus, beyond simply offering and expecting users to visit a website for help, the system can meet users in real-life situations and dynamically deliver accessible and effective personalized help directly to their pockets. In terms of the persuasive system principles by Oinas-Kukkonen and Harjumaa , this mobile therapy delivery system embodies the primary task support principles of tailoring (information provided by the system will be more persuasive if it is tailored to the potential needs, interests, personality, usage context, or other factors relevant to a user group) and personalization (a system that offers personalized content or services has a greater capability for persuasion).
Such a detect-and-deliver system may also inhibit detrimental smartphone usage. In their article on 10 lessons learned about SNSs and addictions, Kuss and Griffiths (p 8)  list “Smartphone Addiction May Be Part of SNS Addiction” and write the following in their discussion of this item:
According to the pathway model, an addictive pattern of mobile phone use is characterized by the use of specific applications, including calls, instant messaging, and the use of social networks. This suggests that rather than being an addictive medium per se, mobile technologies including smartphones and tablets are media that enable the engagement in potentially addictive activities, including SNS use.
In terms of this issue, the benefit of such a detect-and-deliver system is that the smartphone becomes a tool to deliver contextually relevant Actions suggestions in offline situations rather than a necessary portal to an online app.
Gamification, as standardly defined, is the use of “video game elements in nongaming systems to improve user experience (UX) and user engagement” . Not surprisingly, there is an overlap between gamification and persuasive technology [ ]. Gamification ties in with the Dialog Support Rewards principle (systems that reward target behaviors may have great persuasive powers) [ ], and “some persuasion mechanisms can be regarded as similar to those applied in gamification, such as feedback and rewards” [ ]. There are also certain ethical dimensions of gamification to consider, including the argument that gamification is at odds with human flourishing and that it could be “morally corrosive by adversely impacting character” [ ]. There is currently work being done on adopting gamification to promote (mental) health and well-being [ - ]. We see the potential to positively harness gamification to enhance the adoption and sustained use of persuasive technologies that promote positive behavior change for people, particularly youth, in the mental health sphere.
Although not a formative consideration during the initial design and development of the MOST system, developments have since started to incorporate some gamification to encourage social engagement and therapy participation. This is in part because of feedback from users who have expressed a desire for the incorporation of gamification, particularly as ascertained from recent posttrial interviews for a qualitative study in development. In designing gamified components, we recognize that it is important to ensure that gamification does not negatively impact users and is not exploited by other parties. When done appropriately (see the studies by Kim and Werbach  and Llagostera [ ] for an overt example of inappropriate and pernicious gamification), competitiveness may be a suitable and effective ingredient in a gamified system. However, given that MOST is designed for young people experiencing a variety of mental health conditions, they may be particularly vulnerable or sensitive to potential negative effects of inciting competition and social comparison. Thus, the focus is on personal gamification and opportunities to make gamification a social, but not necessarily competitive, experience. In game theoretical parlance, we are dealing with non-zero-sum, possibly cooperative, games.
As introduced in the section Moderated Online Social Therapy upon joining the system, users can complete an initial exercise where they choose 5 out of 24 Strengths that they believe best apply to them. Changes to the Strengths system, at this stage in prototype form, involve adding a gamification component. Rather than a user selecting a fixed group of their top-5 Strengths when they begin using the site, with this new system, each Strength starts out as being more or less equal and various bits of user activity in the site over time add to the points score that they achieve for each strength. For example, contributing a newsfeed post could add 1 point to a user’s Social Connectedness strength score. As another example, users could gain Strength points in their Supportiveness strength by contributing a response to another user’s TIO problem.
The TIO feature is particularly interesting in terms of gamification considerations. As described earlier, the basic flow of a TIO discussion starts with the suggestion of a problem for communal discussion. Once this problem has been shaped, brainstormed solutions are offered by participants. A list of established solutions is then discussed by the group, where for each solution offered, users can respond to the solution with commentary responses in the form of pros and cons. Unlike the MOST news feed, in which posts and comments can be responded to via likes and reactions, no such response options to user posts have been implemented in TIO. The forum-like, crowdsourced question-and-answer structure of TIO makes it amenable to a style of reputation system gamification, in a manner similar to that of highly popular crowdsourcing forums such as Stack Overflow, where users are incentivized to contribute responses to questions by a points-and-recognition system. Users earn reputation points for offering answers, having their answers upvoted or downvoted by peers, and can receive badges for their valued knowledge contributions [- ].
Despite the suitability and tremendous success of Stack Overflow’s gamified reputation system, the viability or ethicality of such a system in TIO is problematic given its sensitivities. To begin with, Stack Overflow has implemented a well-crafted downvoting option, for which there is a good informational value rationale as downvoting another user’s contribution gives “you the critically important ability to distinguish between the good, the bad, and the ugly” and the ability to “tell the difference between a post that is harmless but uninteresting, and one that is actually wrong or harmful” . However, TIO contributions are not pure informational entities in the way that Stack Overflow posts are. They are often responses inspired by lived experience and may be imbued with emotionality and personal sharing. Therefore, it is important to preclude negativity and the perceived hostility that may arise through downvoting. Furthermore, any possibility of categorizing right and wrong answers is problematic. For forums such as Stack Overflow that trade in questions requiring answers of a factual nature, this is more straightforward, though not always perfectly clear. For TIO, the nature of the problems raised, and responses given, is such that any conception of right and wrong is meaningless, highly ambiguous, or unfeasible. Although there is the possibility of implementing a voting system restricted to upvoting to promote positivity and incentivize contributions, a resulting problem could be that an implicit competitive ranking emerges.
The gamified Strengths system differs in this regard as it offers a form of individual incentivization without the issues and pressure associated with social comparison and competition. It is also not intended to be an attempt at pointsification (cases where a stock approach of gamification has been added on top of an existing system ) simply to generate extrinsic motivation through the collection of awards. Rather, with a dash of gamification, the Strengths points system should serve to provide users with a way to track their activity levels on the site, the skills their activity is building, and the strengths they are actualizing. Hopefully, these are goals for which the user has an intrinsic motivation to use MOST.
Digital technologies, particularly computers, have been studied as persuasive technologies for at least a couple of decades now. Beyond the general aim of designing products that people want to use, there is the goal of creating interfaces and features designed to encourage certain actions or to change a person’s attitudes and behaviors. However, it has become apparent that given the commercial pressures and the race for user attention, techniques of persuasion employed by pervasive social media and networking sites are more about capitalizing our attention and generating usage that is addictive rather than usage that prioritizes well-being and is in the user’s best interest. A growing awareness of this phenomenon and the establishment of a movement to counter it have provided us with an impetus to reflect upon and analyze the MOST therapy framework and Web platform developed for online mental health interventions. We have discussed in this paper how consideration of these issues has shaped our development of the MOST system, with the intention to foster usage and engagement that is conducive rather than detrimental to mental health and well-being.
We have also had the opportunity in this paper to critically explore the notion of well-being. We contend that although hedonic or SWB is important, it is problematically limiting to confine well-being evaluations of SNSs to this type of well-being. Rather, a notion of well-being rooted in the Aristotelian conception of eudaimonia is another important dimension of well-being to consider. Although analyses of certain commercial SNSs have been restrictively conducted only in terms of SWB, given the positive psychological and therapeutic nature of the interventional MOST system, we are in a prime position to foster this sense of eudaimonic well-being.
The MOST framework is an evolving one, and as development continues on systems and features powered by tools, technologies and methodologies from artificial intelligence, ubiquitous computing, and HCI, we must remain mindful to scrutinize these developments in terms of ethical design so that user well-being remains paramount.
MA-J was supported by an Investigator Grant (APP1177235) from the National Health and Medical Research Council. Development of MOST has been supported by the Telstra Foundation.
Conflicts of Interest
The authors are part of the MOST development team.
- Chou HG, Edge N. 'They are happier and having better lives than I am': the impact of using Facebook on perceptions of others' lives. Cyberpsychol Behav Soc Netw 2012 Feb;15(2):117-121. [CrossRef] [Medline]
- Deters FG, Mehl MR. Does posting Facebook status updates increase or decrease loneliness? An online social networking experiment. Soc Psychol Personal Sci 2013 Sep 01;4(5). [CrossRef] [Medline]
- Kross E, Verduyn P, Demiralp E, Park J, Lee DS, Lin N, et al. Facebook use predicts declines in subjective well-being in young adults. PLoS One 2013;8(8):e69841 [FREE Full text] [CrossRef] [Medline]
- Steers MN, Wickham RE, Acitelli LK. Seeing everyone else's highlight reels: how Facebook usage is linked to depressive symptoms. J Soc Clin Psychol 2014;33(8):701-731. [CrossRef]
- Verduyn P, Ybarra O, Résibois M, Jonides J, Kross E. Do social network sites enhance or undermine subjective well-being? A critical review. Soc Issues Policy Rev 2017;11(1):274-302. [CrossRef]
- Frost RL, Rickwood DJ. A systematic review of the mental health outcomes associated with Facebook use. Comput Human Behav 2017;76:576-600. [CrossRef]
- Fogg BJ. Persuasive Computers: Perspectives and Research Directions. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 1998 Presented at: CHI'98; April 18-23, 1998; Los Angeles, California, USA p. 225-232. [CrossRef]
- Erfani SS, Abedin B. Impacts of the use of social network sites on users' psychological well-being: a systematic review. J Assoc Inf Sci Technol 2018;69(7):900-912. [CrossRef]
- Ryff CD, Singer BH. Know thyself and become what you are: a eudaimonic approach to psychological well-being. J Happiness Stud 2008;9(1):13-39. [CrossRef]
- Huang C. Internet use and psychological well-being: a meta-analysis. Cyberpsychol Behav Soc Netw 2010 Jun;13(3):241-249. [CrossRef] [Medline]
- Boyd DM, Ellison NB. Social network sites: definition, history, and scholarship. J Comput Mediat Commun 2007;13(1):210-230. [CrossRef]
- Fogg BJ. Persuasive Technology: Using Computers To Change What We Think And Do. San Francisco: Morgan Kaufmann; 2003.
- Fogg BJ. Persuasive technologies. Commun ACM 1999;42(5):26-29. [CrossRef]
- Oinas-Kukkonen H, Harjumaa M. Persuasive systems design: key issues, process model, and system features. Commun Assoc Inform Syst 2009;24(1):485-500. [CrossRef]
- Centre for Humane Technology. 2019. URL: https://humanetech.com/ [accessed 2019-10-22]
- Centre for Humane Technology. The Extractive Attention Economy is Tearing Apart Our Shared Social Fabric. URL: http://humanetech.com/problem/ [accessed 2018-11-28]
- Wayback Machine - Internet Archive. Calling All Technology Makers. URL: http://web.archive.org/web/20181113105139/http://humanetech.com/designers/ [accessed 2019-09-20]
- Diener E. Subjective well-being. Psychological Bulletin 1984;95(3):542-575. [CrossRef]
- Diener E, Suh EM, Lucas RE, Smith HL. Subjective well-being: three decades of progress. Psychol Bull 1999;125(2):276-302. [CrossRef]
- Ryan RM, Deci EL. On happiness and human potentials: a review of research on hedonic and eudaimonic well-being. Annu Rev Psychol 2001;52:141-166. [CrossRef] [Medline]
- Ryff CD, Singer BH. Best news yet on the six-factor model of well-being. Soc Sci Res 2006;35(4):1103-1119. [CrossRef]
- Ryff CD. Psychological well-being revisited: advances in the science and practice of eudaimonia. Psychother Psychosom 2014;83(1):10-28 [FREE Full text] [CrossRef] [Medline]
- Peters D, Calvo RA, Ryan RM. Designing for motivation, engagement and wellbeing in digital experience. Front Psychol 2018;9:797 [FREE Full text] [CrossRef] [Medline]
- D'Alfonso S, Santesteban-Echarri O, Rice S, Wadley G, Lederman R, Miles C, et al. Artificial intelligence-assisted online social therapy for youth mental health. Front Psychol 2017;8:796 [FREE Full text] [CrossRef] [Medline]
- Alvarez-Jimenez M, Bendall S, Lederman R, Wadley G, Chinnery G, Vargas S, et al. On the HORYZON: moderated online social therapy for long-term recovery in first episode psychosis. Schizophr Res 2013 Jan;143(1):143-149. [CrossRef] [Medline]
- Lederman R, Wadley G, Gleeson J, Bendall S, Álvarez-Jiménez M. Moderated online social therapy: designing and evaluating technology for mental health. ACM Trans Comput-Hum Interact 2014;21(1):1-26. [CrossRef]
- Peterson C. A Primer in Positive Psychology. New York: Oxford University Press; 2006.
- Seligman ME, Csikszentmihalyi M. Positive psychology: An introduction. Am Psychol 2000;55(1):5-14. [CrossRef]
- Wadley G, Lederman R, Gleeson J, Alvarez-Jimenez M. Participatory Design of an Online Therapy for Youth Mental Health. In: Proceedings of the 25th Australian Computer-Human Interaction Conference: Augmentation, Application, Innovation, Collaboration. 2013 Presented at: OZCHI’13; November 25–29, 2013; Adelaide, SA, Australia. [CrossRef]
- Gleeson J, Lederman R, Koval P, Wadley G, Bendall S, Cotton S, et al. Moderated online social therapy: a model for reducing stress in carers of young people diagnosed with mental health disorders. Front Psychol 2017;8:485 [FREE Full text] [CrossRef] [Medline]
- Calvo RA, Peters D. Positive Computing: Technology for Wellbeing and Human Potential. Cambridge: MIT Press; 2014.
- Rice S, Gleeson J, Davey C, Hetrick S, Parker A, Lederman R, et al. Moderated online social therapy for depression relapse prevention in young people: pilot study of a 'next generation' online intervention. Early Interv Psychiatry 2018 Aug;12(4):613-625. [CrossRef] [Medline]
- Alvarez-Jimenez M, Gleeson J, Bendall S, Penn D, Yung A, Ryan R, et al. Enhancing social functioning in young people at Ultra High Risk (UHR) for psychosis: a pilot study of a novel strengths and mindfulness-based online social therapy. Schizophr Res 2018 Dec;202:369-377. [CrossRef] [Medline]
- Gleeson J, Lederman R, Herrman H, Koval P, Eleftheriadis D, Bendall S, et al. Moderated online social therapy for carers of young people recovering from first-episode psychosis: study protocol for a randomised controlled trial. Trials 2017 Jan 17;18(1):27 [FREE Full text] [CrossRef] [Medline]
- Alvarez-Jimenez M, Bendall S, Koval P, Rice S, Cagliarini D, Valentine L, et al. HORYZONS trial: protocol for a randomised controlled trial of a moderated online social therapy to maintain treatment effects from first-episode psychosis services. BMJ Open 2019 Feb 19;9(2):e024104 [FREE Full text] [CrossRef] [Medline]
- headspace National Youth Mental Health Foundation. Welcome to eheadspace. URL: https://headspace.org.au/eheadspace/ [accessed 2019-10-22]
- Rice S, Gleeson J, Leicester S, Bendall S, D'Alfonso S, Gilbertson T, et al. Implementation of the enhanced Moderated Online Social Therapy (MOST+) model within a national youth e-Mental health service (eheadspace): protocol for a single group pilot study for help-seeking young people. JMIR Res Protoc 2018 Feb 22;7(2):e48 [FREE Full text] [CrossRef] [Medline]
- van Gemert-Pijnen JE, Kelders SM, Bohlmeijer ET. Understanding the usage of content in a mental health intervention for depression: an analysis of log data. J Med Internet Res 2014 Jan 31;16(1):e27 [FREE Full text] [CrossRef] [Medline]
- Peterson C, Seligman M. Character Strengths and Virtues: A Handbook and Classification. Oxford, UK: Oxford University Press; 2004.
- Seligman ME. Authentic Happiness: Using the New Positive Psychology to Realize Your Potential for Lasting Fulfillment. New York: Free Press; 2002.
- Nezu AM, Nezu CM, D'Zurilla T. Problem-Solving Therapy: A Treatment Manual. New York, NY: Springer Publishing Co; 2013.
- Kuss DJ, Griffiths MD. Online social networking and addiction--a review of the psychological literature. Int J Environ Res Public Health 2011 Sep;8(9):3528-3552 [FREE Full text] [CrossRef] [Medline]
- Kuss D, Griffiths M. Social networking sites and addiction: ten lessons learned. Int J Environ Res Public Health 2017 Mar 17;14(3):pii: E311 [FREE Full text] [CrossRef] [Medline]
- Wozney L, Huguet A, Bennett K, Radomski AD, Hartling L, Dyson M, et al. How do eHealth programs for adolescents with depression work? A realist review of persuasive system design components in internet-based psychological therapies. J Med Internet Res 2017 Aug 9;19(8):e266 [FREE Full text] [CrossRef] [Medline]
- Nahum-Shani I, Smith SN, Spring BJ, Collins LM, Witkiewitz K, Tewari A, et al. Just-in-Time Adaptive Interventions (JITAIs) in mobile health: Key components and design principles for ongoing health behavior support. Ann Behav Med 2018 May 18;52(6):446-462 [FREE Full text] [CrossRef] [Medline]
- D'Alfonso S, Carpenter N, Alvarez-Jimenez M. Making the MOST Out of Smartphone Opportunities for Mental Health. In: Proceedings of the 30th Australian Conference on Computer-Human Interaction. 2018 Presented at: OzCHI'18; December 4-7, 2018; Melbourne, Australia p. 577-581. [CrossRef]
- Deterding S, Sicart M, Nacke L, O'Hara K, Dixon D. Gamification. Using Game-design Elements in Non-gaming Contexts. In: Proceedings of the Extended Abstracts on Human Factors in Computing Systems. 2011 Presented at: CHI EA'11; May 7-12, 2011; Vancouver, BC, Canada p. 2425-2428. [CrossRef]
- Llagostera E. On Gamification and Persuasion. In: Proceedings of SBGames 2012. 2012 Presented at: SBC'12; November 2-4, 2012; Brasilia, Brazil.
- Hamari J, Koivisto J. Social Motivations To Use Gamification: An Empirical Study Of Gamifying Exercise. In: Proceedings of the 21st European Conference on Information Systems. 2013 Presented at: ECIS'13; June 5-8 2013; Utrecht.
- Selinger E, Sadowski J, Seager T. Gamification and morality. In: Walz SP, Deterding S, editors. The Gameful World: Approaches, Issues, Applications. Cambridge: MIT Press; 2014:371-392.
- Fleming TM, Bavin L, Stasiak K, Hermansson-Webb E, Merry SN, Cheek C, et al. Serious games and gamification for mental health: current status and promising directions. Front Psychiatry 2016;7:215 [FREE Full text] [CrossRef] [Medline]
- Brown M, O'Neill N, van Woerden H, Eslambolchilar P, Jones M, John A. Gamification and adherence to web-based mental health interventions: a systematic review. JMIR Ment Health 2016 Aug 24;3(3):e39 [FREE Full text] [CrossRef] [Medline]
- Lister C, West JH, Cannon B, Sax T, Brodegard D. Just a fad? Gamification in health and fitness apps. JMIR Serious Games 2014 Aug 4;2(2):e9 [FREE Full text] [CrossRef] [Medline]
- Pereira P, Duarte E, Rebelo F, Noriega P. A review of gamification for health-related contexts. In: Marcus A, editor. Design, User Experience, and Usability. User Experience Design for Diverse Interaction Platforms and Environments. Switzerland: Springer; 2014:742-753.
- Kim TW, Werbach K. More than just a game: ethical issues in gamification. Ethics Inf Technol 2016;18(2):157-173. [CrossRef]
- Cavusoglu H, Zhuolun L, Huang K. Can Gamification Motivate Voluntary Contributions?: The Case of StackOverflow Q&A Community. In: Proceedings of the 18th ACM Conference Companion on Computer Supported Cooperative Work & Social Computing. 2015 Presented at: CSCW'15 Companion; March 14-18, 2015; Vancouver, BC, Canada p. 171-174. [CrossRef]
- Bornfeld B, Rafaeli S. Gamifying with badges: a big data natural experiment on Stack Exchange. First Monday 2017;22(6). [CrossRef]
- FeverBee. 2017 Dec 17. The Most Advanced Online Community On The Web (A breakdown Of StackOverflow’s Online Community. URL: https://www.feverbee.com/stackoverflow/ [accessed 2018-11-27]
- Atwood J. Stack Overflow. 2009 Mar 9. The Value of Downvoting, or, How Hacker News Gets It Wrong. URL: https://stackoverflow.blog/2009/03/09/the-value-of-downvoting-or-how-hacker-news-gets-it-wrong/ [accessed 2018-11-27]
- Knutas A. Gamification. In: Lee N, editor. Encyclopedia of Computer Graphics and Games. Cham, Switzerland: Springer; 2018.
|CHT: Center for Humane Technology|
|HCI: human-computer interaction|
|MOST: Moderated Online Social Therapy|
|PWB: psychological well-being|
|RCT: randomized controlled trial|
|SDT: Self-Determination Theory|
|SNS: social networking site|
|SWB: subjective well-being|
|TIO: Talk It Out|
Edited by P Batterham; submitted 30.05.19; peer-reviewed by B Ridout, P Batterham; comments to author 24.07.19; revised version received 07.09.19; accepted 09.10.19; published 04.12.19
©Simon D'Alfonso, Jessica Phillips, Lee Valentine, John Gleeson, Mario Alvarez-Jimenez. Originally published in JMIR Mental Health (http://mental.jmir.org), 04.12.2019.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Mental Health, is properly cited. The complete bibliographic information, a link to the original publication on http://mental.jmir.org/, as well as this copyright and license information must be included.