This paper is in the following e-collection/theme issue:

Reviews in Digital Mental Health (228) Participatory Medicine & E-Patients (758) User Needs and Competencies (274) Participatory Design and Participatory Research (305) Users' and Patients' Needs for Mental Health Services (382) Innovations in Mental Health Systems (371)

Published on in Vol 10 (2023)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/46590, first published .
The Involvement of Service Users and People With Lived Experience in Mental Health Care Innovation Through Design: Systematic Review

The Involvement of Service Users and People With Lived Experience in Mental Health Care Innovation Through Design: Systematic Review

The Involvement of Service Users and People With Lived Experience in Mental Health Care Innovation Through Design: Systematic Review

Authors of this article:

Lars Veldmeijer1, 2 Author Orcid Image ;   Gijs Terlouw2 Author Orcid Image ;   Jim Van Os1 Author Orcid Image ;   Olga Van Dijk3 Author Orcid Image ;   Job Van 't Veer2 Author Orcid Image ;   Nynke Boonstra1, 2, 4 Author Orcid Image
Article Authors Cited by (6) Tweetations (4) Metrics

    Review

    1Department of Psychiatry, Utrecht University Medical Center, Utrecht, Netherlands

    2Department of Healthcare and Welfare, NHL Stenden University of Applied Sciences, Leeuwarden, Netherlands

    3NHL Stenden Library, NHL Stenden University of Applied Sciences, Leeuwarden, Netherlands

    4KieN VIP Mental Health Care Services, Leeuwarden, Netherlands

    Corresponding Author:

    Lars Veldmeijer, MA

    Department of Psychiatry

    Utrecht University Medical Center

    Heidelberglaan 100

    Utrecht, 3584 CX

    Netherlands

    Phone: 31 6 82874768

    Email: lars.veldmeijer@nhlstenden.com


    Background: Mental health care faces challenges that not only necessitate innovation but also require the involvement of service users and people with lived experience in developing and evaluating mental health care services. As the development of digital interventions is becoming more prevalent, design approaches are increasingly finding their way into mental health. There is evidence that these approaches can successfully integrate user experience into mental health services. However, there is no clear overview of the studies conducted and the lessons learned concerning the involvement of service users and people with lived experience.

    Objective: In this systematic review, we aimed to provide an overview of the involvement of service users and people with lived experience in mental health care services through design approaches and to synthesize the advantages of design approaches in mental health care.

    Methods: The following 5 databases were searched for relevant abstracts: PsycINFO, PubMed, Web of Science, Scopus, and Embase. In addition, 2 health design journal archives, Design for Health and The Journal of Health Design, were searched. To categorize the results, we collected the reported added value from the included articles and conducted a thematic synthesis in which the themes were developed from the retrieved data. The themes were discussed, revised, and checked until saturation was achieved.

    Results: We included and categorized 33 papers. Most studies involved service users, primarily adults, and used various design approaches. Most of these studies aimed to design or evaluate digital interventions. Service users and people with lived experience were involved in different roles but never as decision makers. Studies that used co-design approaches exhibited the highest levels of involvement. Various added values were reported, including tailoring and testing interventions and digital interventions, improving engagement and collaboration, gathering the needs of stakeholders, and empowering participants as resourceful actors. The challenges reported were maintaining participants’ continued participation throughout the study, managing the iterative nature of design, providing a safe space, balancing insights from design and medical science, and navigating design processes in medical environments.

    Conclusions: This systematic review provides an overview of the studies that used design approaches to involve service users and people with lived experience in mental health care innovation. Design approaches have advantages in mental health care innovation, offering added value and having manageable challenges. Future studies using design approaches in mental health care should involve participants as partners and decision makers and report on collaboration in a systematic and clear manner.

    JMIR Ment Health 2023;10:e46590

    doi:10.2196/46590

    Keywords

    design approaches; innovation; psychiatry; mental health care; involvement; service users; people with lived experience; cocreation; mobile phone 


    Background

    Mental health care services are in need of transformation [1]. However, incremental and iterative integration of advances is recommended rather than a complete paradigm shift [2]. Creative thinking [3] and the involvement of people with lived experience [4] are needed to catalyze these advances. Design and design research hold the potential to drive these incremental and iterative changes in traditional mental health care services, as it builds on creative thinking and doing [5]. Over the last decade, the application of design approaches in mental health care services has increased and has shown to accelerate innovation [6-8]. For example, design or co-design has been effective in designing or redesigning psychiatric facilities [9-11] and has proven successful in engaging end users in the design process of novel therapies [12-14]. The integration of design into mental health services is a logical continuation of the existing solutions to the challenges of the sector. These challenges include the relationship between professionals and patients in the era of value-based competition in health care [15,16], paradigm shifts in the diagnosis of mental health conditions [2,17,18], the integration of empirical evidence of recovery into traditional services [19,20], the efficacy of psychotherapies and pharmacotherapies in adults [21], and the cocreation of novel concepts and language with people with lived experience [22].

    Design Approaches

    Design can contribute to change and innovation in mental health care because it is a transformative discipline [23]. A scoping review of the extensive evidence on the role of the arts in improving health and well-being concluded that design, as a subcategory of the arts, can help prevent the onset of mental health conditions and support their treatment [24]. Design differs from the rational way of solving problems, that is, designers do not aim for the optimal solution to a given problem but choose a more exploratory approach, where the problem and solution evolve together [25]. Although digital innovation in mental health care has shown promising results, such as ecological momentary assessment and passive sensor tracking [26], the field encounters challenges involving service users and people with lived experience in the design of digital health interventions [27]. Despite these challenges, the involvement of service users and people with lived experience in design is seen as essential to tailor innovations to their needs and balance the power between patients and professionals [4]. Recent developments in design methodologies offer potential approaches to address these issues. For example, in recent years, the scope of design in health has been expanded by introducing various user-centered approaches, such as co-design [28], experience-based co-design [29], participatory design [14], design thinking [8], design research [30], iterative design [13], value-sensitive design [31], experience design [32], and human-centered design [33]. In these design approaches, designers aim to integrate users’ tacit knowledge into the design of products and services by assigning them an important role in the design process [34]. These design approaches use various methods from other fields [35], such as natural sciences, sociology, psychology, anthropology, and visual arts [36]. Design approaches have provided opportunities to all the stakeholders involved in the innovation processes to discover the user experience and to place the end users at the center of the design process by involving them as stakeholders [37].

    Level of Involvement of Service Users and People With Lived Experience

    There is a continuing focus on how service users and people with lived experience can be involved in mental health projects. A recently developed framework, The Involvement Matrix [38], was cocreated with experts by experience and researchers. The Involvement Matrix describes 5 roles (ie, listener, cothinker, adviser, partner, and decision maker) and 3 phases. Mainly, these roles are relevant to assessing the level of involvement of people with lived experience and service users in studies using a design approach. The lowest level of involvement is “the listener,” as they only receive information, whereas the second level, “the cothinker,” is also asked for an opinion. The third level, “the adviser,” gives solicited or unsolicited advice, whereas on the fourth level, “the partner,” acts as an equal partner. The “decision maker” can be seen as having the highest level of involvement, as the decision maker takes the initiative and is involved in the (final) decision. Although design approaches are useful in engaging stakeholders in mental health care innovation projects, there is currently no comprehensive overview of the studies that used design approaches, including which specific approaches were used, the roles service users and individuals with lived experience had, and the added value they generated.

    Objective

    In this systematic review, we aimed to provide an overview of the involvement of service users and people with lived experience in mental health care services through design approaches and to synthesize the advantages of design approaches in mental health care.


    Databases and Search Strategy

    The following 5 databases were searched for relevant abstracts: PsycINFO, PubMed, Web of Science, Scopus, and Embase. These databases cover a wide range of published studies in the field of health and design. Design for Health and The Journal of Health Design, which are both health design journals, were also searched because they publish papers at the intersection of health and design. The terms used for the PubMed search are presented in Textbox 1.

    Owing to the differences in search engine functionality, the method by which the terms were entered differed per database. A complete overview of these terms is provided in Multimedia Appendix 1. Before conducting the definitive search, we contacted an information specialist and performed 4 preliminary searches by using different terms to minimize the possibility of missing relevant studies. We followed the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines [39] to report this review. The search was conducted between September 6, 2022, and October 28, 2022.

    Textbox 1. Terms used for searching PubMed.

    A combination of search terms were used to identify relevant papers under the following categories: ((“Mental Health”[Mesh] OR mental-health[tiab] OR mental-hygiene[tiab] OR mental-care[tiab] OR “Psychiatry”[Mesh] OR psychiatr*[tiab]) AND (user-centered development*[tiab] OR user-centred design*[tiab] OR user-centred development*[tiab] OR user-centric design*[tiab] OR user-driven design*[tiab] OR user-driven development*[tiab] OR “User-Centered Design”[Mesh] OR user-centered-design*[tiab] OR usability-testing[tiab] OR Co-design*[tiab] OR Participatory-design*[tiab] OR Experience-based-co-design*[tiab] OR Interaction-design*[tiab] OR Service-design*[tiab] OR Systemic-design*[tiab] OR Patient-centered-design*[tiab] OR Human-centered-design*[tiab] OR Value-sensitive-design*[tiab] OR Design-thinking[tiab] OR Design-research*[tiab] OR Design-method*[tiab] OR Design-session*[tiab] OR design-approach*[tiab] OR design-principle*[tiab] OR design-choice*[tiab] OR universal-design*[tiab] OR Creativ-method*[tiab] OR Creative-session*[tiab] OR Generative-design*[tiab] OR Generative-method*[tiab] OR Generative-session*[tiab] OR Iterative-design*[tiab] OR Design-driven-innovation*[tiab] OR Speculative-design*[tiab] OR Critical-design*[tiab] OR Discursive-design*[tiab] OR Product-design*[tiab])) NOT (“Research Design”[Mesh] OR research-design[tiab] OR research-designs[tiab] OR research-protocol*[tiab] OR research-instrument*[tiab] OR study-design[tiab] OR study-designs[tiab] OR research-method*[tiab] OR methodology[tiab] OR methodological-research[tiab])

    Study Selection and Inclusion and Exclusion Criteria

    We included studies that discussed the involvement of service users and people with lived experience in mental health care services through design approaches. We included only original reports or papers that (1) involved service users, people with lived experience, or both; (2) mentioned design approaches; (3) involved an empirical study; and (4) conducted the study in settings including mental health care service or psychiatry programs. Papers that met these criteria were selected for full-text screening. We defined service users as participants who used mental health care services at the time of their involvement and people with lived experience as those who had used mental health care services in the past but were not currently using them during the study in which they were involved. We included empirical studies because they could provide insights into the level of involvement. We selected studies conducted in mental health care and psychiatry care service settings to retrieve as many studies as possible. We are aware that there is an overlap between the terms and that the services offered under both contexts may vary across countries.

    The following exclusion criteria were used for full-text screening: (1) non–peer-reviewed papers such as abstracts, conference posters, or trade journals; (2) papers with full texts not available; (3) papers in languages other than English; (4) monographs or short reports; and (5) papers with insufficient information in the abstract.

    Research Questions

    To provide an overview of the involvement of service users and people with lived experience in mental health care services through design approaches and to provide insight into the advantages of design approaches in mental health care innovation, the included studies were analyzed using the following research questions (RQs):

    • RQ 1: Who were included (service users, people with lived experience, or both)?
    • RQ 2: What design approach was used?
    • RQ 3: What was the aim of the innovation?
    • RQ 4: What were the roles of service users and people with lived experience?
    • RQ 5: What was the added value of involving service users and people with lived experience through design approaches?
    • RQ 6: What were the challenges in involving service users and people with lived experience through design approaches?

    Screening Process and Study Selection

    After removing duplicates, the titles and abstracts of the papers were screened using Rayyan (Rayyan Systems Inc) [40]. A total of 2 reviewers (LV and GT) independently reviewed all the titles and abstracts and were double blinded for relevance with the formulated inclusion and exclusion criteria. Papers were only included if both LV and GT agreed, and a plausible argumentation for consideration of inclusion always led to the inclusion. Full-text papers were retrieved after this step. During the full-text screening phase, the first 20% of the papers were randomly selected and double-blind reviewed by 2 reviewers (LV and GT). The random selection ensured that the screening process was unbiased, and the double-blind review increased its reliability. Subsequently, the primary reviewer (LV) reviewed the other included papers for full-text reading, which helped to maintain consistency throughout the review process.

    Data Extraction

    Data were extracted using structured forms, including the characteristics of participants (service users and people with lived experience), aim of innovation, design approach, and role of the participants in the design approach. In addition, we focused on the added value and challenges of involving service users and people with lived experience through a design approach that the authors reported in the included studies. Findings from all the studies regarding the reported added values and challenges were extracted and collated using a thematic synthesis. Thematic synthesis preserves principles that have traditionally been important to systematic reviewing [41]. This synthesis was performed by LV and GT. Because our primary aim was to find all possible added values reported (ie, a comprehensive overview), we refrained from using the existing design frameworks to guide data extraction and analysis, as such an approach may have impeded the identification of novel findings that were not aligned with the themes these frameworks provide or other a priori themes that we could have developed [42]. As such, the themes that emerged from the data were discussed and revised to minimize overlap and were checked by researchers JvV and NB. This process was repeated until saturation of the themes was achieved.


    Search Results

    Our initial database search yielded 2758 records. After removing 745 (27.01%) duplicates from 2758 records, the titles and abstracts of the 2013 (72.99%) records were screened. Next, excluding 1971 (97.91%) papers from the 2013 records after full-text screening, 42 (2.13%) records were sought for retrieval, and finally, 28 (67%) papers were included. We also identified 71 records through a journal search. After removing 17 (24%) duplicates from 71 records, we retrieved 54 (76%) records that were assessed for eligibility. Of these 54 records, 5 (9%) were included. This resulted in 33 included papers in this systematic review (Figure 1 shows a flow diagram of the results in the different selection stages). In both stages, a consensus was reached by the reviewers regarding the inclusion and analysis of the papers. All the included studies were published between 2010 and 2022. An overview of these studies is presented in Table 1. In Table 1, to avoid misinterpretation, we retained the terms that were used by the authors to describe their participants.

    The following section outlines the characteristics of the included studies and the results orientated toward the RQs. First, we have described whether the studies included service users, people with lived experience, or both, as well as the age group of the involved participants. Then, we have summarized the aim of the innovation and reported the design approaches used. To address the level of involvement, we have presented the roles of service users and people with lived experiences. Finally, we have elaborated on the included studies to provide a context for the reported added value and challenges.

    ‎
    Figure 1. Selection process: PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) 2020 flow diagram.
    Table 1. Overview and categorization of the included studies.
    Study, yearStudy titleParticipants and age groupAim or aims of innovationApproach and role
    Owens et al [43], 2010Involving service users in intervention design: a participatory approach to developing a text‐messaging intervention to reduce repetition of self‐harm
    • Service users
    • Adults
    		Digital intervention development
    • Participatory workshops
    • Cothinkers
    Gammon et al [44], 2014Service users’ perspectives in the design of an online tool for assisted self-help in mental health: a case study of implications
    • Service users
    • Adults
    		Digital intervention development—recovery orientated
    • Community-based participatory research with iterative and cocreative design
    • Cothinkers
    Terp et al [45], 2016A room for design: through participatory design young adults with schizophrenia become strong collaborators
    • Service users
    • Adolescents
    		Digital intervention development
    • Co-design
    • Partners
    Grim et al [46], 2017Development and usability testing of a web-based decision support for users and health professionals in psychiatric services
    • Service users
    • People with lived experience
    • Adults
    		Digital intervention development
    • Participatory design
    • Cothinkers
    Nakarada-Kordic et al [6], 2017Co-designing for mental health: creative methods to engage young people experiencing psychosis
    • Service users
    • Young people
    		Service improvement
    • Co-design
    • Partners
    Schmitt and Yarosh [47], 2018Participatory design of technologies to support recovery from substance use disorders
    • Service users
    • Adults
    		Digital intervention development—recovery orientated
    • Participatory design
    • Cothinkers
    McClelland and Fitzgerald [48], 2018A participatory mobile application (app) development project with mental health service users and clinicians
    • Service users
    • Not specified
    		Digital intervention development
    • Co-design
    • Cothinkers
    Vilardaga et al [49], 2018User-centered design of learn to quit, a smoking cessation smartphone app for people with serious mental illness
    • Service users
    • Adults
    		Digital intervention development
    • User-centered design
    • Cothinkers
    Terp et al [50], 2018A smartphone app to foster power in the everyday management of living with schizophrenia: qualitative analysis of young adults’ perspectives
    • Service users
    • Adults
    		Digital intervention development—recovery orientated
    • Participatory design
    • Partners
    Vieira da Silva and Bueno [51], 2018Compass: a personal organization mobile app for individuals with mental disorders
    • Service users and people with lived experience
    • Adults
    		Digital intervention development
    • User-centered design
    • Cothinkers
    Hackett et al [52], 2018Co-designing for quality: creating a user-driven tool to improve quality in youth mental health services
    • Service users
    • Young people
    		Digital intervention development
    • Experience-based co-design
    • Advisers
    Mulvale et al [53], 2019Co-designing services for youth with mental health issues: novel elicitation approaches
    • Service users
    • Young people
    		Service improvement
    • Co-design
    • Advisers
    Romm et al [54], 2019Designing easy access to care for first-episode psychosis in complex organizations
    • Service users
    • Adults
    		Service improvement
    • Service design
    • Cothinkers
    Derks et al [55], 2019Development of an ambulatory biofeedback app to enhance emotional awareness in patients with borderline personality disorder: multicycle usability testing study
    • Service users
    • Adults
    		Digital intervention development—recovery orientated
    • User-centered design
    • Cothinkers
    Realpe et al [56], 2019Co-designing a virtual world with young people to deliver social cognition therapy in early psychosis
    • Service users and people with lived experience
    • Young people
    		Digital intervention development—recovery orientated
    • Co-design
    • Advisers
    Maathuis et al [57], 2019Exploring human values in the design of a web-based QoLa instrument for people with mental health problems: a value-sensitive design approach
    • Service users
    • Not specified
    		Digital intervention development
    • Value-sensitive design
    • Cothinkers
    Fonseka et al [58], 2019Collaborating with individuals with lived experience to adapt CANMATb clinical depression guidelines into a patient treatment guide: the CHOICE-Dc co-design process
    • People with lived experience
    • Adults
    		Service improvement—recovery orientated
    • Co-design
    • Partners
    Terlouw et al [59], 2020Design of a digital comic creator (it’s me) to facilitate social skills training for children with autism spectrum disorder: design research approach
    • Service users
    • Young people
    		Digital intervention development
    • Design research
    • Advisers
    Stawarz et al [60], 2020Design considerations for the integrated delivery of cognitive behavioral therapy for depression: user-centered design study
    • Service users
    • Adults
    		Digital intervention development
    • User-centered design
    • Advisers
    Callan et al [61], 2020CBTd MobileWork: user-centered development and testing of a mobile mental health application for depression
    • Service users
    • Adults
    		Digital intervention development—recovery orientated
    • User-centered design
    • Cothinkers
    Flobak et al [62], 2021Designing videos with and for adults with ADHDe for an online intervention: participatory design study and thematic analysis of evaluation
    • People with lived experience
    • Adults
    		Digital intervention development
    • Participatory design
    • Cothinkers
    van der Meer et al [63], 2021Targeting personal recovery of people with complex mental health needs: the development of a psychosocial intervention through user-centered design
    • Service users
    • Adults
    		Recovery orientated
    • User-centered design
    • Advisers
    García et al [64], 2021Co-design of avatars to embody auditory hallucinations of patients with schizophrenia: a study on patients’ feeling of satisfaction and psychiatrists’ intention to adopt the technology
    • Service users
    • Adults
    		Digital intervention development—recovery orientated
    • Co-design
    • Advisers
    Jonathan et al [65], 2021A smartphone-based self-management intervention for bipolar disorder (livewell): user-centered development approach
    • Service users
    • Adults
    		Digital intervention development—recovery orientated
    • User-centered development approach
    • Cothinkers
    Milton et al [66], 2021Technology-enabled reform in a nontraditional mental health service for eating disorders: participatory design study
    • People with lived experience
    • Not specified
    		Digital intervention development—recovery orientated
    • Participatory design
    • Cothinkers
    Sanin et al [67], 2021Creative well-being. prototyping an arts-health practice program for mental health recovery
    • Service users
    • Not specified
    		Service improvement—recovery orientated
    • Participatory design
    • Autonomous design
    • Partners
    Knight et al [14], 2021Participatory design to create a VRf therapy for psychosis
    • People with lived experience
    • Not specified
    		Digital intervention development
    • Participatory design
    • Advisers
    Kruzan et al [68], 2022Centering lived experience in developing digital interventions for suicide and self-injurious behaviors: user-centered design approach
    • People with lived experience
    • Adolescents
    		Digital intervention development—recovery orientated
    • User-centered design
    • Advisers
    Bos et al [69], 2022A web-based application for personalized ecological momentary assessment in psychiatric care: user-centered development of the PETRAg application
    • Service users
    • Not specified
    		Digital intervention development
    • User-centered development approach
    • Cothinkers
    Bongers et al [70], 2022I need to know: using the CeHResh roadmap to develop a treatment feedback tool for youngsters with mental health problems
    • People with lived experience
    • Young people
    		Digital intervention development
    • Co-design
    • Advisers
    Wiberg et al [71], 2022Internet-based cognitive behavior therapy for eating disorders—development and feasibility evaluation
    • Service users and people with lived experience
    • Adults
    		Digital intervention development—recovery orientated
    • User-centered design
    • Cothinkers
    Illarregi et al [72], 2022Is designing therapeutic? a case study exploring the experience of co-design and psychosis
    • Service user
    • Adult
    		Intervention development
    • Co-design
    • Partner
    Jenness et al [73], 2022Lessons learned from designing an asynchronous remote community approach for behavioral activation intervention for teens
    • Service users
    • Teenagers and adolescents
    		Digital intervention development
    • Human-centered design
    • Advisers

    aQoL: quality of life.

    bCANMAT: Canadian Network for Mood and Anxiety Treatments.

    cCHOICE-D: Canadian Network for Mood and Anxiety Treatments Health Options for Integrated Care and Empowerment in Depression.

    dCBT: cognitive behavioral therapy.

    eADHD: attention-deficit/hyperactivity disorder.

    fVR: virtual reality.

    gPETRA: Personalized Treatment by Real-time Assessment.

    hCeHRes: Centre for eHealth Research roadmap.

    Characteristics of the Included Studies

    All the included peer-reviewed articles were published between 2010 and 2022.

    Participants

    Of the 33 studies, 6 (18%) involved individuals with lived experience [14,58,62,66,68,70], 23 (70%) involved service users [6,43-45,47-50,52-55,57,59-61,63-65,67,69,72,73], and 4 (12%) involved both [46,51,56,71]. A total of 18 (55%) studies of the 33 studies included adult participants [43-47,49-51,54,55,58,60-65,71,72], 6 (18%) studies described their participants as young people [6,52,53,56,59,70], 3 (9%) studies described their participants as adolescents [45,68,73], and 6 (18%) did not specify the age group of their participants [14,48,57,66,67,69].

    Aim of the Innovation

    In total, 27 studies aimed to develop interventions, with 12 focusing on recovery [44,47,50,55,56,61,63-66,68,71], 3 targeting service improvement [6,53,54], and 2 targeting both [58,67]. A total of 26 studies focused on digital innovation design or evaluation [14,43-52,55-57,59-62,64-66,68-71,73] and 1 focused on design as an intervention itself [72].

    Design Approaches

    Co-design was used as the design approach in 9 studies [6,45,48,53,56,58,64,70,72]. User-centered design was used in 8 studies [49,51,55,60,61,63,68,71], and participatory design was used in 7 studies [14,46,47,50,62,66,67]. Other identified approaches included value-sensitive design [57], experience-based co-design [52], service design [54], design research [59], human-centered design [73], user-centered development [65,69], community-based participatory research [44], and participatory workshops [43].

    Level of Involvement

    The Involvement Matrix [38] was used to ascertain the roles of service users and individuals with lived experience in the analyzed studies. None of the studies included the participants as “listeners,” whereas 16 studies featured participants in the role of a “cothinker” [43,44,46-49,51,54,55,57,61,62,65,66,69,71], providing their opinions on ideas or evaluating test sessions of innovations developed by the researchers. In addition, participants served as “advisers” in 11 studies, offering solicited or unsolicited feedback to researchers and designers [14,52,53,56,59,60,63,64,68,70,73]. In 6 studies, participants functioned as equal “partners” with researchers and designers [6,45,50,58,67,72]. However, none of the studies identified participants in the decision maker role and reported involving participants in the final decision-making processes. The studies in which co-design was used as the approach exhibited the highest levels of participant involvement.

    Reported Added Values

    Overview

    The included studies reported a wide range of added value of the involvement of service users and people with lived experience through design approaches. Not every article mentioned specific design approach–related benefits [49,70]. On the basis of the thematic synthesis, we divided these added values into 4 categories.

    Design for Tailoring and Testing (Digital) Applications and Interventions

    In total, 6 studies reported on the added value of tailoring and testing existing designs with service users and people with lived experience [51,55,61,64,69,71]. Vieira da Silva and Bueno [51] adopted a user-centered design approach for the development and testing of the Compass app, which aimed to support people with mental health problems in their daily lives. The study found that patient testing provided key learnings for the final prototype, such as improvement of the interface design, resulting in the app meeting the users’ needs and expectations. Derks et al [55] cyclically tested an outpatient biofeedback application to increase emotional awareness in patients with borderline personality disorders. Testing with service users provided insights into the usability of the application. Wiberg et al [71] used a user-centered design process for the development and feasibility assessment of an internet-based cognitive behavioral therapy for patients with eating disorders. This approach contributed to improvements and adjustments to the program according to the end users’ needs and perceptions. Bos et al [69] described a user-centered development approach for a web-based application for personalized ecological momentary assessment in psychiatric care. The user-centered approach ensured that the developed application, which was tested with service users, was intuitive, user-friendly, and useful for clients and clinicians. García et al [64] co-designed avatars to embody auditory hallucinations. The co-design approach guaranteed that the service users found the developed software to be complete and useful for representing their voices. Callan et al [61] used an iterative design process to develop and test a mobile health app for individuals with depression, incorporating user feedback to improve the app’s appearance, navigation, content, and organization.

    Design for Increasing Engagement and Collaboration in the Development of Interventions

    We observed that 10 studies reported added value on increasing user engagement and collaboration in the development of interventions [14,52-54,58,59,65-68]. Romm et al [54] focused on the use of service design to address known barriers to developing early intervention services in complex health care organizations. By emphasizing cocreation and divergent thinking, service design encouraged experimentation and innovation to improve service development, engaging service users in organizational improvement. Jonathan et al [65] reported on a user-centered design process for developing a smartphone-based self-management intervention for individuals with bipolar disorder. This approach prioritized collaboration among stakeholders, which helped to personalize service users’ goals and plans and integrate human support as a self-management tool. Kruzan et al [68] presented a user-centered design approach to engage individuals with self-harming thoughts and behaviors who may be uncomfortable in traditional in-person therapy settings. User-centered design methods allow for flexibility in engaging individuals and facilitating collaboration in the most comfortable and accessible ways, such as through the internet. Sanin et al [67] collaborated with occupational therapists and inpatients to develop an arts-health program prototype. The cocreation of designers and occupational therapists generated a collaborative design process, expanding the creative practices of occupational therapists. Hackett et al [52] described the experience-based co-design process for improving the quality of youth mental health services. The co-design event emphasized communication and collaboration in delivering quality care, and the feedback tools developed by young participants served as an important starting point for continuous quality improvement.

    In another article, Mulvale et al [53] highlighted the effectiveness of elicitation techniques such as experience maps, trigger videos, and prototyping in promoting mutual understanding and shared ideas for system changes. The experience-based co-design process, which prioritized the engagement of people with lived experience in the design of mental health services, was consistent with a recovery orientation that calls for collaboration with service users in the design of services. Terlouw et al [59] described the design of a digital comic maker for children with autism spectrum disorders. The design approach led to finding different problem perceptions among stakeholders and added value to the acceptability of the developed innovation by exploring and sharing different sensemaking processes from different stakeholder perspectives. Milton et al [66] reported on the use of participatory design processes to customize and configure a technological solution for a nontraditional mental health service for people with eating disorders and body image issues. The authors reported that participatory design processes enabled a collaborative approach to the customization and configuration of the platform. Knight et al [14] described a participatory design process for developing virtual reality therapy for people with psychosis, which facilitated collaboration between expert groups, including individuals with lived experience of psychosis. This approach led to design and innovation within a shared understanding of limitations and evidence-based design. Fonseka et al [58] adapted a clinical guideline through a co-design approach to an accessible version for patients and families, emphasizing the importance of informed discussion and partnership between people with lived experience and researchers and designers.

    Design for Identifying the Needs of Service Users and People With Lived Experience

    There were 9 studies that reported added value in identifying user needs [43,46-48,56,57,60,72,73]. Schmitt and Yarosh [47] reported on the value of participatory design workshops in aiding the recovery of women with substance use disorders. The workshops provided new insights into the participants’ needs, emphasizing the importance of anonymity and safety in recovery. Owens et al [43] used a participatory approach to develop a SMS text messaging intervention to reduce repetitive self-harm and found that people with lived experience preferred individualized texting instead of a generic one-size-fits-all approach. Grim et al [46] used participatory design processes to develop a web-based system and found that incorporating user perspectives can tailor an innovation to the needs of the user group. Maathuis et al [57] used a value-sensitive design approach to identify potential value conflicts in the design of an internet-based quality-of-life tool for people with mental health problems. The study showed how the approach made it possible to identify and anticipate potential value conflicts and patients’ needs in the design. McClelland and Fitzgerald [48] used a co-design approach to develop a mobile app for service users involved in the early intervention services for psychosis. The authors described key needs that emerged from service user involvement, and they incorporated those needs into the app prototype design, emphasizing that early input is essential to design flexible and relevant contents that meets user needs.

    Stawarz et al [60] identified new perspectives and requirements by exploring service users’ needs using user-centered design methods. As a result, the authors formulated 12 design considerations for the integrated delivery of cognitive behavioral therapy for people with depression. Jenness et al [73] used a human-centered design process to develop an app to provide an evidence-based psychosocial intervention for teenagers with depression, and they found that it helped teenagers reduce avoidance. Involving service users in the design process led to design changes based on their needs, such as personalizing the timing and frequency of logging reminders based on participants’ routines and times when they felt most comfortable. Realpe et al [56] found that the co-design process with young people with psychosis led to unexpected insights regarding their needs and wishes, which challenged the researchers’ understanding of what service users needed during recovery. For example, the approach revealed that young people preferred designs that resembled familiar environments with an urban feel, such as local therapeutic spaces or classrooms, rather than stereotypical places of leisure. Illarregi et al [72] focused on the experience of 1 service user in a co-design study, providing insights into how the design activity can support recovery.

    Design for Empowering Service Users and People With Lived Experience as Resourceful Actors

    In total, 6 studies reported the added values of empowering participants as resourceful actors through design approaches [6,44,45,50,62,63]. Gammon et al [44] highlighted the importance of involving service users in the design process of a web-based tool for assisted self-help in mental health. Their study showed that involving service users through design approaches could reveal gaps in relevance between mainstream research and service users’ interests, and the involvement fosters commitment to follow through in the implementation and research phases. The authors found that the approach stimulated to involve service users, as no one is more capable of conveying the intentions and functionalities of the innovation than the service users. Flobak et al [62] reported that the participatory design could balance the perspectives of people with attention-deficit/hyperactivity disorder and clinicians, leading to mutual learning. The authors noted that in their study, participants were not only experts on what they liked or disliked but also very knowledgeable about ADHD, as they had first-hand experience and tacit knowledge of the ADHD diagnosis. This experiential knowledge was initially unavailable to the clinicians and deemed very important for the design process of the intervention. van der Meer et al [63] found that service users with complex mental health problems could meaningfully participate in and contribute to understanding the problem and reflecting on the form and content of a psychosocial intervention. Even service users who were less able to express their needs and desires regarding the content or design of the intervention could still identify the factors they felt were important to consider, and these factors played crucial roles in developing the psychosocial intervention.

    Nakarada-Kordic et al [6] reported that service users identified unique needs and interests that differed significantly from those identified by clinicians. Creative participatory methods meaningfully involved young people experiencing psychosis in the process. The study emphasized the importance of treating young people as equal partners and acknowledging them as experts in their own conditions and experiences. The design workshops showed the authors that the unique needs and interests of the participants posed a greater challenge than their severe mental health issues. Terp et al [45] used a design approach to develop a mobile phone tool that enabled young adults with schizophrenia to be actively involved in designing more participatory mental health services. The authors emphasized the importance of giving the community of practice a name and body from the beginning of the design process so that young adults with schizophrenia feel included solely as experts in their own experience and not as patients. The community of practice functioned as an “identity changer” from “receiver” to “giver,” or from a patient in need to a designer of the need. Terp et al [50] concluded in a follow-up study among young adults with schizophrenia that close collaboration between designers, researchers, and users ensured that the app met the target audience’s needs.

    Reported Challenges

    The involvement of service users and people with lived experience through design approaches presents several challenges. Participants’ continued participation throughout the study is challenging due to changing mental states, economic constraints, recruitment and panel size, and difficulty in reaching participants [43,53,54,58,64,70,73]. The iterative nature of design makes it difficult to record dynamic individual small group work [43,63,66], and using a design approach is reported to be time-consuming [44,46,48,56]. Providing a safe space for service users and people with lived experience is not only important but also challenging [45,53,68], and designers must be aware of the trade-off between preserving authenticity and reinforcing the stigmatizing characteristics of mental health [62]. Balancing insights from design and medical science can be challenging, as stakeholder recommendations may be inconsistent with evidence-based practices or theory-based principles of change [49,57]. Managing design processes in medical environments is challenging because of the disruptive nature of co-design formats and methods, difficulty in finding a balance between easy navigation in the app and meeting participant requests for additional features, and logistics of capturing inputs from multiple concurrent discussions [6,65,67].


    Principal Findings

    This systematic review highlights the advantages of involving service users and people with lived experience through design approaches for innovation in mental health care. Innovation projects in mental health care involve service users and people with lived experience in design processes, with the first publication occurring in 2010. Most studies involved service users, mostly adults. Co-design is the most frequently used design approach. Innovation primarily aimed to develop digital interventions that promote recovery. Participants were often involved as cothinkers and advisers, and sometimes as partners, but never as decision makers. We identified 4 themes in which we categorized the added values of design approaches, namely, design for tailoring and testing interventions and applications, to increase engagement and collaboration in the development of interventions, to identify the needs of service users and people with lived experience, and to empower them as resourceful actors. The challenges reported were maintaining participants’ continued participation throughout the study, managing the iterative nature of design, providing a safe space, balancing insights from design and medical science, and navigating design processes in medical environments.

    Many of the included studies emphasized the end results rather than the design processes. Moreover, most studies did not describe whether and how they evaluated the participants’ experiences in the design approach. This can be explained by the fact that the objectives of these studies were not primarily aimed at reporting on the involvement of the participants and their experiences but rather on the development of the interventions or applications. In the studies that we categorized as promoting the partner role, co-design was the design approach that was used most often. This shows the promise of the co-design approach for future innovation projects in mental health care, particularly when significant participation of service users and people with lived experience is required. In line with earlier research, further advantages can be obtained by engaging end users early in the design processes [74]. Many studies reported added values on various topics that centered on the engagement and collaboration in innovation projects. However, based on the findings in this review, this collaboration focused usually on the goals of the researchers and not on the benefits that the design approaches can have for service users and people with lived experience. Although multiple challenges were discovered, these seem to be manageable and can be overcome with more methodological and organizational “design mindedness,” in line with earlier research on the challenges of design in health [75-79].

    Comparison With Previous Findings

    Several studies overlap the scope of this systematic review. In an exploratory mapping review, Vial et al [33] examined the literature to understand how human-centered design is considered in e-mental health intervention research. Their findings show that the included studies relied very little on designers and design research, with limited involvement of end users in the design process. In our review, design approaches were used in most studies as a form of traditional research as opposed to how these approaches are described in the design literature, and the level of involvement of service users and people with lived experience was typically low for design processes. The results of our systematic review are also consistent with the those of 4 other reviews [80-83]: co-design processes involving service users and people with lived experience contribute to person-centered innovation; as a result, design can help shift the power balance in favor of susceptible populations. However, the implementation and explanation of design requirements are lacking, and the reporting offers no substantial ground for definitive conclusions. In our review, many studies that created an intervention or application did not describe a design rationale, whereas previous research has shown that this is essential in determining the thoughts and foundations of an intervention to enable researchers to build on it [74,84,85].

    This systematic review leverages the existing literature to show the potential of design approaches to empower service users and people with lived experience as resourceful actors in innovation processes in mental health care. This finding suggests that high levels of involvement through design may not only have beneficial outcomes for the greater good of the developed product but also contribute to the benefits of the participants involved. Although this value could be miniscule, it is an effect that has not been emphasized previously, exhibiting some therapeutic potential. The studies wherein the design approaches display high levels of involvement seem to foster equal cooperation and shared objectives, which share similarities with the fundamental elements of therapy, such as therapeutic alliances and expectation-rich therapeutic rituals [86]. In addition, using design approaches seems to align with the need to prioritize the use of participatory methods that facilitate the collaboration with service users, empowering them to meaningfully influence design decisions as important stakeholders [87].

    Strengths and Limitations

    The purpose of this systematic review is to provide an overview of the involvement of service users and people with lived experience in mental health care services through design approaches and to identify its advantages. Therefore, we used broad search terms to include as many studies as possible that covered the topic and provide a complete overview of its advantages. To ensure methodological quality, all the included studies were peer reviewed and published in academic journals. To analyze the results, we used a thematic synthesis to have the categories emerge from the data. Although this approach is appropriate for finding new data, the results of the synthesis may appear different from an a priori theoretically driven approach [42]. However, a priori themes could have resulted in overlooking advantages that did not fit within these established categories, such as the potential that design approaches have for empowering service users as resourceful actors. This could have limited the overview of the design approaches and their advantages, which was the main aim of this systematic review.

    Future Research

    Although the current emphasis on empowerment, autonomy, involvement, and participation in design-based innovation is a positive development, sharing numerous principles with the recovery movement [88], the included studies provide little information on what they consider involvement and participation, how they intend it, and how they integrate these principles into their methodology. Given that most studies that were categorized as promoting the partner role were also the studies that were categorized as empowering, we recommend that future studies examine what partner and decision maker roles can accomplish to yield therapeutic and recovery outcomes. Furthermore, we suggest that future design studies that focus on innovation in mental health care use a framework that helps to report engagement with service users and people with lived experience in a systemic and clear manner, such as the Involvement Matrix [38]. Our review identified relevant data on the involvement of service users and people with lived experience, but these data were reported in various sections of the papers, were often brief, and lacked detail, corresponding with previous research on patient and public involvement in health and social care research [89]. Involvement frameworks can be valuable when patient-researcher partnerships are led by researchers with little experience involving service users in research [90]. Other directions for future research are examining the different uses of experiential knowledge and its usefulness for design research, investigating whether the use of experiential knowledge by mental health professionals can be beneficial, and exploring how research can benefit from cocreation and how these impact service users, people with lived experience, and mental health professionals.

    Conclusions

    This systematic review provides an overview of the involvement of service users and people with lived experience in mental health care services through design approaches and their advantages. The results show that design approaches add value to tailoring and testing applications, interventions, digital applications, and digital interventions; improving engagement and collaboration in the development of interventions; identifying the needs of stakeholders; and empowering service users and people with lived experience as resourceful actors. The challenges that were identified are maintaining participants’ continued participation throughout the study, managing the iterative nature of design, providing a safe space, balancing insights from design and medical science, and navigating design processes in medical environments. Of all the design approaches, co-design was identified as achieving the highest level of involvement and can be useful for innovation in mental health care, wherein significant participation of service users and people with lived experience is required. Future studies using design approaches in mental health care are recommended to systematically and clearly report on involvement and collaboration.

    Acknowledgments

    The authors appreciate the financial support of the Faith Research Consortium, GGZ-VS University of Applied Science, and the NHL Stenden University of Applied Sciences Doctor of Philosophy program. These funders had no role in the content of this paper.

    Conflicts of Interest

    None declared.

    Multimedia Appendix 1

    Overview of search terms.

    DOCX File , 18 KB
    1. Freeman M. The World Mental Health Report: transforming mental health for all. World Psychiatry. Oct 08, 2022;21(3):391-392. [FREE Full text] [CrossRef] [Medline]
    2. Stein DJ, Shoptaw SJ, Vigo DV, Lund C, Cuijpers P, Bantjes J, et al. Psychiatric diagnosis and treatment in the 21st century: paradigm shifts versus incremental integration. World Psychiatry. Oct 08, 2022;21(3):393-414. [FREE Full text] [CrossRef] [Medline]
    3. Borsboom D, Haslbeck JM, Robinaugh DJ. Systems-based approaches to mental disorders are the only game in town. World Psychiatry. Oct 08, 2022;21(3):420-422. [FREE Full text] [CrossRef] [Medline]
    4. Thornicroft G. Psychiatric diagnosis and treatment in the 21st century: paradigm shifts or power shifts? World Psychiatry. Oct 08, 2022;21(3):334-335. [FREE Full text] [CrossRef] [Medline]
    5. Veldmeijer L, Terlouw G, van ‘t Veer J, Van Os J, Boonstra N. Design for mental health: can design promote human-centred diagnostics? Design Health. Feb 14, 2023;7(1):5-23. [FREE Full text] [CrossRef]
    6. Nakarada-Kordic I, Hayes N, Reay SD, Corbet C, Chan A. Co-designing for mental health: creative methods to engage young people experiencing psychosis. Design Health. Oct 24, 2017;1(2):229-244. [CrossRef]
    7. Szücs Johansson L, Vink J, Wetter-Edman K. A Trojan horse approach to changing mental health care for young people through service design. Design Health. Oct 24, 2017;1(2):245-255. [CrossRef]
    8. Scholten H, Granic I. Use of the principles of design thinking to address limitations of digital mental health interventions for youth: viewpoint. J Med Internet Res. Jan 14, 2019;21(1):e11528. [FREE Full text] [CrossRef] [Medline]
    9. Sumartojo S, Pink S, Duque M, Vaughan L. Atmospheres of care in a psychiatric inpatient unit. Design Health. Mar 05, 2020;4(1):24-42. [CrossRef]
    10. Farahnak Majd N, Golembiewski J, Tarkashvand A. The psychiatric facility: how patients with schizophrenia respond to place. Design Health. Nov 28, 2020;4(3):384-406. [CrossRef]
    11. Liddicoat S. Mental health facility codesign: a new research method for integrating the service user voice in design processes using virtual reality. Gen Psychiatr. Jul 23, 2019;32(3):e100061. [FREE Full text] [CrossRef] [Medline]
    12. Adams L, Simonoff E, Tierney K, Hollocks MJ, Brewster A, Watson J, et al. Developing a user-informed intervention study of a virtual reality therapy for social anxiety in autistic adolescents. Design Health. Apr 24, 2022;6(1):114-133. [CrossRef]
    13. Terlouw G, Kuipers D, van 't Veer J, Prins JT, Pierie JP. The development of an escape room-based serious game to trigger social interaction and communication between high-functioning children with autism and their peers: iterative design approach. JMIR Serious Games. Mar 23, 2021;9(1):e19765. [FREE Full text] [CrossRef] [Medline]
    14. Knight I, West J, Matthews E, Kabir T, Lambe S, Waite F, et al. Participatory design to create a VR therapy for psychosis. Design Health. Feb 26, 2021;5(1):98-119. [CrossRef]
    15. Berwick DM. Era 3 for medicine and health care. JAMA. Apr 05, 2016;315(13):1329-1330. [CrossRef] [Medline]
    16. Groenewoud AS, Westert GP, Kremer JA. Value based competition in health care's ethical drawbacks and the need for a values-driven approach. BMC Health Serv Res. Apr 27, 2019;19(1):256. [FREE Full text] [CrossRef] [Medline]
    17. Frances AJ, Widiger T. Psychiatric diagnosis: lessons from the DSM-IV past and cautions for the DSM-5 future. Annu Rev Clin Psychol. Apr 27, 2012;8(1):109-130. [CrossRef] [Medline]
    18. Guloksuz S, van Os J. The slow death of the concept of schizophrenia and the painful birth of the psychosis spectrum. Psychol Med. Jul 10, 2017;48(2):229-244. [CrossRef]
    19. Slade M, Longden E. Empirical evidence about recovery and mental health. BMC Psychiatry. Nov 14, 2015;15:285. [FREE Full text] [CrossRef] [Medline]
    20. van Weeghel J, van Zelst C, Boertien D, Hasson-Ohayon I. Conceptualizations, assessments, and implications of personal recovery in mental illness: a scoping review of systematic reviews and meta-analyses. Psychiatr Rehabil J. Jun 2019;42(2):169-181. [CrossRef] [Medline]
    21. Leichsenring F, Steinert C, Rabung S, Ioannidis JP. The efficacy of psychotherapies and pharmacotherapies for mental disorders in adults: an umbrella review and meta-analytic evaluation of recent meta-analyses. World Psychiatry. Feb 11, 2022;21(1):133-145. [FREE Full text] [CrossRef] [Medline]
    22. van Os J, Guloksuz S. Schizophrenia as a symptom of psychiatry's reluctance to enter the moral era of medicine. Schizophr Res. Apr 2022;242:138-140. [FREE Full text] [CrossRef] [Medline]
    23. Latour B. A cautious Prometheus? A few steps toward a philosophy of design with special attention to Peter Sloterdijk. In: In Medias Res. Amsterdam. Amsterdam University Press; 2011;151-164.
    24. Fancourt D, Saoirse F. What is the Evidence on the Role of the Arts in Improving Health and Well-being? A Scoping Review. Geneva, Switzerland. World Health Organization; 2019.
    25. Cross N. Designerly Ways of Knowing. London, England. Springer; 2006.
    26. Verhagen S, van Os J, Delespaul P. Ecological momentary assessment and other digital technologies for capturing daily life in mental health. In: Mental Health in a Digital World. Cambridge, Massachusetts, United States. Academic Press; 2022;81-108.
    27. Birnbaum F, Lewis D, Rosen RK, Ranney ML. Patient engagement and the design of digital health. Acad Emerg Med. Jun 21, 2015;22(6):754-756. [FREE Full text] [CrossRef] [Medline]
    28. Thabrew H, Fleming T, Hetrick S, Merry S. Co-design of eHealth interventions with children and young people. Front Psychiatry. Oct 18, 2018;9:481. [FREE Full text] [CrossRef] [Medline]
    29. Bate P, Robert G. Experience-based design: from redesigning the system around the patient to co-designing services with the patient. Qual Saf Health Care. Oct 01, 2006;15(5):307-310. [FREE Full text] [CrossRef] [Medline]
    30. Veldmeijer L, Wartena B, Terlouw G, van’t Veer J. Reframing loneliness through the design of a virtual reality reminiscence artefact for older adults. Design Health. Nov 26, 2020;4(3):407-426. [CrossRef]
    31. Friedman B. Value-sensitive design. Interactions. Dec 1996;3(6):16-23. [CrossRef]
    32. Hassenzahl M, Diefenbach S, Göritz A. Needs, affect, and interactive products – facets of user experience. Interact Comput. Sep 2010;22(5):353-362. [CrossRef]
    33. Vial S, Boudhraâ S, Dumont M. Human-centered design approaches in digital mental health interventions: exploratory mapping review. JMIR Ment Health. Jun 07, 2022;9(6):e35591. [FREE Full text] [CrossRef] [Medline]
    34. Sanders EB, Stappers PJ. Convivial Toolbox Generative Research for the Front End of Design. Amsterdam, Netherlands. BIS Publishers; 2012.
    35. Dixon BS. Dewey and Design: A Pragmatist Perspective for Design Research. Cham, Switzerland. Springer Nature; 2020.
    36. Koskinen I, Zimmerman J, Binder T, Redstrom J, Wensveen S. Design Research Through Practice From the Lab, Field, and Showroom. Burlington, Massachusetts, United States. Morgan Kaufmann; 2011.
    37. Brown T. Change by Design How Design Thinking Transforms Organizations and Inspires Innovation. New York, United States. HarperCollins; 2009.
    38. Smits DW, van Meeteren K, Klem M, Alsem M, Ketelaar M. Designing a tool to support patient and public involvement in research projects: the Involvement Matrix. Res Involv Engagem. Jun 16, 2020;6(1):30. [FREE Full text] [CrossRef] [Medline]
    39. Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. J Clin Epidemiol. Jun 2021;134:178-189. [FREE Full text] [CrossRef] [Medline]
    40. Ouzzani M, Hammady H, Fedorowicz Z, Elmagarmid A. Rayyan-a web and mobile app for systematic reviews. Syst Rev. Dec 05, 2016;5(1):210. [FREE Full text] [CrossRef] [Medline]
    41. Thomas J, Harden A. Methods for the thematic synthesis of qualitative research in systematic reviews. BMC Med Res Methodol. Jul 10, 2008;8:45. [FREE Full text] [CrossRef] [Medline]
    42. Popay J, Roberts H, Sowden A, Petticrew M, Arai L, Rodgers M, et al. Guidance on the conduct of narrative synthesis in systematic reviews. ESRC Methods Programme. 2006. URL: https:/​/www.​lancaster.ac.uk/​media/​lancaster-university/​content-assets/​documents/​fhm/​dhr/​chir/​NSsynthesisguidanceVersion1-April2006.​pdf [accessed 2023-04-15]
    43. Owens C, Farrand P, Darvill R, Emmens T, Hewis E, Aitken P. Involving service users in intervention design: a participatory approach to developing a text-messaging intervention to reduce repetition of self-harm. Health Expect. Sep 2011;14(3):285-295. [FREE Full text] [CrossRef] [Medline]
    44. Gammon D, Strand M, Eng LS. Service users' perspectives in the design of an online tool for assisted self-help in mental health: a case study of implications. Int J Ment Health Syst. Jan 09, 2014;8(1):2. [FREE Full text] [CrossRef] [Medline]
    45. Terp M, Laursen BS, Jørgensen R, Mainz J, Bjørnes CD. A room for design: through participatory design young adults with schizophrenia become strong collaborators. Int J Ment Health Nurs. Dec 13, 2016;25(6):496-506. [CrossRef] [Medline]
    46. Grim K, Rosenberg D, Svedberg P, Schön UK. Development and usability testing of a web-based decision support for users and health professionals in psychiatric services. Psychiatr Rehabil J. Sep 2017;40(3):293-302. [CrossRef] [Medline]
    47. Schmitt Z, Yarosh S. Participatory design of technologies to support recovery from substance use disorders. Proc ACM Hum Comput Interact. Nov 2018;2(CSCW):1-27. [CrossRef]
    48. McClelland GT, Fitzgerald M. A participatory mobile application (app) development project with mental health service users and clinicians. Health Educ J. Jun 05, 2018;77(7):815-827. [CrossRef]
    49. Vilardaga R, Rizo J, Zeng E, Kientz JA, Ries R, Otis C, et al. User-centered design of learn to quit, a smoking cessation smartphone app for people with serious mental illness. JMIR Serious Games. Jan 16, 2018;6(1):e2. [FREE Full text] [CrossRef] [Medline]
    50. Terp M, Jørgensen R, Laursen BS, Mainz J, Bjørnes CD. A smartphone app to foster power in the everyday management of living with schizophrenia: qualitative analysis of young adults' perspectives. JMIR Ment Health. Oct 01, 2018;5(4):e10157. [FREE Full text] [CrossRef] [Medline]
    51. Vieira da Silva AC, Bueno J. Compass. Inf Des J. Sep 23, 2019;24(3):220-235. [CrossRef]
    52. Hackett CL, Mulvale G, Miatello A. Co-designing for quality: creating a user-driven tool to improve quality in youth mental health services. Health Expect. Dec 2018;21(6):1013-1023. [FREE Full text] [CrossRef] [Medline]
    53. Mulvale G, Moll S, Miatello A, Murray-Leung L, Rogerson K, Sassi RB. Co-designing services for youth with mental health issues: novel elicitation approaches. Int J Qual Methods. Feb 21, 2019;18:160940691881624. [CrossRef]
    54. Romm KL, Gardsjord ES, Gjermundsen K, Aguirre Ulloa M, Berentzen LC, Melle I. Designing easy access to care for first-episode psychosis in complex organizations. Early Interv Psychiatry. Oct 27, 2019;13(5):1276-1282. [CrossRef] [Medline]
    55. Derks YP, Klaassen R, Westerhof GJ, Bohlmeijer ET, Noordzij ML. Development of an ambulatory biofeedback app to enhance emotional awareness in patients with borderline personality disorder: multicycle usability testing study. JMIR Mhealth Uhealth. Oct 15, 2019;7(10):e13479. [FREE Full text] [CrossRef] [Medline]
    56. Realpe A, Elahi F, Bucci S, Birchwood M, Vlaev I, Taylor D, et al. Co-designing a virtual world with young people to deliver social cognition therapy in early psychosis. Early Interv Psychiatry. Feb 25, 2020;14(1):37-43. [CrossRef] [Medline]
    57. Maathuis I, Niezen M, Buitenweg D, Bongers IL, van Nieuwenhuizen C. Exploring human values in the design of a web-based QoL-instrument for people with mental health problems: a value sensitive design approach. Sci Eng Ethics. Apr 09, 2020;26(2):871-898. [CrossRef] [Medline]
    58. Fonseka TM, Pong JT, Kcomt A, Kennedy SH, Parikh SV. Collaborating with individuals with lived experience to adapt CANMAT clinical depression guidelines into a patient treatment guide: the CHOICE-D co-design process. J Eval Clin Pract. Aug 14, 2020;26(4):1259-1269. [FREE Full text] [CrossRef] [Medline]
    59. Terlouw G, van 't Veer JT, Prins JT, Kuipers DA, Pierie JP. Design of a digital comic creator (It's Me) to facilitate social skills training for children with autism spectrum disorder: design research approach. JMIR Ment Health. Jul 10, 2020;7(7):e17260. [FREE Full text] [CrossRef] [Medline]
    60. Stawarz K, Preist C, Tallon D, Wiles N, Kessler D, Turner K, et al. Design considerations for the integrated delivery of cognitive behavioral therapy for depression: user-centered design study. JMIR Ment Health. Sep 03, 2020;7(9):e15972. [FREE Full text] [CrossRef] [Medline]
    61. Callan JA, Dunbar Jacob J, Siegle GJ, Dey A, Thase ME, DeVito Dabbs A, et al. CBT MobileWork©: user-centered development and testing of a mobile mental health application for depression. Cogn Ther Res. Sep 25, 2020;45(2):287-302. [CrossRef]
    62. Flobak E, Nordby ES, Guribye F, Kenter R, Nordgreen T, Lundervold AJ. Designing videos with and for adults with ADHD for an online intervention: participatory design study and thematic analysis of evaluation. JMIR Ment Health. Sep 14, 2021;8(9):e30292. [FREE Full text] [CrossRef] [Medline]
    63. van der Meer L, Jonker T, Wadman H, Wunderink C, van Weeghel J, Pijnenborg GH, et al. Targeting personal recovery of people with complex mental health needs: the development of a psychosocial intervention through user-centered design. Front Psychiatry. Apr 8, 2021;12:635514. [FREE Full text] [CrossRef] [Medline]
    64. García AS, Fernández-Sotos P, Vicente-Querol MA, Sánchez-Reolid R, Rodriguez-Jimenez R, Fernández-Caballero A. Co-design of avatars to embody auditory hallucinations of patients with schizophrenia. Virtual Real. Jul 08, 2021;27(1):217-232. [CrossRef]
    65. Jonathan GK, Dopke CA, Michaels T, Bank A, Martin CR, Adhikari K, et al. A smartphone-based self-management intervention for bipolar disorder (LiveWell): user-centered development approach. JMIR Ment Health. Apr 12, 2021;8(4):e20424. [FREE Full text] [CrossRef] [Medline]
    66. Milton AC, Hambleton A, Dowling M, Roberts AE, Davenport T, Hickie I. Technology-enabled reform in a nontraditional mental health service for eating disorders: participatory design study. J Med Internet Res. Feb 16, 2021;23(2):e19532. [FREE Full text] [CrossRef] [Medline]
    67. Sanin J, Spong L, McRae C. Creative wellbeing. Prototyping an arts-health practice program for mental health recovery. Design Health. May 20, 2021;5(1):61-81. [CrossRef]
    68. Kruzan KP, Meyerhoff J, Biernesser C, Goldstein T, Reddy M, Mohr DC. Centering lived experience in developing digital interventions for suicide and self-injurious behaviors: user-centered design approach. JMIR Ment Health. Dec 24, 2021;8(12):e31367. [FREE Full text] [CrossRef] [Medline]
    69. Bos FM, von Klipstein L, Emerencia AC, Veermans E, Verhage T, Snippe E, et al. A web-based application for personalized ecological momentary assessment in psychiatric care: user-centered development of the PETRA application. JMIR Ment Health. Aug 09, 2022;9(8):e36430. [FREE Full text] [CrossRef] [Medline]
    70. Bongers IL, Buitenweg DC, van Kuijk RE, van Nieuwenhuizen C. I need to know: using the CeHRes roadmap to develop a treatment feedback tool for youngsters with mental health problems. Int J Environ Res Public Health. Aug 31, 2022;19(17):10834. [FREE Full text] [CrossRef] [Medline]
    71. Wiberg AC, Ghaderi A, Danielsson HB, Safarzadeh K, Parling T, Carlbring P, et al. Internet-based cognitive behavior therapy for eating disorders - development and feasibility evaluation. Internet Interv. Dec 2022;30:100570. [FREE Full text] [CrossRef] [Medline]
    72. Illarregi ER, Alexiou K, DiMalta G, Zamenopoulos T. Is designing therapeutic? A case study exploring the experience of co-design and psychosis. Psychosis. Apr 27, 2022:1-15. [CrossRef]
    73. Jenness JL, Bhattacharya A, Kientz JA, Munson SA, Nagar RR. Lessons learned from designing an asynchronous remote community approach for behavioral activation intervention for teens. Behav Res Ther. Apr 2022;151:104065. [FREE Full text] [CrossRef] [Medline]
    74. Terlouw G, Kuipers D, Veldmeijer L, van 't Veer J, Prins J, Pierie JP. Boundary objects as dialogical learning accelerators for social change in design for health: systematic review. JMIR Hum Factors. Feb 03, 2022;9(1):e31167. [FREE Full text] [CrossRef] [Medline]
    75. Groeneveld B, Dekkers T, Boon B, D’Olivo P. Challenges for design researchers in healthcare. Design Health. Jan 12, 2019;2(2):305-326. [CrossRef]
    76. Blandford A, Berndt E, Catchpole K, Furniss D, Mayer A, Mentis H, et al. Strategies for conducting situated studies of technology use in hospitals. Cogn Tech Work. Dec 16, 2014;17(4):489-502. [CrossRef]
    77. Noël G. Health design: mapping current situations, envisioning next steps. Design J. Sep 06, 2017;20(sup1):S2304-S2314. [CrossRef]
    78. Tsekleves E, Cooper R. Emerging trends and the way forward in design in healthcare: an expert’s perspective. Design J. Sep 06, 2017;20(sup1):S2258-S2272. [CrossRef]
    79. Rowe A, Knox M, Harvey G. Re-thinking health through design: collaborations in research, education and practice. Design Health. Nov 15, 2020;4(3):327-344. [CrossRef]
    80. Grindell C, Coates E, Croot L, O'Cathain A. The use of co-production, co-design and co-creation to mobilise knowledge in the management of health conditions: a systematic review. BMC Health Serv Res. Jul 07, 2022;22(1):877. [FREE Full text] [CrossRef] [Medline]
    81. Mulvale A, Miatello A, Hackett C, Mulvale G. Applying experience-based co-design with vulnerable populations: lessons from a systematic review of methods to involve patients, families and service providers in child and youth mental health service improvement. Patient Exp J. Apr 28, 2016;3(1):117-129. [CrossRef]
    82. Schouten SE, Kip H, Dekkers T, Deenik J, Beerlage-de Jong N, Ludden GD, et al. Best-practices for co-design processes involving people with severe mental illness for eMental health interventions: a qualitative multi-method approach. Design Health. Nov 26, 2022;6(3):316-344. [CrossRef]
    83. Aryana B, Brewster L, Nocera JA. Design for mobile mental health: an exploratory review. Health Technol. Oct 27, 2018;9(4):401-424. [CrossRef]
    84. Kuipers DA, Terlouw G, Wartena BO, van 't Veer JT, Prins JT, Pierie JP. The role of transfer in designing games and simulations for health: systematic review. JMIR Serious Games. Nov 24, 2017;5(4):e23. [FREE Full text] [CrossRef] [Medline]
    85. Veldmeijer L, Terlouw G, van ’t Veer J, Kuipers D. Harnessing virtual reality simulation in training healthcare workers in handling patients with suspected COVID-19 infections: results of training and lessons learned about design. Design Health. Apr 21, 2022;6(1):44-68. [CrossRef]
    86. van Os J, Guloksuz S, Vijn TW, Hafkenscheid A, Delespaul P. The evidence-based group-level symptom-reduction model as the organizing principle for mental health care: time for change? World Psychiatry. Feb 02, 2019;18(1):88-96. [FREE Full text] [CrossRef] [Medline]
    87. Jones N, Callejas L, Brown M, Colder Carras M, Croft B, Pagdon S, et al. Barriers to meaningful participatory mental health services research and priority next steps: findings from a national survey. Psychiatr Serv. Mar 20, 2023:appips20220514. [FREE Full text] [CrossRef] [Medline]
    88. Davidson L. The recovery movement: implications for mental health care and enabling people to participate fully in life. Health Affairs. Jun 01, 2016;35(6):1091-1097. [CrossRef] [Medline]
    89. Brett J, Staniszewska S, Mockford C, Herron-Marx S, Hughes J, Tysall C, et al. Mapping the impact of patient and public involvement on health and social care research: a systematic review. Health Expect. Oct 2014;17(5):637-650. [FREE Full text] [CrossRef] [Medline]
    90. Hamilton CB, Hoens AM, Backman CL, McKinnon AM, McQuitty S, English K, et al. An empirically based conceptual framework for fostering meaningful patient engagement in research. Health Expect. Feb 2018;21(1):396-406. [FREE Full text] [CrossRef] [Medline]

    ‎
    PRISMA: Preferred Reporting Items for Systematic Reviews and Meta-Analyses
    RQ: research question

    Edited by J Torous; submitted 17.02.23; peer-reviewed by A Segev, S Markham, N Dippel; comments to author 02.04.23; revised version received 10.05.23; accepted 16.06.23; published 25.07.23.

    Copyright

    ©Lars Veldmeijer, Gijs Terlouw, Jim Van Os, Olga Van Dijk, Job Van 't Veer, Nynke Boonstra. Originally published in JMIR Mental Health (https://mental.jmir.org), 25.07.2023.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Mental Health, is properly cited. The complete bibliographic information, a link to the original publication on https://mental.jmir.org/, as well as this copyright and license information must be included.