This paper is in the following e-collection/theme issue:

Reviews in Digital Mental Health (228) Participatory Design and Participatory Research (305) Methods and New Tools in Mental Health Research (428) Innovations in Mental Health Systems (371) User Needs and Competencies (274) Users' and Patients' Needs for Mental Health Services (382)

Published on in Vol 9, No 6 (2022): June

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/35591, first published .
Human-Centered Design Approaches in Digital Mental Health Interventions: Exploratory Mapping Review

Human-Centered Design Approaches in Digital Mental Health Interventions: Exploratory Mapping Review

Human-Centered Design Approaches in Digital Mental Health Interventions: Exploratory Mapping Review

Authors of this article:

Stéphane Vial1 Author Orcid Image ;   Sana Boudhraâ1 Author Orcid Image ;   Mathieu Dumont2 Author Orcid Image
Article Authors Cited by (19) Tweetations (14) Metrics

    Review

    1Centre de Recherche de l'Institut Universitaire en Santé Mentale de Montréal, École de Design, Université du Québec à Montréal, Montréal, QC, Canada

    2Département D'ergothérapie, Université du Québec à Trois-Rivières, Drummondville, QC, Canada

    *all authors contributed equally

    Corresponding Author:

    Stéphane Vial, PhD

    Centre de Recherche de l'Institut Universitaire en Santé Mentale de Montréal

    École de Design

    Université du Québec à Montréal

    1440 rue Sanguinet

    Montréal, QC, H2X 3X9

    Canada

    Phone: 1 514 987 3000 ext 3919

    Email: vial.stephane@uqam.ca


    Background: Digital mental health interventions have a great potential to alleviate mental illness and increase access to care. However, these technologies face significant challenges, especially in terms of user engagement and adoption. It has been suggested that this issue stems from a lack of user perspective in the development process; accordingly, several human-centered design approaches have been developed over the years to consider this important aspect. Yet, few human-centered design approaches to digital solutions exist in the field of mental health, and rarely are end users involved in their development.

    Objective: The main objective of this literature review is to understand how human-centered design is considered in e-mental health intervention research.

    Methods: An exploratory mapping review was conducted of mental health journals with the explicit scope of covering e-mental health technology. The human-centered design approaches reported and the core elements of design activity (ie, object, context, design process, and actors involved) were examined among the eligible studies.

    Results: A total of 30 studies met the inclusion criteria, of which 22 mentioned using human-centered design approaches or specific design methods in the development of an e-mental health solution. Reported approaches were classified as participatory design (11/27, 41%), codesign (6/27, 22%), user-centered design (5/27, 19%), or a specific design method (5/27, 19%). Just over half (15/27, 56%) of the approaches mentioned were supported by references. End users were involved in each study to some extent but not necessarily in designing. About 27% (8/30) of all the included studies explicitly mentioned the presence of designers on their team.

    Conclusions: Our results show that some attempts have indeed been made to integrate human-centered design approaches into digital mental health technology development. However, these attempts rely very little on designers and design research. Researchers from other domains and technology developers would be wise to learn the underpinnings of human-centered design methods before selecting one over another. Inviting designers for assistance when implementing a particular approach would also be beneficial. To further motivate interest in and use of human-centered design principles in the world of e-mental health, we make nine suggestions for better reporting of human-centered design approaches in future research.

    JMIR Ment Health 2022;9(6):e35591

    doi:10.2196/35591

    Keywords

    design; human-centered design; user experience; mental health; digital mental health 


    Background

    E-mental health research is expanding around the world [1]. This area of mental health research and intervention relies on digital technologies to deliver complementary care, support, and information [2]. Over the past ten years, digital mental health interventions have appeared at an unprecedented rate, largely in the form of mobile apps, social media, chatbots, and virtual reality [3]. Since the beginning of the COVID-19 pandemic, the digital health world has expanded at an unprecedented rate [4], and its potential to improve access to care has never been greater [5]. However, some important challenges remain in the field. Several issues raised in recent years have not been resolved: there is some distrust in the field that is not served by the lack of empirical validation of its benefit [6-9]; it raises privacy and data security concerns [9,10]; it presents commercial issues (eg, financial interest, user access, advertising) [11,12]; and the solutions often lack usability and show low user engagement [13,14].

    The Problem of Adoption

    The promise of digital technology still far outweighs the reality of its use. This is particularly evident in the field of digital mental health, in which designs must survive successive waves of adoption: phases of preuse, first use, and sustained use [15]. A study of 93 mobile mental health apps showed that the overall user retention is very low, with a 15-day retention rate of 3.9% and a 30-day retention rate of 3.3% [16]. Another study with 77 participants in two randomized controlled trials demonstrated how difficult it is to motivate people to begin using an e-mental health solution [17]. Any digital health trial will see a significant proportion of users drop out or cease using the app before completion. Eysenbach [18] calls this phenomenon “the law of attrition.” Data on the health app market are scarce but do converge on two findings: the majority of health apps are downloaded fewer than 5,000 times, and 46% of apps have less than one monthly active user [19]. While usage is only one indicator of engagement [20], these statistics are consistent with adoption issues commonly reported among users, such as a lack of awareness of the app or lack of time and motivation to use one [21,22]. This is concerning because the use of these apps may not be associated with a significant decrease in mental disorders if they are not used for the intended period of time [14]. The average cost of developing a mobile health app is US $425,000 [19]—a cost-benefit ratio too high and unsustainable in the long run if we do not change how they are developed.

    Lack of Attention to User Perspectives During the Design Process

    Research has shown that most people are willing to adopt and use some form of new technology in the interest of improving their mental health [23]. So why the low utilization rates? Given the already significant barriers to adoption that users face (eg, privacy concerns, commercial issues), we seek to underscore the importance of user-centric design approaches for the development of e-mental health solutions, of which a solid notion is lacking in the digital mental health design sphere [14]. Based on the existing literature [13], we hypothesize that the lack of adoption of digital mental health solutions could be largely due to a lack of attention to user perspective in the design of these technologies, or at the very least, a lack of understanding of design approaches that accommodate user perspectives. In the field of mental health, there are very few examples of involving real people with mental disorders in the development and design of mobile apps intended for them [14]. The most common development approaches seem primarily researcher- and expert-driven, top-down in style, and to rely mainly on a bilateral partnership between clinicians and engineers [24]. This is not adapted to the challenges of contemporary digital culture that places the user at the center of these platforms by empowering them [25].

    Design Principles and Human-Centered Design Approaches

    In this section, we recall some fundamental principles of design culture and explain how they can help actors better account for the needs of users and integrate their perspective early on in the e-mental health design process.

    Designers and Engineers

    According to Cumulus [26], an international association of art and design education and research, a designer is someone who has acquired professional design expertise at a “design school.” For instance, Jony Ive, former chief design officer at Apple, is an industrial designer who graduated from the Northumbria School of Design in the United Kingdom. Although engineers might be considered designers (according to the broad sense of the word “design” in English), design and engineering are two separate fields that correspond to two different professions, methods, and cultures. Nevertheless, they share some similarities; for instance, both interaction designers and software engineers follow an iterative process [27].

    However, design must not be confused with engineering design, as differences in the way engineers and designers tackle the design of a technology are well documented [28]. In the initial prototyping phases, engineers seek to define specific goals to be achieved and, following a linear way of thinking, focus on technical functioning. Designers, on the other hand, use prototypes to creatively explore the design space for novel possibilities [29]. In health care, designers tend to focus attention on unmet needs and ways to improve care and are sensitive to how care is received through user-centered practices [30]. In this paper, we use the term “human-centered design” to distinguish the field of design from engineering, and when we say “design,” we mean human-centered design.

    Core Elements of Design Activity: Actor, Object, Context, Process

    It is generally admitted in the field of design studies that the core elements of design activity are the following: (1) a design problem and its coevolving design solution are its objects; (2) the environment in which design activity takes place is the design context; (3) the structure and dynamics of design activity are the process; and (4) a designer (person, team, organization) is an actor [31-33]. To be clear, let us consider the example of Temstem, an app developed in the Netherlands based on language games intended to help people experiencing psychosis distract themselves from voices they hear in their minds [34]. Temstem was co-designed by a group of designers, psychotherapists, and people living with psychosis—all of whom constitute actors (4). In collaboration with Parnassia Group, a private nonprofit mental health institution, a group of industrial design students from the Delft University of Technology spent a day in the life of people with psychosis. This led to a solution fully designed by the Amsterdam-based Reframing Studio design firm—all of which constitute the context (2). Design students were asked to come up with a product that would promote the recovery of psychosis—which constitutes the “problem” aspect of the object—and this product turned into an app called Temstem (“tame voices” in Dutch) to help people cope with “hearing voices”—constituting the “solution” aspect of the object (1). The main methods used to imagine and build this solution were co-design, user experience design, interaction design, game design, and ethnographic approach — the core components of the process (3).

    Typical Process of a Design Activity

    Design research is a relatively young field that appeared in the 1960s and is represented today by the International Association of Societies of Design Research [35]. Since its inception, this field has focused on the study of the design process [31]. The design process has also been the subject of research outside of academia to help the profession structure its methods. In 2005, the Design Council in the United Kingdom published the first version of its Double Diamond model, which was updated in 2019 and renamed the Framework for Innovation [36]. This internationally recognized model proposes a schematic representation of the typical process of any human-centered design activity (Figure 1).

    The framework comprises 4 steps: (1) discover (ie, gather information, understand the problem, make sense of them, and broaden the possibilities); (2) define (ie, narrow down the possible paths and define the main challenge); (3) develop (ie, give different answers to the clearly defined problem and push further the most promising solution, mostly by prototyping); and (4) deliver (ie, test and refine different versions of the solution at different scales). Each step is associated with specific and relevant methods. For instance, the design methods for step 1 include user diaries and quantitative surveys, whereas the design methods for step 2 employ techniques such as focus groups and customer journey mapping. The value of the Double Diamond is that it captures what all human-centered design approaches have in common from the perspective of the process.

    ‎
    Figure 1. Framework for Innovation (used with permission from Design Council 2019).
    View this figure
    Human-Centered Design Approaches

    There are several human-centered design approaches that allow end users to significantly and positively impact the design of technologies. The most used are user-centered design, user experience design, design thinking, participatory design, and co-design. These design methods stem from industry practice rather than academia and are very advanced there. They are used by design agencies, communications agencies, and large technological companies. These methods are historically derived from the disciplines of industrial and graphic design and from the evolution of the latter in contact with digital technologies [37]. Supported by the works of influential authors in design studies, we present how the five differ from each other and for what purpose each is generally used.

    User-centered design, also called human-centered design, was defined in the late 1980s by Don Norman in his book The Design of Everyday Things [38]. It is used to design products that are readily usable and immediately understandable thanks to the observance of certain design principles, such as the salience of affordances (ie, when the user understands what to do just by looking). Enriched by the work of J Nielsen on web usability [39] and JJ Garrett on user experience [40], user-centered design has become the standard for best practices in web design. Garrett defines it as “the practice of creating engaging and effective user experiences,” which involves considering the user at every stage of product development [40]. User-centered design is the fundamental basis of many current practices in modern industrial design, UX design, and interaction design. It is used to gain the best possible knowledge of end users’ needs and desires and to transform this knowledge into the best possible design of a product through usability testing. User-centered design should be used to validate the product’s utility, efficiency, and desirability.

    User experience design, also known as UX design, is about optimizing the experience that arises from interacting with a product, service, or technology [41]. User experience is defined as “the experience that the product creates for the people who use it in the real world,” meaning not its internal workings but “the way it works externally, where a person comes into contact with it” [40]. In the case of an app, it is the cognitive and emotional experience that the user has in front of the screen. In the field of digital technologies, the expression “UX design” has now largely replaced “user-centered design.” UX design should be used to create meaningful interfaces and engaging interactive experiences: it will make it more useful, more attractive, and more engaging for the end user.

    Design thinking as a human-centered method has been widely theorized, practiced, and popularized by the IDEO design agency and its founders. It can be defined as “a creative method of innovation, based on design-like culture and designer-like methods, whose main focus is on the needs of its end users,” and it has three dimensions: the desirability, feasibility, and viability of the future product or service [42]. There are important similarities between user-centered design and design thinking approaches—two terms that appeared around the same time—mainly the central place given to empathy and listening to the user's needs. Design thinking is recognized worldwide for its ability to foster the emergence of user-centered innovative solutions through cocreation, including in the field of health care [43]. It is generally used to implement transformations inside an organization, stimulate creativity within a team, or devise new solutions in a specific sector. Design thinking should be used to drive innovation in an organization or a team to make them more creative and empathetic with end users and to build better products and technologies.

    Participatory design was first defined in Norway and Sweden in the 1970s and 1980s by Kristen Nygaard and Pelle Ehn, respectively. Its original objective was to involve users in every stage of the design and development process of a complex computer system by using low-tech mediation techniques that are easy to handle by nonexperts (colored notes hung on the wall, cardboard mock-ups, decks of design cards) [44]. Participatory design is used to involve users in design activities such as ideation or prototyping. The approach is often implemented partially or even incorrectly, typically reduced to inviting end users to participate during the beginning of the process for research needs or at the end for usability testing [45,46]. Gathering feedback from users via usability testing is not a form of participatory design since users are not involved in the actual designing act of the design process.

    Co-design is often used as a synonym for “participatory design.” However, the term actually refers to a specific form of participatory design that is much closer to cocreation. Co-design refers to the creativity of designers and people not trained in design combined during the design development process. It is “collective creativity as it is applied across the whole span of a design process” [47]. It is a truly participatory approach in which the user is engaged from the start as an equal partner and has been widely recognized as a lever for social innovation [48].

    Participatory design and co-design are generally used to better consider the needs and desires of users in the design of a product and to make the design process less top-down and more democratic. These two approaches aid in developing an idea early that is in line with users' realities and to engage them in the product before it even exists. Co-design, in particular, should be used when the team is faced with a complex problem and seeks to improve and evolve its initial idea, provided that it accepts that the participants can transform this idea in a meaningful way.

    All these human-centered design approaches must become more familiar, better understood, and more widely implemented in the field of mental health in general and e-mental health in particular.

    Objective and Research Questions

    The main objective of this literature review was to understand how human-centered design is considered in e-mental health intervention research. The following research questions were considered:

    1. Which human-centered design approaches are reported in the development of e-mental health interventions?
    2. How are these approaches used in light of the generally accepted core elements of a design activity?
    3. How are designers involved in the process and what roles are they given?

    Through our efforts, we seek to open the discussion on the place of human-centered design methods in e-mental health research.


    Study Design

    To answer the 3 questions, an exploratory mapping review was conducted by researchers from the fields of design and mental health. The aim of mapping reviews is to map out and categorize existing literature on a particular topic to identify gaps in knowledge or opportunities for further research [49]. It focuses less on findings and more on activities related to the findings, such as the quantity and quality of the literature [49,50]. To streamline the process and identify a relevant sample of articles for this interdisciplinary exploratory review, a search was conducted among journals in mental health whose explicit scope covers technology. The following journals were identified: JMIR Mental Health, Frontiers in Psychiatry, Internet Interventions, and the Journal of Technology in Behavioral Science. Articles published between 2015 and 2020 were examined using the search terms “design” and “design*” to narrow down the results.

    Given the interdisciplinary nature of this work, extensive discussions were conducted among the coauthors to agree on a common understanding of the concept of design. The following inclusion criteria were defined: articles reporting original research on the development of a digital technology in mental health and those addressing the concept of design (at least one explicit use of the term design) in connection with at least one core element of a design activity.

    The use of the term “design” in research (eg, “study design”) or in its common sense was excluded.

    Study Selection

    The third author (MD) screened all titles and abstracts for potential articles. Then, the second (SB) and third (MD) authors independently assessed the full text of the articles for eligibility. There was an initial level of agreement of 80.7% (42/52) between the two authors (SB and MD), which is usually considered acceptable in the literature [51]. When there was discrepancy, the first author (SV) made the final decision.

    Data Extraction and Analysis

    For each article selected, data regarding the design approaches and the four core elements of a design activity (ie, the object, the context, the actor, and the process) were extracted. This included the type of solution created, the design approaches reported, the setting in which the project took place, and the type of actors involved throughout the design process. The design process was examined according to the steps defined in the UK Design Council’s framework for innovation [36]. The design methods reported in the articles were used to define the steps addressed in the development of the digital solutions. The analysis process was conducted jointly by the second (SB) and third (MD) authors.


    Overview

    Of the 1035 articles initially found, 51 full-text articles were assessed for eligibility. Of these, 30 studies met the inclusion criteria. The articles came from JMIR Mental Health (22/30, 73%), Frontiers in Psychiatry (4/30, 13%), Internet Interventions (2/20, 7%), and the Journal of Technology in Behavioral Science (2/30, 7%). Multimedia Appendix 1 presents the characteristics of the included studies, indicated from left to right: the specific research domain (eg, depression and anxiety, psychosis, well-being, etc), the synthesized naming of the adopted approach, and the 4 core elements of a design activity (object, context, process, and actors). Process is presented according to the 4 steps in the Double Diamond (coding each actor type with a number across the steps). Finally, we reported whether the study indicated that the process was iterative or not.

    Design Approaches

    To develop the digital solutions, 22 studies mentioned using human-centered design approaches or specific design methods. Various design approaches were reported, and there were many variations in the names given to these approaches. After several rounds of discussions between all authors, different approaches were classified under the 3 common names used in design studies, as listed in Table 1: participatory design (11/27, 41%), co-design (6/27, 22%), and user-centered design (5/27, 19%). Under the term “participatory design,” generally named as such in the studies, we considered alternative names such as “user involvement” [52]. Under the term “user-centered design,” we included other names like “person-based approach” or “person-centered approach.” Other studies reported specific design methods (5/27, 19%) that did not correspond to these 3 common names. Those methods are not common in the design studies field, except for the UK Design Council’s Double Diamond method. Among the studies included in this review, 8 (27%) did not refer to any human-centered design approach, so they are not listed in Table 1 [53-60]. Five studies reported more than one approach, mixing 2 common approaches or 1 common approach with 1 specific design method, and these studies are demarcated with a superscript in Table 1. Only 16 studies provided a definition of the reported approach(es), either by referring to other studies (15/16, 94%) or by offering their own definition (1/16, 6%). This means that about half (14/30, 47%) of the studies did not cite or provide a definition for their chosen approach, include references, or mention the theoretical underpinnings of the design approach. Although it was the second most reported approach, co-design was never defined in the 6 studies that mentioned it.

    Table 1. Classification of the reported approaches.
    Reported approachesAuthorsReported definition
    Participatory design approach

    		Participatory designPeters et al [61]Yes

    		Participatory design (explore, approximate, refine framework)Buitenweg et al [62]Yes

    		Participatory design thinking and methodsTerp et al [63]Yes

    		Participatory design (using research and development cycle)Ospina-Pinillos et al [64]Yes

    		User-involvement processesBuus et al [52]Yes

    		Participatory design processCheng et al [65]Yes

    		Participatory design approachReupert et al [66]Yes

    		Participatory design methodsGulliver et al [67]Not reported

    		Participatory designWerner-Seidler et al [68]Not reported

    		Participatory design processPeck et al [69]Not reported

    		Participatory designPovey et al [70]aNot reported
    Co-design approach

    		Co-design approachYoo et al [71]aNot reported

    		Iterative co-design processChristie et al [72]Not reported

    		Co-design processPovey et al [70]aNot reported

    		Co-designTorous et al [73]Not reported

    		Co-designBevan Jones et al [74]aNot reported

    		Human-centered co-designHetrick et al [75]aNot reported
    User-centered approach

    		User-centered approachHonary et al [76]Yes

    		(Aligned with) person-based approachAbraham et al [77]Yes

    		User-centered approachStawarz et al [78]Yes

    		Person-based/person-centered approach; user-centered approachBevan Jones et al [74]aYes

    		User-centered design researchHardy et al [79]aNot reported
    Specific design methods

    		Design research frameworkTerlouw et al [80]Yes

    		Iterative approach informed by the ADDIEb frameworkKhan et al [81]Yes

    		UK Design Council’s Double Diamond methodHardy et al [79]aNot reported

    		Agile design development/design studio methodologyHetrick et al [75]aYes

    		Needs-affordances analysis frameworkYoo et al [71]aYes

    aAuthors who reported using more than one approach.

    bADDIE: Analyze, Design, Develop, Implement, and Evaluate.

    Core Elements of the Design Activity

    Object (Solution)

    The digital technologies developed were mobile apps (15/30, 50%), web platforms (10/30, 33%), desktop apps (2/30, 7%), virtual reality (1/30, 3%), a serious game (1/30, 3%), and a digital comic creator (1/30, 3%). The solutions were most often used for applications related to anxiety and depression (8/30, 27%), well-being (5/30, 17%), access to and quality of care (5/30, 17%), and psychosis (4/30, 13%).

    Context

    Most (23/30, 77%) design activities were conducted exclusively in academic environments. Some studies (5/30, 17%) mentioned a collaboration with a private company. Two studies reported either a collaboration with community organizations (1/30, 3%) or public mental health services (1/30, 3%). The collaborative work took place within projects using participatory design (3/11, 27%), co-design (3/6, 50%), or no identifiable approach (1/8, 13%).

    Process

    About two-thirds of the projects adopted an iterative process (21/30, 70%). Most of the studies (27/30, 90%) described methods including at least 3 out of the 4 steps of the Double Diamond framework. As one might expect, the studies that covered fewer steps were those not reporting any identified design approach. For 10 studies (indicated by superscript 'a' in Multimedia Appendix 1), the discover and define steps were not clearly differentiated. The most often missing step was deliver, which was planned but not carried out in 8 of the studies (at the time these papers were published).

    Actors

    All 30 studies mentioned that end users were involved at some point in the process, but not necessarily in the act of designing (Table 2). Designers were explicitly mentioned in only 8 studies, whereas software development companies were mentioned in 14. We know from experience that software companies include few UX designers on their teams in proportion to the number of software engineers (eg, even in a small team of 5 software engineers, we can find at best 1 UX designer). However, there were no details about this in the 14 studies. A few studies reported involving other actors such as experts (consultants, health professionals; 8/30, 27%) and various stakeholders (eg, advocates, philanthropists; 1/30, 3%).

    Table 2. Distribution of the explicitly mentioned actors.
    ActorsExplicitly mentioned in the 30 studies, n (%)
    Designers8 (27)
    Software development company14 (47)
    Experts (including health professionals, consultants)8 (27)
    End users30 (100)
    Community of interest1 (3)

    Involvement of Designers

    Although the 30 studies selected addressed the concept of design and reported a variety of human-centered design approaches, very few explicitly mentioned the presence of designers on their teams. Regardless of the step of the process, only 8 studies mentioned designers, representing about 27% of all included studies. For the 22 studies that did not mention them (74%), we do not know whether it is because no designer was involved or because the presence of designers was not considered important enough to be reported.

    Looking at the few studies mentioning designers in their teams (8/30, 27%), it is interesting to note that some designers were explicitly present for all steps but mostly just the first three: discover (4/8, 50%), define (3/8, 38%), and develop (7/8, 88%). Only 1 was explicitly present for deliver. It is also interesting to note that 3 of the 4 studies that included designers in the discover step also included them in the define and develop steps, reflecting their ongoing involvement in the process. These 3 studies represented a small proportion of the studies that reported using participatory design and co-design. Overall, designers were clearly more involved in the develop step (7/30, 23%) but much less involved here than software development companies (Table 3). The latter were exclusively present in this step (14/30, 47%). End users were the most present participants at each step of the design process (Table 3).

    Table 3. Distribution of the explicitly mentioned actors according to the 4 steps of the Double Diamond (discover: n=27; define: n=27; develop: n=30; deliver: n=17).
    ActorsSteps

    		Discover, n (%)Define, n (%)Develop, n (%)Deliver, n (%)
    Designers4 (15)3 (11)7 (23)1 (6)
    Software development company0 (0)0 (0)14 (47)0 (0)
    Experts (including health professionals, consultants)3 (11)5 (19)5 (17)1 (6)
    End users24 (89)26 (96)21 (70)15 (88)
    Community of interest0 (0)0 (0)1 (3)1 (6)

    Principal Results

    In this initial exploratory research study, we investigated how design is considered in e-mental health research. Our results show that there have been attempts to integrate human-centered design methods into the development of e-mental health solutions, but they are still rare and rely very little on designers or design research. Most reported design approaches such as user-centered design, participatory design, and co-design are well known and documented in the design research literature, but most of the included studies did not rely on them. Almost half of the included studies did not bring or report any existing definition of the design approach they used. Moreover, it was not possible to link the use of an approach to its influence on the main core elements (steps conducted through the process or actors involved) and vice versa. The impact of each chosen approach on the whole process is not clear, nor is the reason behind the selection of a particular approach. This indicates that there is a lack of shareable knowledge on how design approaches are understood, and by extension, applied in the mental health field. This suggests that human-centered design methods are not fully integrated in e-mental health and that reported design approaches are still primarily used from the outside without a deep understanding of the design culture that is needed to fully leverage their power.

    Comparison With Earlier Work

    There has been very little research conducted on human-centered design methods in e-mental health and on how to guide the design of e-mental interventions. Thabrew et al [82] highlight the importance of active collaboration using co-design jointly between researchers, designers, developers, and users to develop more engaging and useful interventions. The results from this literature review show that such collaboration among all these stakeholders remains limited throughout the design process. While most design approaches reported were consistent with human-centered methods stemming from the design discipline, the choice and combination of the approaches varied greatly across studies. Orlowski et al [83] claim that the e-mental health development process must prioritize empathy and understanding over innovation, as proposed in participatory design and design thinking approaches. Torous et al [14] highlight the poor usability of mental health apps and the lack of user-centric design. Aryana et al [84] attempt to identify the key principles of the design process relevant to mobile mental health. Among the 6 principles identified, they mention “high quality user experience,” which is closely related to user-centered design, and an “empathic design process,” which is closely related to participatory design and co-design, and conclude that there are few examples of the implementation of several of these design principles in real-world products. This was also the case for the identified research projects. Bakker et al [85] note that design principles that have led to the huge success of many physical health and social networking apps have not been utilized in the mental health apps field. These findings are all consistent with our study and show that human-centered design methods are largely underutilized and neglected when their impact could be very important, especially on user engagement.

    Limitations

    This exploratory review offers significant insights into how design is considered in e-mental health. We consider it to show a fairly representative sample of the type of design-related research currently being conducted on the development of digital technology in mental health. We do not think that additional studies would significantly change our main conclusions. However, this study does not meet the criteria for a systematic review and has a few limitations. First, when analyzing the core elements of design activity, we could only rely on the information reported in the articles, which was fairly heterogeneous. We had to conduct several rounds of interdisciplinary discussions among ourselves (the authors) to ensure its best interpretation. Second, to analyze the design process described in each study, we chose the Double Diamond framework, which is a global reference, but other frameworks could also be used and might yield additional results. Third, in all the studies selected, it was difficult to understand how end users influenced the design, especially in participatory approaches. User involvement can be informative, consultative, or fully collaborative [86]. Orlowski et al [46] have already concluded that it is difficult to track ongoing user participation and clearly determine the contribution of participatory design to the effectiveness of designed interventions.

    Research Implications

    Good Design Comes Before Effective Science

    Health technologies are useless if they are not used, even if they are validated by science. We urge health researchers and technology developers in e-mental health to consider human-centered design methods not as the form-giving step of a technology development process but as a comprehensive approach integrated at an early stage in close relation to the research strategy and vision. Researchers and technology developers in e-mental health should consider systematically hiring interaction designers, user interface designers, user experience designers, and service designers in their teams to fully implement the human-centered design approach they need and then increase user engagement and technology acceptance. They should also include co-design workshops with end users conducted by trained designers from the beginning to the end of the development process. Design comes before science, which means that in the realm of apps, good design is a prerequisite for effective science.

    Suggested Recommendations for Better Reporting of Human-Centered Design Approaches

    This study suggests that researchers in e-mental health may not understand or value design principles enough to clearly describe them in their manuscripts. Without claiming to define a publication standard for reporting the design process and the outcomes of that process, we suggest 9 recommendations to be considered to further motivate interest in and adoption of design principles and human-centered design approaches (Textbox 1).

    Recommendations to motivate interest in and adoption of design principles and human-centered design approaches.

    Name and definition of human-centered design approaches

    1. Explicitly state which human-centered design approach was used.

    2. Provide a definition or, at least, a reference for each human-centered approach.

    3. Explain why a human-centered design approach is chosen (for which purpose).

    Implementation of the core elements of a human-centered design activity

    4. Describe each of the 4 core elements: object, context, process, and actors.

    5. Clearly define the steps and the methods used in the design process. If necessary, use a framework such as the Framework for Innovation (Figure 1).

    6. Explain when and to what extent actors were involved in the design process.

    Involvement of designers

    7. Indicate how many designers (not engineers or software developers) are involved.

    8. Specify what design profession they practice (UX designer, interaction designer, service designer, design researcher, etc).

    9. Indicate if the designers contribute on their own behalf or if they are employed by software development companies.

    Textbox 1. Recommendations to motivate interest in and adoption of design principles and human-centered design approaches.

    Future Work

    Bridging the gap between design and e-mental health is our next research agenda. We are currently developing a health intervention research framework called Design For e-Mental Health [87]. This framework refers to the broad range of human-centered design creative strategies that define the structure, function, and form of a digital mental health with a high quality of experience in terms of user experience, scientific validity, privacy, and viability.

    Acknowledgments

    This work was supported in Canada by the Social Sciences and Humanities Research Council, the Chaire Diament lab at the Université du Québec à Montréal, the Centre de recherche de l’Institut universitaire en santé mentale de Montréal, and the Fondation de l’Institut universitaire en santé mentale de Montréal.

    Conflicts of Interest

    None declared.

    ‎
    Multimedia Appendix 1

    Classification of the included studies.

    DOCX File , 24 KB
    1. Drissi N, Ouhbi S, Janati Idrissi MA, Fernandez-Luque L, Ghogho M. Connected mental health: systematic mapping study. J Med Internet Res 2020 Aug 28;22(8):e19950 [FREE Full text] [CrossRef] [Medline]
    2. Changing directions, changing lives: the mental health strategy for Canada. Mental Health Commission of Canada. 2012.   URL: https://www.mentalhealthcommission.ca/wp-content/uploads/drupal/MHStrategy_Strategy_ENG.pdf [accessed 2022-05-18]
    3. Torous J, Bucci S, Bell IH, Kessing LV, Faurholt-Jepsen M, Whelan P, et al. The growing field of digital psychiatry: current evidence and the future of apps, social media, chatbots, and virtual reality. World Psychiatry 2021 Oct;20(3):318-335 [FREE Full text] [CrossRef] [Medline]
    4. Golinelli D, Boetto E, Carullo G, Nuzzolese AG, Landini MP, Fantini MP. Adoption of digital technologies in health care during the COVID-19 pandemic: systematic review of early scientific literature. J Med Internet Res 2020 Nov 06;22(11):e22280 [FREE Full text] [CrossRef] [Medline]
    5. Torous J, Jän Myrick K, Rauseo-Ricupero N, Firth J. Digital mental health and COVID-19: using technology today to accelerate the curve on access and quality tomorrow. JMIR Ment Health 2020 Mar 26;7(3):e18848 [FREE Full text] [CrossRef] [Medline]
    6. Donker T, Petrie K, Proudfoot J, Clarke J, Birch M, Christensen H. Smartphones for smarter delivery of mental health programs: a systematic review. J Med Internet Res 2013;15(11):e247 [FREE Full text] [CrossRef] [Medline]
    7. Larsen ME, Huckvale K, Nicholas J, Torous J, Birrell L, Li E, et al. Using science to sell apps: evaluation of mental health app store quality claims. NPJ Digit Med 2019:18 [FREE Full text] [CrossRef] [Medline]
    8. Olff M. Mobile mental health: a challenging research agenda. Eur J Psychotraumatol 2015:6:27882 [FREE Full text] [Medline]
    9. Torous J. Mobile telephone apps first need data security and efficacy. BJPsych Bull 2016 Apr;40(2):106-107 [FREE Full text] [CrossRef] [Medline]
    10. Torous J, Roberts LW. Needed innovation in digital health and smartphone applications for mental health: transparency and trust. JAMA Psychiatry 2017 May 01;74(5):437-438. [CrossRef] [Medline]
    11. Lal S. E-mental health: promising advancements in policy, research, and practice. Healthc Manage Forum 2019 Mar;32(2):56-62. [CrossRef] [Medline]
    12. Lipschitz J, Miller CJ, Hogan TP, Burdick KE, Lippin-Foster R, Simon SR, et al. Adoption of mobile apps for depression and anxiety: cross-sectional survey study on patient interest and barriers to engagement. JMIR Ment Health 2019 Jan 25;6(1):e11334 [FREE Full text] [CrossRef] [Medline]
    13. Birnbaum F, Lewis D, Rosen RK, Ranney ML. Patient engagement and the design of digital health. Acad Emerg Med 2015 Jun;22(6):754-756 [FREE Full text] [CrossRef] [Medline]
    14. Torous J, Nicholas J, Larsen ME, Firth J, Christensen H. Clinical review of user engagement with mental health smartphone apps: evidence, theory and improvements. Evid Based Ment Health 2018 Jun 05:116-119. [CrossRef] [Medline]
    15. Nadal C, Sas C, Doherty G. Technology acceptance in mobile health: scoping review of definitions, models, and measurement. J Med Internet Res 2020 Jul 06;22(7):e17256 [FREE Full text] [CrossRef] [Medline]
    16. Baumel A, Muench F, Edan S, Kane JM. Objective user engagement with mental health apps: systematic search and panel-based usage analysis. J Med Internet Res 2019 Sep 25;21(9):e14567 [FREE Full text] [CrossRef] [Medline]
    17. Eccles H, Nannarone M, Lashewicz B, Attridge M, Marchand A, Aiken A, et al. Perceived effectiveness and motivations for the use of web-based mental health programs: qualitative study. J Med Internet Res 2020 Jul 31;22(7):e16961 [FREE Full text] [CrossRef] [Medline]
    18. Eysenbach G. The law of attrition. J Med Internet Res 2005;7(1):e11 [FREE Full text] [CrossRef] [Medline]
    19. mHealth Economics - How mHealth app publishers are monetizing their apps. Research2Guidance. 2018.   URL: https:/​/research2guidance.​com/​product/​mhealth-economics-how-mhealth-app-publishers-are-monetizing-their-apps/​ [accessed 2022-05-18]
    20. Yardley L, Spring BJ, Riper H, Morrison LG, Crane DH, Curtis K, et al. Understanding and promoting effective engagement with digital behavior change interventions. Am J Prev Med 2016 Nov;51(5):833-842. [CrossRef] [Medline]
    21. Peng W, Kanthawala S, Yuan S, Hussain SA. A qualitative study of user perceptions of mobile health apps. BMC Public Health 2016 Nov 14;16(1):1158 [FREE Full text] [CrossRef] [Medline]
    22. Schueller SM, Neary M, O'Loughlin K, Adkins EC. Discovery of and interest in health apps among those with mental health needs: survey and focus group study. J Med Internet Res 2018 Jun 11;20(6):e10141 [FREE Full text] [CrossRef] [Medline]
    23. Dragovic M, Davison S, Morgan VA, Chiu VW, Richards N, Vatskalis T, et al. ‘Validated, easy to use and free’: top three requests for mobile device applications (‘apps’) from mental health consumers and clinicians. Adv Ment Health 2018 Dec 11;18(2):106-114. [CrossRef]
    24. Technology and the future of mental health treatment. National Institute of Mental Health. 2019.   URL: https://www.nimh.nih.gov/health/topics/technology-and-the-future-of-mental-health-treatment [accessed 2022-05-18]
    25. Cardon D. Culture Numérique. Paris, France: Les Presses de Sciences Po; 2019.
    26. Cumulus members: art and design universities and colleges. Cumulus Association.   URL: https://cumulusassociation.org/our-community/our-member-institutions/ [accessed 2022-05-18]
    27. Carlson SE, Rees Lewis DG, Maliakal LV, Gerber EM, Easterday MW. The design risks framework: understanding metacognition for iteration. Design Studies 2020 Sep;70:100961. [CrossRef]
    28. Roozenburg N, Cross N. Models of the design process: integrating across the disciplines. Design Studies 1991 Oct;12(4):215-220. [CrossRef]
    29. Yu F, Pasinelli M, Brem A. Prototyping in theory and in practice: a study of the similarities and differences between engineers and designers. Creat Innov Manag 2017 Nov 27;27(2):121-132 [FREE Full text] [CrossRef]
    30. Rivard L, Lehoux P, Hagemeister N. Articulating care and responsibility in design: A study on the reasoning processes guiding health innovators' ‘care-making’ practices. Design Studies 2021 Jan;72:100986. [CrossRef]
    31. Dorst K. Design research: a revolution-waiting-to-happen. Design Studies 2008 Jan;29(1):4-11. [CrossRef]
    32. Dorst K. Design beyond design. She Ji 2019;5(2):117-127. [CrossRef]
    33. Dorst K, Dijkhuis J. Comparing paradigms for describing design activity. Design Studies 1995 Apr;16(2):261-274. [CrossRef]
    34. Temstem. Reframing Studio. 2013.   URL: https://www.reframingstudio.com/projects/temstem [accessed 2022-05-12]
    35. International Association of Societies of Design Research. 2018.   URL: https://iasdr.net/ [accessed 2022-05-18]
    36. The Double Diamond: A universally accepted depiction of the design process. Design Council. 2019.   URL: https:/​/www.​designcouncil.org.uk/​our-work/​news-opinion/​double-diamond-universally-accepted-depiction-design-process/​ [accessed 2022-06-02]
    37. Moggridge B. Designing Interactions. Cambridge, MA: MIT Press; 2006.
    38. Norman D. The Design of Everyday Things. New York, NY: Basic Books; 2013.
    39. Nielsen J. Designing Web Usability: The Practice of Simplicity. Indianapolis, IN: New Riders; 1999.
    40. Garrett JJ. The Elements of User Experience: User-Centered Design for the Web and Beyond. Berkeley, CA: New Riders; 2011.
    41. Lallemand C. Méthodes de Design UX : 30 Méthodes Fondamentales Pour Concevoir des Expériences Optimales. Paris, France: Eyrolles; 2018.
    42. Brown T. Design thinking. Harv Bus Rev 2008;86(6):84-92. [Medline]
    43. Ku B, Lupton E. Health Design Thinking: Creating Products and Services for Better Health. Cambridge, MA: MIT Press; 2020.
    44. Sundblad Y. UTOPIA: Participatory design from Scandinavia to the world. 2010 Presented at: IFIP Conference on History of Nordic Computing; 2010; Stockholm.
    45. Dekker MR, Williams AD. The use of user-centered participatory design in serious games for anxiety and depression. Games Health J 2017 Dec;6(6):327-333. [CrossRef] [Medline]
    46. Orlowski SK, Lawn S, Venning A, Winsall M, Jones GM, Wyld K, et al. Participatory research as one piece of the puzzle: a systematic review of consumer involvement in design of technology-based youth mental health and well-being interventions. JMIR Hum Factors 2015;2(2):e12 [FREE Full text] [CrossRef] [Medline]
    47. Sanders EB, Stappers PJ. Co-creation and the new landscapes of design. CoDesign 2008 Mar;4(1):5-18. [CrossRef]
    48. Manzini E. hen Everybody Designs: An Introduction to Design for Social Innovation. Cambridge, MA: MIT Press; 2015.
    49. Grant M, Booth A. A typology of reviews: an analysis of 14 review types and associated methodologies. Health Info Libr J 2009 Jun;26(2):91-108 [FREE Full text] [CrossRef] [Medline]
    50. Cooper ID. What is a mapping study? J Med Libr Assoc 2016 Jan;104(1):76-78 [FREE Full text] [CrossRef] [Medline]
    51. Belur J, Tompson L, Thornton A, Simon M. Interrater reliability in systematic review methodology: exploring variation in coder decision-making. Sociol Methods Res 2018 Sep 24;50(2):837-865. [CrossRef]
    52. Buus N, Juel A, Haskelberg H, Frandsen H, Larsen JLS, River J, et al. User involvement in developing the MYPLAN mobile phone safety plan app for people in suicidal crisis: case study. JMIR Ment Health 2019 Apr 16;6(4):e11965 [FREE Full text] [CrossRef] [Medline]
    53. Baron KG, Duffecy J, Reid K, Begale M, Caccamo L. Technology-assisted behavioral intervention to extend sleep duration: development and design of the Sleep Bunny mobile app. JMIR Ment Health 2018 Jan 10;5(1):e3 [FREE Full text] [CrossRef] [Medline]
    54. Doherty K, Barry M, Marcano-Belisario J, Arnaud B, Morrison C, Car J, et al. A mobile app for the self-report of psychological well-being during pregnancy (BrightSelf): qualitative design study. JMIR Ment Health 2018 Nov 27;5(4):e10007 [FREE Full text] [CrossRef] [Medline]
    55. Hoffmann D, Rask CU, Hedman-Lagerlöf E, Ljótsson B, Frostholm L. Development and feasibility testing of internet-delivered acceptance and commitment therapy for severe health anxiety: pilot study. JMIR Ment Health 2018 Apr 06;5(2):e28 [FREE Full text] [CrossRef] [Medline]
    56. Ijaz K, Ahmadpour N, Naismith SL, Calvo RA. An immersive virtual reality platform for assessing spatial navigation memory in predementia screening: feasibility and usability study. JMIR Ment Health 2019 Sep 03;6(9):e13887 [FREE Full text] [CrossRef] [Medline]
    57. Lim MH, Rodebaugh TL, Eres R, Long KM, Penn DL, Gleeson JFM. A pilot digital intervention targeting loneliness in youth mental health. Front Psychiatry 2019;10:604 [FREE Full text] [CrossRef] [Medline]
    58. Rickard N, Arjmand H, Bakker D, Seabrook E. Development of a mobile phone app to support self-monitoring of emotional well-being: a mental health digital innovation. JMIR Ment Health 2016 Nov 23;3(4):e49 [FREE Full text] [CrossRef] [Medline]
    59. Thomas N, Farhall J, Foley F, Leitan ND, Villagonzalo K, Ladd E, et al. Promoting personal recovery in people with persisting psychotic disorders: development and pilot study of a novel digital intervention. Front Psychiatry 2016;7:196 [FREE Full text] [CrossRef] [Medline]
    60. Tiburcio M, Lara MA, Aguilar AA, Fernández M, Martínez VN, Sánchez A. Web-based intervention to reduce substance abuse and depressive symptoms in Mexico: development and usability test. JMIR Ment Health 2016 Sep 29;3(3):e47 [FREE Full text] [CrossRef] [Medline]
    61. Peters D, Deady M, Glozier N, Harvey S, Calvo RA. Worker preferences for a mental health app within male-dominated industries: participatory study. JMIR Ment Health 2018 Apr 25;5(2):e30 [FREE Full text] [CrossRef] [Medline]
    62. Buitenweg DC, Bongers IL, van de Mheen D, van Oers HA, van Nieuwenhuizen C. Cocreative development of the QoL-ME: a visual and personalized quality of life assessment app for people with severe mental health problems. JMIR Ment Health 2019 Mar 28;6(3):e12378 [FREE Full text] [CrossRef] [Medline]
    63. Terp M, Jørgensen R, Laursen BS, Mainz J, Bjørnes CD. A smartphone app to foster power in the everyday management of living with schizophrenia: qualitative analysis of young adults' perspectives. JMIR Ment Health 2018 Oct 01;5(4):e10157 [FREE Full text] [CrossRef] [Medline]
    64. Ospina-Pinillos L, Davenport TA, Navarro-Mancilla AA, Cheng VWS, Cardozo Alarcón AC, Rangel AM, et al. Involving end users in adapting a Spanish version of a web-based mental health clinic for young people in Colombia: exploratory study using participatory design methodologies. JMIR Ment Health 2020 Feb 08;7(2):e15914 [FREE Full text] [CrossRef] [Medline]
    65. Cheng VWS, Davenport TA, Johnson D, Vella K, Mitchell J, Hickie IB. An app that incorporates gamification, mini-games, and social connection to improve men's mental health and well-being (MindMax): participatory design process. JMIR Ment Health 2018 Nov 19;5(4):e11068 [FREE Full text] [CrossRef] [Medline]
    66. Reupert A, Bartholomew C, Cuff R, Foster K, Matar J, Maybery DJ, et al. An online intervention to promote mental health and wellbeing for young adults whose parents have mental illness and/or substance use problems: theoretical basis and intervention description. Front Psychiatry 2019:10:59. [CrossRef] [Medline]
    67. Gulliver A, Bennett K, Bennett A, Farrer LM, Reynolds J, Griffiths KM. Privacy issues in the development of a virtual mental health clinic for university students: a qualitative study. JMIR Ment Health 2015 Mar 31;2(1):e9 [FREE Full text] [CrossRef] [Medline]
    68. Werner-Seidler A, O'Dea B, Shand F, Johnston L, Frayne A, Fogarty AS, et al. A smartphone app for adolescents with sleep disturbance: development of the Sleep Ninja. JMIR Ment Health 2017 Jul 28;4(3):e28 [FREE Full text] [CrossRef] [Medline]
    69. Peck CE, Lim MH, Purkiss M, Foley F, Hopkins L, Thomas N. Development of a lived experience-based digital resource for a digitally-assisted peer support program for young people experiencing psychosis. Front Psychiatry 2020:11:635 [FREE Full text] [CrossRef] [Medline]
    70. Povey J, Sweet M, Nagel T, Mills PPJR, Stassi CP, Puruntatameri AMA, et al. Drafting the Aboriginal and Islander Mental Health Initiative for Youth (AIMhi-Y) app: results of a formative mixed methods study. Internet Interv 2020 Sep;21:100318. [CrossRef] [Medline]
    71. Yoo DW, Birnbaum ML, Van Meter AR, Ali AF, Arenare E, Abowd GD, et al. Designing a clinician-facing tool for using insights from patients' social media activity: iterative co-design approach. JMIR Ment Health 2020 Aug 12;7(8):e16969 [FREE Full text] [CrossRef] [Medline]
    72. Christie GI, Shepherd M, Merry SN, Hopkins S, Knightly S, Stasiak K. Gamifying CBT to deliver emotional health treatment to young people on smartphones. Internet Interv 2019 Dec;18:100286 [FREE Full text] [CrossRef] [Medline]
    73. Torous J, Wisniewski H, Bird B, Carpenter E, David G, Elejalde E, et al. Creating a digital health smartphone app and digital phenotyping platform for mental health and diverse healthcare needs: an interdisciplinary and collaborative approach. J Technol Behav Sci 2019 Apr 27;4(2):73-85 [FREE Full text] [CrossRef]
    74. Bevan Jones R, Thapar A, Rice F, Beeching H, Cichosz R, Mars B, et al. A web-based psychoeducational intervention for adolescent depression: design and development of MoodHwb. JMIR Ment Health 2018 Feb 15;5(1):e13 [FREE Full text] [CrossRef] [Medline]
    75. Hetrick SE, Robinson J, Burge E, Blandon R, Mobilio B, Rice SM, et al. Youth codesign of a mobile phone app to facilitate self-monitoring and management of mood symptoms in young people with major depression, suicidal ideation, and self-harm. JMIR Ment Health 2018 Jan 23;5(1):e9 [FREE Full text] [CrossRef] [Medline]
    76. Honary M, Fisher NR, McNaney R, Lobban F. A web-based intervention for relatives of people experiencing psychosis or bipolar disorder: design study using a user-centered approach. JMIR Ment Health 2018;5(4):e11473 [FREE Full text] [CrossRef] [Medline]
    77. Abraham TH, Marchant-Miros K, McCarther MB, Craske MG, Curran GM, Kearney LK, et al. Adapting coordinated anxiety learning and management for veterans affairs community-based outpatient clinics: iterative approach. JMIR Ment Health 2018 Aug 22;5(3):e10277 [FREE Full text] [CrossRef] [Medline]
    78. Stawarz K, Preist C, Tallon D, Wiles N, Kessler D, Turner K, et al. Design considerations for the integrated delivery of cognitive behavioral therapy for depression: user-centered design study. JMIR Ment Health 2020 Sep 03;7(9):e15972 [FREE Full text] [CrossRef] [Medline]
    79. Hardy A, Wojdecka A, West J, Matthews E, Golby C, Ward T, et al. How inclusive, user-centered design research can improve psychological therapies for psychosis: development of SlowMo. JMIR Ment Health 2018 Dec 05;5(4):e11222 [FREE Full text] [CrossRef] [Medline]
    80. Terlouw G, van 't Veer JT, Prins JT, Kuipers DA, Pierie JEN. Design of a digital comic creator (It's Me) to facilitate social skills training for children with autism spectrum disorder: design research approach. JMIR Ment Health 2020 Jul 10;7(7):e17260 [FREE Full text] [CrossRef] [Medline]
    81. Khan A, Shrivastava R, Tugnawat D, Singh A, Dimidjian S, Patel V, et al. Design and development of a digital program for training non-specialist health workers to deliver an evidence-based psychological treatment for depression in primary care in India. J Technol Behav Sci 2020 Dec;5(4):402-415. [CrossRef] [Medline]
    82. Thabrew H, Fleming T, Hetrick S, Merry S. Co-design of ehealth interventions with children and young people. Front Psychiatry 2018;9:481 [FREE Full text] [CrossRef] [Medline]
    83. Orlowski S, Matthews B, Bidargaddi N, Jones G, Lawn S, Venning A, et al. Mental health technologies: designing with consumers. JMIR Hum Factors 2016 Jan 28;3(1):e4 [FREE Full text] [CrossRef] [Medline]
    84. Aryana B, Brewster L, Nocera JA. Design for mobile mental health: an exploratory review. Health Technol 2018 Oct 27;9(4):401-424. [CrossRef]
    85. Bakker D, Kazantzis N, Rickwood D, Rickard N. Mental health smartphone apps: review and evidence-based recommendations for future developments. JMIR Ment Health 2016;3(1):e7 [FREE Full text] [CrossRef] [Medline]
    86. Scariot CA, Heemann A, Padovani S. Understanding the collaborative-participatory design. Work 2012;41 Suppl 1:2701-2705. [CrossRef] [Medline]
    87. Vial S, Boudhraâ S. Design for E-Mental Health: Toward a New Health Intervention Research Approach. In: Revolutions in Product Design for Healthcare. Singapore: Springer; 2022.

    Edited by J Torous; submitted 09.12.21; peer-reviewed by D Barron, P Matthews, P Whelan; comments to author 26.01.22; revised version received 22.03.22; accepted 19.04.22; published 07.06.22

    Copyright

    ©Stéphane Vial, Sana Boudhraâ, Mathieu Dumont. Originally published in JMIR Mental Health (https://mental.jmir.org), 07.06.2022.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Mental Health, is properly cited. The complete bibliographic information, a link to the original publication on https://mental.jmir.org/, as well as this copyright and license information must be included.