Background: Remote measurement technologies (RMT) such as mobile health devices and apps are increasingly used by those living with chronic neurological and mental health conditions. RMT enables real-world data collection and regular feedback, providing users with insights about their own conditions. Data visualizations are an integral part of RMT, although little is known about visualization design preferences from the perspectives of those living with chronic conditions.
Objective: The aim of this review was to explore the experiences and preferences of individuals with chronic neurological and mental health conditions on data visualizations derived from RMT to manage health.
Methods: In this systematic review, we searched peer-reviewed literature and conference proceedings (PubMed, IEEE Xplore, EMBASE, Web of Science, Association for Computing Machinery Computer-Human Interface proceedings, and the Cochrane Library) for original papers published between January 2007 and September 2021 that reported perspectives on data visualization of people living with chronic neurological and mental health conditions. Two reviewers independently screened each abstract and full-text article, with disagreements resolved through discussion. Studies were critically appraised, and extracted data underwent thematic synthesis.
Results: We identified 35 eligible publications from 31 studies representing 12 conditions. Coded data coalesced into 3 themes: desire for data visualization, impact of visualizations on condition management, and visualization design considerations. Data visualizations were viewed as an integral part of users’ experiences with RMT, impacting satisfaction and engagement. However, user preferences were diverse and often conflicting both between and within conditions.
Conclusions: When used effectively, data visualizations are valuable, engaging components of RMT. They can provide structure and insight, allowing individuals to manage their own health more effectively. However, visualizations are not “one-size-fits-all,” and it is important to engage with potential users during visualization design to understand when, how, and with whom the visualizations will be used to manage health.
Despite widespread interest in the use of remote measurement technology (RMT) such as wearable devices and mobile apps in health care settings, the design and practical implementation of these technologies remain challenging. Designing RMT requires a careful balance between (often conflicting) requirements, which address technological, clinical, and regulatory specifications, individual users’ needs, and health-management goals. The result must be effective and engaging for users and capable of supplementing health management practices and promoting long-term adherence [- ]. However, best practices and guidelines for RMT design are sparse and most designs rely heavily on designers’ interpretations or inferences of user preferences [ ]. Emphasis on user engagement during RMT design has increased in recent years but is not yet a widespread practice [ ].
Although determinants of engagement with RMT are diverse and condition-dependent, access to and interaction with data frequently emerge as a key factor influencing user motivation and satisfaction with RMT [, ]. However, data access alone is insufficient to achieve goals like self-management. Data must be organized and presented in ways that meaningfully address questions of self-awareness and self-care [ ]. To paraphrase Few [ ], a good visualization must clearly indicate relationships, accurately represent the data, enable easy comparisons, clearly show scales and ordering of the data, and encourage people to use the presented information. This is not trivial, as perceptions of whether visualizations are accurate, clear, or easily interpretable are subject to personal mindset and circumstance [ ]. Design of good visualizations for health management requires careful consideration of user perspectives and needs throughout the design process, ideally engaging these users through participatory design methods [ , ]. Recent research on health data visualization tends to focus on the needs of health care professionals, typically with regard to electronic medical records and other novel sources of big health data [ - ]. This paradigm is ripe for change. The abundance and accessibility of health data, driven in large part by RMT, provide individuals with unprecedented resources to aid in condition self-management.
Although theories and techniques exist to guide the visualization design process [- ], these techniques require a fundamental understanding of the purposes for and contexts in which the desired visualizations will be used. Unfortunately, functional guidance describing service-user perspectives and preferences in RMT data visualization is scarce. A recent systematic review explored types of visualizations shown to patients in health research, predominantly in nondigital formats in primary care settings [ ]. However, it did not discuss individuals’ perspectives on these visualizations. It is still unclear which data RMT users wish to access, how these data should be visualized, for what purposes these visualizations are used, and which factors moderate these preferences. The aim of this qualitative systematic review was to identify and synthesize existing studies that report the perspectives of individuals with neurological and mental health conditions on RMT data visualizations. Based on identified themes and gaps in the literature, we suggest both priorities for future research and design considerations for RMT visualizations, which could enrich current service-user engagement practices.
Study Scope and Research Question
This study adhered to PRISMA-P (Preferred Reporting Items for Systematic review and Meta-Analysis Protocols) guidelines for systematic review conduct and reporting [, ]. We aimed to address the question, “What are the data visualization preferences and perceptions of people living with chronic neurological and mental health conditions when using RMT to manage health?” The project’s patient advisory board, which comprises patient advocates for depression, epilepsy, and multiple sclerosis, was consulted during the study design and data analysis.
Identifying Relevant Studies
This protocol was registered on PROSPERO (International Prospective Register of Systematic Reviews, CRD42019139319) while the review was in its pilot phase . We searched PubMed, IEEE Xplore, EMBASE, Web of Science, proceedings from the Association for Computing Machinery Conference on Human Factors in Computing Systems, and the Cochrane Library for original, peer-reviewed, or gray literature published in English between January 2007 and September 2021. Searches included combinations of terms such as mHealth, along with terms related to data visualization and neurological disease. The search strings are provided in . Relevant papers were also identified from manual searches of included studies’ reference lists. Studies were screened in 2 stages: abstract screening and full-text review. Eligibility criteria and screening forms were piloted on a set of 50 abstracts and 15 full-text reviews, and criteria were clarified or amended as needed. Two reviewers (AP, JN, SM, or DM) independently screened each abstract. In the case of disagreement, the abstract automatically proceeded to the full-text stage. Two reviewers then independently assessed each full-text paper for eligibility, and disagreements were resolved through discussion. If no consensus could be reached, a third member of the review team reviewed the paper and made a final determination. Agreement between reviewer pairs was determined through Cohen kappa [ ]. Deduplication, record management, and screening were conducted in CADIMA, an open-access systematic review software [ ]. Data extraction and coding were conducted using custom forms developed in Microsoft Word ( ).
We included studies if they met the following criteria:
- All or part of a study population was living with a neurological or mental health condition
- Participants were ≥18 years of age
- RMT for laypeople to track, monitor, or manage their own health was investigated
- Results of any qualitative methods or integrated syntheses of mixed methods were reported
- Patient perspectives on visualizations of health or wellness data were reported
The following studies were ineligible for inclusion:
- Conditions that were not neurological in nature or not associated with mental health
- Perspectives on interface design, intervention design, or any component of RMT design unrelated to data visualization
- Visualizations limited to medication adherence or non–health-related data
- Perspectives of caregivers, health professionals, or others not living with a neurological or mental health condition
We adhered to Davis et al’s  definition of RMT, which includes “any technology that enables monitoring of a person’s health status through a remote interface,” which can then either be transmitted to a health care provider or as a tool for self-management of one’s health. We purposefully remained broad in our definition of the term “data visualization” because it is understood differently by different people. Therefore, we included any format through which RMT displayed data to service users. We defined chronic neurological or mental health conditions as any long-term, progressive, relapsing, or recurrent conditions related to mental health or dysfunction of the nervous system. Neurodegenerative diseases, depression, anxiety, or bipolar disorder, pain disorders, and sleep disorders, among others were eligible. Mental health conditions were also eligible if they were symptoms or comorbidities of a nonincluded condition. This heterogeneous set of conditions allowed us to identify themes that may be generalizable across conditions and others that are disease-specific.
Data Extraction, Critical Appraisal, and Qualitative Synthesis
Two authors independently reread each included study and extracted quotes related to data visualization preferences. When available, screenshots of data visualizations were also extracted. To ensure that analysis remained grounded in the context of the original studies, data extraction forms included a detailed description of each study’s objectives and methods, and annotated PDFs were preserved. Studies were critically appraised with the Mixed Methods Appraisal Tool [, ]. We then categorized studies as conceptually rich “key papers,” “satisfactory papers,” which are methodologically acceptable but provide only moderate value to the synthesis, and “fatally flawed papers,” which contain major methodological flaws [ , ]. We also noted “minimal impact papers,” which provided minimal contribution to the synthesis.
We employed Thomas and Harden’s  inductive approach to thematic synthesis. Following a reading of the extracted text and its context, 2 authors (AP and JN) independently coded data line by line, producing a draft coding frame. The coding frame was iteratively amended, refined, restructured and the data recoded until no additional codes or disagreements were identified, and categorized into “descriptive themes,” which described the structure and content of the codes. Analytical themes, which interpreted the coded data, were developed through iterative rereading and discussion of the codes and thematically organized data ( ). An experienced qualitative researcher (SS) oversaw and provided input on this process. Following thematic synthesis, we conducted sensitivity analyses to identify potential differences between conditions. We analyzed 4 subgroups (mental health, neurological conditions, sleep, and pain) that arose from the patient populations and lines of inquiry addressed by included studies. As a form of member-checking, we consulted members of the patient advisory board (authors PB and SB) who reviewed our analysis and interpretations for face validity within the context of their own experiences of RMT and condition self-management.
|Extracted text||Coding||Descriptive theme||Analytical theme|
|Participants reported that the mood monitoring surveys and associated graphical feedback were a reason to return to the app and that it increased self-awareness of how their mood fluctuated over time and in relation to use of the intervention content .||Increased self-awareness||Visualizations enable proactive self-management through improved self-awareness|
|…It was really nice to look at the circle plot [the pie-chart]. When I’ve had a hard day, I looked back on the previous day, and saw a big yellow portion [Work and Education] and then it made sense to me why I felt bad today .||Increased self-awareness||Visualizations enable proactive self-management through improved self-awareness|
Searches returned 2928 unique records. Of these, 177 papers were included in full-text review and 35 were eligible for qualitative synthesis (). Reviewer agreement was moderate during abstract screening (weighted κ=0.45) and substantial during full-text review (weighted κ=0.79) [ ]. Our relatively low agreement during abstract screening was expected and mitigated by reviewing the full texts of all abstracts, which were judged eligible by at least one reviewer. Multiple papers were identified for 3 research projects: the SPIRIT study (n=3) [ - ], the MoodRhythm app (n=2) [ , ], and the MONARCA (MONitoring, treAtment and pRediCtion of bipolAr Disorder Episodes) project (n=2) [ , ]. For these projects, all identified papers were analyzed as 1 study. Thus, 31 unique studies were included. The characteristics of the included studies are summarized in and provided in detail in . Most studies (19/31, 61%) addressed mental health conditions. Only 2 studies specifically investigated user perspectives on data visualizations [ , ]. All others reported on data visualization preferences within the broader context of RMT design, evaluation, or usability. We categorized 9 publications as key papers, 16 as satisfactory papers, 6 as minimal impact, and 4 as fatally flawed. We identified 3 themes through content analysis: desire for data visualization, impact of visualizations on condition management, and visualization design considerations ( ). The final coding frame and illustrative quotes are provided in .
|Characteristics||Values, n (%)a|
|Bipolar disorder||6 (19)|
|Sleep disorders||2 (6)|
|Pain disorders||2 (6)|
|Posttraumatic stress disorder||2 (6)|
|Mixed mental health conditions||6 (19)|
|Parkinson disease||2 (6)|
|Multiple sclerosis||3 (10)|
|Motor neuron disease||1 (3)|
|Qualitative feedback on RMTb from a field study||15 (48)|
|Co-design of an RMT||10 (32)|
|Qualitative user acceptance testing of an RMT||11 (35)|
|Exploratory qualitative studies not associated with a specific RMT||10 (32)|
|Qualitative studies specifically on data visualization preferences||2 (6)|
|Mixed methods||12 (39)|
|Open-ended surveys||4 (13)|
|Focus groups||4 (23)|
aAs several projects included multiple conditions, study designs, or qualitative methods, the total exceeds 100%.
bRMT: remote measurement technology.
Identified themes and subthemes.
Theme 1. Desire for data visualization
Theme 2. Impact of visualizations on condition management
- Visualizations enable proactive self-management through improved self-awareness
- Visualizations enable more effective communication with care partners
- Visualizations drive engagement with remote measurement technology
Theme 3. Visualization design considerations
- Context and Annotation
- Moderators of visualization design preferences
Desire for Data Visualization
Users explicitly expressed a desire for data visualizations in 21 of the 31 included studies. Discussed or desired data included mood and disease-specific symptom scores, physical activity, sleep patterns and quality, and rhythm of daily activities. In 6 studies, RMT did not originally include visualizations of users’ historic data. Participants expressed their dissatisfaction, prompting authors to add visualizations to their designs [- , , , ].
Impact of Visualizations on Condition Management
Visualizations Enable Proactive Self-management Through Improved Self-awareness
Participants reported turning to RMT and data visualization tools when they required external structure or organization to manage their conditions. This structure improved users’ recall of their own experiences, which were perceived as valuable owing to the difficulty of accurately reflecting on past symptoms [, , , , , ]. Objective visualizations of past symptoms also afforded them a sense of validation, making current experiences feel more real or trustworthy [ , , ]. This was especially important in bipolar disorder or schizophrenia, when symptoms could distort one’s perception of reality [ , ].
Graphs and charts enabled users to identify patterns [, , - , - ] such as activities that prompted feelings of wellness [ , , ] or triggered symptoms [ , , , , ]. Thus, visualization of historic data heightened service users’ self-awareness, leading them to engage in more proactive self-management [ , - , , , , , ]. Once trends were identified, users could use their newly acquired knowledge to avoid or pre-empt triggers, reducing the severity of oncoming episodes [ ]. This awareness gave users a sense of accountability and level of control over their conditions [ , ] and helped them use the management tools at their disposal more effectively [ , , ]. Some saw timely access to data as essential to proactive self-management, especially when identifying recent triggers or activities that may have affected their current condition [ , ]. Over time and despite fluctuations, visualizations helped users objectively see their own progress, the magnitude of which they may not have fully appreciated otherwise [ , , , , ]. Illustrative quotes are provided in .
|Provide structure and organization||…Still, respondents reported turning to external tracking via paper or technology when they need extra support, for instance, when thoughts get “scrambled” or their mind feels too “full” - sensations that are especially common during [bipolar disorder] episodes .|
|Improve recall of past experiences||…What I saw [in the trial] is that it helped me keep on track. I try to keep track of the triggers [early warning signs], and my history - and in that way it has helped me enormously. Previously, I went into periods where I encountered random mood swings, up and down, and I did not have any history [data] to relate to, so it kind of surprised me. But now I can actually follow how I’m doing - also back in time - and what caused it. It has really been great, and I think I have been able to keep track of myself  (bipolar disorder).|
|Validate current experiences||…I am looking for confirmation that I had similar symptoms in the past, because sometimes due to the nature of bipolar I feel like I can\'t trust the emotions I have at any given moment (or their possible triggers) and it is a relief to know that these are patterns  (bipolar disorder).|
|Increase self-awareness, identify patterns||…I found the most valuable tool to analyze my activities. It provides an understanding of which activities helps me, and which gives problems that I need to be aware of—or completely avoid  (depression).|
|Enable proactive self-management||…A majority of respondents described this awareness as an opportunity to become proactive about their condition, helping them make adjustments to preempt mood episode triggers and maintain stability or at least avoid severe episodes. Survey respondents also stated that the feedback provided by tracking keeps them accountable to themselves and that they find visual forms of feedback particularly helpful for identifying personal behavioral and emotional patterns and motivating positive lifestyle choices  (bipolar disorder).|
|See progress over time||…I was AMAZED when I scrolled back through the Android weeks to see how much my mood has stabilized since I started [medication]. The weeks themselves weren\'t as meaningful as the pattern over time  (bipolar disorder).|
Visualizations Enable More Effective Communication With Care Partners
Participants also frequently reported using or desiring to use RMT data visualizations to communicate with health care professionals, caregivers, and others, regardless of whether the technology was designed for this purpose [, , - , - , , ]. Eisner et al [ ] described “participants theorized that having access to objective data representing their symptoms, particularly in the graph form, might enable a shared understanding of their experiences, both with the care team…and potentially with the general public.”
Participants in several studies reported using visualizations from their self-tracking apps to foster higher-quality dialogue with their care team [, , , , , - , , ]. Visualizations were advantageous because they improved recall of past symptoms and relayed clinically relevant patterns that users found difficult to describe [ , , , ]. Visual aids also helped patients make the most out of short and infrequent appointments, especially when current health status was not representative of the patient’s experiences over previous weeks or months [ , , ]. Sometimes, these visualizations even served as the basis for defensible positions when broaching difficult topics with their care team [ , ]. For example, 1 participant who experienced difficulties getting a care team to take his concerns seriously stated, “If you were to answer the questions and go to the doctor and say ‘look, these are my results, you can see clearly there’s a change, and these are my experiences,’ that would be substantial evidence for the doctor to then sit up and take note” [ ].
Visualizations Drive Engagement With RMT
Participants also described how visualizations made experiences with RMT more engaging [, , , , , , , ]. Users with bipolar disorder and insomnia suggested that data access and visualization could entice users to engage more with the RMT, since data and insights could be perceived as rewards [ , ]. However, those with depression, Parkinson disease, and multiple sclerosis warned that inappropriately designed visualizations could be demoralizing [ , , , , , ], which could lead to disengagement. When visualizations were unavailable, users tended to find RMT unengaging and unmotivating. In 2 studies, the lack of personalized graphs in early prototypes was thought to contribute to study dropout [ , ]. Qualitative feedback in one of these studies, which focused on narcolepsy management, led the designers to conclude, “to keep patients motivated to use the tool over a longer period, a personal visualization of recorded data is required” [ ].
Visualization Design Considerations
Participants often reflected on aspects of visualization design, such as format, the need for contextual information, timeliness, and customization (). Health status, data literacy, and previous experience with RMT appeared to moderate individuals’ needs and design preferences.
|Visualization design||…Similar to other personal health systems that use fishes and flowers as metaphors, we were looking for an appropriate metaphor for bipolar disorder. Many attempts were tried, including using metaphors like a scale, an equalizer, a river, a volcano, a dart board, and a radar, but we always had the case that some patients preferred one visualization, and others hated it  (bipolar disorder).|
|Context and annotation||…I would like to click [points on the daily mood graph] and see what I did on this day, since I was so well  (depression or anxiety disorder). |
…I kinda wish I could put a little note in and be like, “This is why I put this number.” I think, yeah. I guess that’s actually - it would have been really nice to have some sort of journaly type feature where I could make notes like that [ ] (bipolar disorder).
|Timeliness of data access||Comments mostly differed regarding the frequency of (feedback via data visualizations), again with a great range from daily feedback to one response per month:|
…Yes, one feedback per month. Or maybe every two weeks. In the case of warning signals also more frequently.
…Yes a short feedback every two days or every day.
…Yes absolutely. Once a week would be good or every two weeks. Not every day though [ ] (bipolar disorder).
|Customization||…Survey respondents’ approaches for tracking multiple indicators vary. Participants were divided between keeping separate journals or tools, each dedicated to chronicling a particular indicator, or tracking all items with a single chart or application. Sometimes, elaborate tracking setups are reported as necessary to accommodate such tracking habits in ways technologies do not currently support  (depression).|
Studies described a variety of data visualization formats, including line, bar, and pie charts [, ], calendar views [ ], scales [ ], mood clouds [ ], traffic lights [ ], and overlays on maps [ ]. Several studies reported that graphical representations were preferred by most participants [ , , ], though personal preferences varied [ , , ]. Some users preferred to aggregate multiple data streams in a single visualization [ , ], while others preferred simple, nongraphical formats such as scales or textual descriptions [ , ]. Participants suggested that images and color were powerful tools to make data visualizations more meaningful and engaging [ , , , , ]. However, these tools could also trigger emotional responses that affected users’ self-image [ - , , , , , , ].
Context and Annotation
Users also discussed the importance of contextual information when interpreting visualized data [, , , , , , , ]. They often wished to annotate their data, thus providing “internal” context in the form of notes alongside a numeric score [ , , , , ]. When used in conjunction with a graphical visualization, these annotations could help users generate insights, which were not evident from numeric data alone. Such internal context was also seen as valuable when using visualizations to communicate with health care providers since it augmented users’ memories of past experiences [ , , , ]. Often, external context explaining symptom scores or condition-specific concepts were also required to help users interpret visualizations. This was especially important when apps were intended for independent use, outside a health care professional’s oversight [ , , ]. Some participants wanted semipersonalized feedback based on their recent scores [ , , , ], which could be as simple as an occasional reassurance that the users’ data were normal [ ] or as complex as personalized health management advice [ , , ].
Six studies [, , , , , ] discussed the time frame for data access. Participants valued regular data access because it provided them with confidence and insight as they worked to manage their conditions. Preferences varied, including real-time, daily, or monthly feedback. This variety was observed even within relatively uniform user populations. Several studies concluded that it was best to incorporate flexibility into their designs, enabling each user to choose the time frame and amount of data to visualize.
Participants often expressed conflicting visualization design preferences [, , , , , , , , ], and authors noted this as a design challenge. Unsurprisingly, the ability to customize data visualizations was highly desirable [ , - , , , , ], and personalization was seen as key to increase long-term engagement with RMT [ ]. This included the ability to select which data to visualize [ , , , , ], how to visualize it [ , , ], and how often or rapidly to access it [ , , , , ]. Some users even wished to add their own personally relevant data streams to RMT visualizations [ ]. Often, users desired flexibility to manipulate and compare data streams, allowing exploration of one’s own data and generation of insights [ , , ].
Moderators of User Needs and Design Preferences
Participants indicated that visualizations must be meaningful and sensitive to users’ personal experiences of their health conditions and comorbidities. Otherwise, they may unintentionally provide negative feedback. For example, one study on people with Parkinson disease  visualized walking activity as progress across a map of France. However, slow progress was interpreted as negative feedback within the context of the users’ mobility impairments [ ]. Participants with multiple sclerosis recommended that visualizations should be designed to emphasize an individual’s progress against their own goals rather than an uncontextualized or absolute score [ ]. When disease progression is tracked over the long term, it should be visualized in a positive light and contextualized within the resources, management strategies, and self-care activities that individuals can continue to use to manage their conditions [ ]. Use of bright color was frequently seen as desirable and engaging in day-to-day health management [ , , ], but muted colors were perceived as preferable when someone was acutely depressed or struggling to maintain a routine, since harsh colors (ie, red) emphasized lack of progress [ , , , , ]. For conditions that caused vision impairment, such as multiple sclerosis, legibility and color contrast were considered important for visualizations [ , ]. Visualizations must also account for possible changes in health status due to disease progression or episodic fluctuation, which may alter user needs or functional abilities [ , , , , ].
Data Literacy and “Data People”
Participants often referred to themselves in terms of whether they were “data people” when describing their desired level of complexity in visualizations. Data people tended to want more control over their visualizations to allow self-exploration of their symptoms and trends [, ]. However, those who did not identify as data people preferred simpler visualizations. These individuals also tended to question the accuracy of purely numeric information [ , ]. This further highlights the need for flexibility, allowing users to choose how and how much data are displayed on a single visualization [ ].
Experience With Self-monitoring
Some users described that their visualization preferences could evolve when self-monitoring was practiced regularly [, , , ]. Users described developing their skills with just a few variables at first and then moving on to complex customized visualizations with many data streams [ , , , ]. Once they were accustomed to tracking many variables, self-monitoring became a mental task that no longer required RMT or visualizations. However, users reported returning to external tracking methods during acute phases or when something disrupted their routines. Those who had extensive experience with RMT also tended to request more customizable features such as selecting data streams to display or requesting personalized advice [ , ]. If customization is not available, there is a risk of disengagement with the RMT as users’ management practices evolve over time [ ].
When designed appropriately, data visualizations are perceived as valuable, engaging components of RMT. They can be validating and empowering, allowing users to become more active, responsible participants in their own care. Individual experiences of health conditions were perceived as highly personal, leading to requests for contextual aids, flexibility, and personalization. Factors such as health status, data literacy, and past experiences affected user needs, thereby moderating design preferences.describes the themes and relationships identified in this study.
Ample literature discusses scientifically derived best practices for app interface design, engagement strategies, and intervention design in various medical conditions and contexts [- ]. Many of these modern practices emphasize user engagement, co-design, and human-centric design methods with an emphasis on scientific rigor [ , , ]. In fact, many included studies reported on app development processes that adhered to these principles. Unfortunately, specific literature on visualization design within the context of RMT-enabled health management is sparse. This review aimed to address this gap. Based on our synthesis alone, we cannot suggest concrete examples of good design or universal design preferences. On the contrary, this review highlighted the diversity of preferences both across and within conditions and study samples. However, with this in mind, we pose several recommendations for RMT visualization design.
First, visualizations of personal data were consistently considered valuable, engaging, and even necessary components of RMT. When designed appropriately, they can be an integral part of condition self-management. Therefore, incorporation of data visualizations should be considered when designing RMT. However, designs should be sensitive to the experiences and health statuses of their target audiences. Participants were regularly concerned that visualizations that inadvertently emphasized slow progress, poor health, or unattained goals could prompt disengagement with RMT during periods of relapse or perceptible disease progression [- , ]. These warnings are consistent with the findings of Lee et al [ ] who suggest that negative emotions and subsequent reductions in health self-efficacy reduce health information–seeking behavior [ ].
Designs should be informed by a deep understanding of the service users’ needs and experiences. For example, study participants with rapid-cycling bipolar disorder suggested that tracking apps and visualizations were not useful to them since most apps allowed only 1 data entry per day [, ]. Such mismatches between user needs and design features are avoidable if sufficient time is taken early in the design process to truly empathize with service users [ ]. Designers should work with members of the target audience to understand their lived experiences, needs, and challenges. It is critical to engage with potential users during the design phase to understand when, how, and with whom data visualizations will be used. Fit-for-purpose visualizations can then be designed with these factors in mind.
Included studies repeatedly suggested that visualizations are not “one-size-fits-all.” Symptoms, triggers, contextual factors, and tracking needs differ from person to person, context to context, and timepoint to timepoint. As such, individual data visualization preferences are highly variable and often dynamic. This is consistent with Paterson’s  “shifting perspectives model of chronic illness,” which describes how individuals’ perceptions of their conditions, symptoms, and health fluctuate between predominant feelings of wellness and illness over time. Sometimes, individuals may predominantly self-identify as well. In a health-tracking context, this may lead service users to track symptoms less frequently or focus on wellness data (eg, physical activity, sleep) [ ]. During such times, reminders of feelings of illness prompted by symptom tracking may even be detrimental to the service user’s self-image. However, when feelings of control over health status is threatened, such as during a relapse, individuals tend to shift their perspectives and more readily identify as ill [ ]. During these times, individuals may be more inclined to self-track their symptoms to identify trends and regain control [ , ]. Owing to this interpersonal and intrapersonal variability, flexible design is highly desirable when it is feasible to implement. Designers should remain mindful of sources of heterogeneity in their target audience’s needs and subsequently identify RMT features that are most likely to require flexibility or personalization.
We also identified areas where tensions may emerge between user preferences and those of other stakeholders. Although this study focused on RMT designed for individual use, participants, especially those with mental health conditions, perceived data visualizations as tools to help communicate experiences to their care partners. However, clinicians often find it difficult to interpret and manage the visualizations derived from RMT , especially if visualizations are not standardized across the various apps used by patients. If visualizations are to be used as communication tools, they must be interpretable, meaningful, and actionable by those involved in patient care [ ]. Otherwise, confusion or even miscommunication may ensue, potentially wasting valuable face-to-face time during short appointments with health care professionals [ ]. Therefore, engagement with other possible users such as caregivers or health care professionals may also be valuable during visualization design.
As with all qualitative metasyntheses, the themes identified here are influenced by the topics, context, and limitations of the included studies. All results reported here must be interpreted as third-order constructs  or interpretations of interpretations of an individual’s original feedback. Although this is the aim of a meta-synthesis, it does pose limitations to remaining grounded in the authors’ and participants’ original meanings and contexts. As reviewers, we attempted to minimize our assumptions during coding and synthesis by continually questioning each other’s interpretations of the data. However, we acknowledge that is impossible to fully isolate our synthesis from our own experiences and worldviews. Study methodology was heterogeneous and the authors’ place in the data was not always clear. Most comments on visualizations were brief and conducted as part of a larger studies, yielding relatively shallow data. Few studies compared preferences between multiple visualization designs, limiting our ability to compare the merits or relative preferences between design options. Most studies used user experience and co-design methods, which generally did not meet traditional expectations of qualitative research rigor. Although we opted for broad search strategies and sensitive review methods to identify all relevant studies, data visualization was almost always a secondary topic in the included papers and was not always clearly discussed. It is therefore a possibility that our strategies did not identify all eligible papers. Those papers that were included predominantly reflected the perspectives of individuals with mental health conditions, and it is unclear how these results may translate to other populations.
Few studies directly addressed research questions related to data visualization preferences. Rather, data visualization was usually approached as peripheral piece of a larger project. Therefore, this review should serve as a starting point for targeted work on health data visualization design. Additional qualitative research on service-user data visualization preferences is warranted, especially within the context of neurological condition self-management. This research should involve individuals directly through interviews, focus groups, or other qualitative methods and should focus on generating “thick” qualitative data that describe more specific uses and contexts. This work should verify and build upon the concepts developed here. Ideally, this work should span multiple conditions and generate diverse perspectives. These perspectives should then be used to generate more detailed design considerations and recommendations for RMT visualizations.
When designed appropriately, data visualizations are valuable engaging components of RMT. They can provide structure and insight, allowing individuals, especially those with mental health conditions, to manage their own health more effectively. However, visualizations are not “one-size-fits-all,” and it is important to engage with potential users during visualization design to understand when, how, and with whom visualizations will be used to manage health. The considerations presented here should serve as the basis for future designs and discussions to ensure that visualizations address users’ needs and preferences.
This review was conducted as part of the Remote Assessment of Disease and Relapse-Central Nervous System (RADAR-CNS) research program. The RADAR-CNS project has received funding from the Innovative Medicines Initiative 2 Joint Undertaking under grant agreement 115902 . This joint undertaking receives support from the European Union’s Horizon 2020 research and innovation program and European Federation of Pharmaceutical Industries and Associations (EFPIA). This communication reflects the views of the RADAR-CNS consortium, and neither Innovative Medicines Initiative nor the European Union and EFPIA are liable for any use that may be made of the information contained herein. This paper represents independent research part funded by the National Institute for Health Research (NIHR) Biomedical Research Centre at South London and Maudsley National Health Service (NHS) Foundation Trust and King’s College London. The views expressed are those of the authors and not necessarily those of the NHS, the NIHR, or the Department of Health and Social Care. TW is a National Institute of Health Research senior investigator.
Conflicts of Interest
AP, JN, SM, MFD, and GT are employees of Merck, Sharp, and Dohme, Inc, and may own stock or stock options.
Search strategy and data extraction form.PDF File (Adobe PDF File), 100 KB
Characteristics of the included studies, critical appraisal, coding, and illustrative quotes.PDF File (Adobe PDF File), 258 KB
- Gurupur VP, Wan TTH. Challenges in implementing mHealth interventions: a technical perspective. Mhealth 2017;3:32 [FREE Full text] [CrossRef] [Medline]
- Mohammadzadeh N, Safdari R. Patient monitoring in mobile health: opportunities and challenges. Med Arch 2014;68(1):57-60 [FREE Full text] [CrossRef] [Medline]
- Nouri R, R Niakan Kalhori S, Ghazisaeedi M, Marchand G, Yasini M. Criteria for assessing the quality of mHealth apps: a systematic review. J Am Med Inform Assoc 2018 Aug 01;25(8):1089-1098 [FREE Full text] [CrossRef] [Medline]
- Orlowski S, Matthews B, Bidargaddi N, Jones G, Lawn S, Venning A, et al. Mental Health Technologies: Designing With Consumers. JMIR Hum Factors 2016 Jan 28;3(1):e4 [FREE Full text] [CrossRef] [Medline]
- Altman M, Huang TTK, Breland JY. Design Thinking in Health Care. Prev Chronic Dis 2018 Sep 27;15:E117 [FREE Full text] [CrossRef] [Medline]
- Palacholla RS, Fischer N, Coleman A, Agboola S, Kirley K, Felsted J, et al. Provider- and Patient-Related Barriers to and Facilitators of Digital Health Technology Adoption for Hypertension Management: Scoping Review. JMIR Cardio 2019 Mar 26;3(1):e11951 [FREE Full text] [CrossRef] [Medline]
- Simblett S, Greer B, Matcham F, Curtis H, Polhemus A, Ferrão J, et al. Barriers to and Facilitators of Engagement With Remote Measurement Technology for Managing Health: Systematic Review and Content Analysis of Findings. J Med Internet Res 2018 Jul 12;20(7):e10480 [FREE Full text] [CrossRef] [Medline]
- Marcengo A, Rapp A. Visualization of human behavior data: the quantified self. In: Huang ML, Huang W, editors. Innovative Approaches of Data Visualization and Visual Analytics. Hershey, PA: IGI Global; 2014:236-235.
- Few S. Data visualization for human perception. In: The Encyclopedia of Human-Computer Interaction, 2nd Ed. Aarhus, Denmark: The Interaction Design Foundation; 2010.
- Woods L, Cummings E, Duff J, Walker K. Design Thinking for mHealth Application Co-Design to Support Heart Failure Self-Management. Stud Health Technol Inform 2017;241:97-102. [Medline]
- Bate P, Robert G. Experience-based design: from redesigning the system around the patient to co-designing services with the patient. Qual Saf Health Care 2006 Oct;15(5):307-310 [FREE Full text] [CrossRef] [Medline]
- Schmidt JM, Irvine JM, Miller S. Data visualization. In: De Georgia M, Loparo K, editors. Neurocritical Care Informatics. Berlin, Heidelberg: Springer; 2019:135-147.
- Schlee W, Hall DA, Edvall NK, Langguth B, Canlon B, Cederroth CR. Visualization of Global Disease Burden for the Optimization of Patient Management and Treatment. Front Med (Lausanne) 2017;4:86 [FREE Full text] [CrossRef] [Medline]
- Park S, Bekemeier B, Flaxman A, Schultz M. Impact of data visualization on decision-making and its implications for public health practice: a systematic literature review. Inform Health Soc Care 2021 Sep 28:1-19. [CrossRef] [Medline]
- Chittaro L. Visualizing Information on Mobile Devices. Computer 2006 Mar;39(3):40-45. [CrossRef]
- Ware C. In: Kaufmann M, editor. Visual Thinking for Design. Amsterdam: Elsevier; 2008.
- Few S. Data visualization past, present and future. Perceptual Edge. 2009. URL: http://mail.perceptualedge.com/articles/Whitepapers/Data_Visualization.pdf [accessed 2020-06-29]
- Turchioe MR, Myers A, Isaac S, Baik D, Grossman LV, Ancker JS, et al. A Systematic Review of Patient-Facing Visualizations of Personal Health Data. Appl Clin Inform 2019 Aug;10(4):751-770 [FREE Full text] [CrossRef] [Medline]
- Shamseer L, Moher D, Clarke M, Ghersi D, Liberati A, Petticrew M, PRISMA-P Group. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: elaboration and explanation. BMJ 2015 Jan 02;350:g7647 [FREE Full text] [CrossRef] [Medline]
- Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ 2021 Mar 29;372:n71 [FREE Full text] [CrossRef] [Medline]
- Polhemus A, Novak J, Majid S, Simblett S, Wykes T, Dockendorf M, et al. Service user preferences on data visualization by remote measurement technologies for chronic central nervous system disease management. PROSPERO: International Prospective Register of Systematic Reviews. 2019. URL: https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42019139319 [accessed 2020-06-29]
- Cohen J. A Coefficient of Agreement for Nominal Scales. Educational and Psychological Measurement 2016 Jul 02;20(1):37-46. [CrossRef]
- Kohl C, McIntosh EJ, Unger S, Haddaway NR, Kecke S, Schiemann J, et al. Online tools supporting the conduct and reporting of systematic reviews and systematic maps: a case study on CADIMA and review of existing tools. Environ Evid 2018 Feb 1;7(1):1-17. [CrossRef]
- Davis MM, Freeman M, Kaye J, Vuckovic N, Buckley DI. A systematic review of clinician and staff views on the acceptability of incorporating remote monitoring technology into primary care. Telemed J E Health 2014 May;20(5):428-438 [FREE Full text] [CrossRef] [Medline]
- Pace R, Pluye P, Bartlett G, Macaulay AC, Salsberg J, Jagosh J, et al. Testing the reliability and efficiency of the pilot Mixed Methods Appraisal Tool (MMAT) for systematic mixed studies review. Int J Nurs Stud 2012 Jan;49(1):47-53. [CrossRef] [Medline]
- Hong QN, Fàbregues S, Bartlett G, Boardman F, Cargo M, Dagenais P, et al. The Mixed Methods Appraisal Tool (MMAT) version 2018 for information professionals and researchers. EFI 2018 Dec 18;34(4):285-291. [CrossRef]
- Malpass A, Shaw A, Sharp D, Walter F, Feder G, Ridd M, et al. "Medication career" or "moral career"? The two sides of managing antidepressants: a meta-ethnography of patients' experience of antidepressants. Soc Sci Med 2009 Jan;68(1):154-168. [CrossRef] [Medline]
- Dixon-Woods M, Booth A, Sutton AJ. Synthesizing qualitative research: a review of published reports. Qualitative Research 2016 Aug 15;7(3):375-422. [CrossRef]
- Thomas J, Harden A. Methods for the thematic synthesis of qualitative research in systematic reviews. BMC Med Res Methodol 2008 Jul 10;8:45 [FREE Full text] [CrossRef] [Medline]
- Fuller-Tyszkiewicz M, Richardson B, Klein B, Skouteris H, Christensen H, Austin D, et al. A Mobile App-Based Intervention for Depression: End-User and Expert Usability Testing Study. JMIR Ment Health 2018 Aug 23;5(3):e54 [FREE Full text] [CrossRef] [Medline]
- Rohani D, Tuxen N, Lopategui A, Faurholt-Jepsen M, Kessing L, Bardram J. Personalizing mental health: a feasibility study of a mobile behavioral activation tool for depressed patients. : Association for Computing Machinery; 2019 Presented at: 3th EAI International Conference on Pervasive Computing Technologies for Healthcare; May 20-23; Trento, Italy. [CrossRef]
- Bauer AM, Hodsdon S, Bechtel JM, Fortney JC. Applying the Principles for Digital Development: Case Study of a Smartphone App to Support Collaborative Care for Rural Patients With Posttraumatic Stress Disorder or Bipolar Disorder. J Med Internet Res 2018 Jun 06;20(6):e10048 [FREE Full text] [CrossRef] [Medline]
- Bauer AM, Hodsdon S, Hunter S, Choi Y, Bechtel J, Fortney JC. Lessons from the Deployment of the SPIRIT App to Support Collaborative Care for Rural Patients with Complex Psychiatric Conditions. Proc ACM Int Conf Ubiquitous Comput 2017 Sep;2017:772-780 [FREE Full text] [CrossRef] [Medline]
- Bauer AM, Iles-Shih M, Ghomi RH, Rue T, Grover T, Kincler N, et al. Acceptability of mHealth augmentation of Collaborative Care: A mixed methods pilot study. Gen Hosp Psychiatry 2018;51:22-29 [FREE Full text] [CrossRef] [Medline]
- Matthews M, Voida S, Abdullah S, Doherty G, Choudhury T, Im S, et al. In situ design for mental illness: considering the pathology of bipolar disorder in mHealth design. : Association for Computing Machinery; 2015 Presented at: 17th International Conference on Human-Computer Interaction with Mobile Devices and Services; August 24-27; Copenhagen, Denmark. [CrossRef]
- Matthews M, Abdullah S, Murnane E, Voida S, Choudhury T, Gay G, et al. Development and Evaluation of a Smartphone-Based Measure of Social Rhythms for Bipolar Disorder. Assessment 2016 Aug;23(4):472-483 [FREE Full text] [CrossRef] [Medline]
- Bardram J, Frost M, Szántó K, Faurholt-Jepsen M, Vinberg M, Kessing L. Designing mobile health technology for bipolar disorder: a field trial of the MONARCA system. : Association for Computing Machinery; 2013 Presented at: SIGCHI Conference on Human Factors in Computing Systems; April 27-May 3; Paris, France. [CrossRef]
- Bardram J, Frost M, Szántó K, Marcu G. The MONARCA self-assessment system: a persuasive personal monitoring system for bipolar patients. : Association for Computing Machinery; 2012 Presented at: 2nd ACM SIGHIT International Health Informatics Symposium; January 28-30; Miami, Florida, USA. [CrossRef]
- Jonassaint CR, Rao N, Sciuto A, Switzer GE, De Castro L, Kato GJ, et al. Abstract Animations for the Communication and Assessment of Pain in Adults: Cross-Sectional Feasibility Study. J Med Internet Res 2018 Aug 03;20(8):e10056 [FREE Full text] [CrossRef] [Medline]
- Adams P, Murnane E, Elfenbein M, Wethington E, Gay G. Supporting the self-management of chronic pain conditions with tailored momentary self-assessments. 2017 Presented at: 2017 CHI Conference on Human Factors in Computing Systems; May 6-11; Denver, Colorado, USA. [CrossRef]
- Eisner E, Drake RJ, Berry N, Barrowclough C, Emsley R, Machin M, et al. Development and Long-Term Acceptability of ExPRESS, a Mobile Phone App to Monitor Basic Symptoms and Early Signs of Psychosis Relapse. JMIR Mhealth Uhealth 2019 Mar 29;7(3):e11568 [FREE Full text] [CrossRef] [Medline]
- Quaedackers L, De Wit J, Pillen S, Van Gilst M, Batalas N, Lammers GJ, et al. A Mobile App for Longterm Monitoring of Narcolepsy Symptoms: Design, Development, and Evaluation. JMIR Mhealth Uhealth 2020 Jan 07;8(1):e14939 [FREE Full text] [CrossRef] [Medline]
- Hoffman L, Benedetto E, Huang H, Grossman E, Kaluma D, Mann Z, et al. Augmenting Mental Health in Primary Care: A 1-Year Study of Deploying Smartphone Apps in a Multi-site Primary Care/Behavioral Health Integration Program. Front Psychiatry 2019;10:94 [FREE Full text] [CrossRef] [Medline]
- Ando H, Ashcroft-Kelso H, Halhead R, Chakrabarti B, Young CA, Cousins R, et al. Experience of telehealth in people with motor neurone disease using noninvasive ventilation. Disabil Rehabil Assist Technol 2021 Jul;16(5):490-496. [CrossRef] [Medline]
- Anderson K, Burford O, Emmerton L. Mobile Health Apps to Facilitate Self-Care: A Qualitative Study of User Experiences. PLoS One 2016;11(5):e0156164 [FREE Full text] [CrossRef] [Medline]
- Murnane EL, Cosley D, Chang P, Guha S, Frank E, Gay G, et al. Self-monitoring practices, attitudes, and needs of individuals with bipolar disorder: implications for the design of technologies to manage mental health. J Am Med Inform Assoc 2016 May;23(3):477-484. [CrossRef] [Medline]
- Giunti G, Kool J, Rivera Romero O, Dorronzoro Zubiete E. Exploring the Specific Needs of Persons with Multiple Sclerosis for mHealth Solutions for Physical Activity: Mixed-Methods Study. JMIR Mhealth Uhealth 2018 Feb 09;6(2):e37 [FREE Full text] [CrossRef] [Medline]
- Forchuk C, Reiss JP, O'Regan T, Ethridge P, Donelle L, Rudnick A. Client perceptions of the mental health engagement network: a qualitative analysis of an electronic personal health record. BMC Psychiatry 2015 Oct 14;15:250 [FREE Full text] [CrossRef] [Medline]
- Erten-Uyumaz B, Ahuja M, Vacaretu T, Rama M, Overeem S, Visser T, et al. Design and evaluation of a negotiation-based sleep scheduler app for insomnia treatment. : Association for Computing Machinery; 2019 Presented at: 13th EAI International Conference on Pervasive Computing Technologies for Healthcare; May 20-23; Trento, Italy. [CrossRef]
- Saunders KEA, Bilderbeck AC, Panchal P, Atkinson LZ, Geddes JR, Goodwin GM. Experiences of remote mood and activity monitoring in bipolar disorder: A qualitative study. Eur Psychiatry 2017 Mar;41:115-121 [FREE Full text] [CrossRef] [Medline]
- McClelland GT, Fitzgerald M. A participatory mobile application (app) development project with mental health service users and clinicians. Health Education Journal 2018 Jun 05;77(7):815-827. [CrossRef]
- Wannheden C, Revenäs Å. How People with Parkinson's Disease and Health Care Professionals Wish to Partner in Care Using eHealth: Co-Design Study. J Med Internet Res 2020 Sep 21;22(9):e19195 [FREE Full text] [CrossRef] [Medline]
- Van Tiem J, Moeckli J, Suiter N, Fuhrmeister L, Pham K, Dindo L, et al. "A link to the outside:" Patient perspectives on a mobile texting program to improve depression self-management. Patient Educ Couns 2021 Sep;104(9):2154-2158. [CrossRef] [Medline]
- Elsborg M, Bruun A, Jensen R. Supporting anxiety patients? self-reflection through visualization of physiological data. : Association for Computing Machinery; 2020 Presented at: 32nd Australian Conference on Human-Computer Interaction; December 2-4; Sydney, Australia. [CrossRef]
- Ruzic L, Sanford JA. Needs Assessment—mHealth Applications for People Aging with Multiple Sclerosis. J Healthc Inform Res 2018 May 10;2(1-2):71-98. [CrossRef]
- Herbst E, McCaslin SE, Hassanbeigi Daryani S, Laird KT, Hopkins LB, Pennington D, et al. A Qualitative Examination of Stay Quit Coach, A Mobile Application for Veteran Smokers With Posttraumatic Stress Disorder. Nicotine Tob Res 2020 Apr 17;22(4):560-569. [CrossRef] [Medline]
- Schleimer E, Pearce J, Barnecut A, Rowles W, Lizee A, Klein A, et al. A Precision Medicine Tool for Patients With Multiple Sclerosis (the Open MS BioScreen): Human-Centered Design and Development. J Med Internet Res 2020 Jul 06;22(7):e15605 [FREE Full text] [CrossRef] [Medline]
- Daus H, Kislicyn N, Heuer S, Backenstrass M. Disease management apps and technical assistance systems for bipolar disorder: Investigating the patients´ point of view. J Affect Disord 2018 Mar 15;229:351-357. [CrossRef] [Medline]
- Yoo S, Lim K, Baek H, Jang S, Hwang G, Kim H, et al. Developing a mobile epilepsy management application integrated with an electronic health record for effective seizure management. Int J Med Inform 2020 Feb;134:104051. [CrossRef] [Medline]
- Ando H, Ashcroft-Kelso H, Halhead R, Chakrabarti B, Young CA, Cousins R, et al. Experience of telehealth in people with motor neurone disease using noninvasive ventilation. Disabil Rehabil Assist Technol 2021 Jul;16(5):490-496. [CrossRef] [Medline]
- Garzo A, Silva PA, Garay-Vitoria N, Hernandez E, Cullen S, Cochen De Cock V, et al. Design and development of a gait training system for Parkinson's disease. PLoS One 2018;13(11):e0207136 [FREE Full text] [CrossRef] [Medline]
- Buitenweg DC, Bongers IL, van de Mheen D, van Oers HA, van Nieuwenhuizen C. Cocreative Development of the QoL-ME: A Visual and Personalized Quality of Life Assessment App for People With Severe Mental Health Problems. JMIR Ment Health 2019 Mar 28;6(3):e12378 [FREE Full text] [CrossRef] [Medline]
- Ospina-Pinillos L, Davenport T, Mendoza Diaz A, Navarro-Mancilla A, Scott EM, Hickie IB. Using Participatory Design Methodologies to Co-Design and Culturally Adapt the Spanish Version of the Mental Health eClinic: Qualitative Study. J Med Internet Res 2019 Aug 02;21(8):e14127 [FREE Full text] [CrossRef] [Medline]
- Proudfoot J, Parker G, Hadzi Pavlovic D, Manicavasagar V, Adler E, Whitton A. Community attitudes to the appropriation of mobile phones for monitoring and managing depression, anxiety, and stress. J Med Internet Res 2010 Dec 19;12(5):e64 [FREE Full text] [CrossRef] [Medline]
- Farao J, Malila B, Conrad N, Mutsvangwa T, Rangaka MX, Douglas TS. A user-centred design framework for mHealth. PLoS One 2020;15(8):e0237910 [FREE Full text] [CrossRef] [Medline]
- Mummah SA, Robinson TN, King AC, Gardner CD, Sutton S. IDEAS (Integrate, Design, Assess, and Share): A Framework and Toolkit of Strategies for the Development of More Effective Digital Interventions to Change Health Behavior. J Med Internet Res 2016 Dec 16;18(12):e317 [FREE Full text] [CrossRef] [Medline]
- Schnall R, Rojas M, Bakken S, Brown W, Carballo-Dieguez A, Carry M, et al. A user-centered model for designing consumer mobile health (mHealth) applications (apps). J Biomed Inform 2016 Apr;60:243-251 [FREE Full text] [CrossRef] [Medline]
- Polhemus AM, Novák J, Ferrao J, Simblett S, Radaelli M, Locatelli P, et al. Human-Centered Design Strategies for Device Selection in mHealth Programs: Development of a Novel Framework and Case Study. JMIR Mhealth Uhealth 2020 May 07;8(5):e16043 [FREE Full text] [CrossRef] [Medline]
- Lee SY, Hwang H, Hawkins R, Pingree S. Interplay of Negative Emotion and Health Self-Efficacy on the Use of Health Information and Its Outcomes. Communication Research 2008 Apr 14;35(3):358-381. [CrossRef]
- Paterson BL. The shifting perspectives model of chronic illness. J Nurs Scholarsh 2001;33(1):21-26. [CrossRef] [Medline]
- Zhu H, Colgan J, Reddy M, Choe EK. Sharing Patient-Generated Data in Clinical Practices: An Interview Study. AMIA Annu Symp Proc 2016;2016:1303-1312 [FREE Full text] [Medline]
- Andrews JA, Craven MP, Jamnadas-Khoda J, Lang AR, Morriss R, Hollis C, RADAR-CNS Consortium. Health Care Professionals' Views on Using Remote Measurement Technology in Managing Central Nervous System Disorders: Qualitative Interview Study. J Med Internet Res 2020 Jul 24;22(7):e17414 [FREE Full text] [CrossRef] [Medline]
- Caprani N, Doyle J, Komaba Y, Inomata A. Exploring healthcare professionals' preferences for visualising sensor data. : Association for Computing Machinery; 2015 Presented at: 2015 British HCI Conference; July 13; Lincoln, Lincolnshire, United Kingdom. [CrossRef]
- Noblit GW, Hare RD. Meta-Ethnography: Synthesizing Qualitative Studies. Newbury Park, California, USA: SAGE Publications, Inc; 1988.
- Innovative Medicines Initiative. URL: https://www.imi.europa.eu/ [accessed 2022-01-25]
|EFPIA: European Federation of Pharmaceutical Industries and Associations|
|MONARCA: MONitoring, treAtment and pRediCtion of bipolAr Disorder Episodes|
|NHS: National Health Service|
|NIHR: National Institute for Health Research|
|PRISMA-P: Preferred Reporting Items for Systematic review and Meta-Analysis Protocols|
|PROSPERO: International Prospective Register of Systematic Reviews|
|RADAR-CNS: Remote Assessment of Disease and Relapse-Central Nervous System|
|RMT: remote measurement technology|
Edited by J Torous; submitted 25.10.20; peer-reviewed by A Alasmari, I Shubina, H Daus, M Ghazisaeedi, CY Lin; comments to author 30.12.20; revised version received 29.03.21; accepted 20.10.21; published 28.04.22Copyright
©Ashley Polhemus, Jan Novak, Shazmin Majid, Sara Simblett, Daniel Morris, Stuart Bruce, Patrick Burke, Marissa F Dockendorf, Gergely Temesi, Til Wykes. Originally published in JMIR Mental Health (https://mental.jmir.org), 28.04.2022.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Mental Health, is properly cited. The complete bibliographic information, a link to the original publication on https://mental.jmir.org/, as well as this copyright and license information must be included.