Background: Ecological momentary assessment is a method of investigating individuals’ real-time experiences, behaviors, and moods in their natural environment over time. Despite its general usability and clinical value for evaluating daily depressive mood, there are several methodological challenges when applying ecological momentary assessment to older adults.
Objective: The aims of this integrative literature review were to examine possible uses of the ecological momentary assessment methodology with older adults and to suggest strategies to increase the feasibility of its application in geriatric depression research and practice.
Methods: We searched 4 electronic databases (MEDLINE, CINAHL, PsycINFO, and EMBASE) and gray literature; we also hand searched the retrieved articles’ references. We limited all database searches to articles published in peer-reviewed journals from 2009 to 2019. Search terms were “ecological momentary assessment,” “smartphone assessment,” “real time assessment,” “electronic daily diary,” “mHealth momentary assessment,” “mobile-based app,” and “experience sampling method,” combined with the relevant terms of depression. We included any studies that enrolled older adults even as a subgroup and that reported depressive mood at least once a day for more than 2 days.
Results: Of the 38 studies that met the inclusion criteria, only 1 study enrolled adults aged 65 years or older as the entire sample; the remainder of the reviewed studies used mixed samples of both younger and older adults. Most of the analyzed studies (18/38, 47%) were quantitative, exploratory (descriptive, correlational, and predictive), and cohort in design. Ecological momentary assessment was used to describe the fluctuating pattern of participants’ depressive moods primarily and to examine the correlation between mood patterns and other health outcomes as a concurrent symptom. We found 3 key methodological issues: (1) heterogeneity in study design and protocol, (2) issues with definitions of dropout and adherence, and (3) variation in how depressive symptoms were measured with ecological momentary assessment. Some studies (8/38, 21%) examined the age difference of participants with respect to dropout or poor compliance rate. Detailed participant burden was reported, such as technical problems, aging-related health problems, or discomfort while using the device.
Conclusions: Ecological momentary assessment has been used for comprehensive assessment of multiple mental health indicators in relation to depressive mood. Our findings provide methodological considerations for further studies that may be implemented using ecological momentary assessment to assess daily depressive mood in older adults. Conducting more feasibility studies focusing on older adults with standardized data collection protocols and mixed-methods research is required to reflect users’ experiences. Further telepsychiatric evaluation and diagnosis based on ecological momentary assessment data should involve standardized and sophisticated strategies to maximize the potential of ecological momentary assessment for older adults with depression in the community setting.
It is challenging to screen for and diagnose geriatric depression due to the atypical presentations of symptoms in older populations . Consequently, geriatric depression often remains unrecognized in home care settings, even when the individual receives continuous home care service [ ]. If health care providers use only instrument-based interviewing to screen for depression, they detect as few as one-third of depressed older adults [ ]. It is important to diversify the available and implemented assessment methods to improve detection; thus, ecological momentary assessment (EMA) may help detect depressive mood more accurately.
EMA is a method of investigating individuals’ real-time experiences as they occur in their natural environment and situations over time . EMA has a range of methodological strengths: (1) the “ecological” aspect represents real-world environments, allowing for increasing generalization with ecological validity; (2) the “momentary” aspect focuses on an individual’s current state, which may decrease retrospective bias and errors; and (3) the “assessment” aspect provides multiple data collection points over time and across situations [ , ].
EMA methods are used in psychological research . Studies have used EMA methods to investigate individual affect [ - ], behavioral problems [ ], and daily mental health symptoms [ , , ]. For depression research, EMA has much to offer in terms of improving researchers’ understanding of depression because of advantages such as minimizing recall bias and detecting fluctuation of mood for a longer time [ , ]. Traditionally, researchers have relied on participants’ retrospective reports about their depressive mood; however, such recall data are subject to the vagaries of cognitive heuristics and the retrieval processes [ , ]. With EMA, participants may report their mood repeatedly over time, within a familiar real-life environment, rather than reporting recollections or being interviewed in a research or laboratory setting. Researchers or clinicians can gather more ecologically valid data, which reflect participants’ lifestyles or daily needs [ , ]. Thus, EMA can be used for diagnosing geriatric depression even without the screen instruments [ ].
There are ongoing efforts to assure the validity, feasibility, and usability of EMA in individuals who report depressive symptoms [, ]. For example, Hung et al [ ] examined the validity and feasibility of smartphone-based EMA for Chinese patients with depression. Vachon et al [ ] investigated changes in the psychological state of outpatients with major depressive disorder. Moore et al [ ] found compatible psychometrics between traditional pen-and-paper and smartphone versions of EMA in emotionally distressed older adults. Among the growing body of EMA research in this area, many studies involved mixed age groups, such as middle-aged or older adults with younger participants [ , , , , - ]. Thus, it is unclear how older adults’ characteristics were reflected during data collection and interpretation using EMA because older adults with mental health problems frequently have decreased self-confidence and less motivation to use new technology [ ].
Very few studies have examined the feasibility of using EMA with older adults with depressive mood [- ]. Thus, we believe that possible implications can be extracted from studies including older adults even when they are only part of the study population. Our integrative review aimed to (1) synthesize the current information regarding the possible application of EMA to older adults’ depression and (2) discuss the conceptual and methodological issues of EMA when considering further implementations in geriatric depression research and practice.
This integrative review was based on a comprehensive literature search  and the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines [ ].
For this integrative literature review, we conducted a literature search from June to July 2019. Based on the initial search, only 1 study  met the criterion that only older adults, aged 65 years or older, were enrolled. Thus, we decided to include studies that sampled adults aged 65 years or older as part of their samples; that is, both younger and older individuals might be included in the studies. We searched 4 electronic databases: MEDLINE (through PubMed), CINAHL, PsycINFO, and EMBASE. We searched the gray literature, including dissertations, conference proceedings (papers or abstracts), and editorials, in the Virginia Henderson International Nursing Library and CINAHL (exclusively focusing on gray literature). We performed an additional manual search using the Google Scholar online tool, based on an ancestry search of citation and reference lists obtained from articles we retrieved from the targeted databases.
The initial sets of search terms consisted of “ecological momentary assessment,” “smartphone assessment,” “real time assessment,” “electronic daily diary,” “mHealth momentary assessment,” “mobile-based app,” or “experience sampling method,” combined with “affect,” “mood,” and “emotion,” as well as “depress*” to reflect different relevant terms such as depression, depressed, or depressive ().
Inclusion criteria were as follows: (1) studies enrolled at least some participants aged 65 years or older; (2) study participants reported EMA in the community setting; (3) studies measured momentary affect, such as depressive symptoms, depressed mood, negative affect, or negative emotion at least once a day for more than 2 days; (4) studies used certain types of instruments or devices to report participants’ momentary mood or scores, either electronic devices (eg, smartphone, personal digital assistant, or palm computer) or traditional pen-and-paper recording tools; (5) studies were published in English; and (6) studies were published between 2009 and 2019.
Exclusion criteria were as follows: (1) participants’ ages were not clearly reported or were determined to be less than 64 years using the available information regarding the study sample’s means, ranges, and proportion of age groups; (2) studies included a negligible proportion of older adults (eg, 65-69 years old) within a wide range of participant ages; (3) studies measured momentary affect such as depressive symptoms, depressed mood, negative affect, or negative emotion using non-EMA tools; and (4) studies were methodological studies comparing the reliability between traditional and electronic measurements of EMA.
If an article was a systematic review, Cochrane review, literature review, case study, or expert opinion, we used it as background information and examined the references to expand our manual literature search; however, we did not include such reviews in the analysis.
Data Extraction, Analysis, and Synthesis
Four authors (YRJ, HYK, NHK, and HJK) initially screened titles and abstracts based on eligibility criteria and reviewed the full text of articles. These researchers had an acceptable level of agreement of over 95% regarding final selection of the articles. Four authors (YRJ, HYK, NHK, and HJK) extracted the data from the selected articles into an analysis table. Two authors (SK and SSK) validated and confirmed the analyzed data between articles and table entries for accuracy (99% verification).
Characteristics of Selected Studies and Participants
The searches retrieved 1013 records from the 4 databases and gray literature, and 10 records from the manual search. After screening the results against our eligibility criteria, we selected 38 studies for review that met our inclusion criteria (). summarizes the characteristics of the 38 selected studies and their participants.
Study Aims and Design
All 38 studies applied a longitudinal design to observe depressive mood throughout EMA from several days to months to emphasize the benefit of multiple-timescale aspects of the study design. Most of the analyzed studies (18/38, 47%) were quantitative, exploratory (descriptive, correlational, and predictive), and cohort in design [, , , , - , , , , , , , , - ]. Approximately half of the studies used EMA primarily to assess depressive mood over time. However, the other half of the studies used EMA to examine other symptoms or health problems and collected information on depressive mood as concurrent or associated factors. Frequent aims of these studies were to (1) describe the fluctuating pattern of participants’ depressive mood and relevant characteristics and (2) identify concurrent and lagged association of the depressive mood with other psychological factors. Few studies examined predisposing situations and conditions that might influence a lagged effect of depressive mood. Other types of study designs were used to achieve different purposes. Two methodological studies [ , ] aimed to determine the validity, reliability, and user evaluation of EMA over time. Two studies applied a mixed-methods research approach [ , ] to assess perceived acceptability, adherence rates, and reasons for poor compliance or nonadherence to smartphone-based EMA in older adults or to examine participants’ qualitative responses.
Only 1 study enrolled adults aged 65 years or older as the entire sample . The remainder of the reviewed studies used mixed samples of both younger and older adults, with ages ranging from 18 to 97 years. Some studies involved advanced age groups, such as middle-aged or older adults, with younger participants [ , , , , - ]. The sample size of surveyed studies ranged from 12 to 404, which varied according to study purpose, data collection method, and analysis plans. Some studies specifically aimed to enroll study participants with depressive mood and relevant mental health problems (7/38, 18%) [ , , , , , , ], other physical health problems or diseases (8/38, 21%) [ , , , , , - ], or chronic pain (2/38, 5%) [ , ], which may be related to depressive mood. Some studies aimed to enroll study participants who had an alcohol or smoking habit (4/38, 11%) [ , , , ] or obesity (2/38, 5%) [ , ]. However, several studies (15/38, 40%) did not specify any particular disease or condition [ , , , , , , , , , , , , - ].
Measures of Depression and Other Variables
and summarize the characteristics of EMA measurements used in the 38 selected studies.
Measures of Baseline Depression and Concurrent Characteristics
Most studies (22/38, 58%) examined depressive mood at baseline using a diverse array of clinically valid screening instruments or established diagnostic criteria. Several screening or diagnostic instruments were used: the Mini International Neuropsychiatric Interview [, , ]; Hamilton Rating Scale for Depression [ , , ]; Beck Depression Inventory [ , , , , ]; Patient Health Questionnaire (PHQ) [ , ]; Composite International Diagnostic Interview [ , ]; Montgomery-Asberg Depression Rating Scale [ , ]; Diagnostic and Statistical Manual of Mental Disorders (Fourth Edition) (DSM-IV) [ , , , , , ]; Structured Clinical Interview for the DSM-IV-Text Revision [ , , ]; Patient-Reported Outcomes Measurement Information System (PROMIS) [ , ]; Center for Epidemiologic Studies Depression Scale (CES-D) [ , , , , ]; Positive and Negative Affect Schedule (PANAS) [ , ]; Positive and Negative Syndrome Scale [ , ]; Hospital Anxiety and Depression Scale [ , , , ]; and Hamilton Depression Inventory [ , ]. The researchers of each study used this information to describe sample characteristics at baseline or included the data as a controlled variable in their analyses.
Some relevant characteristics were also examined along with depressive mood. Most studies included variables relating to momentary experiences, activities, or behaviors occurring before or at the time of report [, , , , , , - , - , , ]. Some studies also included concurrent symptoms of depression such as fatigue [ , , , , ], pain [ , , , , , , , , , ], stress [ , , - , , , , , , , , , ], anxiety [ , , , , , , , , - , , - , , ], loneliness [ , , , , , , , , ], or cognitive impairment [ , , , , ].
Measures of Momentary Depressive Mood
When employing EMA, most studies did not clearly define “momentary mood of depression,” and there was no consistency of operational definition across the 38 selected studies. Moreover, the depressive score was defined in diverse terms, such as depressive or negative mood and affect [, , , , - , - , , - ], sadness [ , , - , - , , , , , , , , , ], feeling down [ , , , ], or relevant symptoms of depression [ , , , , ]. In some studies, depression was included as a set of subitems of global affect or mood [ , , , , , , , , - ], whereas other studies treated depressive scores separately from other measurements that might have been taken [ , , , , ].
A single item was usually used to measure momentary depression in most studies (35/38, 92%), whereas only a few studies employed multiple items to assess symptoms of depression [, , ]. Most reporting mechanisms relied on a Likert scale (30/38, 79%), visual analog scale (6/38, 16%), or sliding bar scale (2/38, 5%) in the form of points or a sliding bar. Some of the surveyed studies (14/38, 37%) clearly stated that the question used to measure depression was extracted from widely used instruments, such as the PANAS [ , , , , , ], PANAS-Expanded Form [ , ], circumplex model of emotion [ , ], circumplex model of affect [ , , ], PROMIS [ , ], Philadelphia Geriatric Center Positive and Negative Affect Rating Scale [ , ], CES-D-Revised [ , ], DSM-IV [ , ], or PHQ [ , ]. Those instruments were different from the measures used at baseline to screen participants’ depression diagnosis or initial status.
A range of different EMA devices were used to record momentary data. Of the 38 studies, 17 (45%) used computerized handheld devices [, , , , , , , , , , , , , , , , ], whereas 14 studies (14/38, 37%) used smartphone or web-based EMA apps, or both [ , , , - , , , , , , , , ]. One study (1/38, 3%) employed telephone-based EMA via phone interview [ ], and another relied on an automatic cell phone call [ ]. One study (1/38, 3%) made a direct call and entered scores with an input keypad [ ]. A few studies (3/38, 8%) used pen-and-paper–based EMA or booklets using a timekeeping mechanism [ , , ]. One study (1/38, 3%) asked participants to record a diary via email, but their device was unclear [ ].
Observation times varied widely across the studies. The number of repeated EMA measurements ranged from 1 to 10 per day, from 5 to 180 days. Thus, the total number of repeated EMA measurements ranged from 14 to 360. Several studies divided the EMA measurement period into 2 or more periods spaced over several months [, , , , , , , ]; however, the other studies conducted EMA measurements within a consecutive period of days.
Most studies (36/38, 95%) provided detailed information about how EMA was applied within specific timing, except for 2 studies [, ]. In several studies, participants received automatic notifications at fixed times [ , , , , , , , , , ]. In other studies, the participant received an automatic notice at random within the researcher- or participant-designated time interval in a day [ , , , , - , , , , , ]. Other studies used a totally randomized time frame in a day [ , , , , , ]. Several studies used mixed methods, employing fixed or random and individualized time based on sleep and daily activities [ , - , , , , ].
Feasibility: Dropout, Adherence, and Subjective Evaluation
Many studies (34/38, 90%) defined dropout, compliance, adherence, or active usage.summarizes each concept’s definition and reported rate.
Definition and Overall Rate
Many studies defined dropout as participants who exhibited noncompliance during the study period [, , , , , ]. One study applied liberal criteria by excluding those who never used EMA [ ], whereas other researchers were relatively conservative, excluding even those who partially participated in the EMA but did not strictly follow the reporting protocols [ , , ]. In addition, 11 studies (11/38, 29%) did not provide a clear operational definition of dropout, although they reported the rate of dropout. Based on these variously defined criteria and unclear information available across studies, the dropout rate among studies varied significantly, from 1.3% [ ] to 25.9% [ ].
Studies also reported mixed definitions of adherence and compliance. In 3 studies [, , ], these were defined as the degree of completion, calculated by dividing the number of completed ratings by the potential maximum number of required EMA observations. Other studies applied a specific required completion rate to classify whether a given participant adhered to or complied with EMA, such as 30% [ ], 50% [ ], or 100% [ ]. Due to the inconsistency of adherence criteria, large variations in adherence rates were observed starting from 65.1% [ ]. A total of 8 studies (8/38, 21%) examined age difference of dropout or poor compliance rate, but they reported that advanced age was not associated with different compliance or satisfaction with EMA reports [ , , , , , , , ]. However, 1 study [ ] reported that older drinkers were more compliant than the younger group, specifically in the evening survey than in the morning ones.
Few studies reported specific reasons for participant dropout or lack of compliance when assessing EMA use. Those studies that did report this information noted that the most common reasons for withdrawing from study participation were loss of contact, acute health problems, adverse personal events, and decreasing interest or inability to complete the protocol [, ]. Ramsey et al [ ] reported detailed information regarding nonadherence specifically in older adults. The common themes of nonadherence were classified as (1) a technical problem or user error; (2) logistical mismatch with competing demands in the participant’s daily life; (3) health-related barriers, such as sensory, cognitive, or functional impairment; and (4) discomfort involved with carrying the device or completing EMA.
There was some researcher support to assure feasibility. For example, a previous study developed a mobile app that could run on both Android and iOS, allowing each study participant to choose the operating system with which he or she was most comfortable . Because the app did not require an internet connection to record the score [ ], study participants could log EMA reports anytime and anywhere. Alarming using a beeping prompt is very helpful to remind study participants of timely reports [ , , , , , , , ]. Specifically considering older adult participants’ potential sensory impairments, Ravesloot et al [ ] provided additional assistance, such as a larger-format device or magnifiers for those with visual impairments and a stylus for those with dexterity problems.
This integrative review of the literature on EMA implementation in research provides some understanding of whether and how EMA may be feasibly applied with older adults when reporting daily depression or relevant conditions. Diverse conceptual and methodological issues should be considered when developing EMA protocols, and researchers should strive to establish rigorous validation procedures and clinical applications targeting older adults.
Heterogeneity in Study Design and Protocol
EMA protocols are more complicated and time consuming than traditional one-time surveys. The 38 studies reviewed used a great diversity of protocols, with little consistency in the methodologies. Some studies used new protocols developed by the researchers  or previously established ones from large-scale studies [ ]. Protocol content encompassed optimal frequency, duration, and interval of data collection, as well as the device employed to collect the data. Based on the technology acceptance model framework [ ], EMA systems should be very simple, reducing users’ cognitive errors and enhancing response accuracy. Thus, single items were most frequently used for EMA as longitudinally intensive designs because repeated use of multi-item scales may be impractical for a depressed sample [ ], specifically older adults. However, a single question has lower construct validity than multiple questions. Thus, researchers should make a careful decision when choosing fewer items from preexisting measures to assess geriatric depression.
To assure ecological validity, most studies adopted an individualized protocol, which increased the heterogeneity of the studies. EMA reporting time within a day should consider each individual’s lifestyle, preference, and convenience [, ] to minimize interrupting participants’ daily lives [ , ], such as sleep [ ]. It is important to collect information on participants’ current engagement in daily life activities, location, and social context or event when engaging in EMA [ , , , , , ]. This information could be used to differentiate normal patterns in a participant’s daily life versus abnormal data that occur in specific situations or environments [ ].
Diverse theories were used in the EMA studies identified in our review [, , , , , , ], such as the social support theoretical model [ ]; the Intraindividual Study of Affect, Health, and Interpersonal Behavior [ ]; the strength and vulnerability integration theory [ ]; the communal coping model [ ]; the social action theory [ ] and the dynamic model of relapse [ ]; and the cognitive appraisal theory [ ]; as well as a mix of hedonic motivation [ ] and operant conditioning [ ]. It is important to conceptualize complex psychosocial processes measured by multiple-time assessment and modeling. Any theory employed to underpin research in this area should be modified appropriately, focusing on psychological aspects of specific age groups to promote clinical practice emphasizing socioenvironmental factors. This theoretical effort may promote the context-sensitive development of appropriate study protocols, taking into account individual and population needs.
Issues With Definitions of Dropout and Adherence
Some degree of dropout and nonadherence occurred with wide variability. Common reasons for dropout or lack of adherence were associated with technical, logistical, physical, and cognitive problems, similar to issues reported in previous studies [, ], rather than with advanced age. Thus, the selected studies carefully screened participants who might be lacking in technological aptitude based on medical and functional conditions that could inhibit accurate EMA reporting rather than excluding participants based solely on advanced age [ , , , , , , , , , , , - ]. Some studies excluded individuals from participation when they had (1) severe cognitive impairment, such as dementia; (2) severe symptoms of cognitive or emotional disturbances; or (3) other psychiatric diagnoses (eg, schizophrenia or substance abuse) requiring intensive treatment and hospitalization. EMA studies with depressed older adults should be preceded by comprehensive assessment, including physical examination, cognitive and functional tests, and an intensive personal interview regarding health conditions. In addition, it is important to ensure ease, comfort, satisfaction, and accessibility when using an EMA device, app, or system [ ]. Familiarity may be increased by developing a user-friendly app’s features, visual layout, or system based on users’ experience [ ].
Variation in How Depressive Symptoms Were Measured With EMA Devices
EMA was applied to measure daily depressive mood using electronic devices such as smart devices, computerized handheld devices, or telephones. Most studies used an electronic diary format rather than personal direct interviewing , aligning with the dramatic development of information and communication technology in the field. Because EMA requires multiple self-reporting instances in daily life, electronic and smart devices may be more suitable for this type of research; they are portable and easy to use in a range of situations and at various times [ ].
However, device training should be provided to participants, particularly in light of diverse participant backgrounds and technological experience . Although none of the 38 selected studies reported details about the training procedure itself, the participants were instructed on how to respond to prompts regarding their psychological state of momentary mood [ , , , , - , - , - , - , , - ]. Researchers usually checked participants’ understanding of EMA report, functions of the device, or early compliance through daily review [ , , , , - , , ]. After that, some researchers provided the participants with a device practice opportunity under a researcher’s supervision [ , , ] or rental of the device [ , , , , , , , , , ]. Several studies provided a training guidebook [ , , , , ]. To apply EMA in practice, it is important that health care professionals learn how to use information and communication technology devices on their own, then teach the techniques to their patients or patients’ families to monitor older adults’ symptoms [ ].
Implications for Research and Practice
Based on our study findings, EMA could enhance health care professionals’ ability to detect changes in patient-reported emotions (eg, mindfulness, depression, and anxiety) in comparison with standard assessment instruments . However, more research should be conducted with older adult participants to confirm the technique’s suitability in this context. It may be difficult to generalize our review findings due to mixed samples of diverse age groups. However, the identified methodological challenges should be overcome by further studies in both clinical and community settings. Specifically, future research should investigate factors that influence adherence and complete use of EMA when this technique is used as a self-monitoring system reflecting clinical and ecological validation along with the value of technology.
Health care professionals should prepare themselves to use EMA by engaging in multimodal training prior to performing their role; moreover, they should deliver timely device training adapted to meet the needs of diverse study participants . Health care providers typically learn via hands-on experience based on a trial-and-error system or postprofessional certification programs [ ]. To enhance standardization and rigor, as well as to improve implementation, health care professionals should be made aware of the importance of EMA, as well as the methodological challenges of appropriately implementing EMA when dealing with geriatric depression. Our study findings could be fundamental to developing user-centered EMA strategies for older users.
This study had several limitations. First, we initially attempted to include only adults aged 65 years or older; however, only 1 study met this criterion . Thus, this integrative literature review included studies that accepted participants aged 18 years or older, including older adults. This limitation precluded our study findings to apply directly to older adults only. Our study findings may be appropriate for studies including both younger and older adults by using methodological approaches that specifically accommodate or are tailored to older adults. In the future, EMA research specifically targeting older adults needs to be conducted, and further analysis is required. Second, due to limited age-related information in the surveyed studies, we were unable to perform quantitative examinations to assess how proportions of older adults relate to adherence or dropout rates.
EMA is becoming an increasingly popular approach to assess depressive symptoms, and this technique has particular clinical value with older adults. This integrative literature review provides a distinctive understanding of the feasibility of employing EMA to investigate depressive mood among older adults. In the studies under review, EMA was used to examine the correlation between pattern of mood and other health outcomes and to investigate changes in this pattern caused by triggers in terms of effects on treatment and reported symptoms. Further research and guidelines for clinical practice should be developed in consideration of how to evaluate participants’ competence to complete EMA; how to prevent dropout, nonadherence, and data incompleteness; how to use valid measures of momentary depressive mood; how to standardize EMA protocols; and how to ensure sufficient sample sizes. Our study findings support the need to overcome these methodological challenges and facilitate future research demonstrating the clinical implications of EMA, and suggest the next step toward the successful development of ecological momentary interventions for older adults with depression.
This study was supported by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education (NRF-2016R1D1A1B03932013) and the Ministry of Science, ICT and Future Planning (NRF-2020R1C1C1012848). We appreciate the expert review from Dr Sang Eun Lee (Director, Health-IT Acceleration Platform Technology Innovation Center, Yonsei University Health System) and Hee-jae Kang (Director, BRFrame Inc, Seoul, Republic of Korea).
Conflicts of Interest
Search strategy overview.DOCX File , 15 KB
Characteristics of the 38 selected studies.DOCX File , 48 KB
Summary of the characteristics of ecological momentary assessment used in the 38 studies.DOCX File , 55 KB
Definitions and rates of dropout, adherence, and compliance used in the selected studies.DOCX File , 35 KB
- Vieira ER, Brown E, Raue P. Depression in older adults: screening and referral. J Geriatr Phys Ther 2014;37(1):24-30. [CrossRef] [Medline]
- Brown EL, Bruce ML, McAvay GJ, Raue PJ, Lachs MS, Nassisi P. Recognition of late-life depression in home care: accuracy of the outcome and assessment information set. J Am Geriatr Soc 2004 Jun;52(6):995-999. [CrossRef] [Medline]
- Shiffman S, Stone AA, Hufford MR. Ecological momentary assessment. Annu Rev Clin Psychol 2008 Apr;4:1-32. [CrossRef] [Medline]
- Stone AA, Shiffman S. Ecological momentary assessment (EMA) in behavioral medicine. Ann Behav Med 1994 Sep;16(3):199-202. [CrossRef]
- Hung S, Li MS, Chen YL, Chiang JH, Chen YY, Hung GC. Smartphone-based ecological momentary assessment for Chinese patients with depression: an exploratory study in Taiwan. Asian J Psychiatr 2016 Oct;23:131-136. [CrossRef] [Medline]
- Ravesloot C, Ward B, Hargrove T, Wong J, Livingston N, Torma L, et al. Why stay home? Temporal association of pain, fatigue and depression with being at home. Disabil Health J 2016 Apr;9(2):218-225. [CrossRef] [Medline]
- Vachon H, Bourbousson M, Deschamps T, Doron J, Bulteau S, Sauvaget A, et al. Repeated self-evaluations may involve familiarization: an exploratory study related to ecological momentary assessment designs in patients with major depressive disorder. Psychiatry Res 2016 Nov;245:99-104. [CrossRef] [Medline]
- Wenze SJ, Miller IW. Use of ecological momentary assessment in mood disorders research. Clin Psychol Rev 2010 Aug;30(6):794-804. [CrossRef] [Medline]
- Depp CA, Moore RC, Dev SI, Mausbach BT, Eyler LT, Granholm EL. The temporal course and clinical correlates of subjective impulsivity in bipolar disorder as revealed through ecological momentary assessment. J Affect Disord 2016 Mar;193:145-150 [FREE Full text] [CrossRef] [Medline]
- Eldahan AI, Pachankis JE, Jonathon Rendina H, Ventuneac A, Grov C, Parsons JT. Daily minority stress and affect among gay and bisexual men: a 30-day diary study. J Affect Disord 2016 Jan;190:828-835 [FREE Full text] [CrossRef] [Medline]
- Kim H, Lee S, Lee S, Hong S, Kang H, Kim N. Depression prediction by using ecological momentary assessment, Actiwatch data, and machine learning: observational study on older adults living alone. JMIR Mhealth Uhealth 2019 Oct;7(10):e14149 [FREE Full text] [CrossRef] [Medline]
- Moore RC, Depp CA, Wetherell JL, Lenze EJ. Ecological momentary assessment versus standard assessment instruments for measuring mindfulness, depressed mood, and anxiety among older adults. J Psychiatr Res 2016 Apr;75:116-123 [FREE Full text] [CrossRef] [Medline]
- Crowe E, Daly M, Delaney L, Carroll S, Malone KM. The intra-day dynamics of affect, self-esteem, tiredness, and suicidality in major depression. Psychiatry Res 2019 Sep;279:98-108. [CrossRef] [Medline]
- de Hoog N, Verboon P. Is the news making us unhappy? The influence of daily news exposure on emotional states. Br J Psychol 2019 Mar:1-17 [FREE Full text] [CrossRef] [Medline]
- Mogle J, Muñoz E, Hill NL, Smyth JM, Sliwinski MJ. Daily memory lapses in adults: characterization and influence on affect. J Gerontol B Psychol Sci Soc Sci 2019 Jan;74(1):59-68 [FREE Full text] [CrossRef] [Medline]
- Jamison RN, Mei A, Ross EL. Longitudinal trial of a smartphone pain application for chronic pain patients: predictors of compliance and satisfaction. J Telemed Telecare 2018 Feb;24(2):93-100. [CrossRef] [Medline]
- Lamers F, Swendsen J, Cui L, Husky M, Johns J, Zipunnikov V, et al. Mood reactivity and affective dynamics in mood and anxiety disorders. J Abnorm Psychol 2018 Oct;127(7):659-669. [CrossRef] [Medline]
- Neubauer AB, Smyth JM, Sliwinski MJ. When you see it coming: stressor anticipation modulates stress effects on negative affect. Emotion 2018 Apr;18(3):342-354. [CrossRef] [Medline]
- Elliston KG, Ferguson SG, Schüz N, Schüz B. Situational cues and momentary food environment predict everyday eating behavior in adults with overweight and obesity. Health Psychol 2017 Apr;36(4):337-345. [CrossRef] [Medline]
- Forman EM, Schumacher LM, Crosby R, Manasse SM, Goldstein SP, Butryn ML, et al. Ecological momentary assessment of dietary lapses across behavioral weight loss treatment: characteristics, predictors, and relationships with weight change. Ann Behav Med 2017 Oct;51(5):741-753. [CrossRef] [Medline]
- Liao Y, Solomon O, Dunton GF. Does the company of a dog influence affective response to exercise? Using ecological momentary assessment to study dog-accompanied physical activity. Am J Health Promot 2017 Sep;31(5):388-390. [CrossRef] [Medline]
- Maisto SA, Xie FC, Witkiewitz K, Ewart CK, Connors GJ, Zhu H, et al. How chronic self-regulatory stress, poor anger regulation, and momentary affect undermine treatment for alcohol use disorder: integrating social action theory with the dynamic model of relapse. J Soc Clin Psychol 2017 Mar;36(3):238-263. [CrossRef]
- Verhagen SJW, Berben JA, Leue C, Marsman A, Delespaul PAEG, van Os J, et al. Demonstrating the reliability of transdiagnostic mHealth Routine Outcome Monitoring in mental health services using experience sampling technology. PLoS One 2017 Oct;12(10):e0186294 [FREE Full text] [CrossRef] [Medline]
- Vasconcelos e Sa D, Wearden A, Hartley S, Emsley R, Barrowclough C. Expressed emotion and behaviourally controlling interactions in the daily life of dyads experiencing psychosis. Psychiatry Res 2016 Nov;245:406-413. [CrossRef] [Medline]
- Burns JW, Gerhart JI, Post KM, Smith DA, Porter LS, Schuster E, et al. The communal coping model of pain catastrophizing in daily life: a within-couples daily diary study. J Pain 2015 Nov;16(11):1163-1175 [FREE Full text] [CrossRef] [Medline]
- Dunton GF, Liao Y, Intille S, Huh J, Leventhal A. Momentary assessment of contextual influences on affective response during physical activity. Health Psychol 2015 Dec;34(12):1145-1153. [CrossRef] [Medline]
- Floridou GA, Müllensiefen D. Environmental and mental conditions predicting the experience of involuntary musical imagery: an experience sampling method study. Conscious Cogn 2015 May;33:472-486. [CrossRef] [Medline]
- Epler AJ, Tomko RL, Piasecki TM, Wood PK, Sher KJ, Shiffman S, et al. Does hangover influence the time to next drink? An investigation using ecological momentary assessment. Alcohol Clin Exp Res 2014 May;38(5):1461-1469 [FREE Full text] [CrossRef] [Medline]
- Mazure CM, Weinberger AH, Pittman B, Sibon I, Swendsen J. Gender and stress in predicting depressive symptoms following stroke. Cerebrovasc Dis 2014;38(4):240-246 [FREE Full text] [CrossRef] [Medline]
- Ram N, Conroy DE, Pincus AL, Lorek A, Rebar A, Roche MJ, et al. Examining the interplay of processes across multiple time-scales: illustration with the Intraindividual Study of Affect, Health, and Interpersonal Behavior (iSAHIB). Res Hum Dev 2014;11(2):142-160 [FREE Full text] [CrossRef] [Medline]
- Wolf LD, Davis MC. Loneliness, daily pain, and perceptions of interpersonal events in adults with fibromyalgia. Health Psychol 2014 Sep;33(9):929-937 [FREE Full text] [CrossRef] [Medline]
- Scott SB, Sliwinski MJ, Blanchard-Fields F. Age differences in emotional responses to daily stress: the role of timing, severity, and global perceived stress. Psychol Aging 2013 Dec;28(4):1076-1087 [FREE Full text] [CrossRef] [Medline]
- Piasecki TM, Jahng S, Wood PK, Robertson BM, Epler AJ, Cronk NJ, et al. The subjective effects of alcohol-tobacco co-use: an ecological momentary assessment investigation. J Abnorm Psychol 2011 Aug;120(3):557-571 [FREE Full text] [CrossRef] [Medline]
- Ramsey AT, Wetherell JL, Depp C, Dixon D, Lenze E. Feasibility and acceptability of smartphone assessment in older adults with cognitive and emotional difficulties. J Technol Hum Serv 2016;34(2):209-223 [FREE Full text] [CrossRef] [Medline]
- Rullier L, Atzeni T, Husky M, Bouisson J, Dartigues JF, Swendsen J, et al. Daily life functioning of community-dwelling elderly couples: an investigation of the feasibility and validity of ecological momentary assessment. Int J Methods Psychiatr Res 2014 Jun;23(2):208-216 [FREE Full text] [CrossRef] [Medline]
- Smith DM, Parmelee PA. Within-day variability of fatigue and pain among African Americans and non-Hispanic whites with osteoarthritis of the knee. Arthritis Care Res (Hoboken) 2016 Jan;68(1):115-122 [FREE Full text] [CrossRef] [Medline]
- Conn VS, Isaramalai SA, Rath S, Jantarakupt P, Wadhawan R, Dash Y. Beyond MEDLINE for literature searches. J Nurs Scholarsh 2003;35(2):177-182. [CrossRef] [Medline]
- Moher D, Liberati A, Tetzlaff J, Altman DG, PRISMA Group. Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement. PLoS Med 2009 Jul;6(7):e1000097 [FREE Full text] [CrossRef] [Medline]
- Hooker SA, Masters KS. Daily meaning salience and physical activity in previously inactive exercise initiates. Health Psychol 2018 Apr;37(4):344-354. [CrossRef] [Medline]
- Paolillo EW, Obermeit LC, Tang B, Depp CA, Vaida F, Moore DJ, et al. Smartphone-based ecological momentary assessment (EMA) of alcohol and cannabis use in older adults with and without HIV infection. Addict Behav 2018 Aug;83:102-108 [FREE Full text] [CrossRef] [Medline]
- Poulin MJ, Brown SL, Ubel PA, Smith DM, Jankovic A, Langa KM. Does a helping hand mean a heavy heart? Helping behavior and well-being among spouse caregivers. Psychol Aging 2010 Mar;25(1):108-117 [FREE Full text] [CrossRef] [Medline]
- Dunton GF, Atienza AA, Castro CM, King AC. Using ecological momentary assessment to examine antecedents and correlates of physical activity bouts in adults age 50+ years: a pilot study. Ann Behav Med 2009 Dec;38(3):249-255 [FREE Full text] [CrossRef] [Medline]
- Jamison RN, Mei A, Edwards RR, Ross EL. Efficacy of vibrating gloves for chronic hand pain due to osteoarthritis. Pain Med 2018 May;19(5):1044-1057. [CrossRef] [Medline]
- Paterson C, Jones M, Rattray J, Lauder W, Nabi G. What is the mechanism effect that links social support to coping and psychological outcome within individuals affected by prostate cancer? Real time data collection using mobile technology. Eur J Oncol Nurs 2016 Apr;21:126-133. [CrossRef] [Medline]
- Hachizuka M, Yoshiuchi K, Yamamoto Y, Iwase S, Nakagawa K, Kawagoe K, et al. Development of a personal digital assistant (PDA) system to collect symptom information from home hospice patients. J Palliat Med 2010 Jun;13(6):647-651. [CrossRef] [Medline]
- Kuerbis A, Treloar Padovano H, Shao S, Houser J, Muench FJ, Morgenstern J. Comparing daily drivers of problem drinking among older and younger adults: an electronic daily diary study using smartphones. Drug Alcohol Depend 2018 Feb;183:240-246 [FREE Full text] [CrossRef] [Medline]
- van Knippenberg RJM, de Vugt ME, Ponds RW, Myin-Germeys I, Verhey FRJ. An experience sampling method intervention for dementia caregivers: results of a randomized controlled trial. Am J Geriatr Psychiatry 2018 Dec;26(12):1231-1243. [CrossRef] [Medline]
- Droit-Volet S, Wearden JH. Experience sampling methodology reveals similarities in the experience of passage of time in young and elderly adults. Acta Psychol (Amst) 2015 Mar;156:77-82. [CrossRef] [Medline]
- Kööts L, Realo A, Allik J. The influence of the weather on affective experience: an experience sampling study. J Individ Differ 2011;32(2):74-84. [CrossRef]
- Sheehan DV, Lecrubier Y, Sheehan KH, Amorim P, Janavs J, Weiller E, et al. The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry 1998;59(Suppl 20):22-33;quiz 34-57. [Medline]
- Hamilton M. A rating scale for depression. J Neurol Neurosurg Psychiatry 1960 Feb;23(1):56-62 [FREE Full text] [CrossRef] [Medline]
- Beck AT, Steer RA, Brown GK. BDI-II, Beck Depression Inventory: Manual. 2nd edition. San Antonio, TX: Psychology Corporation; 1996.
- Beck AT, Ward CH, Mendelson M, Mock J, Erbaugh J. An inventory for measuring depression. Arch Gen Psychiatry 1961 Jun;4(6):561-571. [CrossRef] [Medline]
- Kroenke K, Spitzer RL. The PHQ-9: a new depression and diagnostic severity measure. Psychiatr Ann 2002 Sep;32(9):509-515. [CrossRef]
- World Health Organization. Composite International Diagnostic Interview (CIDI, version 2.1). Geneva, Switzerland: World Health Organization; 1997.
- Montgomery SA, Asberg M. A new depression scale designed to be sensitive to change. Br J Psychiatry 1979 Apr;134(4):382-389. [Medline]
- American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders, 4th Edition, Text Revision (DSM-IV-TR). Washington, DC: American Psychiatric Association Press; 2000.
- First MB, Spitzer RL, Gibbon M, Williams JBW. Structured Clinical Interview for DSM-IV Axis I Disorders (SCID-I). Washington, DC: American Psychiatric Publishing; 1997.
- First MB, Spitzer RL, Gibbon M, Williams JBW. Structured Clinical Interview for DSM-IV-TR Axis I Disorders, Research Version, Patient Edition with Psychotic Screen (SCID-I/P W/ PSY SCREEN). New York, NY: Biometrics Research Department, Columbia University; 2002.
- Gershon RC, Cella D, Fox NA, Havlik RJ, Hendrie HC, Wagster MV. Assessment of neurological and behavioural function: the NIH Toolbox. Lancet Neurol 2010 Mar;9(2):138-139. [CrossRef] [Medline]
- Radloff LS. The CES-D scale: a self-report depression scale for research in the general population. Appl Psychol Meas 1977 Jun;1(3):385-401. [CrossRef]
- Watson D, Clark LA, Tellegen A. Development and validation of brief measures of positive and negative affect: the PANAS scales. J Pers Soc Psychol 1988 Jun;54(6):1063-1070. [Medline]
- Kay SR, Fiszbein A, Opler LA. The Positive and Negative Syndrome Scale (PANSS) for schizophrenia. Schizophr Bull 1987;13(2):261-276 [FREE Full text] [Medline]
- Zigmond AS, Snaith RP. The Hospital Anxiety and Depression Scale. Acta Psychiatr Scand 1983 Jun;67(6):361-370. [Medline]
- Bjelland I, Dahl AA, Haug TT, Neckelmann D. The validity of the Hospital Anxiety and Depression Scale: an updated literature review. J Psychosom Res 2002 Feb;52(2):69-77. [CrossRef] [Medline]
- Reynolds WM, Kobak KA. Hamilton Depression Inventory: A Self-report Version of the Hamilton Depression Rating Scale (HDRS). Odessa, FL: Psychological Assessment Resources, Inc; 1995.
- Watson D, Clark LA. The PANAS-X: Manual for the Positive and Negative Affect Schedule-Expanded Form. Iowa City, IA: The University of Iowa; 1994.
- Larsen RJ, Diener E. Promises and problems with the circumplex model of emotion. In: Clark MS, editor. Review of Personality and Social Psychology, No. 13. Emotion. Thousand Oaks, CA: Sage Publications, Inc; 1992:25-59.
- Russell JA. A circumplex model of affect. J Pers Soc Psychol 1980;39(6):1161-1178. [CrossRef]
- Cella D, Yount S, Rothrock N, Gershon R, Cook K, Reeve B, PROMIS Cooperative Group. The Patient-Reported Outcomes Measurement Information System (PROMIS): progress of an NIH Roadmap cooperative group during its first two years. Med Care 2007 May;45(5 Suppl 1):S3-S11 [FREE Full text] [CrossRef] [Medline]
- Lawton MP, Parmelee PA, Katz IR, Nesselroade J. Affective states in normal and depressed older people. J Gerontol B Psychol Sci Soc Sci 1996 Nov;51(6):309-316. [CrossRef] [Medline]
- Eaton WW, Muntaner C, Smith C, Tien A, Ybarra M. Center for epidemiologic studies depression scale: review and revision (CESD and CESD-R). In: Maruish ME, editor. The Use of Psychological Testing for Treatment Planning and Outcomes Assessment. 3rd edition. Mahwah, NJ: Lawrence Erlbaum; 2004:363-377.
- Davis FD. Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Q 1989 Sep;13(3):319-340. [CrossRef]
- Ebner-Priemer UW, Trull TJ. Ecological momentary assessment of mood disorders and mood dysregulation. Psychol Assess 2009 Dec;21(4):463-475. [CrossRef] [Medline]
- Hershenberg R, Mavandadi S, Wright E, Thase ME. Anhedonia in the daily lives of depressed veterans: a pilot report on experiential avoidance as a moderator of emotional reactivity. J Affect Disord 2017 Jan;208:414-417. [CrossRef] [Medline]
- Fritz H, Tarraf W, Saleh DJ, Cutchin MP. Using a smartphone-based ecological momentary assessment protocol with community dwelling older African Americans. J Gerontol B Psychol Sci Soc Sci 2017 Sep;72(5):876-887 [FREE Full text] [CrossRef] [Medline]
- Kim H, Park E, Lee S, Kim M, Park EJ, Hong S. Self-management of chronic diseases among older Korean adults: an mHealth training, protocol, and feasibility study. JMIR Mhealth Uhealth 2018 Jun;6(6):e147 [FREE Full text] [CrossRef] [Medline]
- Smedley A. The importance of informatics competencies in nursing: an Australian perspective. Comput Inform Nurs 2005;23(2):106-110. [CrossRef] [Medline]
- Rutledge CM, Kott K, Schweickert PA, Poston R, Fowler C, Haney TS. Telehealth and eHealth in nurse practitioner training: current perspectives. Adv Med Educ Pract 2017;8:399-409 [FREE Full text] [CrossRef] [Medline]
- Papanagnou D, Sicks S, Hollander JE. Training the next generation of care providers: focus on telehealth. Healthc Transform 2015 Dec;1(1):52-63. [CrossRef]
|CES-D: Center for Epidemiologic Studies Depression Scale|
|DSM-IV: Diagnostic and Statistical Manual of Mental Disorders (Fourth Edition)|
|EMA: ecological momentary assessment|
|PANAS: Positive and Negative Affect Schedule|
|PHQ: Patient Health Questionnaire|
|PROMIS: Patient-Reported Outcomes Measurement Information System|
Edited by G Eysenbach; submitted 04.01.19; peer-reviewed by A Ramsey, F Lamers, E Hall, C Simons; comments to author 17.06.19; revised version received 31.01.20; accepted 31.03.20; published 02.06.20Copyright
©Heejung Kim, Sunah Kim, Seong Sook Kong, Yi-Rang Jeong, Hyein Kim, Namhee Kim. Originally published in JMIR Mental Health (http://mental.jmir.org), 02.06.2020.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Mental Health, is properly cited. The complete bibliographic information, a link to the original publication on http://mental.jmir.org/, as well as this copyright and license information must be included.