Published on 21.05.20 in Vol 7, No 5 (2020): May
Preprints (earlier versions) of this paper are available at http://preprints.jmir.org/preprint/15434, first published Jul 10, 2019.
Letter to the Editor
Author’s Reply to: Comment on “Web-Based Measure of Life Events Using Computerized Life Events and Assessment Record (CLEAR): Preliminary Cross-Sectional Study of Reliability, Validity, and Association With Depression”: Validity and Methodological Issues
JMIR Ment Health 2020;7(5):e15434
I thank the editors of JMIR Mental Health for the opportunity to respond to the Letter to the Editor  critiquing the methodology of the Computerised Online Life events Record (CLEAR) [ ] published in this journal. While appreciating the critique, it expands on only one of the validity findings, comparing CLEAR with a life event interview and checklist questionnaire. There are significant points not outlined in the letter [ ] and these are addressed here. Without questioning the additional statistical analyses provided by the sensitivity and specificity, the conclusion that this is unacceptable for a “diagnostic tool” is refuted. CLEAR is not a clinical diagnostic tool but owing to its high predictive validity with regard to depression and superiority to the checklist life events test (LTE-Q) [ ], it retains value as a method for identifying environmental stressors related to clinical models.
The ambition of the CLEAR measure design needs to be understood. It attempts to capture similar data to those established in the intensive, contextualized, face-to-face, semistructured Life Events and Difficulties Interview (LEDS)  by using very detailed, interactive, time-based online self-report material. This is both complex and novel. Such conversion of the interview has never previously been undertaken despite various attempts at further structuring the interview for computerization [ ]. The value of CLEAR lies in the large amount of event information and context generated, both quantitative and qualitative, and the preprogramming of data to produce both derived risk factors and partly analyzed data that are easily downloadable for analysis. CLEAR also provides a tailored feedback report for respondents. Besides identifying events, it can specify life event characteristics—not only their usual domain categorizations, but also their severity of threat/unpleasantness; focus of event; and characteristics such as loss, danger, and humiliation. It also identifies positivity of events and related characteristics (eg, relief, goal achievement). This is in addition to the timing of events and those stressors constituting longer-term problems. No checklist can provide such detailed data. Although interviews can provide such data, CLEAR provides very large savings in time and cost, expertise of investigators, and respondent convenience in large-scale data collection. Therefore, the balance of the reported lower sensitivity of the tool to interviews (ie, in missing some life events) needs to be considered in relation to the higher specificity with associated richness of event characteristics and the associated increased prediction of depression [ , ].
Further points in response to this paper are given below:
- The authors of the letter point out that the sensitivity of CLEAR is weaker than its specificity. This is due, in large part, to the different modes of administering the tools. The results show that an interview (with the investigator asking probing questions) elicits more life events than individuals identify online without such personalized probes, thus yielding lower sensitivity. Further qualitative investigation in the study showed that this was largely because a trained investigator identified more stages in a developing event crisis in the same category—the CLEAR tool tended to combine these into single events. However, all key crisis events were reflected in CLEAR when compared qualitatively with the interview. Therefore, high predictive validity for depression was retained. This limitation is more pronounced in a checklist approach where only one event per category applies, with no differentiation of phases in a developing crisis possible. The online CLEAR is superior to the checklist with better predictive validity.
- There was higher validity found in the group studied, which included midlife clinical and case control individuals and young adult students. Midlife individuals responded more accurately than the students in interview accounts. Because of the restricted numbers in the validation exercise, due to interview time taken, both age groups were combined. We believe young people rushed through the exercise more, and even when interviewed, had a more confused reporting style. We are examining ways of further structuring the measure to avoid this in younger age groups.
- CLEAR severe events significantly differentiate the matched depression and control groups as hypothesized [ ].
- The authors do not address predictive validity in their paper. CLEAR severe life events are significantly related to depression, indicating high predictive validity [ ]. Further investigation showed that this increased from any severe life events (odds ratio [OR]=3.59) to those involving humiliation (OR=6.38) or trauma (OR=5.83). In comparison, the LTE-Q checklist events in this study do not predict depression [ ].
However, we do take messages from the letter by Rahmani and colleagues  and are seeking to increase the validity of CLEAR as compared with the LEDS interview from the observations and qualitative aspects taken from the analyses. This involves providing more structured options on the menu of life events checked. We believe having an online tool such as CLEAR will enable wider investigation of life events and their role in depression for both research and clinical practice.
Conflicts of Interest
- Rahmani J, Karimi R, Mohtasham F, Sabour S. Comment on “Web-Based Measure of Life Events Using Computerized Life Events and Assessment Record (CLEAR): Preliminary Cross-Sectional Study of Reliability, Validity, and Association With Depression”: Validity and Methodological Issues. JMIR Mental Health 2020 May 21;7(5):e14505 Letter to the Editor. [CrossRef]
- Bifulco A, Spence R, Nunn S, Kagan L, Bailey-Rodriguez D, Hosang GM, et al. Web-Based Measure of Life Events Using Computerized Life Events and Assessment Record (CLEAR): Preliminary Cross-Sectional Study of Reliability, Validity, and Association With Depression. JMIR Mental Health 2019 Jan 08;6(1):e10675 [FREE Full text] [CrossRef] [Medline]
- Brugha TS, Cragg D. The List of Threatening Experiences: the reliability and validity of a brief life events questionnaire. Acta Psychiatr Scand 1990 Jul;82(1):77-81. [CrossRef] [Medline]
- Brown GW, Harris TO. Social Origins of Depression: A study of psychiatric disorder in women. London, New York: Tavistock; 1978.
- Wethington E. Life Events Scale. In: Fink G, editor. Encyclopedia of Stress (Vol. 2). San Diego, San Francisco, New York, Boston, London, Sydney, Toronto: Academic Press; 2000:618-622.
- Bifulco A, Kagan L, Spence R, Nunn S, Bailey-Rodriguez D, Hosang G, et al. Characteristics of severe life events, attachment style, and depression - Using a new online approach. Br J Clin Psychol 2019 Nov;58(4):427-439. [CrossRef] [Medline]
|CLEAR: Computerised Online Life events Record|
|LEDS: Life Events and Difficulties Interview|
|LTE-Q: checklist life events test|
Edited by J Torous; This is a non–peer-reviewed article. submitted 10.07.19; accepted 10.07.19; published 21.05.20
©Antonia Bifulco. Originally published in JMIR Mental Health (http://mental.jmir.org), 21.05.2020.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Mental Health, is properly cited. The complete bibliographic information, a link to the original publication on http://mental.jmir.org/, as well as this copyright and license information must be included.