This paper is in the following e-collection/theme issue:

Theme Issue 2023 : Responsible Design, Integration, and Use of Generative AI in Mental Health (16) Chatbots and Conversational Agents (616) Generative Language Models Including ChatGPT (464) Intentional Self-Harm (111) Digital Mental Health Interventions, e-Mental Health and Cyberpsychology (1765) Depression and Mood Disorders; Suicide Prevention (1499)

Published on in Vol 10 (2023)

This is a member publication of Imperial College London (Jisc)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/51232, first published .
Suicide Risk Assessments Through the Eyes of ChatGPT-3.5 Versus ChatGPT-4: Vignette Study

Suicide Risk Assessments Through the Eyes of ChatGPT-3.5 Versus ChatGPT-4: Vignette Study

Suicide Risk Assessments Through the Eyes of ChatGPT-3.5 Versus ChatGPT-4: Vignette Study

Authors of this article:

Inbar Levkovich1 Author Orcid Image ;   Zohar Elyoseph2, 3 Author Orcid Image
Article Authors Cited by (49) Tweetations (6) Metrics

Journals

  1. Suárez A, Jiménez J, Llorente de Pedro M, Andreu-Vázquez C, Díaz-Flores García V, Gómez Sánchez M, Freire Y. Beyond the Scalpel: Assessing ChatGPT's potential as an auxiliary intelligent virtual assistant in oral surgery. Computational and Structural Biotechnology Journal 2024;24:46 View
  2. Elyoseph Z, Refoua E, Asraf K, Lvovsky M, Shimoni Y, Hadar-Shoval D. Capacity of Generative AI to Interpret Human Emotions From Visual and Textual Data: Pilot Evaluation Study. JMIR Mental Health 2024;11:e54369 View
  3. Sethi M, Kumar C, Math S. The Vanguard of Psychiatry: Artificial Intelligence as a Catalyst for Change. Journal of Psychiatry Spectrum 2024;3(1):1 View
  4. Rane N, Choudhary S, Rane J. Contribution of ChatGPT and Similar Generative Artificial Intelligence in Geotechnical Engineering and Soil Mechanics. SSRN Electronic Journal 2024 View
  5. Elyoseph Z, Levkovich I, Shinan-Altman S. Assessing prognosis in depression: comparing perspectives of AI models, mental health professionals and the general public. Family Medicine and Community Health 2024;12(Suppl 1):e002583 View
  6. Elyoseph Z, Hadar Shoval D, Levkovich I. Beyond Personhood: Ethical Paradigms in the Generative Artificial Intelligence Era. The American Journal of Bioethics 2024;24(1):57 View
  7. Sallam M, Barakat M, Sallam M. A Preliminary Checklist (METRICS) to Standardize the Design and Reporting of Studies on Generative Artificial Intelligence–Based Models in Health Care Education and Practice: Development Study Involving a Literature Review. Interactive Journal of Medical Research 2024;13:e54704 View
  8. Reis F, Lenz C. Performance of Artificial Intelligence (AI)-Powered Chatbots in the Assessment of Medical Case Reports: Qualitative Insights From Simulated Scenarios. Cureus 2024 View
  9. Elyoseph Z, Levkovich I. Comparing the Perspectives of Generative AI, Mental Health Experts, and the General Public on Schizophrenia Recovery: Case Vignette Study. JMIR Mental Health 2024;11:e53043 View
  10. Moise A, Centomo-Bozzo A, Orishchak O, Alnoury M, Daniel S. Can ChatGPT Replace an Otolaryngologist in Guiding Parents on Tonsillectomy?. Ear, Nose & Throat Journal 2024 View
  11. Hadar-Shoval D, Asraf K, Mizrachi Y, Haber Y, Elyoseph Z. Assessing the Alignment of Large Language Models With Human Values for Mental Health Integration: Cross-Sectional Study Using Schwartz’s Theory of Basic Values. JMIR Mental Health 2024;11:e55988 View
  12. Haber Y, Levkovich I, Hadar-Shoval D, Elyoseph Z. The Artificial Third: A Broad View of the Effects of Introducing Generative Artificial Intelligence on Psychotherapy. JMIR Mental Health 2024;11:e54781 View
  13. Shinan-Altman S, Elyoseph Z, Levkovich I. The impact of history of depression and access to weapons on suicide risk assessment: a comparison of ChatGPT-3.5 and ChatGPT-4. PeerJ 2024;12:e17468 View
  14. Bhugra D, Liebrenz M, Ventriglio A, Ng R, Javed A, Kar A, Chumakov E, Moura H, Tolentino E, Gupta S, Ruiz R, Okasha T, Chisolm M, Castaldelli-Maia J, Torales J, Smith A. World Psychiatric Association-Asian Journal of Psychiatry Commission on Public Mental Health. Asian Journal of Psychiatry 2024;98:104105 View
  15. Suwała S, Szulc P, Guzowski C, Kamińska B, Dorobiała J, Wojciechowska K, Berska M, Kubicka O, Kosturkiewicz O, Kosztulska B, Rajewska A, Junik R. ChatGPT-3.5 passes Poland’s medical final examination—Is it possible for ChatGPT to become a doctor in Poland?. SAGE Open Medicine 2024;12 View
  16. Omar M, Soffer S, Charney A, Landi I, Nadkarni G, Klang E. Applications of large language models in psychiatry: a systematic review. Frontiers in Psychiatry 2024;15 View
  17. Banerjee S, Dunn P, Conard S, Ali A. Mental Health Applications of Generative AI and Large Language Modeling in the United States. International Journal of Environmental Research and Public Health 2024;21(7):910 View
  18. Elyoseph Z, Gur T, Haber Y, Simon T, Angert T, Navon Y, Tal A, Asman O. An Ethical Perspective on the Democratization of Mental Health With Generative AI. JMIR Mental Health 2024;11:e58011 View
  19. Yilmaz Muluk S, Olcucu N. The Role of Artificial Intelligence in the Primary Prevention of Common Musculoskeletal Diseases. Cureus 2024 View
  20. Lian C, Yuan X, Chokkakula S, Wang G, Song B, Wang Z, Fan G, Yin C. Assessing the ChatGPT aptitude: A competent and effective Dermatology doctor?. Heliyon 2024;10(17):e37220 View
  21. Bedi S, Liu Y, Orr-Ewing L, Dash D, Koyejo S, Callahan A, Fries J, Wornow M, Swaminathan A, Lehmann L, Hong H, Kashyap M, Chaurasia A, Shah N, Singh K, Tazbaz T, Milstein A, Pfeffer M, Shah N. Testing and Evaluation of Health Care Applications of Large Language Models. JAMA 2025;333(4):319 View
  22. Guo Z, Lai A, Thygesen J, Farrington J, Keen T, Li K. Large Language Models for Mental Health Applications: Systematic Review. JMIR Mental Health 2024;11:e57400 View
  23. Zhang Z, Wang J. Can AI replace psychotherapists? Exploring the future of mental health care. Frontiers in Psychiatry 2024;15 View
  24. Levkovich I, Shinan-Altman S, Elyoseph Z. Can large language models be sensitive to culture suicide risk assessment?. Journal of Cultural Cognitive Science 2024;8(3):275 View
  25. Oliveira A, Bessa R, Teles A. Comparative analysis of BERT-based and generative large language models for detecting suicidal ideation: a performance evaluation study. Cadernos de Saúde Pública 2024;40(10) View
  26. Schnepper R, Roemmel N, Schaefert R, Lambrecht-Walzinger L, Meinlschmidt G. Exploring Biases of Large Language Models in the Field of Mental Health: Comparative Questionnaire Study of the Effect of Gender and Sexual Orientation in Anorexia Nervosa and Bulimia Nervosa Case Vignettes. JMIR Mental Health 2025;12:e57986 View
  27. Ho C, Tian T, Ayers A, Aaron R, Phillips V, Wolf R, Mathioudakis N, Dai T, Klonoff D. Qualitative metrics from the biomedical literature for evaluating large language models in clinical decision-making: a narrative review. BMC Medical Informatics and Decision Making 2024;24(1) View
  28. Yuan L, Huang S, Chou D, Tsai C. The In-depth Comparative Analysis of Four Large Language AI Models for Risk Assessment and Information Retrieval from Multi-Modality Prostate Cancer Work-up Reports. The World Journal of Men's Health 2024;42 View
  29. Holmes G, Tang B, Gupta S, Venkatesh S, Christensen H, Whitton A. Applications of Large Language Models in the Field of Suicide Prevention: Scoping Review. Journal of Medical Internet Research 2025;27:e63126 View
  30. Levkovich I, Rabin E, Brann M, Elyoseph Z. Large language models outperform general practitioners in identifying complex cases of childhood anxiety. DIGITAL HEALTH 2024;10 View
  31. Levkovich I, Omar M. Evaluating of BERT-based and Large Language Mod for Suicide Detection, Prevention, and Risk Assessment: A Systematic Review. Journal of Medical Systems 2024;48(1) View
  32. Hadar-Shoval D, Lvovsky M, Asraf K, Shimoni Y, Elyoseph Z. The Feasibility of Large Language Models in Verbal Comprehension Assessment: Mixed Methods Feasibility Study. JMIR Formative Research 2025;9:e68347 View
  33. Zhou Y, Yuan Y, Huang K, Hu X. Can ChatGPT Perform a Grounded Theory Approach to Do Risk Analysis? An Empirical Study. Journal of Management Information Systems 2024;41(4):982 View
  34. Van Meter A, Wheaton M, Cosgrove V, Andreadis K, Robertson R, Laroia G. The Goldilocks Zone: Finding the right balance of user and institutional risk for suicide-related generative AI queries. PLOS Digital Health 2025;4(1):e0000711 View
  35. Asman O, Torous J, Tal A. Responsible Design, Integration, and Use of Generative AI in Mental Health. JMIR Mental Health 2025;12:e70439 View
  36. Milasan L, Scott‐Purdy D. The Future of Artificial Intelligence in Mental Health Nursing Practice: An Integrative Review. International Journal of Mental Health Nursing 2025;34(1) View
  37. Haber Y, Hadar Shoval D, Levkovich I, Yinon D, Gigi K, Pen O, Angert T, Elyoseph Z. The externalization of internal experiences in psychotherapy through generative artificial intelligence: a theoretical, clinical, and ethical analysis. Frontiers in Digital Health 2025;7 View
  38. Huo B, Boyle A, Marfo N, Tangamornsuksan W, Steen J, McKechnie T, Lee Y, Mayol J, Antoniou S, Thirunavukarasu A, Sanger S, Ramji K, Guyatt G. Large Language Models for Chatbot Health Advice Studies. JAMA Network Open 2025;8(2):e2457879 View
  39. Garcia-Rudolph A, Sánchez-Pinsach D, Gilabert A, Saurí J, Soler M, Opisso E. Building Trust with AI: How Essential is Validating AI Models in the Therapeutic Triad of Therapist, Patient, and Artificial Third? Comment on What is the Current and Future Status of Digital Mental Health Interventions?. The Spanish Journal of Psychology 2025;28 View
  40. McBain R, Cantor J, Zhang L, Baker O, Zhang F, Halbisen A, Kofner A, Breslau J, Stein B, Mehrotra A, Yu H. Competency of Large Language Models in Evaluating Appropriate Responses to Suicidal Ideation: Comparative Study. Journal of Medical Internet Research 2025;27:e67891 View
  41. Chen B, Zheng W, Zhao L, Ding X. Leveraging large language models to assist philosophical counseling: prospective techniques, value, and challenges. Humanities and Social Sciences Communications 2025;12(1) View
  42. Jin Y, Liu J, Li P, Wang B, Yan Y, Zhang H, Ni C, Wang J, Li Y, Bu Y, Wang Y. The Applications of Large Language Models in Mental Health: A Scoping Review (Preprint). Journal of Medical Internet Research 2024 View
  43. Levkovich I, Rabin E, Farraj R, Elyoseph Z. Attributional patterns toward students with and without learning disabilities: Artificial intelligence models vs. trainee teachers. Research in Developmental Disabilities 2025;160:104970 View
  44. Bernstein E, Jaroszewski A, Jacoby R, Bailen N, Ragan J, Usmani A, Wilhelm S. Feasibility of Using ChatGPT to Generate Exposure Hierarchies for Treating Obsessive-Compulsive Disorder. Behavior Therapy 2025 View
  45. Lauderdale S, Schmitt R, Wuckovich B, Dalal N, Desai H, Tomlinson S. Effectiveness of generative AI-large language models’ recognition of veteran suicide risk: a comparison with human mental health providers using a risk stratification model. Frontiers in Psychiatry 2025;16 View
  46. Young A, Omosun F. A comparative analysis of CDC and AI-generated health information using computer-aided text analysis. Journal of Communication in Healthcare 2025:1 View
  47. Dolev-Cohen M, Henry N. Teachers vs. Chat GPT: identifying and naming acts of online sexual abuse. Information, Communication & Society 2025:1 View

Books/Policy Documents

  1. Xu M, Wang Y. Human Brain and Artificial Intelligence. View

Conference Proceedings

  1. Han G, Liu W, Huang X, Borsari B. 2024 IEEE 12th International Conference on Healthcare Informatics (ICHI). Chain-of-Interaction: Enhancing Large Language Models for Psychiatric Behavior Understanding by Dyadic Contexts View