This paper is in the following e-collection/theme issue:

Theme Issue 2023 - 2024 : Responsible Design, Integration, and Use of Generative AI in Mental Health (16) Generative Language Models Including ChatGPT (521) Artificial Intelligence (1770) Chatbots and Conversational Agents (644)

Published on in Vol 11 (2024)

This is a member publication of Imperial College London (Jisc)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/54369, first published .
Capacity of Generative AI to Interpret Human Emotions From Visual and Textual Data: Pilot Evaluation Study

Capacity of Generative AI to Interpret Human Emotions From Visual and Textual Data: Pilot Evaluation Study

Capacity of Generative AI to Interpret Human Emotions From Visual and Textual Data: Pilot Evaluation Study

Authors of this article:

Zohar Elyoseph1, 2 Author Orcid Image ;   Elad Refoua3 Author Orcid Image ;   Kfir Asraf4 Author Orcid Image ;   Maya Lvovsky4 Author Orcid Image ;   Yoav Shimoni5 Author Orcid Image ;   Dorit Hadar-Shoval4 Author Orcid Image
Article Authors Cited by (49) Tweetations (3) Metrics

Journals

  1. Elyoseph Z, Levkovich I. Comparing the Perspectives of Generative AI, Mental Health Experts, and the General Public on Schizophrenia Recovery: Case Vignette Study. JMIR Mental Health 2024;11:e53043 View
  2. Hadar-Shoval D, Asraf K, Mizrachi Y, Haber Y, Elyoseph Z. Assessing the Alignment of Large Language Models With Human Values for Mental Health Integration: Cross-Sectional Study Using Schwartz’s Theory of Basic Values. JMIR Mental Health 2024;11:e55988 View
  3. Shinan-Altman S, Elyoseph Z, Levkovich I. The impact of history of depression and access to weapons on suicide risk assessment: a comparison of ChatGPT-3.5 and ChatGPT-4. PeerJ 2024;12:e17468 View
  4. Haber Y, Levkovich I, Hadar-Shoval D, Elyoseph Z. The Artificial Third: A Broad View of the Effects of Introducing Generative Artificial Intelligence on Psychotherapy. JMIR Mental Health 2024;11:e54781 View
  5. Elyoseph Z, Gur T, Haber Y, Simon T, Angert T, Navon Y, Tal A, Asman O. An Ethical Perspective on the Democratization of Mental Health With Generative AI. JMIR Mental Health 2024;11:e58011 View
  6. Javed D. ADVANCING HUMAN-COMPUTER INTERACTION: EXPLORING THE FRONTIERS OF ARTIFICIAL EMOTIONAL INTELLIGENCE IN INTERACTIVE SYSTEMS AND ITS IMPLICATIONS FOR SOCIETAL INTEGRATION. NUST Business Review 2024;6(1) View
  7. On Y, Kim T, Kim N. Psychotherapy Based on the Large Language Models: On the Aspect of the Theory of Mind, a Narrative Review. Journal of Korean Neuropsychiatric Association 2024;63(3):151 View
  8. Dana Z, Nagra H, Kilby K. Role of Synchronous, Moderated, and Anonymous Peer Support Chats on Reducing Momentary Loneliness in Older Adults: Retrospective Observational Study. JMIR Formative Research 2024;8:e59501 View
  9. Guo Z, Lai A, Thygesen J, Farrington J, Keen T, Li K. Large Language Models for Mental Health Applications: A Systematic Review (Preprint). JMIR Mental Health 2024 View
  10. Park C, Kim J. Exploring Affective Representations in Emotional Narratives: An Exploratory Study Comparing ChatGPT and Human Responses. Cyberpsychology, Behavior, and Social Networking 2024;27(10):736 View
  11. Artsi Y, Sorin V, Glicksberg B, Nadkarni G, Klang E. Advancing Clinical Practice: The Potential of Multimodal Technology in Modern Medicine. Journal of Clinical Medicine 2024;13(20):6246 View
  12. Marković M, Kato T. Pathological social withdrawal syndrome and the paradox of new technologies. Engrami 2024;(00):8 View
  13. Odiah A, Gosling S. Laying the foundations for using generative AI images in architectural research: do images convey the intended spaces and ambiances?. Architectural Intelligence 2024;3(1) View
  14. Hadar Souval D, Haber Y, Tal A, Simon T, Elyoseph T, Elyoseph Z. Transforming Perceptions: Exploring the Multifaceted Potential of Generative AI for People With Cognitive Disabilities. JMIR Neurotechnology 2025;4:e64182 View
  15. Kramer R. Face to face: Comparing ChatGPT with human performance on face matching. Perception 2025;54(1):65 View
  16. Chen D, Liu Y, Guo Y, Zhang Y. The revolution of generative artificial intelligence in psychology: The interweaving of behavior, consciousness, and ethics. Acta Psychologica 2024;251:104593 View
  17. Kolding S, Lundin R, Hansen L, Østergaard S. Use of generative artificial intelligence (AI) in psychiatry and mental health care: a systematic review. Acta Neuropsychiatrica 2025;37 View
  18. Nussbaum M, Bekerman Z. Advancing holistic educational goals through generative language-based technologies. Learning and Individual Differences 2025;117:102600 View
  19. Liu Y, Kauttonen J, Zhao B, Li X, Peng W. Editorial: Towards Emotion AI to next generation healthcare and education. Frontiers in Psychology 2024;15 View
  20. Selim R, Basu A, Anto A, Foscht T, Eisingerich A. Effects of Large Language Model–Based Offerings on the Well-Being of Students: Qualitative Study. JMIR Formative Research 2024;8:e64081 View
  21. Hadar-Shoval D, Lvovsky M, Asraf K, Shimoni Y, Elyoseph Z. The Feasibility of Large Language Models in Verbal Comprehension Assessment: Mixed Methods Feasibility Study. JMIR Formative Research 2025;9:e68347 View
  22. Asman O, Torous J, Tal A. Responsible Design, Integration, and Use of Generative AI in Mental Health. JMIR Mental Health 2025;12:e70439 View
  23. Wang P, Yin K, Zhang M, Zheng Y, Zhang T, Kang Y, Feng X. The effect of incorporating large language models into the teaching on critical thinking disposition: An “AI + Constructivism Learning Theory” attempt. Education and Information Technologies 2025 View
  24. Choudhury M, Elyoseph Z, Fast N, Ong D, Nsoesie E, Pavlick E. The promise and pitfalls of generative AI. Nature Reviews Psychology 2025;4(2):75 View
  25. Nagra H, Mines R, Dana Z. Exploring the Impact of Digital Peer Support Services on Meeting Unmet Needs Within an Employee Assistance Program: Retrospective Cohort Study. JMIR Human Factors 2025;12:e68221 View
  26. Saviano M, Thomas A, Del Prete M, Verderese D, Sasso P. The impact of new generative AI chatbots on the switch point (SP): toward an artificial emotional awareness (AEA). European Journal of Innovation Management 2025 View
  27. Maaz S, Palaganas J, Palaganas G, Bajwa M. A guide to prompt design: foundations and applications for healthcare simulationists. Frontiers in Medicine 2025;11 View
  28. Haber Y, Hadar Shoval D, Levkovich I, Yinon D, Gigi K, Pen O, Angert T, Elyoseph Z. The externalization of internal experiences in psychotherapy through generative artificial intelligence: a theoretical, clinical, and ethical analysis. Frontiers in Digital Health 2025;7 View
  29. Dong X, Xie J, Gong H. A Meta-Analysis of Artificial Intelligence Technologies Use and Loneliness: Examining the Influence of Physical Embodiment, Age Differences, and Effect Direction. Cyberpsychology, Behavior, and Social Networking 2025 View
  30. Guo M, Liu Z. Hysteria in empathy: Understanding virtual companionship and emotional connection between humans and Al. Theory & Psychology 2025;35(2):163 View
  31. Omar M, Sorin V, Agbareia R, Apakama D, Soroush A, Sakhuja A, Freeman R, Horowitz C, Richardson L, Nadkarni G, Klang E. Evaluating and addressing demographic disparities in medical large language models: a systematic review. International Journal for Equity in Health 2025;24(1) View
  32. Kramer R. Fusing ChatGPT and Human Decisions in Unfamiliar Face Matching. Applied Cognitive Psychology 2025;39(2) View
  33. Garcia-Rudolph A, Sánchez-Pinsach D, Gilabert A, Saurí J, Soler M, Opisso E. Building Trust with AI: How Essential is Validating AI Models in the Therapeutic Triad of Therapist, Patient, and Artificial Third? Comment on What is the Current and Future Status of Digital Mental Health Interventions?. The Spanish Journal of Psychology 2025;28 View
  34. Zhu Z, Wang Y, Qi Z, Hu W, Zhang X, Wagner S, Wang Y, Ran A, Ong J, Waisberg E, Masalkhi M, Suh A, Tham Y, Cheung C, Yang X, Yu H, Ge Z, Wang W, Sheng B, Liu Y, Lee A, Denniston A, Wijngaarden P, Keane P, Cheng C, He M, Wong T. Oculomics: Current concepts and evidence. Progress in Retinal and Eye Research 2025;106:101350 View
  35. Cheng C, Cao S, Tang G, Ma F, Cui D, Madhumitha S. A Study on the Integrated Application of Deep Learning and Semantic Analysis Techniques in Sentiment Interpretation of Medical Texts. Applied Mathematics and Nonlinear Sciences 2025;10(1) View
  36. Jin Y, Liu J, Li P, Wang B, Yan Y, Zhang H, Ni C, Wang J, Li Y, Bu Y, Wang Y. The Applications of Large Language Models in Mental Health: Scoping Review. Journal of Medical Internet Research 2025;27:e69284 View
  37. Levkovich I, Rabin E, Farraj R, Elyoseph Z. Attributional patterns toward students with and without learning disabilities: Artificial intelligence models vs. trainee teachers. Research in Developmental Disabilities 2025;160:104970 View
  38. Henriksen D, Creely E, Gruber N, Leahy S. Social-Emotional Learning and Generative AI: A Critical Literature Review and Framework for Teacher Education. Journal of Teacher Education 2025;76(3):312 View
  39. Kramer R. Comparing ChatGPT with human judgements of social traits from face photographs. Computers in Human Behavior: Artificial Humans 2025;4:100156 View
  40. McDaniel B, Coupe A, Weston A, Pater J. Emerging Ideas. A brief commentary on human–AI attachment and possible impacts on family dynamics. Family Relations 2025;74(3):1072 View
  41. Castrillón Isaza K, Giraldo Restrepo J, García Uribe J. Riesgos y oportunidades de la inteligencia artificial en el cuidado de enfermería: una revisión de alcance. Trilogía Ciencia Tecnología Sociedad 2025;17(35):e3272 View
  42. Kramer R. Identifying Basic Emotions and Action Units from Facial Photographs with ChatGPT. Journal of Nonverbal Behavior 2025;49(2):289 View
  43. Wang K, Mirosa M, Hou Y, Bremer P. Advancing food safety behavior with AI: Innovations and opportunities in the food manufacturing sector. Trends in Food Science & Technology 2025;161:105050 View
  44. Haider S, Prabha S, Gomez-Cabello C, Borna S, Genovese A, Trabilsy M, Elegbede A, Yang J, Galvao A, Tao C, Forte A. Facial Analysis for Plastic Surgery in the Era of Artificial Intelligence: A Comparative Evaluation of Multimodal Large Language Models. Journal of Clinical Medicine 2025;14(10):3484 View
  45. Gur T, Maaravi Y. The algorithm of friendship: literature review and integrative model of relationships between humans and artificial intelligence (AI). Behaviour & Information Technology 2025:1 View
  46. Refoua E, Elyoseph Z, Wacker R, Dziobek I, Tsafrir I, Meinlschmidt G. The next frontier in mindreading? Assessing generative artificial intelligence (GAI)'s social-cognitive capabilities using dynamic audiovisual stimuli. Computers in Human Behavior Reports 2025;19:100702 View
  47. Alrasheed H, Alghihab A, Pentland A, Alghowinem S, Carrasco-Farré C. Evaluating the capacity of large language models to interpret emotions in images. PLOS One 2025;20(6):e0324127 View

Books/Policy Documents

  1. Kaluarachchi B, Sedera D. Integrating AI-Driven Technologies Into Service Marketing. View
  2. Langer Y, Jamali M, Fischer M. Human-Computer Interaction. View