Use of Machine-Learning Algorithms Based on Text, Audio and Video Data in the Prediction of Anxiety and Post-Traumatic Stress in General and Clinical Populations: A Systematic Review

Research output: Journal contributionsScientific review articlesResearch

Authors

  • Marketa Ciharova
  • Khadicha Amarti
  • Ward van Breda
  • Xianhua Peng
  • Rosa Lorente-Català
  • Burkhardt Funk
  • Mark Hoogendoorn
  • Nikolaos Koutsouleris
  • Paolo Fusar-Poli
  • Eirini Karyotaki
  • Pim Cuijpers
  • Heleen Riper

Research in machine learning (ML) algorithms using natural behavior (i.e., text, audio, and video data) suggests that these techniques could contribute to personalization in psychology and psychiatry. However, a systematic review of the current state of the art is missing. Moreover, individual studies often target ML experts who may overlook potential clinical implications of their findings. In a narrative accessible to mental health professionals, we present a systematic review conducted in 5 psychology and 2 computer science databases. We included 128 studies that assessed the predictive power of ML algorithms using text, audio, and/or video data in the prediction of anxiety and posttraumatic stress disorder. Most studies (n = 87) were aimed at predicting anxiety, while the remainder (n = 41) focused on posttraumatic stress disorder. They were mostly published since 2019 in computer science journals and tested algorithms using text (n = 72) as opposed to audio or video. Studies focused mainly on general populations (n = 92) and less on laboratory experiments (n = 23) or clinical populations (n = 13). Methodological quality varied, as did reported metrics of the predictive power, hampering comparison across studies. Two-thirds of studies, which focused on both disorders, reported acceptable to very good predictive power (including high-quality studies only). The results of 33 studies were uninterpretable, mainly due to missing information. Research into ML algorithms using natural behavior is in its infancy but shows potential to contribute to diagnostics of mental disorders, such as anxiety and posttraumatic stress disorder, in the future if standardization of methods, reporting of results, and research in clinical populations are improved.

Original languageEnglish
JournalBiological Psychiatry
Volume96
Issue number7
Pages (from-to)519-531
Number of pages13
ISSN0006-3223
DOIs
Publication statusPublished - 01.10.2024

Bibliographical note

Publisher Copyright:
© 2024 Society of Biological Psychiatry

    Research areas

  • Informatics - Anxiety, Audio, Machine Learning, Posttraumatic stress, Text, Video

Recently viewed

Publications

  1. Holistic and scalable ranking of RDF data
  2. Towards a spatial understanding of identity play
  3. Global Finite-Time Stabilization of Planar Linear Systems With Actuator Saturation
  4. Noise level estimation and detection
  5. Interpreting Strings, Weaving Threads
  6. Robust Flatness Based Control of an Electromagnetic Linear Actuator Using Adaptive PID Controller
  7. Investigation and modeling of the material behavior due to evolving dislocation microstructures in fcc and bcc metals
  8. Understanding storytelling in the context of information systems
  9. Analyzing math teacher students' sensitivity for aspects of the complexity of problem oriented mathematics instruction
  10. Real-time RDF extraction from unstructured data streams
  11. “Ideation is Fine, but Execution is Key”
  12. Supporting the Development and Realization of Data-Driven Business Models with Enterprise Architecture Modeling and Management
  13. Considerations on efficient touch interfaces - How display size influences the performance in an applied pointing task
  14. A new way of assessing the interaction of a metallic phase precursor with a modified oxide support substrate as a source of information for predicting metal dispersion
  15. Computing regression statistics from grouped data
  16. Foundations and applications of computer based material flow networks for einvironmental management
  17. Mapping interest rate projections using neural networks under cointegration
  18. Partitioned beta diversity patterns of plants across sharp and distinct boundaries of quartz habitat islands
  19. Analysis of PI controllers with anti-windup techniques on level systems
  20. Using Fuzzy PD Controllers for Soft Motions in a Car-like Robot
  21. An expert-based reference list of variables for characterizing and monitoring social-ecological systems
  22. The fuzzy relationship of intelligence and problem solving in computer simulations
  23. Neural network-based estimation and compensation of friction for enhanced deep drawing process control
  24. Resolving the Complexity-Flexibility Dilemma in Multi-Issue Negotiations: Nested Bracketing as a Strategy to Enhance Negotiation Outcomes
  25. Changes of Perception
  26. Self-regulation in error management training: emotion control and metacognition as mediators of performance effects
  27. Resource extraction technologies - is a more responsible path of development possible?
  28. GENESIS - A generic RDF data access interface
  29. In-Vehicle Sensor System for Monitoring Efficiency of Vehicle E/E Architectures
  30. Semantic Evaluation Services for Web-Based Exercises
  31. Emergency detection based on probabilistic modeling in AAL-environments