Use of Machine-Learning Algorithms Based on Text, Audio and Video Data in the Prediction of Anxiety and Post-Traumatic Stress in General and Clinical Populations: A Systematic Review

Research output: Journal contributionsScientific review articlesResearch

Authors

  • Marketa Ciharova
  • Khadicha Amarti
  • Ward van Breda
  • Xianhua Peng
  • Rosa Lorente-Català
  • Burkhardt Funk
  • Mark Hoogendoorn
  • Nikolaos Koutsouleris
  • Paolo Fusar-Poli
  • Eirini Karyotaki
  • Pim Cuijpers
  • Heleen Riper

Research in machine learning (ML) algorithms using natural behavior (i.e., text, audio, and video data) suggests that these techniques could contribute to personalization in psychology and psychiatry. However, a systematic review of the current state of the art is missing. Moreover, individual studies often target ML experts who may overlook potential clinical implications of their findings. In a narrative accessible to mental health professionals, we present a systematic review conducted in 5 psychology and 2 computer science databases. We included 128 studies that assessed the predictive power of ML algorithms using text, audio, and/or video data in the prediction of anxiety and posttraumatic stress disorder. Most studies (n = 87) were aimed at predicting anxiety, while the remainder (n = 41) focused on posttraumatic stress disorder. They were mostly published since 2019 in computer science journals and tested algorithms using text (n = 72) as opposed to audio or video. Studies focused mainly on general populations (n = 92) and less on laboratory experiments (n = 23) or clinical populations (n = 13). Methodological quality varied, as did reported metrics of the predictive power, hampering comparison across studies. Two-thirds of studies, which focused on both disorders, reported acceptable to very good predictive power (including high-quality studies only). The results of 33 studies were uninterpretable, mainly due to missing information. Research into ML algorithms using natural behavior is in its infancy but shows potential to contribute to diagnostics of mental disorders, such as anxiety and posttraumatic stress disorder, in the future if standardization of methods, reporting of results, and research in clinical populations are improved.

Original languageEnglish
JournalBiological Psychiatry
Volume96
Issue number7
Pages (from-to)519-531
Number of pages13
ISSN0006-3223
DOIs
Publication statusPublished - 01.10.2024

Bibliographical note

Publisher Copyright:
© 2024 Society of Biological Psychiatry

    Research areas

  • Informatics - Anxiety, Audio, Machine Learning, Posttraumatic stress, Text, Video

Recently viewed

Publications

  1. Self-tuning of a kalman filter applied in a DC drive and in a kalman-based sensor
  2. A Proposal for Integrating Theories of Complexity for Better Understanding Global Systemic Risks
  3. Control Allocation and Controller Tuning for an Over-Actuated Hexacopter Tilt-Rotor Applied for Precision Agriculture
  4. Correlation of Microstructure and Local Mechanical Properties Along Build Direction for Multi-layer Friction Surfacing of Aluminum Alloys
  5. Visualizing the Hidden Activity of Artificial Neural Networks
  6. Language and Mathematics - Key Factors influencing the Comprehension Process in reality-based Tasks
  7. Model-based logistic controlling of converging material flows
  8. Geodesign as a boundary management process
  9. Employing a Novel Metaheuristic Algorithm to Optimize an LSTM Model
  10. Combining flatness based feedforward action with a fractional PI regulator to control the intake valve engine
  11. Mixed Pickels
  12. Sharing in Christ's rule
  13. Mathematics in Robot Control for Theoretical and Applied Problems
  14. The role of spatial ability in learning from instructional animations - Evidence for an ability-as-compensator hypothesis
  15. Value Orientations in the World of Visual Art: An Exploration Based on Latent Class and Correspondence Analysis
  16. From Open Access to Open Science
  17. Design optimization of spiral coils for textile applications by genetic algorithm
  18. Microstructure-based modeling of residual stresses in WC-12Co-sprayed coatings
  19. Homogenization methods for multi-phase elastic composites with non-elliptical reinforcements
  20. Metrics for Experimentation Programs: Categories, Benefits and Challenges
  21. Joint Item Response Models for Manual and Automatic Scores on Open-Ended Test Items