Use of Machine-Learning Algorithms Based on Text, Audio and Video Data in the Prediction of Anxiety and Post-Traumatic Stress in General and Clinical Populations: A Systematic Review

Research output: Journal contributionsScientific review articlesResearch

Authors

  • Marketa Ciharova
  • Khadicha Amarti
  • Ward van Breda
  • Xianhua Peng
  • Rosa Lorente-Català
  • Burkhardt Funk
  • Mark Hoogendoorn
  • Nikolaos Koutsouleris
  • Paolo Fusar-Poli
  • Eirini Karyotaki
  • Pim Cuijpers
  • Heleen Riper

Research in machine learning (ML) algorithms using natural behavior (i.e., text, audio, and video data) suggests that these techniques could contribute to personalization in psychology and psychiatry. However, a systematic review of the current state of the art is missing. Moreover, individual studies often target ML experts who may overlook potential clinical implications of their findings. In a narrative accessible to mental health professionals, we present a systematic review conducted in 5 psychology and 2 computer science databases. We included 128 studies that assessed the predictive power of ML algorithms using text, audio, and/or video data in the prediction of anxiety and posttraumatic stress disorder. Most studies (n = 87) were aimed at predicting anxiety, while the remainder (n = 41) focused on posttraumatic stress disorder. They were mostly published since 2019 in computer science journals and tested algorithms using text (n = 72) as opposed to audio or video. Studies focused mainly on general populations (n = 92) and less on laboratory experiments (n = 23) or clinical populations (n = 13). Methodological quality varied, as did reported metrics of the predictive power, hampering comparison across studies. Two-thirds of studies, which focused on both disorders, reported acceptable to very good predictive power (including high-quality studies only). The results of 33 studies were uninterpretable, mainly due to missing information. Research into ML algorithms using natural behavior is in its infancy but shows potential to contribute to diagnostics of mental disorders, such as anxiety and posttraumatic stress disorder, in the future if standardization of methods, reporting of results, and research in clinical populations are improved.

Original languageEnglish
JournalBiological Psychiatry
Volume96
Issue number7
Pages (from-to)519-531
Number of pages13
ISSN0006-3223
DOIs
Publication statusPublished - 01.10.2024

Bibliographical note

Publisher Copyright:
© 2024 Society of Biological Psychiatry

    Research areas

  • Informatics - Anxiety, Audio, Machine Learning, Posttraumatic stress, Text, Video

Recently viewed

Publications

  1. Comparison of different FEM codes approach for extrusion process analysis
  2. Towards a spatial understanding of identity play
  3. Global Finite-Time Stabilization of Planar Linear Systems With Actuator Saturation
  4. Effectiveness of a guided multicomponent internet and mobile gratitude training program - A pragmatic randomized controlled trial
  5. Sensor Fusion for Power Line Sensitive Monitoring and Load State Estimation
  6. Clause identification using entropy guided transformation learning
  7. Experimentally established correlation of friction surfacing process temperature and deposit geometry
  8. Constraints are the solution, not the problem
  9. Segment Introduction
  10. Understanding storytelling in the context of information systems
  11. The signal location task as a method quantifying the distribution of attention
  12. Universal Threshold Calculation for Fingerprinting Decoders using Mixture Models
  13. Real-time RDF extraction from unstructured data streams
  14. Age effects on controlling tools with sensorimotor transformations
  15. Supporting the Development and Realization of Data-Driven Business Models with Enterprise Architecture Modeling and Management
  16. Computing regression statistics from grouped data
  17. A localized boundary element method for the floating body problem
  18. On the Decoupling and Output Functional Controllability of Robotic Manipulation
  19. Analysis of PI controllers with anti-windup techniques on level systems
  20. Image compression based on periodic principal components
  21. TRY plant trait database – enhanced coverage and open access
  22. A Review of Latent Variable Modeling Using R - A Step-by-Step-Guide
  23. Knowledge-Enhanced Language Models Are Not Bias-Proof
  24. An Orthogonal Wavelet Denoising Algorithm for Surface Images of Atomic Force Microscopy
  25. Data-driven and physics-based modelling of process behaviour and deposit geometry for friction surfacing
  26. Teaching methods for modelling problems and students’ task-specific enjoyment, value, interest and self-efficacy expectations
  27. Self-regulation in error management training: emotion control and metacognition as mediators of performance effects
  28. Spaces for challenging experiences, indeterminacy, and experimentation
  29. Teachers’ use of data from digital learning platforms for instructional design
  30. Second language learners' performance in mathematics
  31. More input, better output
  32. How Much Home Office is Ideal? A Multi-Perspective Algorithm