Use of Machine-Learning Algorithms Based on Text, Audio and Video Data in the Prediction of Anxiety and Post-Traumatic Stress in General and Clinical Populations: A Systematic Review

Research output: Journal contributionsScientific review articlesResearch

Authors

  • Marketa Ciharova
  • Khadicha Amarti
  • Ward van Breda
  • Xianhua Peng
  • Rosa Lorente-Català
  • Burkhardt Funk
  • Mark Hoogendoorn
  • Nikolaos Koutsouleris
  • Paolo Fusar-Poli
  • Eirini Karyotaki
  • Pim Cuijpers
  • Heleen Riper

Research in machine learning (ML) algorithms using natural behavior (i.e., text, audio, and video data) suggests that these techniques could contribute to personalization in psychology and psychiatry. However, a systematic review of the current state of the art is missing. Moreover, individual studies often target ML experts who may overlook potential clinical implications of their findings. In a narrative accessible to mental health professionals, we present a systematic review conducted in 5 psychology and 2 computer science databases. We included 128 studies that assessed the predictive power of ML algorithms using text, audio, and/or video data in the prediction of anxiety and posttraumatic stress disorder. Most studies (n = 87) were aimed at predicting anxiety, while the remainder (n = 41) focused on posttraumatic stress disorder. They were mostly published since 2019 in computer science journals and tested algorithms using text (n = 72) as opposed to audio or video. Studies focused mainly on general populations (n = 92) and less on laboratory experiments (n = 23) or clinical populations (n = 13). Methodological quality varied, as did reported metrics of the predictive power, hampering comparison across studies. Two-thirds of studies, which focused on both disorders, reported acceptable to very good predictive power (including high-quality studies only). The results of 33 studies were uninterpretable, mainly due to missing information. Research into ML algorithms using natural behavior is in its infancy but shows potential to contribute to diagnostics of mental disorders, such as anxiety and posttraumatic stress disorder, in the future if standardization of methods, reporting of results, and research in clinical populations are improved.

Original languageEnglish
JournalBiological Psychiatry
Volume96
Issue number7
Pages (from-to)519-531
Number of pages13
ISSN0006-3223
DOIs
Publication statusPublished - 01.10.2024

Bibliographical note

Publisher Copyright:
© 2024 Society of Biological Psychiatry

    Research areas

  • Informatics - Anxiety, Audio, Machine Learning, Posttraumatic stress, Text, Video

Recently viewed

Publications

  1. Scholarly Question Answering Using Large Language Models in the NFDI4DataScience Gateway
  2. Technological System and the Problem of Desymbolization
  3. The Influence of Note-taking on Mathematical Solution Processes while Working on Reality-Based Tasks
  4. Holistic and scalable ranking of RDF data
  5. Database on Learning for Sustainable Development – analysis of projects
  6. Taking notes as a strategy for solving reality-based tasks in mathematics
  7. Contextual movement models based on normalizing flows
  8. A guided simulated annealing search for solving the pick-up and delivery problem with time windows and capacity constraints
  9. The role of learners’ memory in app-based language instruction: the case of Duolingo.
  10. Creating regional (e-)learning networks
  11. Towards a spatial understanding of identity play
  12. A Lean Convolutional Neural Network for Vehicle Classification
  13. A reference architecture for the integration of EMIS and ERP-Systems
  14. Modeling of lateness distributions depending on the sequencing method with respect to productivity effects
  15. Effectiveness of a guided multicomponent internet and mobile gratitude training program - A pragmatic randomized controlled trial
  16. Multi-view discriminative sequential learning
  17. Sensor Fusion for Power Line Sensitive Monitoring and Load State Estimation
  18. Supporting the Development and Implementation of a Digitalization Strategy in SMEs through a Lightweight Architecture-based Method
  19. Web-scale extension of RDF knowledge bases from templated websites
  20. Clause identification using entropy guided transformation learning
  21. Experimentally established correlation of friction surfacing process temperature and deposit geometry
  22. Intellectual property issues in the use and distribution of remote sensing data
  23. Mathematical Modeling for Robot 3D Laser Scanning in Complete Darkness Environments to Advance Pipeline Inspection
  24. Interpreting Strings, Weaving Threads
  25. Constraints are the solution, not the problem
  26. Robust Flatness Based Control of an Electromagnetic Linear Actuator Using Adaptive PID Controller
  27. Segment Introduction
  28. Investigation and modeling of the material behavior due to evolving dislocation microstructures in fcc and bcc metals
  29. Improving short-term academic performance in the flipped classroom using dynamic geometry software
  30. Homogenization methods for multi-phase elastic composites with non-elliptical reinforcements
  31. From "cracking the orthographic code" to "playing with language"
  32. The signal location task as a method quantifying the distribution of attention
  33. Generating Energy Optimal Powertrain Force Trajectories with Dynamic Constraints