Use of Machine-Learning Algorithms Based on Text, Audio and Video Data in the Prediction of Anxiety and Post-Traumatic Stress in General and Clinical Populations: A Systematic Review

Research output: Journal contributionsScientific review articlesResearch

Authors

  • Marketa Ciharova
  • Khadicha Amarti
  • Ward van Breda
  • Xianhua Peng
  • Rosa Lorente-Català
  • Burkhardt Funk
  • Mark Hoogendoorn
  • Nikolaos Koutsouleris
  • Paolo Fusar-Poli
  • Eirini Karyotaki
  • Pim Cuijpers
  • Heleen Riper

Research in machine learning (ML) algorithms using natural behavior (i.e., text, audio, and video data) suggests that these techniques could contribute to personalization in psychology and psychiatry. However, a systematic review of the current state of the art is missing. Moreover, individual studies often target ML experts who may overlook potential clinical implications of their findings. In a narrative accessible to mental health professionals, we present a systematic review conducted in 5 psychology and 2 computer science databases. We included 128 studies that assessed the predictive power of ML algorithms using text, audio, and/or video data in the prediction of anxiety and posttraumatic stress disorder. Most studies (n = 87) were aimed at predicting anxiety, while the remainder (n = 41) focused on posttraumatic stress disorder. They were mostly published since 2019 in computer science journals and tested algorithms using text (n = 72) as opposed to audio or video. Studies focused mainly on general populations (n = 92) and less on laboratory experiments (n = 23) or clinical populations (n = 13). Methodological quality varied, as did reported metrics of the predictive power, hampering comparison across studies. Two-thirds of studies, which focused on both disorders, reported acceptable to very good predictive power (including high-quality studies only). The results of 33 studies were uninterpretable, mainly due to missing information. Research into ML algorithms using natural behavior is in its infancy but shows potential to contribute to diagnostics of mental disorders, such as anxiety and posttraumatic stress disorder, in the future if standardization of methods, reporting of results, and research in clinical populations are improved.

Original languageEnglish
JournalBiological Psychiatry
Volume96
Issue number7
Pages (from-to)519-531
Number of pages13
ISSN0006-3223
DOIs
Publication statusPublished - 01.10.2024

Bibliographical note

Publisher Copyright:
© 2024 Society of Biological Psychiatry

    Research areas

  • Informatics - Anxiety, Audio, Machine Learning, Posttraumatic stress, Text, Video

Recently viewed

Publications

  1. How does Enterprise Architecture support the Design and Realization of Data-Driven Business Models?
  2. Scholarly Question Answering Using Large Language Models in the NFDI4DataScience Gateway
  3. The Influence of Note-taking on Mathematical Solution Processes while Working on Reality-Based Tasks
  4. Holistic and scalable ranking of RDF data
  5. Database on Learning for Sustainable Development – analysis of projects
  6. Taking notes as a strategy for solving reality-based tasks in mathematics
  7. The role of learners’ memory in app-based language instruction: the case of Duolingo.
  8. Creating regional (e-)learning networks
  9. Towards a spatial understanding of identity play
  10. A reference architecture for the integration of EMIS and ERP-Systems
  11. Effectiveness of a guided multicomponent internet and mobile gratitude training program - A pragmatic randomized controlled trial
  12. Multi-view discriminative sequential learning
  13. Supporting the Development and Implementation of a Digitalization Strategy in SMEs through a Lightweight Architecture-based Method
  14. Mathematical Modeling for Robot 3D Laser Scanning in Complete Darkness Environments to Advance Pipeline Inspection
  15. Constraints are the solution, not the problem
  16. Robust Flatness Based Control of an Electromagnetic Linear Actuator Using Adaptive PID Controller
  17. Investigation and modeling of the material behavior due to evolving dislocation microstructures in fcc and bcc metals
  18. Understanding storytelling in the context of information systems
  19. The signal location task as a method quantifying the distribution of attention
  20. Analyzing math teacher students' sensitivity for aspects of the complexity of problem oriented mathematics instruction
  21. FaST: A linear time stack trace alignment heuristic for crash report deduplication
  22. What does it mean to be sensitive for the complexity of (problem oriented) teaching?
  23. Improving students’ science text comprehension through metacognitive self-regulation when applying learning strategies
  24. “Ideation is Fine, but Execution is Key”
  25. Age effects on controlling tools with sensorimotor transformations
  26. Assessing Effects Through Semi-Field and Field Toxicity Testing
  27. A new way of assessing the interaction of a metallic phase precursor with a modified oxide support substrate as a source of information for predicting metal dispersion
  28. Computing regression statistics from grouped data
  29. An analytical approach to evaluating bivariate functions of fuzzy numbers with one local extremum
  30. Performance analysis for loss systems with many subscribers and concurrent services
  31. Explaining and controlling for the psychometric properties of computer-generated figural matrix items
  32. Scaffolding argumentation in mathematics with CSCL scripts
  33. A localized boundary element method for the floating body problem
  34. Robust feedback linearization control of a throttle plate by using an approximated pd regulator
  35. On the Decoupling and Output Functional Controllability of Robotic Manipulation