Use of Machine-Learning Algorithms Based on Text, Audio and Video Data in the Prediction of Anxiety and Post-Traumatic Stress in General and Clinical Populations: A Systematic Review

Research output: Journal contributionsScientific review articlesResearch

Authors

  • Marketa Ciharova
  • Khadicha Amarti
  • Ward van Breda
  • Xianhua Peng
  • Rosa Lorente-Català
  • Burkhardt Funk
  • Mark Hoogendoorn
  • Nikolaos Koutsouleris
  • Paolo Fusar-Poli
  • Eirini Karyotaki
  • Pim Cuijpers
  • Heleen Riper

Research in machine learning (ML) algorithms using natural behavior (i.e., text, audio, and video data) suggests that these techniques could contribute to personalization in psychology and psychiatry. However, a systematic review of the current state of the art is missing. Moreover, individual studies often target ML experts who may overlook potential clinical implications of their findings. In a narrative accessible to mental health professionals, we present a systematic review conducted in 5 psychology and 2 computer science databases. We included 128 studies that assessed the predictive power of ML algorithms using text, audio, and/or video data in the prediction of anxiety and posttraumatic stress disorder. Most studies (n = 87) were aimed at predicting anxiety, while the remainder (n = 41) focused on posttraumatic stress disorder. They were mostly published since 2019 in computer science journals and tested algorithms using text (n = 72) as opposed to audio or video. Studies focused mainly on general populations (n = 92) and less on laboratory experiments (n = 23) or clinical populations (n = 13). Methodological quality varied, as did reported metrics of the predictive power, hampering comparison across studies. Two-thirds of studies, which focused on both disorders, reported acceptable to very good predictive power (including high-quality studies only). The results of 33 studies were uninterpretable, mainly due to missing information. Research into ML algorithms using natural behavior is in its infancy but shows potential to contribute to diagnostics of mental disorders, such as anxiety and posttraumatic stress disorder, in the future if standardization of methods, reporting of results, and research in clinical populations are improved.

Original languageEnglish
JournalBiological Psychiatry
Volume96
Issue number7
Pages (from-to)519-531
Number of pages13
ISSN0006-3223
DOIs
Publication statusPublished - 01.10.2024

Bibliographical note

Publisher Copyright:
© 2024 Society of Biological Psychiatry

    Research areas

  • Informatics - Anxiety, Audio, Machine Learning, Posttraumatic stress, Text, Video

Recently viewed

Projects

  1. XR2ESILIENCE

Activities

  1. It's how, not what we use that matters - Communications Modes in the Internet
  2. Uncertainty and Subjectivity in Provenance Linked Open Data
  3. Using the Multiple Streams Framework and the Multi-Level Perspective to Explain Policy Transformation: The Case of the German Energiewende
  4. Seed dispersal and predation: Interactions, ecosystem functions and services
  5. Continuous Innovation through Modular Upgradeability: How Software Upgrades Affect Consumer Product Valuations
  6. Swarming. Science Fact and Science Fiction of Distributed Intelligence
  7. Validation of school inspection frameworks and methods
  8. Spas in the New Länder: A Transformation with an Uncertain Outcome
  9. Is there a threshold effect of time headway on subjective variables for different velocities?
  10. The Impact of Explicit References in Computer Supported Collaborative Learning: Evidence from Eye Movement Analyses
  11. Alterations of a visual and how they work for and at the boundaries of an interorganizational team: A multimodal exploration
  12. Memory Acts: Memory without Representation.: Theoretical and Methodological Suggestions
  13. Self-tuning of a kalman filter applied in a DC drive and in a kalman-based sensor
  14. Language Policy and Language Learning: New Paradigms and New Challenges - LPLL 2009
  15. Dealing with temporal tensions in drug development processes
  16. Draw the line? How boundary creation behaviors at the end of work relate to recovery and next-day work performance
  17. Es geht um
  18. LC-MS identification of the photo-transformation products of desipramine with studying the effect of different environmental variables on the kinetics of their formation
  19. Modeling Grounding Processes in Chat-Based CSCL
  20. THE EUROPEAN CONFERENCE ON MACHINE LEARNING & PRINCIPLES AND PRACTICE OF KNOWLEDGE DISCOVERY IN DATABASES 2017
  21. Conference on Transdisciplinary Research and Modeling - 2013

Publications

  1. What would Colin say?
  2. Teachers’ use of data from digital learning platforms for instructional design
  3. How Much Home Office is Ideal? A Multi-Perspective Algorithm
  4. Dimension estimates for certain sets of infinite complex continued fractions
  5. Validation of an open source, remote web-based eye-tracking method (WebGazer) for research in early childhood
  6. Is too much help an obstacle? Effects of interactivity and cognitive style on learning with dynamic versus non-dynamic visualizations with narrative explanations
  7. Visualizing the Hidden Activity of Artificial Neural Networks
  8. Q-Adaptive Control of the nonlinear dynamics of the cantilever-sample system of an Atomic Force Microscope
  9. How, when and why do negotiators use reference points?
  10. An observer for sensorless variable valve control in camless internal combustion engines
  11. Using conditional inference trees and random forests to predict the bioaccumulation potential of organic chemicals
  12. Visualization of the Plasma Frequency by means of a Particle Simulation using a Normalized Periodic Model
  13. Assembly Modes of General Planar 3-RPR Parallel Mechanisms when Using the Linear Actuators’ Orientations
  14. Use of Machine-Learning Algorithms Based on Text, Audio and Video Data in the Prediction of Anxiety and Post-Traumatic Stress in General and Clinical Populations
  15. Hypertext
  16. Special Issue in Acquisitional Pragmatics in Foreign Language Learning
  17. Distributed robust Gaussian Process regression
  18. Assessment of cognitive load in multimedia learning using dual-task methodology
  19. Diffusion patterns in small vs. large capital markets-the case of value-based management
  20. A MODEL FOR QUANTIFICATION OF SOFTWARE COMPLEXITY
  21. Mathematical relation between extended connectivity and eigenvector coefficients.
  22. Artificial Intelligence in Foreign Language Learning and Teaching
  23. Assembly Theory for Restoring Ecosystem Structure and Functioning
  24. A tutorial introduction to adaptive fractal analysis
  25. Early Detection of Faillure in Conveyor Chain Systems by Wireless Sensor Node
  26. Temperature control in Peltier cells comparing sliding mode control and PID controllers