Finding the Best Match — a Case Study on the (Text‑) Feature and Model Choice in Digital Mental Health Interventions

Publikation: Beiträge in ZeitschriftenZeitschriftenaufsätzeForschungbegutachtet

Authors

With the need for psychological help long exceeding the supply, finding ways of
scaling, and better allocating mental health support is a necessity. This paper contributes by investigating how to best predict intervention dropout and failure to allow for a need-based adaptation of treatment. We systematically compare the predictive power of different text representation methods (metadata, TF-IDF, sentiment and topic analysis, and word embeddings) in combination with supplementary numerical inputs (socio-demographic, evaluation, and closed-question data). Additionally, we address the research gap of which ML model types — ranging from linear to sophisticated deep learning models — are best suited for different features and outcome variables. To this end, we analyze nearly 16.000 open-text answers from 849 German-speaking users in a Digital Mental Health Intervention (DMHI) for stress. Our research proves that — contrary to previous findings — there is great promise in using neural network approaches on DMHI text data. We propose a task-specific LSTM-based model architecture to tackle the challenge of long input sequences and thereby demonstrate the potential of word embeddings (AUC scores of up to 0.7) for
predictions in DMHIs. Despite the relatively small data set, sequential deep learning models, on average, outperform simpler features such as metadata and bag-of-words approaches when predicting dropout. The conclusion is that user-generated text of the first two sessions carries predictive power regarding patients’ dropout and intervention failure risk. Furthermore, the match between the sophistication of features and models needs to be closely considered to optimize results, and additional nontext features increase prediction results.
OriginalspracheEnglisch
Aufsatznummer00148
ZeitschriftJournal of Healthcare Informatics Research
Jahrgang7
Ausgabenummer4
Seiten (von - bis)447-479
Anzahl der Seiten33
DOIs
PublikationsstatusErschienen - 12.2023

Bibliographische Notiz

Publisher Copyright:
© 2023, The Author(s).

DOI

Zuletzt angesehen

Publikationen

  1. Does Job Satisfaction Adapt to Working Conditions?
  2. “It is not the CO2 itself, it’s the imbalance!”
  3. Managing technology as a virtual enterprise
  4. Trusting as a 'Leap of Faith': Trust-Building Practices in Client-Consultant Relationships
  5. Approaching the other
  6. Monitoring of methotrexate chlorination in water
  7. Imagined Networks: Race, Digital Media and the University
  8. Acceleration as process
  9. The first observation of honeydew foraging in army ants since 1933
  10. To Row Together or Paddle One's Own Canoe? Simulating Strategies to Spur Digital Platform Growth
  11. 'Crawling Jurisdiction'
  12. Two high-mountain burnet moth species (Lepidoptera, Zygaenidae) react differently to the global change drivers climate and land-use
  13. Patterns of organizational (sub)culture and their influence on organizational effectiveness
  14. (Inhibiting) Factors for (Un)Sustainable Behaviour in Relation to the Effects of Education for Sustainable Development
  15. archiDART v3.0
  16. The relation of mindfulness and prosocial behavior
  17. Dimension theoretical properties of generalized Baker's transformations
  18. Circularity in green chemical products, processes and services
  19. Fat or lean
  20. Das Nordfenster
  21. Schreiben und Medien - Medienspezifische Schreibprozesse
  22. New incremental methods for springback compensation by stress superposition
  23. Der Mord am Weihnachtsmann
  24. Strategizing in NPOs
  25. Nomadische Treibhäuser
  26. Remote control of a soft walking robot
  27. Nach Bourdieu
  28. Umsteuern erforderlich
  29. With a little help from my website. Firm survial and web presence in times of COVID-19 - Evidence from 10 European Countries
  30. Nachhaltigkeitstrends im Management
  31. Effects of Mn and Zn solutes on grain refinement of commercial pure magnesium
  32. Stilfragen
  33. Selbst und Identität
  34. Inkorporationskunst
  35. Interpersonal Psychotherapy for Mental Health Problems
  36. Topophilie
  37. Patterns of organizational (sub)culture and their influence on organizational effectiveness
  38. Internet-Supported Sustainability Reporting
  39. Digital health literacy, online information-seeking behaviour, and satisfaction of Covid-19 information among the university students of East and South-East Asia
  40. Der Schleier der Pierrette
  41. Popular music in ex-Yugoslavia between global participation and provincial seclusion
  42. We seem to play the platonic tape backwards
  43. Klimaschutz: Auch ein Alleingang der EU ist richtig
  44. Medienästhetik
  45. Influence of Nd in extruded Mg10Gd base alloys on fatigue strength
  46. Fantasierealisierung, Theorie
  47. Kooperatives Lehren und Lernen

Presse / Medien

  1. Computersimulation