Analyzing User Journey Data In Digital Health: Predicting Dropout From A Digital CBT-I Intervention

Publikation: Beiträge in ZeitschriftenKonferenz-Abstracts in FachzeitschriftenForschungbegutachtet

Authors

Intervention dropout is an important factor for the evaluation and implementation of digital therapeutics, including in insomnia. Large amounts of individualized data (logins, questionnaires, EMA data) in these interventions can combine to create user journeys - the data generated by the path an individual takes to navigate the digital therapeutic. User journeys can provide insight about how likely users are to drop out of an intervention on an individual level and lead to increased prediction performance. Thus, the goal of this study is to provide a step-by-step guide for the analysis of user journeys and utilize this guide to predict intervention dropout, illustrated with an example from a data in a RCT of digital therapeutic for chronic insomnia, for which outcomes have previously been published.
Methods
Analysis of user journeys includes data transformation, feature engineering, and statistical model analysis, using machine learning techniques. A framework is established to leverage user journeys to predict various behaviors. For this study, the framework was applied to predict dropouts of 151 participants from a fully automated web-based program (SHUTi) that delivered cognitive behavioral therapy for insomnia. For this task, support vector machines, logistic regression with regularization, and boosted decision trees were applied at different points in 9-week intervention. These techniques were evaluated based on their predictive performance.
Results
After model evaluation, a decision tree ensemble achieved AUC values ranging between 0.6-0.9 based on application of machine earning techniques. Various handcrafted and theory-driven features (e.g., time to complete certain intervention steps, time to get out of bed after arising, and days since last system interaction contributed to prediction performance.
Conclusion
Results indicate that utilizing a user journey framework and analysis can predict intervention dropout. Further, handcrafted theory-driven features can increase prediction performance. This prediction of dropout could lead to an enhanced clinical decision-making in digital therapeutics.
Support
The original study evaluating the efficacy of this intervention has been reported elsewhere and was funded by grant R01 MH86758 from the National Institute of Mental Health.
OriginalspracheEnglisch
Aufsatznummer1204
ZeitschriftSleep
Jahrgang43
AusgabenummerSupplement 1
Seiten (von - bis)A460
Anzahl der Seiten1
ISSN0161-8105
DOIs
PublikationsstatusErschienen - 27.05.2020
VeranstaltungAnnual Meeting of the Associated Professional Sleep Societies 2020 - VIRTUAL
Dauer: 27.08.202030.08.2020
Konferenznummer: 34
https://www.sleepmeeting.org/

Bibliographische Notiz

Abstract supplement

DOI

Zuletzt angesehen

Aktivitäten

  1. Coherent sets in nonautonomous dynamics
  2. Acceptance and Feasibility of a mobile application for panic with and without agoraphobia
  3. Towards a Research Program in Design, Inovation and Aesthetics
  4. Coauthoring an interorganizational collaboration: Exploring multi-voicedness and introducing spatiotemporal orientations
  5. Workshop „Meta-Image Day 2012”
  6. Robots versus Machines
  7. An Evidence-based Approach to the Assessment of Public Participation in Environmental Governance: A conceptual and methodological overview of the ‘EDGE’ project
  8. Kunstuniversität Linz
  9. HyperKult XXI. 2012
  10. Dynamics Days Europe 2018
  11. Rudimentary theory of entrepreneurship
  12. How teachers use digital data: a systematic review
  13. 2nd International Conference on Mathematics and Computers in Science and Engineering - MACISE 2020
  14. Linking Teaching and Learning Formats with Student Development of Key Sustainability Competencies
  15. School Innovation through Knowledge Flows: Does Open Innovation Make the Difference?
  16. Do we need a new paradigm for mastering existing and future challenges of the urban water cycle
  17. Corporate Responsibility Evolution Models: Concepts, Evidence and Implications
  18. Ocean eddies and the polar vortex: coherence in complex systems
  19. Sym­po­si­um "Degrees of Freedom. Art Programs at Universities"
  20. Lodz University of Technology
  21. Art and Sustainability: Aesthetics of Complexity
  22. Conceptualising Animal Resistance: Questions and Approaches
  23. Workshop: Schreibtypengerecht Schreiben - 2018
  24. Journal of Pragmatics (Zeitschrift)
  25. Reciprocity and Democracy
  26. 20th Annual European Symposium on Algorithms - ESA 2012
  27. Where tasks, technology, and textbooks meet: Intelligent tutoring systems on the task-based language teacher's horizon (SLTED, Universität Wien)
  28. Peter Lang Verlag (Verlag)
  29. Greta Claire Gaard