Analyzing User Journey Data In Digital Health: Predicting Dropout From A Digital CBT-I Intervention

Research output: Journal contributionsConference abstract in journalResearchpeer-review

Authors

Intervention dropout is an important factor for the evaluation and implementation of digital therapeutics, including in insomnia. Large amounts of individualized data (logins, questionnaires, EMA data) in these interventions can combine to create user journeys - the data generated by the path an individual takes to navigate the digital therapeutic. User journeys can provide insight about how likely users are to drop out of an intervention on an individual level and lead to increased prediction performance. Thus, the goal of this study is to provide a step-by-step guide for the analysis of user journeys and utilize this guide to predict intervention dropout, illustrated with an example from a data in a RCT of digital therapeutic for chronic insomnia, for which outcomes have previously been published.
Methods
Analysis of user journeys includes data transformation, feature engineering, and statistical model analysis, using machine learning techniques. A framework is established to leverage user journeys to predict various behaviors. For this study, the framework was applied to predict dropouts of 151 participants from a fully automated web-based program (SHUTi) that delivered cognitive behavioral therapy for insomnia. For this task, support vector machines, logistic regression with regularization, and boosted decision trees were applied at different points in 9-week intervention. These techniques were evaluated based on their predictive performance.
Results
After model evaluation, a decision tree ensemble achieved AUC values ranging between 0.6-0.9 based on application of machine earning techniques. Various handcrafted and theory-driven features (e.g., time to complete certain intervention steps, time to get out of bed after arising, and days since last system interaction contributed to prediction performance.
Conclusion
Results indicate that utilizing a user journey framework and analysis can predict intervention dropout. Further, handcrafted theory-driven features can increase prediction performance. This prediction of dropout could lead to an enhanced clinical decision-making in digital therapeutics.
Support
The original study evaluating the efficacy of this intervention has been reported elsewhere and was funded by grant R01 MH86758 from the National Institute of Mental Health.
Original languageEnglish
Article number1204
JournalSleep
Volume43
Issue numberSupplement 1
Pages (from-to)A460
Number of pages1
ISSN0161-8105
DOIs
Publication statusPublished - 27.05.2020
EventAnnual Meeting of the Associated Professional Sleep Societies 2020 - VIRTUAL
Duration: 27.08.202030.08.2020
Conference number: 34
https://www.sleepmeeting.org/

Recently viewed

Researchers

  1. Franziska Stallmann

Publications

  1. Comparing the Sensitivity of Social Networks, Web Graphs, and Random Graphs with Respect to Vertex Removal
  2. Enhancing the Building Information Modeling Lifecycle of Complex Structures with IoT
  3. Other spaces
  4. Creep behavior of AE42 based hybrid composites
  5. ASSESS — automatic self-assessment using linked data
  6. Nonlinear anisotropic boundary value problems – regularity results and multiscale discretizations
  7. Temporal Dynamics of Ecosystem Services
  8. Study of fuzzy controllers performance
  9. Computational modelling of submicron-sized metallic glasses
  10. Grounds different from, though equally solid with
  11. Intraindividual variability in identity centrality
  12. The Automated will
  13. Elevated Temperature and Varied Load Response of AS41 at Bolted Joint
  14. From teacher-centered instruction to peer tutoring in the heterogeneous international classroom
  15. Predator diversity and abundance provide little support for the enemies hypothesis in forests of high tree diversity
  16. An Experimental Approach to the Optimization of Customer Information at the Point of Sale
  17. Harnessing place attachment for local climate mitigation?
  18. Consumers' Responses to CSR Activities
  19. Das relationale Apriori Wiens / Das städtische Apriori des Relationalismus
  20. Study of non-linear systems
  21. Introduction to the basics of life cycle sustainability assessment focusing on the UNEP/SETAC Life Cycle Initiative LCSA framework
  22. Video Game Microtransactions & Loot Boxes - An Empirical Study on the Effectiveness of Social Responsibility Measures
  23. Was gibt´s heute?
  24. Local Responses to Global Integration in a Transnational Professional Service Firm
  25. Going beyond efficiency: including altruistic motives in behavioral models for sustainability transitions to address sufficiency.
  26. Ontology-Guided, Hybrid Prompt Learning for Generalization in Knowledge Graph Question Answering
  27. Geometrical Characterization of Polyethylene Oxide Nanofibers by Atom Force Microscope and Confocal Laser Scanning Microscope
  28. Effects of Y Additions on the Microstructures and Mechanical Behaviours of as Cast Mg–xY–0.5Zr Alloys
  29. Modelling and simulation of dynamic microstructure evolution of aluminium alloys during thermomechanically coupled extrusion process
  30. Local levers for change
  31. Schrogl, Kai-Uwe (et. al.), Handbook of Space Security - Policies, Applications and Programs, Springer, 2015
  32. Diversity of Play
  33. Governance approaches to address scale issues in biodiversity management – current situation and ways forward
  34. Knowledge on global environmental change within social praxis: what do we know?
  35. Environmental Shareholder Value Matrix
  36. Fostering inclusive teaching competences
  37. Inductance Estimation Using an EKF for the Robust Control of PMSMs in the Presence of Saturation
  38. Identitäre Zweigeschlechtlichkeit
  39. Taking Responsibility for Others and Use of Mental Contrasting
  40. Where Are the Organizations? Accounting for the Fluidity and Ambiguity of Organizing in the Arts
  41. Fallstudie
  42. Correction: Bats in a farming landscape benefit from linear remnants and unimproved pastures
  43. Extensive margins of imports in the great import recovery in Germany, 2009/2010