Analyzing User Journey Data In Digital Health: Predicting Dropout From A Digital CBT-I Intervention

Research output: Journal contributionsConference abstract in journalResearchpeer-review

Authors

Intervention dropout is an important factor for the evaluation and implementation of digital therapeutics, including in insomnia. Large amounts of individualized data (logins, questionnaires, EMA data) in these interventions can combine to create user journeys - the data generated by the path an individual takes to navigate the digital therapeutic. User journeys can provide insight about how likely users are to drop out of an intervention on an individual level and lead to increased prediction performance. Thus, the goal of this study is to provide a step-by-step guide for the analysis of user journeys and utilize this guide to predict intervention dropout, illustrated with an example from a data in a RCT of digital therapeutic for chronic insomnia, for which outcomes have previously been published.
Methods
Analysis of user journeys includes data transformation, feature engineering, and statistical model analysis, using machine learning techniques. A framework is established to leverage user journeys to predict various behaviors. For this study, the framework was applied to predict dropouts of 151 participants from a fully automated web-based program (SHUTi) that delivered cognitive behavioral therapy for insomnia. For this task, support vector machines, logistic regression with regularization, and boosted decision trees were applied at different points in 9-week intervention. These techniques were evaluated based on their predictive performance.
Results
After model evaluation, a decision tree ensemble achieved AUC values ranging between 0.6-0.9 based on application of machine earning techniques. Various handcrafted and theory-driven features (e.g., time to complete certain intervention steps, time to get out of bed after arising, and days since last system interaction contributed to prediction performance.
Conclusion
Results indicate that utilizing a user journey framework and analysis can predict intervention dropout. Further, handcrafted theory-driven features can increase prediction performance. This prediction of dropout could lead to an enhanced clinical decision-making in digital therapeutics.
Support
The original study evaluating the efficacy of this intervention has been reported elsewhere and was funded by grant R01 MH86758 from the National Institute of Mental Health.
Original languageEnglish
Article number1204
JournalSleep
Volume43
Issue numberSupplement 1
Pages (from-to)A460
Number of pages1
ISSN0161-8105
DOIs
Publication statusPublished - 27.05.2020
EventAnnual Meeting of the Associated Professional Sleep Societies 2020 - VIRTUAL
Duration: 27.08.202030.08.2020
Conference number: 34
https://www.sleepmeeting.org/

Recently viewed

Researchers

  1. Marcus Erben

Publications

  1. Visualization of the Plasma Frequency by means of a Particle Simulation using a Normalized Periodic Model
  2. Comparison of Odor Thresholds obtained by a Three Alternative Choice Procedure and by the Method of Limits
  3. What can conservation strategies learn from the ecosystem services approach?
  4. Wavelet functions for rejecting spurious values
  5. Modelling and implementation of an Order2Cash Process in distributed systems
  6. AGDISTIS - Graph-based disambiguation of named entities using linked data
  7. Bayesian Parameter Estimation in Green Business Process Management
  8. Agency and structure in a sociotechnical transition
  9. Simulation based comparison of safety-stock calculation methods
  10. Combining linked data and statistical information retrieval
  11. Species composition and forest structure explain the temperature sensitivity patterns of productivity in temperate forests
  12. A simple nonlinear PD control for faster and high-precision positioning of servomechanisms with actuator saturation
  13. Geometric structures for the parameterization of non-interacting dynamics for multi-body mechanisms
  14. Enhancing EFL classroom instruction via the FeedBook: effects on language development and communicative language use.
  15. Predicting the Individual Mood Level based on Diary Data
  16. Applying the Three Horizons approach in local and regional scenarios to support policy coherence in SDG implementation
  17. An intersection test for the cointegrating rank in dependent panel data
  18. Modernizing persistence–bioaccumulation–toxicity (PBT) assessment with high throughput animal-free methods
  19. Learning from Erroneous Examples: When and How do Students Benefit from them?
  20. The Open Anchoring Quest Dataset: Anchored Estimates from 96 Studies on Anchoring Effects
  21. Use of design methods, team leaders' goal orientation, and team effectiveness: A follow-up study in software development projects
  22. The Relation of Children's Performances in Spatial Tasks at Two Different Scales of Space
  23. Language and Mathematics - Key Factors influencing the Comprehension Process in reality-based Tasks
  24. Fusion of knowledge bases for better navigation of wheeled mobile robotic group with 3D TVS
  25. Cognitive load in reading a foreign language text with multimedia aids and the influence of verbal and spatial abilities
  26. Predicate‐based model of problem‐solving for robotic actions planning
  27. Multidimensionality of tree communities structure host-parasitoid networks and their phylogenetic composition
  28. Towards a caring transdisciplinary research practice
  29. Self-perception of the internal audit function within the corporate governance system - Empirical evidence for the European Union
  30. Hedge Detection Using the RelHunter Approach
  31. Combining sense of place theory with the ecosystem services concept: empirical insights and reflections from a participatory mapping study
  32. Project and Design of a Catamaran Prototype with Aerial Propulsion System
  33. Experimental investigation of the fluid-structure interaction during deep drawing of fiber metal laminates in the in-situ hybridization process
  34. The Augmented Theorist - Toward Automated Knowledge Extraction from Conceptual Models
  35. How leaders’ diversity beliefs alter the impact of faultlines on team functioning
  36. Artistic dynamics across the Seas
  37. Differentiating Different Types of Cognitive Load
  38. Jackson networks in nonautonomous random environments
  39. Explaining Investment Dynamics: Empirical Evidence from German New Ventures
  40. Home range size and resource use of breeding and non-breeding white storks along a land use gradient
  41. Computational modelling of submicron-sized metallic glasses
  42. Trainingsqualität durch Trainingsquantität?
  43. Structure as Infrastructure: The Interrelation of Fiber and Construction