A Framework for Applying Natural Language Processing in Digital Health Interventions

Research output: Journal contributionsJournal articlesResearchpeer-review

Standard

A Framework for Applying Natural Language Processing in Digital Health Interventions. / Funk, Burkhardt; Sadeh-Sharvit, Shiri ; Fitzsimmons-Craft, Ellen E. et al.

In: Journal of Medical Internet Research, Vol. 22, No. 2, e13855, 19.02.2020.

Research output: Journal contributionsJournal articlesResearchpeer-review

Harvard

Funk, B, Sadeh-Sharvit, S, Fitzsimmons-Craft, EE, Trockel, MT, Monterubio, GE, Goel , NJ, Balantekin, KN, Eichen, DM, Flatt, RE, Firebaugh, M-L, Jacobi, C, Graham, AK, Hoogendoorn, M, Wilfley, DE & Taylor, CB 2020, 'A Framework for Applying Natural Language Processing in Digital Health Interventions', Journal of Medical Internet Research, vol. 22, no. 2, e13855. https://doi.org/10.2196/13855

APA

Funk, B., Sadeh-Sharvit, S., Fitzsimmons-Craft, E. E., Trockel, M. T., Monterubio, G. E., Goel , N. J., Balantekin, K. N., Eichen, D. M., Flatt, R. E., Firebaugh, M-L., Jacobi, C., Graham, A. K., Hoogendoorn, M., Wilfley, D. E., & Taylor, C. B. (2020). A Framework for Applying Natural Language Processing in Digital Health Interventions. Journal of Medical Internet Research, 22(2), [e13855]. https://doi.org/10.2196/13855

Vancouver

Funk B, Sadeh-Sharvit S, Fitzsimmons-Craft EE, Trockel MT, Monterubio GE, Goel NJ et al. A Framework for Applying Natural Language Processing in Digital Health Interventions. Journal of Medical Internet Research. 2020 Feb 19;22(2):e13855. doi: 10.2196/13855

Bibtex

@article{ed4a41d64c434c2c9d30ed2fa0e39442,
title = "A Framework for Applying Natural Language Processing in Digital Health Interventions",
abstract = "Background: Digital health interventions (DHIs) are poised to reduce target symptoms in a scalable, affordable, and empirically supported way. DHIs that involve coaching or clinical support often collect text data from 2 sources: (1) open correspondence between users and the trained practitioners supporting them through a messaging system and (2) text data recorded during the intervention by users, such as diary entries. Natural language processing (NLP) offers methods for analyzing text, augmenting the understanding of intervention effects, and informing therapeutic decision making.Objective: This study aimed to present a technical framework that supports the automated analysis of both types of text data often present in DHIs. This framework generates text features and helps to build statistical models to predict target variables, including user engagement, symptom change, and therapeutic outcomes.Methods: We first discussed various NLP techniques and demonstrated how they are implemented in the presented framework. We then applied the framework in a case study of the Healthy Body Image Program, a Web-based intervention trial for eating disorders (EDs). A total of 372 participants who screened positive for an ED received a DHI aimed at reducing ED psychopathology (including binge eating and purging behaviors) and improving body image. These users generated 37,228 intervention text snippets and exchanged 4285 user-coach messages, which were analyzed using the proposed model.Results: We applied the framework to predict binge eating behavior, resulting in an area under the curve between 0.57 (when applied to new users) and 0.72 (when applied to new symptom reports of known users). In addition, initial evidence indicated that specific text features predicted the therapeutic outcome of reducing ED symptoms.Conclusions: The case study demonstrates the usefulness of a structured approach to text data analytics. NLP techniques improve the prediction of symptom changes in DHIs. We present a technical framework that can be easily applied in other clinical trials and clinical presentations and encourage other groups to apply the framework in similar contexts.",
keywords = "Business informatics, Digital Health Interventions Text Analytics (DHITA), digital health interventions, eating disorders, guided self-help, natural language processing, text mining, Digital Health Interventions Text Analytics (DHITA), Text mining, Digital health interventions, Eating disorders, Guided self-help, Natural language processing",
author = "Burkhardt Funk and Shiri Sadeh-Sharvit and Fitzsimmons-Craft, {Ellen E.} and Trockel, {Mickey Todd} and Monterubio, {Grace E} and Goel, {Neha J} and Balantekin, {Katherine N} and Eichen, {Dawn M} and Flatt, {Rachael E} and Marie-Laure Firebaugh and Corinna Jacobi and Graham, {Andrea K.} and Mark Hoogendoorn and Wilfley, {Denise E} and Taylor, {C Barr}",
note = "Funding Information: This research was supported by R01 MH100455, T32 HL007456, T32 HL130357, K08 MH120341, K01 DK116925, K23 DK114480, and F32 HD089586 from the National Institutes of Health. The authors sincerely thank the participating universities and students; intervention coaches; and their technology partner, Lantern, for their support, without whom this work would not have been possible. Stanford, Washington University, and DW received royalties from Lantern for the use of the SBED program but did not have any equity in the company. Publisher Copyright: {\textcopyright} Burkhardt Funk, Shiri Sadeh-Sharvit, Ellen E Fitzsimmons-Craft, Mickey Todd Trockel, Grace E Monterubio, Neha J Goel, Katherine N Balantekin, Dawn M Eichen, Rachael E Flatt, Marie-Laure Firebaugh, Corinna Jacobi, Andrea K Graham, Mark Hoogendoorn, Denise E Wilfley, C Barr Taylor. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 19.02.2020. This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.",
year = "2020",
month = feb,
day = "19",
doi = "10.2196/13855",
language = "English",
volume = "22",
journal = "Journal of Medical Internet Research",
issn = "1439-4456",
publisher = "JMIR Publications",
number = "2",

}

RIS

TY - JOUR

T1 - A Framework for Applying Natural Language Processing in Digital Health Interventions

AU - Funk, Burkhardt

AU - Sadeh-Sharvit, Shiri

AU - Fitzsimmons-Craft, Ellen E.

AU - Trockel, Mickey Todd

AU - Monterubio, Grace E

AU - Goel , Neha J

AU - Balantekin, Katherine N

AU - Eichen, Dawn M

AU - Flatt, Rachael E

AU - Firebaugh, Marie-Laure

AU - Jacobi, Corinna

AU - Graham, Andrea K.

AU - Hoogendoorn, Mark

AU - Wilfley, Denise E

AU - Taylor, C Barr

N1 - Funding Information: This research was supported by R01 MH100455, T32 HL007456, T32 HL130357, K08 MH120341, K01 DK116925, K23 DK114480, and F32 HD089586 from the National Institutes of Health. The authors sincerely thank the participating universities and students; intervention coaches; and their technology partner, Lantern, for their support, without whom this work would not have been possible. Stanford, Washington University, and DW received royalties from Lantern for the use of the SBED program but did not have any equity in the company. Publisher Copyright: © Burkhardt Funk, Shiri Sadeh-Sharvit, Ellen E Fitzsimmons-Craft, Mickey Todd Trockel, Grace E Monterubio, Neha J Goel, Katherine N Balantekin, Dawn M Eichen, Rachael E Flatt, Marie-Laure Firebaugh, Corinna Jacobi, Andrea K Graham, Mark Hoogendoorn, Denise E Wilfley, C Barr Taylor. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 19.02.2020. This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.

PY - 2020/2/19

Y1 - 2020/2/19

N2 - Background: Digital health interventions (DHIs) are poised to reduce target symptoms in a scalable, affordable, and empirically supported way. DHIs that involve coaching or clinical support often collect text data from 2 sources: (1) open correspondence between users and the trained practitioners supporting them through a messaging system and (2) text data recorded during the intervention by users, such as diary entries. Natural language processing (NLP) offers methods for analyzing text, augmenting the understanding of intervention effects, and informing therapeutic decision making.Objective: This study aimed to present a technical framework that supports the automated analysis of both types of text data often present in DHIs. This framework generates text features and helps to build statistical models to predict target variables, including user engagement, symptom change, and therapeutic outcomes.Methods: We first discussed various NLP techniques and demonstrated how they are implemented in the presented framework. We then applied the framework in a case study of the Healthy Body Image Program, a Web-based intervention trial for eating disorders (EDs). A total of 372 participants who screened positive for an ED received a DHI aimed at reducing ED psychopathology (including binge eating and purging behaviors) and improving body image. These users generated 37,228 intervention text snippets and exchanged 4285 user-coach messages, which were analyzed using the proposed model.Results: We applied the framework to predict binge eating behavior, resulting in an area under the curve between 0.57 (when applied to new users) and 0.72 (when applied to new symptom reports of known users). In addition, initial evidence indicated that specific text features predicted the therapeutic outcome of reducing ED symptoms.Conclusions: The case study demonstrates the usefulness of a structured approach to text data analytics. NLP techniques improve the prediction of symptom changes in DHIs. We present a technical framework that can be easily applied in other clinical trials and clinical presentations and encourage other groups to apply the framework in similar contexts.

AB - Background: Digital health interventions (DHIs) are poised to reduce target symptoms in a scalable, affordable, and empirically supported way. DHIs that involve coaching or clinical support often collect text data from 2 sources: (1) open correspondence between users and the trained practitioners supporting them through a messaging system and (2) text data recorded during the intervention by users, such as diary entries. Natural language processing (NLP) offers methods for analyzing text, augmenting the understanding of intervention effects, and informing therapeutic decision making.Objective: This study aimed to present a technical framework that supports the automated analysis of both types of text data often present in DHIs. This framework generates text features and helps to build statistical models to predict target variables, including user engagement, symptom change, and therapeutic outcomes.Methods: We first discussed various NLP techniques and demonstrated how they are implemented in the presented framework. We then applied the framework in a case study of the Healthy Body Image Program, a Web-based intervention trial for eating disorders (EDs). A total of 372 participants who screened positive for an ED received a DHI aimed at reducing ED psychopathology (including binge eating and purging behaviors) and improving body image. These users generated 37,228 intervention text snippets and exchanged 4285 user-coach messages, which were analyzed using the proposed model.Results: We applied the framework to predict binge eating behavior, resulting in an area under the curve between 0.57 (when applied to new users) and 0.72 (when applied to new symptom reports of known users). In addition, initial evidence indicated that specific text features predicted the therapeutic outcome of reducing ED symptoms.Conclusions: The case study demonstrates the usefulness of a structured approach to text data analytics. NLP techniques improve the prediction of symptom changes in DHIs. We present a technical framework that can be easily applied in other clinical trials and clinical presentations and encourage other groups to apply the framework in similar contexts.

KW - Business informatics

KW - Digital Health Interventions Text Analytics (DHITA)

KW - digital health interventions

KW - eating disorders

KW - guided self-help

KW - natural language processing

KW - text mining

KW - Digital Health Interventions Text Analytics (DHITA)

KW - Text mining

KW - Digital health interventions

KW - Eating disorders

KW - Guided self-help

KW - Natural language processing

UR - http://www.scopus.com/inward/record.url?scp=85081043151&partnerID=8YFLogxK

U2 - 10.2196/13855

DO - 10.2196/13855

M3 - Journal articles

C2 - 32130118

VL - 22

JO - Journal of Medical Internet Research

JF - Journal of Medical Internet Research

SN - 1439-4456

IS - 2

M1 - e13855

ER -

DOI