Reliability and Validity of Assessing User Satisfaction With Web-Based Health Interventions

Publikation: Beiträge in ZeitschriftenZeitschriftenaufsätzeForschungbegutachtet

Authors

Background: The perspective of users should be taken into account in the evaluation of Web-based health interventions. Assessing the users' satisfaction with the intervention they receive could enhance the evidence for the intervention effects. Thus, there is a need for valid and reliable measures to assess satisfaction with Web-based health interventions. Objective: The objective of this study was to analyze the reliability, factorial structure, and construct validity of the Client Satisfaction Questionnaire adapted to Internet-based interventions (CSQ-I). Methods: The psychometric quality of the CSQ-I was analyzed in user samples from 2 separate randomized controlled trials evaluating Web-based health interventions, one from a depression prevention intervention (sample 1, N=174) and the other from a stress management intervention (sample 2, N=111). At first, the underlying measurement model of the CSQ-I was analyzed to determine the internal consistency. The factorial structure of the scale and the measurement invariance across groups were tested by multigroup confirmatory factor analyses. Additionally, the construct validity of the scale was examined by comparing satisfaction scores with the primary clinical outcome. Results: Multigroup confirmatory analyses on the scale yielded a one-factorial structure with a good fit (root-mean-square error of approximation =.09, comparative fit index =.96, standardized root-mean-square residual =.05) that showed partial strong invariance across the 2 samples. The scale showed very good reliability, indicated by McDonald omegas of .95 in sample 1 and .93 in sample 2. Significant correlations with change in depressive symptoms (r=-.35, P<.001) and perceived stress (r=-.48, P<.001) demonstrated the construct validity of the scale. Conclusions: The proven internal consistency, factorial structure, and construct validity of the CSQ-I indicate a good overall psychometric quality of the measure to assess the user's general satisfaction with Web-based interventions for depression and stress management. Multigroup analyses indicate its robustness across different samples. Thus, the CSQ-I seems to be a suitable measure to consider the user's perspective in the overall evaluation of Web-based health interventions.

OriginalspracheEnglisch
Aufsatznummere234
ZeitschriftJournal of Medical Internet Research
Jahrgang18
Ausgabenummer8
Anzahl der Seiten13
ISSN1439-4456
DOIs
PublikationsstatusErschienen - 31.08.2016

Dokumente

DOI

Zuletzt angesehen

Aktivitäten

  1. Organizing in Times of Crisis: Collaborative and Open
  2. Moral responsibility, motivational crowding, and efficient regulation of externalities
  3. Leveraging digital affordances to make language learning stick
  4. Exploring crowdworker participation on digital work platforms
  5. Crumpled Times. Temporal and Epistemological Depths of Agent-Based Traffic Simulations
  6. Blogs in the Foreign Language Classroom
  7. Gaming the system: Harnessing the power of commercial computer games for foreign language learning
  8. The Simulation of Everything: Social Simulations 1970 | 2010
  9. Using cardiovascular measures to integrate two theories: motivational intensity theory and mental contrasting
  10. Coordinating Collective Agency – A Gradual Practice-Based Framework
  11. Interstitial spaces as garbage cans of early phase innovation processes
  12. How does the degree of freedom in interactive simulations attach the learning success?
  13. Interculturally wired, locally connected: Online collaboration and intercultural learning in a bi-national blended learning project
  14. Twitter as a virtual stage. An enactment perspective on co-creative networks
  15. Different cultures, different interactional norms: Addressing variation across the Englishes (Carl von Ossietzsky Universität)
  16. Fostering Oral Skills Through the Use of Participatory Web 2.0 Technologies in the Project-based EFL Classroom
  17. Three steps forward, two steps backward: How distributed field governance causes incremental practice change in the case of integrated health care in Germany
  18. Space-focused stereotypes of ethnically diverse places
  19. Zootechnologies. A Media History of Swarm Intelligence
  20. Caution and Subversion. Perspective and Comedy in English Translations of Struwwelpeter.
  21. Resilience, Innovation and Sustainability: Navigating the Complexities of Global Change - Resilience 2011
  22. Context-based discrimination in school discipline
  23. Teaching and Exploring Sustainability in Virtual Space
  24. Zootechnologies. Swarming as a Cultural Technique
  25. Teaching Listening Comprehension in the EFL Classroom: Processes, Materials, Tasks and Tests
  26. Make academia meaningful again: A conversation on research, cocreation and impact
  27. MA-Arbeiten 2018
  28. Regulating alcohol use and its concequences
  29. New York Universität
  30. What if Civilization Collapses? Management Scholarship in and for Deep Adaption
  31. Dealing with racial stereotypes in German professional and elite football. What discourse analysis can contribute
  32. Crumpled Times: Temporal and epistemological depths of Computer Simulations