Reliability and Validity of Assessing User Satisfaction With Web-Based Health Interventions

Publikation: Beiträge in ZeitschriftenZeitschriftenaufsätzeForschungbegutachtet

Authors

Background: The perspective of users should be taken into account in the evaluation of Web-based health interventions. Assessing the users' satisfaction with the intervention they receive could enhance the evidence for the intervention effects. Thus, there is a need for valid and reliable measures to assess satisfaction with Web-based health interventions. Objective: The objective of this study was to analyze the reliability, factorial structure, and construct validity of the Client Satisfaction Questionnaire adapted to Internet-based interventions (CSQ-I). Methods: The psychometric quality of the CSQ-I was analyzed in user samples from 2 separate randomized controlled trials evaluating Web-based health interventions, one from a depression prevention intervention (sample 1, N=174) and the other from a stress management intervention (sample 2, N=111). At first, the underlying measurement model of the CSQ-I was analyzed to determine the internal consistency. The factorial structure of the scale and the measurement invariance across groups were tested by multigroup confirmatory factor analyses. Additionally, the construct validity of the scale was examined by comparing satisfaction scores with the primary clinical outcome. Results: Multigroup confirmatory analyses on the scale yielded a one-factorial structure with a good fit (root-mean-square error of approximation =.09, comparative fit index =.96, standardized root-mean-square residual =.05) that showed partial strong invariance across the 2 samples. The scale showed very good reliability, indicated by McDonald omegas of .95 in sample 1 and .93 in sample 2. Significant correlations with change in depressive symptoms (r=-.35, P<.001) and perceived stress (r=-.48, P<.001) demonstrated the construct validity of the scale. Conclusions: The proven internal consistency, factorial structure, and construct validity of the CSQ-I indicate a good overall psychometric quality of the measure to assess the user's general satisfaction with Web-based interventions for depression and stress management. Multigroup analyses indicate its robustness across different samples. Thus, the CSQ-I seems to be a suitable measure to consider the user's perspective in the overall evaluation of Web-based health interventions.

OriginalspracheEnglisch
Aufsatznummere234
ZeitschriftJournal of Medical Internet Research
Jahrgang18
Ausgabenummer8
Anzahl der Seiten13
ISSN1439-4456
DOIs
PublikationsstatusErschienen - 31.08.2016

Dokumente

DOI

Zuletzt angesehen

Forschende

  1. Julia Preisigke

Publikationen

  1. Unveiling local knowledge
  2. Effectiveness of a Guided Internet- and Mobile-Based Intervention for Patients with Chronic Back Pain and Depression (WARD-BP): A Multicenter, Pragmatic Randomized Controlled Trial
  3. Europe and the media: Changing structures in a changing context
  4. Local perceptions of ecosystem services across multiple ecosystem types in Spain
  5. Essential ecosystem service variables for monitoring progress towards sustainability
  6. From estimation results to stylized facts
  7. Representation of Integration Profiles Using an Ontology
  8. Identification of floodplain contamination hot spots by reconstructing Elbe river pollution load history and high flood sediment distribution during inundation.
  9. Temporal order judgments
  10. Introduction
  11. Legal Parameters of Space Tourism
  12. Developing pragmatic competence in a study abroad context
  13. DESI
  14. Introduction
  15. Organizational Practices for the Aging Workforce
  16. Pitfalls in the Study of Democratization
  17. Evaluating a web-based PPGIS for the rehabilitation of urban riparian corridors
  18. Spatial and seasonal distribution of trace metals in floodplain soils
  19. Zur Methodologie der ‘Fehleranalyse’ in der mathematikdidaktischen Forschung
  20. RIGID PRICES AS A RESULT FROM PROFIT MAXIMIZATION
  21. Schreiben in Deutsch
  22. The current challenges of liability for loss of satellite based services
  23. Meeting the challenges of global change
  24. Efficient control of formation flying spacecraft
  25. Die Vertreibung aus dem Elfenbeinturm
  26. Responses of an arable crop rotation system to elevated [CO2]
  27. Finding the Boomers
  28. Soil chemical legacies trigger species-specific and context-dependent root responses in later arriving plants
  29. Activity-Based Costing as a Basis for Transfer Prices and Target Setting
  30. The development and function of anger in childhood and adolescence
  31. Klimasimulation