Reliability and Validity of Assessing User Satisfaction With Web-Based Health Interventions

Publikation: Beiträge in ZeitschriftenZeitschriftenaufsätzeForschungbegutachtet

Authors

Background: The perspective of users should be taken into account in the evaluation of Web-based health interventions. Assessing the users' satisfaction with the intervention they receive could enhance the evidence for the intervention effects. Thus, there is a need for valid and reliable measures to assess satisfaction with Web-based health interventions. Objective: The objective of this study was to analyze the reliability, factorial structure, and construct validity of the Client Satisfaction Questionnaire adapted to Internet-based interventions (CSQ-I). Methods: The psychometric quality of the CSQ-I was analyzed in user samples from 2 separate randomized controlled trials evaluating Web-based health interventions, one from a depression prevention intervention (sample 1, N=174) and the other from a stress management intervention (sample 2, N=111). At first, the underlying measurement model of the CSQ-I was analyzed to determine the internal consistency. The factorial structure of the scale and the measurement invariance across groups were tested by multigroup confirmatory factor analyses. Additionally, the construct validity of the scale was examined by comparing satisfaction scores with the primary clinical outcome. Results: Multigroup confirmatory analyses on the scale yielded a one-factorial structure with a good fit (root-mean-square error of approximation =.09, comparative fit index =.96, standardized root-mean-square residual =.05) that showed partial strong invariance across the 2 samples. The scale showed very good reliability, indicated by McDonald omegas of .95 in sample 1 and .93 in sample 2. Significant correlations with change in depressive symptoms (r=-.35, P<.001) and perceived stress (r=-.48, P<.001) demonstrated the construct validity of the scale. Conclusions: The proven internal consistency, factorial structure, and construct validity of the CSQ-I indicate a good overall psychometric quality of the measure to assess the user's general satisfaction with Web-based interventions for depression and stress management. Multigroup analyses indicate its robustness across different samples. Thus, the CSQ-I seems to be a suitable measure to consider the user's perspective in the overall evaluation of Web-based health interventions.

OriginalspracheEnglisch
Aufsatznummere234
ZeitschriftJournal of Medical Internet Research
Jahrgang18
Ausgabenummer8
Anzahl der Seiten13
ISSN1439-4456
DOIs
PublikationsstatusErschienen - 31.08.2016

Dokumente

DOI

Zuletzt angesehen

Publikationen

  1. Informatik
  2. Learning from partially annotated sequences
  3. Modelling ammonia emissions after field application of biogas slurries
  4. Efficient co-regularised least squares regression
  5. Using measures of reading time regularity (RTR) to quantify eye movement dynamics, and how they are shaped by linguistic information
  6. Optimal control strategies for PMSM with a decoupling super twisting SMC and inductance estimation in the presence of saturation
  7. Key Element No. 2: Applying Diagnostic Forms of Assessment
  8. Experimentally validated multi-step simulation strategy to predict the fatigue crack propagation rate in residual stress fields after laser shock peening
  9. Perfectly nested or significantly nested - an important difference for conservation management
  10. Deciding between the Covariance Analytical Approach and the Change-Score Approach in Two Wave Panel Data
  11. Facing Up to Third Party Liability for Space Activities
  12. Playing in the Spaces: Anarchism in the Classroom
  13. Solution for the direct kinematics problem of the general stewart-gough platform by using only linear actuators’ orientations
  14. Sustainable Consumption - Mapping the Terrain
  15. Phase Shift APOD and POD Control Technique in Multi-Level Inverters to Mitigate Total Harmonic Distortion
  16. Integrating inductive and deductive analysis to identify and characterize archetypical social-ecological systems and their changes
  17. Framework for empirical research on science teaching and learning
  18. Supporting non-hierarchical supply chain networks in the electronics industry
  19. Towards a Concept for Integrating IT Innovation Management into Business IT Management
  20. Recurrence-based diagnostics of rotary systems
  21. „More than a game“
  22. Collaborative business in supply chains - a system dynamics approach
  23. From Enterprise Architecture to Business Ecosystem Architecture
  24. Why Notational Iconicity is a Form of Operational Iconicity
  25. Pathways and mechanisms for catalyzing social impact through Orchestration: Insights from an open social innovation project
  26. From Claiming to Creating Value
  27. Friedenspraxis