Reliability and Validity of Assessing User Satisfaction With Web-Based Health Interventions

Publikation: Beiträge in ZeitschriftenZeitschriftenaufsätzeForschungbegutachtet

Authors

Background: The perspective of users should be taken into account in the evaluation of Web-based health interventions. Assessing the users' satisfaction with the intervention they receive could enhance the evidence for the intervention effects. Thus, there is a need for valid and reliable measures to assess satisfaction with Web-based health interventions. Objective: The objective of this study was to analyze the reliability, factorial structure, and construct validity of the Client Satisfaction Questionnaire adapted to Internet-based interventions (CSQ-I). Methods: The psychometric quality of the CSQ-I was analyzed in user samples from 2 separate randomized controlled trials evaluating Web-based health interventions, one from a depression prevention intervention (sample 1, N=174) and the other from a stress management intervention (sample 2, N=111). At first, the underlying measurement model of the CSQ-I was analyzed to determine the internal consistency. The factorial structure of the scale and the measurement invariance across groups were tested by multigroup confirmatory factor analyses. Additionally, the construct validity of the scale was examined by comparing satisfaction scores with the primary clinical outcome. Results: Multigroup confirmatory analyses on the scale yielded a one-factorial structure with a good fit (root-mean-square error of approximation =.09, comparative fit index =.96, standardized root-mean-square residual =.05) that showed partial strong invariance across the 2 samples. The scale showed very good reliability, indicated by McDonald omegas of .95 in sample 1 and .93 in sample 2. Significant correlations with change in depressive symptoms (r=-.35, P<.001) and perceived stress (r=-.48, P<.001) demonstrated the construct validity of the scale. Conclusions: The proven internal consistency, factorial structure, and construct validity of the CSQ-I indicate a good overall psychometric quality of the measure to assess the user's general satisfaction with Web-based interventions for depression and stress management. Multigroup analyses indicate its robustness across different samples. Thus, the CSQ-I seems to be a suitable measure to consider the user's perspective in the overall evaluation of Web-based health interventions.

OriginalspracheEnglisch
Aufsatznummere234
ZeitschriftJournal of Medical Internet Research
Jahrgang18
Ausgabenummer8
Anzahl der Seiten13
ISSN1439-4456
DOIs
PublikationsstatusErschienen - 31.08.2016

Dokumente

DOI

Zuletzt angesehen

Aktivitäten

  1. Strategies for the Control of Water Treatment by Stripping and Injection of CO2
  2. Symposium "Art and its Frames - Continuity and Change" 2014
  3. Workshop "Biodiversity and pollination services – from basic and applied science to stakeholders and policy" 2012
  4. Process Tracing Methodology - 2011
  5. The impact of information on diabetes patients' acceptance of internet-based depression interventions: a randomized controlled trial.
  6. Explaining the performance of participatory and collaborative governance in addressing long-term environmental policy issues
  7. Purposeful Work Symposium (PWS)
  8. Reactivity on a student-centered recording system – a video-based longitudinal study in primary education
  9. HyperKult XI - Computer als Medium: Das Unsichtbare - 2002
  10. Invited talk at the Lodz University of Technology
  11. IDG Summit 2023
  12. Preliminary results of the state of the art study on scaling and corrosion.
  13. Quantity, Quality, Trust: Dilemmas and Strategies of Museum Documentation in the Age of AI
  14. Playing guitar while playing video games: An experiment with students learning to play the guitar by playing Rocksmith
  15. meson press (Verlag)
  16. 'Can you play a new CD,please?' Speech act representation in EFL textbooks: An interlanguage pragmatic appraisal (Universität Gießen, invited talk)
  17. ‘Towards relational practices of world-making: entrepreneurship from a more-than-human perspective’.
  18. Rationality and affect – instructions as a form of care in Russian protest online networks
  19. Dealing with racial stereotypes in German professional and elite football. What discourse analysis can contribute
  20. International Class Actions Conference - ICAC Workshop 2024

Publikationen

  1. Knowledge integration
  2. A comparison between private and public access rules to bottlenecks - experiences and expectations from telecommunication and energy
  3. Migration-Based Multilingualism in the English as a Foreign Language Classroom
  4. Using frequency tagging to investigate social processing in autism
  5. ℓp-norm multiple kernel learning
  6. Editorial introduction to the special issue on crises at work
  7. Comparison of an Electrochemical and Luminescence-Based Oxygen Measuring System for Use in the Biodegradability Testing According to Closed Bottle Test (OECD 301D)
  8. Creative Network Communities in the Translocal Space of Digital Networks
  9. The Role of Formalisation, Participation and Context in the Success of Public Involvement Mechanisms in Resource Management
  10. »CO2 causes a hole in the atmosphere« Using laypeople’s conceptions as a starting point to communicate climate change
  11. Influence of Dy in solid solution on the degradation behavior of binary Mg-Dy alloys in cell culture medium
  12. Socio-technical instruments in the field of Integrated Water Resources Management
  13. An Adaptive Resonance Regulator Design for Motion Control of Intake Valves in Camless Engine Systems
  14. De-Anonymizing Anonymous
  15. A Hybrid Hydraulic Piezo Actuator for Camless Internal Combustion Engines Controlled with an MPC and an Affine Feedforward Structure
  16. Non-acceptances in context
  17. Thanking and responding to thanks in American English: Language patterning and contextual appropriateness
  18. Applying the Rasch sampler to identify aberrant responding through person fit statistics under fixed nominal α-level.
  19. Planning for Sea Spaces I: Processes, Practices and Future Perspectives
  20. Dadadatadada: From Dada to Data and Back Again
  21. Understanding needs embodiment
  22. Diversity of Play
  23. Entangled – But How?
  24. A path to clean water
  25. Grain size statistics, composition and provenance of fragmental particles in some Apollo 14 breccias
  26. New Methods for the Analysis of Links between International Firm Activities and Firm Performance: A Practitioner’s Guide
  27. Curatorial Practices of the ‘Global’
  28. Organic Synthesis – Art or Science?