Reliability and Validity of Assessing User Satisfaction With Web-Based Health Interventions

Publikation: Beiträge in ZeitschriftenZeitschriftenaufsätzeForschungbegutachtet

Authors

Background: The perspective of users should be taken into account in the evaluation of Web-based health interventions. Assessing the users' satisfaction with the intervention they receive could enhance the evidence for the intervention effects. Thus, there is a need for valid and reliable measures to assess satisfaction with Web-based health interventions. Objective: The objective of this study was to analyze the reliability, factorial structure, and construct validity of the Client Satisfaction Questionnaire adapted to Internet-based interventions (CSQ-I). Methods: The psychometric quality of the CSQ-I was analyzed in user samples from 2 separate randomized controlled trials evaluating Web-based health interventions, one from a depression prevention intervention (sample 1, N=174) and the other from a stress management intervention (sample 2, N=111). At first, the underlying measurement model of the CSQ-I was analyzed to determine the internal consistency. The factorial structure of the scale and the measurement invariance across groups were tested by multigroup confirmatory factor analyses. Additionally, the construct validity of the scale was examined by comparing satisfaction scores with the primary clinical outcome. Results: Multigroup confirmatory analyses on the scale yielded a one-factorial structure with a good fit (root-mean-square error of approximation =.09, comparative fit index =.96, standardized root-mean-square residual =.05) that showed partial strong invariance across the 2 samples. The scale showed very good reliability, indicated by McDonald omegas of .95 in sample 1 and .93 in sample 2. Significant correlations with change in depressive symptoms (r=-.35, P<.001) and perceived stress (r=-.48, P<.001) demonstrated the construct validity of the scale. Conclusions: The proven internal consistency, factorial structure, and construct validity of the CSQ-I indicate a good overall psychometric quality of the measure to assess the user's general satisfaction with Web-based interventions for depression and stress management. Multigroup analyses indicate its robustness across different samples. Thus, the CSQ-I seems to be a suitable measure to consider the user's perspective in the overall evaluation of Web-based health interventions.

OriginalspracheEnglisch
Aufsatznummere234
ZeitschriftJournal of Medical Internet Research
Jahrgang18
Ausgabenummer8
Anzahl der Seiten13
ISSN1439-4456
DOIs
PublikationsstatusErschienen - 31.08.2016

Dokumente

DOI

Zuletzt angesehen

Aktivitäten

  1. One generation plants the trees, another gets the shade? Negotiators' perceptions and behaviors in intergenerational allocations of resources.
  2. Differentiating forest types using Terrasar-X spotlight images based on factor analysis
  3. Ecological Applications (Zeitschrift)
  4. Kunstuniversität Linz
  5. Intra-firm Wage Dispersion and Cost Coverage of Training: Evidence from German Linked Employer-Employee Data
  6. Moral responsibility, motivational crowding, and efficient regulation of externalities
  7. Robust Current Decoupling in a Permanent Magnet Motor Combining a Geometric Method and SMC
  8. Plenary lecture eintitled: "Mathematical insights for advanced ice-clamping control in the context of Industry 4.0"
  9. Leveraging digital affordances to make language learning stick
  10. 19th Annual SemFest
  11. The link between supervisory board reporting and firm performance in Germany and Austria
  12. Common Ground #3. Where the Circles Intersect
  13. Does resin represent a neglected component of bee ecology? A comparison between Old and New World bees.
  14. Ars Electronica
  15. Towards an Undercommons (Eco)Logistics?
  16. The Use of Media in Intercultural Dialogue "dialogo_dialog"!: Investigation of a Research Event in Terms of Communication without Language
  17. Life cycle thinking and systems thinking - how to support systems thinking in material flow management
  18. Hyperkult XXV - 2015
  19. RHYTHMS OF ATTUNEMENT
  20. Workshop "Biodiversity and pollination services – from basic and applied science to stakeholders and policy" 2012
  21. 1st ECPR Winter School in Methods and Techniques 2012

Publikationen

  1. Comparison of modeling approaches based on the microstructure of thermally sprayed coatings
  2. Development of high performance single-phase solid solution magnesium alloy at low temperature
  3. Where do the data live?
  4. Chapter 9: Particular Remedies for Non-performance: Section 2: Withholding Performance
  5. E-stability and stability of adaptive learning in models with private information
  6. The relationship between values and knowledge in visioning for landscape management
  7. Health State Valuation Methods and Reference Points
  8. Explorations in social spaces
  9. Evaluating the effectiveness of retention forestry to enhance biodiversity in production forests of Central Europe using an interdisciplinary, multi-scale approach
  10. Do abundance distributions and species aggregation correctly predict macroecological biodiversity patterns in tropical forests?
  11. Conceptualizing community in energy systems
  12. Applied Conversation Analysis in Foreign Language Didactics
  13. Understanding and managing post-acquisition integration as change process
  14. Internet-based public debate of CCS
  15. Introduction
  16. Influence of data clouds fusion from 3D real-time vision system on robotic group dead reckoning in unknown terrain
  17. The Crowd in Flux
  18. Exchanging Knowledge and Good Practices of Education for Sustainable Development within a Global Student Organization (oikos)
  19. Finite element modeling of laser beam welding for residual stress calculation
  20. Modeling Grounding Processes in Chat-based CSCL
  21. Embedded, not plugged-in
  22. On the Direct Kinematics Problem of Parallel Mechanisms
  23. Vom „rights-based approach" zum "solution-based approach" in der WTO-Streitbeilegung?
  24. Digital teaching as an instrument for cross-location teaching networks in medical informatics
  25. Discussion report part 2
  26. Action rate models for predicting actions in soccer
  27. An EKF-based observer for sensorless valve control in camless internal combustion engine