Deciding between the Covariance Analytical Approach and the Change-Score Approach in Two Wave Panel Data

Research output: Journal contributionsJournal articlesResearchpeer-review

Authors

The manuscript focuses on effects in nonrandomized studies with two outcome measurement occasions and one explanatory variable, and in which groups already differ at the pretest. Such study designs are often encountered in educational and instructional research. Two prominent approaches to estimate effects are (1) covariance analytical approaches and (2) latent change-score models. In current practice, both approaches are applied interchangeably, without a clear rationale for when to use which approach. The aim of this contribution is to outline under which conditions the approaches produce unbiased estimates of the instruction effect. We present a theoretical data generating model in which we decompose the variances of the relevant variables, and examine under which data generating conditions the estimated instruction effect is unbiased. We show that, under specific assumptions, both methods can be used to answer the general question of whether instruction has an effect. Another implication from the results is that practitioners need to consider which underlying data generating assumptions the approaches make, since a violation of those assumptions will lead to biased effects. Based on our results, we give recommendations for preferable research designs.
Original languageEnglish
JournalMultivariate Behavioral Research
Volume56
Issue number3
Pages (from-to)447-458
Number of pages12
ISSN0027-3171
DOIs
Publication statusPublished - 21.07.2021

Bibliographical note

Publisher Copyright:
© 2020 Taylor & Francis Group, LLC.

    Research areas

  • Educational science - Change-Score Model, conditional model, instruction effect, multilevel SEM

Recently viewed

Publications

  1. AUC Maximizing Support Vector Learning
  2. Integrating inductive and deductive analysis to identify and characterize archetypical social-ecological systems and their changes
  3. Applying the Three Horizons approach in local and regional scenarios to support policy coherence in SDG implementation
  4. Simulation-based Investigation of Energy Flexibility in the Optimization of Hinterland Drainage
  5. How mobile app design impacts user responses to mixed self-tracking outcomes
  6. Introduction
  7. Comment on “Stretching intervention can prevent muscle injuries: a systematic review and meta-analysis”
  8. Navigating (In)Visibility
  9. A latent state-trait analysis of current achievement motivation across different tasks of cognitive ability
  10. An interdisciplinary perspective on scaling in transitions
  11. Steering of land use in the context of sustainable development
  12. A Conceptual Structure of Justice - Providing a Tool to Analyse Conceptions of Justice
  13. Audiosoftware im Unterricht
  14. Using work values to predict post-retirement work intentions
  15. Mathematical Model of Double Row Self-Aligning Ball Bearing
  16. Rotational complexity in mental rotation tests
  17. Development and characterisation of a new interface for coupling capillary LC with collision-cell ICPMS and its application for phosphorylation profiling of tryptic protein digests
  18. The global context and people at work: Special issue introduction
  19. Microstructure, mechanical properties and fracture behaviors of large-scale sand-cast Mg-3Y-2Gd-1Nd-0.4Zr alloy
  20. Predictive mapping of plant species and communities using GIS and Landsat data in a southern Mongolian mountain range
  21. Toxicity testing with luminescent bacteria - Characterization of an automated method for the combined assessment of acute and chronic effects
  22. Degrees of Integration
  23. Optimizing price levels in e-commerce applications
  24. Why Emergency? Reflections on the Practice and Rhetoric of Exceptionalism
  25. Experimental Verification of the Impact of Radial Internal Clearance on a Bearing's Dynamics
  26. Do You Like What You (Can't) See? The Differential Effects of Hardware and Software Upgrades on High-Tech Product Evaluations
  27. Direct measurement of cognitive load in multimedia learning
  28. Exploring Difficult History Lessons, Identity Construction, the Artistic Expansion of Sitcom Storytelling Tools in the Black-ish Episode, "Juneteenth"
  29. Integrating indigenous and local knowledge in management and research on coastal ecosystems in the Global South
  30. Wireless power transmission via a multi-coil inductive system
  31. Revisiting the tolerance limit of Fe impurity in biodegradable magnesium
  32. Thermal synthesis of a thermochemical heat storage with heat exchanger optimization
  33. Computational Study of Three-Dimensional Lagrangian Transport and Mixing in a Stirred Tank Reactor  
  34. Land-use legacy and tree age in continuous woodlands
  35. Cognitive verbs in discourse
  36. Integration in Controllingsystemen
  37. Technology-centred learning processes as digital artistic development
  38. A flexible global warming index for use in an integrated approach to climate change assessment
  39. The First-Mover Disadvantage
  40. Jurisdiction and applicable law in cases of damage from space in Europe - The advent of the most suitable choice - Rome II
  41. The interaction of precipitation and deformation in a binary Mg-Ca alloy at elevated temperatures