Deciding between the Covariance Analytical Approach and the Change-Score Approach in Two Wave Panel Data

Research output: Journal contributionsJournal articlesResearchpeer-review

Authors

The manuscript focuses on effects in nonrandomized studies with two outcome measurement occasions and one explanatory variable, and in which groups already differ at the pretest. Such study designs are often encountered in educational and instructional research. Two prominent approaches to estimate effects are (1) covariance analytical approaches and (2) latent change-score models. In current practice, both approaches are applied interchangeably, without a clear rationale for when to use which approach. The aim of this contribution is to outline under which conditions the approaches produce unbiased estimates of the instruction effect. We present a theoretical data generating model in which we decompose the variances of the relevant variables, and examine under which data generating conditions the estimated instruction effect is unbiased. We show that, under specific assumptions, both methods can be used to answer the general question of whether instruction has an effect. Another implication from the results is that practitioners need to consider which underlying data generating assumptions the approaches make, since a violation of those assumptions will lead to biased effects. Based on our results, we give recommendations for preferable research designs.
Original languageEnglish
JournalMultivariate Behavioral Research
Volume56
Issue number3
Pages (from-to)447-458
Number of pages12
ISSN0027-3171
DOIs
Publication statusPublished - 21.07.2021

Bibliographical note

Publisher Copyright:
© 2020 Taylor & Francis Group, LLC.

    Research areas

  • Educational science - Change-Score Model, conditional model, instruction effect, multilevel SEM

Recently viewed

Activities

  1. Comfort and Adaptive Cruise Control in Highly Automated Vehicles
  2. Teams are changing! Going into the wild to expand theory on dynamics in modern teamwork settings
  3. Configurating the Creation of the New: Spaces of Organising and Entrepreneuring
  4. Performing ventures in, trough and with regional start-up ecosystems: Emering insights on slowness in accelerators and the pedagogy of pitching
  5. Histories of Media Art (Networking) in Deep Europe in the 1990s
  6. Unintended Consequences of Field Experiments in Poverty Settings
  7. Plenary Speaker at the 2021 4th IEEE International Conference on Information Communication and Signal Processing (ICICSP 2021)
  8. Confident for the next job interview: virtual reality for effective training
  9. Dissertation "Participation and Democracy: Dynamics, Causes and Consequences of Elite-Challenging Activities"
  10. Quantitative Gefügeanalyse mit dem programmierbaren Zeiss Mikroskop Linearanalysator
  11. Classical:NEXT Conference 2024
  12. A lecture
  13. 17th Trends in Enterprise Architecture Research Workshop
  14. Conference - The 8th International Federation of Automatic Control Symposium on System Structure and Control (SSSC) , Montreal, Canada
  15. PEER 2012 Workshop
  16. Absatztheorie
  17. The 14th International Symposium of Mathematical Theory of Networks and Systems - MTNS 2000
  18. 28th American Conference on Information Systems 2022 - AMCIS 2022
  19. Mathematics teacher students' use of instructional videos
  20. European Intelligence and Security Informatics Conference - EISIC 2013
  21. Academy of Management Journal (Fachzeitschrift)
  22. Workshop - PhD Workshop of the 6th International CSRCommunication Conference
  23. Organized Creativity Virtual Workshop
  24. 2nd Organizing Creativity Transalpine Paper Development Workshop
  25. Academy of Management (Externe Organisation)

Publications

  1. Putting inquiry-based learning into practice
  2. Who can nudge for sustainable development? How nudge source renders dynamic norms (in-)effective in eliciting sustainable behavior
  3. Time- and age-related effects of experimentally simulated nitrogen deposition on the functioning of montane heathland ecosystems
  4. “You’re Not Allowed to Give Us the Solution, but Can You Guide Us towards It?”
  5. Geometric series with randomly increasing exponents
  6. Integrated curvature sensing of soft bending actuators using inertial measurement units
  7. Downsizing, Ideology and Contracts
  8. Efficacy and Moderators of Internet-Based Interventions in Adults with Subthreshold Depression
  9. Systems of IT Innovation
  10. Burdens, Stresses, Resources and Needs of School Management and Teaching staff during the Corona Pandemic. Results of a qualitative Interview Study at primary and secondary Schools in Hesse
  11. Accuracy Improvement by Artificial Neural Networks in Technical Vision System
  12. Effects of oral corrective feedback on the development of complex morphosyntax
  13. Rechtschreiblernen in der Sekundarstufe I
  14. Influence of Extrusion Rate on Microstructure and Mechanical Properties of Magnesium Alloy AM60 and an AM60-Based Metal Matrix Nanocomposite
  15. Social and dimensional comparison effects on math and reading self-concepts of elementary school children
  16. The use of the online Inverted Classroom Model for digital teaching with gamification in medical studies
  17. Do overlapping audit and compensation committee memberships contribute to better financial reporting quality?
  18. Workplace mediation: Lessons from negotiation theory
  19. Sustainable development, sustainable software, and sustainable software engineering
  20. Artificial neural network for correction of effects of plasticity in equibiaxial residual stress profiles measured by hole drilling
  21. Establishment age and wages
  22. Mapping the European Space of Circulation
  23. Mathematical reasoning in the written argumentation of primary students
  24. Utilization of food waste in continuous flow cultures of the heterotrophic microalga Chlorella pyrenoidosa for saturated and unsaturated fatty acids production
  25. Research in-between