The eTIMSS and TIMSS Measurement Invariance Study: Multigroup Factor Analyses and Differential Item Functioning Analyses with the 2019 Cycle

Publikation: Beiträge in ZeitschriftenZeitschriftenaufsätzeForschungbegutachtet

Authors

  • Murat Yalçınkaya
  • Hakan Atılgan
  • Selim Daşcıoğlu
  • Burak Aydın

In this study, measurement invariance and differential item functioning (DIF) studies of the TIMSS 2019 4th and 8th-grade mathematics and science achievement tests were conducted for the country groups participating in both TIMSS and eTIMSS. The study sample consisted of 9560 responders of the first booklet of the 2019 cycle. Multiple Group Confirmatory Factor Analysis (MGCFA) was utilized to test measurement invariance, and Mantel-Haenszel (MH), Logistic Regression (LR), and SIBTEST were used for the DIF analyses. The measurement invariance results indicated strict invariance between groups for all tests which included 111 items in total. In the DIF analyses, for the 4th and 8th-grade mathematics tests, only three items showed moderate DIF with MH, and four items showed DIF with SIBTEST. For the 4th-grade science test, one item showed moderate DIF with both MH and SIBTEST. However, in the 8th-grade science test, no items showed DIF with MH and LR methods, while four items showed moderate DIF with SIBTEST. Overall, MH and SIBTEST techniques were in agreement, whereas LR method produced inconsistent results and showed disagreement with these two methods. The results of the measurement invariance analysis and the LR method were consistent and indicated equivalency of TIMSS and e-TIMSS scores.

OriginalspracheEnglisch
ZeitschriftJournal of Measurement and Evaluation in Education and Psychology
Jahrgang15
Ausgabenummer2
Seiten (von - bis)94-119
Anzahl der Seiten26
DOIs
PublikationsstatusErschienen - 30.06.2024

Bibliographische Notiz

Publisher Copyright:
© 2024 Association of Measurement and Evaluation in Education and Psychology (EPODDER). All rights reserved.

DOI

Zuletzt angesehen

Publikationen

  1. Weltweiter Klimaschutz
  2. Die Wichtigkeit des "Zeitlassens"
  3. Franz Hessel: Sämtliche Werke in fünf Bänden
  4. The curvilinear and time-lagging impact of sustainability performance on financial performance
  5. Das Wuchern der Gefahr.
  6. BAuA-Working Time Survey (BAuA-WTS)
  7. Einstellungschancen von Älteren
  8. Analyse non linéaire des récessions de l'écoulement de base dans des bassins versants à écoulements intermittents
  9. Consequences of the Organizational Structure for the Production Planning System
  10. Research Perspectives and Innovative Applications for Sustainable Engineering Education
  11. Mismatches in the ecosystem services-wellbeing nexus: a case study for Chilean Patagonia
  12. Zuhause statt Hörsaal
  13. Mit Flugblättern gegen Hitler, der Widerstandskreis um Hans Scholl und Alexander Schmorell
  14. Näherung oder Richtung?
  15. ›Systemische Visualisierung‹ als Lernmethode zur normativen und gestaltenden Reflexion wirtschaftsbetrieblicher Situationen im Kontext der Nachhaltigkeitskritik
  16. A Hybrid Extended Kalman Filter as an Observer for a Pot-Electro-Magnetic Actuator
  17. GrassVeg.DE
  18. Digital Health Literacy and Web-Based Information-Seeking Behaviors of University Students in Germany during the COVID-19 Pandemic
  19. Space Dispute Settlement in Asia in the Context of the Belt & Road Initiative
  20. Erratum
  21. Tourism strategies for adaption and sustainable development in mountain and coastal destinations in Germany
  22. Multiple anthropogenic pressures challenge the effectiveness of protected areas in western Tanzania
  23. With a little help from my website. Firm survial and web presence in times of COVID-19 - Evidence from 10 European Countries
  24. Farmers' perceptions of climate change and adaptation strategies in South Africa's Western Cape
  25. Growth strategies
  26. Sustainability through institutional failure and decline?
  27. Wie lernen die Generationen?
  28. Choreographien der Homogenisierung
  29. Bioavailability of Antibiotics at Soil-Water Interfaces
  30. Evaluating one-shot tournament predictions
  31. Mysterium Gender in der Mediengewaltforschung
  32. Krisen und Diskurse - das Kunstjahr 2023 aus Berliner Sicht
  33. Editorial
  34. The Relevance of Entrepreneurship Ecosystems for Start-up Success: A Venture Capital Perspective
  35. Sozialarbeit mit Ausländern
  36. Sprache und Mathematiklernen
  37. Maximum strength and power as determinants of on-ice sprint performance in elite U16 to adult ice hockey players