The eTIMSS and TIMSS Measurement Invariance Study: Multigroup Factor Analyses and Differential Item Functioning Analyses with the 2019 Cycle

Research output: Journal contributionsJournal articlesResearchpeer-review

Authors

  • Murat Yalçınkaya
  • Hakan Atılgan
  • Selim Daşcıoğlu
  • Burak Aydın

In this study, measurement invariance and differential item functioning (DIF) studies of the TIMSS 2019 4th and 8th-grade mathematics and science achievement tests were conducted for the country groups participating in both TIMSS and eTIMSS. The study sample consisted of 9560 responders of the first booklet of the 2019 cycle. Multiple Group Confirmatory Factor Analysis (MGCFA) was utilized to test measurement invariance, and Mantel-Haenszel (MH), Logistic Regression (LR), and SIBTEST were used for the DIF analyses. The measurement invariance results indicated strict invariance between groups for all tests which included 111 items in total. In the DIF analyses, for the 4th and 8th-grade mathematics tests, only three items showed moderate DIF with MH, and four items showed DIF with SIBTEST. For the 4th-grade science test, one item showed moderate DIF with both MH and SIBTEST. However, in the 8th-grade science test, no items showed DIF with MH and LR methods, while four items showed moderate DIF with SIBTEST. Overall, MH and SIBTEST techniques were in agreement, whereas LR method produced inconsistent results and showed disagreement with these two methods. The results of the measurement invariance analysis and the LR method were consistent and indicated equivalency of TIMSS and e-TIMSS scores.

Original languageEnglish
JournalJournal of Measurement and Evaluation in Education and Psychology
Volume15
Issue number2
Pages (from-to)94-119
Number of pages26
DOIs
Publication statusPublished - 30.06.2024

Bibliographical note

Publisher Copyright:
© 2024 Association of Measurement and Evaluation in Education and Psychology (EPODDER). All rights reserved.

    Research areas

  • Computer-Based Assessments, DIF, Differential Item Functioning, Multiple Group Confirmatory Factor Analysis, Paper-Pencil Assessments, TIMSS
  • Educational science

DOI

Recently viewed

Publications

  1. Genossenschaft, Repräsentation und Partizipation
  2. Climate Change: Implications for Europe's Security and Defence Policy
  3. KI-Kanban-Behälter
  4. Historical family structure as a predictor of liberal voting
  5. Lieder
  6. Wider die 'Mode heutiger Archaik'
  7. Beyond stereotypes
  8. Vom Normalstaat zum Ausnahmestaat
  9. Wolke 7
  10. The City is our Anthropo-Scene!
  11. Chasing the difference
  12. Abstrakte Gefährdungslagen
  13. Outreach on Space Traffic Management
  14. Linking Transitions to Sustainability
  15. The case of a proposed 21.5 MWe biomass gasifier in Winkleigh, Devon
  16. Teilhabe durch Fachlichkeit
  17. Platform workers centre stage!
  18. Emotionale Entwicklung
  19. Shame
  20. National Regulation of Space Activities
  21. Das Programm MindMatters. Aspekte salutogener und inklusiver Unterrichtsaspekte
  22. Tasks and Evaluation of Human Resource Departments
  23. Solidarity with refugees
  24. The Place of Marx in Reiner Schürmann’s Work
  25. With a little help from my website
  26. Decision|Culture.
  27. (Not) Thinking about you
  28. Pierre Bourdieus Beitrag zur Analyse des Rechts
  29. Karl Jaspers:Die Schuldfrage
  30. Nutzung und User Experience einer gamifizierten Webanwendung zur Förderung der körperlichen Aktivität im betrieblichen Setting
  31. What makes a high-quality exporter? Evidence from Germany
  32. Market for Corporate Control and CSR
  33. Bush encroachment control and risk management in semi-arid rangelands
  34. Textverstehen als Voraussetzung für erfolgreiches mathematisches Modellieren
  35. Landscape features shape people's perception of ecosystem service supply areas
  36. Der adaptive Umgang mit Heterogenität in der Schule
  37. Stock price reactions to environmental pollution events
  38. Replizierbare Forschung in den Wirtschaftswissenschaften erhöhen
  39. Germany must invest more in its future
  40. Pennycress double-cropping does not negatively impact spider diversity
  41. What influences environmental entrepreneurship? A multilevel analysis of the determinants of entrepreneurs’ environmental orientation
  42. Grundlagen und Modelle der Programmierung
  43. Vergütungsbericht - Eine Komponente der nichtfinanziellen Berichterstattung
  44. Ultrasonic stirring as a production process for nanoparticle reinforced magnesium alloys and the compression creep response of ZE10 reinforced with ceria nanoparticles