Same but different? Measurement invariance of the PIAAC motivation-to-learn scale across key socio-demographic groups

Research output: Journal contributionsJournal articlesResearchpeer-review

Standard

Same but different? Measurement invariance of the PIAAC motivation-to-learn scale across key socio-demographic groups. / Gorges, Julia; Koch, Tobias; Maehler, Débora B. et al.
In: Large-Scale Assessments in Education, Vol. 5, No. 1, 13, 01.12.2017.

Research output: Journal contributionsJournal articlesResearchpeer-review

Harvard

APA

Vancouver

Bibtex

@article{18182b966ea544efbb3f34b275a07b98,
title = "Same but different? Measurement invariance of the PIAAC motivation-to-learn scale across key socio-demographic groups",
abstract = "Background: Data from the Programme for the International Assessment of Adult Competencies (PIAAC) revealed that countries systematically differ in their respondents{\textquoteright} literacy, numeracy, and problem solving in technology-rich environments skills; skill levels also vary by gender, age, level of education or migration background. Similarly, systematic differences have been documented with respect to adults{\textquoteright} participation in education, which can be considered as a means to develop and maintain skills. From a psychological perspective, motivation to learn is considered a key factor associated with both skill development and participation in (further) education. In order to account for motivation when analyzing PIAAC data, four items from the PIAAC background questionnaire were recently compiled into a motivation-to-learn scale. This scale has been found to be invariant (i.e., showing full weak and partial strong measurement invariance) across 21 countries. Methods: This paper presents further analyses using multiple-group graded response models to scrutinize the validity of the motivation-to-learn scale for group comparisons. Results: Results indicate at least partial strong measurement invariance across gender, age groups, level of education, and migration background in most countries under study (all CFI >.95, all RMSEA <.08). Thus, the scale is suitable for comparing both means and associations across these groups. Conclusions: Results are discussed in light of country characteristics, challenges of measurement invariance testing, and potential future research using PIAAC data.",
keywords = "Social Work and Social Pedagogics",
author = "Julia Gorges and Tobias Koch and Maehler, {D{\'e}bora B.} and Judith Offerhaus",
note = "Funding Information: Work on this paper was supported by the College for Interdisciplinary Educational Research (CIDER), a Joint Initiative of the BMBF, the Jacobs Foundation and the Leibniz Association. The data used were provided by GESIS-Leibniz Institute for the Social Sciences. Publisher Copyright: {\textcopyright} 2017, The Author(s).",
year = "2017",
month = dec,
day = "1",
doi = "10.1186/s40536-017-0047-5",
language = "English",
volume = "5",
journal = "Large-Scale Assessments in Education",
issn = "2196-0739",
publisher = "SpringerOpen",
number = "1",

}

RIS

TY - JOUR

T1 - Same but different? Measurement invariance of the PIAAC motivation-to-learn scale across key socio-demographic groups

AU - Gorges, Julia

AU - Koch, Tobias

AU - Maehler, Débora B.

AU - Offerhaus, Judith

N1 - Funding Information: Work on this paper was supported by the College for Interdisciplinary Educational Research (CIDER), a Joint Initiative of the BMBF, the Jacobs Foundation and the Leibniz Association. The data used were provided by GESIS-Leibniz Institute for the Social Sciences. Publisher Copyright: © 2017, The Author(s).

PY - 2017/12/1

Y1 - 2017/12/1

N2 - Background: Data from the Programme for the International Assessment of Adult Competencies (PIAAC) revealed that countries systematically differ in their respondents’ literacy, numeracy, and problem solving in technology-rich environments skills; skill levels also vary by gender, age, level of education or migration background. Similarly, systematic differences have been documented with respect to adults’ participation in education, which can be considered as a means to develop and maintain skills. From a psychological perspective, motivation to learn is considered a key factor associated with both skill development and participation in (further) education. In order to account for motivation when analyzing PIAAC data, four items from the PIAAC background questionnaire were recently compiled into a motivation-to-learn scale. This scale has been found to be invariant (i.e., showing full weak and partial strong measurement invariance) across 21 countries. Methods: This paper presents further analyses using multiple-group graded response models to scrutinize the validity of the motivation-to-learn scale for group comparisons. Results: Results indicate at least partial strong measurement invariance across gender, age groups, level of education, and migration background in most countries under study (all CFI >.95, all RMSEA <.08). Thus, the scale is suitable for comparing both means and associations across these groups. Conclusions: Results are discussed in light of country characteristics, challenges of measurement invariance testing, and potential future research using PIAAC data.

AB - Background: Data from the Programme for the International Assessment of Adult Competencies (PIAAC) revealed that countries systematically differ in their respondents’ literacy, numeracy, and problem solving in technology-rich environments skills; skill levels also vary by gender, age, level of education or migration background. Similarly, systematic differences have been documented with respect to adults’ participation in education, which can be considered as a means to develop and maintain skills. From a psychological perspective, motivation to learn is considered a key factor associated with both skill development and participation in (further) education. In order to account for motivation when analyzing PIAAC data, four items from the PIAAC background questionnaire were recently compiled into a motivation-to-learn scale. This scale has been found to be invariant (i.e., showing full weak and partial strong measurement invariance) across 21 countries. Methods: This paper presents further analyses using multiple-group graded response models to scrutinize the validity of the motivation-to-learn scale for group comparisons. Results: Results indicate at least partial strong measurement invariance across gender, age groups, level of education, and migration background in most countries under study (all CFI >.95, all RMSEA <.08). Thus, the scale is suitable for comparing both means and associations across these groups. Conclusions: Results are discussed in light of country characteristics, challenges of measurement invariance testing, and potential future research using PIAAC data.

KW - Social Work and Social Pedagogics

UR - http://www.scopus.com/inward/record.url?scp=85062704309&partnerID=8YFLogxK

U2 - 10.1186/s40536-017-0047-5

DO - 10.1186/s40536-017-0047-5

M3 - Journal articles

VL - 5

JO - Large-Scale Assessments in Education

JF - Large-Scale Assessments in Education

SN - 2196-0739

IS - 1

M1 - 13

ER -

Documents

DOI

Recently viewed

Publications

  1. Tree cover mediates the effect on rapeseed leaf damage of excluding predatory arthropods, but in an unexpected way
  2. Does Allulose Appeal to Consumers? Results from a Discrete Choice Experiment in Germany
  3. If you call for frameworks in sustainability management... editorial to the special issue
  4. OPERATIONALIZING DIGITAL TRANSFORMATION FROM MULTIPLE PERSPECTIVES
  5. Reading instruction in 5th grade: teachers’ perspectives on promoting self-regulated reading in language and content area teaching
  6. Polarization of Time and Income
  7. Optimisation of root traits to provide enhanced ecosystem services in agricultural systems
  8. How digital reflection and feedback environments contribute to pre-service teachers’ beliefs during a teaching practicum
  9. Käsemann, Ernst
  10. Challenges in political interviews
  11. The theory of human development
  12. How cognitive issue bracketing affects interdependent decision-making in negotiations
  13. Time matters
  14. Integration of material flow management tools in workplace environments
  15. An Ecosystem Architecture Meta-Model for Supporting Ultra-Large Scale Digital Transformations
  16. Exports and productivity: A survey of the evidence from firm-level data
  17. Donor Upgrading Strategies
  18. Das Inverted Classroom Model (ICM) im Kontext kompetenzorientierter Hochschullehre
  19. Teaching Provenance to AI
  20. Effect of ambient conditions in friction surfacing
  21. Article 66 CISG
  22. Structuring and advancing solution-oriented research for sustainability
  23. Reading Marx
  24. Thermal disturbances attenuation using a Lyapunov controller for an ice-clamping device actuated by thermoelectric coolers