Same but different? Measurement invariance of the PIAAC motivation-to-learn scale across key socio-demographic groups

Research output: Journal contributionsJournal articlesResearchpeer-review

Standard

Same but different? Measurement invariance of the PIAAC motivation-to-learn scale across key socio-demographic groups. / Gorges, Julia; Koch, Tobias; Maehler, Débora B. et al.
In: Large-Scale Assessments in Education, Vol. 5, No. 1, 13, 01.12.2017.

Research output: Journal contributionsJournal articlesResearchpeer-review

Harvard

APA

Vancouver

Bibtex

@article{18182b966ea544efbb3f34b275a07b98,
title = "Same but different? Measurement invariance of the PIAAC motivation-to-learn scale across key socio-demographic groups",
abstract = "Background: Data from the Programme for the International Assessment of Adult Competencies (PIAAC) revealed that countries systematically differ in their respondents{\textquoteright} literacy, numeracy, and problem solving in technology-rich environments skills; skill levels also vary by gender, age, level of education or migration background. Similarly, systematic differences have been documented with respect to adults{\textquoteright} participation in education, which can be considered as a means to develop and maintain skills. From a psychological perspective, motivation to learn is considered a key factor associated with both skill development and participation in (further) education. In order to account for motivation when analyzing PIAAC data, four items from the PIAAC background questionnaire were recently compiled into a motivation-to-learn scale. This scale has been found to be invariant (i.e., showing full weak and partial strong measurement invariance) across 21 countries. Methods: This paper presents further analyses using multiple-group graded response models to scrutinize the validity of the motivation-to-learn scale for group comparisons. Results: Results indicate at least partial strong measurement invariance across gender, age groups, level of education, and migration background in most countries under study (all CFI >.95, all RMSEA <.08). Thus, the scale is suitable for comparing both means and associations across these groups. Conclusions: Results are discussed in light of country characteristics, challenges of measurement invariance testing, and potential future research using PIAAC data.",
keywords = "Social Work and Social Pedagogics",
author = "Julia Gorges and Tobias Koch and Maehler, {D{\'e}bora B.} and Judith Offerhaus",
note = "Funding Information: Work on this paper was supported by the College for Interdisciplinary Educational Research (CIDER), a Joint Initiative of the BMBF, the Jacobs Foundation and the Leibniz Association. The data used were provided by GESIS-Leibniz Institute for the Social Sciences. Publisher Copyright: {\textcopyright} 2017, The Author(s).",
year = "2017",
month = dec,
day = "1",
doi = "10.1186/s40536-017-0047-5",
language = "English",
volume = "5",
journal = "Large-Scale Assessments in Education",
issn = "2196-0739",
publisher = "Springer",
number = "1",

}

RIS

TY - JOUR

T1 - Same but different? Measurement invariance of the PIAAC motivation-to-learn scale across key socio-demographic groups

AU - Gorges, Julia

AU - Koch, Tobias

AU - Maehler, Débora B.

AU - Offerhaus, Judith

N1 - Funding Information: Work on this paper was supported by the College for Interdisciplinary Educational Research (CIDER), a Joint Initiative of the BMBF, the Jacobs Foundation and the Leibniz Association. The data used were provided by GESIS-Leibniz Institute for the Social Sciences. Publisher Copyright: © 2017, The Author(s).

PY - 2017/12/1

Y1 - 2017/12/1

N2 - Background: Data from the Programme for the International Assessment of Adult Competencies (PIAAC) revealed that countries systematically differ in their respondents’ literacy, numeracy, and problem solving in technology-rich environments skills; skill levels also vary by gender, age, level of education or migration background. Similarly, systematic differences have been documented with respect to adults’ participation in education, which can be considered as a means to develop and maintain skills. From a psychological perspective, motivation to learn is considered a key factor associated with both skill development and participation in (further) education. In order to account for motivation when analyzing PIAAC data, four items from the PIAAC background questionnaire were recently compiled into a motivation-to-learn scale. This scale has been found to be invariant (i.e., showing full weak and partial strong measurement invariance) across 21 countries. Methods: This paper presents further analyses using multiple-group graded response models to scrutinize the validity of the motivation-to-learn scale for group comparisons. Results: Results indicate at least partial strong measurement invariance across gender, age groups, level of education, and migration background in most countries under study (all CFI >.95, all RMSEA <.08). Thus, the scale is suitable for comparing both means and associations across these groups. Conclusions: Results are discussed in light of country characteristics, challenges of measurement invariance testing, and potential future research using PIAAC data.

AB - Background: Data from the Programme for the International Assessment of Adult Competencies (PIAAC) revealed that countries systematically differ in their respondents’ literacy, numeracy, and problem solving in technology-rich environments skills; skill levels also vary by gender, age, level of education or migration background. Similarly, systematic differences have been documented with respect to adults’ participation in education, which can be considered as a means to develop and maintain skills. From a psychological perspective, motivation to learn is considered a key factor associated with both skill development and participation in (further) education. In order to account for motivation when analyzing PIAAC data, four items from the PIAAC background questionnaire were recently compiled into a motivation-to-learn scale. This scale has been found to be invariant (i.e., showing full weak and partial strong measurement invariance) across 21 countries. Methods: This paper presents further analyses using multiple-group graded response models to scrutinize the validity of the motivation-to-learn scale for group comparisons. Results: Results indicate at least partial strong measurement invariance across gender, age groups, level of education, and migration background in most countries under study (all CFI >.95, all RMSEA <.08). Thus, the scale is suitable for comparing both means and associations across these groups. Conclusions: Results are discussed in light of country characteristics, challenges of measurement invariance testing, and potential future research using PIAAC data.

KW - Social Work and Social Pedagogics

UR - http://www.scopus.com/inward/record.url?scp=85062704309&partnerID=8YFLogxK

U2 - 10.1186/s40536-017-0047-5

DO - 10.1186/s40536-017-0047-5

M3 - Journal articles

VL - 5

JO - Large-Scale Assessments in Education

JF - Large-Scale Assessments in Education

SN - 2196-0739

IS - 1

M1 - 13

ER -

Documents

DOI