Reality-based tasks for competency-based education: The need for an integrated analysis of subject-specific, linguistic, and contextual task features

Research output: Journal contributionsJournal articlesResearchpeer-review

Standard

Harvard

APA

Vancouver

Bibtex

@article{604190d7741548df9d4de61649a47a79,
title = "Reality-based tasks for competency-based education: The need for an integrated analysis of subject-specific, linguistic, and contextual task features",
abstract = "In evaluating competency-based education, effective test instruments must address real-life complexities. The impact of subject-specific, linguistic, and contextual task features, alongside central personal characteristics, on the empirical challenge of such tasks is unclear. We developed mathematics tasks from 30 real-world contexts, each with three questions of varying complexity, administered through a systematically rotated experimental design to 535 German grades 9 and 10 students. Various student variables were collected. Generalized linear mixed models revealed that contextual and mathematical task features significantly contributed to task difficulty variance. Language features had no intermediate-level influence, while students' mathematical self-efficacy moderated low task context familiarity's impact. These findings guide the construction of reality-based mathematics tasks to tailor empirical difficulty. Educational relevance: In the context of worldwide competence-orientated education, it is crucial to reform in-class and national tests. Traditional task formats are limited in representing authentic problems. In most school subjects, a lack of understanding exists in designing reality-based competence-oriented tasks that ensure fair test conditions and meet the subjects' normative demands. This study addresses this gap by empirically investigating the interplay of subject-related, linguistic, and contextual aspects of reality-based tasks in mathematics. Teachers and researchers can use these insights to improve competence-oriented performance situations, sparking further questions. These findings encourage similar studies across subjects for broader applicability.",
keywords = "Assessment, Competency-based education, Language competence, Mathematical competence, Test items, Mathematics, Didactics of Mathematics",
author = "Dominik Leiss and Timo Ehmke and Lena Heine",
note = "Publisher Copyright: {\textcopyright} 2024 The Authors",
year = "2024",
month = aug,
day = "1",
doi = "10.1016/j.lindif.2024.102518",
language = "English",
volume = "114",
journal = "Learning and Individual Differences",
issn = "1041-6080",
publisher = "Elsevier B.V.",

}

RIS

TY - JOUR

T1 - Reality-based tasks for competency-based education

T2 - The need for an integrated analysis of subject-specific, linguistic, and contextual task features

AU - Leiss, Dominik

AU - Ehmke, Timo

AU - Heine, Lena

N1 - Publisher Copyright: © 2024 The Authors

PY - 2024/8/1

Y1 - 2024/8/1

N2 - In evaluating competency-based education, effective test instruments must address real-life complexities. The impact of subject-specific, linguistic, and contextual task features, alongside central personal characteristics, on the empirical challenge of such tasks is unclear. We developed mathematics tasks from 30 real-world contexts, each with three questions of varying complexity, administered through a systematically rotated experimental design to 535 German grades 9 and 10 students. Various student variables were collected. Generalized linear mixed models revealed that contextual and mathematical task features significantly contributed to task difficulty variance. Language features had no intermediate-level influence, while students' mathematical self-efficacy moderated low task context familiarity's impact. These findings guide the construction of reality-based mathematics tasks to tailor empirical difficulty. Educational relevance: In the context of worldwide competence-orientated education, it is crucial to reform in-class and national tests. Traditional task formats are limited in representing authentic problems. In most school subjects, a lack of understanding exists in designing reality-based competence-oriented tasks that ensure fair test conditions and meet the subjects' normative demands. This study addresses this gap by empirically investigating the interplay of subject-related, linguistic, and contextual aspects of reality-based tasks in mathematics. Teachers and researchers can use these insights to improve competence-oriented performance situations, sparking further questions. These findings encourage similar studies across subjects for broader applicability.

AB - In evaluating competency-based education, effective test instruments must address real-life complexities. The impact of subject-specific, linguistic, and contextual task features, alongside central personal characteristics, on the empirical challenge of such tasks is unclear. We developed mathematics tasks from 30 real-world contexts, each with three questions of varying complexity, administered through a systematically rotated experimental design to 535 German grades 9 and 10 students. Various student variables were collected. Generalized linear mixed models revealed that contextual and mathematical task features significantly contributed to task difficulty variance. Language features had no intermediate-level influence, while students' mathematical self-efficacy moderated low task context familiarity's impact. These findings guide the construction of reality-based mathematics tasks to tailor empirical difficulty. Educational relevance: In the context of worldwide competence-orientated education, it is crucial to reform in-class and national tests. Traditional task formats are limited in representing authentic problems. In most school subjects, a lack of understanding exists in designing reality-based competence-oriented tasks that ensure fair test conditions and meet the subjects' normative demands. This study addresses this gap by empirically investigating the interplay of subject-related, linguistic, and contextual aspects of reality-based tasks in mathematics. Teachers and researchers can use these insights to improve competence-oriented performance situations, sparking further questions. These findings encourage similar studies across subjects for broader applicability.

KW - Assessment

KW - Competency-based education

KW - Language competence

KW - Mathematical competence

KW - Test items

KW - Mathematics

KW - Didactics of Mathematics

UR - http://www.scopus.com/inward/record.url?scp=85199531360&partnerID=8YFLogxK

UR - https://www.mendeley.com/catalogue/fefc46d0-4f85-36d3-a079-f4edccba3532/

U2 - 10.1016/j.lindif.2024.102518

DO - 10.1016/j.lindif.2024.102518

M3 - Journal articles

AN - SCOPUS:85199531360

VL - 114

JO - Learning and Individual Differences

JF - Learning and Individual Differences

SN - 1041-6080

M1 - 102518

ER -

Recently viewed

Publications

  1. The Bigger Picture of Corruption
  2. Flavonoids as biopesticides – Systematic assessment of sources, structures, activities and environmental fate
  3. Expertise for the public:
  4. Identifying user assistance systems for radiotherapy to increase efficiency and help saving lives
  5. Water-related problématiques
  6. GOMBRICH,ERNST,HANS, BETWEEN PATHOS AND ORNAMENT
  7. Public Value
  8. Preliminary data on help‐seeking intentions and behaviors of individuals completing a widely available online screen for eating disorders in the United States
  9. Intra-industry adjustment to import competition
  10. Atmospheric mercury over sea ice during the OASIS-2009 campaign
  11. The balanced scorecard’s missing link to compensation
  12. The effects of managerial preferences on the financial behaviour of small firms
  13. European External Action Service
  14. Coplanar micro-strips/electrospun sensor system to measure the electronics properties of the polyethylene oxide (PEO) electrospun
  15. Programm FAKE
  16. Fast Catch Bumerang
  17. Investigation on Flexible Coils Geometries for Inductive Power Transmission Systems
  18. Navigating cognition biases in the search of sustainability
  19. Virtual-exchange collaboration timeline planner
  20. Physical self-concept and physical activity enjoyment in elementary school children
  21. Impact Assessment of Emissions Stabilization Scenarios with and without Induced Technological Change
  22. Unterschiedliche Welten
  23. The global distribution of authorship in economics journals
  24. Testing of a Multiple Criteria Assessment Tool for Healthcare Facilities Quality and Sustainability
  25. The joint effects of supervisor knowledge hiding, abusive supervision, and employee political skill on employee knowledge hiding behaviors