Reality-based tasks for competency-based education: The need for an integrated analysis of subject-specific, linguistic, and contextual task features

Research output: Journal contributionsJournal articlesResearchpeer-review

Standard

Harvard

APA

Vancouver

Bibtex

@article{604190d7741548df9d4de61649a47a79,
title = "Reality-based tasks for competency-based education: The need for an integrated analysis of subject-specific, linguistic, and contextual task features",
abstract = "In evaluating competency-based education, effective test instruments must address real-life complexities. The impact of subject-specific, linguistic, and contextual task features, alongside central personal characteristics, on the empirical challenge of such tasks is unclear. We developed mathematics tasks from 30 real-world contexts, each with three questions of varying complexity, administered through a systematically rotated experimental design to 535 German grades 9 and 10 students. Various student variables were collected. Generalized linear mixed models revealed that contextual and mathematical task features significantly contributed to task difficulty variance. Language features had no intermediate-level influence, while students' mathematical self-efficacy moderated low task context familiarity's impact. These findings guide the construction of reality-based mathematics tasks to tailor empirical difficulty. Educational relevance: In the context of worldwide competence-orientated education, it is crucial to reform in-class and national tests. Traditional task formats are limited in representing authentic problems. In most school subjects, a lack of understanding exists in designing reality-based competence-oriented tasks that ensure fair test conditions and meet the subjects' normative demands. This study addresses this gap by empirically investigating the interplay of subject-related, linguistic, and contextual aspects of reality-based tasks in mathematics. Teachers and researchers can use these insights to improve competence-oriented performance situations, sparking further questions. These findings encourage similar studies across subjects for broader applicability.",
keywords = "Assessment, Competency-based education, Language competence, Mathematical competence, Test items, Mathematics, Didactics of Mathematics",
author = "Dominik Leiss and Timo Ehmke and Lena Heine",
note = "Publisher Copyright: {\textcopyright} 2024 The Authors",
year = "2024",
month = aug,
day = "1",
doi = "10.1016/j.lindif.2024.102518",
language = "English",
volume = "114",
journal = "Learning and Individual Differences",
issn = "1041-6080",
publisher = "Elsevier B.V.",

}

RIS

TY - JOUR

T1 - Reality-based tasks for competency-based education

T2 - The need for an integrated analysis of subject-specific, linguistic, and contextual task features

AU - Leiss, Dominik

AU - Ehmke, Timo

AU - Heine, Lena

N1 - Publisher Copyright: © 2024 The Authors

PY - 2024/8/1

Y1 - 2024/8/1

N2 - In evaluating competency-based education, effective test instruments must address real-life complexities. The impact of subject-specific, linguistic, and contextual task features, alongside central personal characteristics, on the empirical challenge of such tasks is unclear. We developed mathematics tasks from 30 real-world contexts, each with three questions of varying complexity, administered through a systematically rotated experimental design to 535 German grades 9 and 10 students. Various student variables were collected. Generalized linear mixed models revealed that contextual and mathematical task features significantly contributed to task difficulty variance. Language features had no intermediate-level influence, while students' mathematical self-efficacy moderated low task context familiarity's impact. These findings guide the construction of reality-based mathematics tasks to tailor empirical difficulty. Educational relevance: In the context of worldwide competence-orientated education, it is crucial to reform in-class and national tests. Traditional task formats are limited in representing authentic problems. In most school subjects, a lack of understanding exists in designing reality-based competence-oriented tasks that ensure fair test conditions and meet the subjects' normative demands. This study addresses this gap by empirically investigating the interplay of subject-related, linguistic, and contextual aspects of reality-based tasks in mathematics. Teachers and researchers can use these insights to improve competence-oriented performance situations, sparking further questions. These findings encourage similar studies across subjects for broader applicability.

AB - In evaluating competency-based education, effective test instruments must address real-life complexities. The impact of subject-specific, linguistic, and contextual task features, alongside central personal characteristics, on the empirical challenge of such tasks is unclear. We developed mathematics tasks from 30 real-world contexts, each with three questions of varying complexity, administered through a systematically rotated experimental design to 535 German grades 9 and 10 students. Various student variables were collected. Generalized linear mixed models revealed that contextual and mathematical task features significantly contributed to task difficulty variance. Language features had no intermediate-level influence, while students' mathematical self-efficacy moderated low task context familiarity's impact. These findings guide the construction of reality-based mathematics tasks to tailor empirical difficulty. Educational relevance: In the context of worldwide competence-orientated education, it is crucial to reform in-class and national tests. Traditional task formats are limited in representing authentic problems. In most school subjects, a lack of understanding exists in designing reality-based competence-oriented tasks that ensure fair test conditions and meet the subjects' normative demands. This study addresses this gap by empirically investigating the interplay of subject-related, linguistic, and contextual aspects of reality-based tasks in mathematics. Teachers and researchers can use these insights to improve competence-oriented performance situations, sparking further questions. These findings encourage similar studies across subjects for broader applicability.

KW - Assessment

KW - Competency-based education

KW - Language competence

KW - Mathematical competence

KW - Test items

KW - Mathematics

KW - Didactics of Mathematics

UR - http://www.scopus.com/inward/record.url?scp=85199531360&partnerID=8YFLogxK

UR - https://www.mendeley.com/catalogue/fefc46d0-4f85-36d3-a079-f4edccba3532/

U2 - 10.1016/j.lindif.2024.102518

DO - 10.1016/j.lindif.2024.102518

M3 - Journal articles

AN - SCOPUS:85199531360

VL - 114

JO - Learning and Individual Differences

JF - Learning and Individual Differences

SN - 1041-6080

M1 - 102518

ER -

Recently viewed

Publications

  1. The effects of pre-intervention mindset induction on a brief intervention to increase risk perception and reduce alcohol use among university students
  2. Using structure biodegradability relationships for environmentally benign design of organosilicons – An experimental comparison of organosilicons and their carbon analogues
  3. Technology management and collaboration profile: virtual companies and industrial platforms in the high-tech biotechnology industries
  4. Interdisciplinary engineering education in the context of digitalization and global transformation prozesses.
  5. Punitive Damages
  6. Die Unternehmergesellschaft
  7. Is a severe clinical profile an effect modifier in a web-based depression treatment for adults with type 1 or type 2 diabetes ?
  8. Pragmatic Competence in EIL
  9. Textkohärenz in mathematischen Modellierungsaufgaben
  10. Jonathan Swift, Travels into Several Remote Nations of the World
  11. What makes for trusting relationships in online communication?
  12. Innovation for Sustainability
  13. Matching between oral inward–outward movements of object names and oral movements associated with denoted objects
  14. Vermittlungstheologie II. Dogmatisch
  15. Fictions of the Possible
  16. Environmental Indicators for Business
  17. New ways in engineering education for a sustainable and smart future
  18. Existenzgründung
  19. Design of a Master of Science Sustainable Chemistry
  20. Stir bar sorptive extraction and high-performance liquid chromatography-fluorescence detection for the determination of polycyclic aromatic hydrocarbons in Mate teas
  21. Co-Shaping an Ecosystem for Responsible AI
  22. A comprehensive method for determination of fatty acids in the initial oral biofilm (pellicle)
  23. Working time flexibility and work-life balance
  24. Targeted metabolomics of pellicle and saliva in children with different caries activity
  25. A three-armed randomised controlled trial investigating the comparative impact of guidance on the efficacy of a web-based stress management intervention and health impairing and promoting mechanisms of prevention