Linguistic Determines Mathematics: How Linguistic Item Characteristics Influence the Difficulty of Mathematics Test Ttems

Activity: Talk or presentationConference PresentationsResearch

Timo Ehmke - Coauthor

The language characteristics of mathematics tests can influence the validity and the fairness of assessments especially for second language learners (Wolf & Leon, 2009). For example, Abedi and Lord (2001) showed that the students’ language background has an impact on their performance on math word problems and that their performance can be influenced through modifying the linguistic structure of the test. Furthermore, Martinello (2008) showed that the complexity of the linguistic structure of the test items can cause differential item functioning (DIF) for English Language Learners. According to this it is important for the evaluation and interpretation of assessments to consider a possible influence of language characteristics on the test scores.
The aim of this study was to analyze the impact of different language characteristics of about 280 mathematics items from the two mathematics assessments National Educational Panel Studie (NEPS) and Standard-based National Assessment in Germany (NA) on the item difficulty. The empirical basis for this analysis was built by a study where N=752 fourth graders were assessed with the NEPS and N=1584 fourth graders were assessed with the NA mathematics test. For the estimation of the item difficulty the one dimensional scaling of the Rasch-Model is used.
Furthermore the mathematics items were classified according to their language demands on word-level, sentence-level, text-level and presentation formats. In order to explore the relationships between the item difficulty and the language characteristics correlation analyses and regression analyses were carried out. The outcomes reveal an impact from divergent linguistic characteristics on the item difficulty, whereby the extent of the influence differs for distinct subpopulations (eg. migration).
These results enhance the importance of taking into account the impact certain linguistic characteristics of the mathematics items have on item difficulty for a valid evaluation and interpretation of the test scores and for creating fair test items.
06.11.201309.11.2013

Event

14th Annual Conference of the Association for Educational Assessment Europe - AEA 2013 : International surveys, policy borrowing and national assessment.

07.11.1309.11.13

Paris, France

Event: Other

Recently viewed

Activities

  1. Conference of SIG4 'Higher Education' & SIG17 'Qualitative and Quantitative Approaches to Learning and Instruction'
  2. Global Classroom. Introduction, presentation and workshop
  3. Spec­tral Ki­ne­tic Si­mu­la­ti­on of Ideal Mul­ti­po­le Re­so­nan­ce Probe
  4. Mental Parsing as A Mixed Blessing for Integrative Agreements: When Parsing Multiple Issues into Separate Mental Accounts Helps Versus Hurts Negotiators.
  5. Co-Production of Knowledge
  6. Competency-oriented written feedback in every-day mathematics teaching: How to report on students’ solutions of modelling tasks and how to assess the quality of these reports
  7. Winding the Sociotechnical Mangle of Organization
  8. Preliminary selection of experimental techniques in Subtask D
  9. BDSM Sagacity: embodying complexity
  10. "Curious and Concerned" – A mixed-methods study of teacher educators’ AI literacy, usage experience, and perceptions
  11. Assessing cognitive abilities for L2 learning: A review of accessible tools
  12. Dimension theory of representations of real numbers
  13. Project Workshop on "Worker Flows, Match Quality, and Productivity" - 2019
  14. Plenary Speaker at the 2022 5th IEEE International Conference on Information Communication and Signal Processing (ICICSP 2022). Plenary entitled "Soft Optimal Computing Techniques to Identify and Control Surface Roughness in Manufacturing".
  15. A Tool for Applications: Wavelet Packets
  16. E-learning module on “Participation” in the context of IWRM – “Social Science” Part
  17. The 22nd International Semantic Web Conference (ISWC 2023)
  18. Monitoring Phenological phases of the crops using TerraSAR-X Spotlight Images based on Factor Analysis

Publications

  1. Robust Flatness Based Control of an Electromagnetic Linear Actuator Using Adaptive PID Controller
  2. Considerations on efficient touch interfaces - How display size influences the performance in an applied pointing task
  3. Understanding reading as a form of language-use
  4. Stimulating Computing
  5. Introducing split orders and optimizing operational policies in robotic mobile fulfillment systems
  6. Robust feedback linearization control of a throttle plate by using an approximated pd regulator
  7. TRY plant trait database – enhanced coverage and open access
  8. Model predictive control for switching gain adaptation in a sliding mode controller of a DC drive with nonlinear friction
  9. Homogenization methods for multi-phase elastic composites
  10. Adjustable automation and manoeuvre control in automated driving
  11. Performance predictors for graphics processing units applied to dark-silicon-aware design space exploration
  12. Evaluating a Bayesian Student Model of Decimal Misconceptions
  13. The identification of up-And downstream industries using input-output tables and a firm-level application to minority shareholdings
  14. The structure of emotions in learning situations
  15. Detection of coherent oceanic structures via transfer operators
  16. Introduction: The representative turn in EU studies
  17. Taking notes as a strategy for solving reality-based tasks in mathematics
  18. Closed-form Solution for the Direct Kinematics Problem of the Planar 3-RPR Parallel Mechanism
  19. Towards productive functions?
  20. Factored MDPs for detecting topics of user sessions
  21. Who can receive the pass? A computational model for quantifying availability in soccer
  22. An Outcome-Oriented, Social-Ecological Framework for Assessing Protected Area Effectiveness
  23. Aspect-oriented software development
  24. Combining Evaluative and Generative Diagnosis in ActiveMath
  25. “Ideation is Fine, but Execution is Key”
  26. Towards a spatial understanding of identity play
  27. Foreign bias in institutional portfolio allocation