Effects and interaction of linguistic and subject-specific requirements in school-related assessment tasks

Project: Research

Project participants

Description

In the school subjects of mathematics and science, assessment tasks are frequently used to diagnose and measure students’ subject-specific competences and to provide them with feedback on their learning progress. Because these tasks are often presented in written form, linguistic competences are necessary pre-requisites in order to demonstrate subject-specific cognitive competences. But even though linguistic competences play a vital role for mental model building and the activation of previous knowledge, it is still largely unclear on empirical grounds in how far the linguistic requirements of assessment tasks influence their level of difficulty and how linguistic and subject-specific cognitive item features interact with each other.The aim of this study is therefore to investigate in an experimental design, how subject-specific cognitive requirements (UV1) and linguistic requirements (UV2) of assessment items in the domains of mathematics and physics influence empirical task difficulty. Besides the main effects (UV1, UV2), effects of interaction (UV1*UV2) are measured. The goal is to investigate if, and if yes, which individual learner variables (e.g. subject-specific and linguistic competences) influence empirical task difficulty. The treatment design of the experimental study is as follows: Students solve assessment tasks differing systematically in their subject-specific cognitive and linguistic requirements. The situational context is kept stable, as is the subject-specific domain in which the tasks are situated. Each assessment task is systematically varied on three subject-specific cognitive and three linguistic requirement levels (low, intermediate, high). This results in a 3x3 variation matrix for every task. 15 tasks are created for both subjects each, which in turn are varied within the 3x3 matrix design. The task variations are presented in rotated order in 9 test booklets. Students are randomly assigned to test booklets. Power analyses have identified an optimal sample size of 1350 students. The target group are 9th graders from three federal states of Germany. Methods of IRT are used for multidimensional scaling of the obtained data. This allows us to determine the task parameters for all test tasks and to analyse the effects of the subject-specific cognitive and the linguistics task requirements. Structural Equation Models and Multilevel Analysis which controls for the nested data structure are used for moderator analysis. This analysis allows to investigate which individual student variables influence the empirical task difficulty and in how far domain specific effects can be identified. The results will serve as the basis for practice-oriented recommendations for suitable task design for objective, reliable and valid diagnostic and achievement tests for subject-specific contexts.
StatusFinished
Period01.02.1931.08.23

Activities

Research outputs

Recently viewed

Publications

  1. Uncovered workers in plants covered by collective bargaining: Who are they and how do they fare?
  2. Learner pragmatics at the discourse level: Staying “on topic” in a telecollaborative eTandem task
  3. Digital Workplace Transformation: Subtraction Logic as Deinstitutionalising the Taken-for-Granted
  4. Clinical and functional outcome of assertive outreach for patients with schizophrenic disorder
  5. Can rare arable plants benefit biological pest control potential of cereal aphids in croplands?
  6. Blick über den Zaun: Leseförderung in Europa. Ergebnisse und Einsichten aus dem EU-Projekt ADORE
  7. Visualizing stakeholders’ willingness for collective action in participatory scenario planning
  8. Validierung des Adaptiven Tests des Emotionswissens für drei- bis neunjährige Kinder (ATEM 3 - 9)
  9. Science on ecosystems and people to support the Kunming-Montreal Global Biodiversity Framework
  10. Prediction of the tool change point in a polishing process using a modular software framework
  11. Personenbeförderungsgesetz; Lauterkeitsrecht; Rechtsbruchtatbestand; Mobilitätsdienstleistungen
  12. Können Corporate-Governance-Variablen die Qualität der Vergütungsberichte positiv beeinflussen?
  13. I share because of who I am: values, identities, norms, and attitudes explain sharing intentions
  14. Funciones agroecológicas de los nichos de agrobiodiversidad en la ruralidad de Bogotá, Colombia
  15. Experiential marketing as a tool to enhance Tourists’ pre-travel online destination experiences?
  16. Entrepreneurs and Freelancers: Are They Time and Income Multidimensional Poor? - The German Case
  17. Entertainment Education as a Means to Reduce Anti-Muslim Prejudice - For Whom Does It Work Best?
  18. Aktuelle Trends und Herausforderungen in der schulischen Prävention und Gesundheitsförderung
  19. Zur Vereinbarkeit rationalistischer und kulturalistischer Ansätze in der Politikwissenschaft
  20. The granular nature of the great export collapse in German manufacturing industries, 2008/2009
  21. Regionale Weiterbildung – Chance oder Sackgasse für Frauen in Sozialen und Gesundheitsberufen
  22. Reducing Environmental Pollution by Antibiotics through Design for Environmental Degradation
  23. Prospective Relations Between Adolescents' Social-emotional Competencies and Their Friendships
  24. Lexikalische Erwerbsstrategien auf der Basis primärsprachenunterrichtlicher Wortschatzarbeit
  25. Lässt sich Sensibilität für die Komplexität problemorientierten Mathematikunterrichts "messen"?
  26. Impacts of Multiple Environmental Change Drivers on Growth of European Beech (Fagus sylvatica)
  27. “I’ll Worry About It Tomorrow” – Fostering Emotion Regulation Skills to Overcome Procrastination
  28. A comprehensive method for determination of fatty acids in the initial oral biofilm (pellicle)
  29. Zum Demokratiedefizit in der Sozialen Arbeit mit ehemals rechtsorganisierten Rechtsextremen
  30. Umgang mit Pestiziden und deren Transformationsprodukten bei der Regenwasserbewirtschaftung
  31. Taking interdisciplinarity and transdisciplinarity to eye level with scientific disciplines
  32. Sustainable Statehood: Reflections on Critical (Pre-)Conditions, Requirements and Design Options
  33. Relativity in Social Cognition: Basic processes and novel applications of social comparisons
  34. oREV: An item response theory-based open receptive vocabulary task for 3- to 8-year-old children
  35. Mapping water ecosystem services: Evaluating InVEST model predictions in data scarce regions
  36. Joppke, Christian (2021): Neoliberal Nationalism. Immigration and the Rise of the Populist Right
  37. Experimental Verification of the Impact of Radial Internal Clearance on a Bearing's Dynamics
  38. Examining how AI capabilities can foster organizational performance in public organizations
  39. Die Wahrnehmung von temporaler Textkohäsion durch Schüler/-innen am Beispiel eines Sachtextes
  40. Biodiversity–stability relationships strengthen over time in a long-term grassland experiment
  41. Activity–rest schedules in physically demanding work and the variation of responses with age
  42. Activating an Integrative Mindset Improves the Subjective Outcomes of Value-Driven Conflicts
  43. Supportive Mental Health Self-Monitoring among Smartphone Users with Psychological Distress
  44. Maternal transfer of emerging brominated and chlorinated flame retardants in European eels
  45. IT-Effizienzverstärker oder Komplexitätsbetreiber in der analytischen Unternehmenssteuerung?
  46. Intuition – der einfache Weg? Rezension der Bücher von Gerd Gigerenzer und Gerald Traufetter
  47. Innovatives Lernen zwischen betrieblichen Anforderungen und nachhaltigen Herausforderungen