Predicting the Difficulty of Exercise Items for Dynamic Difficulty Adaptation in Adaptive Language Tutoring

Publikation: Beiträge in ZeitschriftenZeitschriftenaufsätzeForschungbegutachtet

Standard

Predicting the Difficulty of Exercise Items for Dynamic Difficulty Adaptation in Adaptive Language Tutoring. / Pandarova, Irina; Schmidt, Torben; Hartig, Johannes et al.
in: International Journal of Artificial Intelligence in Education, Jahrgang 29, Nr. 3, 15.08.2019, S. 342-367.

Publikation: Beiträge in ZeitschriftenZeitschriftenaufsätzeForschungbegutachtet

Harvard

APA

Vancouver

Bibtex

@article{348f671ee47740708ec089a02c9c14c2,
title = "Predicting the Difficulty of Exercise Items for Dynamic Difficulty Adaptation in Adaptive Language Tutoring",
abstract = "Advances in computer technology and artificial intelligence create opportunities for developing adaptive language learning technologies which are sensitive to individual learner characteristics. This paper focuses on one form of adaptivity in which the difficulty of learning content is dynamically adjusted to the learner{\textquoteright}s evolving language ability. A pilot study is presented which aims to advance the (semi-)automatic difficulty scoring of grammar exercise items to be used in dynamic difficulty adaptation in an intelligent language tutoring system for practicing English tenses. In it, methods from item response theory and machine learning are combined with linguistic item analysis in order to calibrate the difficulty of an initial exercise pool of cued gap-filling items (CGFIs) and isolate CGFI features predictive of item difficulty. Multiple item features at the gap, context and CGFI levels are tested and relevant predictors are identified at all three levels. Our pilot regression models reach encouraging prediction accuracy levels which could, pending additional validation, enable the dynamic selection of newly generated items ranging from moderately easy to moderately difficult. The paper highlights further applications of the proposed methodology in the area of adapting language tutoring, item design and second language acquisition, and sketches out issues for future research.",
keywords = "Didactics of English as a foreign language, adaptivity, Intelligent language tutoring systems, Idem difficulty prediction, Item response theory, Machine Learning, Scon language aquisition",
author = "Irina Pandarova and Torben Schmidt and Johannes Hartig and Ahc{\`e}ne Boubekki and Jones, {Roger Dale} and Ulf Brefeld",
note = "doi.org/10.1007/s40593-019-00180-4",
year = "2019",
month = aug,
day = "15",
doi = "10.1007/s40593-019-00180-4",
language = "English",
volume = "29",
pages = "342--367",
journal = "International Journal of Artificial Intelligence in Education",
issn = "1560-4306",
publisher = "Springer Netherlands",
number = "3",

}

RIS

TY - JOUR

T1 - Predicting the Difficulty of Exercise Items for Dynamic Difficulty Adaptation in Adaptive Language Tutoring

AU - Pandarova, Irina

AU - Schmidt, Torben

AU - Hartig, Johannes

AU - Boubekki, Ahcène

AU - Jones, Roger Dale

AU - Brefeld, Ulf

N1 - doi.org/10.1007/s40593-019-00180-4

PY - 2019/8/15

Y1 - 2019/8/15

N2 - Advances in computer technology and artificial intelligence create opportunities for developing adaptive language learning technologies which are sensitive to individual learner characteristics. This paper focuses on one form of adaptivity in which the difficulty of learning content is dynamically adjusted to the learner’s evolving language ability. A pilot study is presented which aims to advance the (semi-)automatic difficulty scoring of grammar exercise items to be used in dynamic difficulty adaptation in an intelligent language tutoring system for practicing English tenses. In it, methods from item response theory and machine learning are combined with linguistic item analysis in order to calibrate the difficulty of an initial exercise pool of cued gap-filling items (CGFIs) and isolate CGFI features predictive of item difficulty. Multiple item features at the gap, context and CGFI levels are tested and relevant predictors are identified at all three levels. Our pilot regression models reach encouraging prediction accuracy levels which could, pending additional validation, enable the dynamic selection of newly generated items ranging from moderately easy to moderately difficult. The paper highlights further applications of the proposed methodology in the area of adapting language tutoring, item design and second language acquisition, and sketches out issues for future research.

AB - Advances in computer technology and artificial intelligence create opportunities for developing adaptive language learning technologies which are sensitive to individual learner characteristics. This paper focuses on one form of adaptivity in which the difficulty of learning content is dynamically adjusted to the learner’s evolving language ability. A pilot study is presented which aims to advance the (semi-)automatic difficulty scoring of grammar exercise items to be used in dynamic difficulty adaptation in an intelligent language tutoring system for practicing English tenses. In it, methods from item response theory and machine learning are combined with linguistic item analysis in order to calibrate the difficulty of an initial exercise pool of cued gap-filling items (CGFIs) and isolate CGFI features predictive of item difficulty. Multiple item features at the gap, context and CGFI levels are tested and relevant predictors are identified at all three levels. Our pilot regression models reach encouraging prediction accuracy levels which could, pending additional validation, enable the dynamic selection of newly generated items ranging from moderately easy to moderately difficult. The paper highlights further applications of the proposed methodology in the area of adapting language tutoring, item design and second language acquisition, and sketches out issues for future research.

KW - Didactics of English as a foreign language

KW - adaptivity

KW - Intelligent language tutoring systems

KW - Idem difficulty prediction

KW - Item response theory

KW - Machine Learning

KW - Scon language aquisition

UR - http://www.scopus.com/inward/record.url?scp=85065811581&partnerID=8YFLogxK

UR - https://www.mendeley.com/catalogue/272a803a-842d-38d7-b186-cb3092c08c57/

U2 - 10.1007/s40593-019-00180-4

DO - 10.1007/s40593-019-00180-4

M3 - Journal articles

VL - 29

SP - 342

EP - 367

JO - International Journal of Artificial Intelligence in Education

JF - International Journal of Artificial Intelligence in Education

SN - 1560-4306

IS - 3

ER -

DOI

Zuletzt angesehen

Publikationen

  1. Using Fuzzy PD Controllers for Soft Motions in a Car-like Robot
  2. An evaluation of BPR methodologies adopting NIMSAD: A systematic framework for understanding and evaluating methodologies
  3. An analytical approach to evaluating monotonic functions of fuzzy numbers
  4. GENESIS - A generic RDF data access interface
  5. Advantages and Disadvanteges of Different Text Coding Procedures for Research and Practice in a School Context
  6. An integrative research framework for enabling transformative adaptation
  7. ENVISIONING PROTECTED AREAS THROUGH PARTICIPATORY SCENARIO PLANNING: NAVIGATING COVERAGE AND EFFECTIVENESS CHALLENGES AHEAD
  8. Exploring Leverages and Pitfalls of Context Collapse in Modern Communication
  9. Biodiversity in space and time - towards a grid mapping for Mongolia
  10. Neural correlates of own name and own face processing in neurotypical adults scoring low versus high on symptomatology of autism spectrum disorder
  11. Challenging the status quo of accelerator research: Concluding remarks
  12. Behavior in the context of control
  13. Explaining Disagreement on Interest Rates in a Taylor-Rule Setting
  14. The role of spatial ability when fostering mental animation in multimedia learning
  15. Computational history of knowledge
  16. Instruments for research on transition. Applied methods and approaches for exploring the transition of young care leavers to adulthood
  17. Working memory capacity and narrative task performance
  18. “Smart is not smart enough!” Anticipating critical raw material use in smart city concepts
  19. From teacher-centered instruction to peer tutoring in the heterogeneous international classroom
  20. Predator diversity and abundance provide little support for the enemies hypothesis in forests of high tree diversity
  21. Tracing Concepts
  22. Introduction
  23. Maschinenbelegungsplanung mit evolutionären Algorithmen
  24. Cross-hedging minimum return guarantees
  25. Atmospheric gas-particle partitioning versus gaseous/particle-bound deposition of SVOCs
  26. Importance of timing
  27. Article 21 Formal Validity
  28. Facing complex crime
  29. Mouseology – Ludic Interfaces – Zero Interfaces
  30. A(l)gora: the Mindscape