Predicting the Difficulty of Exercise Items for Dynamic Difficulty Adaptation in Adaptive Language Tutoring

Publikation: Beiträge in ZeitschriftenZeitschriftenaufsätzeForschungbegutachtet

Standard

Predicting the Difficulty of Exercise Items for Dynamic Difficulty Adaptation in Adaptive Language Tutoring. / Pandarova, Irina; Schmidt, Torben; Hartig, Johannes et al.
in: International Journal of Artificial Intelligence in Education, Jahrgang 29, Nr. 3, 15.08.2019, S. 342-367.

Publikation: Beiträge in ZeitschriftenZeitschriftenaufsätzeForschungbegutachtet

Harvard

APA

Vancouver

Bibtex

@article{348f671ee47740708ec089a02c9c14c2,
title = "Predicting the Difficulty of Exercise Items for Dynamic Difficulty Adaptation in Adaptive Language Tutoring",
abstract = "Advances in computer technology and artificial intelligence create opportunities for developing adaptive language learning technologies which are sensitive to individual learner characteristics. This paper focuses on one form of adaptivity in which the difficulty of learning content is dynamically adjusted to the learner{\textquoteright}s evolving language ability. A pilot study is presented which aims to advance the (semi-)automatic difficulty scoring of grammar exercise items to be used in dynamic difficulty adaptation in an intelligent language tutoring system for practicing English tenses. In it, methods from item response theory and machine learning are combined with linguistic item analysis in order to calibrate the difficulty of an initial exercise pool of cued gap-filling items (CGFIs) and isolate CGFI features predictive of item difficulty. Multiple item features at the gap, context and CGFI levels are tested and relevant predictors are identified at all three levels. Our pilot regression models reach encouraging prediction accuracy levels which could, pending additional validation, enable the dynamic selection of newly generated items ranging from moderately easy to moderately difficult. The paper highlights further applications of the proposed methodology in the area of adapting language tutoring, item design and second language acquisition, and sketches out issues for future research.",
keywords = "Didactics of English as a foreign language, adaptivity, Intelligent language tutoring systems, Idem difficulty prediction, Item response theory, Machine Learning, Scon language aquisition",
author = "Irina Pandarova and Torben Schmidt and Johannes Hartig and Ahc{\`e}ne Boubekki and Jones, {Roger Dale} and Ulf Brefeld",
note = "doi.org/10.1007/s40593-019-00180-4",
year = "2019",
month = aug,
day = "15",
doi = "10.1007/s40593-019-00180-4",
language = "English",
volume = "29",
pages = "342--367",
journal = "International Journal of Artificial Intelligence in Education",
issn = "1560-4306",
publisher = "Springer Netherlands",
number = "3",

}

RIS

TY - JOUR

T1 - Predicting the Difficulty of Exercise Items for Dynamic Difficulty Adaptation in Adaptive Language Tutoring

AU - Pandarova, Irina

AU - Schmidt, Torben

AU - Hartig, Johannes

AU - Boubekki, Ahcène

AU - Jones, Roger Dale

AU - Brefeld, Ulf

N1 - doi.org/10.1007/s40593-019-00180-4

PY - 2019/8/15

Y1 - 2019/8/15

N2 - Advances in computer technology and artificial intelligence create opportunities for developing adaptive language learning technologies which are sensitive to individual learner characteristics. This paper focuses on one form of adaptivity in which the difficulty of learning content is dynamically adjusted to the learner’s evolving language ability. A pilot study is presented which aims to advance the (semi-)automatic difficulty scoring of grammar exercise items to be used in dynamic difficulty adaptation in an intelligent language tutoring system for practicing English tenses. In it, methods from item response theory and machine learning are combined with linguistic item analysis in order to calibrate the difficulty of an initial exercise pool of cued gap-filling items (CGFIs) and isolate CGFI features predictive of item difficulty. Multiple item features at the gap, context and CGFI levels are tested and relevant predictors are identified at all three levels. Our pilot regression models reach encouraging prediction accuracy levels which could, pending additional validation, enable the dynamic selection of newly generated items ranging from moderately easy to moderately difficult. The paper highlights further applications of the proposed methodology in the area of adapting language tutoring, item design and second language acquisition, and sketches out issues for future research.

AB - Advances in computer technology and artificial intelligence create opportunities for developing adaptive language learning technologies which are sensitive to individual learner characteristics. This paper focuses on one form of adaptivity in which the difficulty of learning content is dynamically adjusted to the learner’s evolving language ability. A pilot study is presented which aims to advance the (semi-)automatic difficulty scoring of grammar exercise items to be used in dynamic difficulty adaptation in an intelligent language tutoring system for practicing English tenses. In it, methods from item response theory and machine learning are combined with linguistic item analysis in order to calibrate the difficulty of an initial exercise pool of cued gap-filling items (CGFIs) and isolate CGFI features predictive of item difficulty. Multiple item features at the gap, context and CGFI levels are tested and relevant predictors are identified at all three levels. Our pilot regression models reach encouraging prediction accuracy levels which could, pending additional validation, enable the dynamic selection of newly generated items ranging from moderately easy to moderately difficult. The paper highlights further applications of the proposed methodology in the area of adapting language tutoring, item design and second language acquisition, and sketches out issues for future research.

KW - Didactics of English as a foreign language

KW - adaptivity

KW - Intelligent language tutoring systems

KW - Idem difficulty prediction

KW - Item response theory

KW - Machine Learning

KW - Scon language aquisition

UR - http://www.scopus.com/inward/record.url?scp=85065811581&partnerID=8YFLogxK

UR - https://www.mendeley.com/catalogue/272a803a-842d-38d7-b186-cb3092c08c57/

U2 - 10.1007/s40593-019-00180-4

DO - 10.1007/s40593-019-00180-4

M3 - Journal articles

VL - 29

SP - 342

EP - 367

JO - International Journal of Artificial Intelligence in Education

JF - International Journal of Artificial Intelligence in Education

SN - 1560-4306

IS - 3

ER -

DOI

Zuletzt angesehen

Publikationen

  1. Classical PI Controllers with Anti-Windup Techniques Applied on Level Systems
  2. Lagged Multidimensional Recurrence Quantification Analysis for Determining Leader–Follower Relationships Within Multidimensional Time Series
  3. Effective informational entropy reduction in multi-robot systems based on real-time TVS
  4. Positioning Improvement for a Laser Scanning System using cSORPD control
  5. Improved sensorimotor control is not connected with improved proprioception
  6. Machine Learning and Knowledge Discovery in Databases
  7. Competing Vegetation Structure Indices for Estimating Spatial Constrains in Carabid Abundance Patterns in Chinese Grasslands Reveal Complex Scale and Habitat Patterns
  8. Advances in Dynamics, Optimization and Computation
  9. Does thinking-aloud affect learning, visual information processing and cognitive load when learning with seductive details as expected from self-regulation perspective?
  10. Cognitive load and instructionally supported learning with provided and learner-generated visualizations
  11. Resource extraction technologies - is a more responsible path of development possible?
  12. Using augmented video to test in-car user experiences of context analog HUDs
  13. Robust Control of Mobile Transportation Object with 3D Technical Vision System
  14. How Much Home Office is Ideal? A Multi-Perspective Algorithm
  15. Efficient Order Picking Methods in Robotic Mobile Fulfillment Systems
  16. Guided discovery learning with computer-based simulation games
  17. Probabilistic approach to modelling of recession curves
  18. Eighth Workshop on Mining and Learning with Graphs
  19. Mostly harmless econometrics? Statistical paradigms in the ‘top five’ from 2000 to 2018
  20. Learning and Re-learning from net- based cooperative learning discourses
  21. Using Heider’s Epistemology of Thing and Medium for Unpacking the Conception of Documents: Gantt Charts and Boundary Objects
  22. Topic Embeddings – A New Approach to Classify Very Short Documents Based on Predefined Topics
  23. Transfer operator-based extraction of coherent features on surfaces
  24. Optimising business performance with standard software systems
  25. Reality-Based Tasks with Complex-Situations
  26. On the Difficulty of Forgetting
  27. An experience-based learning framework
  28. Soft Skills for Hard Constraints
  29. Should learners use their hands for learning? Results from an eye-tracking study
  30. Influence of Process Parameters and Die Design on the Microstructure and Texture Development of Direct Extruded Magnesium Flat Products
  31. Introduction Mobile Digital Practices. Situating People, Things, and Data
  32. Integrating the underlying structure of stochasticity into community ecology