1. //
  2. Start
  3. //
  4. Publications
  5. Predicting the Difficulty of Exercise It...
  6. Output formats
  7. //

Predicting the Difficulty of Exercise Items for Dynamic Difficulty Adaptation in Adaptive Language Tutoring

Research output: Journal contributions › Journal articles › Research › peer-review

Standard

Predicting the Difficulty of Exercise Items for Dynamic Difficulty Adaptation in Adaptive Language Tutoring. / Pandarova, Irina; Schmidt, Torben; Hartig, Johannes et al.
In: International Journal of Artificial Intelligence in Education, Vol. 29, No. 3, 15.08.2019, p. 342-367.

Research output: Journal contributions › Journal articles › Research › peer-review

Harvard

Pandarova, I, Schmidt, T, Hartig, J, Boubekki, A, Jones, RD & Brefeld, U 2019, 'Predicting the Difficulty of Exercise Items for Dynamic Difficulty Adaptation in Adaptive Language Tutoring', International Journal of Artificial Intelligence in Education, vol. 29, no. 3, pp. 342-367. https://doi.org/10.1007/s40593-019-00180-4

APA

Pandarova, I., Schmidt, T., Hartig, J., Boubekki, A., Jones, R. D., & Brefeld, U. (2019). Predicting the Difficulty of Exercise Items for Dynamic Difficulty Adaptation in Adaptive Language Tutoring. International Journal of Artificial Intelligence in Education, 29(3), 342-367. https://doi.org/10.1007/s40593-019-00180-4

Vancouver

Pandarova I, Schmidt T, Hartig J, Boubekki A, Jones RD, Brefeld U. Predicting the Difficulty of Exercise Items for Dynamic Difficulty Adaptation in Adaptive Language Tutoring. International Journal of Artificial Intelligence in Education. 2019 Aug 15;29(3):342-367. Epub 2019 May 13. doi: 10.1007/s40593-019-00180-4

Bibtex

@article{348f671ee47740708ec089a02c9c14c2,
title = "Predicting the Difficulty of Exercise Items for Dynamic Difficulty Adaptation in Adaptive Language Tutoring",
abstract = "Advances in computer technology and artificial intelligence create opportunities for developing adaptive language learning technologies which are sensitive to individual learner characteristics. This paper focuses on one form of adaptivity in which the difficulty of learning content is dynamically adjusted to the learner{\textquoteright}s evolving language ability. A pilot study is presented which aims to advance the (semi-)automatic difficulty scoring of grammar exercise items to be used in dynamic difficulty adaptation in an intelligent language tutoring system for practicing English tenses. In it, methods from item response theory and machine learning are combined with linguistic item analysis in order to calibrate the difficulty of an initial exercise pool of cued gap-filling items (CGFIs) and isolate CGFI features predictive of item difficulty. Multiple item features at the gap, context and CGFI levels are tested and relevant predictors are identified at all three levels. Our pilot regression models reach encouraging prediction accuracy levels which could, pending additional validation, enable the dynamic selection of newly generated items ranging from moderately easy to moderately difficult. The paper highlights further applications of the proposed methodology in the area of adapting language tutoring, item design and second language acquisition, and sketches out issues for future research.",
keywords = "Didactics of English as a foreign language, adaptivity, Intelligent language tutoring systems, Idem difficulty prediction, Item response theory, Machine Learning, Scon language aquisition",
author = "Irina Pandarova and Torben Schmidt and Johannes Hartig and Ahc{\`e}ne Boubekki and Jones, {Roger Dale} and Ulf Brefeld",
note = "doi.org/10.1007/s40593-019-00180-4",
year = "2019",
month = aug,
day = "15",
doi = "10.1007/s40593-019-00180-4",
language = "English",
volume = "29",
pages = "342--367",
journal = "International Journal of Artificial Intelligence in Education",
issn = "1560-4306",
publisher = "Springer Netherlands",
number = "3",

}

RIS

TY - JOUR

T1 - Predicting the Difficulty of Exercise Items for Dynamic Difficulty Adaptation in Adaptive Language Tutoring

AU - Pandarova, Irina

AU - Schmidt, Torben

AU - Hartig, Johannes

AU - Boubekki, Ahcène

AU - Jones, Roger Dale

AU - Brefeld, Ulf

N1 - doi.org/10.1007/s40593-019-00180-4

PY - 2019/8/15

Y1 - 2019/8/15

N2 - Advances in computer technology and artificial intelligence create opportunities for developing adaptive language learning technologies which are sensitive to individual learner characteristics. This paper focuses on one form of adaptivity in which the difficulty of learning content is dynamically adjusted to the learner’s evolving language ability. A pilot study is presented which aims to advance the (semi-)automatic difficulty scoring of grammar exercise items to be used in dynamic difficulty adaptation in an intelligent language tutoring system for practicing English tenses. In it, methods from item response theory and machine learning are combined with linguistic item analysis in order to calibrate the difficulty of an initial exercise pool of cued gap-filling items (CGFIs) and isolate CGFI features predictive of item difficulty. Multiple item features at the gap, context and CGFI levels are tested and relevant predictors are identified at all three levels. Our pilot regression models reach encouraging prediction accuracy levels which could, pending additional validation, enable the dynamic selection of newly generated items ranging from moderately easy to moderately difficult. The paper highlights further applications of the proposed methodology in the area of adapting language tutoring, item design and second language acquisition, and sketches out issues for future research.

AB - Advances in computer technology and artificial intelligence create opportunities for developing adaptive language learning technologies which are sensitive to individual learner characteristics. This paper focuses on one form of adaptivity in which the difficulty of learning content is dynamically adjusted to the learner’s evolving language ability. A pilot study is presented which aims to advance the (semi-)automatic difficulty scoring of grammar exercise items to be used in dynamic difficulty adaptation in an intelligent language tutoring system for practicing English tenses. In it, methods from item response theory and machine learning are combined with linguistic item analysis in order to calibrate the difficulty of an initial exercise pool of cued gap-filling items (CGFIs) and isolate CGFI features predictive of item difficulty. Multiple item features at the gap, context and CGFI levels are tested and relevant predictors are identified at all three levels. Our pilot regression models reach encouraging prediction accuracy levels which could, pending additional validation, enable the dynamic selection of newly generated items ranging from moderately easy to moderately difficult. The paper highlights further applications of the proposed methodology in the area of adapting language tutoring, item design and second language acquisition, and sketches out issues for future research.

KW - Didactics of English as a foreign language

KW - adaptivity

KW - Intelligent language tutoring systems

KW - Idem difficulty prediction

KW - Item response theory

KW - Machine Learning

KW - Scon language aquisition

UR - http://www.scopus.com/inward/record.url?scp=85065811581&partnerID=8YFLogxK

UR - https://www.mendeley.com/catalogue/272a803a-842d-38d7-b186-cb3092c08c57/

U2 - 10.1007/s40593-019-00180-4

DO - 10.1007/s40593-019-00180-4

M3 - Journal articles

VL - 29

SP - 342

EP - 367

JO - International Journal of Artificial Intelligence in Education

JF - International Journal of Artificial Intelligence in Education

SN - 1560-4306

IS - 3

ER -

Other publications by the same author(s)

Connecting sustainability and culture: Building competencies through virtual exchange

Birdman, J., Çelik, H., Pandarova, I., Barron, A., Benitt, N. & Schmidt, T., 08.04.2025, North American and European Perspectives on Sustainability in Higher Education. Leal Filho, W., Newman, J., Lange Salvia, A., Viera Trevisan, L. & Corazza, L. (eds.). Cham: Springer Nature Switzerland AG, p. 729-747 19 p. (World Sustainability Series; vol. Part F280).

Research output: Contributions to collected editions/works › Chapter › peer-review

DELT – Digitally-Enhanced Language Teaching: Ein standortübergreifendes Lehr-Lernkonzept zur digitalisierungsbezogenen Professionalisierung von Englischlehramtsstudierenden

Schmidt, J., Klaasen, L., Wucherpfennig, S., Blume, C., Rossa, H. & Schmidt, T., 14.04.2025, Grenzen, Grenzräume, Entgrenzungen: Perspektiven in der Fremdsprachenforschung. Kulovics, N., Mentz, O. & Raith, T. (eds.). Bielefeld: wbv Media, p. 167-183 17 p. (Beiträge zur Fremdsprachenforschung; vol. 18).

Research output: Contributions to collected editions/works › Article in conference proceedings › Research › peer-review

Effective digital practice in the competence-oriented English as a foreign language classroom in Germany: Focus on L2 development and feedback in an intelligent tutorial system

Schmidt, T. & Pili-Moss, D., 14.05.2025, Innovative Teaching and Classroom Processes: Research Perspectives from Germany and China. Ehmke, T. & Lee, J.C.-K. (eds.). Routledge Taylor & Francis Group, p. 146-158 13 p.

Research output: Contributions to collected editions/works › Contributions to collected editions/anthologies › Research › peer-review

Implicit statistical learning and working memory predict EFL development and written task outcomes in adolescents

Pili-Moss, D., Hamrick, P., Schmidt, T., Meurers, D. & Wendebourg, K., 01.07.2025, In: System. 131, 14 p., 103656.

Research output: Journal contributions › Journal articles › Research › peer-review

Inszenierung

Küppers, A. & Schmidt, T., 15.02.2025, Metzler Lexikon Fremdsprachendidaktik : Ansätze – Methoden – Grundbegriffe. Surkamp, C. (ed.). 3 ed. Stuttgart: J.B. Metzler, p. 202-203 2 p.

Research output: Contributions to collected editions/works › Chapter › peer-review

DOI

Recently viewed

Activities

  1. Discerning aspects of memory: The ethics of memory in (post)global and transnational contexts
  2. Orientation workshop on "historical research projects using geographical data and GIS technology" - 2013
  3. Improving the quality of selecting applicants for university student programs
  4. Review in Application Process for External University
  5. Thematic and Task-Based Categorization of K-12 GenAI Usages with Hierarchical Topic Modeling
  6. Detection time analysis of propulsion system fault effects in a hexacopter
  7. Is there only one modelling competency? The question of situated cognition when solving real world problems
  8. Judgement Practices in the Artistic Field
  9. Convergence analysis of an approximated response function of the impedance probe
  10. Implementing aspects of inquiry-based learning in secondary chemistry classes: a case study

Publications

  1. Parking space management through deep learning – an approach for automated, low-cost and scalable real-time detection of parking space occupancy
  2. The Use of Genetic Algorithm for PID Controller Auto-Tuning in ARM CORTEX M4 Platform
  3. Framework for the Parallelized Development of Estimation Tasks for Length, Area, Capacity and Volume in Primary School - A Pilot Study
  4. Changing the Administration from within:
  5. Using cross-recurrence quantification analysis to compute similarity measures for time series of unequal length with applications to sleep stage analysis
  6. Stepwise-based optimizing approaches for arrangements of loudspeaker in multi-zone sound field reproduction
  7. Contributions of declarative and procedural memory to accuracy and automatization during second language practice
  8. On the Functional Controllability Using a Geometric Approach together with a Decoupled MPC for Motion Control in Robotino
  9. On the Power and Performance of a Doubly Latent Residual Approach to Explain Latent Specific Factors in Multilevel-Bifactor-(S-1) Models
  10. Modeling and numerical simulation of multiscale behavior in polycrystals via extended crystal plasticity
  11. Using learning protocols for knowledge acquisition and problem solving with individual and group incentives
  12. An extended analytical approach to evaluating monotonic functions of fuzzy numbers
  13. FaST: A linear time stack trace alignment heuristic for crash report deduplication
  14. Age effects on controlling tools with sensorimotor transformations
  15. Age effects on controlling tools with sensorimotor transformations
  16. Predicting the Difficulty of Exercise Items for Dynamic Difficulty Adaptation in Adaptive Language Tutoring
  17. Distinguishing state variability from trait change in longitudinal data
  18. Return of Fibonacci random walks
  19. Knowledge Graph Question Answering Using Graph-Pattern Isomorphism
  20. Artificial Intelligence Algorithms for Collaborative Book Recommender Systems
  21. A discrete approximate solution for the asymptotic tracking problem in affine nonlinear systems
  22. A Switching Cascade Sliding PID-PID Controllers Combined with a Feedforward and an MPC for an Actuator in Camless Internal Combustion Engines
  23. Appendix A: Design, implementation, and analysis of the iGOES project
  24. Evaluation of Time/Phase Parameters in Frequency Measurements for Inertial Navigation Systems
  25. Modelling and implementation of an Order2Cash Process in distributed systems
  26. Investigation and modeling of the material behavior due to evolving dislocation microstructures in fcc and bcc metals
  27. The Scalable Question Answering Over Linked Data (SQA) Challenge 2018
  28. 7th open challenge on question answering over linked data (QALD-7)
  29. Effectiveness of a guided multicomponent internet and mobile gratitude training program - A pragmatic randomized controlled trial
  30. Graphism and Flatness. The Line as Mediator between Time and Space, Intuition and Concept
  31. An expert-based reference list of variables for characterizing and monitoring social-ecological systems
  32. Homogenization modeling of thin-layer-type microstructures
  33. Integration of laser scanning and projection speckle pattern for advanced pipeline monitoring
  34. Considerations on efficient touch interfaces - How display size influences the performance in an applied pointing task
  35. An Orthogonal Wavelet Denoising Algorithm for Surface Images of Atomic Force Microscopy
  36. Expertise in research integration and implementation for tackling complex problems
  37. For a return to the forgotten formula: 'Data 1 + Data 2 > Data 1'