A Learning Agent for Parameter Adaptation in Speeded Tests

Activity: Talk or presentationConference PresentationsResearch

Daniel Bengs - Speaker

Ulf Brefeld - Speaker

The assessment of a person’s traits such as ability is a fundamental
problem in human sciences. Compared to traditional paper
and pencil tests, computer based assessment not only facilitates data
acquisition and processing, but also allows for real-time adaptivity and
personalization. By adaptively selecting tasks for each test subject, competency
levels can be assessed with fewer items. We focus on assessments
of traits that can be measured by determining the shortest time limit allowing
a testee to solve simple repetitive tasks (speed tests). Existing approaches
for adjusting the time limit are either intrinsically non-adaptive
or lack theoretical foundation. By contrast, we propose a mathematically
sound framework in which latent competency skills are represented by
belief distributions on compact intervals. The algorithm iteratively computes
a new difficulty setting, such that the amount of belief that can be
updated after feedback has been received is maximized. We rigorously
prove a bound on the algorithms’ step size paving the way for convergence
analysis. Empirical simulations show that our method performs
equally well or better than state of the art baselines in a near-realistic
scenario simulating testee behaviour under different assumptions.
23.09.201627.09.2016

Event

European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases - ECML-PKDD 2016

23.09.1627.09.16

Riva del Garda, Italy

Event: Conference

Recently viewed

Activities

  1. The Water Framework Directive: Policy Implementation Through Multi-Level Governance
  2. Transdisciplinary Evaluation of Alternative Adaptation Strategies Value-Tree Method as a Tool to Integrate Multiple Values of Science, Practice and the General Public into Decision-Making
  3. Meta analysis as a strategy of evidence-based participation research: The example of the project ‘EDGE’
  4. Analysis of kinetic damping in the spectrum of the impedance probe by means of a block-based LU decomposition
  5. Didacta - 2006
  6. GIS program – Geographischer Informationssyteme
  7. Professional Development Workshop on “What Were You Thinking: Developing Cognitive Sensibilities for Inductive Coding” with Arne Carlsen, Martha Feldman, Claus Rerup, Heather Vogue, and Kristina Workman
  8. Session "The technological cause of entropy"
  9. The control of life and everything living. Biohacking as a Technology of Cybernetic Biopolitics
  10. Realizing Potentials
  11. Dimo Dimov
  12. Legitimizing museums as an agent of social change?
  13. Dokumentation und Qualitätssicherung vor Ort
  14. MA-Arbeit 2017
  15. Virtual Doctoral-Postdoctoral Seminar on Social-Symbolic Work
  16. Is Neoliberalism Still Spreading?
  17. Kritiken des Leidens
  18. Leuphana Startwoche 2016
  19. Expressivity in Lessing, Wittgenstein and Adorno
  20. "Neue MusikmachDinge: Augmented Creativity and Connectivity?"
  21. Wie lässt sich Unterrichtsfeedbackkompetenz messen? Entwicklung und Validierung eines videobasierten Instruments zur Erfassung der Unterrichtsfeedbackkompetenz
  22. Journal of European Public Policy (Fachzeitschrift)
  23. Between standardization and creativity: The role of strategic temporal (dis-)entrainment in drug development processes
  24. Focusing Events and Changes in the Regulation of Labour Standards in Australian and German Garment Supply Chains
  25. Einleitung zur Konferenz