Masked Autoencoder Pretraining for Event Classification in Elite Soccer

Research output: Contributions to collected editions/worksArticle in conference proceedingsResearchpeer-review

Authors

We show that pretraining transformer models improves the performance on supervised classification of tracking data from elite soccer. Specifically, we propose a novel self-supervised masked autoencoder for multiagent trajectories. In contrast to related work, our approach is significantly simpler, has no necessity for handcrafted features and inherently allows for permutation invariance in downstream tasks.

Original languageEnglish
Title of host publicationMachine Learning and Data Mining for Sports Analytics : 10th International Workshop, MLSA 2023, Revised Selected Papers
EditorsUlf Brefeld, Jesse Davis, Jan Van Haaren, Albrecht Zimmermann
Number of pages12
Place of PublicationCham
PublisherSpringer Nature Switzerland AG
Publication date26.02.2024
Pages24-35
ISBN (print)978-3-031-53832-2
ISBN (electronic)978-3-031-53833-9
DOIs
Publication statusPublished - 26.02.2024
Event10th International Workshop on Machine Learning and Data Mining for Sports Analytics - MLSA 2023 - Turin, Italy
Duration: 18.09.202318.09.2023
Conference number: 10
https://dtai.cs.kuleuven.be/events/MLSA23/
http://www.wikicfp.com/cfp/servlet/event.showcfp?eventid=173575&copyownerid=49896

Bibliographical note

Publisher Copyright:
© The Author(s), under exclusive license to Springer Nature Switzerland AG 2024.

    Research areas

  • Factorized transformer architecture, Masked autoencoder, Multiagent trajectories, Self-supervised learning, Soccer, Tracking data
  • Informatics
  • Business informatics

Recently viewed

Researchers

  1. Kerstin Fedder

Publications

  1. Comparison of EKF and TSO for Health Monitoring of a Textile-Based Heater Structure and its Control
  2. Determinants and Outcomes of Dual Distribution:
  3. The identification of up-And downstream industries using input-output tables and a firm-level application to minority shareholdings
  4. Sliding mode and model predictive control for inverse pendulum
  5. A Hermeneutic Interpretation of Concepts in a Cooperative Multicultural Working Project
  6. Multilayer neural networks
  7. Teachers’ temporary support and worked-out examples as elements of scaffolding in mathematical modeling
  8. Self-supervised Siamese Autoencoders
  9. Explaining Disagreement on Interest Rates in a Taylor-Rule Setting
  10. Audio-Hacks
  11. Geodesign as a boundary management process
  12. Octanol-Water Partition Coefficient Measurement by a Simple 1H NMR Method
  13. A New Approach for Optimal Solving Cyclic and Non-Cyclic Bus Drvier Rostering Problems
  14. Online-scheduling using past and real-time data
  15. Semiparametric one-step estimation of a sample selection model with endogenous covariates
  16. Negotiation complexity
  17. Design, Modeling and Control of an Over-actuated Hexacopter Tilt-Rotor
  18. Continued logarithm representation of real numbers
  19. Science-Related Outcomes
  20. Explorations in social spaces
  21. Conceptualizing community in energy systems
  22. Qualitative Daten computergestutzt auswerten
  23. Phosphorus uptake from struvite is modulated by the nitrogen form applied
  24. A Multilab Replication of the Ego Depletion Effect
  25. Assessing authenticity in modelling test items: deriving a theoretical model
  26. From Planning to Implementation: Top-Down and Bottom-Up Approaches for Collaborative Watershed Management
  27. Perceptron and SVM learning with generalized cost models
  28. Phase Shift APOD and POD Control Technique in Multi-Level Inverters to Mitigate Total Harmonic Distortion
  29. Test of advanced hyperfine structure theory by precision radio-frequency and laser spectroscopy in molybdenum