Masked Autoencoder Pretraining for Event Classification in Elite Soccer

Research output: Contributions to collected editions/worksArticle in conference proceedingsResearchpeer-review

Authors

We show that pretraining transformer models improves the performance on supervised classification of tracking data from elite soccer. Specifically, we propose a novel self-supervised masked autoencoder for multiagent trajectories. In contrast to related work, our approach is significantly simpler, has no necessity for handcrafted features and inherently allows for permutation invariance in downstream tasks.

Original languageEnglish
Title of host publicationMachine Learning and Data Mining for Sports Analytics : 10th International Workshop, MLSA 2023, Revised Selected Papers
EditorsUlf Brefeld, Jesse Davis, Jan Van Haaren, Albrecht Zimmermann
Number of pages12
Place of PublicationCham
PublisherSpringer Nature Switzerland AG
Publication date26.02.2024
Pages24-35
ISBN (print)978-3-031-53832-2
ISBN (electronic)978-3-031-53833-9
DOIs
Publication statusPublished - 26.02.2024
Event10th International Workshop on Machine Learning and Data Mining for Sports Analytics - MLSA 2023 - Turin, Italy
Duration: 18.09.202318.09.2023
Conference number: 10
https://dtai.cs.kuleuven.be/events/MLSA23/
http://www.wikicfp.com/cfp/servlet/event.showcfp?eventid=173575&copyownerid=49896

Bibliographical note

Publisher Copyright:
© The Author(s), under exclusive license to Springer Nature Switzerland AG 2024.

    Research areas

  • Factorized transformer architecture, Masked autoencoder, Multiagent trajectories, Self-supervised learning, Soccer, Tracking data
  • Informatics
  • Business informatics

Recently viewed

Publications

  1. What is missing in the EVS?
  2. Diversity: Konzept. Programmatik. Praxis.
  3. Avoiding irreversible change
  4. Adding the “e-” to Learning for Sustainable Development
  5. Plants, Androids and Operators
  6. Foundations for the Development of Simulator-based Training for Older Professional Drivers
  7. An Extended Kalman Filter as an Observer in a Sliding Mode Controller for a Metal-Polymer Composite Actuator
  8. Effect of erbium modification on the microstructure, mechanical and corrosion characteristics of binary Mg-Al alloys
  9. University mathematics students’ use of resources: strategies, purposes, and consequences
  10. Random year intercepts in mixed models help to assess uncertainties in insect population trends
  11. Dynamische Mathematik
  12. Performance of the Chemcatcher ® passive sampler when used to monitor 10 polar and semi-polar pesticides in 16 Central European streams, and comparison with two other sampling methods
  13. Using the learner-generated drawing strategy
  14. Learning-related emotions in multimedia learning
  15. Nonautonomous control of stable and unstable manifolds in two-dimensional flows
  16. Exporter and Importer Dynamics Database for Germany
  17. Hermann Stutte
  18. Digitalisierung und Differenzierung
  19. Accuracy and bias of methods used for root length measurements in functional root research
  20. A new magnesium alloy system
  21. Sustainable Wireless Sensor Networks for Railway Systems Powered by Energy Harvesting from Vibration
  22. Export diversification and income differences reconsidered
  23. Machine Learning for the Quantified Self
  24. Part based decentralized information handling for process improvements along the supply chain
  25. Biodiversity and ecosystem functioning relations in European forests depend on environmental context.
  26. ADORE-Project Teaching Adolescent Struggling Readers
  27. Ports
  28. Along the Path of the Pine, the Parrot, and the Tortoise
  29. Study harder? the relationship of achievement goals to attitudes and self-reported use of desirable difficulties in self-regulated learning
  30. What makes online professional development effective?
  31. Measuring institutional overlap in global governance
  32. The Shareholder Value Effect of System Overloads: An Analysis of Investor Responses to the 2003 Blackout in the US
  33. Human development and the "explosion" of democracy
  34. Development of tools to prevent food waste
  35. Methan - das unterschätzte Klimagas
  36. Paradoxe Kritik
  37. Publikationsbasierte Dissertation?!
  38. Evidence-based Entrepreneurship (EBE): A systematic approach to cumulative science
  39. Odors enhance visual attention to congruent objects
  40. Existenzgründungen junger Handwerksmeister
  41. VALUES-BASED BUSINESS MODEL INNOVATION-THE CASE OF ECOSIA AND ITS BUSINESS MODEL
  42. System Properties Determine Food Security and Biodiversity Outcomes at Landscape Scale
  43. Die Liebe der Soziologie
  44. Human development as a general theory of social change