Masked Autoencoder Pretraining for Event Classification in Elite Soccer

Research output: Contributions to collected editions/worksArticle in conference proceedingsResearchpeer-review

Authors

We show that pretraining transformer models improves the performance on supervised classification of tracking data from elite soccer. Specifically, we propose a novel self-supervised masked autoencoder for multiagent trajectories. In contrast to related work, our approach is significantly simpler, has no necessity for handcrafted features and inherently allows for permutation invariance in downstream tasks.

Original languageEnglish
Title of host publicationMachine Learning and Data Mining for Sports Analytics : 10th International Workshop, MLSA 2023, Revised Selected Papers
EditorsUlf Brefeld, Jesse Davis, Jan Van Haaren, Albrecht Zimmermann
Number of pages12
Place of PublicationCham
PublisherSpringer Nature Switzerland AG
Publication date26.02.2024
Pages24-35
ISBN (print)978-3-031-53832-2
ISBN (electronic)978-3-031-53833-9
DOIs
Publication statusPublished - 26.02.2024
Event10th International Workshop on Machine Learning and Data Mining for Sports Analytics - MLSA 2023 - Turin, Italy
Duration: 18.09.202318.09.2023
Conference number: 10
https://dtai.cs.kuleuven.be/events/MLSA23/
http://www.wikicfp.com/cfp/servlet/event.showcfp?eventid=173575&copyownerid=49896

Bibliographical note

Publisher Copyright:
© The Author(s), under exclusive license to Springer Nature Switzerland AG 2024.

    Research areas

  • Factorized transformer architecture, Masked autoencoder, Multiagent trajectories, Self-supervised learning, Soccer, Tracking data
  • Informatics
  • Business informatics

Recently viewed

Activities

  1. Nonlinear dynamics and opinion formation in time varying networks
  2. Verification of Measuring the Bearing Clearance Using Kurtosis, Recurrences and Neural Networks and Comparison of These Approaches
  3. Workshop mit David Bates: "Compossible Worlds"
  4. Empirical Insights into Working in Research-Practice Partnerships: New Findings on Motivation, Co-Constructive Collaboration and Learning Effects
  5. The temporal dynamics of ambidextrous leadership for innovation: A diary study
  6. Linking Teaching and Learning Formats with Student Development of Key Sustainability Competencies
  7. Digital Games Lab Lecture Series - 2018
  8. Experiencing Nature of Science – Discover your own understanding of NOS, mit Kerstin Oschatz
  9. PhD Workshop 2022 - Empirical Microeconomics
  10. Paper, pegboard, software: Elements of a media theory of organization
  11. Bridging the Curricular Divide. Integrating sustainability and EFL instruction in a project (week) context for secondary school learners of English and Science
  12. That is not enough–Or is it? A qualitative investigation of reference points in negotiations
  13. Combining SMC and MTPA Using an EKF to estimate parameters and states of an interior PMSM
  14. From e-learning to the acquirement of competencies: wiki-based knowledge management and complex problem solving
  15. Clustering (Spatial) Relationships to unveil small-scale Schooling Markets
  16. PEAR - Provenance Event and Archives Reconciliation
  17. ReThink - ReStructure - ReConnect
  18. Life cycle thinking and systems thinking - how to support systems thinking in material flow management
  19. Maximum-Likelihood-Based Panel Cointegration Test with Linear Time Trend
  20. Ludic Overload - Ludic Overkill: Gamification in the age of Media Overload

Publications

  1. The role of task meaning on output in groups
  2. Efficacy of an internet and app-based gratitude intervention in reducing repetitive negative thinking and mechanisms of change in the intervention's effect on anxiety and depression
  3. Perception and Inference
  4. Action Errors, Error Management, and Learning in Organizations
  5. Quantifying diffuse and point inputs of perfluoroalkyl acids in a nonindustrial river catchment
  6. Segment Introduction
  7. Comparison of EKF and TSO for Health Monitoring of a Textile-Based Heater Structure and its Control
  8. A Voxel-based technique to estimate the volume of trees from terrestrial laser scanner data
  9. Optimal scheduling of AGVs in a reentrant blocking job-shop
  10. BUSINESS MODELS IN BANKING: A CLUSTER ANALYSIS USING ARCHIVAL DATA
  11. Assessing authenticity in modelling test items: deriving a theoretical model
  12. A longitudinal multilevel CFA-MTMM model for interchangeable and structurally different methods
  13. Using EEG movement tagging to isolate brain responses coupled to biological movements
  14. How to support students-learning in mathematical bridging-courses using ITS? Remedial Scenarios in the EU-Project Math-Bridge
  15. An Adaptive Resonance Regulator for an Actuator using Periodic Signals in Camless Engine Systems
  16. Soil conditions modify species diversity effects on tree functional trait expression
  17. Increased Reliability of Draw-In Prediction in a Single Stage Deep-Drawing Operation via Transfer Learning
  18. Order parameters and energies of analytic and singular vortex lines in rotating3He-A
  19. Efficacy of a Web-Based Intervention With Mobile Phone Support in Treating Depressive Symptoms in Adults With Type 1 and Type 2 Diabetes
  20. Use of design methods, team leaders' goal orientation, and team effectiveness: A follow-up study in software development projects
  21. Determinants and Outcomes of Dual Distribution:
  22. Modeling self-determination theory motivation data by using unfolding IRT
  23. Industry 4.0 more than a challenge in modeling, identification, and control for cyber-physical systems
  24. Using Conjoint Analysis to Elicit Preferences for Occupational Health Services in Small and Microenterprises
  25. Optimal trajectory generation for camless internal combustion engine valve control