Masked autoencoder for multiagent trajectories

Research output: Journal contributionsJournal articlesResearchpeer-review

Authors

Automatically labeling trajectories of multiple agents is key to behavioral analyses but usually requires a large amount of manual annotations. This also applies to the domain of team sport analyses. In this paper, we specifically show how pretraining transformer models improves the classification performance on tracking data from professional soccer. For this purpose, we propose a novel self-supervised masked autoencoder for multiagent trajectories to effectively learn from only a few labeled sequences. Our approach builds upon a factorized transformer architecture for multiagent trajectory data and employs a masking scheme on the level of individual agent trajectories. As a result, our model allows for a reconstruction of masked trajectory segments while being permutation equivariant with respect to the agent trajectories. In addition to experiments on soccer, we demonstrate the usefulness of the proposed pretraining approach on multiagent pose data from entomology. In contrast to related work, our approach is conceptually much simpler, does not require handcrafted features and naturally allows for permutation invariance in downstream tasks.
Original languageEnglish
Article number44
JournalMachine Learning
Volume114
Issue number2
Number of pages18
ISSN0885-6125
DOIs
Publication statusPublished - 02.2025

Bibliographical note

Publisher Copyright:
© The Author(s) 2025.

Recently viewed

Publications

  1. Comparison of three methods of length compensation in a parallel kinematic and their equivalence conditions
  2. Market and network corruption
  3. Coping with concept drift in a virtual metrology application to predict part quality in micro gear manufacturing
  4. Databases as citadels in the web 2.0
  5. Why the measurement of species diversity requires prior value judgements
  6. Emotional reactivity and interoceptive sensitivity
  7. The educational benefits of technological competence
  8. Symmetry in Spatial Perspective Tasks
  9. The parrot knew everything
  10. Integrative inspection methodology for enhanced PCB remanufacturing using artificial intelligence
  11. Adaptive acquisition planning for visual inspection in remanufacturing using reinforcement learning
  12. Putting a premium on music
  13. If You Have a Hammer, You Only Look for Nails
  14. The hidden hand that shapes conceptual understanding: Choosing effective representations for teaching cell division and climate change
  15. Effort and Success as Predictors of Passion
  16. A robust cascade sliding mode control for a hybrid piezo-hydraulic actuator in camless internal combustion engines
  17. Software-Unterstützung für Routine im betrieblichen Umweltschutz
  18. Robust Current Decoupling in a Permanent Magnet Motor Combining a Geometric Method and SMC
  19. Robust Maneuver Planning With Scalable Prediction Horizons
  20. Identification of multi-fault in rotor-bearing system using spectral kurtosis and EEMD
  21. Patterns of ecosystem services supply across farm properties: Implications for ecosystem services-based policy incentives
  22. The Hanoverian Supply Chain Model: modelling the impact of production planning and control on a supply chain's logistic objectives
  23. Das 6-Punkte-Programm für besseres Reiten
  24. Early semantic activation in picture processing
  25. The Good have a Website
  26. "Zwei-Kämpfen" von Anfang an
  27. Die Rechtsquellenlehre des Gaius
  28. Do overlapping audit and compensation committee memberships contribute to better financial reporting quality?
  29. Building actor-centric transformative capacity through city-university partnerships