Masked autoencoder for multiagent trajectories

Research output: Journal contributionsJournal articlesResearchpeer-review

Authors

Automatically labeling trajectories of multiple agents is key to behavioral analyses but usually requires a large amount of manual annotations. This also applies to the domain of team sport analyses. In this paper, we specifically show how pretraining transformer models improves the classification performance on tracking data from professional soccer. For this purpose, we propose a novel self-supervised masked autoencoder for multiagent trajectories to effectively learn from only a few labeled sequences. Our approach builds upon a factorized transformer architecture for multiagent trajectory data and employs a masking scheme on the level of individual agent trajectories. As a result, our model allows for a reconstruction of masked trajectory segments while being permutation equivariant with respect to the agent trajectories. In addition to experiments on soccer, we demonstrate the usefulness of the proposed pretraining approach on multiagent pose data from entomology. In contrast to related work, our approach is conceptually much simpler, does not require handcrafted features and naturally allows for permutation invariance in downstream tasks.
Original languageEnglish
Article number44
JournalMachine Learning
Volume114
Issue number2
Number of pages18
ISSN0885-6125
DOIs
Publication statusPublished - 02.2025

Bibliographical note

Publisher Copyright:
© The Author(s) 2025.

Recently viewed

Publications

  1. Vergütung, variable
  2. Mimicking and anticipating others’ actions is linked to social information processing
  3. Machine Learning and Knowledge Discovery in Databases
  4. Wozu in Tönen denken?
  5. Faulty Process Detection Using Machine Learning Techniques
  6. Competing Vegetation Structure Indices for Estimating Spatial Constrains in Carabid Abundance Patterns in Chinese Grasslands Reveal Complex Scale and Habitat Patterns
  7. Differences of Four Work-Related Behavior and Experience Patterns in Work Ability and Other Work-Related Perceptions in a Finance Company
  8. Guest Editorial - ''Econometrics of Anonymized Micro Data''
  9. Making the most out of timeseries symptom data
  10. Study of fuzzy controllers performance
  11. Robust approximate fixed-time tracking control for uncertain robot manipulators
  12. Challenges for biodiversity monitoring using citizen science in transitioning social-ecological systems
  13. Understanding the modes of use and availability of critical metals-An expert-based scenario analysis for the case of indium
  14. Machine Learning Applications
  15. 8th challenge on question answering over linked data (QALD-8)
  16. Do guided internet-based interventions result in clinically relevant changes for patients with depression?
  17. Understanding and Supporting Management Decision-Making
  18. Entity linking in 40 languages using MAG
  19. Unravelling insect declines: Can space replace time?
  20. Turning Good Intentions Into Actions by Using the Health Action Process Approach to Predict Adherence to Internet-Based Depression Prevention
  21. The generative drawing principle in multimedia learning
  22. Exploring transition research as transformative science
  23. A Lean Convolutional Neural Network for Vehicle Classification
  24. Recognition and approach responses toward threatening objects
  25. On the distinctiveness of tags in collaborative tagging systems
  26. An analytical approach to evaluating nonmonotonic functions of fuzzy numbers
  27. Space Systems Cross-Compatibility
  28. Understanding the properties of isospectral points and pairs in graphs
  29. NNARX networks on didactic level system identification
  30. Combining a PI Controller with an Adaptive Feedforward Control in PMSM
  31. Improvements in Flexibility depend on Stretching Duration
  32. Highly Efficient IPT Transmitter Circuit Based on a Novel Enhanced Class B Amplifier for Consumer Applications
  33. Retest effects in matrix test performance
  34. Multidimensionality of tree communities structure host-parasitoid networks and their phylogenetic composition