Semi-Supervised Generative Models for Multi-Agent Trajectories

Research output: Contributions to collected editions/worksArticle in conference proceedingsResearchpeer-review

Authors

Analyzing the spatiotemporal behavior of multiple agents is of great interest to many communities. Existing probabilistic models in this realm are formalized either in an unsupervised framework, where the latent space is described by discrete or continuous variables, or in a supervised framework, where weakly preserved labels add explicit information to continuous latent representations. To overcome inherent limitations, we propose a novel objective function for processing multi-agent trajectories based on semi-supervised variational autoencoders, where equivariance and interaction of agents are captured via customized graph networks. The resulting architecture disentangles discrete and continuous latent effects and provides a natural solution for injecting expensive domain knowledge into interactive sequential systems. Empirically, our model not only outperforms various state-of-the-art baselines in trajectory forecasting, but also learns to effectively leverage unsupervised multi-agent sequences for classification tasks on interactive real-world sports datasets.

Original languageEnglish
Title of host publicationAdvances in Neural Information Processing Systems 35 : 36th Conference on Neural Information Processing Systems (NeurIPS 2022)
EditorsS. Koyejo, S. Mohamed, A. Agarwal, D. Belgrave, K. Cho, A. Oh
Number of pages15
Volume48
Place of PublicationRed Hook
PublisherCurran Associates
Publication date2022
Pages37267-37281
ISBN (print)978-1-7138-7108-8
ISBN (electronic)978-1-7138-7312-9
Publication statusPublished - 2022
Event36th Conference on Neural Information Processing Systems - NeurIPS 2022 - New Orleans Convention Center, New Orleans, United States
Duration: 28.11.202209.12.2022
Conference number: 36
https://nips.cc/Conferences/2022

Bibliographical note

Publisher Copyright:
© 2022 Neural information processing systems foundation. All rights reserved.

Recently viewed

Researchers

  1. Isabelle Fincke

Publications

  1. Effect of grain size and structure, solid solution elements, precipitates and twinning on nanohardness of Mg-Re alloys
  2. Cognitive load in reading a foreign language text with multimedia aids and the influence of verbal and spatial abilities
  3. Forced exit from the joint-decision trap
  4. Higher Wages in Exporting Firms: Self-Selection, Export Effect, or Both?
  5. Bright Spots for Local WFD Implementation Through Collaboration with Nature Conservation Authorities?
  6. The complex spatio-temporal dynamics of organic micropollutants in tidal rivers
  7. Challenges and opportunities in linking carbon sequestration, livelihoods and ecosystem service provision in drylands
  8. AN INVESTIGATION OF LENGTH ESTIMATION SKILLS OF HIGH SCHOOL STUDENTS WITH MILD INTELLECTUAL DISABILITY
  9. Landscape moderation of biodiversity patterns and processes - eight hypotheses
  10. Comparison of wood volume estimates of young trees from terrestrial laser scan data
  11. Chemistry of POPs in the Atmosphere
  12. How to do and communicate politics beyond routines
  13. Kunst
  14. Outcome expectations and work design characteristics in post-retirement work planning
  15. Vegetation mapping in central Asian dry eco-systems using Landsat ETM+.
  16. Der Konsum in der deutschen Soziologie
  17. Determinants of farm size and stocking rate in Namibian commercial cattle farming
  18. Bad Practices in Unternehmen und die Mechanismen ihrer Etablierung
  19. The Video Game Industry: Formation, Present State, and Future, Peter Zackariasson and Timothy Wilson (eds) (2012) New York: Routledge
  20. Questions liées au genre dans la scène berlinoise de l’electronic dance music
  21. Ein Code, eine Kunst ?