Principled Interpolation in Normalizing Flows

Research output: Contributions to collected editions/worksArticle in conference proceedingsResearchpeer-review

Authors

Generative models based on normalizing flows are very successful in modeling complex data distributions using simpler ones. However, straightforward linear interpolations show unexpected side effects, as interpolation paths lie outside the area where samples are observed. This is caused by the standard choice of Gaussian base distributions and can be seen in the norms of the interpolated samples as they are outside the data manifold. This observation suggests that changing the way of interpolating should generally result in better interpolations, but it is not clear how to do that in an unambiguous way. In this paper, we solve this issue by enforcing a specific manifold and, hence, change the base distribution, to allow for a principled way of interpolation. Specifically, we use the Dirichlet and von Mises-Fisher base distributions on the probability simplex and the hypersphere, respectively. Our experimental results show superior performance in terms of bits per dimension, Frechet Inception Distance (FID), and Kernel Inception Distance (KID) scores for interpolation, while maintaining the generative performance
Original languageEnglish
Title of host publicationMachine Learning and Knowledge Discovery in Databases. Research Track : European Conference, ECML PKDD 2021, Bilbao, Spain, September 13–17, 2021, Proceedings, Part II
EditorsNuria Oliver, Fernando Pérez-Cruz, Stefan Kramer, Jesse Read, Jose A. Lozano
Number of pages16
Place of PublicationCham
PublisherSpringer Nature
Publication date09.2021
Pages116-131
ISBN (print)978-3-030-86519-1
ISBN (electronic)978-3-030-86520-7
DOIs
Publication statusPublished - 09.2021
EventEuropean Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases - ECML PKDD 2021 - Virtual, Online
Duration: 13.09.202117.09.2021

Bibliographical note

Funding Information:
This research was financed in part by the Coordena??o de Aperfei?oamento de Pessoal de N?vel Superior (CAPES), Brazil, Finance Code 001 and by FAPESP (grants 2017/24005-2 and 2018/19350-5).

Publisher Copyright:
© 2021, Springer Nature Switzerland AG.

Recently viewed

Publications

  1. Extraterritorial Asylum Processing. The Libya-Niger Emergency Transit Mechanism
  2. Early-Career Researchers’ Perceptions of the Prevalence of Questionable Research Practices, Potential Causes, and Open Science
  3. Investigating Internal CSR Communication: Building a Theoretical Framework
  4. Host functional and phylogenetic composition rather than host diversity structure plant–herbivore networks
  5. Forging of cast Mg-3Sn-2Ca-0.4Al-0.4Si magnesium alloy using processing map
  6. Combination of a reduced order state observer and an Extended Kalman Filter for Peltier cells
  7. Patients' experiences in a guided Internet- and App-based stress intervention for college students
  8. Norms and variation in L2 pragmatics
  9. Does self-control training improve self-control?
  10. EU Migration and Asylum Policies
  11. Out of the box
  12. Whose home is it anyway?
  13. Noise-induced Statistical Periodicity in Random Lasota-Mackey Maps
  14. Double perspective taking processes of primary children - adoption and application of a psychological instrument
  15. Can't Stop The Feeling
  16. Analyzing a transition to a sustainability-oriented science system in Germany
  17. Isolation Playground
  18. Article 73 CISG
  19. 'Creativity and Innovation' in the Nineteenth Century
  20. Negotiated third party access
  21. Logic
  22. Rechtschreiben
  23. Transgressive Use of Technology
  24. Design of a Real Time Path of Motion Control for Manufacturing Applications
  25. Differentiated integration and role conceptions in multilateral security orders. A comparative study of France, Germany, Ireland and Romania
  26. Process parameter assessment on the dissimilar deposition of AA2024-T351 on AA7475-T761 by friction surfacing
  27. TERIM – Transition Dynamics in Energy Regions
  28. Documenting and Describing the Transcultural
  29. Affective responses to system messages in human-computer-interaction
  30. Project ARBRE
  31. Auswendigkeit (oder: Toast Master´s Backen ohne Mehl)
  32. Exploring the potential role of priority effects for ecological restoration
  33. Pragmatics and the English Language, Jonathan Culpeper, Michael Haugh. Palgrave Macmillan, Basingstoke (2014), 316 pp., ISBN: 9780230551732
  34. Creativity in the opportunity identification process and the moderating effect of diversity of information
  35. Non-linear effects of comparison income in quit decisions: status versus signal !
  36. Modelling Interdependencies Within Production Planning and Control
  37. Rapping against Old and New Nazis: Bejarano and Microphone Mafia’s Multidirectional Musical Memory Work
  38. Corrigendum to: Pathways to Implementation: Evidence on How Participation in Environmental Governance Impacts on Environmental Outcomes
  39. "Kulturinstrument Radio"
  40. Answers to seven questions
  41. Joint proceedings of RSP 2017 and QuWeDa 2017