Principled Interpolation in Normalizing Flows

Research output: Contributions to collected editions/worksArticle in conference proceedingsResearchpeer-review

Authors

Generative models based on normalizing flows are very successful in modeling complex data distributions using simpler ones. However, straightforward linear interpolations show unexpected side effects, as interpolation paths lie outside the area where samples are observed. This is caused by the standard choice of Gaussian base distributions and can be seen in the norms of the interpolated samples as they are outside the data manifold. This observation suggests that changing the way of interpolating should generally result in better interpolations, but it is not clear how to do that in an unambiguous way. In this paper, we solve this issue by enforcing a specific manifold and, hence, change the base distribution, to allow for a principled way of interpolation. Specifically, we use the Dirichlet and von Mises-Fisher base distributions on the probability simplex and the hypersphere, respectively. Our experimental results show superior performance in terms of bits per dimension, Frechet Inception Distance (FID), and Kernel Inception Distance (KID) scores for interpolation, while maintaining the generative performance
Original languageEnglish
Title of host publicationMachine Learning and Knowledge Discovery in Databases. Research Track : European Conference, ECML PKDD 2021, Bilbao, Spain, September 13–17, 2021, Proceedings, Part II
EditorsNuria Oliver, Fernando Pérez-Cruz, Stefan Kramer, Jesse Read, Jose A. Lozano
Number of pages16
Place of PublicationCham
PublisherSpringer Nature
Publication date09.2021
Pages116-131
ISBN (print)978-3-030-86519-1
ISBN (electronic)978-3-030-86520-7
DOIs
Publication statusPublished - 09.2021
EventEuropean Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases - ECML PKDD 2021 - Virtual, Online
Duration: 13.09.202117.09.2021

Bibliographical note

Funding Information:
This research was financed in part by the Coordena??o de Aperfei?oamento de Pessoal de N?vel Superior (CAPES), Brazil, Finance Code 001 and by FAPESP (grants 2017/24005-2 and 2018/19350-5).

Publisher Copyright:
© 2021, Springer Nature Switzerland AG.

Recently viewed

Publications

  1. Learning with summaries
  2. Facing Up to Third Party Liability for Space Activities
  3. Extraterritorial Asylum Processing. The Libya-Niger Emergency Transit Mechanism
  4. Comparison of Backpropagation and Kalman Filter-based Training for Neural Networks
  5. How much can we learn about voluntary climate action from behavior in public goods games?
  6. A dynamic perspective on affect and creativity
  7. Investigating Factors on R estorative Sleep Quality and its Relationship with Personal Work Performance - An Analysis of Diary Data
  8. An introduction to sliding mode control for interdisciplinary education
  9. Leaf trait variation within individuals mediates the relationship between tree species richness and productivity
  10. Sustainability-oriented technology exploration: managerial values, ambidextrous design, and separation drift
  11. Norms and variation in L2 pragmatics
  12. Determinants in the online distribution of digital content
  13. Modeling of 3D fluid-structure-interaction during in-situ hybridization of double-curved fiber-metal-laminates
  14. Co-production of nature's contributions to people
  15. Out of the box
  16. Logistische Lageranalyse und Methodenvalidierung
  17. An Unusual Encounter with Oneself
  18. Introduction to the Special Issue Section
  19. An Approach for Ex-Post-Facto Analysis of Knowledge Graph-Driven Chatbots – The DBpedia Chatbot
  20. Effects of strategy instructions on learning from text and pictures
  21. The dispositive factor in a system of inventory-controlled production
  22. Effects of welding conditions on microstructural transformations and mechanical properties in AE42-HP friction welded joints
  23. Digital and IT-Enabled Organizational Transformation - Where Do We Go From Here?
  24. Grounding language performance in the anticipatory dynamics of the body
  25. Tree phylogenetic diversity structures multitrophic communities
  26. Navigating ambiguities
  27. Effects of gadolinium and neodymium addition on young’s modulus of magnesium-based binary alloys
  28. HEPS Inventory Tool
  29. Manufacturing of irregular shapes through force control in incremental sheet forming with active medium
  30. Development and validation of a stability-indicating RP-HPLC method for the determination of paracetamol with dantrolene or/and cetirizine and pseudoephedrine in two pharmaceutical dosage forms
  31. Assessment of occupational exertion and strain in laboratory- and real occupational environments
  32. Learning for change
  33. Evaluating Introductory Lectures in Entrepreneurship