Principled Interpolation in Normalizing Flows

Research output: Contributions to collected editions/worksArticle in conference proceedingsResearchpeer-review

Authors

Generative models based on normalizing flows are very successful in modeling complex data distributions using simpler ones. However, straightforward linear interpolations show unexpected side effects, as interpolation paths lie outside the area where samples are observed. This is caused by the standard choice of Gaussian base distributions and can be seen in the norms of the interpolated samples as they are outside the data manifold. This observation suggests that changing the way of interpolating should generally result in better interpolations, but it is not clear how to do that in an unambiguous way. In this paper, we solve this issue by enforcing a specific manifold and, hence, change the base distribution, to allow for a principled way of interpolation. Specifically, we use the Dirichlet and von Mises-Fisher base distributions on the probability simplex and the hypersphere, respectively. Our experimental results show superior performance in terms of bits per dimension, Frechet Inception Distance (FID), and Kernel Inception Distance (KID) scores for interpolation, while maintaining the generative performance
Original languageEnglish
Title of host publicationMachine Learning and Knowledge Discovery in Databases. Research Track : European Conference, ECML PKDD 2021, Bilbao, Spain, September 13–17, 2021, Proceedings, Part II
EditorsNuria Oliver, Fernando Pérez-Cruz, Stefan Kramer, Jesse Read, Jose A. Lozano
Number of pages16
Place of PublicationCham
PublisherSpringer Nature
Publication date09.2021
Pages116-131
ISBN (print)978-3-030-86519-1
ISBN (electronic)978-3-030-86520-7
DOIs
Publication statusPublished - 09.2021
EventEuropean Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases - ECML PKDD 2021 - Virtual, Online
Duration: 13.09.202117.09.2021

Bibliographical note

Funding Information:
This research was financed in part by the Coordena??o de Aperfei?oamento de Pessoal de N?vel Superior (CAPES), Brazil, Finance Code 001 and by FAPESP (grants 2017/24005-2 and 2018/19350-5).

Publisher Copyright:
© 2021, Springer Nature Switzerland AG.

Recently viewed

Publications

  1. A Stacked Planar Sensor Concept for Minimally Invasive Plasma Monitoring
  2. Facing Up to Third Party Liability for Space Activities
  3. Trainingsqualität durch Trainingsquantität?
  4. Using Principal Component Analysis for information-rich socio-ecological vulnerability mapping in Southern Africa
  5. Integratives Gendering in der Lehre
  6. The Framework for Inclusive Science Education
  7. The polarity field concept
  8. Effectiveness of a Guided Internet- and Mobile-Based Intervention for Patients with Chronic Back Pain and Depression (WARD-BP): A Multicenter, Pragmatic Randomized Controlled Trial
  9. Ensuring the Long-Term Provision of Heathland Ecosystem Services—The Importance of a Functional Perspective in Management Decision Frameworks
  10. A highly transparent method of assessing the contribution of incentives to meet various technical challenges in distributed energy systems
  11. Actuator- and/or sensor element for sleeve in medical field e.g. limb or joint fracture treatment, has nano-wires comprising nano-fibers, where element deforms and acquires dimensional change of nano-fibers via electrical signal
  12. From temporal myopia to foresight: Bridging the near and the distant future through temporal work
  13. Dealing with inclusion–teachers’ assessment of internal and external resources
  14. Editorial introduction to the special issue on crises at work
  15. Plants, Androids and Operators
  16. Microstructure, mechanical and functional properties of refill friction stir spot welds on multilayered aluminum foils for battery application
  17. Pathways of Data-driven Business Model Design and Realization
  18. Multinomial choice models based on Archimedean copulas
  19. Adaptor device for transmitting e.g. blood pressure data of human body from blood pressure measuring device of data communication system to e.g. personal computer, has controller for controlling transmission of data to communication module
  20. A Genetic Algorithm for the Dynamic Management of Cellular Reconfigurable Manufacturing Systems
  21. An Integrated Case Study of the Concepts and Applications of SAP ERP HCM
  22. Model Predictive Control for Energy Optimization in Generators/Motors as Well as Converters and Inverters for Futuristic Integrated Power Networks
  23. Promoting physical activity in worksite settings
  24. Evaluating the (cost-)effectiveness of guided and unguided Internet-based self-help for problematic alcohol use in employees
  25. Extension of SEIR compartmental models for constructive Lyapunov control of COVID-19 and analysis in terms of practical stability
  26. Assembly history modulates vertical root distribution in a grassland experiment
  27. A Person-Centered Approach for Analyzing Multidimensional Integration in Collaboration Between Educational Researchers and Practitioners
  28. Continental mapping of forest ecosystem functions reveals a high but unrealised potential for forest multifunctionality.
  29. Toward a better understanding of the mindsets of negotiators
  30. Thanking and responding to thanks in American English: Language patterning and contextual appropriateness
  31. Practices and Policies from Spaces of Possibilities to Institutional Innovations