p-norm multiple kernel learning

Publikation: Beiträge in ZeitschriftenZeitschriftenaufsätzeForschungbegutachtet

Authors

Learning linear combinations of multiple kernels is an appealing strategy when the right choice of features is unknown. Previous approaches to multiple kernel learning (MKL) promote sparse kernel combinations to support interpretability and scalability. Unfortunately, this ℓ1norm MKL is rarely observed to outperform trivial baselines in practical applications. To allow for robust kernel mixtures that generalize well, we extend MKL to arbitrary norms. We devise new insights on the connection between several existing MKL formulations and develop two efficient interleaved optimization strategies for arbitrary norms, that is ℓp -norms with p ≥ 1. This interleaved optimization is much faster than the commonly used wrapper approaches, as demonstrated on several data sets. A theoretical analysis and an experiment on controlled artificial data shed light on the appropriateness of sparse, non-sparse and ℓ-norm MKL in various scenarios. Importantly, empirical applications of ℓp-norm MKL to three real-world problems from computational biology show that non-sparse MKL achieves accuracies that surpass the state-of-the-art. Data sets, source code to reproduce the experiments, implementations of the algorithms, and further information are available at http://doc.ml.tu-berlin.de/nonsparse-mkl/.

OriginalspracheEnglisch
ZeitschriftJournal of Machine Learning Research
Jahrgang12
Seiten (von - bis)953-997
Anzahl der Seiten45
ISSN1532-4435
PublikationsstatusErschienen - 03.2011
Extern publiziertJa

Zuletzt angesehen

Publikationen

  1. Editorial introduction to the special issue on crises at work
  2. Comparison of an Electrochemical and Luminescence-Based Oxygen Measuring System for Use in the Biodegradability Testing According to Closed Bottle Test (OECD 301D)
  3. Creative Network Communities in the Translocal Space of Digital Networks
  4. The Role of Formalisation, Participation and Context in the Success of Public Involvement Mechanisms in Resource Management
  5. »CO2 causes a hole in the atmosphere« Using laypeople’s conceptions as a starting point to communicate climate change
  6. Influence of Dy in solid solution on the degradation behavior of binary Mg-Dy alloys in cell culture medium
  7. Socio-technical instruments in the field of Integrated Water Resources Management
  8. An Adaptive Resonance Regulator Design for Motion Control of Intake Valves in Camless Engine Systems
  9. De-Anonymizing Anonymous
  10. A Hybrid Hydraulic Piezo Actuator for Camless Internal Combustion Engines Controlled with an MPC and an Affine Feedforward Structure
  11. Non-acceptances in context
  12. Thanking and responding to thanks in American English: Language patterning and contextual appropriateness
  13. Applying the Rasch sampler to identify aberrant responding through person fit statistics under fixed nominal α-level.
  14. Planning for Sea Spaces I: Processes, Practices and Future Perspectives
  15. Dadadatadada: From Dada to Data and Back Again
  16. Understanding needs embodiment
  17. Diversity of Play
  18. Entangled – But How?
  19. A path to clean water
  20. Grain size statistics, composition and provenance of fragmental particles in some Apollo 14 breccias
  21. New Methods for the Analysis of Links between International Firm Activities and Firm Performance: A Practitioner’s Guide
  22. Curatorial Practices of the ‘Global’
  23. Organic Synthesis – Art or Science?
  24. Motion-decoupled internal force control in grasping with visco-elastic contacts
  25. Computational Swarming
  26. Maintaining the impact of action-oriented entrepreneurship training
  27. Points of cooperation: integrating cooperative learning into web-based courses
  28. Learning how to request using textbooks
  29. What drives the spatial distribution and dynamics of local species richness in tropical forest?
  30. Analyzing a transition to a sustainability-oriented science system in Germany

Presse / Medien

  1. Cyber-Feminist Urbanism