p-norm multiple kernel learning

Research output: Journal contributionsJournal articlesResearchpeer-review

Authors

Learning linear combinations of multiple kernels is an appealing strategy when the right choice of features is unknown. Previous approaches to multiple kernel learning (MKL) promote sparse kernel combinations to support interpretability and scalability. Unfortunately, this ℓ1norm MKL is rarely observed to outperform trivial baselines in practical applications. To allow for robust kernel mixtures that generalize well, we extend MKL to arbitrary norms. We devise new insights on the connection between several existing MKL formulations and develop two efficient interleaved optimization strategies for arbitrary norms, that is ℓp -norms with p ≥ 1. This interleaved optimization is much faster than the commonly used wrapper approaches, as demonstrated on several data sets. A theoretical analysis and an experiment on controlled artificial data shed light on the appropriateness of sparse, non-sparse and ℓ-norm MKL in various scenarios. Importantly, empirical applications of ℓp-norm MKL to three real-world problems from computational biology show that non-sparse MKL achieves accuracies that surpass the state-of-the-art. Data sets, source code to reproduce the experiments, implementations of the algorithms, and further information are available at http://doc.ml.tu-berlin.de/nonsparse-mkl/.

Original languageEnglish
JournalJournal of Machine Learning Research
Volume12
Pages (from-to)953-997
Number of pages45
ISSN1532-4435
Publication statusPublished - 03.2011
Externally publishedYes

    Research areas

  • Bioinformatics, Block coordinate descent, Convex conjugate, Generalization bounds, Large scale optimization, Learning kernels, Multiple kernel learning, Non-sparse, Rademacher complexity, Support vector machine
  • Informatics

Recently viewed

Publications

  1. Denoising and harmonic detection using nonorthogonal wavelet packets in industrial applications
  2. Introduction: Habitual Action, Automaticity, and Control
  3. Short and long-term dominance of negative information in shaping public energy perceptions
  4. An introduction to sliding mode control for interdisciplinary education
  5. Extension of SEIR compartmental models for constructive Lyapunov control of COVID-19 and analysis in terms of practical stability
  6. Development and evaluation of a training program for dialysis nurses - An intervention study
  7. Glancing into the Applied Tool Box
  8. Riding Two Horses at The Same Time: Paradox Responses for Navigating Exploration and Exploitation in Small and Medium-Sized IT Consulting Firms
  9. The frame of the game
  10. Linking the multi-level perspective with social representations theory
  11. Exchanging Knowledge and Good Practices of Education for Sustainable Development within a Global Student Organization (oikos)
  12. Group membership does not modulate goal- versus movement-based imitation
  13. Accuracy Improvement of Vision System for Mobile Robot Navigation by Finding the Energetic Center of Laser Signal
  14. Perceptions of Resource Criticality in Times of Resource Scarcity
  15. An empirical investigation of experiences and the link between a servicedominant logic mindset, competitive advantage, and performance of nonprofit organizations
  16. An Indirectly Controlled Full Variable Valve Train System to Improve the Internal Combustion Phase Engines
  17. State of the Art of Handling and Storage Systems on Container Terminals
  18. Narrative dialogic reading with wordless picture books
  19. Implicit and explicit horizons
  20. Analysis of life cycle datasets for the material gold
  21. Gas-Kampf oder Gas-Krampf
  22. Capitalizing on natural language processing (NLP) to automate the evaluation of coach implementation fidelity in guided digital cognitive-behavioral therapy (GdCBT)
  23. Rapid Prototyping of a Mechatronic Engine Valve Controller for IC Engines
  24. Dietary patterns of children on three indigenous societies
  25. Integrating work place and social environment into the measurement of work ability
  26. Detection of oscillations with application in the pantograph control
  27. Solution for the direct kinematics problem of the general stewart-gough platform by using only linear actuators’ orientations
  28. „Ist das dein Handy oder vibrierst du?“
  29. Improving collaboration between ecosystem service communities and the IPBES science-policy platform
  30. The utility of macroecological rules for microbial biogeography
  31. Collaboration and Open Science Initiatives in Primate Research
  32. Non-target Analysis and Chemometric Evaluation of a Passive Sampler Monitoring of Small Streams
  33. The Multiple Self Objection to the Prudential Lifespan Account
  34. Random year intercepts in mixed models help to assess uncertainties in insect population trends
  35. Friction riveting of 3D printed polyamide 6 with AA 6056-T6