Skip to Main content Skip to Navigation
Preprints, Working Papers, ...

Input Output Kernel Regression: Supervised and Semi-Supervised Structured Output Prediction with Operator-Valued Kernels

Abstract : In this paper, we introduce a novel approach, called Input Output Kernel Regression (IOKR), for learning mappings between structured inputs and structured outputs. The approach belongs to the family of Output Kernel Regression methods devoted to regression in feature space endowed with some output kernel. In order to take into account structure in input data and benefit from kernels in the input space as well, we use the Reproducing Kernel Hilbert Space theory for vector-valued functions. We first recall the ridge solution for supervised learning and then study the regularized hinge loss-based solution used in Maximum Margin Regression. Both models are also developed in the context of semi-supervised setting. We also derive an extension of Generalized Cross Validation for model selection in the case of the least-square model. Finally we show the versatility of the IOKR framework on two different problems: link prediction seen as a structured output problem and multi-task regression seen as a multiple and interdependent output problem. Eventually, we present a set of detailed numerical results that shows the relevance of the method on these two tasks.
Document type :
Preprints, Working Papers, ...
Complete list of metadatas

Cited literature [52 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01216708
Contributor : Céline Brouard <>
Submitted on : Monday, October 19, 2015 - 4:24:47 PM
Last modification on : Friday, July 31, 2020 - 10:44:08 AM
Document(s) archivé(s) le : Thursday, April 27, 2017 - 7:12:22 AM

File

Input_Output_Kernel_Regression...
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01216708, version 1

Citation

Céline Brouard, Florence d'Alché-Buc, Marie Szafranski. Input Output Kernel Regression: Supervised and Semi-Supervised Structured Output Prediction with Operator-Valued Kernels. 2015. ⟨hal-01216708⟩

Share

Metrics

Record views

976

Files downloads

954