Skip to Main content Skip to Navigation
Journal articles

Exploring multimodal data fusion through joint decompositions with flexible couplings

Abstract : A Bayesian framework is proposed to define flexible coupling models for joint tensor decompositions of multiple data sets. Under this framework, a natural formulation of the data fusion problem is to cast it in terms of a joint maximum a posteriori (MAP) estimator. Data driven scenarii of joint posterior distributions are provided, including general Gaussian priors and non Gaussian coupling priors. We present and discuss implementation issues of algorithms used to obtain the joint MAP estimator. We also show how this framework can be adapted to tackle the problem of joint decompositions of large datasets. In the case of a conditional Gaussian coupling with a linear transformation, we give theoretical bounds on the data fusion performance using the Bayesian Cramer-Rao bound. Simulations are reported for hybrid coupling models ranging from simple additive Gaussian models, to Gamma-type models with positive variables and to the coupling of data sets which are inherently of different size due to different resolution of the measurement devices.
Document type :
Journal articles
Complete list of metadatas
Contributor : Rodrigo Cabral Farias <>
Submitted on : Friday, May 29, 2015 - 2:45:10 PM
Last modification on : Wednesday, October 14, 2020 - 1:56:03 PM

Links full text




Rodrigo Cabral Farias, Jérémy Cohen, Pierre Comon. Exploring multimodal data fusion through joint decompositions with flexible couplings. IEEE Transactions on Signal Processing, Institute of Electrical and Electronics Engineers, 2016, 64 (18), pp.4830-4844. ⟨10.1109/TSP.2016.2576425⟩. ⟨hal-01158082⟩



Record views