Extracting Universal Representations of Cognition across Brain-Imaging Studies

Arthur Mensch 1 Julien Mairal 2 Bertrand Thirion 1 Gaël Varoquaux 1
1 PARIETAL - Modelling brain structure, function and variability based on high-field MRI data
NEUROSPIN - Service NEUROSPIN, Inria Saclay - Ile de France
2 Thoth - Apprentissage de modèles à partir de données massives
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann
Abstract : We show in this paper how to extract shared brain representations that predict mental processes across many cognitive neuroimaging studies. Focused cognitive-neuroimaging experiments study precise mental processes with carefully-designed cognitive paradigms; however the cost of imaging limits their statistical power. On the other hand, large-scale databasing efforts increase considerably the sample sizes, but cannot ask precise cognitive questions. To address this tension, we develop new methods that turn the heterogeneous cognitive information held in different task-fMRI studies into common-universal-cognitive models. Our approach does not assume any prior knowledge of the commonalities shared by the studies in the corpus; those are inferred during model training. The method uses deep-learning techniques to extract representations - task-optimized networks - that form a set of basis cognitive dimensions relevant to the psychological manipulations. In this sense, it forms a novel kind of functional atlas, optimized to capture mental state across many functional-imaging experiments. As it bridges information on the neural support of mental processes, this representation improves decoding performance for 80% of the 35 widely-different functional imaging studies that we consider. Our approach opens new ways of extracting information from brain maps, increasing statistical power even for focused cognitive neuroimaging studies, in particular for those with few subjects.
Liste complète des métadonnées

Contributeur : Arthur Mensch <>
Soumis le : jeudi 18 octobre 2018 - 10:06:17
Dernière modification le : vendredi 8 mars 2019 - 01:20:23
Document(s) archivé(s) le : samedi 19 janvier 2019 - 12:30:48


Fichiers produits par l'(les) auteur(s)


  • HAL Id : hal-01874713, version 2
  • ARXIV : 1809.06035


Arthur Mensch, Julien Mairal, Bertrand Thirion, Gaël Varoquaux. Extracting Universal Representations of Cognition across Brain-Imaging Studies. 2018. 〈hal-01874713v2〉



Consultations de la notice


Téléchargements de fichiers