S. Arlot and A. Celisse, A survey of cross-validation procedures for model selection, Statistics Surveys, vol.4, issue.0, pp.40-79, 2010.
DOI : 10.1214/09-SS054
URL : https://hal.archives-ouvertes.fr/hal-00407906

L. Baldassarre, J. Mourao-miranda, and M. Pontil, Structured Sparsity Models for Brain Decoding from fMRI Data, 2012 Second International Workshop on Pattern Recognition in NeuroImaging, p.5, 2012.
DOI : 10.1109/PRNI.2012.31

L. Breiman, Bagging predictors, Machine Learning, vol.10, issue.2, pp.123-140, 1996.
DOI : 10.2307/1403680

P. Bühlmann, P. Rütimann, S. Van-de-geer, and C. H. Zhang, Correlated variables in regression: Clustering and sparse estimation, Journal of Statistical Planning and Inference, vol.143, issue.11, pp.1835-1871, 2013.
DOI : 10.1016/j.jspi.2013.05.019

P. Bühlmann and B. Yu, Analyzing bagging, The Annals of Statistics, vol.30, issue.4, pp.927-961, 2002.
DOI : 10.1214/aos/1031689014

O. Demirci, V. P. Clark, V. A. Magnotta, N. C. Andreasen, J. Lauriello et al., A Review of Challenges in the Use of fMRI for Disease Classification / Characterization and A Projection Pursuit Application from A Multi-site fMRI Schizophrenia Study, Brain Imaging and Behavior, vol.23, issue.4, pp.207-226, 2008.
DOI : 10.1111/j.2044-8341.1961.tb00936.x

T. G. Dietterich, Ensemble Methods in Machine Learning, 2000.
DOI : 10.1007/3-540-45014-9_1

E. Dohmatob, M. Eickenberg, B. Thirion, and G. Varoquaux, Speeding-Up Model-Selection in Graphnet via Early-Stopping and Univariate Feature-Screening, 2015 International Workshop on Pattern Recognition in NeuroImaging, pp.17-20, 2015.
DOI : 10.1109/PRNI.2015.19
URL : https://hal.archives-ouvertes.fr/hal-01147731

L. Dümbgen, R. J. Samworth, and D. Schuhmacher, Stochastic search for semiparametric linear regression models. From Probability to Statistics and Back: High-Dimensional Models and Processes ? A Festschrift, pp.78-90, 2013.

K. Duncan, C. Pattamadilok, I. Knierim, and J. Devlin, Consistency and variability in functional localisers, NeuroImage, vol.46, issue.4, pp.1018-1026, 2009.
DOI : 10.1016/j.neuroimage.2009.03.014

M. Eickenberg, E. Dohmatob, B. Thirion, and G. Varoquaux, Total variation meets sparsity: statistical learning with segmenting penalties, International Conference on Medical Image Computing and Computer-Assisted Intervention, 2015.
URL : https://hal.archives-ouvertes.fr/hal-01170619

D. V. Essen, K. Ugurbil, E. Auerbach, D. Barch, T. Behrens et al., The Human Connectome Project: A data acquisition perspective, NeuroImage, vol.62, issue.4, pp.2222-2231, 2012.
DOI : 10.1016/j.neuroimage.2012.02.018

Y. Fan, N. Batmanghelich, C. M. Clark, and C. Davatzikos, Spatial patterns of brain atrophy in MCI patients, identified via high-dimensional pattern classification, predict subsequent cognitive decline, NeuroImage, vol.39, issue.4, pp.1731-1743, 2008.
DOI : 10.1016/j.neuroimage.2007.10.031

A. Gramfort, B. Thirion, and G. Varoquaux, Identifying predictive regions from fMRI with TV-L1 prior. PRNI, p.17, 2013.
URL : https://hal.archives-ouvertes.fr/hal-00839984

A. Gramfort, G. Varoquaux, and B. Thirion, Beyond Brain Reading: Randomized Sparsity and Clustering to Simultaneously Predict and Identify, pp.9-16, 2012.
DOI : 10.1016/j.neuroimage.2008.05.050
URL : https://hal.archives-ouvertes.fr/hal-00704875

K. Grill-spector and R. Malach, THE HUMAN VISUAL CORTEX, Annual Review of Neuroscience, vol.27, issue.1, pp.649-677, 2004.
DOI : 10.1146/annurev.neuro.27.070203.144220
URL : https://hal.archives-ouvertes.fr/hal-01418475

L. Grosenick, B. Klingenberg, K. Katovich, B. Knutson, and J. E. Taylor, Interpretable whole-brain prediction analysis with GraphNet, NeuroImage, vol.72, pp.304-321, 2013.
DOI : 10.1016/j.neuroimage.2012.12.062

T. Hastie, R. Tibshirani, M. B. Eisen, A. Alizadeh, R. Levy et al., 'gene shaving' as a method for identifying distinct sets of genes with similar expression patterns, Genome Biology, vol.1, 2000.

T. Hastie, R. Tibshirani, and J. Friedman, The Elements of Statistical Learning, 2009.

J. V. Haxby, M. I. Gobbini, M. L. Furey, A. Ishai, J. L. Schouten et al., Distributed and Overlapping Representations of Faces and Objects in Ventral Temporal Cortex, Science, vol.293, issue.5539, pp.2425-2430, 2001.
DOI : 10.1126/science.1063736

J. D. Haynes and G. Rees, Decoding mental states from brain activity in humans, Nature Reviews Neuroscience, vol.16, issue.7, pp.523-534, 2006.
DOI : 10.1520/JFS14925J

R. Henson, Forward inference using functional neuroimaging: dissociations versus associations, Trends in Cognitive Sciences, vol.10, issue.2, pp.64-69, 2006.
DOI : 10.1016/j.tics.2005.12.005

R. Henson, T. Shallice, M. Gorno-tempini, and R. Dolan, Face Repetition Effects in Implicit and Explicit Memory Tests as Measured by fMRI, Cerebral Cortex, vol.12, issue.2, p.178, 2002.
DOI : 10.1093/cercor/12.2.178

A. Hoyos-idrobo, G. Varoquaux, J. Kahn, and B. Thirion, Recursive nearest agglomeration (ReNA): fast clustering for approximation of structured signals, 2016.
URL : https://hal.archives-ouvertes.fr/hal-01366651

A. Knops, B. Thirion, E. M. Hubbard, V. Michel, and S. Dehaene, Recruitment of an Area Involved in Eye Movements During Mental Arithmetic, Science, vol.42, issue.5, p.1583, 2009.
DOI : 10.1016/S0010-9452(08)70416-7
URL : https://hal.archives-ouvertes.fr/hal-00504101

L. I. Kuncheva and J. J. Rodríguez, Classifier ensembles for fmri data analysis: an experiment. Magnetic resonance imaging 28, p.583, 2010.

L. I. Kuncheva, J. J. Rodríguez, C. O. Plumpton, D. E. Linden, and S. J. Johnston, Random Subspace Ensembles for fMRI Classification, IEEE Transactions on Medical Imaging, vol.29, issue.2, pp.531-542, 2010.
DOI : 10.1109/TMI.2009.2037756

L. I. Kuncheva, J. J. Rodriguez, C. O. Plumpton, D. E. Linden, and S. J. Johnston, Random Subspace Ensembles for fMRI Classification, IEEE Transactions on Medical Imaging, vol.29, issue.2, pp.531-542, 2010.
DOI : 10.1109/TMI.2009.2037756

G. Leung and A. R. Barron, Information theory and mixing leastsquares regressions, IEEE Transactions on information theory, vol.52, 2006.
DOI : 10.1109/tit.2006.878172

D. S. Marcus, T. H. Wang, and J. Parker, Open Access Series of Imaging Studies (OASIS): Cross-sectional MRI Data in Young, Middle Aged, Nondemented, and Demented Older Adults, Journal of Cognitive Neuroscience, vol.58, issue.9, 1498.
DOI : 10.1109/42.906424

N. Meinshausen and P. Bühlmann, Stability selection, Journal of the Royal Statistical Society: Series B (Statistical Methodology), vol.7, issue.4, pp.417-473, 2010.
DOI : 10.1186/1471-2105-9-307
URL : http://onlinelibrary.wiley.com/doi/10.1111/j.1467-9868.2010.00740.x/pdf

V. Michel, A. Gramfort, G. Varoquaux, E. Eger, and B. Thirion, Total Variation Regularization for fMRI-Based Prediction of Behavior, IEEE Transactions on Medical Imaging, vol.30, issue.7, pp.1328-1340, 2011.
DOI : 10.1109/TMI.2011.2113378

H. Mohr, U. Wolfensteller, S. Frimmel, and H. Ruge, Sparse regularization techniques provide novel insights into outcome integration processes, NeuroImage, vol.104, 2015.
DOI : 10.1016/j.neuroimage.2014.10.025

J. M. Moran, E. Jolly, and J. P. Mitchell, Social-Cognitive Deficits in Normal Aging, Journal of Neuroscience, vol.32, issue.16, p.5553, 2012.
DOI : 10.1523/JNEUROSCI.5511-11.2012

J. Mourão-miranda, A. L. Bokde, C. Born, H. Hampel, and M. Stetter, Classifying brain states and determining the discriminating activation patterns: Support Vector Machine on functional MRI data, NeuroImage, vol.28, issue.4, pp.980-995, 2005.
DOI : 10.1016/j.neuroimage.2005.06.070

A. Nemirovski, Topics in non-parametric statistics. Lectures on Probability Theory and Statistics: Ecole d'Ete de Probabilites de Saint-Flour XXVIII, p.85, 2000.

K. A. Norman, S. M. Polyn, G. J. Detre, and J. V. Haxby, Beyond mind-reading: multi-voxel pattern analysis of fMRI data, Trends in Cognitive Sciences, vol.10, issue.9, 2006.
DOI : 10.1016/j.tics.2006.07.005

F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion et al., Scikit-learn: Machine learning in python, Journal of Machine Learning Research, vol.12, p.2825, 2011.
URL : https://hal.archives-ouvertes.fr/hal-00650905

F. Pereira, T. Mitchell, and M. Botvinick, Machine learning classifiers and fMRI: A tutorial overview, NeuroImage, vol.45, issue.1, pp.199-209, 2009.
DOI : 10.1016/j.neuroimage.2008.11.007

R. A. Poldrack, Inferring Mental States from Neuroimaging Data: From Reverse Inference to Large-Scale Decoding, Neuron, vol.72, issue.5, pp.692-697, 2011.
DOI : 10.1016/j.neuron.2011.11.001

R. A. Poldrack, D. M. Barch, J. P. Mitchell, T. D. Wager, A. D. Wagner et al., Toward open sharing of task-based fMRI data: the OpenfMRI project, Frontiers in Neuroinformatics, vol.7, 2013.
DOI : 10.3389/fninf.2013.00012

R. A. Poldrack and K. J. Gorgolewski, OpenfMRI: Open sharing of task fMRI data, NeuroImage, vol.144, 2015.
DOI : 10.1016/j.neuroimage.2015.05.073

J. Praestgaard and J. A. Wellner, Exchangeably weighted bootstraps of the general empirical process. The Annals of Probability 21, pp.2053-2086, 1993.

J. M. Rondina, T. Hahn, L. De-oliveira, A. Marquand, T. Dresler et al., SCoRS—A Method Based on Stability for Feature Selection and Mapping in Neuroimaging, IEEE Transactions on Medical Imaging, vol.33, issue.1, pp.85-98, 2014.
DOI : 10.1109/TMI.2013.2281398

Y. Schwartz, B. Thirion, and G. Varoquaux, Mapping cognitive ontologies to and from the brain, in: Advances in neural information processing systems, 2013.

R. D. Shah and R. J. Samworth, Variable selection with error control: another look at stability selection, Journal of the Royal Statistical Society: Series B (Statistical Methodology), vol.97, issue.1, pp.55-80, 2013.
DOI : 10.1198/016214502760047032

S. Shalev-shwartz, O. Shamir, N. Srebro, and K. Sridharan, Learnability, stability and uniform convergence, Journal of Machine Learning Research, vol.11, pp.2635-2670, 2010.

R. Tibshirani, Regression shrinkage and selection via the Lasso, Journal of the Royal Statistical Society: Series B (Statistical Methodology), vol.58, 1994.

G. Varoquaux, A. Gramfort, and B. Thirion, Small-sample brain mapping: sparse recovery on spatially correlated designs with randomization and clustering, International conference on machine learning, p.1375, 2012.
URL : https://hal.archives-ouvertes.fr/hal-00705192

G. Varoquaux, P. R. Raamana, D. A. Engemann, A. Hoyos-idrobo, Y. Schwartz et al., Assessing and tuning brain decoders: Cross-validation, caveats, and guidelines, NeuroImage, vol.145, pp.166-179, 2017.
DOI : 10.1016/j.neuroimage.2016.10.038
URL : https://hal.archives-ouvertes.fr/hal-01332785

G. Varoquaux and B. Thirion, How machine learning is shaping cognitive neuroimaging, GigaScience, vol.3, issue.1, 2014.
DOI : 10.1186/2047-217X-3-28
URL : https://hal.archives-ouvertes.fr/hal-01094737

T. Wager, M. Davidson, B. Hughes, M. Lindquist, and K. Ochsner, Prefrontal-Subcortical Pathways Mediating Successful Emotion Regulation, Neuron, vol.59, issue.6, pp.1037-1050, 2008.
DOI : 10.1016/j.neuron.2008.09.006

Y. Wang, J. Zheng, S. Zhang, X. Duan, and H. Chen, Randomized structural sparsity via constrained block subsampling for improved sensitivity of discriminative voxel identification, NeuroImage, vol.117, pp.170-183, 2015.
DOI : 10.1016/j.neuroimage.2015.05.057

B. Yu, Stability, Bernoulli, vol.19, issue.4, pp.1484-1500, 2013.
DOI : 10.3150/13-BEJSP14
URL : https://hal.archives-ouvertes.fr/hal-01418476

Z. H. Zhou, Ensemble Methods: Foundations and Algorithms, 2012.

H. Zou and T. Hastie, Regularization and variable selection via the elastic net, Journal of the Royal Statistical Society: Series B (Statistical Methodology), vol.5, issue.2, pp.301-320, 2005.
DOI : 10.1073/pnas.201162998

/. ++clustering-frem-experimentallconditions-hcpfalseepicturee and . Henson, HCP::storyy//math ds009::successfull//unsuccessfullstop ds107::consonantt//scramble ds107, lefttfield OASIS::malee//female Nonnsparseemodels Sparseemodels

C. Figure, Relative performance: Relative prediction accuracy, weight stability and computation time for different classification tasks. Values are displayed relative to the mean over all the classifiers