Skip to Main content Skip to Navigation
Preprints, Working Papers, ...

Deep learning for brains?: Different linear and nonlinear scaling in UK Biobank brain images vs. machine-learning datasets

Abstract : Abstract In recent years, deep learning has unlocked unprecedented success in various domains, especially in image, text, and speech processing. These breakthroughs may hold promise for neuroscience and especially for brain-imaging investigators who start to analyze thousands of participants. However, deep learning is only beneficial if the data have nonlinear relationships and if they are exploitable at currently available sample sizes.We systematically profiled the performance of deep models, kernel models, and linear models as a function of sample size on UK Biobank brain images against established machine learning references. On MNIST and Zalando Fashion, prediction accuracy consistently improved when escalating from linear models to shallow-nonlinear models, and further improved when switching to deep-nonlinear models. The more observations were available for model training, the greater the performance gain we saw. In contrast, using structural or functional brain scans, simple linear models performed on par with more complex, highly parameterized models in age/sex prediction across increasing samplesizes. In fact, linear models kept improving as the sample size approached ~10,000 participants. Our results indicate that the increase in performance of linear models with additional data does not saturate at the limit of current feasibility. Yet, nonlinearities of common brain scans remain largely inaccessible to both kernel and deep learning methods at any axemined scale
Document type :
Preprints, Working Papers, ...
Complete list of metadatas

Cited literature [78 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-02276649
Contributor : Danilo Bzdok <>
Submitted on : Tuesday, September 3, 2019 - 9:13:27 AM
Last modification on : Wednesday, October 14, 2020 - 4:16:39 AM
Long-term archiving on: : Wednesday, February 5, 2020 - 1:45:55 PM

File

deeper_brain_manu_draft4_19082...
Files produced by the author(s)

Identifiers

  • HAL Id : hal-02276649, version 1

Collections

Citation

Marc-Andre Schulz, B Yeo, Joshua Vogelstein, Janaina Mourao-Miranada, Jakob Kather, et al.. Deep learning for brains?: Different linear and nonlinear scaling in UK Biobank brain images vs. machine-learning datasets. 2019. ⟨hal-02276649⟩

Share

Metrics

Record views

1210

Files downloads

1785