HAL will be down for maintenance from Friday, June 10 at 4pm through Monday, June 13 at 9am. More information
Skip to Main content Skip to Navigation
Conference papers

Linear predictor on linearly-generated data with missing values: non consistency and solutions

Abstract : We consider building predictors when the data have missing values. We study the seemingly-simple case where the target to predict is a linear function of the fully-observed data and we show that, in the presence of missing values, the optimal predictor may not be linear. In the particular Gaussian case, it can be written as a linear function of multiway interactions between the observed data and the various missing-value indicators. Due to its intrinsic complexity, we study a simple approximation and prove generalization bounds with finite samples, highlighting regimes for which each method performs best. We then show that multilayer perceptrons with ReLU activation functions can be consistent, and can explore good trade-offs between the true model and approximations. Our study highlights the interesting family of models that are beneficial to fit with missing values depending on the amount of data available.
Complete list of metadata

https://hal.archives-ouvertes.fr/hal-02464569
Contributor : Marine Le Morvan Connect in order to contact the contributor
Submitted on : Wednesday, May 6, 2020 - 7:03:20 PM
Last modification on : Wednesday, March 16, 2022 - 3:53:08 AM

Files

aistats.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-02464569, version 2
  • ARXIV : 2002.00658

Citation

Marine Le Morvan, Nicolas Prost, Julie Josse, Erwan Scornet, Gaël Varoquaux. Linear predictor on linearly-generated data with missing values: non consistency and solutions. AISTATS 2020 - International Conference on Artificial Intelligence and Statistics, Aug 2020, Online, France. pp.3165-3174. ⟨hal-02464569v2⟩

Share

Metrics

Record views

430

Files downloads

122