Skip to Main content Skip to Navigation
Reports

Adaptive and Optimal Online Linear Regression on L1-balls

Abstract : We consider the problem of online linear regression on individual sequences. The goal in this paper is for the forecaster to output sequential predictions which are, after T time rounds, almost as good as the ones output by the best linear predictor in a given L1-ball in R^d. We consider both the cases where the dimension d is small and large relative to the time horizon T. We first present regret bounds with optimal dependencies on the sizes U, X and Y of the L1-ball, the input data and the observations. The minimax regret is shown to exhibit a regime transition around the point d = sqrt(T) U X / (2 Y). Furthermore, we present efficient algorithms that are adaptive, i.e., they do not require the knowledge of U, X, and Y, but still achieve nearly optimal regret bounds.
Complete list of metadatas

https://hal.archives-ouvertes.fr/hal-00594399
Contributor : Sébastien Gerchinovitz <>
Submitted on : Monday, January 23, 2012 - 3:29:02 PM
Last modification on : Thursday, September 17, 2020 - 12:29:52 PM
Long-term archiving on: : Tuesday, April 24, 2012 - 2:27:49 AM

Files

GY11.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-00594399, version 3
  • ARXIV : 1105.4042

Collections

Citation

Sébastien Gerchinovitz, Jia Yuan Yu. Adaptive and Optimal Online Linear Regression on L1-balls. 2011. ⟨hal-00594399v3⟩

Share

Metrics

Record views

573

Files downloads

274