Efficient tracking of a growing number of experts

Jaouad Mourtada 1 Odalric-Ambrym Maillard 2
2 SEQUEL - Sequential Learning
Inria Lille - Nord Europe, CRIStAL - Centre de Recherche en Informatique, Signal et Automatique de Lille (CRIStAL) - UMR 9189
Abstract : We consider a variation on the problem of prediction with expert advice, where new forecasters that were unknown until then may appear at each round. As often in prediction with expert advice, designing an algorithm that achieves near-optimal regret guarantees is straightforward, using ag-gregation of experts. However, when the comparison class is sufficiently rich, for instance when the best expert and the set of experts itself changes over time, such strategies naively require to maintain a prohibitive number of weights (typically exponential with the time horizon). By contrast, designing strategies that both achieve a near-optimal regret and maintain a reasonable number of weights is highly non-trivial. We consider three increasingly challenging objectives (simple regret, shifting regret and sparse shifting regret) that extend existing notions defined for a fixed expert ensemble; in each case, we design strategies that achieve tight regret bounds, adaptive to the parameters of the comparison class, while being computationally inexpensive. Moreover, our algorithms are anytime , agnostic to the number of incoming experts and completely parameter-free. Such remarkable results are made possible thanks to two simple but highly effective recipes: first the " abstention trick " that comes from the specialist framework and enables to handle the least challenging notions of regret, but is limited when addressing more sophisticated objectives. Second, the " muting trick " that we introduce to give more flexibility. We show how to combine these two tricks in order to handle the most challenging class of comparison strategies.
Document type :
Conference papers
Complete list of metadatas

Cited literature [30 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01615424
Contributor : Odalric-Ambrym Maillard <>
Submitted on : Thursday, October 12, 2017 - 1:17:25 PM
Last modification on : Wednesday, March 27, 2019 - 4:08:31 PM

File

paper-growing.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01615424, version 1

Citation

Jaouad Mourtada, Odalric-Ambrym Maillard. Efficient tracking of a growing number of experts. Algorithmic Learning Theory, Oct 2017, Tokyo, Japan. pp.1 - 23. ⟨hal-01615424⟩

Share

Metrics

Record views

900

Files downloads

324