 |
Free and accessible knowledge |
Journal articles
Statistically Efficient, Polynomial Time Algorithms for Combinatorial Semi Bandits
Statistically Efficient, Polynomial Time Algorithms for Combinatorial Semi Bandits
Abstract : We consider combinatorial semi-bandits over a set of arms X ⊂ {0, 1} d where rewards are uncorrelated across items. For this problem, the algorithm ESCB yields the smallest known regret bound R(T) = O d(ln m)² (ln T) ∆ min , but it has computational complexity O(|X|) which is typically exponential in d, and cannot be used in large dimensions. We propose the first algorithm which is both computationally and statistically efficient for this problem with regret R(T) = O d(ln m) 2 (ln T) ∆ min and computational complexity O(T poly(d)). Our approach involves carefully designing an approximate version of ESCB with the same regret guarantees, showing that this approximate algorithm can be implemented in time O(T poly(d)) by repeatedly maximizing a linear function over X subject to a linear budget constraint, and showing how to solve this maximization problems efficiently.
https://hal.archives-ouvertes.fr/hal-03162127
Contributor : Thibaut Cuvelier Connect in order to contact the contributor
Submitted on : Monday, March 8, 2021 - 12:05:10 PM
Last modification on : Thursday, April 15, 2021 - 3:06:31 AM
Long-term archiving on: : Wednesday, June 9, 2021 - 6:54:12 PM
Contributor : Thibaut Cuvelier Connect in order to contact the contributor
Submitted on : Monday, March 8, 2021 - 12:05:10 PM
Last modification on : Thursday, April 15, 2021 - 3:06:31 AM
Long-term archiving on: : Wednesday, June 9, 2021 - 6:54:12 PM
File
2002.07258.pdf
Files produced by the author(s)