Scaling Bayesian Optimization up to Higher Dimensions: a Review and Comparison of Recent Algorithms

Abstract : Bayesian optimization is known to be a method of choice when it comes to solving optimization problems involving black-box, non-convex and low-dimensional functions in a few iterations. Yet, how to scale this method up to higher dimensions is a challenging and still unsolved research issue. In this paper, we first present and structure recent axes of research addressing this topic. We then experimentally compare three selected high-dimensional Bayesian optimization algorithms to random search on diverse high-dimensional functions. Our results suggest that no algorithm consistently outperforms the others across all types of difficulties encountered and that random search is in general very competitive, confirming recent research results.
Document type :
Conference papers
Complete list of metadatas

https://hal.archives-ouvertes.fr/hal-02265260
Contributor : Benoît Choffin <>
Submitted on : Friday, August 9, 2019 - 9:03:23 AM
Last modification on : Sunday, August 11, 2019 - 1:13:54 AM

Identifiers

Citation

Benoît Choffin, Naonori Ueda. Scaling Bayesian Optimization up to Higher Dimensions: a Review and Comparison of Recent Algorithms. 2018 IEEE 28th International Workshop on Machine Learning for Signal Processing (MLSP), Sep 2018, Aalborg, Denmark. ⟨10.1109/MLSP.2018.8517011⟩. ⟨hal-02265260⟩

Share

Metrics

Record views

13