Surrogate Assisted Feature Computation for Continuous Problems

Nacim Belkhir (1, 2) , Johann Dréo (1) , Pierre Savéant (1) , Marc Schoenauer (2)

1 TRT - Thales Research and Technologies [Orsay]
2 TAO - Machine Learning and Optimisation

A possible approach to Algorithm Selection and Configuration for continuous black box optimization problems relies on problem features, computed from a set of evaluated sample points. However, the computation of the features proposed in the literature require a rather large number of such sample points, unlikely to be practical for expensive real-world problems. On the other hand, surrogate models have been proposed to tackle the optimization of expensive objective functions. This paper propose to use surrogate models to approximate the values of the features at reasonable computational cost. Two experimental studies are conducted, using a continuous domain test bench. First, the effect of sub-sampling is analyzed. Then, a methodology to compute approximate values for the features using a surrogate model is proposed, and validated from the point of view of the classification of the test functions. It is shown that when only small computational budgets are available, using surrogate models as proxies to compute the features can be beneficial.

Mots clés: Empirical Study; Black-box Continuous Optimization; Surrogate Modelling; Problem Features

Domaines: Intelligence artificielle [cs.AI]; Apprentissage [cs.LG]

Nacim Belkhir, Johann Dréo, Pierre Savéant, Marc Schoenauer. Surrogate Assisted Feature Computation for Continuous Problems. 2015. ⟨hal-01303320v1⟩