Skip to Main content Skip to Navigation
Conference papers

A comparison of performance specialization learning for configurable systems

Abstract : The specialization of the configuration space of a software system has been considered for targeting specific configuration profiles, usages, deployment scenarios, or hardware settings. The challenge is to find constraints among options' values that only retain configurations meeting a performance objective. Since the exponential nature of configurable systems makes a manual specialization unpractical, several approaches have considered its automation using machine learning, i.e., measuring a sample of configurations and then learning what options' values should be constrained. Even focusing on learning techniques based on decision trees for their built-in explainability, there is still a wide range of possible approaches that need to be evaluated, i.e., how accurate is the specialization with regards to sampling size, performance thresholds, and kinds of configurable systems. In this paper, we compare six learning techniques: three variants of decision trees (including a novel algorithm) with and without the use of model-based feature selection. We first perform a study on 8 configurable systems considered in previous related works and show that the accuracy reaches more than 90% and that feature selection can improve the results in the majority of cases. We then perform a study on the Linux kernel and show that these techniques performs as well as on the other systems. Overall, our results show that there is no one-size-fits-all learning variant (though high accuracy can be achieved): we present guidelines and discuss tradeoffs. CCS CONCEPTS • Software and its engineering → Software product lines; • Computing methodologies → Classification and regression trees.
Complete list of metadata

https://hal.archives-ouvertes.fr/hal-03335263
Contributor : Hugo Martin Connect in order to contact the contributor
Submitted on : Tuesday, September 7, 2021 - 10:30:01 AM
Last modification on : Friday, August 5, 2022 - 2:54:52 PM
Long-term archiving on: : Wednesday, December 8, 2021 - 6:06:37 PM

File

PerformanceSpecialization.pdf
Files produced by the author(s)

Identifiers

Citation

Hugo Martin, Mathieu Acher, Juliana Alves Pereira, Jean-Marc Jézéquel. A comparison of performance specialization learning for configurable systems. SPLC 2021 - 25th ACM International Systems and Software Product Line Conference, Sep 2021, Leicester, United Kingdom. pp.46-57, ⟨10.1145/3461001.3471155⟩. ⟨hal-03335263⟩

Share

Metrics

Record views

66

Files downloads

117