Skip to Main content Skip to Navigation
Conference papers

Fine-grained Benchmark Subsetting for System Selection

Abstract : System selection aims at finding the best architecture for a set of programs and workloads. It traditionally requires long running benchmarks. We propose a method to reduce the cost of system selection. We break down benchmarks into elementary fragments of source code, called codelets. Then, we identify two causes of redundancy: first, similar codelets; second, codelets called repeatedly. The key idea is to minimize redundancy inside the benchmark suite to speed it up. For each group of similar codelets, only one representative is kept. For codelets called repeatedly and for which the performance does not vary across calls, the number of invocations is reduced. Given an initial benchmark suite, our method produces a set of reduced benchmarks that can be used in place of the original one for system selection. We evaluate our method on the NAS SER benchmarks, producing a reduced benchmark suite 30 times faster in average than the original suite, with a maximum of 44 times. The reduced suite predicts the execution time on three target architectures with a median error between 3.9% and 8%.
Document type :
Conference papers
Complete list of metadata
Contributor : Pablo de Oliveira Castro Connect in order to contact the contributor
Submitted on : Wednesday, February 26, 2014 - 2:17:59 PM
Last modification on : Wednesday, October 20, 2021 - 12:24:14 AM




Pablo de Oliveira Castro, Yuriy Kashnikov, Chadi Akel, Mihail Popov, William Jalby. Fine-grained Benchmark Subsetting for System Selection. Annual IEEE/ACM International Symposium on Code Generation and Optimization, Feb 2014, Orlando, FL, United States. pp.132:132--132:142, ⟨10.1145/2544137.2544144⟩. ⟨hal-00952256⟩



Les métriques sont temporairement indisponibles