The Linux Scheduler: a Decade of Wasted Cores

Abstract : As a central part of resource management, the OS thread scheduler must maintain the following, simple, invariant: make sure that ready threads are scheduled on available cores. As simple as it may seem, we found that this invariant is often broken in Linux. Cores may stay idle for seconds while ready threads are waiting in runqueues. In our experiments, these performance bugs caused many-fold performance degradation for synchronization-heavy scientific applications, 13% higher latency for kernel make, and a 14-23% decrease in TPC-H throughput for a widely used commercial database. The main contribution of this work is the discovery and analysis of these bugs and providing the fixes. Conventional testing techniques and debugging tools are ineffective at confirming or understanding this kind of bugs, because their symptoms are often evasive. To drive our investigation , we built new tools that check for violation of the invariant online and visualize scheduling activity. They are simple, easily portable across kernel versions, and run with a negligible overhead. We believe that making these tools part of the kernel developers' tool belt can help keep this type of bug at bay.
Type de document :
Communication dans un congrès
EuroSys 2016, Apr 2016, London, United Kingdom. Proceedings of the Eleventh European Conference on Computer Systems. <http://eurosys16.doc.ic.ac.uk/>. <10.1145/2901318.2901326>
Liste complète des métadonnées

https://hal.archives-ouvertes.fr/hal-01295194
Contributeur : Jean-Pierre Lozi <>
Soumis le : jeudi 31 mars 2016 - 19:09:00
Dernière modification le : samedi 9 avril 2016 - 20:01:32
Document(s) archivé(s) le : lundi 14 novembre 2016 - 09:42:35

Fichier

eurosys16-final29.pdf
Accord explicite pour ce dépôt

Identifiants

Collections

UNICE | LIG | I3S | UGA

Citation

Jean-Pierre Lozi, Baptiste Lepers, Justin Funston, Fabien Gaud, Vivien Quéma, et al.. The Linux Scheduler: a Decade of Wasted Cores. EuroSys 2016, Apr 2016, London, United Kingdom. Proceedings of the Eleventh European Conference on Computer Systems. <http://eurosys16.doc.ic.ac.uk/>. <10.1145/2901318.2901326>. <hal-01295194>

Partager

Métriques

Consultations de
la notice

440

Téléchargements du document

1750