Skip to Main content Skip to Navigation
Conference papers

Predicting Durability in DHTs using Markov Chains

Fabio Picconi Bruno Baynat 1 Pierre Sens 2
1 NPA - Networks and Performance Analysis
LIP6 - Laboratoire d'Informatique de Paris 6
2 Regal - Large-Scale Distributed Systems and Applications
LIP6 - Laboratoire d'Informatique de Paris 6, Inria Paris-Rocquencourt
Abstract : We consider the problem of data durability in low-bandwidth large-scale distributed storage systems. Given the limited bandwidth between replicas, these systems suffer from long repair times after a hard disk crash, making them vulnerable to data loss when several replicas fail within a short period of time. Recent work has suggested that the probability of data loss can be predicted by modeling the number of live replicas using a Markov chain. This, in turn, can then be used to determine the number of replicas necessary to keep the loss probability under a given desired value. Previous authors have suggested that the model parameters can be estimated using an expression that is constant or linear on the number of replicas. Our simulations, however, show that neither is correct, as these parameter values grow sublinearly with the number of replicas. Moreover, we show that using a linear expression will result in the probability of data loss being underestimated, while the constant expression will produce a significant overestimation. Finally, we provide an empirical expression that yields a good approximation of the sublinear parameter values. Our work can be viewed as a first step towards finding more accurate models to predict the durability of this type of systems.
Document type :
Conference papers
Complete list of metadata
Contributor : Lip6 Publications Connect in order to contact the contributor
Submitted on : Wednesday, June 22, 2016 - 5:28:18 PM
Last modification on : Friday, January 8, 2021 - 5:46:03 PM



Fabio Picconi, Bruno Baynat, Pierre Sens. Predicting Durability in DHTs using Markov Chains. InternationalWorkshop on Advanced Storage Systems (ADSS 2007), Oct 2007, Lyon, France. pp.532-538, ⟨10.1109/ICDIM.2007.4444278⟩. ⟨hal-01336261⟩



Record views