Assessing and Improving Sensors Data Quality in Streaming Context

Rayane El Sibai , Yousra Chabchoub (1) , Raja Chiky (1) , Jacques Demerjian (2) , Barbar Kablan (3)

1 ISEP - Institut Supérieur d'Electronique de Paris
2 LU / ULB - الجامعة اللبنانية [بيروت] = Lebanese University [Beirut] = Université libanaise [Beyrouth]
3 LaBRI - Laboratoire Bordelais de Recherche en Informatique

An environmental monitoring process consists of a regular collection and analysis of sensors data streams. It aims to infer new knowledge about the environment, enabling the explorer to supervise the network and to take right decisions. Different data mining techniques are then applied to the collected data in order to infer aggregated statistics useful for anomalies detection and forecasting. The obtained results are closely dependent on the collected data quality. In fact, the data are often dirty, they contain noisy, erroneous and missing values. Poor data quality leads to defective and faulty results. One solution to overcome this problem will be presented in this paper. It consists of evaluating and improving the data quality, to be able to obtain reliable results. In this paper, we first introduce the data quality concept. Then, we discuss the existing related research studies. Finally, we propose a complete sensors data quality management system.

Mots clés: Data quality; sensor errors; streaming data

Domaines: Informatique [cs]

Rayane El Sibai, Yousra Chabchoub, Raja Chiky, Jacques Demerjian, Barbar Kablan. Assessing and Improving Sensors Data Quality in Streaming Context. Acceso : Revista Puertorriqueña de Bibliotecología y Documentación, 2017, ⟨10.1007/978-3-319-67077-5_57⟩. ⟨hal-01588680⟩