Skip to Main content Skip to Navigation
Conference papers

ChaT: Evaluation of Reconfigurable Distributed Network Systems Using Metamorphic Testing

Alif Pranata 1 Olivier Barais 1 Johann Bourcier 1 Ludovic Noirie 2
1 DiverSe - Diversity-centric Software Engineering
Inria Rennes – Bretagne Atlantique , IRISA-D4 - LANGAGE ET GÉNIE LOGICIEL
Abstract : Detecting faults in distributed network systems is challenging because of their complexity, but this is required to evaluate and improve their reliability. This paper proposes ChaT, a testing and evaluation methodology under system reconfigurations and perturbations for distributed network systems, to evaluate QoS reliability by discriminating safe and failure-prone behaviors from different testing scenarios. Motivated by metamorphic testing technique that removes the burden of defining software oracles, we propose some metamorphic relationships that correlate system inputs and outputs to find patterns in executions. Classification techniques based on machine learning (principal component analysis and support vector machine) are used to identify system states and validate the proposed metamorphic relationships. These metamorphic relationships are also used to help anomaly detection. We verify this with several anomaly detection techniques (isolation forest, one-class SVM, local outlier factor, and robust covariance) that categorize experiments belonging to either safe or failure-prone states. We apply ChaT to a video streaming application use case. The simulation results show the effectiveness of ChaT to achieve our goals: identifying execution classes and detecting failure-prone experiments based on metamorphic relationships with high level of statistical scores.
Complete list of metadata

https://hal.archives-ouvertes.fr/hal-03379913
Contributor : Alif Akbar Pranata Connect in order to contact the contributor
Submitted on : Friday, October 15, 2021 - 11:42:30 AM
Last modification on : Friday, October 22, 2021 - 3:16:25 AM

File

Globecom_2021_hal_alif.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-03379913, version 1

Citation

Alif Pranata, Olivier Barais, Johann Bourcier, Ludovic Noirie. ChaT: Evaluation of Reconfigurable Distributed Network Systems Using Metamorphic Testing. GLOBCOM 2021 - IEEE Global Communications Conference, Dec 2021, Madrid, Spain. pp.1-6. ⟨hal-03379913⟩

Share

Metrics

Record views

28

Files downloads

26