ChaT: Evaluation of Reconfigurable Distributed Network Systems Using Metamorphic Testing - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2021

ChaT: Evaluation of Reconfigurable Distributed Network Systems Using Metamorphic Testing

Alif Akbar Pranata
  • Fonction : Auteur
  • PersonId : 1090666
Olivier Barais
Johann Bourcier
  • Fonction : Auteur
  • PersonId : 955621
Ludovic Noirie

Résumé

Detecting faults in distributed network systems is challenging because of their complexity, but this is required to evaluate and improve their reliability. This paper proposes ChaT, a testing and evaluation methodology under system reconfigurations and perturbations for distributed network systems, to evaluate QoS reliability by discriminating safe and failure-prone behaviors from different testing scenarios. Motivated by metamorphic testing technique that removes the burden of defining software oracles, we propose some metamorphic relationships that correlate system inputs and outputs to find patterns in executions. Classification techniques based on machine learning (principal component analysis and support vector machine) are used to identify system states and validate the proposed metamorphic relationships. These metamorphic relationships are also used to help anomaly detection. We verify this with several anomaly detection techniques (isolation forest, one-class SVM, local outlier factor, and robust covariance) that categorize experiments belonging to either safe or failure-prone states. We apply ChaT to a video streaming application use case. The simulation results show the effectiveness of ChaT to achieve our goals: identifying execution classes and detecting failure-prone experiments based on metamorphic relationships with high level of statistical scores.
Fichier principal
Vignette du fichier
Globecom_2021_hal_alif.pdf (861.11 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03379913 , version 1 (15-10-2021)

Identifiants

  • HAL Id : hal-03379913 , version 1

Citer

Alif Akbar Pranata, Olivier Barais, Johann Bourcier, Ludovic Noirie. ChaT: Evaluation of Reconfigurable Distributed Network Systems Using Metamorphic Testing. GLOBCOM 2021 - IEEE Global Communications Conference, Dec 2021, Madrid, Spain. pp.1-6. ⟨hal-03379913⟩
109 Consultations
86 Téléchargements

Partager

Gmail Facebook X LinkedIn More