TRANSMUT-SPARK: Transformation Mutation for Apache Spark - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2020

TRANSMUT-SPARK: Transformation Mutation for Apache Spark

Résumé

We propose TRANSMUT-Spark, a tool that automates the mutation testing process of Big Data processing code within Spark programs. Apache Spark is an engine for Big Data Processing. It hides the complexity inherent to Big Data parallel and distributed programming and processing through built-in functions, underlying parallel processes, and data management strategies. Nonetheless, programmers must cleverly combine these functions within programs and guide the engine to use the right data management strategies to exploit the large number of computational resources required by Big Data processing and avoid substantial production losses. Many programming details in data processing code within Spark programs are prone to false statements that need to be correctly and automatically tested. This paper explores the application of mutation testing in Spark programs, a fault-based testing technique that relies on fault simulation to evaluate and design test sets. The paper introduces the TRANSMUT-Spark solution for testing Spark programs. TRANSMUT-Spark automates the most laborious steps of the process and fully executes the mutation testing process. The paper describes how the tool automates the mutants generation, test execution, and adequacy analysis phases of mutation testing with TRANSMUT-Spark. It also discusses the results of experiments that were carried out to validate the tool to argue its scope and limitations.

Dates et versions

hal-03315927 , version 1 (06-08-2021)

Identifiants

Citer

Joao Batista de Souza Neto, Anamaria Martins Moreira, Genoveva Vargas-Solar, Martin A. Musicante. TRANSMUT-SPARK: Transformation Mutation for Apache Spark. 23rd Brazilian Symposium, SBMF 2020, 2020-11-25, Nov 2020, Ouro Preto, Brazil. ⟨hal-03315927⟩
32 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More