Skip to Main content Skip to Navigation
Conference papers

TRANSMUT-SPARK: Transformation Mutation for Apache Spark

Abstract : We propose TRANSMUT-Spark, a tool that automates the mutation testing process of Big Data processing code within Spark programs. Apache Spark is an engine for Big Data Processing. It hides the complexity inherent to Big Data parallel and distributed programming and processing through built-in functions, underlying parallel processes, and data management strategies. Nonetheless, programmers must cleverly combine these functions within programs and guide the engine to use the right data management strategies to exploit the large number of computational resources required by Big Data processing and avoid substantial production losses. Many programming details in data processing code within Spark programs are prone to false statements that need to be correctly and automatically tested. This paper explores the application of mutation testing in Spark programs, a fault-based testing technique that relies on fault simulation to evaluate and design test sets. The paper introduces the TRANSMUT-Spark solution for testing Spark programs. TRANSMUT-Spark automates the most laborious steps of the process and fully executes the mutation testing process. The paper describes how the tool automates the mutants generation, test execution, and adequacy analysis phases of mutation testing with TRANSMUT-Spark. It also discusses the results of experiments that were carried out to validate the tool to argue its scope and limitations.
Document type :
Conference papers
Complete list of metadata
Contributor : Genoveva Vargas-Solar Connect in order to contact the contributor
Submitted on : Friday, August 6, 2021 - 10:00:40 AM
Last modification on : Friday, December 3, 2021 - 3:48:32 AM

Links full text


  • HAL Id : hal-03315927, version 1
  • ARXIV : 2108.02589


Joao Batista de Souza Neto, Anamaria Martins Moreira, Genoveva Vargas-Solar, Martin A. Musicante. TRANSMUT-SPARK: Transformation Mutation for Apache Spark. 23rd Brazilian Symposium, SBMF 2020, 2020-11-25, Nov 2020, Ouro Preto, Brazil. ⟨hal-03315927⟩



Record views