A Systematic Analysis of Data Preprocessing for Machine Learning- based Software Cost Estimation

Jianglin Huang (1) , Yan-Fu Li (2) , Min Xie (1)

1 SEEM - Department of Systems Engineering and Engineering Management
2 LGI - Laboratoire Génie Industriel - EA 2606

Context Due to the complex nature of software development process, traditional parametric models and statistical methods often appear to be inadequate to model the increasingly complicated relationship between project development cost and the project features (or cost drivers). Machine learning (ML) methods, with several reported successful applications, have gained popularity for software cost estimation in recent years. Data preprocessing has been claimed by many researchers as a fundamental stage of ML methods; however, very few works have been focused on the effects of data preprocessing techniques. Objective This study aims for an empirical assessment of the effectiveness of data preprocessing techniques on ML methods in the context of software cost estimation. Method In this work, we first conduct a literature survey of the recent publications using data preprocessing techniques, followed by a systematic empirical study to analyze the strengths and weaknesses of individual data preprocessing techniques as well as their combinations. Results Our results indicate that data preprocessing techniques may significantly influence the final prediction. They sometimes might have negative impacts on prediction performance of ML methods. Conclusion In order to reduce prediction errors and improve efficiency, a careful selection is necessary according to the characteristics of machine learning methods, as well as the datasets used for software cost estimation.

Mots clés: software cost estimation; missing-data treatments; scaling; feature selection; case selection 2; data preprocessing

Domaines: Informatique [cs]

Jianglin Huang, Yan-Fu Li, Min Xie. A Systematic Analysis of Data Preprocessing for Machine Learning- based Software Cost Estimation. Information and Software Technology, 2015, 67, pp.108-127. ⟨10.1016/j.infsof.2015.07.004⟩. ⟨hal-01340341⟩