Prediction of Number of Software Defects based on SMOTE

doi:10.23940/ijpe.21.01.p12.123134

Abstract

Abstract:

Prediction of software defects is an effective way to improve system quality, and it is a key factor affecting the efficiency of defect detection and repair in software components. The purpose of this study is to improve the effectiveness of component defect prediction in the following two ways: for the imbalance of training data in defect prediction and the insufficient support of single regression in predicting the number of defects in components First, this study proposed to adopt SMOTE to construct a balanced sample dataset and oversample the defective components in the unbalanced sample dataset to take into account the proportion of different types of samples and improve the accuracy of prediction; second, this study proposes a method of multi-step prediction for the number of defects that supports regression after classification, and the method applies support vector machines to classify components and filter out non-defective components in the classification results, applies regression to establish a component defect number prediction model to effectively implement the multi-step prediction of component defect number, and further improves the accuracy of prediction. The evaluation of the experiment was completed on open-source datasets. The results show that the accuracy of multi-step prediction is better than the prediction by regression alone, and multi-step prediction has higher overall efficiency and applicability.

Key words: defect number prediction, oversampling, classification, SVM, regression

Guoqiang Xie, Shiyi Xie, Xiaohong Peng, and Zhao Li. Prediction of Number of Software Defects based on SMOTE [J]. Int J Performability Eng, 2021, 17(1): 123-134.

Add to citation manager EndNote|Reference Manager|ProCite|BibTeX|RefWorks

References 39.

1.	W. E. Wong, X. Li,P. A. Laplante, “Be More Familiar with Our Enemies and Pave the Way Forward: A Review of the Roles Bugs Played in Software Failures,”Journal of Systems and Software, Vol. 133, pp. 68-94, 2017
2.	X. Chen, Q. Gu, W. Liu, et al., “Survey of Static Software Defect Prediction,” Journal of Software, Vol. 27, No. 1, pp. 1-25, 2016
3.	L. Gong, S. Jiang,L. Jiang, “Research Progress of Software Defect Prediction,” Journal of Software, Vol. 30, No. 10, pp. 3090-3114, 2019
4.	Q. Wang, S. Wu,M. Li, “Software Defect Prediction,” Journal of Software, Vol. 19, No. 7, pp. 1565-1580, 2008
5.	N. Li, Y. Guo, X. Wang, et al., “Data Quality Evaluation Method in Software Defect Prediction,” Journal of Huazhong University of Science and Technology (Natural Science Edition), Vol. 48, No. 11, pp. 24-29, 2020
6.	Y. Li, W. E. Wong, S. Lee,F. Wotawa, “Using Tri-Relation Networks for Effective Software Fault-Proneness Prediction,”IEEE Access, Vol. 7, pp. 63066-63080, 2019
7.	X. Jing, Z. Zhang, S. Ying,F. Wang, “Software Defect Prediction based on Collaborative Representation Classification,” inProceedings of the 36th International Conference on Software Engineering, pp. 632-633, 2014
8.	S. Rathore and S. Kumar, “A Decision Tree Regression based Approach for the Number of Software Faults Prediction,” ACM SIGSOFT Software Engineering Notes, Vol. 41, No. 1, pp. 1-6, 2016
9.	M. Dambros, M. Lanza,R. Robbes, “An Extensive Comparison of Bug Prediction Approaches,” inProceedings of the 7th IEEE Working Conference on Mining Software Repositories, pp. 31-41, IEEE, Cape Town, 2010
10.	Y. Zhang, D. Lo, X. Xia,J. Sun, “An Empirical Study of Classifier Combination for Cross-Project Defect Prediction,” inProceedings of IEEE 39th Annual Computer Software and Applications Conference, pp. 264-269, IEEE, Taichung, 2015
11.	Y. Koroglu, A. Sen, D. Kutluay,A. Bayraktar, “Defect Prediction on a Legacy Industrial Software: A Case Study on Software with Few Defects,” inProceedings of IEEE/ACM 4th International Workshop on Conducting Empirical Studies in Industry, pp. 14-20, IEEE/ACM, 2016
12.	K. Dejaeger, T. Verbraken,B. Baesens, “Toward Comprehensible Software Fault Prediction Models using Bayesian Network Classifiers,” IEEE Transactions on Software Engineering, Vol. 39, No. 2, pp. 237-257, 2013
13.	V. Challagulla, F. Bastani, I. Yen,R. PAUL, “Empirical Assessment of Machine Learning based Software Defect Prediction Techniques,” inProceedings of the 10th IEEE International Workshop on Object-Oriented Real-Time Dependable Systems, pp. 263-270, IEEE, Sedona, 2005
14.	T. Graves, A. Karr, J. Marron,H. Siy, “Predicting Fault Incidence using Software Change History,” IEEE Transactions on Software Engineering, Vol. 26, No. 7, pp. 653-661, 2000
15.	S. Rathore and S. Kumar, “Predicting Number of Faults in Software System using Genetic Programming,”Procedia Computer Science, Vol. 62, pp. 303-311, 2015
16.	L. Madeyski and M. Jureczko, “Which Process Metrics can Significantly Improve Defect Prediction Models? An Empirical Study,” Software Quality Journal, Vol. 23, No. 3, pp. 393-422, 2015
17.	A. Panichella, C. Alexandru, S. Panichella, A. Bacchelli,H. Gall, “A Search-based Training Algorithm for Cost-Aware Defect Prediction,” inProceedings of the Genetic and Evolutionary Computation Conference 2016, pp. 1077-1084, ACM, Denver, 2016
18.	S. Chidamber and C. Kemerer, “A Metrics Suite for Object Oriented Design,” IEEE Transactions on Software Engineering, Vol. 20, No. 6, pp. 476-493, 1994
19.	P. Sandhu, R. Goel, A. Brar, J. Kaur,S. Anand, “A Model for Early Prediction of Faults in Software Systems,” inProceedings of 2010 the 2nd International Conference on Computer and Automation Engineering, pp. 281-285, IEEE, Rotterdam, 2010
20.	G. Scanniello, C. Gravino, A. Marcus,T. Menzies, “Class Level Fault Prediction using Software Clustering,” inProceedings of the 28th IEEE/ACM International Conference on Automated Software Engineering, pp. 640-645, IEEE/ACM, Clayton, 2013
21.	K. Gupta and S. Kang, “Fuzzy Clustering based Approach for Prediction of Level of Severity of Faults in Software Systems,” International Journal of Computer and Electrical Engineering, Vol. 3, No. 6, pp. 845-849, 2011
22.	F. Zhang, Q. Zheng, Y. Zou,A. Hassan, “Cross-Project Defect Prediction using a Connectivity-based Unsupervised Classifier,” inProceedings of the 38th International Conference on Software Engineering, pp. 309-320, IEEE/ACM, Austin, 2016
23.	S. Liu, X. Chen, W. Liu, J. Chen, Q. Gu,D. Chen, “FECAR: A Feature Selection Framework for Software Defect Prediction,” inProceedings of the 38th Annual Computer Software and Applications Conference, pp. 426-435, IEEE, Vasteras, 2014
24.	W. Liu, S. Liu, Q. Gu, X. Chen,D. Chen, “Fecs: A Cluster based Feature Selection Method for Software Fault Prediction with Noises,” inProceedings of the 39th Annual Computer Software and Applications Conference, pp. 276-281, IEEE, Taichung, 2015
25.	N. Chawla, K. Bowyer, L. Hall,W. Kegelmeyer, “SMOTE: Synthetic Minority Over-Sampling Technique,” Journal of Artificial Intelligence Research, Vol. 16, No. 1, pp. 321-357, 2002
26.	W. Yu and S. Huang, “Research and Application of Principal Component Analysis to Software Static Testing,” Computer Technology and Development, Vol. 21, No. 6, pp. 73-76, 2011
27.	M. Thangavel and G. Nasira, “Support Vector Machine for Software Defect Prediction,” International Journal of Applied Engineering Research, Vol. 9, No. 24, pp. 25633-25644, 2014
28.	K. Elish and M. Elish, “Predicting Defect-Prone Software Modules using Support Vector Machines,” Journal of Systems and Software, Vol. 81, No. 5, pp. 649-660, 2008
29.	S. Rathore and S. Kumar, “An Empirical Study of Some Software Fault Prediction Techniques for the Number of Faults Prediction,” Soft Computing, Vol. 21, No. 24, pp. 7417-7434, 2017
30.	M. Chen and Y. Ma, “An Empirical Study on Predicting Defect Numbers,” inProceedings of the 27th International Conference on Software Engineering and Knowledge Engineering, pp. 397-402, KSI, Pittsburgh, 2015
31.	B. Caglayan, E. Kocaguneli, J. Krall, F. Peters,B. Turhan, “The Promise Repository of Empirical Software Engineering Data,” 2012
32.	Y. Lai, X. Chen,H. Liu, “Research on Software Defect Prediction based on Bayesian Logistic Regression,” Computer Engineering and Applications, Vol. 55, No. 11, pp. 204-220, 2019
33.	C. Zhu, X. Chen, Z. Wang, et al., “Defect Prediction Model for Object Oriented Software based on Particle Swarm Optimized SVM,” Journal of Computer Applications, Vol. 37, No. S2, pp. 60-64, 2017
34.	J. Bansiya and C. Davis, “A Hierarchical Model for Object-Oriented Design Quality Assessment,” IEEE Transactions on Software Engineering, Vol. 28, No. 1, pp. 4-17, 2002
35.	B. Henderson-Sellers, “Object-Oriented Metrics: Measures of Complexity,” 1st Edition, Prentice-Hall, New Jersey, 1995
36.	T. Mccabe, “A Complexity Measure,” IEEE Transactions on Software Engineering, Vol.SE-2, No. 4, pp. 308-320, 1976
37.	M. Robert, “OO Design Quality Metrics,”An Analysis of Dependencies, Vol. 12, pp. 151-170, 1994
38.	T. Nguyen, T. An, V. Hai,T. Phuong, “Similarity-based and Rank-based Defect Prediction,” inProceedings of the 2014 International Conference on Advanced Technologies for Communications, pp. 321-325, IEEE, Hanoi, 2014
39.	R. Gao and E. Wong, “MSeer—An Advanced Technique for Locating Multiple Bugs in Parallel,” IEEE Transactions on Software Engineering, Vol. 45, No. 3, pp. 301-318, 2019

[1]	Vikas Verma, Arun Malik, and Isha Batra. Analyzing and Classifying Malware Types on Windows Platform using an Ensemble Machine Learning Approach [J]. Int J Performability Eng, 2024, 20(5): 312-318.
[2]	Manu Jyoti Gupta and Parveen Sehgal. Optimizing Credit Card Fraud Detection: Classifier Performance and Feature Selection Empowered by Grasshopper Algorithm [J]. Int J Performability Eng, 2024, 20(3): 177-185.
[3]	Ovais Bashir Gashroo and Monica Mehrotra. DetectHATE: Detecting Targeted Hate - A Framework for Classifying Online Abuse on X [J]. Int J Performability Eng, 2024, 20(11): 699-711.
[4]	Janarthanan Sekar and Ganesh Kumar T. Hyperparameter Tuning in Deep Learning-Based Image Classification to Improve Accuracy using Adam Optimization [J]. Int J Performability Eng, 2023, 19(9): 579-586.
[5]	Aashita Rajput, Muskan Yadav, Sachin Yadav, Megha Chhabra, and Arun Prakash Agarwal. Patch-Based Breast Cancer Histopathological Image Classification using Deep Learning [J]. Int J Performability Eng, 2023, 19(9): 607-623.
[6]	Rakesh Kumar, Sunny Arora, Ashima Arya, Neha Kohli, Vaishali Arya, and Ekta Singh. Ensemble Learning for Appraising English Text Readability using Gompertz Function [J]. Int J Performability Eng, 2023, 19(6): 388-396.
[7]	Vaishali Arya and Tapas Kumar. Boosting X-Ray Scans Feature for Enriched Diagnosis of Pediatric Pneumonia using Deep Learning Models [J]. Int J Performability Eng, 2023, 19(3): 175-183.
[8]	Harshita Batra and Leema Nelson. DCADS: Data-Driven Computer Aided Diagnostic System using Machine Learning Techniques for Polycystic Ovary Syndrome [J]. Int J Performability Eng, 2023, 19(3): 193-202.
[9]	Shobhanam Krishna and Sumati Sidharth. AI-Powered Workforce Analytics: Maximizing Business and Employee Success through Predictive Attrition Modelling [J]. Int J Performability Eng, 2023, 19(3): 203-215.
[10]	Liwei Chen, Jianhao An, Mingxin Du, and Kai Su. A New Method of Identifying the Prognostic Factors of Hepatocellular Carcinoma Patients [J]. Int J Performability Eng, 2023, 19(2): 85-93.
[11]	Shalaka Prasad Deore. SongRec: A Facial Expression Recognition System for Song Recommendation using CNN [J]. Int J Performability Eng, 2023, 19(2): 115-121.
[12]	Shikha Choudhary and Bhawna Saxena. Image-Based Crop Disease Detection using Machine Learning Approaches: A Survey [J]. Int J Performability Eng, 2023, 19(2): 122-132.
[13]	Kamireddy Vijay Chandra, Kala Praveen Bagadi, Kalapala Vidya Sagar, R. Manjula Sri, and K. Sudha Rani. Deep Learning-Powered Corneal Endothelium Image Segmentation with Attention U-Net [J]. Int J Performability Eng, 2023, 19(11): 736-743.
[14]	Jitender Tanwar, Sanjay Kumar Sharma, Mandeep Mittal, and Ashok Kumar Yadav. Classification of Web Services for Efficient Performability [J]. Int J Performability Eng, 2023, 19(10): 654-662.
[15]	Priyanshu Verma, Ishan Sharma, Sonia Deshmukh, and Rohit Vashisht. Customer Churn Analysis using Spark and Hadoop [J]. Int J Performability Eng, 2023, 19(10): 663-675.