A Hybrid Oversampling and Cleaning Framework for Accurate and Reliable Software Fault Prediction

doi:10.23940/ijpe.26.02.p4.8898

Abstract

Abstract:

Software fault prediction is an essential tool in improving the quality of software and minimizing the maintenance expenses of the software by detecting modules that were prone to defects at an early stage of the development lifecycle. Nevertheless, the class imbalance, in which faulty modules are a small subset of the dataset, is also a significant issue to the traditional machine learning classifier, which can subsequently result in low detection of instances of minority classes. To eliminate this problem, the current research suggests MC-SMOTE (Meta-Clustered SMOTE with Cleaning), a new hybrid sampling method that combines the clustering-based selective oversampling and mild under sampling with noise removal through ENN and Tomek Links. MC-SMOTE produces quality balanced data, minimizes artificial noise, and stabilizes decision-borders to better detect the minority-classes. The efficiency of the suggested method is measured on 6 NASA PROMISE datasets (CM1, KC1, JM1, PC1, PC2, PC3) with the help of 6 popular classifiers: Random Forest, Naive Bayes, K-Nearest Neighbors, Support Vector Machine, Logistic Regression, and Decision Tree. The experiment has shown that MC-SMOTE demonstrates significantly better results in all metrics, such as Accuracy, Precision, Recall, F1-Score, AUC-ROC, MCC, and G-Mean, and shows significant improvement in minority-class recognition and false alarm reduction. The results indicate that the hybrid methodology provides an increase in the reliability of the prediction of fault and effective generalization of the concept across various classifiers, which provide a strong solution to the challenge of dealing with class imbalance in the context of software quality assurance.

Key words: software fault prediction, class imbalance, hybrid sampling, MC-SMOTE, ENN, Tomek links

Ashu Mehta. A Hybrid Oversampling and Cleaning Framework for Accurate and Reliable Software Fault Prediction [J]. Int J Performability Eng, 2026, 22(2): 88-98.

Add to citation manager EndNote|Reference Manager|ProCite|BibTeX|RefWorks

References 21

[1]	Wong W.E., Horgan J.R., Syring M., Zage W., and Zage D., 2000. Applying design metrics to predict fault‐proneness: a case study on a large‐scale software system. Software: Practice and Experience, 30(14), pp. 1587-1608.
[2]	Rathore S.S., and Kumar S., 2017. An empirical study of some software fault prediction techniques for the number of faults prediction. Soft Computing, 21(24), pp. 7417-7434.
[3]	Mehta A., 2025. Intelligent software fault prediction with feature optimization and ensemble learning. International Journal of Reliability, Quality and Safety Engineering, 2550039.
[4]	Sharma B.U., Sadam R., Raj V., Jayabalan S., Krishnan S., Saravanakumar K., and Maturi S., 2025. DEST: diverse ensemble of self-trainers for software defect prediction. SN Computer Science, 6(8), 974.
[5]	Odejide B.J., Bajeh A.O., Balogun A.O., Alanamu Z.O., Adewole K.S., Akintola A.G., Salihu S.A., Usman-Hamza F.E., and Mojeed H.A., 2022. An empirical study on data sampling methods in addressing class imbalance problem in software defect prediction. In Computer Science on-Line Conference, pp. 594-610.
[6]	Kaliraj S., Sahasranth V.G.P., and Sivakumar V., 2025. Generalization of set of features for the software fault prediction using ant colony-based feature selection. International Journal of Information Technology, pp. 1-14.
[7]	Bennin K.E., Keung J., Phannachitta P., Monden A., and Mensah S., 2017. Mahakil: diversity based oversampling approach to alleviate the class imbalance issue in software defect prediction. IEEE Transactions on Software Engineering, 44(6), pp. 534-550.
[8]	Mehta A., Kaur N., and Kaur A., 2025. An ensemble voting classification approach for software defects prediction. International Journal of Information Technology, 17(3), pp. 1813-1820.
[9]	Siers M.J., and Islam M.Z., 2015. Software defect prediction using a cost sensitive decision forest and voting, and a potential solution to the class imbalance problem. Information Systems, 51, pp. 62-71.
[10]	Tong H., Liu B., and Wang S., 2018. Software defect prediction using stacked denoising autoencoders and two-stage ensemble learning. Information and Software Technology, 96, pp. 94-111.
[11]	Huda S., Liu K., Abdelrazek M., Ibrahim A., Alyahya S., Al-Dossari H., and Ahmad S., 2018. An ensemble oversampling model for class imbalance problem in software defect prediction. IEEE Access, 6, pp. 24184-24195.
[12]	Bejjanki K.K., Gyani J., and Gugulothu N., 2020. Class imbalance reduction (CIR): a novel approach to software defect prediction in the presence of class imbalance. Symmetry, 12(3), 407.
[13]	Feng S., Keung J., Yu X., Xiao Y., Bennin K.E., Kabir M.A., and Zhang M., 2021. COSTE: complexity-based OverSampling TEchnique to alleviate the class imbalance problem in software defect prediction. Information and Software Technology, 129, 106432.
[14]	Rathore S.S., Chouhan S.S., Jain D.K., and Vachhani A.G., 2022. Generative oversampling methods for handling imbalanced data in software fault prediction. IEEE Transactions on Reliability, 71(2), pp. 747-762.
[15]	Gupta M., Rajnish K., and Bhattacharjee V., 2024. Software fault prediction with imbalanced datasets using SMOTE-tomek sampling technique and genetic algorithm models. Multimedia Tools and Applications, 83(16), pp. 47627-47648.
[16]	Arun C., and Lakshmi C., 2022. Genetic algorithm-based oversampling approach to prune the class imbalance issue in software defect prediction. Soft Computing, 26(23), pp. 12915-12931.
[17]	Bhandari K., Kumar K., and Sangal A.L., 2024. Alleviating class imbalance issue in software fault prediction using DBSCAN-based induced graph under-sampling method. Arabian Journal for Science and Engineering, 49(9), pp. 12589-12627.
[18]	Kaliraj S., Kishoore A.M., and Sivakumar V., 2024. Software fault prediction using cross-project analysis: a study on class imbalance and model generalization. IEEE Access, 12, pp. 64212-64227.
[19]	Zhou Y., 2024. A software defect prediction approach based on machine learning. In 2024 IEEE 7th Advanced Information Technology, Electronic and Automation Control Conference (IAEAC), 7, pp. 630-634.
[20]	Nandeesh T., and Mehta A., 2024. Comparative performance of supervised learning models for software defect detection. In 2024 International Conference on Information Science and Communications Technologies (ICISCT), pp. 19-24.
[21]	Nandeesh T., and Mehta A., 2025. Improving classifier performance on imbalanced software defect datasets using resampling techniques. In 2025 International Conference on Frontier Technologies and Solutions (ICFTS), pp. 1-8.