Optimizing Bug Resolution: A Data-Driven Developer Recommendation System

doi:10.23940/ijpe.24.08.p5.510519

Abstract

Abstract: To deliver a quality project on time during software maintenance, selecting the most suitable developer to assign a newly reported bug is a complex task. The proposed Data-Driven Developer Recommendation System (DDRS) examines developer performance metrics based on bug reports. It recommends using machine learning techniques such as Random Forest, Decision Tree, and Support Vector Machine (SVM). The dataset from four open-source projects (SWT, Eclipse UI, BIRT, and JDT) is initially preprocessed. The algorithm computes severity and priority scores, average bug resolution time, and developer effort before merging these parameters into a Developer Weighted Score for ranking. Machine learning models are trained on the complete dataset with textual features converted to numerical representations via TF-IDF. These algorithms predict developer appropriateness for new bugs by combining predictions and precomputed scores to produce a top ten list. When tested using 10-fold cross-validation, the model displayed better accuracy, scoring up to 98.85% on BIRT, 97.7% on JDT, 91.5% on Eclipse UI, and 96.8% on SWT. The study emphasizes the importance of bug priority, resolution time, workload, and severity in triage. The suggested methodology successfully automates developer assignment, resulting in more efficient and accurate defect resolution in software development projects.

Key words: bug assignment, bug triaging, software maintenance, machine learning

Saurabh Saxena, and Chetna Gupta. Optimizing Bug Resolution: A Data-Driven Developer Recommendation System [J]. Int J Performability Eng, 2024, 20(8): 510-519.

Add to citation manager EndNote|Reference Manager|ProCite|BibTeX|RefWorks

References

[1] Jadhav V., Devale P., Jadhav R. B., Bidwe R. V., Mane M. and Pawar P., 2024. Machine Learning and Just-in-Time Strategies for Effective Bug Tracking in Software Development, International Journal of Intelligent Systems and Applications in Engineering,12(6s), p.749-758.
[2] Song, Y. and Chaparro, O., 2023. Recommending Bug Assignment Approaches for Individual Bug Reports: An Empirical Investigation.arXiv preprint arXiv:2305.18650.
[3] Samir M., Sherief N. and Abdelmoez W., 2023. Improving bug assignment and developer allocation in software engineering through interpretable machine learning models.Computers, 12(7), p.128.
[4] Rani, D.K. and Raajan, K., 2022, April. Bug Triaging Automation using Text Processing and Machine Learning Techniques. InProceedings of the International Conference on Innovative Computing & Communication (ICICC).
[5] Wu X., Zheng W., Chen X., Zhao Y., Yu T. and Mu D., 2021. Improving high-impact bug report prediction with combination of interactive machine learning and active learning. Information and Software Technology, 133, p.106530.
[6] Yadav, A. and Singh, S.K., 2024. Automated time based multi-criteria bug triage approach: developer working efficiency and social network based developer recommendation. Journal of Shanghai Jiaotong University (Science),29(3), pp.566-578.
[7] da Silva M.C., Cizotto A.A.J. and Paraiso E.C., 2020, July. A developer recommendation method based on code quality. In 2020 International Joint Conference on Neural Networks (IJCNN)(pp. 1-8). IEEE.
[8] Matsoukas V., Diamantopoulos T., Papamichail M.D. and Symeonidis A.L., 2020, December. Towards analyzing contributions from software repositories to optimize issue assignment. In 2020 IEEE 20th International Conference on Software Quality, Reliability and Security (QRS)(pp. 243-253). IEEE.
[9] Zhang W., Zhao J., Peng R., Wang S. and Yang Y., 2022. SusRec: An Approach to Sustainable Developer Recommendation for Bug Resolution Using Multimodal Ensemble Learning. IEEE Transactions on Reliability,72(1), pp.61-78.
[10] Gupta C., Inacio P.R. and Freire M.M., 2022. Improving software maintenance with improved bug triaging. Journal of King Saud University-Computer and Information Sciences,34(10), pp.8757-8764.
[11] Alkhazi B., DiStasi A., Aljedaani W., Alrubaye H., Ye X. and Mkaouer M.W., 2020. Learning to rank developers for bug report assignment. Applied Soft Computing, 95, p.106667.
[12] Sajedi‐Badashian, A. and Stroulia, E., 2020. Vocabulary and time based bug‐assignment: A recommender system for open‐source projects. Software: Practice and Experience,50(8), pp.1539-1564.
[13] Wu H., Ma Y., Xiang Z., Yang C. and He K., 2022. A spatial-temporal graph neural network framework for automated software bug triaging. Knowledge-Based Systems, 241, p.108308.
[14] Liu Y., Qi X., Zhang J., Li H., Ge X. and Ai J., 2022. Automatic bug triaging via deep reinforcement learning.Applied Sciences, 12(7), p.3565.
[15] Guo S., Zhang X., Yang X., Chen R., Guo C., Li H. and Li T., 2020. Developer activity motivated bug triaging: via convolutional neural network.Neural Processing Letters, 51, pp.2589-2606.
[16] Nagwani, N.K. and Suri, J.S., 2023. An artificial intelligence framework on software bug triaging, technological evolution, and future challenges: A review.International Journal of Information Management Data Insights, 3(1), p.100153.
[17] Rastogi A., Gupta A. and Sureka A., 2013, February. Samiksha: mining issue tracking system for contribution and performance assessment. InProceedings of the 6th India Software Engineering Conference(pp. 13-22).
[18] Mani S., Sankaran A. and Aralikatte R., 2019, January. Deeptriage: Exploring the effectiveness of deep learning for bug triaging. InProceedings of the ACM India joint international conference on data science and management of data(pp. 171-179).
[19] Zaidi S.F.A., Woo H. and Lee C.G., 2022. Toward an effective bug triage system using transformers to add new developers.Journal of Sensors, 2022(1), p.4347004.
[20] Kardoost M.R., Moosavi M.R. and Akbari R., 2022, November. Devranker: an effective approach to rank developers for bug report assignment. In 2022 12th International Conference on Computer and Knowledge Engineering (ICCKE)(pp. 030-035). IEEE.
[21] Baloch M.Z., Hussain S., Afzal H., Mufti M.R. and Ahmad B., 2021. Software developer recommendation in terms of reducing bug tossing length. In Security, Privacy, and Anonymity in Computation, Communication, and Storage: 13th International Conference, SpaCCS 2020, Nanjing, China, December 18-20, 2020, Proceedings 13 (pp. 396-407). Springer International Publishing.
[22] Yousefi M., Akbari R. and Moosavi S.M.R., 2020. Using Machine Learning Methods for Automatic Bug Assignment to Developers. Journal of Electrical and Computer Engineering Innovations (JECEI),8(2), pp.263-272.
[23] Sarkar A., Rigby P.C. and Bartalos B., 2019, September. Improving bug triaging with high confidence predictions at ericsson. In 2019 IEEE International Conference on Software Maintenance and Evolution (ICSME)(pp. 81-91). IEEE.
[24] Pahins C.A.D.L., D'Morison F., Rocha T.M., Almeida L.M., Batista A.F. and Souza D.F., 2019, December. T-REC: Towards accurate bug triage for technical groups. In 2019 18th IEEE International Conference on Machine Learning and Applications (ICMLA)(pp. 889-895). IEEE.
[25] Goyal, A. and Sardana, N., 2019, August. Empirical analysis of ensemble machine learning techniques for bug triaging. In 2019 Twelfth International Conference on Contemporary Computing (IC3)(pp. 1-6). IEEE.
[26] Guo S., Chen S., Wang S., Zhang D., Liu Y., Guo C., Li H. and Li T., 2019. A Multi-Factor Approach for Selection of Developers to Fix Bugs in a Program.Applied sciences, 9(16), p.3327.
[27] Sawarkar R., Nagwani N.K. and Kumar S., 2019, March. Predicting bug estimation time for newly reported bug using machine learning algorithms. In 2019 IEEE 5th International Conference for Convergence in Technology (I2CT)(pp. 1-4). IEEE.
[28] Yadav, A. and Singh, S.K., 2020. A novel and improved developer rank algorithm for bug assignment. International Journal of Intelligent Systems Technologies and Applications,19(1), pp.78-101.
[29] Uddin J., Ghazali R., Deris M.M., Naseem R. and Shah H., 2017. A survey on bug prioritization.Artificial Intelligence Review, 47, pp.145-180.
[30] Tran H.M., Le S.T., Nguyen S.V. and Ho P.T., 2020. An analysis of software bug reports using machine learning techniques.SN Computer Science, 1(1), p.4.
[31] Sbih, A. and Akour, M., 2018. Towards Efficient Ensemble Method for Bug Triaging.Journal of Multiple-Valued Logic & Soft Computing, 31.
[32] Xuan J., Jiang H., Ren Z., Yan J. and Luo Z., 2017. Automatic bug triage using semi-supervised text classification.arXiv preprint arXiv:1704.04769.
[33] Sharma M., Tandon A., Kumari M. and Singh V.B., 2017. Reduction of redundant rules in association rule mining-based bug assignment.International Journal of Reliability, Quality and Safety Engineering, 24(06), p.1740005.
[34] Xia X., Lo D., Shihab E. and Wang X., 2015. Automated bug report field reassignment and refinement prediction. IEEE Transactions on Reliability,65(3), pp.1094-1113.
[35] Sharma, M. and Singh, V.B., 2016. Clustering-based association rule mining for bug assignee prediction. International Journal of Business Intelligence and Data Mining,11(2), pp.130-150.
[36] Jonsson L., Borg M., Broman D., Sandahl K., Eldh S. and Runeson P., 2016. Automated bug assignment: Ensemble-based machine learning in large scale industrial contexts.Empirical Software Engineering, 21, pp.1533-1578.
[37] Hu H., Zhang H., Xuan J. and Sun W., 2014, November. Effective bug triage based on historical bug-fix information. In 2014 IEEE 25th international symposium on software reliability engineering(pp. 122-132). IEEE.