Piecewise Combination of Hyper-Sphere Support Vector Machine for Multi-Class Classification Problems

doi:10.23940/ijpe.19.06.p12.16111619

Int J Performability Eng ›› 2019, Vol. 15 ›› Issue (6): 1611-1619.doi: 10.23940/ijpe.19.06.p12.16111619

Previous Articles Next Articles

Piecewise Combination of Hyper-Sphere Support Vector Machine for Multi-Class Classification Problems

Shuang Liu^a,*, Peng Chen^b, Jiayi Li^a, Hui Yang^a, and Niko Lukač^c

a School of Computer Science and Engineering, Dalian Minzu University, Dalian, 116600, China
b Department of Software Engineering, Dalian Neusoft University of Information, Dalian, 116023, China
c Faculty of Electrical Engineering and Computer Science, University of Maribor, Maribor, SI-2000, Slovenia

Submitted on ;
Contact: * E-mail address: liushuang@dlnu.edu.cn
About author:Shuang Liu received her Ph.D. in traffic information engineering and control from Dalian Maritime University, China. She is currently an associate professor at Dalian Minzu University, China. Her current research interests include machine learning and image processing;Peng Chen is currently a professor at Dalian Neusoft University of Information, China. His research interests include machine learning, collision avoidance, and intelligent information processing;Jiayi Li is currently a postgraduate candidate at Dalian Minzu University, China. Her research interests include deep learning and big data;Hui Yang is currently a postgraduate candidate at Dalian Minzu University, China. His research interests include deep learning and big data;Niko Lukač obtained his Ph.D. in computer science in 2016 from Maribor University. He is currently a researcher in the Faculty of Electrical Engineering and Computer Science at the University of Maribor, Slovenia.
Supported by:
This work is partially supported by the National Nature Science Foundation of Liaoning Province (No. 2015020099) and the National Natural Science Foundation (No. 71303031).

Abstract

Abstract: Hyper-sphere Support vector machine (SVM) is a widely used machine learning method for multi-class classification problems such as image recognition, text classification, or handwriting recognition. In most cases, only one hyper-sphere optimization problem is computed to solve the problem. However, there are many complex applications with complicated data distributions. In these cases, the computation cost will be increased with unsatisfied classification results if only one support vector machine is adopted as the classification decision rule. To achieve good classification performance, a piecewise combination of the hyper-sphere support vector machine is put forward in this paper based on the analysis of the data sample distribution. First, statistical analysis is adopted for the original data. Then, the k-means cluster algorithm is introduced to compute cluster centers for different classes of the data. For the n classes classification problem, m (m > n) hyper-spheres are computed to solve the objective problems based on the number of data centers. For simple sphere-distribution and locally linearly separable distribution cases, the minimum enclosing and maximum excluding support vector machine and the combination of hyper-sphere support vector machine are defined. Experimental results show that different support vector machines for different data distributions will improve the final classification performance.

Key words: support vector machine, hyper-sphere, data distribution, piecewise, combination, classification performance

Shuang Liu, Peng Chen, Jiayi Li, Hui Yang, and Niko Lukač. Piecewise Combination of Hyper-Sphere Support Vector Machine for Multi-Class Classification Problems [J]. Int J Performability Eng, 2019, 15(6): 1611-1619.

Add to citation manager EndNote|Reference Manager|ProCite|BibTeX|RefWorks

References

[1] V. N. Vapnik, “An Overview of Statistical Learning Theory,” IEEE Transactions on Neural Networks, Vol. 10, No. 5, pp. 988-999, 1999
[2] V. N. Vapnik, “The Nature of Statistical Learning Theory,” Springer-Verlag, New York, 1999
[3] J. Weston and C. Watkins, “Support Vector Machines for Multi-Class Pattern Recognition,” inProceedings of the European Symposium on Artificial Neural Networks, pp. 219-224, Bruges, 1999
[4] C. W.Hsu and C. J. Lin, “A Comparison of Methods for Multi-Class Support Vector Machines,” IEEE Transactions on Neural Networks, Vol. 13, No. 2, pp. 415-425, 2002
[5] M. L. Zhu, S. F. Chen,X. D. Liu, “Sphere-Structured Support Vector Machines for Multi-Class Pattern Recognition,”Lecture Notes in Computing Science, Vol. 2369, pp. 589-593, 2003
[6] Q. Wu, C. Y. Jia,A. F. Zhang, “An Improved Algorithm based on Sphere Structure SVMs and Simulation,” Journal of System Simulation (Chinese), Vol. 20, No. 2, pp. 345-348, 2008
[7] Y. Chen, X. S. Zhou, and T. S. Huang, “One-Class SVM for Learning in Image Retrieval,” in Proceedings of the 2001 IEEE International Conference On Image Processing, pp. 34-37, 2001
[8] V. Vural and J. G. Dy, “A Hierarchical Method for Multi-Class Support Vector Machines,” inProceedings of International Conference on Machine Learning, pp. 831-838, ACM, 2004
[9] K. Mele and J. Maver, “Object Recognition using Hierarchical SVMs,” in Proceedings of Computer Vision Winter Workshop '03, Valtice, Czech Republic, 2003
[10] K. Benabdeslem and Y. Bennani, “Dendogram-based SVM for Multi-Class Classification,” Journal of Computing & Information Technology, Vol. 14, No. 4, pp. 283-289, 2006
[11] W. Chmielnicki and K. Sta?por, “Combining One-Versus-One and One-Versus-All Strategies to Improve Multiclass SVM Classifier,” inProceedings of the 9th International Conference on Computer Recognition Systems, pp. 37-45, 2016
[12] T. Le, D. Tran, W. Ma,D. Sharma, “A Theoretical Framework for Multi-Sphere Support Vector Data Description,” in Proceedings of the 17th International Conference on N Neural Information Processing Models & Applications ICONIP'10, Vol. part II, pp. 132-142 , Sydney, Australia, 2010
[13] H. Cevikalp and B. Triggs, “Visual Object Detection using Cascades of Binary and One-Class Classifiers,” International Journal of Computer Vision, Vol. 123, No. 3, pp. 334-349, 2017
[14] Y. S. Xiao, B. Liu, L. B. Cao, X. D. Wu, C. Q. Zhang, Z. F. Hao, et al., “Multi-Sphere Support Vector Data Description for Outliers Detection on Multi-Distribution Data,” in Proceedings of 2009 IEEE International Conference on Data Mining Workshops, pp. 82-87, 2009
[15] Y. Liu and Y. F. Zheng, “Minimum Enclosing and Maximum Excluding Machine for Pattern Description and Discrimination,” inProceedings of the 18th International Conference on Pattern Recognition, Vol. 3, pp. 129-132, 2006
[16] Z. Yang, N. Meratnia,P. Havinga, “An Online Outlier Detection Technique for Wireless Sensor Networks using Unsupervised Quarter-Sphere Support Vector Machine,” inProceedings of International Conference on Intelligent Sensors, pp. 151-156, 2008
[17] S. Liu, P. Chen,K. Q. Li, “Multiple Sub-Hyper-Spheres Support Vector Machine for Multi-Class Classification,” International Journal of Wavelets Multiresolution and Information Processing, Vol. 12, No. 3, 2014
[18] S. Liu, P. Chen,J. Yun, “Fuzzy Hyper-Sphere Support Vector Machine for Pattern Recognition,” ICIC Express Letters, Vol. 9, No. 1, pp. 87-92, 2015
[19] A. Rabaoui, M. Davy, S. Rossignol, Z. Lachiri,N. Ellouze, “Improved One-Class SVM Classifier for Sounds Classification,” inProceedings of IEEE Conference on Advanced Video & Signal based Surveillance, pp. 117-122, 2007
[20] J. Munoz-Mari, F. Bovolo, L. Gomez-Chova, L. Bruzzone,G. Camp-Valls, “Semisupervised One-Class Support Vector Machines for Classification of Remote Sensing Data,” IEEE Transactions on Geoscience and Remote Sensing, Vol. 48, No. 8, pp. 3188-3197, 2010
[21] S. Mohanty, “Speaker Identification using SVM During Oriya Speech Recognition,”I. J. Image, Graphics and Signal Processing, Vol. 10, pp. 28-36, 2015
[22] A. Sun, E. P. Lim,Y. Liu, “On Strategies for Imbalanced Text Classification using SVM: A Comparative Study,” Decision Support Systems, Vol. 48, No. 1, pp. 191-201, 2009

Piecewise Combination of Hyper-Sphere Support Vector Machine for Multi-Class Classification Problems

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended 0

[1]	Sanjay Razdan, Himanshu Gupta, and Ashish Seth. D-SVM: A Deep Support Vector Machine Model with Different Kernel Types for Improved Intrusion Detection Performance [J]. Int J Performability Eng, 2023, 19(9): 598-606.
[2]	Pranshu Kumar Soni and Leema Nelson. PCP: Profit-Driven Churn Prediction using Machine Learning Techniques in Banking Sector [J]. Int J Performability Eng, 2023, 19(5): 303-311.
[3]	Harshita Batra and Leema Nelson. DCADS: Data-Driven Computer Aided Diagnostic System using Machine Learning Techniques for Polycystic Ovary Syndrome [J]. Int J Performability Eng, 2023, 19(3): 193-202.
[4]	Richa Sharma and Shailendra Narayan Singh. Towards Accurate Heart Disease Prediction System: An Enhanced Machine Learning Approach [J]. Int J Performability Eng, 2022, 18(2): 136-148.
[5]	Jiali Yang, Jiarui Chen, and Sheng Li. Decomposition and Identification of Non-Intrusive Load Equipment Group [J]. Int J Performability Eng, 2021, 17(1): 74-84.
[6]	Yong Yang. Wireless Sensor Node Location based on IGWO-LSSVM [J]. Int J Performability Eng, 2020, 16(9): 1434-1442.
[7]	Minghua Wei. Pedestrian Re-Identification Incorporating Multi-Information Flow Deep Learning Model [J]. Int J Performability Eng, 2020, 16(7): 1027-1037.
[8]	Jie Lin, Minghua Wei. Network Security Situation Prediction based on Combining 3D-CNNs and Bi-GRUs [J]. Int J Performability Eng, 2020, 16(12): 1875-1887.
[9]	Sibo Li, Yongqin Zhou, Ran Li, and Xu Zhao. Online Lithium Battery Fault Diagnosis based on Least Square Support Vector Machine Optimized by Ant Lion Algorithm [J]. Int J Performability Eng, 2020, 16(10): 1637-1645.
[10]	Jiaqi Zhen, and Xiaoli Zhang. Signal Number Estimation based on Support Vector Machine [J]. Int J Performability Eng, 2020, 16(10): 1655-1664.
[11]	Qinggang Wu, Yilan Zhao, Qiuwen Zhang, and Bin Jiang. Remote Sensing Image Classification based on Fusion of ATLTP and Tamura Texture Features [J]. Int J Performability Eng, 2020, 16(1): 59-66.
[12]	Xinlei Wang, Shulin Liu, Xiaojian Yi, Huoming Wei, and Qun Hu. Method for Earlier Failure of the Special Vehicle Tub Curve based on the Weibull Two-Fold Piecewise Model [J]. Int J Performability Eng, 2020, 16(1): 87-97.
[13]	Manu Banga, Abhay Bansal, and Archana Singh. Proposed Hybrid Approach to Predict Software Fault Detection [J]. Int J Performability Eng, 2019, 15(8): 2049-2061.
[14]	Pawan Kumar Upadhyay and Satish Chandra. Salient Bag of Feature for Skin Lesion Recognition [J]. Int J Performability Eng, 2019, 15(4): 1083-1093.
[15]	Haiyan Sun, Jing Wu, Ji Wu, and Haiyan Yang. Hybrid SVM and ARIMA Model for Failure Time Series Prediction based on EEMD [J]. Int J Performability Eng, 2019, 15(4): 1161-1170.