Int J Performability Eng ›› 2018, Vol. 14 ›› Issue (5): 985-994.doi: 10.23940/ijpe.18.05.p17.985994

• Original articles • Previous Articles     Next Articles

Classification Decision based on a Hybrid Method of Weighted kNN and Hyper-Sphere SVM

Peng Chena, b, Guoyou Shia, Shuang Liuc, Yuanqiang Zhanga, and Denis Špeličd   

  1. aNavigation College, Dalian Maritime University, Dalian, 116026, China
    bDepartment of Software Engineering, Dalian Neusoft University of Information, Dalian, 116030, China
    cSchool of Computer Science & Engineering, Dalian Minzu University, Dalian, 116605, China
    dFaculty of Electrical Engineering and Computer Science, University of Maribor, Maribor, SI-2000, Slovenia

Abstract:

Hyper-sphere Support Vector Machine (SVM) is very effective for solving multi-class classification problems. Considering data distribution is very important for convergence of solving support vectors, a weight factor is imported into the original hyper-sphere SVM. After computing data for each training class, this weight factor is decided by its center-distance ratio. In the training process, data with bigger weight is put into the data processing thread first and is then followed by smaller ones. To save computation cost, a parallel genetic algorithm based SMO multi-threading is adopted. For a test sample, its class decision is based on its position with each classification of hyper-sphere. If all class-specific hyper-spheres are independent of each other, a new test sample can be classified correctly. But, if some hyper-spheres have common spaces, that is, one hyper-sphere intersects with one or more hyper-spheres, it is hard to decide the class of the test sample. Based on detailed analysis of three decision rules for the intersection data classification, one decision rule that combines the kNN method is put forward in this paper. For other simple inclusion cases, the simple decision rule is defined. Through two real experimental results of navigation tracking and ship meeting situations classification, our new proposed algorithm has a higher classification accuracy and boasts a lower computation cost than other algorithms.


Submitted on February 8, 2018; Revised on March 12, 2018; Accepted on April 23, 2018
References: 11