Int J Performability Eng ›› 2018, Vol. 14 ›› Issue (4): 795-804.doi: 10.23940/ijpe.18.04.p21.795804

• Original articles • Previous Articles     Next Articles

Two-Stage Semantic Matching for Cross-Media Retrieval

Gongwen Xua, Lina Xua, Meijia Zhanga, and Xiaomei Lib   

  1. aSchool of Information Science and Engineering, Shandong Normal University, Jinan, 250358, China
    bThe Second Hospital of Shandong University, Jinan, 250033, China

Abstract:

With the development of information technology, there exists a large amount of multi-media data in our lives; the data is heterogeneous with low-level features while consistent with semantic information. Traditional mono-media retrieval can’t cross the heterogeneous gap of multi-media data, and cross-media retrieval is arousing many researchers’ interests. In this paper, we propose a two-stage semantic matching for cross-media retrieval based on support vector machines (called TSMCR). Our approach uses a combination of testing images’ predictive labels and testing texts’ predictive labels as the next training labels. It makes full use of semantic information of both training samples and testing samples, and the experimental results on four state-of-the-art datasets show that the TSMCR algorithm is effective.


Submitted on December 29, 2017; Revised on February 2, 2018; Accepted on March 20, 2018
References: 9