Int J Performability Eng ›› 2020, Vol. 16 ›› Issue (11): 1793-1802.doi: 10.23940/ijpe.20.11.p11.17931802

Previous Articles     Next Articles

A Co-Saliency Object Detection Model for Video Sequences

Tao Weia, Xuezhuan Zhaob,c,*, Lishen Peic,d and Lingling Lib   

  1. aHenan Institute of Engineering, Computer College, Zhengzhou, 451191, China;
    bZhengzhou University of Aeronautics, Zhengzhou, 450046, China;
    cInformation Technology Research Base of Civil Aviation Administration of China, Civil Aviation University of China, Tianjin, 300300, China;
    dHenan University of Finance, Economics and Law, Zhengzhou, 450046, China
  • Submitted on ; Revised on ; Accepted on
  • Contact: *E-mail address: xuezhuansci@126.com

Abstract: Whilst existing research mainly focus on detecting the saliency of dynamic objects based on spatiotemporal features, it is also meaningful to detect the saliency of static objects and label their salient values on the video saliency map, a useful tool for many high-level applications. In view of these, we propose a novel salient object detection model for video sequences, which combines the dynamic saliency and the static saliency into a co-saliency map. First, the salient degree of the general objects in each frame was estimated by the motion-independent algorithm, and the global static saliency map was generated based on the results. Next, the dynamic regions were detected by an improved motion-based approach, and the dynamic saliency map was computed with a local saliency detection method according to the related dynamic regions and the visual fixation map. Finally, a novel co-saliency algorithm was devised to fuse the static and dynamic maps. The final hierarchical co-saliency map reflects the saliency of both dynamic and static objects, and it satisfies the demand of more advanced tasks. Through the evaluation on two existing datasets, it is proven that the proposed model can achieve state-of-the-art performance.

Key words: co-saliency, dynamic map, object detection, saliency detection, stationary map