A heuristic framework for perceptual saliency prediction |
| |
Affiliation: | 1. Shanghai Institute for Advanced Communication and Data Science, Shanghai University, Shanghai 200444, China;2. School of Communication and Information Engineering, Shanghai University, Shanghai 200444, China;1. Xi’an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xi’an 710119, China;2. School of Electronic & Information Engineering, Xi’an Jiaotong University, Xi’an 710049, China;3. University of Chinese Academy of Sciences, Beijing 100049, China;1. Shanghai Institute for Advanced Communication and Data Science, Shanghai University, Shanghai 200444, China;2. School of Communication and Information Engineering, Shanghai University, Shanghai 200444, China;3. Department of Computer Science, University of Manitoba, Winnipeg, MB R3T 2N2, Canada;4. School of Medical Instrument and Food Engineering, University of Shanghai for Science and Technology, Shanghai, China |
| |
Abstract: | Saliency prediction can be regarded as the human spontaneous activity. The most effective saliency model should highly approximate the response of viewers to the perceived information. In the paper, we exploit the perception response for saliency detection and propose a heuristic framework to predict salient region. First, to find the perceptually meaningful salient regions, an orientation selectivity based local feature and a visual Acuity based global feature are proposed to jointly predict candidate salient regions. Subsequently, to further boost the accuracy of saliency map, we introduce a visual error sensitivity based operator to activate the meaningful salient regions from a local and global perspective. In addition, an adaptive fusion method based on free energy principle is designed to combine the sub-saliency maps from each image channel to obtain the final saliency map. Experimental results on five natural and emotional datasets demonstrate the superiority of the proposed method compared to twelve state-of-the-art algorithms. |
| |
Keywords: | Saliency prediction Orientation selectivity Visual acuity Visual error sensitivity Free energy principle |
本文献已被 ScienceDirect 等数据库收录! |
|