3D Visual Saliency: An Independent Perceptual Measure or A Derivative of 2D Image Saliency?

Ran Song, Wei Zhang, Yitian Zhao, YONGHUAI LIU, Paul L Rosin

Research output: Contribution to journalArticle (journal)peer-review

7 Citations (Scopus)
112 Downloads (Pure)

Abstract

While 3D visual saliency aims to predict regional importance of 3D surfaces in agreement with human visual perception and
has been well researched in computer vision and graphics, latest work with eye-tracking experiments shows that state-of-the-art 3D visual saliency methods remain poor at predicting human fixations. Cues emerging prominently from these experiments suggest that 3D visual saliency might associate with 2D image saliency. This paper proposes a framework that combines a Generative Adversarial Network and a Conditional Random Field for learning visual saliency of both a single 3D object and a scene composed of multiple 3D objects with image saliency ground truth to 1) investigate whether 3D visual saliency is an independent perceptual measure or just a derivative of image saliency and 2) provide a weakly supervised method for more accurately predicting 3D visual saliency. Through extensive experiments, we not only demonstrate that our method significantly outperforms the state-of-the-art approaches, but also
manage to answer the interesting and worthy question proposed within the title of this paper.
Original languageEnglish
JournalIEEE Transactions on Pattern Analysis and Machine Intelligence
Early online date19 Jun 2023
DOIs
Publication statusE-pub ahead of print - 19 Jun 2023

Research Centres

  • Centre for Intelligent Visual Computing Research
  • Data and Complex Systems Research Centre

Fingerprint

Dive into the research topics of '3D Visual Saliency: An Independent Perceptual Measure or A Derivative of 2D Image Saliency?'. Together they form a unique fingerprint.

Cite this