Unsupervised Multi-View CNN for Salient View Selection of 3D Objects and Scenes

Ran Song, Wei Zhang, Yitian Zhao, YONGHUAI LIU

Research output: Contribution to journalConference proceeding article (ISSN)peer-review

224 Downloads (Pure)


We present an unsupervised 3D deep learning framework based on a
ubiquitously true proposition named by us view-object consistency as it states that
a 3D object and its projected 2D views always belong to the same object class.
To validate its effectiveness, we design a multi-view CNN instantiating it for the
salient view selection of 3D objects, which quintessentially cannot be handled
by supervised learning due to the difficulty of collecting sufficient and consistent
training data. Our unsupervised multi-view CNN branches off two channels
which encode the knowledge within each 2D view and the 3D object respectively
and also exploits both intra-view and inter-view knowledge of the object. It ends
with a new loss layer which formulates the view-object consistency by impelling
the two channels to generate consistent classification outcomes. We evaluate our
method both qualitatively and quantitatively, demonstrating its superiority over
several state-of-the-art methods. In addition, we showcase that our method can
be used to select salient views of 3D scenes containing multiple objects which is
a more challenging and less investigated problem.
Original languageEnglish
Pages (from-to)454-470
JournalLecture Notes in Computer Sciences (LNCS) - European Conference on Computer Vision
Early online date13 Nov 2020
Publication statusE-pub ahead of print - 13 Nov 2020
Duration: 23 Aug 202028 Aug 2020


  • Unsupervised 3D Deep Learning
  • Multi-View CNN
  • View-Object Consistency
  • View Selection

Research Groups

  • Visual Computing Lab


Dive into the research topics of 'Unsupervised Multi-View CNN for Salient View Selection of 3D Objects and Scenes'. Together they form a unique fingerprint.

Cite this