Hierarchical Structure and Nonrigid Motion Recovery from 2D Monocular Views


Inferring both 3D structure and motion of nonrigid objects from monocular images is an important problem in computational vision. The challenges stem not only from the absence o f p oint correspondences but also from the structure ambiguity. In this paper, a hierarchical method which integrates both local patch analysis and global shape descriptions is devised to solve the dual problem of structure and nonrigid motion recovery by using an elastic geometric model|extended superquadrics. The nonrigid object of interest is segmented into many small areas and local analysis is performed t o r ecover small details for each small area, assuming that each small area is undergoing similar non-rigid motion. Then, a recursive algorithm is proposed to guide and regularize local analysis with global information by using an appropriate global shape m o del. This local-global hierarchy enables us to capture both local and global deformations accurately and robustly. Experimental results on both simulation and real data are p r esented to validate and evaluate the eeectiveness and robustness of the proposed approach.


7 Figures and Tables

Download Full PDF Version (Non-Commercial Use)