On recovering hyperquadrics from range data

This paper discusses the applications of hyperquadric models in computer vision and focuses on their recovery from range data. Hyperquadrics are volumetric shape models that include superquadrics as a special case. A hyperquadric model can be composed of any number of terms and its geometric bound is an arbitrary convex polytope. Thus, hyperquadrics can model more complex shapes than superquadrics. Hyperquadrics also possess many other advantageous properties (compactness, semilocal control, and intuitive meaning). Our proposed algorithm starts with a rough fit using only six terms in 3D (four in 2D) and adds additional terms as necessary to improve fitting. Suitable constraints are used to ensure proper convergence. Experimental results with real 2D and 3D data are presented     

Extending Superquadrics with Exponent Functions: Modeling and Reconstruction

Superquadrics are a family of parametric shapes which can model a diverse set of objects. They have received significant attention because of their compact representation and robust methods for recovery of 3D models. However, their assumption of intrinsical symmetry fails in modeling numerous real-world examples such as the human body, animals, and other naturally occurring objects. In this paper, we present a novel approach, which is called extended superquadric, to extend superquadric's representation power with exponent functions. An extended superquadric model can be deformed in any direction because it extends the exponents of superquadrics from constants to functions of the latitude and longitude angles in the spherical coordinate system. Thus, extended superquadrics can model more complex shapes than superquadrics. It also maintains many desired properties of superquadrics such as compactness, controllability, and intuitive meaning, which are all advantageous for shape modeling, recognition, and reconstruction. In this paper, besides the use of extended superquadrics for modeling, we also discuss the recovery of extended superquadrics from 3D information (reconstruction). Experiments on both realistic modeling and extended superquadric fitting are presented. Our results are very encouraging and indicate that the use of extended superquadric has potential benefits for the generation of synthetic images for computer graphics and that extended superquadric also is a promising paradigm for shape representation and recovery in computer vision.     

Symmetry-seeking models and 3D object reconstruction

We propose models of 3D shape which may be viewed as deformable bodies composed of simulated elastic material. In contrast to traditional, purely geometric models of shape, deformable models are active—their shapes change in response to externally applied forces. We develop a deformable model for 3D shape which has a preference for axial symmetry. Symmetry is represented even though the model does not belong to a parametric shape family such as (generalized) cylinders. Rather, a symmetry-seeking property is designed into internal forces that constrain the deformations of the model. We develop a framework for 3D object reconstruction based on symmetry-seeking models. Instances of these models are formed from monocular image data through the action of external forces derived from the data. The forces proposed in this paper deform the model in space so that the shape of its projection into the image plane is consistent with the 2D silhouette of an object of interest. The effectiveness of our approach is demonstrated using natural images.     

D-NURBS: a physics-based framework for geometric design

Presents dynamic non-uniform rational B-splines (D-NURBS), a physics-based generalization of NURBS. NURBS have become a de facto standard in commercial modeling systems. Traditionally, however, NURBS have been viewed as purely geometric primitives, which require the designer to interactively adjust many degrees of freedom-control points and associated weights-to achieve the desired shapes. The conventional shape modification process can often be clumsy and laborious. D-NURBS are physics-based models that incorporate physical quantities into the NURBS geometric substrate. Their dynamic behavior, resulting from the numerical integration of a set of nonlinear differential equations, produces physically meaningful, and hence intuitive shape variation. Consequently, a modeler can interactively sculpt complex shapes to required specifications not only in the traditional indirect fashion, by adjusting control points and setting weights, but also through direct physical manipulation, by applying simulated forces and local and global shape constraints. We use Lagrangian mechanics to formulate the equations of motion for D-NURBS curves, tensor-product D-NURBS surfaces, swung D-NURBS surfaces and triangular D-NURBS surfaces. We apply finite element analysis to reduce these equations to efficient numerical algorithms computable at interactive rates on common graphics workstations. We implement a prototype modeling environment based on D-NURBS and demonstrate that D-NURBS can be effective tools in a wide range of computer-aided geometric design (CAGD) applications     

The role of model-based segmentation in the recovery of volumetricparts from range data

We present a method for segmenting and estimating the shape of 3D objects from range data. The technique uses model views, or aspects, to constrain the fitting of deformable models to range data. Based on an initial region segmentation of a range image, regions are grouped into aspects corresponding to the volumetric parts that make up an object. The qualitative segmentation of the range image into a set of volumetric parts not only captures the coarse shape of the parts, but qualitatively encodes the orientation of each part through its aspect. Knowledge of a part's coarse shape, its orientation, as well as the mapping between the faces in its aspect and the surfaces on the part provides strong constraints on the fitting of a deformable model (supporting both global and local deformations) to the data. Unlike previous work in physics-based deformable model recovery from range data, the technique does not require presegmented data. Furthermore, occlusion is handled at segmentation time and does not complicate the fitting process, as only 3D points known to belong to a part participate in the fitting of a model to the part. We present the approach in detail and apply it to the recovery of objects from range data     

Snake pedals: compact and versatile geometric models withphysics-based control

We introduce a geometric shape modeling scheme which allows for representation of global and local shape characteristics of an object. Geometric models are well-suited for representing global shapes without local detail, but we propose a scheme which represents global shapes with local detail and permits model shaping as well as topological changes via physics-based control. The scheme represents shapes by pedal curves and surfaces, i.e. the loci of the foot of perpendiculars to the tangents of a fixed curve/surface from a fixed point called the pedal point. By varying the location of the pedal point, one can synthesize a large class of shapes which exhibit both local and global deformations. We introduce physics-based control for shaping these geometric models by letting the pedal point vary and use a snake to represent the position of this varying point. The model, a “snake pedal”, allows for interactive manipulation via forces applied to the snake. We develop a fast numerical iterative algorithm for shape recovery from image data using this scheme. The algorithm involves the Levenberg-Marquardt (LM) method in the outer loop for solving the global parameters and the alternating direction implicit (ADI) method in the inner loop for solving the local parameters of the model. The combination of the global and local scheme leads to an efficient numerical solution to the model fitting problem. We demonstrate the applicability of this modeling scheme via examples of shape synthesis and shape estimation from real image data     

Chain Vibration and Dynamic Stress in Three-Dimensional Multibody Tracked Vehicles

A three-dimensional computational finite element procedure for the vibration and dynamic stress analysis of the track link chains of off-road vehicles is presented in this paper. The numerical procedure developed in this investigation integrates classical constrained multibody dynamics methods with finite element capabilities. The nonlinear equations of motion of the three-dimensional tracked vehicle model in which the track link s are considered flexible bodies, are obtained using the floating frame of reference formulation. Three-dimensional contact force models are used to describe the interaction of the track chain links with the vehicle components and the ground. The dynamic equations of motion are first presented in terms of a coupled set of reference and elastic coordinates of the track links. Assuming that the structural flexibility of the track links does not have a significant effect on their overall rigid body motion as well as the vehicle dynamics, a partially linearized set of differential equations of motion of the track links is obtained. The equations associated with the rigid body motion are used to predict the generalized contact, inertia, and constraint forces associated with the deformation degrees of freedom of the track links. These forces are introduced to the track link flexibility equations which are used to calculate the deformations of the links resulting from the vehicle motion. A detailed three-dimensional finite element model of the track link is developed and utilized to predict the natural frequencies and mode shapes. The terms that represent the rigid body inertia, centrifugal and Coriolis forces in the equations of motion associated with the elastic coordinates of the track link are described in detail. A computational procedure for determining the generalized constraint forces associated with the elastic coordinates of the deformable chain links is presented. The finite element model is then used to determine the deformations of the track links resulting from the contact, inertia, and constraint forces. The results of the dynamic stress analysis of the track links are presented and the differences between these results and the results obtained by using the static stress analysis are demonstrated.     

基于可形变模型的左心室形状恢复与运动跟踪

从心脏核磁共振图像恢复左心室的3D形状并跟踪其运动,是当前医学图像分析领域的重要研究课题之一。提出了一种基于可形变模型的左心室3D形状恢复与运动跟踪方法,该模型充分考虑了左心室的实际几何形状,将左心室描述为一个一端封闭、非轴对称、轴线弯曲的广义圆柱壳;模型的参数为函数,用全局参数即可捕捉左心室的局部形变;模型的求解纳入基于物理学的可形变模型框架之下,这样,左心室的形状恢复与运动跟踪变成一个动态的数据拟合过程。根据跟踪的结果可以观察左心室的容积、质量等在一个心动周期中的变化情况,计算每博容积、射血分数等心功能指标,为心脏疾病诊断提供直观的临床参考。     

Shape and nonrigid motion estimation through physics-basedsynthesis

A physics-based framework for 3-D shape and nonrigid motion estimation for real-time computer vision systems is presented. The framework features dynamic models that incorporate the mechanical principles of rigid and nonrigid bodies into conventional geometric primitives. Through the efficient numerical simulation of Lagrange equations of motion, the models can synthesize physically correct behaviors in response to applied forces and imposed constraints. Applying continuous Kalman filtering theory, a recursive shape and motion estimator that employs the Lagrange equations as a system model is developed. The system model continually synthesizes nonrigid motion in response to generalized forces that arise from the inconsistency between the incoming observations and the estimated model state. The observation forces also account formally for instantaneous uncertainties and incomplete information. A Riccati procedure updates a covariance matrix that transforms the forces in accordance with the system dynamics and prior observation history. Experiments involving model fitting and tracking of articulated and flexible objects from noisy 3-D data are described     

从视频中恢复三维人脸的实时方法

三维人脸恢复是视觉交互的一个难点问题,提出了一种从视频中实时恢复三维人脸的新方法.该方法利用主动形状模型进行人脸特征点提取和跟踪,确保了三维形状恢复和特征跟踪的有效性和一致性;采用非刚体形状和运动估计方法构建三维形变基,有效地适应人脸形状变化的多样性;采用非线性优化算法估算人脸姿态和三维形变基参数,实现了三维人脸形状和姿态的实时恢复.实验结果表明,该方法不仅能从视频中实时恢复三维人脸模型,而且可有效跟踪人脸各种姿态的变化.     

Analytical development of dynamic equations of motion for a three-dimensional flexible link manipulator with revolute and prismatic joints

In this paper, a mathematical model capable of handling a three-dimensional (3D) flexible n-degree of freedom manipulator having both revolute and prismatic joints is considered. This model is used to study the longitudinal, transversal, and torsional vibration characteristics of the robot manipulator and obtain kinematic and dynamic equations of motion. The presence of prismatic joints makes the mathematical derivation complex. In this paper, for the first time, prismatic joints as well as revolute joints have been considered in the structure of a 3D flexible n-degree of freedom manipulator. The kinematic and dynamic equations of motion representing longitudinal, transversal, and torsional vibration characteristics have been solved in parametric form with no discretization. In this investigation, in order to obtain an analytical solution of the vibrational equations, a novel approach is presented using the perturbation method. By solving the equations of motion, it is shown that mode shapes of the link with prismatic joints can be modeled as the equivalent clamped beam at each time instant. As an example, this method is applied to a three degrees of freedom robot with revolute and prismatic joints. The obtained equations are solved using the perturbation method and the results are used to simulate vibrational behavior of the manipulator.     

Deformable model for estimating clothed and naked human shapes from a single image

Estimation of human shape from images has numerous applications ranging from graphics to surveillance. A single image provides insufficient constraints (e.g. clothing), making human shape estimation more challenging. We propose a method to simultaneously estimate a person’s clothed and naked shapes from a single image of that person wearing clothing. The key component of our method is a deformable model of clothed human shape. We learn our deformable model, which spans variations in pose, body, and clothes, from a training dataset. These variations are derived by the non-rigid surface deformation, and encoded in various low-dimension parameters. Our deformable model can be used to produce clothed 3D meshes for different people in different poses, which neither appears in the training dataset. Afterward, given an input image, our deformable model is initialized with a few user-specified 2D joints and contours of the person. We optimize the parameters of the deformable model by pose fitting and body fitting in an iterative way. Then the clothed and naked 3D shapes of the person can be obtained simultaneously. We illustrate our method for texture mapping and animation. The experimental results on real images demonstrate the effectiveness of our method.     

d-Dimensional parametric models for dynamic animation of deformable objects

This paper introduces an accurate, efficient, and unified engine dedicated to dynamic animation of d-dimensional deformable objects. The objects are modelled as d-dimensional manifolds defined as functional combinations of a mesh of 3D control points, weighted by parametric blending functions. This model ensures that, at each time step, the object shape conforms to its manifold definitions. The object motion is deduced from the control points dynamic animation. In fact, control points should be viewed as the degrees of freedom of the continuous object. The chosen dynamic equations (Lagrangian formalism) reflect this generic modelling scheme and yield an exact and computationally efficient linear system.     

Incremental model-based estimation using geometric constraints

We present a model-based framework for incremental, adaptive object shape estimation and tracking in monocular image sequences. Parametric structure and motion estimation methods usually assume a fixed class of shape representation (splines, deformable superquadrics, etc.) that is initialized prior to tracking. Since the model shape coverage is fixed a priori, the incremental recovery of structure is decoupled from tracking, thereby limiting both processes in their scope and robustness. In this work, we describe a model-based framework that supports the automatic detection and integration of low-level geometric primitives (lines) incrementally. Such primitives are not explicitly captured in the initial model, but are moving consistently with its image motion. The consistency tests used to identify new structure are based on trinocular constraints between geometric primitives. The method allows not only an increase in the model scope, but also improves tracking accuracy by including the newly recovered features in its state estimation. The formulation is a step toward automatic model building, since it allows both weaker assumptions on the availability of a prior shape representation and on the number of features that would otherwise be necessary for entirely bottom-up reconstruction. We demonstrate the proposed approach on two separate image-based tracking domains, each involving complex 3D object structure and motion.     

Monocular 3D tracking of deformable surfaces using sequential second order cone programming

Reconstructing structures of deformable objects from monocular image sequences is important for applications like visual servoing and augmented reality. In this paper, we propose a method to recover 3D shapes of deformable surfaces using sequential second order cone programming (SOCP). The key of our approach is to represent the surface as a triangulated mesh and introduce two sets of constraints, one for model-to-image keypoint correspondences which are SOCP constraints, another for retaining the original lengths of the mesh edges which are non-convex constraints. In the process of tracking, the surface structure is iteratively updated by solving sequential SOCP feasibility problems in which the non-convex constraints are replaced by a set of convex constraints over a local convex region. The shape constraints used in our approach is more generic than previous methods, that enables us to reliably recover surface shapes with smooth, sharp and other complex deformations. The capability and efficiency of our approach are evaluated quantitatively with synthetic image sequences and qualitatively with real image sequences.     

Recursive non-rigid structure from motion with online learned shape prior

Most existing approaches in structure from motion for deformable objects focus on non-incremental solutions utilizing batch type algorithms. All data is collected before shape and motion reconstruction take place. This methodology is inherently unsuitable for applications that require real-time learning. Ideally the online system is capable of incrementally learning and building accurate shapes using current measurement data and past reconstructed shapes. Estimation of 3D structure and camera position is done online. To rely only on the measurements up until that moment is still a challenging problem.     

Geometric Flows of Curves in Shape Space for Processing Motion of Deformable Objects

We introduce techniques for the processing of motion and animations of non‐rigid shapes. The idea is to regard animations of deformable objects as curves in shape space. Then, we use the geometric structure on shape space to transfer concepts from curve processing in ?ⁿ to the processing of motion of non‐rigid shapes. Following this principle, we introduce a discrete geometric flow for curves in shape space. The flow iteratively replaces every shape with a weighted average shape of a local neighborhood and thereby globally decreases an energy whose minimizers are discrete geodesics in shape space. Based on the flow, we devise a novel smoothing filter for motions and animations of deformable shapes. By shortening the length in shape space of an animation, it systematically regularizes the deformations between consecutive frames of the animation. The scheme can be used for smoothing and noise removal, e.g., for reducing jittering artifacts in motion capture data. We introduce a reduced‐order method for the computation of the flow. In addition to being efficient for the smoothing of curves, it is a novel scheme for computing geodesics in shape space. We use the scheme to construct non‐linear “Bézier curves” by executing de Casteljau's algorithm in shape space.