Model-Based Recognition of 3D Curves From One View

It is well known that there are no geometric invariants of a projection from 3D to 2D. However, given some modeling assumptions about the 3D object, such invariants can be found. The modeling assumptions should be sufficiently strong to enable us to find such invariants, but not stronger than necessary. In this paper we find such modeling assumptions for general 3D curves under affine projection. We show, for example, that if one of the two affine curvatures is known along the 3D curve, the other can be found from the curve's 2D image. We can also derive the point correspondence between the curve and its image. We also deal with point sets and direction vectors.     

Solving the recognition problem for six lines using the Dixon resultant

The “Six-line Problem” arises in computer vision and in the automated analysis of images. Given a three-dimensional (3D) object, one extracts geometric features (for example six lines) and then, via techniques from algebraic geometry and geometric invariant theory, produces a set of 3D invariants that represents that feature set. Suppose that later an object is encountered in an image (for example, a photograph taken by a camera modeled by standard perspective projection, i.e. a “pinhole” camera), and suppose further that six lines are extracted from the object appearing in the image. The problem is to decide if the object in the image is the original 3D object. To answer this question two-dimensional (2D) invariants are computed from the lines in the image. One can show that conditions for geometric consistency between the 3D object features and the 2D image features can be expressed as a set of polynomial equations in the combined set of two- and three-dimensional invariants. The object in the image is geometrically consistent with the original object if the set of equations has a solution. One well known method to attack such sets of equations is with resultants. Unfortunately, the size and complexity of this problem made it appear overwhelming until recently. This paper will describe a solution obtained using our own variant of the Cayley–Dixon–Kapur–Saxena–Yang resultant. There is reason to believe that the resultant technique we employ here may solve other complex polynomial systems.     

Model-Based Object Recognition Using Geometric Invariants of Points and Lines

In this paper, we derive new geometric invariants for structured 3D points and lines from single image under projective transform, and we propose a novel model-based 3D object recognition algorithm using them. Based on the matrix representation of the transformation between space features (points and lines) and the corresponding projected image features, new geometric invariants are derived via the determinant ratio technique. First, an invariant for six points on two adjacent planes is derived, which is shown to be equivalent to Zhu's result [1], but in simpler formulation. Then, two new geometric invariants for structured lines are investigated: one for five lines on two adjacent planes and the other for six lines on four planes. By using the derived invariants, a novel 3D object recognition algorithm is developed, in which a hashing technique with thresholds and multiple invariants for a model are employed to overcome the over-invariant and false alarm problems. Simulation results on real images show that the derived invariants remain stable even in a noisy environment, and the proposed 3D object recognition algorithm is quite robust and accurate.     

Projective invariants of co-moments of 2D images

Functions of moments of 2D images that are invariant under some changes are important in image analysis and pattern recognition. One of the most basic changes to a 2D image is geometric change. Two images of the same plane taken from different viewpoints are related by a projective transformation. Unfortunately, it is well known that geometric moment invariants for projective transformations do not exist in general. Yet if we generalize the standard definition of the geometric moments and utilize some additional information from the images, certain type of projective invariants of 2D images can be derived. This paper first defines co-moment as a moment-like function of image that contains two reference points. Then a set of functions of co-moments that is invariant under general projective transformations is derived. The invariants are simple and in explicit form. Experimental results validated the mathematical derivations.     

一种新的几何约束结构及其射影不变量

几何不变量,特别是射影不变量,是基于单视点灰度图像识别三维物体的一条有效途径．但理论研究表明,只有特定的几何约束结构,才具有射影不变量．所以,研究并发现这种几何约束结构就具有十分重要的意义．该文提出了一种新的由相邻3平面上5条直线组成的几何约束结构及其所具有的射影不变量．该结构较Sugimoto提出的几何约束结构简单,可从结构同样复杂的物体中获得更多的几何不变量,有利于提高物体识别的稳定性;同时,由于该结构大量存在于由多面体组合而构成的人造物体及地面建筑物中,因此它非常适合这类物体的识别．实验验证了文中提出的几何约束结构具有不随物体成像视点改变的射影不变量．     

基于空间透视不变量的摄象机标定方法

本文给出了一种以空间不变量的数据来计算摄象机外部参数的方法．空间透视不变量是指在几何变换中如投影或改变观察点时保持不变的形状描述．由于它可以得到一个相对于外界来讲独立的物体景物的特征描述，故可以很广泛的应用到计算机视觉等方面．摄象机标定是确定摄象机摄取的２Ｄ图象信息及其３Ｄ实际景物的信息之间的变换关系，它包括内部参数和外部参数两个部分．内部参数表征的是摄象机的内部特征和光学特征参数，包括图象中心（Ｃｘ，Ｃｙ）坐标、图象尺度因子Ｓｘ、有效的焦距长度ｆ和透镜的畸变失真系数Ｋ；外部参数表示的是摄象机的位置和方向在世界坐标中的坐标参数，它包括平移矩阵Ｔ和旋转矩阵Ｒ３×３，一般情况下可以写成一个扩展矩阵［ＲＴ］３×４．本文基于空间透视不变量的计算数据，给出了一种标定摄象机外部参数的方法，实验结果表明该方法具有很强的鲁棒性．     

Using geometric distance fits for 3-D object modeling andrecognition

Addresses the problems of automatically constructing algebraic surface models from sets of 2D and 3D images and using these models in pose computation, motion and deformation estimation, and object recognition. We propose using a combination of constrained optimization and nonlinear least-squares estimation techniques to minimize the mean-squared geometric distance between a set of points or rays and a parameterized surface. In modeling tasks, the unknown parameters are the surface coefficients, while in pose and deformation estimation tasks they represent the transformation which maps the observer's coordinate system onto the modeled surface's own coordinate system. We have applied this approach to a variety of real range, computerized tomography and video images     

Implicit Moment Invariants

The use of traditional moment invariants in object recognition is limited to simple geometric transforms, such as rotation, scaling and affine transformation of the image. This paper introduces so-called implicit moment invariants. Implicit invariants measure the similarity between two images factorized by admissible image deformations. For many types of image deformations traditional invariants do not exist but implicit invariants can be used as features for object recognition. In the paper we present implicit moment invariants with respect to polynomial transform of spatial coordinates, describe their stable and efficient implementation by means of orthogonal moments, and demonstrate their performance in artificial as well as real experiments.     

View Invariance for Human Action Recognition

This paper presents an approach for viewpoint invariant human action recognition, an area that has received scant attention so far, relative to the overall body of work in human action recognition. It has been established previously that there exist no invariants for 3D to 2D projection. However, there exist a wealth of techniques in 2D invariance that can be used to advantage in 3D to 2D projection. We exploit these techniques and model actions in terms of view-invariant canonical body poses and trajectories in 2D invariance space, leading to a simple and effective way to represent and recognize human actions from a general viewpoint. We first evaluate the approach theoretically and show why a straightforward application of the 2D invariance idea will not work. We describe strategies designed to overcome inherent problems in the straightforward approach and outline the recognition algorithm. We then present results on 2D projections of publicly available human motion capture data as well on manually segmented real image sequences. In addition to robustness to viewpoint change, the approach is robust enough to handle different people, minor variabilities in a given action, and the speed of aciton (and hence, frame-rate) while encoding sufficient distinction among actions. This work was done when the author was a graduate student in the Department of Computer Science and was partially supported by the NSF Grant ECS-02-5475. The author is curently with Siemens Corporate Research, Princeton, NJ. Dr. Chellappa is with the Department of Electrical and Computer Engineering.     

基于方面图技术的三维运动目标识别

三维目标在不同的视点下呈现不同的姿态 ,所得的二维视图也不尽相同 ,因此三维目标识别是一个较为复杂的问题 .为此提出了通过图象序列和图象序列之间的转移关系 ,根据胜者为王的原则来识别三维目标的方法 .该方法采用极指数栅格技术和傅立叶变换相结合得到目标的轮廓不变量 ;用神经网络结合方面图技术 ,通过识别运动目标图象序列来识别三维运动目标 ,实现了一个目标识别系统 .实验结果证明 ,此方法可以有效地用于三维运动目标的识别     

用于遥感图像人造目标识别的三维建模方法研究

该文研究了用于遥感图像人造地物目标识别的三维建模方法,文中分析了识别任务的特点,比较了一般的建模方法,介绍了一种基于广义锥思想的几何表示方法,并利用面向对象的技术来表示模型内部数据及其操作。     

基于组合不变矩和神经网络的三维物体识别

在三维物体识别系统中,提出将三维物体的Hu不变矩和仿射不变矩两者的低阶矩组合作为三维物体的特征,结合改进的BP神经网络应用于三维物体的分类识别。理论分析和仿真实验表明组合这两种矩特征进行物体识别,性能优于单独使用Hu不变矩,如果进一步对这两种组合的矩特征进行主成分分析处理,可显著提高系统识别性能,并减少网络的训练时间。     

Determination of blur and affine combined invariants by normalization

The determination of invariant characteristics is an important problem in pattern recognition. In many situations, images to be processed are usually subjected to geometric distortion and/or blur degradation. In this paper, we introduce an approach to derive blur and affine combined invariants (BAI). Firstly, we normalize the image to a standard form by using blur invariant moments as normalization constraints. Then, we construct the blur and affine combined invariants at the standard form. Using the method proposed in this paper, a set of blur and affine combined invariant features can be obtained easily and effectively. Several experimental results are presented to illustrate the performance of the invariants for simultaneously affine deformed and blur degraded images.     

Minimal Decomposition of Model-Based Invariants

Model-based invariants are relations between model parameters and image measurements, which are independent of the imaging parameters. Such relations are true for all images of the model. Here we describe an algorithm which, given L independent model-based polynomial invariants describing some shape, will provide a linear re-parameterization of the invariants. This re-parameterization has the properties that: (i) it includes the minimal number of terms, and (ii) the shape terms are the same in all the model-based invariants. This final representation has 2 main applications: (1) it gives new representations of shape in terms of hyperplanes, which are convenient for object recognition; (2) it allows the design of new linear shape from motion algorithms. In addition, we use this representation to identify object classes that have universal invariants.