Construction of 3D solid objects from orthographic views

An algorithm to generate three-dimensional solid objects, made up of planar surfaces, from the given three conventional engineering orthographic views is presented in this paper. Consisting of six major steps, the algorithm has been programmed in C on IRIS 1400 graphics workstation. The algorithm generates all possible solutions. The infinite space has been divided into finite subspaces by making use of the surface normals and the direction of travel of the edges that connect the faces. Classification of the probable 3D subobjects into the certain and uncertain ones has proved to be very useful in reducing the time taken by the algorithm. Several illustrative examples, simple as well as complex giving single and multiple solutions, are included.     

Solid reconstruction from orthographic opaque views using incremental extrusion

The reconstruction of 3-D solids from 2-D projections is an important research topic in reverse engineering. The reconstruction can be grouped into two categories: single-view approach and multiple-view approach. Each approach can be classified as wireframe, BRep or CSG. However, not many CSG approaches have been reported in the literature. The methods are also restricted to uniform-thickness objects or require user interaction. The method proposed in this paper employs the CSG approach. A 3-D solid computer model is reconstructed from 2-D line drawings of six orthographic opaque views, viz. top, front, left, right, bottom and rear views. Firstly, the six views are grouped into three pairs. For each pair of views, segmented areas from one of the two views (called g-view) is incrementally extruded according to the information in the neighbouring view (called d-view). Extrusion primitive solids are generated during the incremental extrusion. All primitive solids are then unioned into an extrusion solid. Finally, all extrusion solids are intersected to give a unique 3-D solution object.     

Estimation of three-dimensional objects from orthographic views with inconsistencies

Many algorithms to construct 3-D solid objects from orthographic views assume the bottom-up approach. This paper describes a method for identifying conflictions found in inconsistent views which improbably present complete objects and estimating solid objects. The sources of inconsistencies are extra segments, missing segments and incorrect classifications of line types (visible lines or hidden lines). In order to supply candidates for missing segments, probable segments are generated not from three views but from two views. The signs appearing in each step of the bottom-up algorithm are examined, and then the heuristic method for selecting more probable segments is developed. The estimation of solid objects and identification of incoherences are useful, for example, to detect improper input of three views and incorrect recognition of engineering drawings.     

Reconstruction of intersecting curved solids from 2D orthographic views

This paper presents a new approach to reconstruct curved solids composed of elementary volumes intersecting with one another from three-view engineering drawings. Intersection curves arising from two intersecting curved surfaces are mostly higher order spatial curves, which cannot be described exactly by 2D orthographic projections and normally represented as smooth curves passing through several key points or even simplified as arcs or lines. Approximated sketches of higher order intersection curves in 2D views result in the invalidation of existing methods that need the exact projection information as input. Based on some heuristic hints, our method is able to recover the complete and correct half-profiles of the intersecting elementary volumes using the least traces left by them, which ensure the correctness of solution solids constructed finally. Several examples are provided to show the validation of the described method.     

Solid reconstruction using recognition of quadric surfaces from orthographic views

The reconstruction of 3D objects from 2D orthographic views is crucial for maintaining and further developing existing product designs. A B-rep oriented method for reconstructing curved objects from three orthographic views is presented by employing a hybrid wire-frame in place of an intermediate wire-frame. The Link-Relation Graph (LRG) is introduced as a multi-graph representation of orthographic views, and quadric surface features (QSFs) are defined by special basic patterns of LRG as well as aggregation rules. By hint-based pattern matching in the LRGs of three orthographic views in an order of priority, the corresponding QSFs are recognized, and the geometry and topology of quadric surfaces are recovered simultaneously. This method can handle objects with interacting quadric surfaces and avoids the combinatorial search for tracing all the quadric surfaces in an intermediate wire-frame by the existing methods. Several examples are provided.     

Lines in one orthographic and two perspective views

We introduce a linear algorithm to recover the Euclidean motion between an orthographic and two perspective cameras from straight line correspondences filling the gap in the analysis of motion estimation from line correspondences for various projection models. The general relationship between lines in three views is described by the trifocal tensor. Euclidean structure from motion for three perspective views is a special case in which the relationship is defined by a collection of three matrices. Here, we describe the case of two calibrated perspective views and an orthographic view. Similar to the other cases, our linear algorithm requires 13 or more line correspondences to recover 27 coefficients of the trifocal tensor.     

Using motion from orthographic views to verify 3-D point matches

The specific problem addressed by the authors is how to detect the true match of a fourth point from among candidate matches in a situation in which three points have already been matched. The two sets of points to be matched are both subject to measurement errors. The depth error is more dominant than errors in the other two coordinates; however, the exact statistical distribution of the measurement errors is not known. The authors present a new method for solving the problem. The method is based on the technique of motion analysis using orthographic views. It discards the noisy z (depth) coordinates and uses only the x and y coordinates of the points to verify the match. The effect of depth errors on the motion estimate is completely prevented. Results show that this method is substantially more effective than previous methods that use all three coordinates     

Adaptive 3-D object recognition from multiple views

The authors address the problem of generating representations of 3-D objects automatically from exploratory view sequences of unoccluded objects. In building the models, processed frames of a video sequence are clustered into view categories called aspects, which represent characteristic views of an object invariant to its apparent position, size, 2-D orientation, and limited foreshortening deformation. The aspects as well as the aspect transitions of a view sequence are used to build (and refine) the 3-D object representations online in the form of aspect-transition matrices. Recognition emerges as the hypothesis that has accumulated the maximum evidence at each moment. The `winning' object continues to refine its representation until either the camera is redirected or another hypothesis accumulates greater evidence. This work concentrates on 3-D appearance modeling and succeeds under favorable viewing conditions by using simplified processes to segment objects from the scene and derive the spatial agreement of object features     

Reconstruction of 3D interacting solids of revolution from 2D orthographic views

3D CAD is replacing 2D CAD to improve efficiency of product design and manufacturing. Therefore, converting legacy 2D drawings into 3D solid models is required. CSG based approaches reconstruct solid models from orthographic views more efficiently than traditional B-rep based approaches. A major limitation of CSG based approaches has been the limited domain of objects that can be handled. This paper aims at extending the capabilities of CSG based approaches by proposing a hint-based recognition of interacting solids of revolution. This approach can handle interacting solids of revolution as well as isolated solids of revolution.     

Polyhedral objects identification through the orthographic projection views generation

This paper presents a new method to automatic recognition of polyhedra. Given images taken from different viewpoints of designated polyhedra, algorithms are developed to interpret them as the same object. Based on the heuristic inference of the polyhedral scene regularities and the gradient space analysis, this method will restore the 3-D information of the polyhedra. The 3-D data is used for the generation of the orthographic projection views of the observed object which consist of the top view, the front view, and the side view.     

Bayesian 3D shape from silhouettes

This paper introduces a smooth posterior density function for inferring shapes from silhouettes. Both the likelihood and the prior are modelled using kernel density functions and optimisation is performed using gradient ascent algorithms. Adding a prior allows for the recovery of concave areas of the shape that are usually lost when estimating the visual hull. This framework is also extended to use colour information when it is available in addition to the silhouettes. In these cases, the modelling not only allows for the shape to be recovered but also its colour information. Our new algorithms are assessed by reconstructing 2D shapes from 1D silhouettes and 3D faces from 2D silhouettes. Experimental results show that using the prior can assist in reconstructing concave areas and also illustrate the benefits of using colour information even when only small numbers of silhouettes are available.     

Genetic object recognition using combinations of views

Investigates the application of genetic algorithms (GAs) for recognizing real 2D or 3D objects from 2D intensity images, assuming that the viewpoint is arbitrary. Our approach is model-based (i.e. we assume a pre-defined set of models), while our recognition strategy relies on the theory of algebraic functions of views. According to this theory, the variety of 2D views depicting an object can be expressed as a combination of a small number of 2D views of the object. This implies a simple and powerful strategy for object recognition: novel 2D views of an object (2D or 3D) can be recognized by simply matching them to combinations of known 2D views of the object. In other words, objects in a scene are recognized by "predicting" their appearance through the combination of known views of the objects. This is an important idea, which is also supported by psychophysical findings indicating that the human visual system works in a similar way. The main difficulty in implementing this idea is determining the parameters of the combination of views. This problem can be solved either in the space of feature matches among the views ("image space") or the space of parameters ("transformation space"). In general, both of these spaces are very large, making the search very time-consuming. In this paper, we propose using GAs to search these spaces efficiently. To improve the efficiency of genetic searching in the transformation space, we use singular value decomposition and interval arithmetic to restrict the genetic search to the most feasible regions of the transformation space. The effectiveness of the GA approaches is shown on a set of increasingly complex real scenes where exact and near-exact matches are found reliably and quickly     

Free-form object reconstruction from silhouettes, occluding edges and texture edges: a unified and robust operator based on duality

In this paper, the duality in differential form is developed between a 3D primal surface and its dual manifold formed by the surface's tangent planes, i.e., each tangent plane of the primal surface is represented as a four-dimensional vector which constitutes a point on the dual manifold. The iterated dual theorem shows that each tangent plane of the dual manifold corresponds to a point on the original 3D surface, i.e., the dual of the dual goes back to the primal. This theorem can be directly used to reconstruct 3D surface from image edges by estimating the dual manifold from these edges. In this paper we further develop the work in our original conference papers resulting in the robust differential dual operator. We argue that the operator makes good use of the information available in the image data, by using both points of intensity discontinuity and their edge directions; we provide a simple physical interpretation of what the abstract algorithm is actually estimating and why it makes sense in terms of estimation accuracy; our algorithm operates on all edges in the images, including silhouette edges, self occlusion edges, and texture edges, without distinguishing their types (thus resulting in improved accuracy and handling locally concave surface estimation if texture edges are present); the algorithm automatically handles various degeneracies; and the algorithm incorporates new methodologies for implementing the required operations such as appropriately relating edges in pairs of images, evaluating and using the algorithm's sensitivity to noise to determine the accuracy of an estimated 3D point. Experiments with both synthetic and real images demonstrate that the operator is accurate, robust to degeneracies and noise, and general for reconstructing free-form objects from occluding edges and texture edges detected in calibrated images or video sequences.     

An octree-based method for shape from inconsistent silhouettes

Shape-from-Silhouette (SfS) is the widely known problem of obtaining the 3D structure of an object from its silhouettes. Two main approaches can be employed: those based on voxel sets, which perform an exhaustive search of the working space, and those based on octrees, which perform a top-down analysis that speeds up the computation. The main problem of both approaches is the need for perfect silhouettes to obtain accurate results. Perfect background subtraction hardly ever happens in realistic scenarios, so these techniques are restricted to controlled environments where the consistency hypothesis can be assumed. Recently, some approaches (all of them based on voxel sets) have been proposed to solve the problem of inconsistency. Their main drawback is the high computational cost required to perform an exhaustive analysis of the working space. This paper proposes a novel approach to solve SfS with inconsistent silhouettes from an octree based perspective. The inconsistencies are dealt by means of the Dempster–Shafer (DS) theory and we employ a Butterworth function for adapting threshold values in each resolution level of the octree. The results obtained show that our proposal provides higher reconstruction quality than the standard octree based methods in realistic environments. When compared to voxel set approaches that manage inconsistency, our method obtains similar results with a reduction in the computing time of an order of magnitude.     

Query processing over object views of relational data

This paper presents an approach to object view management for relational databases. Such a view mechanism makes it possible for users to transparently work with data in a relational database as if it was stored in an object-oriented (OO) database. A query against the object view is translated to one or several queries against the relational database. The results of these queries are then processed to form an answer to the initial query. The approach is not restricted to a ‘pure’ object view mechanism for the relational data, since the object view can also store its own data and methods. Therefore it must be possible to process queries that combine local data residing in the object view with data retrieved from the relational database. We discuss the key issues when object views of relational databases are developed, namely: how to map relational structures to sub-type/supertype hierarchies in the view, how to represent relational database access in OO query plans, how to provide the concept of object identity in the view, how to handle the fact that the extension of types in the view depends on the state of the relational database, and how to process and optimize queries against the object view. The results are based on experiences from a running prototype implementation. Edited by: M.T. ?zsu. Received April 12, 1995 / Accepted April 22, 1996     

Optimal registration of object views using range data

This paper deals with robust registration of object views in the presence of uncertainties and noise in depth data. Errors in registration of multiple views of a 3D object severely affect view integration during automatic construction of object models. We derive a minimum variance estimator (MVE) for computing the view transformation parameters accurately from range data of two views of a 3D object. The results of our experiments show that view transformation estimates obtained using MVE are significantly more accurate than those computed with an unweighted error criterion for registration