Image‐based modeling of 3D objects with curved surfaces

This paper addresses an image‐based method for modeling 3D objects with curved surfaces based on the non‐uniform rational B‐splines (NURBS) representation. The user fits the feature curves on a few calibrated images with 2D NURBS curves using the interactive user interface. Then, 3D NURBS curves are constructed by stereo reconstruction of the corresponding feature curves. Using these as building blocks, NURBS surfaces are reconstructed by the known surface building methods including bilinear surfaces, ruled surfaces, generalized cylinders, and surfaces of revolution. In addition to them, we also employ various advanced techniques, including skinned surfaces, swept surfaces, and boundary patches. Based on these surface modeling techniques, it is possible to build various types of 3D shape models with textured curved surfaces without much effort. Copyright © 2007 John Wiley & Sons, Ltd.     

3D reconstruction for featureless scenes with curvature hints

We present a novel interactive framework for improving 3D reconstruction starting from incomplete or noisy results obtained through image-based reconstruction algorithms. The core idea is to enable the user to provide localized hints on the curvature of the surface, which are turned into constraints during an energy minimization reconstruction. To make this task simple, we propose two algorithms. The first is a multi-view segmentation algorithm that allows the user to propagate the foreground selection of one or more images both to all the images of the input set and to the 3D points, to accurately select the part of the scene to be reconstructed. The second is a fast GPU-based algorithm for the reconstruction of smooth surfaces from multiple views, which incorporates the hints provided by the user. We show that our framework can turn a poor-quality reconstruction produced with state of the art image-based reconstruction methods into a high- quality one.     

一种改进的三维人脸重构方法

提出一种改进的三维人脸重构方法。该方法采用基于单个相机的双目立体视觉系统对人脸进行采样,根据人脸对称性假设,运用补洞与纠错技术进行自动点云优化。继而采用简化的Candide-3模型作为细分初始控制网格,局部加细地进行细分曲面分层次拟合操作,采用测地线映射技术对不同表情进行归一化,并分别建立人脸数据库。实验结果表明,采用单相机立体视觉系统在提高重建精度的同时,很大程度上避免由于双相机拍摄不同步引起的重建鲁棒性降低问题。而采用细分曲面作为存储结构,在节约空间的前提下,为分层次比对筛选提供理论支持。该系统成本较低,适合在许多领域推广应用。     

Displacement modeling: Hardware-accelerated interactive feature modeling on subdivision surfaces

Feature modeling on subdivision surfaces remains a challenging task for interactive 3D design. This paper presents the idea of displacement modeling, which utilizes displacement mapping as an interactive modeling method to design fine level features by exploiting the computation power of modern programmable graphics hardware (GPU). We also propose a view-dependent adaptive subdivision method according to the error metric in view space. It can highly reduce the number of refined faces and points while maintaining the same visual quality as uniform subdivision. Furthermore, several feature adjustment tools are introduced for flexible design and manipulation of created features. Since the displacement modeling approach is fully implemented on graphics hardware, it can substantially alleviate the computing load on CPU and significantly reduce the data transmission on the graphics channel.     

Soft Folding

We introduce soft folding, a new interactive method for designing and exploring thin‐plate forms. A user specifies sharp and soft folds as two‐dimensional(2D) curves on a flat sheet, along with the fold magnitude and sharpness of each. Then, based on the soft folds, the system computes the three‐dimensional(3D) folded shape. Internally, the system first computes a fold field, which defines local folding operations on a flat sheet. A fold field is a generalization of a discrete fold graph in origami, replacing a graph with sharp folds with a continuous field with soft folds. Next, local patches are folded independently according to the fold field. Finally, a globally folded 3D shape is obtained by assembling the locally folded patches. This algorithm computes an approximation of 3D developable surfaces with user‐defined soft folds at an interactive speed. The user can later apply nonlinear physical simulation to generate more realistic results. Experimental results demonstrated that soft folding is effective for producing complex folded shapes with controllable sharpness.     

Parallel Rendering and Animation of Subdivision Surfaces on the Cell BE Processor

In this work we propose a parallel graphics pipeline for real-time interactive editing, processing and rendering of smooth surface primitives on the Cell BE. Our approach integrates a special patch-based geometry shader for subdivision surface targeting high-performance single-chip multi-core platforms. We describe a combination of algorithmic, architectural and back-end optimizations that enable us to render smooth subdivision surfaces in real-time and to dynamically deform 3D models represented by subdivision surfaces.     

DigitalSculpture: a subdivision-based approach to interactive implicit surface modeling

This paper presents DigitalSculpture, an interactive sculpting framework founded upon iso-surfaces extracted from recursively subdivided, 3D irregular grids. Our unique implicit surface model arises from an interpolatory, volumetric subdivision scheme that is C¹ continuous across the domains defined by arbitrary 3D irregular grids. We assign scalar coefficients and color to each control vertex and allow these quantities to participate in the volumetric subdivision of irregular grids. In the subdivision limit, a virtual sculpture is obtained by extracting the zero-level from the volumetric, scalar field defined over the irregular grid. This novel shape geometry extends concepts from solid modeling, recursive subdivision, and implicit surfaces; facilitates many techniques for interactive sculpting; permits rapid, local evaluation of iso-surfaces; and affords level-of-detail control of the sculpted surfaces.     

Some applications of Loop-subdivision wavelet tight frames to?the?processing of 3D graphics

Multiresolution analysis based on subdivision wavelets is an important method of 3D graphics processing. Many applications of this method have been studied and developed, including denoising, compression, progressive transmission, multiresolution editing and so on. Recently Charina and St?ckler firstly gave the explicit construction of wavelet tight frame transform for subdivision surfaces with irregular vertices, which made its practical applications to 3D graphics became a subject worthy of investigation. Based on the works of Charina and St?ckler, we present in detail the wavelet tight frame decomposition and reconstruction formulas for Loop-subdivision scheme. We further implement the algorithm and apply it to the denoising, compression and progressive transmission of 3D graphics. By comparing it with the biorthogonal Loop-subdivision wavelets of Bertram, the numerical results illustrate the good performance of the algorithm. Since multiresolution analysis based on subdivision wavelets or subdivision wavelet tight frames requires the input mesh to be semi-regular, we also propose a simple remeshing algorithm for constructing meshes which not only have subdivision connectivity but also approximate the input mesh.     

The design and realization of CoViD: a system for collaborative virtual 3D design

Many important decisions in the design process are made during fairly early on, after designers have presented initial concepts. In many domains, these concepts are already realized as 3D digital models. Then, in a meeting, the stakeholders for the project get together and evaluate these potential solutions. Frequently, the participants in this meeting want to interactively modify the proposed 3D designs to explore the design space better. Today’s systems and tools do not support this, as computer systems typically support only a single user and computer-aided design tools require significant training. This paper presents the design of a new system to facilitate a collaborative 3D design process. First, we discuss a set of guidelines which have been introduced by others and that are relevant to collaborative 3D design systems. Then, we introduce the new system, which consists of two main parts. The first part is an easy-to-use conceptual 3D design tool that can be used productively even by naive users. The tool provides novel interaction techniques that support important properties of conceptual design. The user interface is non-obtrusive, easy-to-learn, and supports rapid creation and modification of 3D models. The second part is a novel infrastructure for collaborative work, which offers an interactive table and several large interactive displays in a semi-immersive setup. It is designed to support multiple users working together. This infrastructure also includes novel pointing devices that work both as a stylus and a remote pointing device. The combination of the (modified) design tool with the collaborative infrastructure forms a new platform for collaborative virtual 3D design. Then, we present an evaluation of the system against the guidelines for collaborative 3D design. Finally, we present results of a preliminary user study, which asked naive users to collaborate in a 3D design task on the new system.     

基于隐式T样条的曲面重构算法

提出隐式T样条曲面，将T网格从二维推广到三维情形，同时利用八叉树及其细分过程，从无结构散乱点数据集构造T网格，利用曲面拟合模型将曲面重构问题转化为最优化问题；然后基于隐式T样条曲面将最优化问题通过矩阵形式表述，依据最优化原理将该问题转化成线性方程组，通过求解线性方程组解决曲面重构问题；最后结合计算实例进行讨论．该方法能较好地解决曲面重构问题，与传统张量B样条函数相比，能效地减少未知控制系数与计算量．     

一种散乱数据点的多分辨率曲面重构方法

给出一种基于细分曲面技术实现散乱数据点的多分辨率曲面重构的方法。在曲面重构过程中,依据灰度图像边缘检测思想分析散乱数据特征值,将这些特征值生成纹理特征曲线进行曲面细分,从而形成了多分辨率网格模型结构。经过测试,该方法不仅重构曲面时间短,同时构造出的细分曲面能较好地反映原始数据的细节特征。     

Computer-aided appearance design based on BRDF measurements

This paper presents a comprehensive and efficient framework for computer-aided appearance design based on BRDF (bidirectional reflectance distribution function) measurements. It covers all stages of a new product development including acquisition, processing and modeling of reflectance data, interactive rendering and evaluation of material appearance, and manufacturing operations. The proposed method eliminates the need of making a real physical prototype by providing a reliable surface appearance design process in which he/she can faithfully simulate the final surface appearance in the early design stage of a product. In addition, it enables us to manufacture the coating surface the same as the computer simulated surface from the known coating specification. The accuracy test between a real sample and the computer simulated one demonstrates that the proposed method satisfies an acceptable level of accuracy for industrial applications. A case study has been conducted to evaluate the user preference on the surface appearance of a digital handheld device which contains a combination of different coating surfaces. The case study successfully demonstrates that the user preference can be identified using the proposed method while changing the combination of different coating surfaces represented by BRDFs considering factors such as surrounding environments and age groups.     

Human knowledge acquisition from 3D interaction in virtual environments

Recently,virtual environment (VE) based design and planning,which is a kind of interaction intensive computing,has shown great potential.Most users of such systems are specialists or technicians and their 3D interactions with the system embed a great deal of knowledge and skills.Thus,how to integrate human knowledge and skills into VE is a great challenge to researchers in the human computer interaction field.This paper proposes a method for acquiring user knowledge from VE.The main ideas and work include,abstracting the interactive process and formalizing the interactive semantics,as well as providing a semantic model of an interactive information repository,from which user interactive processes can be retrieved and all kinds of application logics can be established.A virtual assembly planning system is introduced as an example of a practical application of this method.Experiments show that the related models can well capture user knowledge and retrieve the interaction process.     

Materialization of interactive stereoscopic artwork based on hand-painted images

This paper presents interactive stereoscopic artwork and an algorithm for natural artistic expression using hand-painted images expressed by the artist’s manual brush strokes. The system proposes a new interactive method that allows a viewer to experience the painting process representing the consecutive process of an actual artist’s oil painting. The combination of analog and digital techniques stimulates emotions of the audience. The system architecture is composed of the Kinect sensor, which recognizes the movement of the user, a module that generates real-time stereoscopic images, and a projection module that displays the generated image. The survey is conducted to evaluate the effects of the 3D modeling method and the artistic modeling method. The statistical result show that the proposed hand-painted method provides more artistic satisfaction to the viewers than the 3D modeling method.     

An Interactive Designing System with Virtual Sculpting and Virtual Woodcut Printing

In this paper, we propose an interactive designing method and a system based on it to create 3D objects and 2D images. This system consists of two subsystems for virtual sculpting to create a 3D shape and virtual printing to produce a picture with a printing block. In the virtual sculpting subsystem, a user can form solid objects with curved surfaces as if sculpting them. The user operates virtual chisels, and can remove or attach arbitrary shapes of ellipsoids or cubes from or to the workpiece. A 3D object generated by virtual sculpting looks like a real wooden sculpture. If using a board as a workpiece, a user can generate a virtual printing block. In the virtual printing subsystem, a user can synthesize a woodcut printing image from the virtual printing block mentioned above, a virtual paper sheet, and a printing brush. The user can synthesize a realistic woodcut print with a procedure similar to the actual woodcut printing.     

An Intuitive Interface for Interactive High Quality Image‐Based Modeling

We present the design of an interactive image‐based modeling tool that enables a user to quickly generate detailed 3D models with texture from a set of calibrated input images. Our main contribution is an intuitive user interface that is entirely based on simple 2D painting operations and does not require any technical expertise by the user or difficult pre‐processing of the input images. One central component of our tool is a GPU‐based multi‐view stereo reconstruction scheme, which is implemented by an incremental algorithm, that runs in the background during user interaction so that the user does not notice any significant response delay.     

C-C细分曲面的交互形状修改

为了增强细分曲面的造型功能,讨论了C-C细分曲面的交互形状修改算法。通过实时建立局部坐标系定义C-C细分曲面上点、法向量和局部等参数线等约束并将其转化为对控制顶点的约束,得到全局线性系统,从而可以在满足不同类型的几何约束时修改曲面的形状。基于最小二乘法和能量优化法给出两种修改算法,前者可以保持控制顶点扰动量的总和最小,运行速度快,适合于局部、精确调整;后者利用罚函数法给出了能量极小意义下的最优解,适合于保持光顺性要求的全局修改。两种方法都可以利用广义逆矩阵求得显式解,具有可逆性、可交换性、结合性等优点,提高了曲面形状修改的效率和可控性。     

基于细分曲面的三维服装柔性实体模拟

提出一种基于细分曲面的三维服装柔性实体模拟算法，该算法将整个模拟过程分为两个阶段：首先利用四点细分曲面造型方法生成三维服装刚性曲面，然后在刚性曲面基础上通过引入织物的物理模型来模拟三维服装柔性曲面，通过物理和几何模拟方法有机结合，算法有效解决了复杂衣片间的缝合问题，较大地提高了模拟的计算效率，同时，也提出了一种基于细分曲面层次数据结构的碰撞检测算法，有效提高了模拟速度，提出的算法已全部在所开发的三维虚拟服装试衣系统中得以实现，实验结果表明：该算法具有模拟效率高、交互性强和易于计算机实现等优点。     

SimSelect: Similarity‐based selection for 3D surfaces

Surface selection is one of the fundamental interactions in shape modeling. In the case of complex models, this task is often tedious for at least two reasons: firstly the local geometry of a given region may be hard to manually select and needs great accuracy; secondly the selection process may have to be repeated a large number of times for similar regions requiring similar subsequent editing. We propose SimSelect, a new system for interactive selection on 3D surfaces addressing these two issues. We cope with the accuracy issue by classifying selections in different types, namely components, parts and patches for which we independently optimize the selection process. Second, we address the repetitiveness issue by introducing an expansion process based on shape recognition which automatically retrieves potential selections similar to the user‐defined one. As a result, our system provides the user with a compact set of simple interaction primitives providing a smooth select‐and‐edit workflow.