采用草绘轮廓的3维人脸建模方法

为方便用户进行3维人脸形状设计,提出一种基于手绘轮廓的3维人脸建模方法。该方法的主要特点在于,一方面,引用姿态估计技术对人脸草图进行解析,将用户绘制的侧视人脸草图转换成对应的正视人脸草图,可支持用户选择多个视角绘制人脸;另一方面,采用多层映射机制建立人脸草图特征点与3维人脸特征点之间的一一对应关系,由对应特征点之间的形变量来控制生成3维人脸,保证草图笔画的几何形状信息能有效映射到3维模型中。实验结果表明,文中方法能快速生成形状新颖的特定人脸,可有效支持用户进行3维人脸形状的手绘建模。     

草绘3维人体建模的模板形变方法

目的 采用草绘交互方式直接构造3维人体模型是当前人体建模研究的重要课题之一.提出一种草绘3维人体建模的模板形变方法.方法 针对输入的草图,首先,采用关节点定位方法获取草图中的人体关节点,根据人体结构学约束识别人体骨架结构,通过解析人体轮廓草图获取人体草图特征;其次,通过骨架模板和外观轮廓模板形变,将草图特征映射到3维人体模型,实现3维人体建模.结果 草图解析方法能有效提取草图特征,通过模板形变方法生成3维人体模型,并在模型上保持草图特征;能适应不同用户的绘制习惯,且生成的3维人体模型可用于人体动画设计.结论 提出一种草绘3维人体建模的模板形变方法,支持用户采用草绘方式进行3维人体模型设计,方法具有良好的用户适应性,对3维动画创作具有重要意义.     

New grouping and fitting methods for interactive overtraced sketches

This paper describes a new method for recognizing overtraced strokes to 2D geometric primitives, which are further interpreted as 2D line drawings. This method can support rapid grouping and fitting of overtraced polylines or conic curves based on the classified characteristics of each stroke during its preprocessing stage. The orientation and its endpoints of a classified stroke are used in the stroke grouping process. The grouped strokes are then fitted with 2D geometry. This method can deal with overtraced sketch strokes in both solid and dash linestyles, fit grouped polylines as a whole polyline and simply fit conic strokes without computing the direction of a stroke. It avoids losing joint information due to segmentation of a polyline into line-segments. The proposed method has been tested with our freehand sketch recognition system (FSR), which is robust and easier to use by removing some limitations embedded with most existing sketching systems which only accept non-overtraced stroke drawing. The test results showed that the proposed method can support freehand sketching based conceptual design with no limitations on drawing sequence, directions and overtraced cases while achieving a satisfactory interpretation rate.     

A survey on freehand sketch recognition and retrieval

With the development of digital devices and pressure sensing equipment, research into freehand sketches from touch-screen interfaces has increased significantly in recent years. As such, we provide the first comprehensive survey of recognition tasks based on sketch generation, freehand sketch classification, sketch-based image retrieval (SBIR), fine-grained sketch-based image retrieval (FG-SBIR), and sketch-based 3D shape image retrieval. Specifically, SBIR and FG-SBIR were the main focus of the survey. Primary technologies and benchmark datasets related to all sketch-based recognition topics are also discussed, along with future trends for this promising technology.     

基于草绘的机构识别及机构分析方法研究*

在概念设计阶段构造新型的支持创新过程的设计系统,对新产品的设计活动具有重要意义。在机械产品概念设计中将机构看成由图元构成的图形,提出一种面向概念设计的机构草图识别及分析方法,主要内容包括手绘草图输入及机构草图识别、机构方案运动分析。本文把手绘草图识别技术和机构运动相结合,通过对机构草图的识别以及机构的运动分析,实现在概念设计阶段对机构设计方案的评价分析。     

手绘草图的在线分段识别

提出了一种在线手绘草图快速分段识别方法。先对草绘笔划进行平滑预处理,以减少噪声干扰和冗余点的数目;然后利用草绘笔划的动静态特性,以及用户的草绘习惯等特性找出笔划的关键分段点,将笔划分为多个笔划子段;最后利用基于二次曲线的方法对笔划子段进行分段识别和特征参数计算,并通过构造面向对象的图形数据结构对识别出的几何图元进行重构。实例表明,该方法具有较好的识别能力和系统稳定性,能够应用于二维概念草图的快速表达,以及后续三维草绘建模的特征笔划智能识别过程中。     

基于草图交互的个性化服装生成方法

以建立和交互修改三维服装草图为设计手段,提出在三维人体模型上生成三维个性化服装的参数化造型方法．服装草图由2种基本几何元素组成：体现人体围度信息的封闭样条曲线和体现人体在高度方向上曲面形状过渡的不封闭样条曲线．将服装草图约束分为2类4种：一类是体现服装宽松程度的人体与服装曲面之间的间隙约束;另一类是服装几何元素本身之间的共点、共面与对称约束．从人体的特征点出发,通过间隙约束生成服装草图的几何元素;在共点、对称和共面约束下,由服装草图几何元素建立拓扑结构为四边网格的服装草图．服装草图的交互修改是草图约束维护的过程,构建侧视图、正视图、断面图3个视图组成草图修改平台,在平台上交互编辑特征曲线．服装曲面则以三维草图为框架,通过对四边网格双线性Coons曲面插值生成．提供的设计方法使服装的造型变得简洁、灵活．     

手绘草图实时处理方法研究

徒手草绘作为一种简便、自然、高效的人机交互方式,在计算机辅助设计领域越来越受到人们的重视。本文主要针对草绘设计与图形识别的行为过程进行了一系列较为广泛的研究,以便将用户的草绘习惯、识别能力与现有的CAD技术紧密结合起来,开发出新一代的智能CAD产品。具体包括草图前处理、特征点的检测、笔划分段、图元识别、图元重构、图元规整、端点校正等内容。实验表明所提出的方法能得到较好的识别结果。     

手绘草图实时处理方法研究

徒手草绘作为一种简便、自然、高效的人机交互方式，在计算机辅助设计领域越来越受到人们的重视。本文主要针对草绘设计与图形识别的行为过程进行了一系列较为广泛的研究，以便将用户的草绘习惯、识别能力与现有的CAD技术紧密结合起来，开发出新一代的智能CAD产品。具体包括草图前处理、特征点的检测、笔划分段、图元识别、图元重构、图元规整、端点校正等内容。实验表明所提出的方法能得到较好的识别结果。     

3D-freehand-pose initialization based on operator’s cognitive behavioral models

Tracking, recognition and interaction based on 3D freehand are a part of our virtual assembly system, in which monocular camera is used to input online freehand videos and the hand pose tracker requires a reliable initial pose in the first frame. A novel approach to initializing 3D pose and position of freehand is put forward in this paper visualization of 3D hand model and modeling the operators’ cognitive behaviors. Our approach is composed of three phases: hand posture recognition, coarse-tuning and fine-tuning. The operator moves his/her hand onto the to meet the needs of our virtual assembly system. The main contribution of this paper is that the three core techniques are for the first time integrated together, including human–computer interaction (HCI) in the process of initializing, projection of the 3D hand model in the period of coarse-tuning time. Then, the computer repeatedly fine-tunes the 3D hand model until the projection of the 3D hand model is completely superimposed onto the operator’s hand image. We focus on exploring and modeling cognitive behavior of operator’s hand upon which we design our initialization algorithm. Our research shows that cognitive behavioral models are not only beneficial to reducing cognitive loads for operators, because it makes the computers cater for the changes of the operators’ hand poses, but also helpful to address high dimensionality of articulated 3D hand model. Our experimental results also show that the approach presented in this paper is easier, more pleasurable and satisfactory experience for the operators. Our initialization system has successfully been applied to our 3D freehand tracking system and a simulation virtual assembly system.     

基于深度学习的人体动作草图到三维骨骼模型重建方法的研究

为了提高三维人体骨骼模型的建模效率并简化交互规则,提出了一种基于深度学习的手绘人体动作草图到三维骨骼模型的重建方法。首先将三维骨骼模型渲染为二维图像来建立维度映射关系,进而使用图像分类方法识别手绘草图动作并根据维度映射实现三维骨骼模型重建。在实验中使用基于深度卷积神经网络对图像分类模型进行构建,使用浅层卷积网络作为训练单元,并使用逐级分类与分块训练策略加速网络收敛速度来提高训练效率。最后实验结果验证了该方法的可行性与有效性。     

Extracting 3D model feature lines based on conditional random fields

We propose a 3D model feature line extraction method using templates for guidance. The 3D model is first projected into a depth map, and a set of candidate feature points are extracted. Then, a conditional random fields (CRF) model is established to match the sketch points and the candidate feature points. Using sketch strokes, the candidate feature points can then be connected to obtain the feature lines, and using a CRF-matching model, the 2D image shape similarity features and 3D model geometric features can be effectively integrated. Finally, a relational metric based on shape and topological similarity is proposed to evaluate the matching results, and an iterative matching process is applied to obtain the globally optimized model feature lines. Experimental results showed that the proposed method can extract sound 3D model feature lines which correspond to the initial sketch template.     

素描式草绘的三维花朵建模

三维花朵建模是虚拟现实中的重要部分,花瓣作为一种自由曲面,是整个建模的重点。提出了一种由非常自然的素描式草绘方式构造三维花朵模型的方法：从草绘图形中分析和提取信息,由这些信息计算出的横截面曲线来构造花瓣的曲面形状。通过草图绘制、笔划特征分析及识别、空间位置估计及曲面构造这几大步骤完成对花朵的三维建模。     

基于图像辅助的三维模型形状检索

随着3D建模技术的快速发展,互联网上可用的3D模型库出现了爆炸式增长,越来越多的3D模型可以方便地通过网络下载使用.这直接促使了3D形状检索技术的发展,即给出特定的搜索信息,要求系统搜索出符合要求的、相似的3D模型.文章提出了一种新的3D形状检索方法,以3D模型作为输入,系统将会从模型数据库中自动检索出与输入形状最相似的模型.对于给定的输入模型以及数据库中的每一个模型,首先由计算机生成多幅在不同视角下的2D草图;然后,应用Gabor滤波器对每一幅2D草图提取图像上的局部特征,并对特征进行量化,从而得到代表该图像特征的直方图,这样对于每一个3D模型将得到多个代表该模型的直方图;最终,通过对比两个模型之间直方图的相似性,可以得到它们的相似性值,从而检索出与输入模型最相似的模型.文章所提出的方法通过采取2D图像分析方法提取能反映3D模型的特征并计算出模型之间的相似性值.经过测试,在一些公开的数据集上得到了较好的效果.     

基于笔序的手绘草图识别方法

本文提出了一种基于用户绘图过程笔序信息的手绘草图识别方法,该方法利用同一用户绘制同一草图的笔序趋向于一致这一特点,在收集用户绘图笔序信息的基础上建立用户模型,从而达到提高输入自由度和识别效率的目的,并用实验加以了证明。     

Freely-drawn sketches interpretation using SVMs-chain modeling

The growing popularity of tablet PCs and intelligent pen-centric computing has increased the importance of freehand sketch recognition algorithms. In this paper, the proposed method integrates the temporal, spatial and geometric constraint information to improve the recognition accuracy. To interpret the sketch as an incremental process, the paper investigates the use of the information fusion technique with Support Vector Machines (SVMs) chain for modeling and understanding the spatial and temporal information of sketch sequences. Online sketch recognition is achieved through the use of the SVMs-chain for systematically modeling the dynamic and stochastic behaviors of the sketch. To validate its efficiency, the experimental results in various domains and the comparison with traditional Hidden Markov Models have been presented.     

草图交互式地质建模研究

提出一种简单、快捷的草图交互式地质建模方法,旨在帮助地质学家们在地质勘测初期直观、快速地创建无数据地质概念模型.迄今,现存专业地质建模工具依赖成本较高的真实数据创建精细复杂的三维地质模型,且通常具有建模用时长、不易于学习和使用等缺陷.因此,采用直观的“纸-笔”建模隐喻,提供了一套从草图绘制到三维模型创建,再到三维模型编辑的完整建模流程,允许用户在自由定义的绘图平面上绘制描述模型地质特征的三维草图,并对其构成的连通草图网络实时地进行三维模型重建.模型重建使用分治的思想,大致分为3个步骤完成：首先利用三维草图的几何信息,即拐点,根据其拓扑连接搜寻草图网络中近似平面的能量最小圈,然后通过调和函数计算草图网络中每个圈包围区域的目标平均曲率标量及其法线方向,随后以Laplacian方程优化生成曲面片,最后将曲面片拼接成完整的三维模型.褶皱、断层地质现象可以分别通过重绘和切割操作进行建模.此外,利用层级结构树存储地质模型间的层级关系,并通过变形传递的方式对与形变物体接触的地质模型进行形变,从而保持了地质结构中多物质体相互接触的特性.相比现有基于草图的交互式建模工具,该方法融合了地质学知识,且能够更有效地使用少量草图描述地质物体的特征.基于用户体验调查,该方法具有操作简单、建模直观的特点,能够同时满足专业和非专业人士快速创建地质概念模型的需求.     

手绘二维曲线自动生成三维模型研究

通过手绘创作三维模型是改变传统三维模型制作方式的新兴研究点;论文提出两种由手绘二维曲线自动产生三维模型的算法,分别进行了详细介绍和讨论：算法一基于重心原理拓展曲线,并在曲线簇上进行网格重构,但此方法仅限于椭圆拓扑的曲线;算法二利用离散方法寻找轴线,该方法能够生成更加多样化的模型并侧重于细节。通过算法实现效果的对比,验证了两种算法快速生成三维模型的有效性;最后展示了通过该文算法绘制的几个卡通模型,并对进一步生成模型动画进行了设想。