Image-based virtual exhibit and its extension to 3D

In this paper we introduce an image-based virtual exhibition system especially for clothing product.It can provide a powerful material substitution function,which is very useful for customization clothing-built.A novel color substitution algorithm and two texture morphing methods are designed to ensure realistic substitution result.To extend it to 3D,we need to do the model reconstruction based on photos.Thus we present an improved method for modeling human body.It deforms a generic model with shape details extracted from pictures to generate a new model.Our method begins with model image generation followed by silhouette extraction and segmentation.Then it builds a mapping between pixeis inside every pair of silhouette segments in the model image and in the picture.Our mapping algorithm is based on a slice space representation that conforms to the natural features of human body.     

基于模板匹配的三维人体语义特征提取算法

随着社会经济发展,生活水平的提高,人们对定制产品的需求越来越多,例如服装高级定制、健身计划定制等。为更好地满足这些需求并提供精准的数据支撑,需提取精确的人体语义特征,即人体的身高、胸围、腰围等一系列参数。对现有特征提取算法进行分析研究,设计一种基于模板匹配的三维人体语义特征提取算法。通过模板模型逼近输入模型,将模板模型上的语义特征采样点拓展到输入模型上,使用NURBS曲线拟合采样点,计算曲线长度。实验结果表明本文所提算法综合性能好,能够为服装定制、人体动画、人体工程学设计等提供精确广泛的数据支持。     

An interactive clothing design and personalized virtual display system

An interactive clothing design and a personalized virtual display with user’s own face are presented in this paper to meet the requirement of personalized clothing customization. A customer interactive clothing design approach based on genetic engineering ideas is analyzed by taking suit as an example. Thus, customers could rearrange the clothing style elements, chose available color, fabric and come up with their own personalized suit style. A web 3D customization prototype system of personalized clothing is developed based on the Unity3D and VR technology. The layout of the structure and functions combined with the flow of the system are given. Practical issues such as 3D face scanning, suit style design, fabric selection, and accessory choices are addressed also. Tests to the prototype system indicate that it could show realistic clothing and fabric effect and offer effective visual and customization experience to users.

     

3D Body Shapes Estimation from Dressed‐Human Silhouettes

Estimation of 3D body shapes from dressed‐human photos is an important but challenging problem in virtual fitting. We propose a novel automatic framework to efficiently estimate 3D body shapes under clothes. We construct a database of 3D naked and dressed body pairs, based on which we learn how to predict 3D positions of body landmarks (which further constrain a parametric human body model) automatically according to dressed‐human silhouettes. Critical vertices are selected on 3D registered human bodies as landmarks to represent body shapes, so as to avoid the time‐consuming vertices correspondences finding process for parametric body reconstruction. Our method can estimate 3D body shapes from dressed‐human silhouettes within 4 seconds, while the fastest method reported previously need 1 minute. In addition, our estimation error is within the size tolerance for clothing industry. We dress 6042 naked bodies with 3 sets of common clothes by physically based cloth simulation technique. To the best of our knowledge, We are the first to construct such a database containing 3D naked and dressed body pairs and our database may contribute to the areas of human body shapes estimation and cloth simulation.     

Customized products recommendation based on probabilistic relevance model

Product customization is attracting more attentions in industry as a viable strategy to better meet customer requirements and gain more profit. However the vast number of product variants in product customization process often makes it difficult for consumers to make purchase decisions, a phenomenon referred to as information overload. In this paper we take a two-prong approach to tackle the issue of information overload in customized products recommendation. Basically, the method answers two questions, namely, which products to recommend and in what order to present the recommendations. Firstly, a probability relevance model is deployed to calculate the probability of relevance for each end product. Then a probability ranking principle is exploited to present the recommendations. The approach also takes customer flexibility into consideration and thus mitigates the effect of inconsistent specifications from customers. It does not require any prior knowledge about an active customer’s preference and can accommodate the new customers challenge facing by recommendation approaches. Analytical results show that the method is optimal in terms of customer’s utility and product recommendation efficiency. Numerical experiments are also conducted to test the presented approach.     

交互式服装定制平台移动端设计

在“互联网+”普及的环境中,无论是消费者,还是服装定制企业,对于互联网在线服装定制都拥有较高的接受程度和需求. 交互式是一种新型的线上服务模式,它的出现为人们提供了一种新的消费理念. 针对服装定制行业的发展现状,文中提出并研究了基于WeX5的交互式服装定制平台移动端. 首先介绍了系统用到的关键技术,指出了应用移动端模式定制的优势. 然后分析了服装线上定制的需求,完成了系统移动端的设计.     

Parametric 3D modeling of young women's lower bodies based on shape classification

Three-dimensional (3D) human body modeling is an important research direction in the field of clothing virtual design. On the basis of 3D human body scanning, this paper studied a method to build a 3D parametric lower body model according to body classification. The research includes three main parts. (1) Anthropometry and body shape classification. We randomly selected 333 young women ages 18–25 years old in Northeast China as the experimental sample. Then we divided the lower body shape into three categories using principal component analysis and K-means clustering. (2) Determination of feature cross sections and points, and reconstruction of feature curves. According to the average values of each body type, we obtained the mean reference body by Euclidean distance method. We determined feature cross sections and points, and extracted the 3D coordinates of the feature points of the mean reference body to reconstruct the feature curves. (3) The surface lofting and establishment of parametric 3D lower body model. According to the shape characteristics of the lower body, we constructed the guiding lines for the crotch and lower limbs, and established parametric lower body models for three body types.Relevance to industry3D human modeling is an important part of garment industry digitization. This research provides an effective way to construct a parametric 3D lower body model. The method offers a reference for the parametric virtual human modeling and virtual fitting of trousers.     

基于顾客需求特征的眼镜产品配置设计研究

基于顾客的脸形特征,面向产品的个性化设计需求,提出了采用参数化建立眼镜结构单元库和变型设计。利用顾客头部的正侧面照片合成人脸的三维模型并提取脸形特征参数,根据脸形特征参数构建顾客需求矩阵,基于顾客需求特征与眼镜产品结构单元之间的映射关系,提出了需求特征匹配算法。最后,给出了网络环境下由顾客、经销商和设计人员协同参与的眼镜配置设计系统的框架结构。     

Deformable model for estimating clothed and naked human shapes from a single image

Estimation of human shape from images has numerous applications ranging from graphics to surveillance. A single image provides insufficient constraints (e.g. clothing), making human shape estimation more challenging. We propose a method to simultaneously estimate a person’s clothed and naked shapes from a single image of that person wearing clothing. The key component of our method is a deformable model of clothed human shape. We learn our deformable model, which spans variations in pose, body, and clothes, from a training dataset. These variations are derived by the non-rigid surface deformation, and encoded in various low-dimension parameters. Our deformable model can be used to produce clothed 3D meshes for different people in different poses, which neither appears in the training dataset. Afterward, given an input image, our deformable model is initialized with a few user-specified 2D joints and contours of the person. We optimize the parameters of the deformable model by pose fitting and body fitting in an iterative way. Then the clothed and naked 3D shapes of the person can be obtained simultaneously. We illustrate our method for texture mapping and animation. The experimental results on real images demonstrate the effectiveness of our method.     

草绘3维人体建模的模板形变方法

目的 采用草绘交互方式直接构造3维人体模型是当前人体建模研究的重要课题之一.提出一种草绘3维人体建模的模板形变方法.方法 针对输入的草图,首先,采用关节点定位方法获取草图中的人体关节点,根据人体结构学约束识别人体骨架结构,通过解析人体轮廓草图获取人体草图特征;其次,通过骨架模板和外观轮廓模板形变,将草图特征映射到3维人体模型,实现3维人体建模.结果 草图解析方法能有效提取草图特征,通过模板形变方法生成3维人体模型,并在模型上保持草图特征;能适应不同用户的绘制习惯,且生成的3维人体模型可用于人体动画设计.结论 提出一种草绘3维人体建模的模板形变方法,支持用户采用草绘方式进行3维人体模型设计,方法具有良好的用户适应性,对3维动画创作具有重要意义.     

A template of ease allowance for garments based on a 3D reverse methodology

Nowadays, with the very competitive environment and the emergence of the mass customization concept, garment design is become a crucial step for clothing companies. Indeed, garments should be designed quickly under controlled costs and perfectly fitted to consumers. No traditional pattern making in 2D matches these new constraints since it requires the production of expensive and time consuming physical prototypes. The study presented in this paper relies on 3D virtual design that lets achieve customized garments. An original image processing method based on ellipses and a reverse methodology using scans of a reference body and garment enables evaluation of the overall 3D ease of the garment. The garment is then designed virtually and the result is checked with a 3D simulation on the reference body.     

结合深度多标签解析的哈希服装检索

目的 服装检索对于在线服装的推广和销售有着重要的作用。而目前的服装检索算法无法准确地检索出非文本描述的服装。特别是对于跨场景的多标签服装图片,服装检索算法的准确率还有待提升。本文针对跨场景多标签服装图片的差异性较大以及卷积神经网络输出特征维度过高的问题,提出了深度多标签解析和哈希的服装检索算法。方法 该方法首先在FCN（fully convolutional network）的基础上加入条件随机场,对FCN的结果进行后处理,搭建了FCN粗分割加CRFs（conditional random fields）精分割的端到端的网络结构,实现了像素级别的语义识别。其次,针对跨场景服装检索的特点,我们调整了CCP（Clothing Co-Parsing）数据集,并构建了Consumer-to-Shop数据集。针对检索过程中容易出现的语义漂移现象,使用多任务学习网络分别训练了衣物分类模型和衣物相似度模型。结果 我们首先在Consumer-to-Shop数据集上进行了服装解析的对比实验,实验结果表明在添加了CRFs作为后处理之后,服装解析的效果有了明显提升。然后与3种主流检索算法进行了对比,结果显示,本文方法在使用哈希特征的条件下,也可以取得较好的检索效果。在top-5正确率上比WTBI（where to buy it）高出1.31%,比DARN（dual attribute-aware ranking network）高出0.21%。结论 针对服装检索的跨场景效果差、检索效率低的问题,本文提出了一种基于像素级别语义分割和哈希编码的快速多目标服装检索方法。与其他检索方法相比,本文在多目标、多标签服装检索场景有一定的优势,并且在保持了一定检索效果的前提下,有效地降低了存储空间,提高了检索效率。     

基于参数化逆向建模的踝足矫形器设计

为了实现踝足矫形器(AFO)快速精准建模,提高矫形器个体化定制效率与患者佩 戴舒适性,提出了一种基于参数化逆向建模的AFO 设计方法。该方法采用3D 扫描技术获取足 部与小腿原始点云数据,通过点云数据处理与优化得到基础数字化模型。利用Grasshopper 插 件提取踝足个性化形状特征型值点,用于重建踝足数字化模型。创建了包括6 阶段的AFO 参数 化逆向建模程序,通过改变参数即可实现AFO 的定制设计。最终,通过脑卒中患者定制设计 AFO 实例验证了所提方法的可行性。     

An interactive service customization model

Mass customization has become one of the key strategies for a service provider to differentiate itself from its competitors in a highly segmented global service market. This paper proposes an interactive service customization model to support individual service offering for customers. In this model, not only that the content of an activity is customizable, but the process model can also be constructed dynamically according to the customer's requirements. Based on goal ontology, the on-demand customer requirements are transformed into a high-level service process model. Process components, which are building blocks for reusable standardized service processes, are designed to support on-demand process composition. The customer can incrementally define the customized service process through a series of operations, including activation of goal decomposition, reusable component selection, and process composition. In this paper, we first discuss the key requirements of the service customization problem. We then present in detail a knowledge-based customizable service process model and the accompanying customization method. Finally we demonstrate the feasibility of the our approach through a case study of the well-known travel planning problem and present a prototype system that enables users to interactively organize a satisfying travel plan.     

3D model retrieval using principal plane analysis and dynamic programming

Three dimensional models play an important role in many applications; the problem is how to select the appropriate models from a 3D database rapidly and accurately. In recent years, a variety of shape representations, statistical methods, and geometric algorithms have been proposed for matching 3D shapes or models. In this paper, we propose a 3D shape representation scheme based on a combination of principal plane analysis and dynamic programming. The proposed 3D shape representation scheme consists of three steps. First, a 3D model is transformed into a 2D image by projecting the vertices of the model onto its principal plane. Second, the convex hall of the 2D shape of the model is further segmented into multiple disjoint triangles using dynamic programming. Finally, for each triangle, a projection score histogram and moments are extracted as the feature vectors for similarity searching. Experimental results showed the robustness of the proposed scheme, which resists translation, rotation, scaling, noise, and destructive attacks. The proposed 3D model retrieval method performs fairly well in retrieving models having similar characteristics from a database of 3D models.     

Generating shapes by analogies: An application to hearing aid design

3D shape modeling is a crucial component of rapid prototyping systems that customize shapes of implants and prosthetic devices to a patient’s anatomy. In this paper, we present a solution to the problem of customized 3D shape modeling using a statistical shape analysis framework. We design a novel method to learn the relationship between two classes of shapes, which are related by certain operations or transformation. The two associated shape classes are represented in a lower dimensional manifold, and the reduced set of parameters obtained in this subspace is utilized in an estimation, which is exemplified by a multivariate regression in this paper. We demonstrate our method with a felicitous application to the estimation of customized hearing aid devices.     

一种基于GRA的虚拟模特生成算法研究

该文首先提出,在CPC环境下的服装个性化定制系统必须解决远程顾客试衣的问题,现有的设备和技术手段还不能完全实现基于网络的远程真人试衣.顾客在个性化定制系统中的试衣目的在于对服装是否符合自己体形的整体感受.该文作者提出由虚拟模特代替顾客试衣,只要虚拟模特的各个部位尺寸比例与顾客的身体尺寸比例足够的接近,就可以足够精确地模拟顾客体形试衣,并且通过采用一种近似匹配的虚拟模特生成思路,给出了一种基于GRA的算法,可以降低运算量.通过实例验证,取得较好的结果.     

基于显著特征谱嵌入的三维模型相似性分析*

面向快速、高效的三维模型检索技术的迫切需求,提出基于显著特征谱嵌入的三维模型相似性分析方法.首先通过局部曲率及凸凹性检测,有效提取模型的显著特征点,构建模型的显著特征描述算子.然后基于拉普拉斯映射及谱分析原理进一步提取模型的内蕴形状特征.最后,结合薄板样条函数实现模型间的配准与相似性分析.通过实验验证文中方法不仅有效提高模型匹配的效率,而且能有效识别同一类模型的结构特征,同时对于残缺模型间的匹配具有较强的鲁棒性.     

基于支持向量回归机的三维人脸建模方法研究

提出一种新的三维人脸建模方法,该方法首先运用双目立体视觉原理从不同角度获得人脸的两张照片,在一张照片上选定特征点,通过匹配在另一张照片上得到对应的特征点,然后从空间立体几何知识出发,根据两张照片上特征点的坐标以及拍摄时的参数,计算其三维坐标,利用支持向量回归机(SVR)对其进行回归预测建模,最后经纹理贴图,得到具有纹理特征的特定三维人脸模型。仿真实验结果表明,该方法获得的三维人脸模型较为逼真。