3D human pose estimation in motion based on multi-stage regression

3D human pose estimation in motion is a hot research direction in the field of computer vision. However, the performance of the algorithm is affected by the complexity of 3D spatial information, self-occlusion of human body, mapping uncertainty and other problems. In this paper, we propose a 3D human joint localization method based on multi-stage regression depth network and 2D to 3D point mapping algorithm. First of all, we use a single RGB image as the input, through the introduction of heatmap and multi-stage regression to constantly optimize the coordinates of human joint points. Then we input the 2D joint points into the mapping network for calculation, and get the coordinates of 3D human body joint points, and then to complete the 3D human body pose estimation task. The MPJPE of the algorithm in Human3.6 M dataset is 40.7. The evaluation of dataset shows that our method has obvious advantages.     

Bayesian network based general correspondence retrieval method for depth sensing with single-shot structured light

This study reinvestigated one of the most fundamental problems in structure light depth sensing field: correspondence retrieval of features between patterns and images. We formulate the global optimum correspondence retrieval by maximizing a conditional probability of correspondence given observed features, which is depicted by a Bayesian network. Different from traditional “code-only” based correspondence retrieval methods, the proposed Bayesian network based method exploits the positional correlations of correspondences of neighboring features, namely, the correspondences of poorly detected features are estimated with the aid of the correspondences of well detected features. The method performs especially well on challenging scenes with rich depth variations, abrupt depth changes, edges, etc. Experiments show that the proposed method increase the correspondence accuracy by about 40% on challenging scenes, compared with traditional “code-only” based correspondence retrieval methods.     

Film and television industry cloud exhibition design based on 3D imaging and virtual reality

The three-dimensional virtual scene can provide users with a visual three-dimensional virtual environment, with various multimedia channels such as sound, video, force feedback equipment, etc., to bring users a completely immersive interactive experience. This paper introduces 3D imaging and virtual reality technology in the film and television industry cloud exhibition, and develops a virtual display platform. First of all, this paper divides the registration into two processes: camera calibration and joint calibration of the camera and laser scanner based on the calibration results. Camera calibration can determine the plane model of the calibration board in the camera coordinate system, and the joint calibration uses the RANSAC algorithm to extract the point cloud of the plane model of the calibration board, and then optimizes the distance between the points in the plane model point cloud and the corresponding plane in the camera coordinate system Find the optimal transformation between the two sets of data, and then calculate the registration relationship between the point cloud and the image. Secondly, this article conducts a demand analysis of the film and television industry cloud exhibition platform based on virtual reality technology, including the business goals set by the platform, platform system analysis, overall design, and system operating environment and configuration requirements. This model provides a feasible solution for the visual interaction of the cloud exhibition design of the film and television industry.     

Parametric 3D modeling of young women's lower bodies based on shape classification

Three-dimensional (3D) human body modeling is an important research direction in the field of clothing virtual design. On the basis of 3D human body scanning, this paper studied a method to build a 3D parametric lower body model according to body classification. The research includes three main parts. (1) Anthropometry and body shape classification. We randomly selected 333 young women ages 18–25 years old in Northeast China as the experimental sample. Then we divided the lower body shape into three categories using principal component analysis and K-means clustering. (2) Determination of feature cross sections and points, and reconstruction of feature curves. According to the average values of each body type, we obtained the mean reference body by Euclidean distance method. We determined feature cross sections and points, and extracted the 3D coordinates of the feature points of the mean reference body to reconstruct the feature curves. (3) The surface lofting and establishment of parametric 3D lower body model. According to the shape characteristics of the lower body, we constructed the guiding lines for the crotch and lower limbs, and established parametric lower body models for three body types.Relevance to industry3D human modeling is an important part of garment industry digitization. This research provides an effective way to construct a parametric 3D lower body model. The method offers a reference for the parametric virtual human modeling and virtual fitting of trousers.     

Selection of optimized features for fusion of palm print and finger knuckle‐based person authentication

The impact of digital technology in biometrics is much more efficient at interpreting data than humans, which results in completely replacement of manual identification procedures in forensic science. Because the single modality‐based biometric frameworks limit performance in terms of accuracy and anti‐spoofing capabilities due to the presence of low quality data, therefore, information fusion of more than one biometric characteristic in pursuit of high recognition results can be beneficial. In this article, we present a multimodal biometric system based on information fusion of palm print and finger knuckle traits, which are least associated to any criminal investigation as evidence yet. The proposed multimodal biometric system might be useful to identify the suspects in case of physical beating or kidnapping and establish supportive scientific evidences, when no fingerprint or face information is present in photographs. The first step in our work is data preprocessing, in which region of interest of palm and finger knuckle images have been extracted. To minimize nonuniform illumination effects, we first normalize the detected circular palm or finger knuckle and then apply line ordinal pattern (LOP)‐based encoding scheme for texture enrichment. The nondecimated quaternion wavelet provides denser feature representation at multiple scales and orientations when extracted over proposed LOP encoding and increases the discrimination power of line and ridge features. To best of our knowledge, this first attempt is a combination of backtracking search algorithm and 2D²LDA has been employed to select the dominant palm and knuckle features for classification. The classifiers output for two modalities are combined at unsupervised rank level fusion rule through Borda count method, which shows an increase in performance in terms of recognition and verification, that is, 100% (correct recognition rate), 0.26% (equal error rate), 3.52 (discriminative index), and 1,262 m (speed).     

Towards sustainable industry 4.0: A green real-time IIoT multitask scheduling architecture for distributed 3D printing services

As the keystones of the personalized manufacturing, the Industrial Internet of Things (IIoT) consolidated with 3D printing pave the path for the era of Industry 4.0 and smart manufacturing. By resembling the age of craft manufacturing, Industry 4.0 expedites the alteration from mass production to mass customization. When distributed 3D printers (3DPs) are shared and collaborated in the IIoT, a promising dynamic, globalized, economical, and time-effective manufacturing environment for customized products will appear. However, the optimum allocation and scheduling of the personalized 3D printing tasks (3DPTs) in the IIoT in a manner that respects the customized attributes submitted for each model while satisfying not only the real-time requirements but also the workload balancing between the distributed 3DPs is an inevitable research challenge that needs further in-depth investigations. Therefore, to address this issue, this paper proposes a real-time green-aware multi-task scheduling architecture for personalized 3DPTs in the IIoT. The proposed architecture is divided into two interconnected folds, namely, allocation and scheduling. A robust online allocation algorithm is proposed to generate the optimal allocation for the 3DPTs. This allocation algorithm takes into consideration meeting precisely the customized user-defined attributes for each submitted 3DPT in the IIoT as well as balancing the workload between the distributed 3DPs simultaneously with improving their energy efficiency. Moreover, meeting the predefined deadline for each submitted 3DPT is among the main objectives of the proposed architecture. Consequently, an adaptive real-time multi-task priority-based scheduling (ARMPS) algorithm has been developed. The built ARMPS algorithm respects both the dynamicity and the real-time requirements of the submitted 3DPTs. A set of performance evaluation tests has been performed to thoroughly investigate the robustness of the proposed algorithm. Simulation results proved the robustness and scalability of the proposed architecture that surpasses its counterpart state-of-the-art architectures, especially in high-load environments.     

Applications of additive manufacturing (AM) in sustainable energy generation and battle against COVID-19 pandemic: The knowledge evolution of 3D printing

Sustainable and cleaner manufacturing systems have found broad applications in industrial processes, especially aerospace, automotive and power generation. Conventional manufacturing methods are highly unsustainable regarding carbon emissions, energy consumption, material wastage, costly shipment and complex supply management. Besides, during global COVID-19 pandemic, advanced fabrication and management strategies were extremely required to fulfill the shortfall of basic and medical emergency supplies. Three-dimensional printing (3DP) reduces global energy consumption and CO₂ emissions related to industrial manufacturing. Various renewable energy harvesting mechanisms utilizing solar, wind, tidal and human potential have been fabricated through additive manufacturing. 3D printing aided the manufacturing companies in combating the deficiencies of medical healthcare devices for patients and professionals globally. In this regard, 3D printed medical face shields, respiratory masks, personal protective equipment, PLA-based recyclable air filtration masks, additively manufactured ideal tissue models and new information technology (IT) based rapid manufacturing are some significant contributions of 3DP. Furthermore, a bibliometric study of 3D printing research was conducted in CiteSpace. The most influential keywords and latest research frontiers were found and the 3DP knowledge was categorized into 10 diverse research themes. The potential challenges incurred by AM industry during the pandemic were categorized in terms of design, safety, manufacturing, certification and legal issues. Significantly, this study highlights the versatile role of 3DP in battle against COVID-19 pandemic and provides up-to-date research frontiers, leading the readers to focus on the current hurdles encountered by AM industry, henceforth conduct further investigations to enhance 3DP technology.     

Personalizing 3D virtual fashion stores: Exploring modularity with a typology of atmospherics based on user input

This research develops a typology of atmospherics that contains user-identified modules and modular options for personalizing 3D virtual fashion stores. A content analysis of 46 focus group discussions (n = 170) was conducted to understand the user’s perspective for personalizing 3D virtual fashion store atmospherics. Based on three atmospheric categories (pathfinding assistant, environment, and the manner of product presentation), 17 modules and 207 modular options were identified for personalizing 3D virtual stores. This research pioneers the development of an atmospherics typology for personalizing 3D virtual shopping environments as a persuasive selling tool in the emerging field of 3D virtual reality (VR) retailing.     

基于Multipath的煤矿巷道三维模型构建方法

针对现有煤矿巷道三维模型存在灵活性和可移植性差、数据更新维护困难等问题,提出了一种基于Multipath的煤矿巷道三维模型构建方法。该方法通过定义点弧拓扑数据模型,将煤矿CAD格式数据转换为Geodatabase中的要素类,利用开发的ArcGIS Engine程序、通过插入节点坐标生成巷道三维模型,实现了煤矿巷道自动建模,有效减少了巷道三维建模的工作量。     

SVG的3D实现

针对SVG在3D图形的描述与绘制上存在局限性的问题,提出了一种SVG的3D实现方法;详细介绍了SVG的2D坐标系到3D坐标系的转换原理,给出了转换到3D坐标系后的SVG-3D图形的绘制与操控流程,并以在3D场景中绘制一个正立方体和圆球体为例,介绍了在HTML页面中采用JavaScript创建3D场景和绘制与操控这2个图形的实现。