Performance Comparison of a SSVEP BCI Task by Individual Stereoscopic 3D Susceptibility

This study aimed at investigating the differences in brain–computer interface (BCI) task performance between 2D and 3D displays depending on their individual susceptibility to stereoscopic 3D. Eleven female and 10 male participants attempted a steady-state visually evoked potential BCI navigation task in a virtual home environment with and without 3D views. Participants were categorized into fatigued and unfatigued groups, depending on their individual susceptibility to 3D, which was characterized using a subjective evaluation method for 3D visual fatigue. The task completion time for the fatigued group under the 3D conditions was significantly delayed relative to the 2D mode. In contrast, a significantly decreased completion time was observed in the 3D view relative to the 2D view for the unfatigued group. The averaged positive predictive value significantly increased in the 3D mode relative to the 2D one for the unfatigued group only. These results are expected to provide a practical implication for enhancing BCI task performance in light of individual vulnerability to 3D.     

基于弹簧质点模型的二维/三维映射算法*

提出了一种用于服装设计的二维/三维映射算法.该算法基于弹簧质点变形模型,服装裁剪片二维到三维映射及三维到二维映射可以在该模型中得到统一的实现.在服装裁剪片二维到三维的映射过程中,二维裁剪片被放置在人体模型附近的初始位置,在缝合力的作用下,裁剪片自动变形并缝合到人体模型上.在服装裁剪片三维到二维映射的过程中,三维裁剪片被初始映射到指定的平面内,在弹性变形力的作用下,逐步变形并得到最终的二维裁剪片.在进行服装裁剪片二维到三维映射的过程中,考虑了干涉检验的问题.     

Integrated approach of streaming 3d multimedia contents in real-time for mobile devices

It is popular to watch a 3D video through a 3D display nowadays. However, it is still difficult to enjoy the 3D multimedia contents with a mobile device even if a mobile device with a 3D display is currently introduced into the market. The main technological challenges for watching 3D contents via the mobile devices can be identified as the following: generating and streaming 3D contents. Generating 3D contents requires extra computational resources. Moreover, streaming 3D contents demands additional network bandwidth for receiving and transmitting the 3D data. To overcome these technological challenges, we propose ReMA, a novel 3D video streaming system in this paper. We devised a novel architecture for transmitter, receiver, and a distribution system to efficiently disseminate and generate 3D videos for the mobile devices. We implemented ReMA in a real test-bed and conducted a thorough empirical evaluation study to see the feasibility of streaming 3D contents for the mobile devices. Based on our empirical study, the resulting system presents a great promise in streaming 3D video in real-time to the mobile devices.     

A Prototypical 3D Graphical Visualizer for Object-Oriented Systems

is paper describes a framework for visualizing object-oriented systems within a 3D interactive environment.The 3D visualizer represents the structure of a program as Cylinder Net that simultaneously specifies two relationships between objects within 3D virtual space.Additionally,it represents additional relationships on demand when objects are moved into local focus.The 3D visualizer is implemented using a 3D graphics toolkit,TOAST,that implements 3D Widgets 3D graphics to ease the programming task for 3D visualization.     

3D Image Synthesis for B-Reps Objects

This paper presents a new algorithm for generating 3D images of B-reps objects with trimmed surface boundaries.The 3D image is a discrete voxel-map representation within a Cubic Frame Buffer (CFB).The definition of 3D images for curve,surface and solid object are introduced which imply the connectivity and fidelity requirements.Adaptive Forward Differencing matrix (AFD-matrix) for 1D-3D manifolds in 3D space is developed.By setting rules to update the AFD-matrix,the forward difference direction and stepwise can be adjusted.Finally,an efficient algorithm is presented based on the AFD-matrix concept for converting the object in 3D space to 3D image in 3D discrete space.     

考古地层的三维重建方法*

基于现有三维可视化技术,分别介绍了3D图形库接口、3D GIS技术、3D GMS技术、虚拟现实技术等可以实现考古地层三维重建的方法,并从地层三维建模的角度比较了各种方法的特点,探讨了较为实用的考古地层三维重建途径.     

三维图形生成支撑环境综述

介绍了三维图形生成支撑环境OpenGL,Direct 3D及Glide,详细分析了各自的软件底层接口特点及硬件支持,并探讨了三维图形在网络上的应用接口语言VRML和Java 3D,展望了三维图形生成环境的发展前景。     

Alignment of continuous video onto 3D point clouds

We propose a general framework for aligning continuous (oblique) video onto 3D sensor data. We align a point cloud computed from the video onto the point cloud directly obtained from a 3D sensor. This is in contrast to existing techniques where the 2D images are aligned to a 3D model derived from the 3D sensor data. Using point clouds enables the alignment for scenes full of objects that are difficult to model; for example, trees. To compute 3D point clouds from video, motion stereo is used along with a state-of-the-art algorithm for camera pose estimation. Our experiments with real data demonstrate the advantages of the proposed registration algorithm for texturing models in large-scale semi-urban environments. The capability to align video before a 3D model is built from the 3D sensor data offers new practical opportunities for 3D modeling. We introduce a novel modeling-through-registration approach that fuses 3D information from both the 3D sensor and the video. Initial experiments with real data illustrate the potential of the proposed approach.     

2D representation of facial surfaces for multi-pose 3D face recognition

The increasing availability of 3D facial data offers the potential to overcome the intrinsic difficulties faced by conventional face recognition using 2D images. Instead of extending 2D recognition algorithms for 3D purpose, this letter proposes a novel strategy for 3D face recognition from the perspective of representing each 3D facial surface with a 2D attribute image and taking the advantage of the advances in 2D face recognition. In our approach, each 3D facial surface is mapped homeomorphically onto a 2D lattice, where the value at each site is an attribute that represents the local 3D geometrical or textural properties on the surface, therefore invariant to pose changes. This lattice is then interpolated to generate a 2D attribute image. 3D face recognition can be achieved by applying the traditional 2D face recognition techniques to obtained attribute images. In this study, we chose the pose invariant local mean curvature calculated at each vertex on the 3D facial surface to construct the 2D attribute image and adopted the eigenface algorithm for attribute image recognition. We compared our approach to state-of-the-art 3D face recognition algorithms in the FRGC (Version 2.0), GavabDB and NPU3D database. Our results show that the proposed approach has improved the robustness to head pose variation and can produce more accurate 3D multi-pose face recognition.     

Object-oriented development and application of a nonlinear structural analysis framework

This paper describes the framework and application of numerical simulation software on earthquake engineering research and practice. The analysis kernel is developed at the National Center for Research on Earthquake Engineering (NCREE) and is entitled as “Platform of Inelastic Structural Analysis for 3D systems (PISA3D)”. The design of PISA3D framework adopts the Design Pattern and the Unified Process. PISA3D provides structural modeling and high computational efficiency for engineers and researchers to simulate the responses of nonlinear systems under various kinds of load effects. It includes static or cyclic loads, displacements, earthquake ground accelerations, and earthquake aftershocks. PISA3D is easy to extend and maintain due to its object-oriented nature. Advanced users can derive or compose its objects’ libraries to perform different types of structural analyses. Based on object-oriented techniques, VISA3D (Visualization of Inelastic Structural Analysis for 3D systems) has been implemented with usage of OpenGL for 3D graphics and MFC for graphical user interface (GUI). Its framework allows further extension on new input formats and new element types. VISA3D has been mainly developed as a post-processor to examine the analytical results of PISA3D through 2D/3D static or dynamic graphic approaches. It includes graphical checking of the structural model, mode shapes, deformations, extents and locations of plastic hinges, plotting of nodal velocity, acceleration, and energy distribution time histories. This paper then introduces NCREE’s recent development on the pre-processing framework GISA3D (Graphical Interface of Inelastic Structural Analysis for 3D systems). The GISA3D does not only supply features as a “post-processor”, but also fully supports operations of “model generation” via mouse motion. Users can create, remove, modify and set elements/nodes through mouse clicking, dragging and selecting. Finally, this paper illustrates the networked sub-structural pseudo dynamic tests using PISA3D as the analysis engine, and concludes with several successful applications of PISA3D/VISA3D/GISA3D on various researches and actual structural engineering projects.     

医学3D计算机视觉：研究进展和挑战

医学影像的诊断是许多临床决策的基础,而医学影像的智能分析是医疗人工智能的重要组成部分。与此同时,随着越来越多3D空间传感器的兴起和普及,3D计算机视觉正变得越发重要。本文关注医学影像分析和3D计算机的交叉领域,即医学3D计算机视觉或医学3D视觉。本文将医学3D计算机视觉系统划分为任务、数据和表征3个层面,并结合最新文献呈现这3个层面的研究进展。在任务层面,介绍医学3D计算机视觉中的分类、分割、检测、配准和成像重建,以及这些任务在临床诊断和医学影像分析中的作用和特点。在数据层面,简要介绍了医学3D数据中最重要的数据模态：包括计算机断层成像（computed tomography,CT）、磁共振成像（magnetic resonance imaging,MRI）、正电子放射断层成像（positron emission tomography,PET）等,以及一些新兴研究提出的其他数据格式。在此基础上,整理了医学3D计算机视觉中重要的研究数据集,并标注其数据模态和主要视觉任务。在表征层面,介绍并讨论了2D网络、3D网络和混合网络在医学3D数据的表征学习上的优缺点。此外,针对医学影像中普遍存在的小数据问题,重点讨论了医学3D数据表征学习中的预训练问题。最后,总结了目前医学3D计算机视觉的研究现状,并指出目前尚待解决的研究挑战、问题和方向。     

A survey of memory architecture for 3D chip multi-processors

3D chip multi-processors (3D CMPs) combine the advantages of 3D integration and the parallelism of CMPs, which are emerging as active research topics in VLSI and multi-core computer architecture communities. One significant potentiality of 3D CMPs is to exploit the diversity of integration processes and high volume of vertical TSV bandwidth to mitigate the well-known “Memory Wall” problem. Meanwhile, the 3D integration techniques are under the severe thermal, manufacture yield and cost constraints. Research on 3D stacking memory hierarchy explores the high performance and power/thermal efficient memory architectures for 3D CMPs. The micro-architectures of memories can be designed in the 3D integrated circuit context and integrated into 3D CMPs. This paper surveys the design of memory architectures for 3D CMPs. We summarize current research into two categories: stacking cache-only architectures and stacking main memory architectures for 3D CMPs. The representative works are reviewed and the remaining opportunities and challenges are discussed to guide the future research in this emerging area.     

3D建模与编程技术

3D建模与编程技术是3D应用软件实现中非常技巧和关键性的技术，目前应用比较广泛的有OpenGL，Direet3D，Java3D和VRML等。OpenGL主要用于底层软件和复杂场景建模软件的开发，Direet3D和Java3D主要应用于较高层次3D软件的快速开发，而VRML实质是一种描述性的3D建模语言，在Plug-in的支持下，可以增强Web的三维功能。对这四种技术的运行机理、实现机制和程序结构等作了较为详尽的阐述。     

A novel 3D sensory system for robot-assisted mapping of cluttered urban search and rescue environments

In this paper, the first application of utilizing a unique 3D sensor for sequential 3D map building in unknown cluttered urban search and rescue (USAR) environments is proposed. The sensor utilizes a digital fringe projection and phase shifting technique to provide real-time 2D and 3D sensory information of the environment. The proposed sensor is unique over current technologies in that high-resolution 3D information of rubble filled environments can be acquired from the single sensor at a speed of 30 frames per second (fps). Furthermore, we propose the development of a novel robust and reliable landmark identification technique that utilizes both 2D and 3D depth images taken by the sensor for 3D mapping. Preliminary experiments show the potential of the real-time 3D sensory system and landmark identification scheme for robotic 3D mapping in unknown cluttered USAR-like environments.     

A novel 2D and 3D multimodal approach for in-the-wild facial expression recognition

This study proposes a novel deep learning approach for the fusion of 2D and 3D modalities in in-the-wild facial expression recognition (FER). Different from other studies, we exploit the 3D facial information in in-the-wild FER. In particular, in-the-wild 3D FER dataset is not widely available; therefore, 3D facial data are constructed from available 2D datasets thanks to recent advances in 3D face reconstruction. The 3D facial geometry features are then extracted by deep learning technique to exploit the mid-level details, which provides meaningful expression for the recognition. In addition, to demonstrate the potential of 3D data on FER, the 2D projected images of 3D faces are taken as additional input to FER. These features are then jointly fused with 2D features obtained from the original input. The fused features are then classified by support vector machines (SVMs). The results show that the proposed approach achieves state-of-the-art recognition performances on Real-World Affective Faces (RAF) and Static Facial Expressions in the Wild (SFEW 2.0), and AffectNet dataset. This approach is also applied to a 3D FER dataset, i.e. BU-3DFE, to compare the effectiveness of reconstructed and available 3D face data for FER. This is the first time such a deep learning combination of 3D and 2D facial modalities is presented in the context of in-the-wild FER.     

3维模型形状相似性比较算法综述

随着3维模型使用得日益广泛,对3维模型检索系统的研究,近年来日益受到了国内外广大研究人员的关注。3维模型形状相似性比较算法是3维模型检索系统的主要研究问题之一,很多学者对其进行了深入的研究并提出了很多算法。为了使人们对该领域现状有个概略了解,首先介绍了3维模型检索系统,同时回顾了近几年来3维模型检索技术的发展概况,并且从3维模型检索系统实用性的角度分析了3维模型形状相似性比较算法所应该具备的特点;然后对3维模型形状相似性比较算法进行了分类综述,同时分析了它们的特点,并对其中的一些算法进行了检索对比实验;最后归纳了3维模型形状相似性比较算法研究所面临的困难和挑战,指出了进一步研究此问题的发展空间,并对此问题进行了展望。     

三维物体的形态图表达方法

三维物体的表达方法是计算机视觉中的关键问题之一，现有的各种三维物体表达方法虽然在各自的识别中得到应用，但都存在各自的局限性，用形态图表达三维物体是一种以视点为中心的表达方法，由于它列举了一个物体所有可能的“定性”形象，即它可使用最少的二维投影线图（特征视图）来表达一个完整的三维物体，因此使三维物体识别转化为2D与2D的匹配，该文首先定义了二维线图拓扑结构等价的判别准则，然后给出了构造透明物体形态图的方法，最后根据拓扑结构等价准则来得到不透明物体的形态图和特征图，并用圆锥与圆柱相交的实例进行了验证。     

U3D文件格式及运行机制剖析

通用三维文件格式（U3D）是一种可扩展的三维数据文件格式,其目的是为了使下游的3DCAD数据重用和可视化。它主要嵌入到其它文件格式中来显示三维数据,因此在许多主流的应用程序中极为有用。详细分析了这种文件格式及其运行机制,并通过一个写U3D文件的编程实例来进一步说明文件的构造方式。最后,还探讨了这种文件格式的优点及其应用。     

三维视频压缩研究进展

信息压缩是信息传输过程中的一个关键环节,随着三维显示和三维视频技术的发展和完善,未来的视频传输将不仅限于二维视频。但是,三维视频的数据量很大,这就给三维视频的传输带来了阻碍。因此,设计出高压缩比、高压缩效率的三维视频压缩技术,不但可以解决三维视频的传输问题,而且有利于促进三维视频及三维显示领域的进一步发展。本文系统地讨论了目前三维视频压缩技术的研究进展,在对各种技术特点研究的基础上,提出了进一步的研究和发展方向。     

基于极半径曲面矩的三维模型检索

提出一种三维极半径曲面矩,并应用于三维模型检索.三维极半径矩是一种具有平移、旋转和缩放不变性的不变量,将三维极半径矩推广到三维极半径曲面矩获得了新的不变矩,该方法不需要将三角面片表示的三维模型数据体素化,从而提高了计算速度和计算精度.同时,基于这种三维极半径曲面矩的识别算法具有很好的识别率.