Progress in 3-D Multiperspective Display by Integral Imaging

Three-dimensional (3-D) imaging techniques have the potential to establish a future mass-market in the fields of entertainment and communications. Integral imaging (InI), which can capture and display true 3-D color images, has been seen as the right technology for 3-D viewing for audiences of more than one person. Due to the advanced degree of its development, InI technology could be ready for massive commercialization in the coming years. This development is the result of a strong research effort performed over the past few years. In this sense, this paper is devoted to reviewing some recent advances in InI, which have allowed improvement in the response of InI systems to the problems of the limited depth of field, poor axial and lateral resolution, pseudoscopic-to-orthoscopic conversion, production of 3-D images with continuous relief, or the limited range of viewing angles of InI monitors.      

Transpost: 360 deg-Viewable Three-Dimensional Display System

Three-dimensional (3-D) displays are drawing attention as next-generation devices. Some techniques which can reproduce 3-D images prepared in advance have already been developed. However, technology for the transmission of 3-D moving pictures in real time is yet to be achieved. In this paper, we present a novel method for 360/spl deg/ viewable 3-D displays and the Transpost system in which we implement the method. The basic concept of our system is to project multiple images of the object, taken from different angles, onto a spinning screen. The key to the method is projection of the images onto a directionally reflective screen with a limited viewing angle. The images are reconstructed to give the viewer a 3-D image of the object displayed on the screen. The display system can present images of computer-graphics pictures, live pictures, and movies. Furthermore, the reverse optical process of that in the display system can be used to record images of the subject from multiple directions; the images can then be transmitted to the display in real-time. We have developed prototypes of a 3-D display and a 3-D human-image transmission system. Our preliminary working prototypes demonstrate new possibilities of expression and forms of communication.     

Three-Dimensional Imaging and Processing Using Computational Holographic Imaging

Digital holography is a technique that permits digital capture of holograms and subsequent processing on a digital computer. This paper reviews various applications of this technique. The presented applications cover three-dimensional (3-D) imaging as well as several associated problems. For the case of 3-D imaging, optical and digital methods to reconstruct and visualize the recorded objects are described. In addition, techniques to compress and encrypt 3-D information in the form of digital holograms are presented. Lastly, 3-D pattern recognition applications of digital holography are discussed. The described techniques constitute a comprehensive approach to 3-D imaging and processing.     

Methods for Displaying Three-Dimensional Images

The essential components of generating three-dimensional (3-D) images are defined, and various methods of creating each of the components are explained. The components are image acquisition, image multiplexing and processing, and display mechanisms. For image acquisition, transforming, synthesizing based on disparity, voxel and wavefront deformation, and sampling and photographing methods are used. For multiplexing, time, spatial, and spatiotemporal, and for processing, chirping, layering, and pixel cell based multiview image arrangement methods are used. The display mechanisms are classified into projection, contact,and scanning types depending on their means of displaying images. From these methods, 3-D images with real volume, with parallax only and with psychologically induced depth sense can be generated. The display mechanisms have another important mission of creating viewing zones. For this purpose, all 3-D imaging methods employ a special form of optics or mechanisms complying with their image multiplexing schemes. These optics and mechanisms are essential in realizing 3-D imaging systems but at the same time they provide many unfriendly and uncomfortable effects to viewers, and also impose some functional limitations.     

Surgical navigation by autostereoscopic image overlay of integral videography

This paper describes an autostereoscopic image overlay technique that is integrated into a surgical navigation system to superimpose a real three-dimensional (3-D) image onto the patient via a half-silvered mirror. The images are created by employing a modified version of integral videography (IV), which is an animated extension of integral photography. IV records and reproduces 3-D images using a microconvex lens array and flat display; it can display geometrically accurate 3-D autostereoscopic images and reproduce motion parallax without the need for special devices. The use of semitransparent display devices makes it appear that the 3-D image is inside the patient's body. This is the first report of applying an autostereoscopic display with an image overlay system in surgical navigation. Experiments demonstrated that the fast IV rendering technique and patient-image registration method produce an average registration accuracy of 1.13 mm. Experiments using a target in phantom agar showed that the system can guide a needle toward a target with an average error of 2.6 mm. Improvement in the quality of the IV display will make this system practical and its use will increase surgical accuracy and reduce invasiveness.     

Resampling, Antialiasing, and Compression in Multiview 3-D Displays

Multiview three-dimensional (3-D) displays offer viewing of high-resolution stereoscopic images from arbitrary positions without glasses. This article surveyed different approaches to develop signal processing algorithms for these displays. Such displays consist of view-dependent pixels that reveal a different color according to the viewing angle. Therefore, the left and right eye of an observer sees slightly different images on the screen. This leads to the perception of 3-D depth and parallax effects when the observer moves. Although the basic optical principles of multiview auto-stereoscopy have been known for over a century, only recently displays with increased resolution, or systems based on multiple projectors, have made this approach practical.     

A Hybrid Compression Method for Integral Images Using Discrete Wavelet Transform and Discrete Cosine Transform

Integral imaging (II) is a promising three-dimensional (3-D) imaging technique that uses an array of diffractive or refractive optical elements to record the 3-D information on a conventional digital sensor. With II, the object information is recorded in the form of an array of subimages, each representing a slightly different perspective of the object In order to obtain high-quality 3-D images, digital sensors with a large number of pixels are required. Consequently, high-quality II involves recording and processing large amounts of data. In this paper, we present a compression method developed for the particular characteristics of the digitally recorded integral image. The compression algorithm is based on a hybrid technique implementing a four-dimensional transform combining the discrete wavelet transform and the discrete cosine transform. The proposed algorithm outperforms the baseline JPEG compression scheme applied to II and a previous compression method developed for II based on MPEG II.     

Three-dimensional holographic image sensing and Integral imaging display

In this paper, we propose three-dimensional (3-D) holographic sensing, and computational/optical 3-D integral imaging reconstruction. We demonstrate experimentally that through the integral imaging technique, it is possible to reconstruct a full 3-D scene which has been obtained by digital holograms. Three-dimensional color objects can also be displayed optically in 3-D without convergence-accommodation conflict using a microlens array, and a two-dimensional (2-D) display panel illuminated by incoherent light. The proposed approach takes advantages of high resolution holographic sensing and robust 3-D integral imaging visualization.     

多视点三维投影显示系统

许多人都认为自动分光立体显示技术将使得家庭视觉体验朝着更自然、更逼真的方向发展.为了营造更逼真、更刺激的 VR 效果,屏幕越大越好.本文旨在详细介绍运用在 3D 显示的多视点三维投影系统.三维图像方法的原理是视差的深度暗示.采用的方法的视差不是由于使用特殊光学眼镜或者是特殊的光学头盔作为观察光学图像形成区域而引起的.实验装置系统包括暗箱组、PC 组和一个多视点三维显示器.采用了透镜、视差栅栏来制作空间多元多视角的自动分光立体显示器.使用投影仪来模拟分光图像对.这种自动分光显示屏幕的优点在于:容易按比例放大;低成本;投影仪和屏幕间不需要精确对准.本文还研究了该屏幕的制作工艺,并给出了实验结果.     

Three-dimensional imaging methods based on multiview images

Three-dimensional imaging methods, based on parallaxes as their depth cues, can be classified into the stereoscopic providing binocular parallax only, and multiview providing both binocular and motion parallaxes. In these methods, the parallaxes are provided by creating a viewing zone with use of either a special optical eyeglasses or a special optical plate as their viewing zone-forming optics. For the stereoscopic image generations, either the eyeglasses or the optical plate can be employed, but for the multiview the optical plate or the eyeglasses with a tracking device. The stereoscopic image pair and the multiview images are presented either simultaneously or as a time sequence with use of projectors or display panels. For the case of multiview images, they can also be presented as two images at a time according to the viewer's movements. The presence of the viewing zone-forming optics often causes undesirable problems, such as appearance of moire/spl acute/ fringes, image quality deterioration, depth reversion, limiting viewing regions, low image brightness, image blurring, and inconveniences of wearing.     

Image-Based Rendering and Synthesis

One of the most important applications in multiview imaging (MVI) is the development of advanced immersive viewing or visualization systems using, for instance, 3DTV. With the introduction of multiview TVs, it is expected that a new age of 3DTV systems will arrive in the near future. Image-based rendering (IBR) refers to a collection of techniques and representations that allow 3-D scenes and objects to be visualized in a realistic way without full 3-D model reconstruction. IBR uses images as the primary substrate. The potential for photorealistic visualization has tremendous appeal, and it has been receiving increasing attention over the years. Applications such as video games, virtual travel, and E-commerce stand to benefit from this technology. This article serves as a tutorial introduction and brief review of this important technology. First the classification, principles, and key research issues of IBR are discussed. Then, an object-based IBR system to illustrate the techniques involved and its potential application in view synthesis and processing are explained. Stereo matching, which is an important technique for depth estimation and view synthesis, is briefly explained and some of the top-ranked methods are highlighted. Finally, the challenging problem of interactive IBR is explained. Possible solutions and some state-of-the-art systems are also reviewed.     

全息立体显示视角增强方法研究

介绍了全息立体成像的工作原理,通过与其他立体成像技术比较,说明全息立体显示能形成真三维再现像,具有可以提供全部物理景深的优势。从改善全息立体像观察视角出发,阐述了4种增强视角的方法,介绍了这些方法的原理,并对这些方法做了比较分析。     

Interactive display and analysis of 3-D medical images

The ANALYZE software system, which permits detailed investigation and evaluation of 3-D biomedical images, is discussed. ANALYZE can be used with 3-D imaging modalities based on X-ray computed tomography, radionuclide emission tomography, ultrasound tomography, and magnetic resonance imaging. The package is unique in its synergistic integration of fully interactive modules for direct display, manipulation, and measurement of multidimensional image data. One of the most versatile and powerful capabilities in ANALYZE is image volume rendering for 3-D display. An important advantage of this technique is that it can be used to display 3-D images directly from the original data set and to provide on-the-fly combinations of selected image transformations, such as surface segmentation, cutting planes, transparency, and/or volume set operations (union, intersection, difference, etc.). The module has been optimized to be fast (interactive) without compromising image quality. The software is written entirely in C and runs on standard UNIX workstations.     

集成成像立体显示技术研究进展

集成成像立体显示是一种水平和垂直方向同时具有运动视差的真三维立体显示技术。本文概述了集成成像立体显示在显示三维图像时存在的景深范围小,视角范围窄,赝像等问题,介绍了提升景深范围、扩大视角、消除赝像的技术方法。介绍了利用子图像阵列进行计算机三维虚拟重建的最新研究进展。通过研究指出,具有二维和三维显示模式转换功能的集成成像立体显示技术是超薄型真三维立体显示器的重要发展方向。     

Magnetic resonance diffractive imaging

Magnetic resonance (MR) diffractive imaging is proposed as a new approach to MR angiography. The expression of the nuclear MR signal is similar to the equation for the Fresnel diffraction of a three-dimensional (3-D) object in light or sound waves. The proposed technique offers the possibility of fast angiographic imaging and the on-line reconstruction of 3-D volumetric images using the holographic technique. Static imaging experiments using an ultra-low-field MRI system are performed to verify the feasibility of the technique. It is shown that the images focused on an arbitrary plane can be reconstructed from data scanned in two dimensions, even though blurred image data is superimposed on the image. Moreover, the 3-D image can be observed in a coherent optical imaging system. This study demonstrates the possibility of the proposed method as a fast imaging technique for MR angiography.     

Patient-specific bronchoscopy visualization through BRDF estimation and disocclusion correction

This paper presents an image-based method for virtual bronchoscope with photo-realistic rendering. The technique is based on recovering bidirectional reflectance distribution function (BRDF) parameters in an environment where the choice of viewing positions, directions, and illumination conditions are restricted. Video images of bronchoscopy examinations are combined with patient-specific three-dimensional (3-D) computed tomography data through two-dimensional (2-D)/3-D registration and shading model parameters are then recovered by exploiting the restricted lighting configurations imposed by the bronchoscope. With the proposed technique, the recovered BRDF is used to predict the expected shading intensity, allowing a texture map independent of lighting conditions to be extracted from each video frame. To correct for disocclusion artefacts, statistical texture synthesis was used to recreate the missing areas. New views not present in the original bronchoscopy video are rendered by evaluating the BRDF with different viewing and illumination parameters. This allows free navigation of the acquired 3-D model with enhanced photo-realism. To assess the practical value of the proposed technique, a detailed visual scoring that involves both real and rendered bronchoscope images is conducted.     

基于偏振光栅的一维集成成像双视3D显示

为了解决视区分离的问题,设计了一种基于偏振光栅的一维集成成像双视3D显示器,建立了3D成像模型,详细阐述了一维集成成像双视3D显示的原理;通过几何光学推导视区宽度以及观看视角的计算公式;研制了基于偏振光栅的一维集成成像双视3D显示测试装置,在左18°到右18°的范围内,通过左偏振眼镜和右偏振眼镜在同一视区内分别观看到两个不同的3D图像。     

Tag surface reconstruction and tracking of myocardial beads from SPAMM-MRI with parametric B-spline surfaces

Magnetic resonance imaging (MRI) is unique in its ability to noninvasively and selectively alter tissue magnetization, and create tag planes intersecting image slices. The resulting grid of signal voids allows for tracking deformations of tissues in otherwise homogeneous-signal myocardial regions. In this paper, we propose a specific spatial modulation of magnetization (SPAMM) imaging protocol together with efficient techniques for measurement of three-dimensional (3-D) motion of material points of the human heart (referred to as myocardial beads) from images collected with the SPAMM method. The techniques make use of tagged images in orthogonal views by explicitly reconstructing 3-D B-spline surface representation of tag planes (tag planes in two orthogonal orientations intersecting the short-axis (SA) image slices and tag planes in an orientation orthogonal to the short-axis tag planes intersecting long-axis (LA) image slices). The developed methods allow for viewing deformations of 3-D tag surfaces, spatial correspondence of long-axis and short-axis image slice and tag positions, as well as nonrigid movement of myocardial beads as a function of time.     

Optical scanner for immunoassays with up-converting phosphorescent labels

A 2-D optical scanner was developed for the imaging and quantification of up-converting phosphor (UCP) labels in immunoassays. With resolution better than 500 microm, a scan rate of 0.4 mm/s, and a 1-2% coefficient of variation for repeatability, this scanner achieved a detection limit of fewer than 100 UCP particles in an 8.8. x 10(4) microm(2) area and a dynamic range that covered more than three orders of magnitude. Utilizing this scanner, a microfluidic chip immunoassay for the cytokine interferon-gamma (IFN-gamma) was developed: concentrations as low as 3 pM (50 pg/mL) were detected from 100 microL samples with a total assay time of under an hour, including the 8 min readout. For this UCP-based assay, 2-D images of the capture antibody lines were scanned, image processing techniques were employed to extract the UCP emission signals, a response curve that spanned 3-600 pM IFN-gamma was generated, and a five-parameter logistic mathematical model was fitted to the data for determination of unknown IFN-gamma concentrations. Relative to common single-point or 1-D scanning optical measurements, our results suggest that a simple 2-D imaging system can speed assay development, reduce errors, and improve accuracy by characterizing the spatial distribution and uniformity of surface-captured optical labels as a function of assay conditions and device parameters.