Blur-metric-based resolution enhancement of computationally reconstructed integral images

A computational integral imaging reconstruction technique can reconstruct a set of plane images of three-dimensional (3-D) objects along the output plane, in which only the plane object image (POI) reconstructed on the right planes where the objects were positioned is highly focused, whereas the other POIs reconstructed away from these planes are unfocused and blurred. In fact, these blurred POIs act as additional noises to other object images reconstructed on different output planes, so that the resolution of reconstructed object images should be considerably deteriorated. In this paper, a novel approach is proposed to effectively reduce the blurred images occurring in the focused POIs by employing a blur metric. From the estimated blur metric of each reconstructed POI, the right output planes where the objects were located can be detected. In addition, with an estimated blur metric, focused POIs can be adaptively eroded by a simple gray level erosion operation because it reduces regional expansion caused by the blur effect. The gray values of the eroded POIs are then finally remapped by referencing the original POIs. Some experiments revealed an average increase of 1.95 dB in the peak signal-to-noise ratio in the remapped POIs compared with that of the originally reconstructed POIs, and that the original forms of the object images in the remapped POIs could be preserved even after they had gone through an erosion operation. This feasibility test of the proposed scheme finally suggests a possibility of its application to robust detection and recognition of 3-D objects in a scene.     

Digitized holography: modern holography for 3D imaging of virtual and real objects

Recent developments in computer algorithms, image sensors, and microfabrication technologies make it possible to digitize the whole process of classical holography. This technique, referred to as digitized holography, allows us to create fine spatial three-dimensional (3D) images composed of virtual and real objects. In the technique, the wave field of real objects is captured in a wide area and at very high resolution using the technique of synthetic aperture digital holography. The captured field is incorporated in virtual 3D scenes including two-dimensional digital images and 3D polygon mesh objects. The synthetic field is optically reconstructed using the technique of computer-generated holograms. The reconstructed 3D images present all depth cues like classical holograms but are digitally editable, archivable, and transmittable unlike classical holograms. The synthetic hologram printed by a laser lithography system has a wide viewing zone in full-parallax and give viewers a strong sensation of depth, which has never been achieved by conventional 3D systems. A real hologram as well as the details of the technique is presented to verify the proposed technique.     

Depth extraction of three-dimensional objects using block matching for slice images in synthetic aperture integral imaging

We describe a computational method for depth extraction of three-dimensional (3D) objects using block matching for slice images in synthetic aperture integral imaging (SAII). SAII is capable of providing high-resolution 3D slice images for 3D objects because the picked-up elemental images are high-resolution ones. In the proposed method, the high-resolution elemental images are recorded by moving a camera; a computational reconstruction algorithm based on ray backprojection generates a set of 3D slice images from the recorded elemental images. To extract depth information of the 3D objects, we propose a new block-matching algorithm between a reference elemental image and a set of 3D slice images. The property of the slices images is that the focused areas are the right location for an object, whereas the blurred areas are considered to be empty space; thus, this can extract robust and accurate depth information of the 3D objects. To demonstrate our method, we carry out the preliminary experiments of 3D objects; the results indicate that our method is superior to a conventional method in terms of depth-map quality.     

Curved computational integral imaging reconstruction technique for resolution-enhanced display of three-dimensional object images

A novel curved computational integral imaging reconstruction (C-CIIR) technique for the virtually curved integral imaging (VCII) system is proposed, and its performances are analyzed. In the C-CIIR model, an additional virtual large-aperture lens is included to provide a multidirectional curving effect in the reconstruction process, and its effect is analyzed in detail by using the ABCD matrix. With this method, resolution-enhanced 3D object images can be computationally reconstructed from the picked-up elemental images of the VCII system. To confirm the feasibility of the proposed model, some experiments are carried out. Experiments revealed that the sampling rate in the VCII system could be kept at a maximum value within some range of the distance z, whereas in the conventional integral imaging system it linearly decreased as the distance z increased. It is also shown that resolutions of the object images reconstructed by the C-CIIR method have been significantly improved compared with those of the conventional CIIR method.     

Enhanced reconstruction of three-dimensional shape and texture from integral photography images

A method for the reconstruction of 3D shape and texture from integral photography (IP) images is presented. Sharing the same principles with stereoscopic-based object reconstruction, it offers increased robustness to noise and occlusions due to the unique characteristics of IP images. A coarse-to-fine approach is used, employing what we believe to be a novel grid refinement step in order to increase the quality of the reconstructed objects. The proposed method's properties include configurable depth accuracy and direct and seamless triangulation. We evaluate our method using synthetic data from a computer-simulated IP setup as well as real data from a simple yet effective digital IP setup. Experiments show reconstructed objects of high-quality indicating that IP can be a competitive modality for 3D object reconstruction.     

Image quality enhancement of computational integral imaging reconstruction for partially occluded objects using binary weighting mask on occlusion areas

This paper presents an image quality enhancement of computational integral imaging reconstruction (CIIR) method by using a binary weighting mask on occlusion areas in elemental images. The proposed method utilizes a block-matching algorithm to estimate the occlusion areas in elemental images. Then, a binary weighting mask generated from the estimated occlusion area is applied to our CIIR method. This minimizes the overlapping effect of occluding objects in the reconstructed plane images and thus improves visual quality dramatically. To show the usefulness of our proposed scheme, we conduct several experiments and present the results. The experimental results indicate that our method is superior to the existing methods.     

Extended focused imaging for digital holograms of macroscopic three-dimensional objects

When a digital hologram is reconstructed, only points located at the reconstruction distance are in focus. We have developed a novel technique for creating an in-focus image of the macroscopic objects encoded in a digital hologram. This extended focused image is created by combining numerical reconstructions with depth information extracted by using our depth-from-focus algorithm. To our knowledge, this is the first technique that creates extended focused images of digital holograms encoding macroscopic objects. We present results for digital holograms containing low- and high-contrast macroscopic objects.     

Three-dimensional measurement and imaging based on multicameras randomly distributed on the circumference

We present a three-dimensional (3D) measurement and imaging based on a multicamera system. In the presented system, projected images of 3D objects are taken by cameras located at random positions on a circumference, and then the 3D objects can be reconstructed numerically. We introduce an angle correction function to improve the quality of the reconstructed object. The angle correction function can correct the angle error caused by the position errors in the projected images due to the finite pixel size of the image sensor. The numerical results show that the point source was reconstructed successfully by introducing the angle correction function. We also demonstrate experiments: the two objects are located on a rotary stage controlled by a computer, the projected images are taken by a single camera, and by using 33 projected images, the two objects are reconstructed successfully.     

Automatic threshold technique for holographic particle field characterization

The 3D distribution of a particle field by digital holography is obtained by 3D numerical reconstruction of a 2D hologram. The proper identification of particles from the background during numerical reconstruction influences the overall effectiveness of the technique. The selection of a suitable threshold value to segment particles from the background of reconstructed images during 3D holographic reconstruction process is a critical issue, which influences the accuracy of particle size and number density of reconstructed particles. The object particle field parameters, such as depth of sample volume and density of object particles, influence the optimal threshold value. The present study proposes a novel technique for the determination of the optimal threshold value of a reconstructed image. The effectiveness of the proposed technique is demonstrated using both simulated and experimental data. The proposed technique is robust to variation in optical properties of particle and background, depth of sample volume, and number density of object particle field. The particle diameter obtained from the proposed threshold technique is within 5% of that obtained from the particle size analyzer. There is a maximum ten times increase in reconstruction effectiveness by using the proposed automatic threshold technique in comparison with the fixed manual threshold technique.     

Magnification of 3D reconstructed images in integral imaging using an intermediate-view reconstruction technique

A new integral imaging (II) system that can magnify 3D reconstructed images by employing an intermediate-view reconstruction technique (IVRT) is proposed in which the number of the elemental images obtained from a one-step pickup process can be computationally increased by use of an IVRT without mechanical movement and a long multistep pickup process. To show the feasibility of the proposed II system, some optical experiments on the magnification of 3D reconstructed images with a real 3D object have been carried out and results are presented.     

Computer-generated holograms of a real three-dimensional object based on stereoscopic video images

A novel method of using stereoscopic video images to synthesize the computer-generated hologram (CGH) patterns of a real 3D object is proposed. Stereoscopic video images of a real 3D object are captured by a 3D camera system. Disparity maps between the captured stereo image pairs are estimated and from these estimated maps the depth data for each pixel of the object can be extracted on a frame basis. By using these depth data and original color images, hologram patterns of a real object can be computationally generated. In experiments, stereoscopic video images of a real 3D object, a wooden rhinoceros doll, are captured by using the Wasol 3D adapter system and its depth data are extracted from them. Then, CGH patterns of 1280 pixels x 1024 pixels are generated with these depth-annotated images of the wooden rhinoceros doll, and the CGH patterns are experimentally displayed via a holographic display system.     

Real-time three-dimensional object reconstruction by use of a phase-encoded digital hologram

A three-dimensional (3D) object reconstruction technique that uses only phase information of a phase-shifting digital hologram and a phase-only spatial-light modulator is proposed. It is well known that a digital hologram can store both amplitude and phase information of an optical electric field and can reconstruct the original 3D object in a computer. We demonstrate that it is possible to reconstruct optically 3D objects using only phase information of the optical field calculated from phase-shifting digital holograms. The use of phase-only information enables us to reduce the amount of data in the digital hologram and reconstruct optically the 3D objects using a liquid-crystal spatial light modulator without optical power loss. Numerical evaluation of the reconstructed 3D object is presented.     

Three-dimensional object feature extraction and classification with computational holographic imaging

We address three-dimensional (3D) object classification with computational holographic imaging. A 3D object can be reconstructed at different planes by use of a single hologram. We apply principal component and Fisher linear discriminant analyses based on Gabor-wavelet feature vectors to classify 3D objects measured by digital interferometry. Experimental and simulation results are presented for regional filtering concentrated at specific positions and for overall grid filtering. The proposed technique substantially reduces the dimensionality of the 3D classification problem. To the best of our knowledge, this is the first report on the use of the proposed technique for 3D object classification.     

可见光与热像融合的三维温度模型重建

热像仪因其能够通过检测物体表面热辐射而产生温度图像,近年来被广泛应用于多种工业场合.然而,由于热像图缺少直观的几何信息,当物体表面温度相近时,难以通过人眼分辨物体特征差异.为了解决这个问题,提出了一种结合可见光几何信息与热像图温度信息的三维模型重建方法.首先使用自制标定板进行可见光相机与热像仪的校正;随后,通过运动恢复...     

Visibility-enhanced reconstruction of three-dimensional objects under a heavily scattering medium through combined use of intermediate view reconstruction, multipixel extraction, and histogram equalization methods in the conventional integral imaging system

In this paper, we propose an effective approach for reconstructing visibility-enhanced three-dimensional (3D) objects under the heavily scattering medium of dense fog in the conventional integral imaging system through the combined use of the intermediate view reconstruction (IVR), multipixel extraction (MPE), and histogram equalization (HE) methods. In the proposed system, the limited number of elemental images (EIs) picked up from the 3D objects under the dense fog is increased by as many as required by using the IVR technique. The increased number of EIs is transformed into the subimages (SIs) in which the resolution of the transformed SIs has been also improved as much as possible with the MPE method. Subsequently, by using the HE algorithm, the histogram of the resolution-enhanced SIs is uniformly redistributed over the entire range of discrete pixel levels of the image in a way that the subimage contrast can be much enhanced. Then, these equalized SIs are converted back into the newly modified EIs, and consequently a visibility-enhanced 3D object image can be reconstructed. Successful experimental results with the test object confirmed the feasibility of the proposed method.     

Generation of three-dimensional integral images from a holographic pattern of 3-D objects

We present a novel approach for generating three-dimensional (3-D) integral images from a fringe pattern of 3-D objects. A recorded hologram of 3-D objects is segmented into a number of subholograms. Then, different views of 3-D objects are reconstructed from them because each subhologram has its own perspective of 3-D objects in the recording process. These locally reconstructed images can be rearranged as the same subimage array of the conventional integral-imaging system and transformed into virtually picked-up elemental images of 3-D objects. From this newly generated elemental image array, 3-D images could easily be reconstructed by using a white light. Experiments with a 3-D test object have been performed and the results have been presented.     

Mapping road surface features using single-camera images acquired by a mobile mapping system

Mapping road surface features, such as manholes, traffic markings, and cracks, is an essential task for transportation facility management. Although, these features can be rapidly surveyed using the latest mobile mapping techniques, a sophisticated sensor system with a complicated post-processing procedure is usually required. In this study, an efficient framework for modeling road surface features is proposed using a single camera system installed on a moving platform. First, the road surface images along a route of interest are acquired and potential objects are identified based on their shapes and recorded spectra in the images. Then, the contour pixels of the identified objects are extracted by the Canny edge detection technique. Finally, the 3D coordinates of the detected features in object space are obtained by integrating the profile-image technique and the instantaneous exterior orientation parameters of the platform. Based on the numerical results from a case study, it has been demonstrated that a fully automatic and reliable extraction of road surface features can be easily achieved by implementing the proposed approach. Consequently, the modeling of road surface features, which essentially contributes to the management of transportation facilities, can be executed in a cost-efficient manner.     

High-precision three-dimensional shape reconstruction via digital refocusing in multi-wavelength digital holography

Three-dimensional (3D) shape reconstructions and metrology measurements are often limited by depth-of-field constraints. Current focus-detection-based techniques are insufficient to profile out-of-focus 3D objects with high axial accuracy. Extended-focus imaging (EFI) techniques can improve the range and precision of such measurements. By incorporating digital refocusing with multiwavelength interferometry, a holographic imaging solution is presented in this paper to accurately measure 3D objects over a large depth range. Accuracy and repeatability of the proposed EFI technique are validated by digital simulations and refocusing experiments. A reconstruction example demonstrates the feasibility of high-precision 3D measurements of objects deeper than the system's classical depth of field.     

Three-dimensional range data compression using computer graphics rendering pipeline

This paper presents the idea of naturally encoding three-dimensional (3D) range data into regular two-dimensional (2D) images utilizing computer graphics rendering pipeline. The computer graphics pipeline provides a means to sample 3D geometry data into regular 2D images, and also to retrieve the depth information for each sampled pixel. The depth information for each pixel is further encoded into red, green, and blue color channels of regular 2D images. The 2D images can further be compressed with existing 2D image compression techniques. By this novel means, 3D geometry data obtained by 3D range scanners can be instantaneously compressed into 2D images, providing a novel way of storing 3D range data into its 2D counterparts. We will present experimental results to verify the performance of this proposed technique.     

Improvement of color reproduction in color digital holography by using spectral estimation technique

We propose a color digital holography by using spectral estimation technique to improve the color reproduction of objects. In conventional color digital holography, there is insufficient spectral information in holograms, and the color of the reconstructed images depend on only reflectances at three discrete wavelengths used in the recording of holograms. Therefore the color-composite image of the three reconstructed images is not accurate in color reproduction. However, in our proposed method, the spectral estimation technique was applied, which has been reported in multispectral imaging. According to the spectral estimation technique, the continuous spectrum of object can be estimated and the color reproduction is improved. The effectiveness of the proposed method was confirmed by a numerical simulation and an experiment, and, in the results, the average color differences are decreased from 35.81 to 7.88 and from 43.60 to 25.28, respectively.