Performance analysis of different pixel-wise processing methods for depth imaging with single photon detection data

We establish a long-range single photon counting three-dimensional (3D) imaging system based on cage optical structure. Five different pixel-wise processing methods for time-of-flight (TOF) photon counting data are compared with data collected by our 3D imaging system for ranges 40–700?m and a suitable representation model for photon counting data is proposed for pixel-wise processing. Experimental results show that these methods exploit the instrumental response function (IRF), yielding a high-quality 3D image. When the signal photon counts are greater than 13 per pixel, the resulting mean absolute error (MAE) values of the IRF-based methods are better than results from the non-IRF-based methods. Regarding IRF-based methods, the union of subspace (UOS) model-based approach and cross correlation are more suitable than the Markov chain Monte Carlo (MCMC) method in the condition of a small number of return signal photons. These results offer valuable information to promote the implementation of photon counting 3D imaging in real applications.     

Lens-less quantum ghost imaging: New two-photon experiments

New types of lens-less two-photon ghost imaging experiments are described that can also be useful for 3D X-ray imaging. In these experimental setups, a CCD array is placed facing a chaotic light source and gated by a photon counting detector that simply counts all randomly reflected photons from an object. A “ghost” image of the object is then observed from the gated CCD. A ghost image of an object can even be observed when the photon path to the photon counting device is obscured. These interesting demonstrations are not only useful for practical applications, such as X-ray lens-less imaging, but are also important from a fundamental point of view. These demonstrations lead to insight regarding the nonclassical two-photon interference nature of thermal light ghost imaging.     

Photon-counting three-dimensional integral imaging with compression of elemental images

In this paper, we present lossless compression of elemental images in photon-counting integral imaging. In order to verify the performance of the compression method applied to low light level three-dimensional (3D) integral imaging, we compute the correlation coefficient and peak to mean square error (PSNR) as metrics for 3D scene reconstruction integrity. We show quantitatively via experiments that a considerable compression of the elemental images in photon-counting integral imaging may be achievable without significant loss in the performance in terms of correlation and PSNR metrics. To the best of our knowledge, this is the first report on applying lossless compression algorithms in photon-counting 3D computational integral imaging.     

Multidimensional optical sensor and imaging system

We describe a multidimensional optical sensor and imaging system (MOSIS). Using a time-multiplexing, polarimetric, and multispectral imaging system, we are able to reconstruct a fully integrated multidimensional scene. Image fusion is used to integrate the multidimensional images. The fused image contains more information than the single two-dimensional and three-dimensional (3D) images. The multidimensional imaging system utilizes polarimetric imaging, multispectral imaging, 3D integral imaging with time and space multiplexing, and 3D image-fusion techniques to reconstruct the multidimensionally integrated scene. Optical experiments and computer simulations are presented.     

Real-time three-dimensional object recognition with multiple perspectives imaging

A novel system for recognizing three-dimensional (3D) objects by use of multiple perspectives imaging is proposed. A 3D object under incoherent illumination is projected into an array of two-dimensional (2D) elemental images by use of a microlens array. Each elemental 2D image corresponds to a different perspective of the 3D object. Multiple perspectives imaging based on integral photography has been used for 3D display. In this way, the whole set of 2D elemental images records 3D information about the input object. After an optical incoherent-to-coherent conversion, an optical processor is employed to perform the correlation between the input and the reference 3D objects. Use of micro-optics allows us to process the 3D information in real time and with a compact optical system. To the best of our knowledge this 3D processor is the first to apply the principle of integral photography to 3D image recognition. We present experimental results obtained with both a digital and an optical implementation of the system. We also show that the system can recognize a slightly out-of-plane rotated 3D object.     

Depth extraction of three-dimensional objects using block matching for slice images in synthetic aperture integral imaging

We describe a computational method for depth extraction of three-dimensional (3D) objects using block matching for slice images in synthetic aperture integral imaging (SAII). SAII is capable of providing high-resolution 3D slice images for 3D objects because the picked-up elemental images are high-resolution ones. In the proposed method, the high-resolution elemental images are recorded by moving a camera; a computational reconstruction algorithm based on ray backprojection generates a set of 3D slice images from the recorded elemental images. To extract depth information of the 3D objects, we propose a new block-matching algorithm between a reference elemental image and a set of 3D slice images. The property of the slices images is that the focused areas are the right location for an object, whereas the blurred areas are considered to be empty space; thus, this can extract robust and accurate depth information of the 3D objects. To demonstrate our method, we carry out the preliminary experiments of 3D objects; the results indicate that our method is superior to a conventional method in terms of depth-map quality.     

Effect of illumination in an integral imaging system with large depth of focus

We present the characteristics of integral imaging systems with large depth of focus (DOF) by use of two kinds of illumination: plane illumination and diffusing illumination. For each system, we perform ray analysis based on ray optics. To check the visual quality through optical experiments, we use an average image of observed images picked up at various positions within a large DOF. The synthesized elemental images for a three-dimensional (3-D) object with two character patterns were displayed in an optical system and its reconstruction experiments are performed. Experimental results show that use of diffusing illumination can improve visual quality of reconstruction 3-D images in depth-priority integral imaging.     

Lateral Migration Radiography

Lateral migration radiography (LMR) is a new form of Compton backscatter imaging (CBI) that utilizes both multiple-scatter and single-scatter photons. The LMR imaging modality uses two pairs of detectors. Each set has a detector that is uncollimated to predominantly image single-scatter photons and the other collimated to image predominantly multiple-scattered photons. This allows generation of two separate images, one containing primarily surface features and the other containing primarily subsurface features. These two images make LMR useful for imaging and identifying objects to a depth of several X-ray photon mean free paths even in the presence of unknown surface clutter or surface imperfections. The principles of LMR are demonstrated through Monte Carlo simulation of the photon transport. The Monte Carlo simulation results are verified with experimental measurements from an LMR system used for landmine detection. The presented research demonstrates the methodology for designing an LMR system, identifies methods for restoring and enhancing LMR images, and lays the foundation for the development of other applications of LMR, including, for example, the nondestructive examination of welds, castings, and composites.     

Enhanced three-dimensional integral imaging system by use of double display devices

We propose an enhanced three-dimensional (3D) integral imaging system using multiple display devices. Experimental results with double devices prove the improvement in the image depth for a given image quality. We present experiments on an enhanced 3D integral imaging system using double display devices, in which two 3D subimages that cover different depth ranges are separately generated in each device, and then they are combined with a beam splitter to reconstruct the whole 3D image with an enhanced depth of view. In a similar manner, the double-device system can also be used to obtain a wider viewing angle by combining two images with different viewing angle ranges. We discuss the possibility of 3D integral imaging systems using multiple display devices as extensions of the system with double display devices.     

Theoretical analysis for three-dimensional integral imaging systems with double devices

By adoption of double-device systems, integral imaging can be enhanced in image depth, viewing angle, or image size. Theoretical analyses are done for the double-image-plane integral imaging systems. Both ray optics analysis and wave optics analysis confirm that the double-device integral imaging systems can pick up and display images at two separate image planes. The analysis results are also valuable in the understanding of the conventional integral imaging systems for image positions off the central depth plane.     

Lateral Migration Radiography

Abstract

Lateral migration radiography (LMR) is a new form of Compton backscatter imaging (CBI) that utilizes both multiple-scatter and single-scatter photons. The LMR imaging modality uses two pairs of detectors. Each set has a detector that is uncollimated to predominantly image single-scatter photons and the other collimated to image predominantly multiple-scattered photons. This allows generation of two separate images, one containing primarily surface features and the other containing primarily subsurface features. These two images make LMR useful for imaging and identifying objects to a depth of several X-ray photon mean free paths even in the presence of unknown surface clutter or surface imperfections.

The principles of LMR are demonstrated through Monte Carlo simulation of the photon transport. The Monte Carlo simulation results are verified with experimental measurements from an LMR system used for landmine detection. The presented research demonstrates the methodology for designing an LMR system, identifies methods for restoring and enhancing LMR images, and lays the foundation for the development of other applications of LMR, including, for example, the nondestructive examination of welds, castings, and composites.     

Three-dimensional measurement and imaging based on multicameras randomly distributed on the circumference

We present a three-dimensional (3D) measurement and imaging based on a multicamera system. In the presented system, projected images of 3D objects are taken by cameras located at random positions on a circumference, and then the 3D objects can be reconstructed numerically. We introduce an angle correction function to improve the quality of the reconstructed object. The angle correction function can correct the angle error caused by the position errors in the projected images due to the finite pixel size of the image sensor. The numerical results show that the point source was reconstructed successfully by introducing the angle correction function. We also demonstrate experiments: the two objects are located on a rotary stage controlled by a computer, the projected images are taken by a single camera, and by using 33 projected images, the two objects are reconstructed successfully.     

Application of Different X-ray Techniques to Improve In-Service Carbon Fiber Reinforced Rope Inspection

Carbon fiber reinforced polymer ropes are gaining in significance in the fields of civil engineering and hoisting applications. Thus, methods of non-destructive testing (NDT) need to be developed and evaluated with respect to new challenges and types of defects. Particularly important is the development of in-service testing solutions which allow the integration in global online monitoring systems. Conventional methods like electrical resistivity or strain measurements using optical fibers are already in use. This study investigates the possibility of using various X-ray techniques to increase the reliability and significance of NDT and their applicability to in-service testing. Conventional film radiography is the most common technique; however, even after image enhancement of the digitized film, this technique lacks contrast sensitivity and dynamic range compared to digital detector array (DDA) radiography. The DDA radiography is a highly sensitive method; yet, the limitation is that it delivers 2D images of 3D objects. By the use of co-planar translational laminography the detectability of planar defects is superior to 2D methods due to multiple projection angles. Apart from this, it can be used on-site due to a rather simple setup and robust equipment. In this work two photon counting detectors (PCD) with different sensor materials (Si and CdTe) were used. The results show that the resolution and defect recognition is lower in case of DDA radiography and laminography using PCDs compared to high-resolution computed tomography. However, the DDA radiography and laminography are sensitive enough to both fiber breakage and delaminations and can be significantly advantageous in terms of measurement time and adaptability for on-site monitoring.     

Least-squares estimation of imaging parameters for an ultrasonic array using known geometric image features

Ultrasonic array images are adversely affected by errors in the assumed or measured imaging parameters. For non-destructive testing and evaluation, this can result in reduced defect detection and characterization performance. In this paper, an autofocus algorithm is presented for estimating and correcting imaging parameter errors using the collected echo data and a priori knowledge of the image geometry. Focusing is achieved by isolating a known geometric feature in the collected data and then performing a weighted leastsquares minimization of the errors between the data and a feature model, with respect to the unknown parameters. The autofocus algorithm is described for the estimation of element positions in a flexible array coupled to a specimen with an unknown surface profile. Experimental results are shown using a prototype flexible array and it is demonstrated that (for an isolated feature and a well-prescribed feature model) the algorithm is capable of generating autofocused images that are comparable in quality to benchmark images generated using accurately known imaging parameters.     

Three-dimensional imaging by partially coherent light under nonparaxial condition

In this paper, we present the theory of three-dimensional (3D) imaging using partially coherent light under the nonparaxial condition. Using the linear system approach, we derive the image intensity in terms of the 3D nonparaxial transmission cross coefficient (TCC) and the transmission function defined in this paper. We present that the 3D TCC can be calculated by multiple applications of the 3D fast Fourier transform instead of the six-dimensional integral in the original formula. Using the simplified formula, we simulate phase contrast and Nomarski differential interference contrast (DIC) imaging of a transparent 3D object. Within our knowledge, the 3D model for the DIC based on the 3D nonparaxial TCC is the most rigorous approach that has been suggested. It demonstrates clearly the optical sectioning effect of DIC.     

用于室外道路环境综合理解的多种新型视觉传感技术和系统

针对室外智能移动机器人自主导航的要求，提出了基于多种新型视觉传感技术的室外道路环境综合理解方法，其基本原理是综合利用机器人四周360°景物的环视图象信息、机器人前方道路的双目注视图象信息以及机器人运行过程中形成的时空全景图象信息，综合完成实时机器人行驶方向确定、实时路面障碍物检测和机器人全局定位等视觉任务。     

Depth extraction of three-dimensional objects in space by the computational integral imaging reconstruction technique

A novel approach to extract the depth data of 3D objects in space by using the computational integral imaging reconstruction (CIIR) technique is proposed. With elemental images of 3D objects captured by the CCD camera through a pinhole array, depth-dependent object images can be reconstructed on the output plane by the CIIR technique. Only the images reconstructed on the output planes where 3D objects were located are clearly focused; so the depth data of 3D objects in space can be extracted by discriminating these focused output images from the others by using an image separation technique. A feasibility test of the proposed CIIR-based depth extraction method is carried out, and its results are discussed as well.     

Curved computational integral imaging reconstruction technique for resolution-enhanced display of three-dimensional object images

A novel curved computational integral imaging reconstruction (C-CIIR) technique for the virtually curved integral imaging (VCII) system is proposed, and its performances are analyzed. In the C-CIIR model, an additional virtual large-aperture lens is included to provide a multidirectional curving effect in the reconstruction process, and its effect is analyzed in detail by using the ABCD matrix. With this method, resolution-enhanced 3D object images can be computationally reconstructed from the picked-up elemental images of the VCII system. To confirm the feasibility of the proposed model, some experiments are carried out. Experiments revealed that the sampling rate in the VCII system could be kept at a maximum value within some range of the distance z, whereas in the conventional integral imaging system it linearly decreased as the distance z increased. It is also shown that resolutions of the object images reconstructed by the C-CIIR method have been significantly improved compared with those of the conventional CIIR method.     

科学级CCD相机在星敏感器中的设计与应用

星敏感器通过探测天球上不同位置的恒星来确定航天器的姿态。星相机是星敏感器的成像系统。虽然近年来CMOS成像技术快速发展,但在科学级成像领域,特别是星敏感器应用中,CCD技术较成熟。本文的研究目的是研究一种探测能力强、数据更新快的用于星敏感器的成像系统。文中主要研究了基于TH7888A科学级CCD传感器的星相机的设计和应用,说明了CCD工作原理,详细分析了该种CCD传感器的星等探测灵敏度,论述了CCD星相机的设计方案。并用成像实验、动态范围测试、星等探测能力实验等实验验证了所设计的相机的性能。设计的星相机可以用给定的小型光学系统在60 ms以内的积分时间探测6等星,相机可达到10帧/秒的图像数据更新频率,满足短积分时间进行快速星光成像的要求。     

Interactive volume rendering of real-time three-dimensional ultrasound images

Real-time, three-dimensional (RT3D) ultrasound allows video frame rate volumetric imaging. The ability to acquire full three-dimensional (3-D) image data in real-time is particularly helpful for applications such as cardiac imaging, which require visualization of complex and dynamic 3-D anatomy. Volume rendering provides a method for intuitive graphical display of the 3-D image data, but capturing the RT3D echo data and performing the necessary processing to generate a volumetric image in real time poses a significant technical challenge. We present a data capture and rendering implementation that uses off-the-shelf components to real-time volume render RT3D ultrasound images. Our approach allowed live, interactive volume rendering of RT3D ultrasound scans.