An online triple-frequency color-encoded fringe projection profilometry for discontinuous object

Abstract

An online triple-frequency color-encoded fringe projection profilometry is proposed to measure the complex and discontinuous object at straight-line movement. N frames of color fringe patterns are specially designed. Three grayscale sinusoidal grating patterns with geometric progression frequency growth are encoded into red (R), green (G), and blue (B) channels separately to compose a color-encoded fringe pattern. If these three grayscale sinusoidal grating patterns are phase-shifted N steps with an equivalent shift phase of 2π/N, they can compose the corresponding N frames of color-encoded fringe patterns as above respectively. In order to avoid the movement’s interference to the phase shifting, position adjustment should be done to guarantee the phase-shifting direction to be perpendicular to the moving direction. While these N frames of specially designed color-encoded fringe patterns are projected onto the moving object one by one, the corresponding deformed color patterns are captured by a CCD camera in real time. By color separating, color crosstalk compensation, pixel matching, and phase calculation, three wrapped phase at different frequencies can be extracted. The unwrapped phase can be solved by a simplified algorithm based on temporal phase unwrapping method from the relationship of the three wrapped phase at the same pixel. Thus, it is very suitable to measure the online complex and discontinuous objects at straight-line movement. The experimental results show the feasibility and the validity of the proposed method.     

Real-time tricolor phase measuring profilometry based on CCD sensitivity calibration

A real-time tricolor phase measuring profilometry (RTPMP) based on charge coupled device (CCD) sensitivity calibration is proposed. Only one colour fringe pattern whose red (R), green (G) and blue (B) components are, respectively, coded as three sinusoidal phase-shifting gratings with an equivalent shifting phase of 2π/3 is needed and sent to an appointed flash memory on a specialized digital light projector (SDLP). A specialized time-division multiplexing timing sequence actively controls the SDLP to project the fringe patterns in R, G and B channels sequentially onto the measured object in one over seventy-two of a second and meanwhile actively controls a high frame rate monochrome CCD camera to capture the corresponding deformed patterns synchronously with the SDLP. So the sufficient information for reconstructing the three-dimensional (3D) shape in one over twenty-four of a second is obtained. Due to the different spectral sensitivity of the CCD camera to RGB lights, the captured deformed patterns from R, G and B channels cannot share the same peak and valley, which will lead to lower accuracy or even failing to reconstruct the 3D shape. So a deformed pattern amending method based on CCD sensitivity calibration is developed to guarantee the accurate 3D reconstruction. The experimental results verify the feasibility of the proposed RTPMP method. The proposed RTPMP method can obtain the 3D shape at over the video frame rate of 24 frames per second, avoid the colour crosstalk completely and be effective for measuring real-time changing object.     

Blind color isolation for color-channel-based fringe pattern profilometry using digital projection

We present an algorithm for estimating the color demixing matrix based on the color fringe patterns captured from the reference plane or the surface of the object. The advantage of this algorithm is that it is a blind approach to calculating the demixing matrix in the sense that no extra images are required for color calibration before performing profile measurement. Simulation and experimental results convince us that the proposed algorithm can significantly reduce the influence of the color cross talk and at the same time improve the measurement accuracy of the color-channel-based phase-shifting profilometry.     

面向视觉测量的像素当量标定方法

像素当量是视觉测量系统中的重要参数,对最终测量精度有决定性的影响.设计了一种具有抗噪性且制作便捷的像素当量标定物.考虑标定面与测量面之间存在高度差问题,对高度差引起的误差进行了分析.引入亚像素技术,提出了一种基于形状匹配的像素当量标定方法.通过实验综合分析了物距、光照强度、标定物姿态单因素变化或耦合变化对像素当量标定结果的影响.结果表明,提出的基于形状匹配的像素当量标定方法具有良好的鲁棒性、实用性.     

基于改进测量系统的非定步距相位轮廓测量技术研究

提出一种基于改进测量系统,该系统放宽了传统测量光路的3个约束,降低对系统结构的要求;同时结合非定步距轮廓测量技术,与传统相位轮廓测量技术相比较,无需保证等步距相移量,且仅需两幅畸变光栅图像就可以重建物体的三维轮廓。通过理论分析,推导出高度与相位之间的非线性映射函数关系式。实验证明,在满足一定精度要求的同时,该系统对结构条件要求较低,测量速度较快,具有较强的可操作性。     

Red-green-blue interferometer for the metrology of discontinuous structures

Discontinuous surface profiles, e.g., diffractive optical elements (DOEs), are commonly measured by white-light interferometry. White-light interferometry needs significantly more memory capacity and computer time than does phase-shifting interferometry; there are approximately ten times more frames to be taken to gather the required information about the object under test. But usually the grooves of the DOEs are too deep for single-wavelength phase-shifting interferometry. Here we show how phase-shifting techniques can be applied to DOEs. For this purpose three interference patterns are recorded simultaneously by a three-chip color CCD camera at three wavelengths (Red-green-blue). It is possible to calculate separately the optical path difference at each pixel from the three phase patterns modulo 2pi. The algorithms used and experimental results are presented.     

一种改进的基于条纹对比度的三维测量方法

基于条纹对比度的三维测量方法由于具有垂直测量的特点,可用于测量表面有突变的复杂物体的三维信息.本文在现有方法的基础上,提出了一种改进的基于条纹对比度的三维测量方法.该方法利用投影仪将一组相移的正弦条纹依次投射在被测物体上,并使被测物体位于投影仪成像面的前方,CCD相机通过一个半透半反镜从投影方向获取物体表面的条纹图像,...     

Three-dimensional profilometry based on shift estimation of projected fringe patterns

This paper presents a new approach to fringe pattern profilometry. In this paper, a generalized model describing the relationship between the projected fringe pattern and the deformed fringe pattern is derived, in which the projected fringe pattern can be arbitrary rather than being limited to being sinusoidal, as are those for the conventional approaches. Based on this model, what is believed to be a new approach is proposed to reconstruct the three-dimensional object surface by estimating the shift between the projected and deformed fringe patterns. Additionally, theoretical analysis, computer simulation, and experimental results are presented, which show how the proposed approach can significantly improve the measurement accuracy, especially when the fringe patterns are distorted by unknown factors.     

Three-dimensional profilometry based on coded linear-structure light with isosceles triangle teeth

A method of linearly coded profilometry is proposed. It uses linear-structure light with isosceles triangle teeth to code the object being measured and a phase-shifting technique to decode the profile. For reducing the effect of noise more than three equally spaced samples are used, and, according to the least-squares method, the general formulas of the decoded phase are given. The experimental results of a model of a head are shown.     

A fast 3D shape measurement method based on sinusoidal and triangular fringe projection

Existing methods to measure 3D shape of complex object involve processing more than six captured images to obtain the absolute phase, which limit the measurement speed. This paper presents two sinusoidal fringes and two triangular wave fringes which is used to measure 3D shape of complex object. The two-step phase-shifting sinusoidal fringes and two-step phase-shifting triangular wave fringes are calculated to obtain the wrapped phase, and then the two-step phase-shifting triangular wave fringes are used to determine the fringe order. Due to decrease the number of projection fringes, the speed of measurement increases. The triangular wave fringe carries more information of the object than linear increasing/decreasing ramp fringe in the actual measurement, more noise in the base phase to be overcome, thus improving the measurement accuracy. The benefits can be widely applied in high-speed, real-time 3D measurement of complex shape. Experimental results have demonstrated that the proposed method is simple, but effective.     

Design of adaptive digital filters for phase extraction in complex fringe patterns obtained using the Ronchi test

A powerful technique is presented for processing complex fringe patterns with high noise levels and arbitrary distributions of spatial frequencies, which can successfully extract the phase information. Artifacts that arise from phase extraction in local filtering approaches are avoided by using a simple design and implementation strategy for the adaptive filter, based on the theory of digital filter design used in electronics, and applied to pixel rows (or columns) in the fringe-pattern. The filter designed in this manner is then applied to phase extraction in an experimental fringe pattern measured in a digital Ronchi test setup using a Carré phase-shifting procedure. The filtering strategy has a very low computational cost and allows phase extraction in noisy ronchigrams regardless their spatial frequency distribution, provided the fringes are still visible.     

Microscopic phase-shifting profilometry based on digital micromirror device technology

A microscopic three-dimensional (3-D) shape measurement system based on digital fringe projection has been developed and experimentally investigated. A Digital Micromirror Device along with its illumination optics is integrated into a stereomicroscope, which projects computer-generated fringe patterns with a sinusoidal intensity profile through the microscope objective onto the object surface being measured. The fringe patterns deformed by the object surface are recorded by a CCD camera. The microscopic 3-D shape of the object surface is measured and reconstructed by use of a phase-shifting technique. We discuss design considerations and error analysis of the system. Experimental results successfully demonstrate the capability of this technique for surface profile measurement of rough surfaces at the micrometer level.     

基于二次曲面拟合的亚象素图象匹配算法

在图象测量系统中，目标的精确定位是一个关键问题，也是应用其它图像处理技术的基础。传统的图象匹配算法只能在象素极定位，本文基于相关函数的二次曲面拟合提出了一种亚象素精度的匹配算法，它对于无噪声图象匹配的绝对误差小于０．０１象素。模拟实验表明，在有噪声的情况下该算法仍具有较小的偏差。     

Profile measurement taken with liquid-crystal gratings

Profile measurement taken with liquid-crystal gratings and a phase-shifting technique is proposed, and its effectiveness is verified by experiment. The surface profile is obtained by measurement of the phase distributions of the sinusoidal gratings deformed by an object's surface. The liquid-crystal grating gives an accurate phase shift, an arbitrary projection pitch, and a constant surface brightness compared with conventional gratings such as a laser interference fringe grating and a Ronchi grating. Therefore a flexible measuring system may be developed with it. Two gratings with different pitches are used to measure an object with large steps. A two-color projection system can be used to produce such gratings simultaneously. Locally varying reflectivity on a surface can also be compensated by adjustment of the color component of the projected grating with a liquid-crystal grating. Thus the contrast in the projected grating can be made uniform, and a good profile measurement can be accomplished.     

采用图像融合技术的多模式人脸识别

利用图像融合技术实现了基于可见光图像和红外热图像相结合的多模式人脸识别,研究了两种图像在像素级和特征级的融合方法.在像素级,提出了基于小波分解的图像融合方法,实现了两种图像的有效融合.在特征级,采用分别提取两种识别方法中具有较好分类效果的前50%的特征进行特征级的融合.实验表明,经像素级和特征级融合后,识别准确率都较单一图像有很大程度的提高,并且特征级的融合效果明显优于像素级的融合.因此,基于图像融合技术的多模式人脸识别,有效的增加了图像的信息量,是提高人脸识别准确率的有效途径之一.     

Recovery of absolute phases for the fringe patterns of three selected wavelengths with improved anti-error capability

Abstract

In a recent published work, we proposed a technique to recover the absolute phase maps of fringe patterns with two selected fringe wavelengths. To achieve higher anti-error capability, the proposed method requires employing the fringe patterns with longer wavelengths; however, longer wavelength may lead to the degradation of the signal-to-noise ratio (SNR) in the surface measurement. In this paper, we propose a new approach to unwrap the phase maps from their wrapped versions based on the use of fringes with three different wavelengths which is characterized by improved anti-error capability and SNR. Therefore, while the previous method works on the two-phase maps obtained from six-step phase-shifting profilometry (PSP) (thus 12 fringe patterns are needed), the proposed technique performs very well on three-phase maps from three steps PSP, requiring only nine fringe patterns and hence more efficient. Moreover, the advantages of the two-wavelength method in simple implementation and flexibility in the use of fringe patterns are also reserved. Theoretical analysis and experiment results are presented to confirm the effectiveness of the proposed method.     

Holographic imaging and interferometry with non-Bragg diffraction orders on volume and surface-relief gratings in lithium niobate and photo-thermoplastic materials

The recording of holographic volume and surface-relief gratings in a photorefractive crystal using a photo-thermoplastic (PTP) holographic camera with an image-bearing signal beam leads to the appearance of two Bragg and two or more non-Bragg diffracted beams that show the transformed images in each beam (rotation and angular amplification of images). Using this real-time mode of interferometry, the hologram is retrieved with a deformed object beam, resulting in the appearance of fringes with a proper phase shift in each of four diffracted beams. This one-shot (one-exposure) phase-shifting interferometry results in clarification of the object wave-front information (for example, from surface deformation) and solution of the sign ambiguity problem. This procedure demonstrates that high-resolution holographic imaging of the PTP holographic camera static deformations in the order of ～0.1?mm can be revealed on the diffusion reflection surface. In addition, it was demonstrated that using the PTP materials could achieve holographic recording and imaging through phase aberration, with the image appearing in the non-Bragg diffraction order.     

气流场ESPI载频条纹图的消噪处理与相位提取方法

为拓展ESPI方法在流动可视化测量技术中的应用,对气流场ESPI载频条纹图进行了傅立叶变换、数字全低通滤波,和傅立叶逆变换的处理以消除散斑噪声,并直接将其替换为原散斑相关条纹图,进而成为保留了流场信息的高对比度、低噪声的灰度条纹图,便于提取原散斑图中流动相位信息。根据模拟数据确定了由这两种条纹图互换所引起的空间相移量和相应流场测量中的修正量。提出了用灰度扫描法对互换后的条纹图进行一维灰度扫描,由灰度计算得出气流扰动的一维相位差分布和流场一维温度分布;同时也用FTP法对该图进行了二维相位展开和温度分布计算,亦可对多帧条纹图进行时间轴上的逐点相位提取以计算其他流场参数。结果表明,计算数据与实测符合,方法简单易行,为在气流场参数测量中应用动态ESPI方法提供了一种实用有效的方法。     

Optimized pulse width modulation pattern strategy for three-dimensional profilometry with projector defocusing

Three-dimensional profilometry by sinusoidal fringe projection using phase-shifting algorithms is usually distorted by the nonlinear intensity response of commercial video projectors. To overcome this problem, several methods including sinusoidal pulse width modulation (SPWM) were proposed to generate sinusoidal fringe patterns with binary ones by defocusing the project to some certain extent. However, the residual errors are usually nonnegligible for highly accurate measurement fields, especially when the defocusing level is insufficient. In this work, we propose two novel methods to further improve the defocusing technique. We find that by properly optimizing SPWM patterns according to some criteria, and combining SPWM technique with four-step phase-shifting algorithm, the dominant undesired harmonics will have no impact on the phase obtained. We also propose a new sinusoidal fringe generation technique called tripolar SPWM, which can generate ideal sinusoidal fringe patterns with a very small degree of defocusing. Simulations and experiments are presented to verify the performance of these two proposed techniques.     

Two-step phase-shifting fringe projection profilometry: intensity derivative approach

A new two-step phase-shifting fringe projection profilometry is proposed. The slowly variable background intensity of fringe patterns is removed by the use of an intensity differential algorithm. The high-resolution differential algorithm is achieved based on global interpolation of fringe gray level on a subpixel scale. Compared with the traditional three- or four-step phase-shifting method, the profile measurement is sped up with this approach. Computer simulation and experimental performance are evaluated to demonstrate the validity of the proposed measurement method. The experimental results compared with those of the four-step phase-shifting method are presented.