Quality evaluation metric for greyscale error diffusion halftone images based on texture and visual characteristics

Halftone images produced by error diffusion algorithms suffer from texture structures that decrease their visual qualities, such as worm-like and stripe-like defects. An effective quality evaluation metric is needed to evaluate various error diffusion halftoning algorithms and their corresponding halftone images. A texture distortion evaluation metric (TDEM) is proposed to measure the texture distortions within the referenced halftoned greyscale images. First, the weights of different tonal regions were assigned based on the two types of visual objects available and the locations of the texture structures. Then, based on image structure correlations and human visual characteristics, a block operation was performed and TDEM values were obtained by summing the local block-weighted variances based on image information. The proposed metric was validated using objective comparison and psycho-visual experiments. Results indicate that the metric can measure texture distortions effectively, and that the results are consistent with subjective visual perception.     

Feature‐assisted stereo correlation

Stereo correlation in digital image correlation (DIC) involves an optimisation problem that is sensitive to initial guess. In practice, this problem is circumvented by manually selecting a pair of points in the two stereo images that guarantees convergence and provides stereo mapping parameter estimates that are used as initial guesses at neighbouring subsets. However, such an approach is not always feasible, especially in the presence of substantial perspective distortions, for example, due to large stereo angles or complexities in specimen geometry. Therefore, it is desirable to provide high‐quality independent initial estimates over the entire region of interest. Recently, SIFT has been used for this purpose, but it fails when perspective distortions are severe. In this work, we investigate seven other feature‐based matching techniques to address this gap. Among these, DeepFlow algorithm provides the highest quality and most spatially uniform initial estimates. Further, we use DeepFlow estimates as initial guesses in a conventional stereo optimisation to compute geometry measures of a specimen in DIC challenge dataset. These geometry measures show excellent agreement with ground truth, further supporting the choice of DeepFlow in stereo correlation.     

基于2D-3D双目运动估计的立体视觉定位算法

运动估计算法是影响立体视觉定位精度的重要因素,传统的3D-3D运动估计算法受噪声影响很大,计算精度不高.本文提出了一种基于2D-3D双目运动估计的立体视觉定位算法.算法不使用运动后的特征点3D坐标,而直接利用其2D图像投影坐标.首先,利用EPnP运动估计算法确定匹配内点和初始运动参数.接着,利用双目相机之间的2D投影几...     

基于FFST和Hessenberg分解的立体图像零水印算法

目的 为提高立体图像零水印方案抗几何攻击性能,提出一种基于快速有限剪切波变换（FFST）和Hessenberg分解的立体图像零水印算法。方法 首先分别对原始立体图像在YCbCr颜色空间下的左右视点亮度分量进行FFST,然后在得到的2个低频子带中,基于随机子块选择策略和Hessenberg联合分解来构造鲁棒特征矩阵,最后与预处理后的二值水印执行异或运算生成认证零水印。此外,零水印检测前先采用傅里叶-梅林变换方法对待认证的立体图像进行几何校正。结果 与相关算法相比,文中算法对常见非几何和几何攻击提取水印的平均NC值为0.984 1,表现出更优的抗攻击性能。结论 所提算法具有无损性和较强的安全性,可为立体图像版权保护提供可行的解决方案。     

Integrated visual quality assessment for ZiYuan-3 optical satellite panchromatic products

In practical data production process of ZiYuan-3 (ZY-3) optical satellite, the quality of massive panchromatic (PAN) products is usually measured with multiple quality metrics. Although the existing metrics have been widely used in practice and obtained good performance, they have some limitations: (1) there are so many quality metrics that makes it difficult for users or operators to directly judge whether the imagery is acceptable or not; and (2) a specific quality metric can only measure a certain aspect of image quality and is often not designed from the perspective of human visual system (HVS), leading the objective evaluation result inconsistent with subjective one. To tackle the aforementioned problems, we propose an integrated visual quality assessment (VQA) method to predict comprehensive quality scores for ZY-3 sensor calibration (SC) PAN products. In the proposed method: (1) we exploited eight quality elements that have significant influences on the visual quality of SC PAN products; (2) we constructed a database composed of 360 ZY-3 SC PAN images and the corresponding subjective mean opinion scores (MOS); (3) we introduced generalised regression neural network to combine the extracted quality elements of the images and their MOS and obtained the integrated VQA result. Experimental results on the database showed that the proposed method achieved high accuracy of predicted quality scores and well consistency with HVS, indicating the effectiveness and reliability of the presented approach.     

Bond line thickness and die tilt inspection in die bonding process

This study focuses upon building an automated inspection system for the in-line measurement of bond-line thickness (BLT) and die tilt in die attachments in the semiconductor packaging process. A prototype of a visual system utilizing the line scan stereo vision technique via two linear CCD cameras has been developed for the die bonding quality inspection. A novel algorithm is proposed for the determination of the 3D coordinates of certain points on an object. The BLT and die tilt of a die attached chip of substrate height 800 μm and cross section 15 × 15 mm² were measured to be approximately 76.8 μm and 0.00094, respectively. The measurement can be completed within one second. Thus the in-line inspection of die bonding quality can be conducted efficiently using the proposed technique.     

基于最优色空间和视觉掩蔽的彩色图像评价算法

目的针对当前色差算法在评价彩色图像时未考虑图像中像素之间颜色在视觉上的空间效应,提出基于最优色空间和视觉掩蔽效应的彩色图像质量评价算法。方法通过分析色空间通道间的相关性,选取最优正交、对立空间作为评价的工作色空间,在此基础上,利用色空间各颜色通道的掩蔽函数,去除图像颜色与颜色之间在视觉上的空间关联性,最后构建图像颜色差别公式,以评价彩色图像质量。结果在验证实验中,通过利用Pearson相关系数、Spearman等级相关系数以及Kendall等级相关系数,分析各算法评价与图像主观评价之间的关系发现,该算法评价与主观评价的Pearson相关系数、Spearman等级相关系数和Kendall等级相关系数分别可达到0.3948,0.5840和0.4814,且分别大于现有其他色差算法评价与主观评价的相关系数。结论该算法评价结果与人眼视觉主观评价相对一致。     

Medical image fusion based on laws of texture energy measures in stationary wavelet transform domain

Medical image fusion is widely used in various clinical procedures for the precise diagnosis of a disease. Image fusion procedures are used to assist real-time image-guided surgery. These procedures demand more accuracy and less computational complexity in modern diagnostics. Through the present work, we proposed a novel image fusion method based on stationary wavelet transform (SWT) and texture energy measures (TEMs) to address poor contrast and high-computational complexity issues of fusion outcomes. SWT extracts approximate and detail information of source images. TEMs have the capability to capture various features of the image. These are considered for fusion of approximate information. In addition, the morphological operations are used to refine the fusion process. Datasets consisting of images of seven patients suffering from neurological disorders are used in this study. Quantitative comparison of fusion results with visual information fidelity-based image fusion quality metric, ratio of spatial frequency error, edge information-based image fusion quality metric, and structural similarity index-based image fusion quality metrics proved the superiority. Also, the proposed method is superior in terms of average execution time to state-of-the-art image fusion methods. The proposed work can be extended for fusion of other imaging modalities like fusion of functional image with an anatomical image. Suitability of the fused images by the proposed method for image analysis tasks needs to be studied.     

立体电视技术的发展趋势

立体电视可以使电视画面再现立体视觉的真实效果，不仅可以用于现代的信息交流和文化活动，而且也可用于科学技术研究，工业设计、建设和生产以及医学和军事事业等等，显著提高其工作效率，因此已成为新的电视技术的发展方向和研究重点。本文阐述了近几年来国内外在这一方面的研究进展，包括常说的立体电视STV及全息电视HTV，和立本视觉及立体电视的基本原理。     

Research on the application of single camera stereo vision sensor in three-dimensional point measurement

A single camera stereo vision sensor model based on planar mirror imaging is proposed for measuring a three-dimensional point. The model consists of a CCD camera and a planar mirror. Using planar mirror reflections of a scene, a picture with parallax is obtained by shooting the target object and its virtual image. This is equivalent to shooting the target object from different angles with the camera and the virtual camera in the planar mirror, so it has the function of binocular stereo vision. In addition, the measurement theory of the three-dimensional point is discussed. The mathematical model of a single camera stereo vision sensor is established, the intrinsic and extrinsic parameters are calibrated, and the corresponding experiment has been done. The experimental results show that the measuring method is convenient and effective; it also has the advantages of simple structure, convenient adjustment, and is especially suitable for short-distance measurement with high precision.     

采用模糊判别的自适应多窗口立体匹配

考虑到立体匹配过程中存在的不确定性和模糊性,将已经获得广泛应用的模糊理论引入立体匹配领域,使用与人类感知相似的模糊逻辑为基础的HVS彩色图像点颜色相似性测度,然后把这种模糊颜色相似性测度应用到区域匹配方法的多窗口选择和自适应窗口尺寸缩减当中,最后用SSD方法实现了彩色图像的立体匹配.实验结果表明,该方法具有更高的匹配精确性.     

Characteristics of stereo images from detectors in focal plane array

The equivalent ray geometry of two horizontally aligned detectors at the focal plane of the main antenna in a millimeter wave imaging system is analyzed to reveal the reason why the images from the detectors are fused as an image with a depth sense. Scanning the main antenna in both horizontal and vertical directions makes each detector perform as a camera, and the two detectors can work like a stereo camera in the millimeter wave range. However, the stereo camera geometry is different from that of the stereo camera used in the visual spectral range because the detectors' viewing directions are diverging to each other and they are a certain distance apart. The depth sense is mainly induced by the distance between detectors. The images obtained from the detectors in the millimeter imaging system are perceived with a good depth sense. The disparities responsible for the depth sense are identified in the images.     

Improved depth map through optimal axis stereo

Feature-based stereo correspondence techniques suffer from the major limitation that it is difficult to match along epipolar lines and this often results in a sparse set of depth points. Past researchers attempted to solve this problem through trinocular stereo. In this paper, a new method has been proposed for reducing the sparsity of depth points by orienting the epipolar line of the cameras in a direction that maximizes the number of feature points. The corresponding epipolar axis has been termed as the optimal axis. Our analytical as well as simulation results have established that for a limited edge scenario, the proposed approach can lead to considerable improvement in the number of feature points that can be matched. We have introduced a figure-of-merit for the optimal axis and discussed how it is qualitatively related to the variance of the probability density function (pdf). We have also presented the results of our simulation experiment, termed as the random stick experiment. Finally, we have also shown the results of improved reconstructed surface of a synthetic image using optimal axis alignment.     

基于图像的曲面光顺算法

针对目前曲面光顺算法存在的问题,提出了一种由平滑曲面在平行光照射下图像达到光顺的思想而形成的曲面光顺算法。该算法直接平滑曲面在平行光照射下的图像,然后通过光度立体技术反求出光顺后的曲面。由于能直接平滑曲面在平行光照射下的图像,使得光顺后的曲面在基于光照模型的曲面光顺准则下具有很的好光顺性质。应用实例显示,该算法能在保持原曲面形态的基础上达到很好的光顺效果。     

基于感兴趣区域的图像质量评价算法研究

目的降低计算量,提高计算效率,达到评价算法与人眼观察的一致性。方法首先提取感兴趣区域,利用眼动仪记录人眼在观察图像时的关注点、关注时长、眼球运动轨迹以及眼跳数据,然后提取显著区域。将感兴趣区域引入客观视觉模型中评价图像质量,通过测量图像的有效感知跃变百分数,客观评价图像质量的优劣,并且与传统算法进行比较。结果感兴趣区域包含了图像大部分的关键信息,即人眼关注的信息。基于不同增强方法的图像感兴趣区域内的有效感知跃变百分数均大于原始图像的有效感知跃变百分数(20.3%)。结论提出的算法优于传统客观评价算法,且客观质量评价的结果更符合人眼视觉特性。     

虚拟立体视觉自由飞行昆虫运动参数测量系统

本文提出了用于测量自由飞行昆虫运动参数的立体视觉测量系统,实现了高扇翅频昆虫双侧翅膀运动参数的测量.文章在分析虚拟四目立体视觉测量原理的基础上搭建了虚拟四目立体视觉测量系统,并设计了自由飞行昆虫的引导装置,最后利用该测量系统和引导装置实现了自由飞行昆虫双侧翅膀运动参数的测量.实验结果表明该系统不仅降低了系统成本而且减少了多摄像机同步驱动的复杂性,对研究自由飞行状态昆虫运动机理具有重要意义.     

焊缝射线立体视觉检测中图像匹配的特征提取算法研究

目的　研究焊缝射线立体视觉检测中图像匹配的特征提取方法 .方法　依据焊缝射线图像的特点 ,提出了几种特征提取方法 .结果　采用这些方法快速地提取出了图像的边缘特征点 .结论　找到了对于焊缝射线像立体匹配边缘特征提取效果较好的方法     

基于四元数奇异值分解的数字印刷质量评价

目的针对人眼视觉感受与印刷质量评价结果存在不一致的缺陷,提出全四元数及奇异值分解的数字印刷质量评价方法。方法首先,依据图像颜色空间属性,采用四元数作为印刷图像表示模型,其中四元数矩阵实部为图像亮度方差,虚部为红、绿、蓝颜色,建立印刷图像全四元数表示模型。然后,对四元数图像模型进行四元数奇异值分解,得到图像四元数特征向量。最后,印刷图像质量评价指标以图像奇异值特征向量线性相关程度进行衡量。结果印刷图像四元数模型可完整地表示数字印刷图像,有效地凸显人眼视觉敏感结构信息,在印刷质量评价中实现了图像信息并行处理。结论印刷图像四元数模型提高和改善了彩色印刷图像质量准确性,与人眼视觉特性一致性较好。     

Efficient disparity estimation from stereo images using hybrid-guided image filter

Stereo vision process involves capturing the pictures from a camera of the same scene from at least two different locations and calculating the three-dimensional information. Conventionally, these two versions of snapshots are called left and right views which yield the depth information of an object upon relative comparison of its location in two views. Although the stereo image and its applications are becoming increasingly prevalent, there has been very limited research on disparity estimation from stereo images. Most of the existing techniques suffer from the gradient reversal artefacts issue. Therefore, to handle this issue, we have proposed a hybrid-guided image filter for improving the disparity estimation from stereo images. The hybrid filter utilizes the features of guided image filter and Bayesian non-local means with edge aware constraint. Maximum likelihood and local area homogeneity analysis are used to generate the guidance image for the proposed filter. To enhance the quality of disparity estimation from stereo images, segmentation is also done using the modified mean shift technique. Experimental results show that the proposed technique can efficiently estimate the depth maps over the available techniques. One-way ANOVA analysis on experimental results validates that the hybrid filter-based stereo matching outperforms consistently over the state-of-art approaches.     

立体视觉曲面重建与系统误差分析

采用立体视觉空间曲面重建技术对三维曲面表面成像进行边缘提取、图像匹配、匹配点空间位置计算等步骤,得到三维曲面表面点的空间位置,利用空间点信息对三维曲面形状进行重建,恢复曲面三维形状;并讨论了立体视觉系统的摄像机分辨率、测量范围和摄像机间距等参数之间的关系.利用该方法对堆积物表面形状及体积进行测量实验结果表明,该方法能准确、快速、方便地给出三维曲面的形状.