图像插值方法对互信息局部极值的影响分析

多模态图像配准中常使用互信息作为配准度量，互信息中的联合概率密度函数一般是利用图像灰度对的统计值来代替的，而图像插值可能产生新的灰度对，造成互信息出现局部极值。该文利用一维信号从理论上分析了线性和最近邻两种插值方法对互信息的影响。理论分析表明，线性插值造成互信息局部极值的可能性较小，而最近邻插值会使互信息出现周期性局部极值。试验结果证实了该文的结论。分析结果对基于互信息的多模态图像配准具有理论参考价值。     

Interpolation artifacts in multimodality image registration based on maximization of mutual information

Mutual information (MI) is an increasingly popular match metric for multimodality image registration. However, its value is affected by interpolation, which may limit registration accuracy. The purpose of this study was to characterize the artifacts from eight interpolators and to investigate efficient strategies to overcome these artifacts. The interpolators were: 1) nearest neighbor; 2) linear; 3) cubic Catmull-Rom; 4) Hamming-windowed sinc; 5) partial volume; 6) NN with jittered sampling (JIT); 7) NN with histogram blurring (BLUR); and 8) NN with JIT and BLUR. The impact of interpolation on MI was evaluated in two dimensions over different translational and rotational misregistration. Interpolation caused spurious fluctuations in MI whenever the voxel grids had coinciding periodicities and were nearly aligned. The artifacts did not lessen by using intensity interpolators with wider support (e.g., cubic Catmull-Rom, Hamming-windowed sinc). PV could lead to either arch artifacts or inverted-arch artifacts, depending on the relative voxel sizes. Several strategies reduced artifacts and improved registration robustness: JIT, BLUR, avoiding an extreme number of intensity bins, and resampling the images in a rotated orientation with different relative voxel sizes (e.g., pi/3). These findings also apply to related methods, including normalized MI, joint entropy, and Hill's third moment.     

Mutual information-based CT-MR brain image registration using generalized partial volume joint histogram estimation

Mutual information (MI)-based image registration has been found to be quite effective in many medical imaging applications. To determine the MI between two images, the joint histogram of the two images is required. In the literature, linear interpolation and partial volume interpolation (PVI) are often used while estimating the joint histogram for registration purposes. It has been shown that joint histogram estimation through these two interpolation methods may introduce artifacts in the MI registration function that hamper the optimization process and influence the registration accuracy. In this paper, we present a new joint histogram estimation scheme called generalized partial volume estimation (GPVE). It turns out that the PVI method is a special case of the GPVE procedure. We have implemented our algorithm on the clinically obtained brain computed tomography and magnetic resonance image data furnished by Vanderbilt University. Our experimental results show that, by properly choosing the kernel functions, the GPVE algorithm significantly reduces the interpolation-induced artifacts and, in cases that the artifacts clearly affect registration accuracy, the registration accuracy is improved.     

Quality image metrics for synthetic images based on perceptual color differences

Due to the improvement of image rendering processes, and the increasing importance of quantitative comparisons among synthetic color images, it is essential to define perceptually based metrics which enable to objectively assess the visual quality of digital simulations. In response to this need, this paper proposes a new methodology for the determination of an objective image quality metric, and gives an answer to this problem through three metrics. This methodology is based on the LLAB color space for perception of color in complex images, a modification of the CIELab1976 color space. The first metric proposed is a pixel by pixel metric which introduces a local distance map between two images. The second metric associates, to a pair of images, a global value. Finally, the third metric uses a recursive subdivision of the images to obtain an adaptative distance map, rougher but less expensive to compute than the first method.     

Polyphase antialiasing in resampling of images.

Changing resolution of images is a common operation. It is also common to use simple, i.e., small, interpolation kernels satisfying some "smoothness" qualities that are determined in the spatial domain. Typical applications use linear interpolation or piecewise cubic interpolation. These are popular since the interpolation kernels are small and the results are acceptable. However, since the interpolation kernel, i.e., impulse response, has a finite and small length, the frequency domain characteristics are not good. Therefore, when we enlarge the image by a rational factor of (L/M), two effects usually appear and cause a noticeable degradation in the quality of the image. The first is jagged edges and the second is low-frequency modulation of high-frequency components, such as sampling noise. Both effects result from aliasing. Enlarging an image by a factor of (L/M) is represented by first interpolating the image on a grid L times finer than the original sampling grid, and then resampling it every M grid points. While the usual treatment of the aliasing created by the resampling operation is aimed toward improving the interpolation filter in the frequency domain, this paper suggests reducing the aliasing effects using a polyphase representation of the interpolation process and treating the polyphase filters separately. The suggested procedure is simple. A considerable reduction in the aliasing effects is obtained for a small interpolation kernel size. We discuss separable interpolation and so the analysis is conducted for the one-dimensional case.     

Adaptive homogeneity-directed demosaicing algorithm.

A cost-effective digital camera uses a single-image sensor, applying alternating patterns of red, green, and blue color filters to each pixel location. A way to reconstruct a full three-color representation of color images by estimating the missing pixel components in each color plane is called a demosaicing algorithm. This paper presents three inherent problems often associated with demosaicing algorithms that incorporate two-dimensional (2-D) directional interpolation: misguidance color artifacts, interpolation color artifacts, and aliasing. The level of misguidance color artifacts present in two images can be compared using metric neighborhood modeling. The proposed demosaicing algorithm estimates missing pixels by interpolating in the direction with fewer color artifacts. The aliasing problem is addressed by applying filterbank techniques to 2-D directional interpolation. The interpolation artifacts are reduced using a nonlinear iterative procedure. Experimental results using digital images confirm the effectiveness of this approach.     

An improved image interpolation algorithm

The paper sets forth an improved edge-directed image interpolation algorithm with low time complexity which is the combination of Newton’s method and edge-directed method. It first partitions images into homogeneous areas and edge areas by setting a preset threshold value based on the local structure characteristics, and then specified algorithms are assigned to interpolate each classified areas, respectively. In this way, it achieves the goals of real-time interpolation and good subjective quality. The interpolated images have higher peak signal noise ratios (PSNR) and better visual effects using proposed method than that of using other algorithms referred to in this paper. Experimental results show that proposed method is highly performed in image interpolation.

基于最大互信息的图像拼接优化算法

基于多分辨分析(MA)策略,提出了以图像最大互信息(MI)为匹配测度的图像拼接粒子群优化算法(OA-MI),使参数随图像的MI计算和多分辨率级数进行自适应调整,解决了灰度图像配准中由于目标函数容易陷入局部极值而造成的误匹配问题。实验证明,该方法能够有效地避免局部极值的影响,通过有限次寻优迭代即可找到最优配准变换,提高了图像配准的计算速度和图像拼接的质量。     

Remote sensing image registration via active contour model

Image registration is the process by which we determine a transformation that provides the most accurate match between two images. The search for the matching transformation can be automated with the use of a suitable metric, but it can be very time-consuming and tedious. In this paper, we introduce a registration algorithm that combines active contour segmentation together with mutual information. Our approach starts with a segmentation procedure. It is formed by a novel geometric active contour, which incorporates edge knowledge, namely Edgeflow, into active contour model. Two edgemap images filled with closed contours are obtained. After ruling out mismatched curves, we use mutual information (MI) as a similarity measure to register two edgemap images. Experimental results are provided to illustrate the performance of the proposed registration algorithm using both synthetic and multisensor images. Quantitative error analysis is also provided and several images are shown for subjective evaluation.