Edge and Depth from Focus

This paper proposes a novel method to obtain the reliable edge and depth information by integrating a set of multi-focus images, i.e., a sequence of images taken by systematically varying a camera parameter focus. In previous work on depth measurement using focusing or defocusing, the accuracy depends upon the size and location of local windows where the amount of blur is measured. In contrast, no windowing is needed in our method; the blur is evaluated from the intensity change along corresponding pixels in the multi-focus images. Such a blur analysis enables us not only to detect the edge points without using spatial differentiation but also to estimate the depth with high accuracy. In addition, the analysis result is stable because the proposed method involves integral computations such as summation and least-square model fitting. This paper first discusses the fundamental properties of multi-focus images based on a step edge model. Then, two algorithms are presented: edge detection using an accumulated defocus image which represents the spatial distribution of blur, and depth estimation using a spatio-focal image which represents the intensity distribution along focus axis. The experimental results demonstrate that the highly precise measurement has been achieved: 0.5 pixel position fluctuation in edge detection and 0.2% error at 2.4 m in depth estimation.     

仿人机器人视觉导航中的实时性运动模糊探测器设计

针对仿人机器人视觉导航系统的鲁棒性受到运动模糊制约的问题,提出一种基于运动模糊特征的实时性异常探测方法. 首先定量地分析运动模糊对视觉导航系统的负面影响,然后研究仿人机器人上图像的运动模糊规律,在此基础上对图像的运动模糊特征进行无参考的度量,随后采用无监督的异常探测技术,在探测框架下对时间序列上发生的图像运动模糊特征进行聚类分析,实时地召回数据流中的模糊异常,以增强机器人视觉导航系统对运动模糊的鲁棒性. 仿真实验和仿人机器人实验表明:针对国际公开的标准数据集和仿人机器人NAO数据集,方法具有良好的实时性（一次探测时间0.1s）和有效性（召回率98.5%,精确率90.7%）. 方法的探测框架对地面移动机器人亦具有较好的普适性和集成性,可方便地与视觉导航系统协同工作.     

Robust PCA-based solution to image composition using augmented Lagrange multiplier (ALM)

Computational photography relies on specialized image-processing techniques to combine multiple images captured by a camera to generate a desired image of the scene. We first consider the high dynamic range (HDR) imaging problem. We can change either the exposure time or the aperture while capturing multiple images of the scene to generate an HDR image. This paper addresses the HDR imaging problem for static and dynamic scenes captured using a stationary camera under various aperture and exposure settings, when we do not have any knowledge of the camera settings. We have proposed a novel framework based on sparse representation which enables us to process images while getting rid of artifacts due to moving objects and defocus blur. We show that the proposed approach is able to produce significantly good results through dynamic object rejection and deblurring capabilities. We compare the results with other competitive approaches and discuss the relative advantages of the proposed approach.     

基于边缘先验模型的运动去模糊

从单幅运动模糊图像复原出清晰的图像,一直是数字图像处理领域中富有挑战的问题.基于边缘先验模型和小波分析提出了一种运动模糊退化图像的复原算法.在去模糊之前,对图像进行预处理,将噪声去除,用冲击滤波器增强边缘,并采用canny边缘检测获取清晰边缘作为先验模型,以此估计模糊核;然后在紧小波框架系统下,将清晰图像的稀疏性最大化,采用改进的分裂Bregman方法求解最优化问题,最终得到清晰的图像.实验结果表明,相对于传统的盲复原算法,提出的方法可以有效地去除运动模糊.     

A Hybrid Motion Deblurring Strategy Using Patch Based Edge Restoration and Bilateral Filter

Motion blur is a common problem in digital photography. In the dim light, a long exposure time is needed to acquire a satisfactory photograph, and if the camera shakes during exposure, a motion blur is captured. Image deblurring has become a crucial image-processing challenge, because of the increased popularity of handheld cameras. Traditional motion deblurring methods assume that the blur degradation is shift-invariant; therefore, the deblurring problem can be reduced to a deconvolution problem. Edge-specific motion deblurring sharpened the strong edges of the image and then used them to estimate the blur kernel. However, this also enhanced noise and narrow edges, which cause ambiguity and ringing artifacts. We propose a hybrid-based single image motion deblurring algorithm to solve these problems. First, we separated the blurred image into strong edge parts and smooth parts. We applied the improved patch-based sharpening method to enhance the strong edge for kernel estimation, but for the smooth part, we used the bilateral filter to remove the narrow edge and the noise for avoiding the generation of ringing artifacts. Experimental results show that the proposed method is efficient at deblurring for a variety of images and can produce images of a quality comparable to other state-of-the-art techniques.     

RX architectures for real-time anomaly detection in hyperspectral images

In the field of hyperspectral image processing, anomaly detection (AD) is a deeply investigated task whose goal is to find objects in the image that are anomalous with respect to the background. In many operational scenarios, detection, classification and identification of anomalous spectral pixels have to be performed in real time to quickly furnish information for decision-making. In this framework, many studies concern the design of computationally efficient AD algorithms for hyperspectral images in order to assure real-time or nearly real-time processing. In this work, a sub-class of anomaly detection algorithms is considered, i.e., those algorithms aimed at detecting small rare objects that are anomalous with respect to their local background. Among such techniques, one of the most established is the Reed–Xiaoli (RX) algorithm, which is based on a local Gaussian assumption for background clutter and locally estimates its parameters by means of the pixels inside a window around the pixel under test (PUT). In the literature, the RX decision rule has been employed to develop computationally efficient algorithms tested in real-time systems. Initially, a recursive block-based parameter estimation procedure was adopted that makes the RX processing and the detection performance differ from those of the original RX. More recently, an update strategy has been proposed which relies on a line-by-line processing without altering the RX detection statistic. In this work, the above-mentioned RX real-time oriented techniques have been improved using a linear algebra-based strategy to efficiently update the inverse covariance matrix thus avoiding its computation and inversion for each pixel of the hyperspectral image. The proposed strategy has been deeply discussed pointing out the benefits introduced on the two analyzed architectures in terms of overall number of elementary operations required. The results show the benefits of the new strategy with respect to the original architectures.     

针对棋盘格角点快速检测的一种新方法

棋盘格图像在摄像机标定及视觉检测中有着广泛的应用。针对目前棋盘格图像角点检测的局限性,提出了一种棋盘格图像角点快速检测方法。该方法是利用存在过渡区和角点处灰度分布的独特性质,设计了环形检测方法。仿真及实测实验结果表明：该方法实时性强,对棋盘格图像的旋转变换、亮度变换和边缘模糊具有良好的适应性;与经典Harris角点检测算法相比,易于实现、计算量小。     

An Improved FoE Model for Image Deblurring

Image restoration from noisy and blurred image is one of the important tasks in image processing and computer vision systems. In this paper, an improved Fields of Experts model for deconvolution of isotropic Gaussian blur is developed, where edges are preserved in deconvolution by introducing local prior information. The edges with different local background in a blur image are retained since local prior information is adaptively estimated. Experiments indicate that the proposed approach is capable of producing highly accurate solutions and preserving more edge and object boundaries than many other algorithms.     

纹理边缘引导的深度图像超分辨率重建

目的 深度图像作为一种普遍的3维场景信息表达方式在立体视觉领域有着广泛的应用。Kinect深度相机能够实时获取场景的深度图像,但由于内部硬件的限制和外界因素的干扰,获取的深度图像存在分辨率低、边缘不准确的问题,无法满足实际应用的需要。为此提出了一种基于彩色图像边缘引导的Kinect深度图像超分辨率重建算法。方法 首先对深度图像进行初始化上采样,并提取初始化深度图像的边缘;进一步利用高分辨率彩色图像和深度图像的相似性,采用基于结构化学习的边缘检测方法提取深度图的正确边缘;最后找出初始化深度图的错误边缘和深度图正确边缘之间的不可靠区域,采用边缘对齐的策略对不可靠区域进行插值填充。结果 在NYU2数据集上进行实验,与8种最新的深度图像超分辨率重建算法作比较,用重建之后的深度图像和3维重建的点云效果进行验证。实验结果表明本文算法在提高深度图像的分辨率的同时,能有效修正上采样后深度图像的边缘,使深度边缘与纹理边缘对齐,也能抑制上采样算法带来的边缘模糊现象;3维点云效果显示,本文算法能准确区分场景中的前景和背景,应用于3维重建等应用能取得较其他算法更好的效果。结论 本文算法普遍适用于Kinect深度图像的超分辨率重建问题,该算法结合同场景彩色图像与深度图像的相似性,利用纹理边缘引导深度图像的超分辨率重建,可以得到较好的重建结果。     

一种实时的主动跟踪方法

针对单视角像机的视野局限性以及连续跟踪特定目标时运动目标实时检测的困难，提出了一种离散化活动像机运动的方法。先离散化像机运动；建立像机预置位表和背景索引表；然后，利用目标位置信息和运动信息判断像机转动情况，并结合对应的控制原理，实现了像机的调度；最后，利用通过计算机视觉方法确定了特定目标在不同离散空间的对应关系，实现了对特定目标大范围的主动跟踪和运动目标的实时检测。实验结果表明，对于复杂场景中特定运动目标大范围的主动跟踪具有较好的鲁棒性和实时性，并且可以实时提取场景中的运动区域。     

结合四元数与最小核值相似区的边缘检测

目的 针对传统彩色图像边缘检测方法中未充分利用图像色度信息、颜色模型间非线性转换过程中时间和空间的大量耗费、算法实现复杂等问题,将四元数引入最小核值相似区（SUSAN）算法中,提出一种RGB空间下的结合四元数与最小核值相似区的边缘检测算法。方法 该算法首先对彩色图像进行四元数描述,然后用改进的SUSAN算子进行边缘检测。针对其中单一几何阈值g的限制,以及检测出的边缘较粗等问题,本文采用Otsu算法自适应获取双几何阈值,再对弱边缘点集进行边缘生长,最后根据USAN重心及其对称最长轴来确定边缘局部方向,实现对边缘点的局部非极大值抑制,得到最终细化后的边缘图像。结果 实验选取1幅合成彩色图像及3幅标准图像库图像,与彩色Canny算法、SUSAN算法,及采用单阈值的本文算法进行对比,并采用Pratt品质因数衡量边缘定位精度。本文算法能够检测出亮度相近的不同颜色区域之间的边缘,且提取的边缘比较连续、细致,漏检边缘较少。与公认边缘检测效果较好的彩色Canny算法相比,本文算法的品质因数提高了0.012 0,耗时缩短了2.527 9 s。结论 本文提出了一种结合四元数与最小核值相似区的边缘检测算法,实现了四元数与SUSAN算子的有效融合。实验结果表明,该算法能够提高边缘定位精度,对弱噪声具有较好的抑制能力,适用于对实时性要求不高的低层次彩色图像处理。     

眼前节组织OCT图像边缘检测及特征角点提取

提出了一种适用于眼前节组织OCT图像的边缘检测算法。该算法在单尺度下用多个结构元素进行边缘检测,根据边缘图像灰阶值的差异性,采用动态自适应权重进行像素点融合;再利用连通域的方法抹去面积小的干扰区域,最终得到多结构元素单尺度边缘检测图像,并在其上通过象限区间有效地提取出了角膜特征角点。仿真结果表明边缘特征明显,较以往边缘检测算法有效避免了OCT图像边缘结果的突变像素点的出现,抹去了干扰区域。因此,提出的特征角点具有较高的准确性。     

基于G-GMM的视频序列运动目标检测算法研究

为了能够从视频序列中快速准确地检测运动目标,在混合高斯背景差分法的基础上引入Grabcut算法,提出了一种新的运动目标检测G-GMM(Grabcut-Gaussian Mixture Model)算法。首先通过混合高斯模型背景差分法提取运动目标初始二值轮廓,构建其最小的外接矩形;然后初始化矩形内图像信息,寻找潜在前景区域;最后采用迭代算法实现最优化分割,得到准确的运动目标轮廓。实验结果表明,在静止摄像机户外视频监控系统中,提出算法具有较高的准确性和鲁棒性,对刚性和非刚性两类目标都具有较好的检测结果。     

边缘追踪模型与SURF检测结合提取天绘影像机场目标

目的 遥感影像提取识别机场目标是遥感领域研究的热点。但是大多研究仅使用被裁剪的影像进行提取识别,由于处理速度等原因很少使用整景高空间分辨率遥感影像提取机场目标。大多数研究是先提取出图像中的直线,根据直线确定机场跑道再确定机场目标,但高分辨率图像提取的直线不仅是机场跑道的,还有可能是高速公路、铁路、大型厂房的外墙、耕地边缘、山脉、地层等,如何区分提取的直线是机场跑道很少被研究。很多研究提取的都是大型机场目标,没有对小型机场进行提取识别,另外如果图像中同时有两个机场应该如何提取也没有被研究。天绘具有数据实时回收,数据全球覆盖等特点,本文将使用高空间分辨率天绘影像（6 000×6 000 像素）提取机场目标。天绘影像地物类型复杂,细节丰富,仅使用一般的空间滤波或边缘探测方法会导致检测结果中有过多的噪声和伪边缘,致使机场目标识别不出来,所以建立了一种以边缘提取追踪模型和SURF（speeded up robust features）检测结合的检测方法和提取流程,达到机场目标识别的目的。方法 边缘提取追踪模型是建立在边缘提取基础上。首先对天绘影像进行滤波处理消除噪声,再对图像进行梯度幅值和法线梯度方向的计算,并利用改进的非极大值抑制方法找到梯度图像中局部变化的最大值,删掉其他值,获得单像素边缘图像,然后对边缘图像进行边缘轮廓线追踪提取出边缘轮廓线,最后使用直线检测和SURF检测方法识别出机场目标。结果 使用本文方法成功地识别了4景天绘卫星图像中的机场目标。借助改进的非极大值抑制和边缘轮廓线追踪提取方法有效地提取了影像中所有地物的边缘,识别出的地物边缘都是清晰的、单像素的边缘,对地物边缘轮廓进行直线提取,并在提取直线的基础上使用SURF检测获得图像中的机场目标。利用天绘卫星图像成功在2景图像中分别提取出一大、一小两个机场,在另外两景图像中分别各提取出一个机场,顺利地实现了用天绘卫星图像提取识别机场目标的过程。结论 本文提出的机场目标提取方法十分有效,该方法不仅适合于天绘卫星遥感数据,还适用于和天绘卫星类似的其他遥感卫星数据。其中对非极大值抑制方法的改进能够提取出更准确的边缘,也能提取出更细微的边缘, 抑制虚假边缘的产生,对提取小型机场有帮助。     

Obtaining base edge correspondence in stereo images via quantitative measures along C-diagonals

We propose a novel approach to solving the object edge correspondence problem for stereo images. For an object placed on a calibration plate (C-plate), the proposed approach first obtains the correspondences of the object edges lying on the C-plate (the base edges) via quantitative measures of locations of the intersections of the extended line of the edges and the diagonals of the C-plate (C-diagonals) using cross ratios. The measures are viewpoint invariant for an object base edge, and are expressed in the number of image pixels. Special cases which need only coarse calculations, as well as those which require extra measures for additional point features, are also considered. The proposed approach requires 2-D image data only, and is robust in the presence of errors in the feature detection. Experimental results are presented for polyhedral and curved objects to demonstrate the effectiveness of the proposed approach.     

Error analysis in determining the centroids of circular objects in images

Detecting the size and/or location of circular object(s) in an image(s) has application in many areas, like, flow diagnostics, biomedical engineering, computer vision, etc. The detection accuracy of circular object(s) largely depends on the accuracy of centroiding algorithm and image preprocessing technique. In the present work, an error analysis is performed in determining the centroids of circular objects using synthetic images with eight different signal-to-noise ratios ranging from 2.7 to 17.8. In the first stage, four different centroiding algorithms, namely, Center of Mass, Weighted Center of Mass, Späth algorithm, and Hough transform, are studied and compared. The error analysis shows that Späth algorithm performs better than other algorithms. In the second stage, various image preprocessing techniques, consisting of two filters, namely, Median and Wiener, and five image segmentation methods, namely, Sobel, Prewitt, Laplacian of Gaussian (LoG) edge detector, basic global thresholding, and Otsu’s global thresholding, are compared to determine the centroids of circular objects using Späth algorithm. It is found that Wiener filter plus LoG edge detector performs better than other preprocessing techniques. Real images of a calibration target (typical in flow diagnostics) and the secondary atomization of water droplets are then considered for centroids detection. These two images are preprocessed using Wiener filter plus LoG edge detector and then processed using Späth algorithm to detect the centroids of circular objects. It is observed that the results of real image of the calibration target and synthetic images are comparable. Also, based on visual inspection, the centroids detected in the real image of water droplets are found to be reasonably accurate.

     

边缘环境中目标检测算法的应用研究

为了满足对安防图像数据安全准确高效的处理需求,在低延迟、高可靠性的边缘计算环境中设计了一种实时性目标检测框架,按层次分为终端网络层、边缘服务器层与云层。在终端网络层采用BING（Binarized Normed Gradients）算法区分图像的目标区域与背景区域,对不同区域采取选择性压缩以减少数据传输量。在边缘服务器层,针对安防图像中小目标易漏检的问题提出了基于SSD（Single Shot Multibox Detector）的改进算法2FSSD,将SSD主干网络中具有高语义信息的深层特征与低层特征进行融合,形成新的特征提取层进行目标检测。实验表明,2FSSD算法在VOC数据集中检测精度可达79.5%,检测速度为27.3 frame/s。因此该研究方法可以在保证检测准确度的同时满足安防图像处理的实时性要求。     

Kinect based real-time synthetic aperture imaging through occlusion

Real-time and high performance occluded object imaging is a big challenge to many computer vision applications. In recent years, camera array synthetic aperture theory proves to be a potential powerful way to solve this problem. However, due to the high cost of complex system hardware, the severe blur of occluded object imaging, and the slow speed of image processing, the exiting camera array synthetic aperture imaging algorithms and systems are difficult to apply in practice. In this paper, we present a novel handheld system to handle those challenges. The objective of this work is to design a convenient system for real-time high quality object imaging even under severe occlusion. The main characteristics of our work include: (1) To the best of our knowledge, this is the first real-time handheld system for seeing occluded object in synthetic imaging domain using color and depth images. (2) A novel sequential synthetic aperture imaging framework is designed to achieve seamless interaction among multiple novel modules, and this framework includes object probability generation, virtual camera array generation, and sequential synthetic aperture imaging. (3) In the virtual camera array generation module, based on the integration of color and depth information, a novel feature set iterative optimization algorithm is presented, which can improve the robustness and accuracy of camera pose estimation even in dynamic occlusion scene. Experimental results in challenging scenarios demonstrate the superiority of our system both in robustness and efficiency compared against the state-of-the-art algorithms.     

Video super-resolution using controlled subpixel detector shifts

Video cameras must produce images at a reasonable frame-rate and with a reasonable depth of field. These requirements impose fundamental physical limits on the spatial resolution of the image detector. As a result, current cameras produce videos with a very low resolution. The resolution of videos can be computationally enhanced by moving the camera and applying super-resolution reconstruction algorithms. However, a moving camera introduces motion blur, which limits super-resolution quality. We analyze this effect and derive a theoretical result showing that motion blur has a substantial degrading effect on the performance of super-resolution. The conclusion is that, in order to achieve the highest resolution motion blur should be avoided. Motion blur can be minimized by sampling the space-time volume of the video in a specific manner. We have developed a novel camera, called the "jitter camera," that achieves this sampling. By applying an adaptive super-resolution algorithm to the video produced by the jitter camera, we show that resolution can be notably enhanced for stationary or slowly moving objects, while it is improved slightly or left unchanged for objects with fast and complex motions. The end result is a video that has a significantly higher resolution than the captured one.     

基于分数阶微分和Sobel算子的边缘检测新模型

现有的边缘检测算法对噪声敏感,检测到的图像边缘效果不够理想,得到的图像边缘有可能模糊不清。为了克服这些不足,以分数阶微分理论为基础,结合Sobel算子边缘检测方法,提出了一种基于分数阶微分和Sobel算子的边缘检测新模型。理论研究和实验结果表明,与现有方法相比较,该模型不仅能较好地提取图像边缘特征,而且对噪声具有一定的抑制作用;特别地,对于纹理细节较丰富的图像而言,该模型能够检测出更多的纹理细节信息,优于常用的整数阶微分方法,是一种有效的边缘检测方法。