全方位图像展开的双线性内插值法

把全方位图像展开成全景图或透视图时,近邻取样的像素点取值方法虽然运算简单,但展开后的图像质量较差。采用双线性内插值法,提高了展开图像的质量。并使用三角函数查表法减少了展开过程的运算量。实验结果表明,采用该方法展开后的图像更清晰。     

反馈控制采集的双模式折反射全景成像处理系统

为解决折反射全景成像系统中的采样分辨率与帧速之间的矛盾,通过反馈控制图像传感器的参数配置,设计并实现了一个全局与局部双模式的全景成像处理系统.在全局模式下,为保证采集帧速率,使用行列跳跃模式采集完整的环状全向图,并将其展开为包含360°全局信息的柱面全景图像;在局部模式下,根据感兴趣区域的空间位置设置采样窗口大小及位置,以逐像素采样模式只采集全向图中相应的一块矩形区域,并将其展开为对应视线方向上高清晰度的局部透视图;最后给出了DSP+FPGA结构的系统硬件设计方案.实验结果表明了该系统设计的科学性及实用性.     

全方位图像展开成全景和透视图的实现方法

全方位视觉系统生成的全方位图像能获得水平方向3600环境信息,非常适合于某些有大视场需求的应用。该文介绍了全方位图像的特点、生成原理及其展开成全景图及透视图的具体实现方法。同时也介绍了以DirectShow为工具,全方位视频的展开实现方法。最后通过实验证明了全景图及透视图生成方法的有效性。     

A Catadioptric and Pan-Tilt-Zoom Camera Pair Object Tracking System for UAVs

Unmanned aerial vehicles (UAVs) are seeing widespread use in military, scientific, and civilian sectors in recent years. As the mission demands increase, these systems are becoming more complicated. Omnidirectional camera is a vision sensor that can captures 360° view in a single frame. In recent years omnidirectional camera usage has experienced a remarkable increase in many fields, where many innovative research has been done. Although, it is very promising, employment of omnidirectional cameras in UAVs is quite new. In this paper, an innovative sensory system is proposed, that has an omnidirectional imaging device and a pan tilt zoom (PTZ) camera. Such a system combines the advantages of both of the camera systems. The system can track any moving object within its 360° field of view and provide detailed images of it. The detection of the moving object has been accomplished by an adaptive background subtraction method implemented on the lowered resolution images of the catadioptric camera. A novel algorithm has also been developed to estimate the relative distance of the object with respect to the UAV, using tracking information of both of the cameras. The algorithms are implemented on an experimental system to validate the approach.     

Acquiring a radiance distribution to superimpose virtual objectsonto a real scene

This paper describes a new method for superimposing virtual objects with correct shadings onto an image of a real scene. Unlike the previously proposed methods, our method can measure a radiance distribution of a real scene automatically and use it for superimposing virtual objects appropriately onto a real scene. First, a geometric model of the scene is constructed from a pair of omnidirectional images by using an omnidirectional stereo algorithm. Then, radiance of the scene is computed from a sequence of omnidirectional images taken with different shutter speeds and mapped onto the constructed geometric model. The radiance distribution mapped onto the geometric model is used for rendering virtual objects superimposed onto the scene image. As a result, even for a complex radiance distribution, our method can superimpose virtual objects with convincing shadings and shadows cast onto the real scene. We successfully tested the proposed method by using real images to show its effectiveness     

Omnidirectional edge detection

In this paper we propose a new method for extending 1-D step edge detection filters to two dimensions via complex-valued filtering. Complex-valued filtering allows us to obtain edge magnitude and direction simultaneously. Our method can be viewed either as an extension of n-directional complex filtering of Paplinski to infinite directions or as a variant of Canny’s gradient-based approach. In the second view, the real part of our filter computes the gradient in the x direction and the imaginary part computes the gradient in the y direction. Paplinski claimed that n-directional filtering is an improvement over the gradient-based method, which computes gradient only in two directions. We show that our omnidirectional and Canny’s gradient-based extensions of the 1-D DoG coincide. In contrast to Paplinski’s claim, this coincidence shows that both approaches suffer from being confined to the subspace of two 2-D filters, even though n-directional filtering hides these filters in a single complex-valued filter. Aside from these theoretical results, the omnidirectional method has practical advantages over both n-directional and gradient-based approaches. Our experiments on synthetic and real-world images show the superiority of omnidirectional and gradient-based methods over n-directional approach. In comparison with the gradient-based method, the advantage of omnidirectional method lies mostly in freeing the user from specifying the smoothing window and its parameter. Since the omnidirectional and Canny’s gradient-based extensions of the 1-D DoG coincide, we have based our experiments on extending the 1-D Demigny filter. This filter has been proposed by Demigny as the optimal edge detection filter in sampled images.     

Angle-based homing from a reference image set using the 1D trifocal tensor

This paper presents a visual homing method for a robot moving on the ground plane. The approach employs a set of omnidirectional images acquired previously at different locations (including the goal position) in the environment, and the current image taken by the robot. We present as contribution a method to obtain the relative angles between all these locations, using the computation of the 1D trifocal tensor between views and an indirect angle estimation procedure. The tensor is particularly well suited for planar motion and provides important robustness properties to our technique. Another contribution of our paper is a new control law that uses the available angles, with no range information involved, to drive the robot to the goal. Therefore, our method takes advantage of the strengths of omnidirectional vision, which provides a wide field of view and very precise angular information. We present a formal proof of the stability of the proposed control law. The performance of our approach is illustrated through simulations and different sets of experiments with real images.     

立方体表面上的图象拼接

介绍了一种全方位全景图的建模和实现方式，给出并实现了普通图像、立方体表面以及景物所在平面之间一组新的坐标变换，提出了一种实现彩色图象拼接的方法，在立方体表面实现了实景图象的拼接，给出了拼接实例，为全方位全景图象的生成奠定了基础。     

Development of a Positioning Technique for an Urban Area Using Omnidirectional Infrared Camera and Aerial Survey Data

This paper describes an outdoor positioning system for vehicles that can be applied to an urban canyon by using an omnidirectional infrared (IR) camera and a digital surface model (DSM). By means of omnidirectional IR images, this system enables robust positioning in urban areas where satellite invisibility caused by buildings hampers high-precision GPS measurements. The omnidirectional IR camera can generate IR images with an elevation of 20–70° for the surrounding area of 360°. The image captured by the camera is highly robust to light disturbances in the outdoor environment. Through the IR camera, the sky appears distinctively dark; this enables easy detection of the border between the sky and the buildings captured in white due to the difference in the atmospheric transmittance rate between visible light and IR rays. The omnidirectional image, which includes several building profiles, is compared with building-restoration images produced by the corresponding DSM in order to determine the self-position. Field experiments in an urban area show that the proposed outdoor positioning method is valid and effective, even if high-rise buildings cause satellite blockage that affects GPS measurements.     

改进的形态学肺部图像边缘检测

针对肺部图像边缘检测中存在的噪声问题,在数学形态学边缘检测的基础上做了3点改进:(1)结合结构元素3个基本选取原则,即形状的相似性、尺寸的覆盖性和不同结构元素的组合性,选取适合肺部图像的全方位结构元和多尺度结构元;(2)改进了普通的形态学边缘检测算子,将全方位结构元和多尺度结构元相结合,得到适用于肺部图像的新型复合形态学边缘检测算子;(3)将峰值信噪比(Peak signal-to-noise ratio, PSNR)加入权值计算方法中,改进了权值的计算方法。最后通过仿真实验,对PSNR为50684 9 dB的肺部噪声图像进行边缘检测,并与一般算法进行比较,结果表明改进算法在PSNR和均方误差(Mean square error, MSE)上均有明显改善,能够检测出更清晰、去噪效果更好的肺部图像边缘。应用于其他图像或加入不同噪声时,本文算法也能检测出更清晰的图像边缘,表明该算法具有很好的鲁棒性。     

Multiple homographies with omnidirectional vision for robot homing

Two relevant issues in vision-based navigation are the field-of-view constraints of conventional cameras and the model and structure dependency of standard approaches. A good solution of these problems is the use of the homography model with omnidirectional vision. However, a plane of the scene will cover only a small part of the omnidirectional image, missing relevant information across the wide range field of view, which is the main advantage of omnidirectional sensors. The interest of this paper is in a new approach for computing multiple homographies from virtual planes using omnidirectional images and its application in an omnidirectional vision-based homing control scheme. The multiple homographies are robustly computed, from a set of point matches across two omnidirectional views, using a method that relies on virtual planes independently of the structure of the scene. The method takes advantage of the planar motion constraint of the platform and computes virtual vertical planes from the scene. The family of homographies is also constrained to be embedded in a three-dimensional linear subspace to improve numerical consistency. Simulations and real experiments are provided to evaluate our approach.     

Defocus deblurring for catadioptric omnidirectional imaging based on coded aperture and omni-total variation

The problem of catadioptric omnidirectional imaging defocus blur, which is caused by lens aperture and mirror curvature, becomes more severe when high-resolution sensors and large apertures are applied. In order to overcome this problem, a novel method based on coded aperture technique is proposed in this article. Firstly, the defocus blur of catadioptric omnidirectional imaging is analyzed to calculate the point spread function for different scene points. Then, a method of obtaining optimal focused plane is proposed. Lastly, based on the strategies of neighboring annuluses division and stitching of omnidirectional images, a deconvolution algorithm using omni-total variation prior is applied to obtain all-focused/sharp omnidirectional images. Experimental results demonstrate that the proposed method is effective for omnidirectional image defocus deblurring and can be applied to most existing catadioptric omnidirectional imaging systems.     

基于全景视觉的监控系统设计

设计了一个基于全景视觉的多摄像机监控网络。全景相机视野广,可以实现大范围的目标检测与跟踪。云台摄像机视角具有一定的自由度,可以捕捉目标的高分辨率图像。将全景相机与云台相机相互配合,通过多传感器的数据融合,分层次的跟踪算法及多相机调度算法,实现了大范围的多个运动目标的检测与跟踪,并能捕获目标的清晰图像。实验验证了该系统的有效性和合理性。     

Omnidirectional Image Stabilization for Visual Object Recognition

In this paper, we present a pipeline for camera pose and trajectory estimation, and image stabilization and rectification for dense as well as wide baseline omnidirectional images. The proposed pipeline transforms a set of images taken by a single hand-held camera to a set of stabilized and rectified images augmented by the computed camera 3D trajectory and a reconstruction of feature points facilitating visual object recognition. The paper generalizes previous works on camera trajectory estimation done on perspective images to omnidirectional images and introduces a new technique for omnidirectional image rectification that is suited for recognizing people and cars in images. The performance of the pipeline is demonstrated on real image sequences acquired in urban as well as natural environments.     

高分辨率遥感影像的形态学边缘检测算法

结合高空间分辨率遥感影像的特点,利用数学形态学方法,选取具有不同尺度和包含全部方向的结构元素,设计一种多尺度全方位形态学边缘检测算法,并采用峰值信噪比方法代替均值以自适应地确定尺度权重.实验结果表明:与传统Canny算子和结构元素尺度形状单一的形态学边缘检测算法相比,本算法解决了噪声抑制和精细边缘提取的矛盾,检测出的图像边缘清晰,而且抗噪性能强.边缘检测结果可用于遥感影像地物几何特征和纹理特征提取.     

An efficient similarity metric for omnidirectional vision sensors

This paper presents an efficient metric for the computation of the similarity among omnidirectional images (image matching). The representation of image appearance is based on feature vectors that include both the chromatic attributes of color sets and their mutual spatial relationships. The proposed metric fits well to robotic navigation using omnidirectional vision sensors, because it has very important properties: it is reflexive, compositional and invariant with respect to image scaling and rotation. The robustness of the metric was repeatedly tested using omnidirectional images for a robot localization task in a real indoor environment.     

On improved calibration method for the catadioptric omnidirectional vision with a single viewpoint

The single viewpoint constraint is a principal optical characteristic for most catadioptric omnidirectional vision. Single viewpoint catadioptric omnidirectional vision is very useful because it allows the generation of geometrically correct perspective images from one omnidirectional image. Therefore precise calibration for single viewpoint constraint is needed during system assembling. However, in most image detection based calibration methods, the nonlinear optical distortion brought by lens is often neglected. Hence the calibration precision is poor. In this paper, a new calibration method of single viewpoint constraint for the catadioptric omni-directional vision is proposed. Firstly, an image correction algorithm is obtained by training a neural network. Then, according to characteristics of the space circular perspective projection, the corrected image of the mirror boundary is used to estimate its position and attitude relative to the camera to guide the calibration. Since the estimate is conducted based on actual imaging model rather than the simplified model, the estimate error is largely reduced, and the calibration accuracy is significantly improved. Experiments are conducted on simulated images and real images to show the accuracy and the effectiveness of the proposed method.     

基于空间结构统计建模的图像分类方法

提出一种基于图像空间结构统计建模的复杂纹理图像模式识别方法。从理论上分析了复杂纹理图像空间结构的韦伯分布过程,通过构造多尺度全向高斯导数滤波器,获得复杂纹理图像在不同观测尺度上的全方向空间结构统计建模表征结果。基于偏最小二乘-判决分析原理构建分类器,实现了复杂纹理图像的分类识别。实验结果表明,所提出的图像空间结构统计建模方法能获得复杂纹理图像关键性的视觉感知特性,基于该方法的图像分类准确率高且性能稳定。     

全方位全景图象的一种映射方式

在介绍全景图象的基础上,提出了全方位全景图象的一种新的映射方式,推导了映射的变换公式,并给出了变换实例,为全方位全景图象的处理和应用给出了一种新方法。     

Gaze direction based vehicle teleoperation method with omnidirectional image stabilization and automatic body rotation control

In robot teleoperation, a robot works as a physical agent at a remote site for a robot operator. There are mainly two tasks in robot teleoperation using camera images: environment recognition using visual information and robot control according to the recognition. In this paper, we propose a gaze direction based vehicle teleoperation method with an omnidirectional image stabilization and an automatic body rotation control. In the proposed method, we manage above two tasks in the same manner that are usually treated separately. This method is an intuitive vehicle teleoperation method where an operator do not need to have concern about vehicle body orientations and can absorb differences of vehicle driving mechanisms. That is, this method frees an operator from being bothered from controlling a vehicle and the operator can concentrate on where he/she intends to go. This method mainly consists of two technologies: an omnidirectional image stabilization technology and automatic body rotation control. The conducted experiments show effectiveness of the proposed method.