单目视觉下结构化车道实时检测

车道检测是高级驾驶员辅助系统的重要组成部分。本文对视频进行实时处理，实现对结构化车道线的实时检测。首先使用行方向的Sobel算子对处理区域进行边缘增强，接着在处理后的区域使用LSD(Line Segment Detector)进行线段提取，提取的线段集合包含代表车道线的线段。最后通过线段倾角以及相对位置过滤线段集合，并结合线段稳定帧数来筛选出最佳候选车道线。      

基于扩展卡尔曼滤波器的车道线检测算法

提出一种将道路结构模型信息与扩展卡尔曼滤波器(EKF,extended Kalman filter)相结合的车道线检测算法。基于扫描线的自适应边缘检测算子进行边缘点的检测,针对车道模型建立了适合算法的自定义参数空间,进行边缘点的投票,提取出候选车道线,解决了传统Hough变换中处理速度慢的问题。根据道路几何学和车辆动力学建立新的车道模型,增加了车道信息待估计的参数,并利用车道线的特征约束排除干扰线得到车道线的内边界,结合EKF对车道线边界点坐标参数进行跟踪估计,以保证算法的稳定性与鲁棒性。实验结果表明,本文算法能够处理绝大多数的复杂车道情况,在实时性、鲁棒性和检测率上都取得很好的效果。     

基于机器视觉的车道线精确检测算法

车道线检测是车辆智能驾驶系统的重要组成部分.针对传统的车道线检测方法精度低、实时性能差的问题,提出一种基于机器视觉的车道线精确检测算法.该算法采用车道内侧边缘线代表车道线,具体包括预处理和车道线提取两个步骤:预处理部分包括灰度化、Sobel边缘检测、ROI设定、二值化,最终得到车道线部分的二值图像;车道线提取部分包括图像切片、改进的Hough直线检测、DBSCAN直线聚类以及直线拟合,最终得到精确的车道边缘线信息.最后将算法应用于各种场景下的路况测试,实验结果表明:该算法的平均准确率为94.9％,平均处理时长为25.6 ms/f,具有很好的实时性和鲁棒性.     

线段的三步快速聚类算法

针对图像处理获得杂乱边缘线条信息,本文提出了一种新的三步快速线段聚类算法。该算法首先利用线条检测算法对原始图像进行线条检测获得初始线条集合,然后根据这些线段的方向进行粗分类,在此基础上对构成的每个集合内部根据距离差异再进行细分,把距离较远的线段进一步聚类到不同的集合中,最后根据线段之间的邻近关系进行合并和分离,形成最终线段聚类效果。通过试验,与前人工作相比,本文算法效率更高,而且容易实现,所形成的线段聚类能充分反映出目标的结构信息。     

基于RGB彩色通道的结构化道路车道线检测

车道线检测是车辆智能辅助系统的重要组成部分,为提高检测准确性,文中采用一种基于RGB颜色特征的车道线检测方法。根据车道线颜色特征设计转移函数标记图像中的车道线区域,并应用基于形态学的边缘检测算法提取车道线边缘,最终检测出车道线。文中算法原理简单,在车道线边缘识别上,具有较高的准确度,对自动车辆车道线检测有一定的意义。     

夜间车道线检测的研究

夜间环境下的车道线检测是汽车智能辅助安全驾驶系统在夜间正常工作的前提和基础。由于夜间环境下存在图像整体较暗、光照不均匀、车道线不易检测的特点,使当前在日间环境下应用良好的算法难以适用。针对此问题,该文提出一种夜间车道线检测的方法。通过从摄像机获取的图像中提取感兴趣区域,采用双边滤波去除感兴趣区域中的噪点,并使用暗光增强算法提高对比度,最后通过边缘检测算法提取出边缘并应用霍夫变换得出直线。应用该文算法对夜间环境下的车道图像进行测试,实验结果表明,该文算法较常规的车道检测算法更能准确地检测出车道线。     

复杂SAR场景中机场跑道的提取

本文提出了一种从大幅SAR场景图像中提取机场跑道的方法。跑道是机场的最明显的特征,在图像上可抽象为相隔一定距离,具有一定长度的平行线对。算法首先检测图像边缘,然后连接成线段,从中搜索平行线对,最后进行验证。算法的特点在于连接线段时,通过将图像域中的线段转化成极坐标中的点,将线段连接问题转化为点的聚类问题,并利用贝叶斯估计原理构造相似性测度准则函数,利用区域生长聚类方法将断裂的但属于同一条直线的点聚集起来。实验结果表明,该算法能够从大幅SAR图像中提取机场跑道,具有重要的实际应用价值。     

夜间车道线检测与跟踪算法研究

夜间车道线的检测与跟踪是汽车智能辅助安全驾驶系统在夜间工作的前提.根据夜间车道图像照度低,光照不均匀的特点,提出先进行基于光密度差的对数Prewitt边缘检测,再进行Hough变换检测单帧车道线,最后融合固定区域法和Kalman滤波法预测感兴趣区域跟踪连续车道线的算法.实验结果表明,该算法具有准确、实时的夜间车道线检测与跟踪能力.     

车道线实时检测与偏离预警系统设计与研究

为保证交通安全,设计了一种基于单目视觉的车道偏离检测系统,利用 车载前视摄像 头获取图像,实时对动态图像进行处理,在驾驶员非主观偏离车道时进行报警。首先研 究了图像预处 理技术,包括灰度化、截取有效区域、滤波去噪、图像灰度增强、边缘检测和边缘修复功能 。其次对预处 理后的图像进行车道线检测,为有效识别具有车道线特征的图像,提出了一种改进的Hough 变换算法;对 没有车道线特征或车道线特征不明显的图像,采用了动态检测方法。在此基础上,提出 了一种车道线 纠正算法,即四点标定逆透视变换,将车道图像转化为俯视图,建立图像坐标系与实际俯视 坐标系之间的 关系,得到实际车辆的位置和偏移角度,判断该车辆的情况并作出指示。最后,在实际道路 中对设计中关 键技术以及整个系统进行了实验,大量实验结果表明,本文系统能在多种环境的道路中实现 车道线的准确识别和偏移判断,具有良好的实时性和鲁棒性。     

基于改进最小二乘法拟合的车道线检测

提出了一种新的适用于自主驾驶系统的车道线检测——基于改进最小二乘法拟合的车道线检测。算法首先将摄像头采集的一帧帧图像,截取感兴趣的下半部分进行灰度变换,得到灰度图像;其次采取高通滤波,小波变换,来进行边缘增强与检测;之后采取最小阀值二值化得到二值化图像,采用最小二乘法拟合车道线;最后车道线的跟踪采用粒子滤波。实验表明,该算法简单、鲁棒性强,能准确地检测到车道标识线。     

结构化道路车道线的鲁棒检测与跟踪

针对智能车在视觉导航过程中车道线检测的鲁棒性和实时性问题,提出一种适用于结构化道路的车道线鲁棒检测与跟踪方法。首先,简化的Sobel算子提取车道线边缘图像,将边缘图像与改进的Otsu方法得到的车道线分割图像进行融合,实现对车道线标记点的鲁棒检测;然后,采用迭代最小二乘方法拟合车道线标记点并去除干扰点,并根据拟合参数建立车道线模型;最后,引入尺度无迹卡尔曼滤波(SUKF)对车道线进行跟踪。通过对多段实地采集的视频进行了仿真实验,结果表明,该方法对于高速公路车道线的检测率可达到99%,并具有较好实时性能;对于受损和弄污的城市道路车道线也体现出较好的鲁棒性和时间性能。     

Structure-prior deep neural network for lane detection

Lane detection is an important task of road environment perception for autonomous driving. Deep learning methods based on semantic segmentation have been successfully applied to lane detection, but they require considerable computational cost for high complexity. The lane detection is treated as a particular semantic segmentation task due to the prior structural information of lane markings which have long continuous shape. Most traditional CNN are designed for the representation learning of semantic information, while this prior structural information is not fully exploited. In this paper, we propose a recurrent slice convolution module (called RSCM) to exploit the prior structural information of lane markings. The proposed RSCM is a special recurrent network structure with several slice convolution units (called SCU). The RSCM could obtain stronger semantic representation through the propagation of the prior structural information in SCU. Furthermore, we design a distance loss in consideration of the prior structure of lane markings. The lane detection network can be trained more steadily via the overall loss function formed by combining segmentation loss with the distance loss. The experimental results show the effectiveness of our method. We achieve excellent computation efficiency while keeping decent detection quality on lane detection benchmarks and the computational cost of our method is much lower than the state-of-the-art methods.     

Moment-based multi-lane detection and tracking

Lane-detection methods are still facing robustness issues when confronted with challenging road surfaces, road markings and illumination conditions. Such combined challenges occur infrequently but are crucial for driving safety. Although advanced learning-based methods (using deep learning) demonstrate an impressive performance, they rely on plenty of training images for varying scenes and their performance is limited for scenes not covered by the training data. Also, multi-lane detection is indispensable for determining the exact position of both ego-car and surrounding vehicles as well as lane changing behavior on the road. In this paper we propose a new multi-lane detection algorithm, detecting all visible lane boundaries in front of the ego-car. In contrast to the Hough transforms often used for lane boundaries detection, our approach uses moments to calculate the deflection angles and the centroids of lane segments, achieving more precise lane boundaries. We propose a novel algorithm based on moments and Kalman filtering to achieve lane tracking. State-of-the-art neural-network-based methods are compared with the proposed method concretely. Experimental results show that our method outperforms other (recently published) multi-lane detection algorithms regarding detection rate as well as accuracy.     

基于视觉的车道状态估计

车道状态估计是车辆辅助驾驶系统的关键功能。本文提出了一种基于教育处机视觉的车道状态估计新方法。提出了车道标线在图像平面中的一种描述,讨论了其性质,并应用于车道的检测。利用真实世界中车辆在二维图像平面中的透视特征,提出了基于二值有序变换（BROT）的障碍物检测新方法。由于采用单目视觉方法检测前方车辆以控制车辆的横向偏离和纵向间距,降低了系统的复杂度,实验结果显示了新方法的有效性。     

面向嵌入式平台的车道线检测方法

车道线检测在自动驾驶和高级辅助驾驶中起着举足轻重的作用,然而,传统的车道线检测技术鲁棒性较差,而大多数基于深度学习的方法复杂度又较高,难以在嵌入式平台实时应用。提出一种面向嵌入式平台的轻量级车道线检测网络,将车道线检测转化为语义分割问题,该网络借鉴U-Net与Segnet网络结构,使用了小尺度卷积等轻量化组件设计计算高效的语义分割网络。在检测车道线的基础上,计算车辆距离两侧车道线的距离,以及车道线的曲率,同时当车辆偏离车道线或检测出现异常时进行预警,最后将整个系统移植到海思平台。实验结果表明:该系统具有较高的检测精度以及检测速度,准确率达到97.5%,速度达到50 FPS,满足实时性要求,因此该系统能够用于面向嵌入式平台的实时车道线的检测、测距、曲率计算以及预警。     

Multi-scale spatial convolution algorithm for lane line detection and lane offset estimation in complex road conditions

Deep learning has made remarkable progress in the field of image classification and object detection. Nevertheless, in the autonomous driving research, the real-time lane line detection and lane offset estimation in complex traffic scenes have always been challenging and difficult tasks. Traditional detection methods need manual adjustment of parameters, they face many problems and difficulties and are still highly susceptible to interference caused by obstructing objects, illumination changes, and pavement wear. It is still challenging to design a robust lane detection and lane offset estimation algorithm. In this paper, we propose a convolutional neural network for lane offset estimation and lane line detection in a complex road environment, which transforms the problems of lane line detection into the instance’s segmentation. In response to a change in the method of lane processing, the network will form its example to each line. The global scale perception optimization mechanism is designed to solve the issue, especially where the lane line width is gradually narrowing at the vanishing point of the lane. At the same time, to realize multi-tasking processing and improve performance, and end-to-end lane offset estimation network is used in addition to the lane line detection network.     

GOLD: a parallel real-time stereo vision system for genericobstacle and lane detection

This paper describes the generic obstacle and lane detection system (GOLD), a stereo vision-based hardware and software architecture to be used on moving vehicles to increment road safety. Based on a full-custom massively parallel hardware, it allows to detect both generic obstacles (without constraints on symmetry or shape) and the lane position in a structured environment (with painted lane markings) at a rate of 10 Hz. Thanks to a geometrical transform supported by a specific hardware module, the perspective effect is removed from both left and right stereo images; the left is used to detect lane markings with a series of morphological filters, while both remapped stereo images are used for the detection of free-space in front of the vehicle. The output of the processing is displayed on both an on-board monitor and a control-panel to give visual feedbacks to the driver. The system was tested on the mobile laboratory (MOB-LAB) experimental land vehicle, which was driven for more than 3000 km along extra-urban roads and freeways at speeds up to 80 km/h, and demonstrated its robustness with respect to shadows and changing illumination conditions, different road textures, and vehicle movement.     

车道线信息的全面理解及偏离预警算法

为全面理解车道线信息,提出了一种车道线检测分类跟踪及偏离预警算法。首先利用动态感兴趣区域约束Canny算子的检测范围,基于扩展的Otsu算法改进Canny算子的阈值设定方式,并通过Hough变换进行车道线边缘拟合;然后依据车道线的颜色及线型特征进行分类,同时借助Kalman滤波器实时跟踪车道线,对检测失效区域采用Kalman滤波器的预测值进行替换;最后设定有效的偏离预警策略,确保行驶的安全性。实验结果表明,算法能全面地理解车道线信息并进行跟踪,同时具备对危险行驶状态下的车辆进行预警的能力。