首页 | 本学科首页   官方微博 | 高级检索  
     

YOLO-NKLT视觉SLAM回环检测方法
引用本文:刘玮,温显斌.YOLO-NKLT视觉SLAM回环检测方法[J].光电子.激光,2023,34(4):405-412.
作者姓名:刘玮  温显斌
作者单位:天津理工大学 计算机视觉与系统教育部重点实验室和天津市智能计算及软件新技术重点实验室,天津 300384,天津理工大学 计算机视觉与系统教育部重点实验室和天津市智能计算及软件新技术重点实验室,天津 300384
基金项目:天津市高等学校自然科学研究项目(2017ZD13)资助项目
摘    要:针对存在明显光照变化或遮挡物等室外复杂场景下,现有基于深度学习的视觉即时定位与地图构建(visual simultaneous localization and mapping,视觉SLAM)回环检测方法没有很好地利用图像的语义信息、场景细节且实时性差等问题,本文提出了一种YOLO-NKLT视觉SLAM回环检测方法。采用改进损失函数的YOLOv5网络模型获取具有语义信息的图像特征,构建训练集,对网络重训练,使提取的特征更加适用于复杂场景下的回环检测。为了进一步提高闭环检测的实时性,提出了一种基于非支配排序的KLT降维方法。通过在New College数据集和光照等变化更复杂的Nordland数据集上进行实验,结果表明:室外复杂场景下,相较于其他传统和基于深度学习的方法,所提方法具有更高的鲁棒性,可以取得更佳的准确率和实时性表现。

关 键 词:室外复杂场景  深度学习  损失函数  回环检测  降维
收稿时间:2022/5/30 0:00:00
修稿时间:2022/9/18 0:00:00

YOLO-NKLT visual SLAM loopback detection method
LIU Wei and WEN Xianbin.YOLO-NKLT visual SLAM loopback detection method[J].Journal of Optoelectronics·laser,2023,34(4):405-412.
Authors:LIU Wei and WEN Xianbin
Affiliation:Key Laboratory on Computer Vision and System,Ministry of Education of China,Key Laboratory on Intelligence Computing and Novel Software Technology of the City of Tianjin, Tianjin University of Technology, Tianjin 300384, China and Key Laboratory on Computer Vision and System,Ministry of Education of China,Key Laboratory on Intelligence Computing and Novel Software Technology of the City of Tianjin, Tianjin University of Technology, Tianjin 300384, China
Abstract:Aiming at the problems that the existing deep learning based visual simultaneous localization and mapping (visual SLAM) loopback detection methods do not make good use of the semantic information of images,scene details and poor real-time performance in complex outdoor scenes with obvious illumination changes or occlusion objects,this paper proposes an YOLO-NKLT visual SLAM loopback detection method.The YOLOv5 network model with improved loss function is used to obtain image features with semantic information,construct the training set,and retrain the network to make the extracted features more suitable for loopback detection in complex scenes.In order to further improve the real-time performance of closed-loop detection,a KLT dimensionality reduction method based on non-dominated sorting is proposed.Through experiments on the New College dataset and Nordland dataset with more complex changes such as illumination,the results show that compared with other traditional and deep learn-based methods in outdoor complex scenes,it has higher robustness and can achieve better accuracy and real-time rate performance.
Keywords:complex outdoor scene  deep learning  loss function  loopback detection  dimensionality reduction
点击此处可从《光电子.激光》浏览原始摘要信息
点击此处可从《光电子.激光》下载全文
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号