基于场景模态深度理解网络的单目图像深度理解

基于深度卷积神经网络的图像处理方法得到的单目深度图像质量远高于传统图像处理方法,但该方法对无用特征的训练易产生误差积累,且基于回归求解的连续深度距离预测精度较低,导致图像深度信息提取不精确、目标边缘模糊与图像细节缺失.提出一种应用于单目彩色图像的场景模态深度理解网络.建立以堆叠沙漏为主框架的网络模型,通过反复进行自下而...

Monocular Image Depth Understanding Based on Scene Modality Depth Understanding Network

The monocular depth image quality obtained by the image processing method based on Depth Convolution Neural Network(DCNN)is much higher than that of traditional image processing methods.However,this method is prone to error accumulation in the training of useless features,and the accuracy of continuous depth distance prediction based on regression solution is low,which leads to inaccurate image depth information extraction,blurred target edge and lack of image details.This paper proposes a Scene Modality Depth Understanding Network(SMDUN)for monocular color images.A network model based on stacked hourglass is established.Through repeated bottom-up and top-down processes,low-level texture and highlevel semantic features are fused.In each layer of network training,discrete depth tags and real depth images are combined to reduce the difficulty of depth understanding.Error correction sub module and maximum likelihood decoding optimization sub module are inserted to accurately extract depth features.Experimental results show that the network can obtain more accurate depth information,the Absolute Relative Error(AbsRel)of NYUv2 dataset is 0.72% lower than that of ACAN network,and the Mean Squared Relative Error(MSqRel)of KITTI dataset is 41.28% lower than that of GASDA network.Compared with DORN and other depth networks,the predicted depth image contains more detail information and the target contour is clearer.