基于纹理信息的室内场景语义标注学习方法

针对目前室内场景视频中关键物体的检测、跟踪及信息编辑等方面主要是采用人工处理方式，存在效率低、精度不高等问题，提出了一种基于纹理信息的室内场景语义标注学习方法。首先，采用光流方法获取视频帧间的运动信息，利用关键帧标注和帧间运动信息进行非关键帧的标注初始化；然后，利用非关键帧的图像纹理信息约束及其初始化标注构建能量方程；最后，利用图割方法优化得到该能量方程的解，即为非关键帧语义标注。标注的准确率和视觉效果的实验结果表明，与运动估计法和基于模型的学习法相比较，所提基于纹理信息的室内场景语义标注学习法具有较好的效果。该方法可以为服务机器人、智能家居、应急响应等低时延决策系统提供参考。

Learning method of indoor scene semantic annotation based on texture information

The manual processing method is mainly used for the detection, tracking and information editing of key objects in indoor scene video, which has the problems of low efficiency and low precision. In order to solve the problems, a new learning method of indoor scene semantic annotation based on texture information was proposed. Firstly, the optical flow method was used to obtain the motion information between video frames, and the key frame annotation and interframe motion information were used to initialize the annotation of non-key frames. Then, the image texture information constraint of non-key frames and its initialized annotation were used to construct an energy equation. Finally, the graph-cuts method was used for optimizing to obtain the solution of the energy equation, which was the non-key frame semantic annotation. The experimental results of the annotation accuracy and visual effects show that, compared with the motion estimation method and the model-based learning method, the proposed learning method of indoor scene semantic annotation based on texture information has the better effect. The proposed method can provide the reference for low-latency decision-making systems such as service robots, smart home and emergency response.