首页 | 本学科首页   官方微博 | 高级检索  
     

基于深度学习的草图分割算法综述
引用本文:王佳欣,朱志亮,邓小明,马翠霞,王宏安. 基于深度学习的草图分割算法综述[J]. 软件学报, 2022, 33(7): 2729-2752
作者姓名:王佳欣  朱志亮  邓小明  马翠霞  王宏安
作者单位:中国科学院大学 计算机科学与技术学院, 北京 100049;计算机科学国家重点实验室中国科学院 软件研究所, 北京 100190;人机交互北京市重点实验室中国科学院 软件研究所, 北京 100190;计算机科学国家重点实验室中国科学院 软件研究所, 北京 100190;人机交互北京市重点实验室中国科学院 软件研究所, 北京 100190;华东交通大学 软件学院, 江西 南昌 330013;计算机科学国家重点实验室中国科学院 软件研究所, 北京 100190;人机交互北京市重点实验室中国科学院 软件研究所, 北京 100190
基金项目:国家自然科学基金(61872346);国家重点研发计划(2016YFB1001200)
摘    要:草图一直是人类传递信息的重要工具之一.草图可以通过简单明了的形式更快地表达人类的一些复杂思想,因此,草图处理算法一直是计算机视觉领域的研究热点之一.目前,对草图的研究主要集中在识别、检索和补全等方面.随着研究者对于草图细粒度操作的重视,对草图分割方面的研究也得到越来越多的关注.近年来,随着深度学习与计算机视觉技术的发展,出现了大量基于深度学习的草图分割方法,草图分割的精确度和效率也都得到了较大提升.但是,由于草图自身的抽象性、稀疏性和多样性,草图分割仍然是一个非常具有挑战性的课题.对基于深度学习的草图分割算法进行整理、分类、分析和总结,首先阐述了3种基本的草图表示方法与常用的草图分割数据集,再按草图分割算法的预测结果分别介绍了草图语义分割、草图感知聚类与草图解析算法,然后在主要的数据集上收集与整理草图分割算法的评测结果并对结果进行分析,最后总结了草图分割相关的应用并探讨未来可能的发展方向.

关 键 词:草图分割  感知聚类  语义分割  草图解析
收稿时间:2020-08-07
修稿时间:2020-10-13

Survey on Sketch Segmentation Algorithm Based on Deep Learning
WANG Jia-Xin,ZHU Zhi-Liang,DENG Xiao-Ming,MA Cui-Xi,WANG Hong-An. Survey on Sketch Segmentation Algorithm Based on Deep Learning[J]. Journal of Software, 2022, 33(7): 2729-2752
Authors:WANG Jia-Xin  ZHU Zhi-Liang  DENG Xiao-Ming  MA Cui-Xi  WANG Hong-An
Affiliation:School of Computer Science and Technology, University of Chinese Academy of Sciences, Beijing 100049, China;State Key Laboratory of Computer Science (Institute of Software, Chinese Academy of Sciences), Beijing 100190, China;Beijing Key Laboratory of Human-Computer Interaction (Institute of Software, Chinese Academy of Sciences), Beijing 100190, China;State Key Laboratory of Computer Science (Institute of Software, Chinese Academy of Sciences), Beijing 100190, China;Beijing Key Laboratory of Human-Computer Interaction (Institute of Software, Chinese Academy of Sciences), Beijing 100190, China;School of Software, East China Jiaotong University, Nanchang 330013, China
Abstract:Sketches have always been one of the important tools for human communication. As it can express some complex human thoughts quickly in a succinct form, the sketch processing algorithm is one of the research hotspots in the filed of computer vision. Currently, the research on sketches mainly focuses on the recognition, retrieval, and completion. As researchers focus on the fine-grained operation of sketches, research on sketch segmentation has also received more and more attention. In recent years, with the development of deep learning and computer vision technology, a large number of sketch segmentation methods based on deep learning have been proposed. Moreover, the accuracy and efficiency of sketch segmentation have also been significantly increased. Nevertheless, sketch segmentation is still a very challenging topic because of the abstraction, sparsity, and diversity of sketches. This study organizes, categorizes, analyzes, and summarizes the sketch segmentation algorithm based on deep learning to solve the above deficiency. Firstly, three basic sketch representation methods and commonly used sketch segmentation datasets are shown. According to the sketch segmentation algorithm prediction results, sketch semantic segmentation, sketch perceptual grouping, and sketch parsing are introduced respectively. Moreover, the evaluation results of sketch segmentation are collected and analyzed on the primary data sets. Finally, the application of sketch segmentation is summarized and the possible future development direction is discussed.
Keywords:sketch segmentation|perceptual grouping|semantic segmentation|sketch parsing
本文献已被 万方数据 等数据库收录!
点击此处可从《软件学报》浏览原始摘要信息
点击此处可从《软件学报》下载全文
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号