首页 | 本学科首页   官方微博 | 高级检索  
     

面向细粒度草图检索的对抗训练三元组网络
引用本文:陈健,白琮,马青,郝鹏翼,陈胜勇.面向细粒度草图检索的对抗训练三元组网络[J].软件学报,2020,31(7):1933-1942.
作者姓名:陈健  白琮  马青  郝鹏翼  陈胜勇
作者单位:浙江工业大学计算机科学与技术学院,浙江杭州 310023;浙江工业大学计算机科学与技术学院,浙江杭州 310023;浙江工业大学理学院,浙江杭州 310023;天津理工大学计算机科学与工程学院,天津300384
基金项目:国家重点研发计划(2018YFB1305200);浙江省自然科学基金(LY18F020032,LY18F020034);浙江省教育厅项目(Y201839922)
摘    要:将草图作为检索示例用于图像检索称之为基于草图的图像检索.在这其中,细粒度检索问题或类内检索问题是2014年被研究者提出并快速成为广受关注的研究方向.目前研究者通常用三元组网络来解决类内检索问题,且取得了不错的效果.但是三元组网络的训练非常困难,很多情况下很难收敛甚至不收敛,且存在着容易过拟合的风险.本文借鉴循环生成对抗训练的思想,设计了SketchCycleGAN帮助提高三元组网络训练过程的效率,以对抗训练的方式使其参与到三元组网络的训练过程中,通过充分挖掘数据集自身信息的方式取代了利用其他数据集进行预训练的过程,在简化训练步骤的基础上取得了更好的检索性能.通过在常用的细粒度草图检索数据集上的一系列对比实验,证明了所提方法的有效性和优越性.

关 键 词:基于草图的图像检索  细粒度检索  三元组网络  对抗训练
收稿时间:2019/5/2 0:00:00
修稿时间:2019/7/11 0:00:00

Adversarial Training Triplet Network for Fine-grained Sketch Based Image Retrieval
CHEN Jian,BAI Cong,MA Qing,HAO Peng-Yi,CHEN Sheng-Yong.Adversarial Training Triplet Network for Fine-grained Sketch Based Image Retrieval[J].Journal of Software,2020,31(7):1933-1942.
Authors:CHEN Jian  BAI Cong  MA Qing  HAO Peng-Yi  CHEN Sheng-Yong
Affiliation:School of Computer Science and Technology, Zhejiang University of Technology, Hangzhou 310023, China,School of Computer Science and Technology, Zhejiang University of Technology, Hangzhou 310023, China,School of Computer Science and Technology, Zhejiang University of Technology, Hangzhou 310023, China;College of Science, Zhejiang University of Technology, Hangzhou 310023, China,School of Computer Science and Technology, Zhejiang University of Technology, Hangzhou 310023, China and College of Computer Science and Engineer, Tianjin University of Technology, Tianjin 300384, China
Abstract:Sketch based image retrieval means that the sketch is used as the query in the retrieval. Fine-grained image retrieval or intra-category retrieval was proposed in 2014 and attracted more attentions quickly. Triplet network is often used to do fine-grained retrieval and get promising performance. However, training triplet network is quite difficult, it is hard to converge and easy to over-fit in some situations. Inspired by the adversarial training, this paper proposes SketchCycleGAN to improve the efficiency of the triplet network training process. In this proposal, pre-training the networks with other database is replaced by mining the information inside the database with the help of adversarial training. That could simplify the training procedure with better performance. This proposal could get better performance than other state-of-the-art methods in a series of experiments executed on widely used databases for fine-grained sketch based retrieval.
Keywords:Sketch based image retrieval  fine-grained retrieval  triplet network  adversarial training
本文献已被 万方数据 等数据库收录!
点击此处可从《软件学报》浏览原始摘要信息
点击此处可从《软件学报》下载全文
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号