视觉问答技术研究

随着深度学习在计算机视觉、自然语言处理领域取得的长足进展，现有方法已经能准确理解视觉对象和自然语言的语义，并在此基础上开展跨媒体数据表达与交互研究.近年来，视觉问答(visual question answering, VQA)是跨媒体表达与交互方向上的研究热点问题.视觉问答旨在让计算机理解图像内容后根据自然语言输入的查询进行自动回答.围绕视觉问答问题，从概念、模型、数据集等方面对近年来的研究进展进行综述，同时探讨现有工作存在的不足；最后从方法论、应用和平台等多方面对视觉问答未来的研究方向进行了展望.

Research on Visual Question Answering Techniques

With the significant advances of deep learning in computer vision and natural language processing, the existing methods are able to accurately understand the semantics of visual contents and natural languages, and carry out research on cross-media data representation and interaction. In recent years, visual question answering (VQA) has become a hot spot in cross-media expression and interaction area. The target of VQA is to learn a model to understand the visual content referred by a natural language question, and answer it automatically. This paper summarizes the research progresses in recent years on VQA from the aspects of concepts, models and datasets, and discusses the shortcomings of the current works. Finally, the possible future directions of VQA are discussed on methodology, applications and platforms.