基于密令位置信息特征的问题生成

问题生成是指在理解特定陈述句语义的前提下,自动地生成一条或多条关于该陈述句的问题。该文主要针对其中一项子任务开展研究,即一对一的问题生成(Point-wise Question Generation,PQG)。现有PQG研究,主要以端到端的序列化生成模型为框架,相应方法生成的问句,在流畅度方面已达到有限的可接受度(BlEU-4约13%)。尽管如此,现有方法缺乏语块一级的注意力建模,从而无法将"潜在提问对象"的语义独立且整体地纳入表示学习过程。这一不足往往负面影响解码端的问题类型预测和提问词估计。针对这一问题,该文提出了一种融合密令注意力机制的端对端PQG模型。其中,密令是对短语和语块一级的潜在答案的总体概括,其往往表现为陈述句中的一组连续的词项。在方法实现方面,该文在端对端架构的编码过程中,将密令的位置信息与全句语义信息进行融合,而在解码过程中,则加强了针对密令的注意力。实验采用SQuAD语料予以实施,测试结果显示,该文所提方法的性能优于现有主流模型,其获得的BLEU-4指标高于基准系统1.98%。

Question Generation Based on Information Features of Token Position

The question generation task aims to automatically generate one or more questions on the condition of understanding the semantics of a declarative sentence. This paper focuses on one of the sub-tasks, Point-wise Question Generation (PQG), and proposes a seq2seq PGQ model that combines attention mechanism about tokens. Among them, the token is a general summary of the potential answers for the sentences level, which is often shown as a series of consecutive terms in a declarative sentence. In terms of method implementation, the position information of the token and the semantic information of the whole sentence are integrated in the process of encoding. While in the process of decoding, the attention of token is strengthened. The experiment is carried out on the SQuAD corpus, revealing a better performance of 1.98% improvement in BLEU-4.