基于BERT-FNN的意图识别分类

意图识别分类是自然语言处理领域的一个热点问题，在智能机器人、智能客服中如何根据上下文理解用户意图是一个重点问题，同时也是一个难点问题。传统的意图识别分类主要是采用基于规则、模板匹配的正则化方法或基于机器学习的方法，然而却存在计算成本高、泛化能力差的问题。针对上述问题，本文设计以Google公开的BERT预训练语言模型为基础，进行输入文本的上下文建模和句级别的语义表示,采用［cls］符号(token)对应的向量代表文本的上下文，再通过全连接神经网络(FNN)对语句进行特征提取，为了充分利用数据，本文利用拆解法的思想，将多分类问题转换成多个二分类问题处理，每次将一个类别作为正例，其余类别均作为负例，产生多个二分类任务，从而实现意图分类。实验结果表明，该方法性能优于传统模型，可以获得94%的准确率。

Intention Recognition and Classification Based on BERT-FNN

Intention recognition classification is an important question in the field of natural language processing. How to understand the user’s intention based on context is a key and difficult problem in intelligent robots and intelligent customer service. Traditional intention recognition classification is mainly based on regularization methods or machine learning methods. However, there are problems of high computational cost and poor generalization ability. In response to the above problems, the design of this paper is based on Google’s BERT pre-training language model to perform context modeling and sentence-level semantic representation of the text, uses the vector corresponding to the ［cls］ token to represent the context of the text, then, extracts the feature of sentences through fully-connected neural network (FNN). In order to make full use of the data, this paper uses the idea of disassembly method to convert the multi-classification problem into multiple binary classification problems. Each time, one category is used as a positive example, and the remaining categories are used as negative examples, which generates multiple two-classification tasks so as to achieve intention classification. Experimental results show that the performance of this method is better than the traditional model, and the accuracy of this method is 94%.