5G核心网业务模型的智能化预测研究

摘 要：核心网业务模型的建立是5G网络容量规划和网络建设的基础，通过现有方法得到的理论业务模型是静态不可变的且与实际网络存在偏离。为了克服现有5G核心网业务模型与现网模型适配性较差以及规划设备无法满足用户实际业务需求的问题，提出了一种长短期记忆（long short-term memory，LSTM）网络与卷积LSTM （convolution LSTM，ConvLSTM）网络双通道融合的 5G 核心网业务模型预测方法。该方法基于人工智能（artificial intelligence，AI）技术以实现高质量的核心网业务模型的智能预测，形成数据反馈闭环，实现网络自优化调整，助力网络智能化建设。     

基于并行多通道卷积长短时记忆网络的轴承寿命预测方法

在预测轴承剩余使用寿命时，数据间的时序特性是一个可以利用的重要隐藏信息。为了更好地提取具有时序信息的特征用于预测，提出了一种基于并行多通道卷积长短时记忆网络（PMCCNN-LSTM）的剩余使用寿命预测模型。该模型主要由两部分组成：前端为并行多通道卷积网络（PMCCNN），提取信号特征，挖掘数据的时序特性，并采用逐层训练和微调的方式提升参数的收敛性；后端为长短时记忆（LSTM）网络，基于特征进行剩余使用寿命预测，并采用加权平均的方法对预测结果进行平滑处理。在一个轴承加速寿命实验的公开数据集上使用留一法验证了该模型的准确性，实验结果表明：所提模型的平均误差与最大误差分别比传统的卷积神经网络（CNN）低23.38%和15.84%，比传统的LSTM低24.14%和19.01%，比卷积长短时记忆网络（CNN-LSTM）低30.32%和23.09%。     

Soft sensing of water depth in combined sewers using LSTM neural networks with missing observations

Information and communication technologies combined with in-situ sensors are increasingly being used in the management of urban drainage systems. The large amount of data collected in these systems can be used to train a data-driven soft sensor, which can supplement the physical sensor. Artificial Neural Networks have long been used for time series forecasting given their ability to recognize patterns in the data. Long Short-Term Memory (LSTM) neural networks are equipped with memory gates to help them learn time dependencies in a data series and have been proven to outperform other type of networks in predicting water levels in urban drainage systems. When used for soft sensing, neural networks typically receive antecedent observations as input, as these are good predictors of the current value. However, the antecedent observations may be missing due to transmission errors or deemed anomalous due to errors that are not easily explained. This study quantifies and compares the predictive accuracy of LSTM networks in scenarios of limited or missing antecedent observations. We applied these scenarios to an 11-month observation series from a combined sewer overflow chamber in Copenhagen, Denmark. We observed that i) LSTM predictions generally displayed large variability across training runs, which may be reduced by improving the selection of hyperparameters (non-trainable parameters); ii) when the most recent observations were known, adding information on the past did not improve the prediction accuracy; iii) when gaps were introduced in the antecedent water depth observations, LSTM networks were capable of compensating for the missing information with the other available input features (time of the day and rainfall intensity); iv) LSTM networks trained without antecedent water depth observations yielded larger prediction errors, but still comparable with other scenarios and captured both dry and wet weather behaviors. Therefore, we concluded that LSTM neural network may be trained to act as soft sensors in urban drainage systems even when observations from the physical sensors are missing.     

Using deep learning to combine static and dynamic power analyses of cryptographic circuits

Side-channel attacks have shown to be efficient tools in breaking cryptographic hardware. Many conventional algorithms have been proposed to perform side-channel attacks exploiting the dynamic power leakage. In recent years, with the development of processing technology, static power has emerged as a new potential source for side-channel leakage. Both types of power leakage have their advantages and disadvantages. In this work, we propose to use the deep neural network technique to combine the benefits of both static and dynamic power. This approach replaces the classifier in template attacks with our proposed long short-term memory network schemes. Hence, instead of deriving a specific probability density model for one particular type of power leakage, we gain the ability of combining different leakage sources using a structural algorithm. In this paper, we propose three schemes to combine the static and dynamic power leakage. The performance of these schemes is compared using simulated test circuits designed with a 45-nm library.     

融合情感与语义信息的情感分析方法

在使用词嵌入法进行词转向量时，两个反义词会转换成相近的向量。如果这两个词是情感词，将会导致词的情感信息的丢失，这在情感分析任务中是不合理的。为了解决这个问题，提出了一种在词嵌入的基础上增加情感向量来获取情感信息的方法。首先利用情感词典资源构建情感向量，将其与词嵌入法得到的词向量融合在一起；然后采用双向长短期记忆（BiLSTM）网络获取文本的特征；最后对文本的情感进行分类。在4个数据集上分别对该方法与未融合情感向量的方法进行了实验。实验结果表明所提方法分类准确度与F1值都高于未融合方法，说明了加入情感向量有助于提高情感分析的性能。     

基于深度学习的动态手势识别方法

为了提高动态手势的识别准确率,并避免动态手势的数据预分割和后输出处理过程,设计了一种融合卷积神经网络(CNN)和双向长短时记忆(BiLSTM),引入连接主义时间分类(CTC)作为损失函数的串联型网络模型。使用CTC训练网络来判断输入流中的类标签,以完成动态手势的识别工作。在公开视频手势数据集Jester和通过Kinect自建的包含9个动态手势的数据集上进行了实验验证,结果表明提出的串联型融合网络模型在Jester上能得到较高的识别率,并且引入CTC算法用于手势识别领域是可行的,该方法高效且具有很高的识别率,对9个动态手势最好识别正确率可达98.11%。     

基于LSTM神经网络的流域污染物通量预测

针对流域水文和污染物迁移转化过程模型受限于模型初始条件、边界条件、数值分辨率、参数敏感等及现有的深度学习模型对污染物通量时间序列数据解析缺少物理机制的问题,提出了基于长短时记忆神经网络（LSTM）的流域污染物通量预测模型。借助深度学习框架Keras,构建了多变量时间序列预测模型。选择气象数据作为流域产汇污过程的驱动因子、前期降雨量作为表征流域土壤干湿程度的指标,基于以上指标在不同降雨强度、月份、水文期的污染物通量的差异性分析,确定了模型的输入端特征;使用基于LSTM的时间模拟器识别了历史数据间的固有特征及输入特征间的复杂非线性关系;通过基于该模型的流域污染物日通量模拟值和实测值的比较,以及与流域分布式水文和污染物迁移转化过程模型（SWAT模型）的对比分析,评价了模型的预测性能,分析了不同输入特征的贡献率,验证了使用该模型预测流域污染物通量的可行性。该预测模型可为流域污染物通量预测提供一种新的思路。     

基于长短期记忆网络的PMU不良数据检测方法

同步相量测量单元(Phasor Measurement Units, PMUs)因其同步性、快速性和准确性,已成为复杂电力系统状态感知的最有效工具之一。但是,现场的复杂环境导致PMU数据存在数据丢失、数据损坏、同步异常、噪声影响等质量问题,严重影响其在系统中的各类应用,甚至威胁电网安全稳定运行。提出了一种基于长短期记忆(Long Short-Term Memory,LSTM)网络的PMU不良数据检测方法。首先分析了LSTM在不良数据检测中的优势。然后基于LSTM网络对时间序列选择记忆的特性,构造了一种双层LSTM网络架构,提出了对原始数据的分解重构方法。在此基础上,定义了两种目标函数,以获得不同的误差特征。提出了一种基于决策树的不良数据阈值确定方法,实现了不良数据的有效检测。通过大量仿真与实测数据验证了该方法的可行性和准确性,可提高PMU数据质量,使其更好地应用于电力系统的各个方面。