一种基于SVM向量机的手势识别算法

在传统的手势识别中,多数是通过人工神经网络,隐Markov模型和几何边缘特征等算法。以一种改进的SVM统计向量机算法对手势特征集进行精确识别,通过进行适当函数子集的选择,使判别函数的识别率达到最优,得到一个具有推广泛化能力和最优分类能力学习机,该方法能够保证特征子集的划分的识别效果等价于对整个样本集。通过Kinect进行手势识别测试,结果表明基于改进的SVM向量机手势识别算法具有较好的精确性和准确度。     

一种改进的基于误差最小化的极限学习机

在基于误差最小化的极限学习机（EM_ELM）的基础上,提出了一种改进的基于误差最小化的极限学习机,输入权重和偏置采用递归最小二乘法获得.实验证明,该方法具有更快的学习速度、良好的预测精度和更精简的网络结构.     

基于局部深度一致性的自监督手部姿态估计

基于深度图的3D手部姿态估计通常需要大量人工标注数据以达到高精确度和鲁棒性，然而关节点标注过程冗杂且存在一定误差.现有研究工作使用自监督方法解决对标注数据的依赖，通过在虚拟数据集上预训练网络，并在无标注的真实数据集上进行模型拟合，实现3D姿态估计.自监督方法的关键在于设计模型拟合的能量函数以减小模型在真实数据集上的精度下降程度.为了减小模型拟合难度，本文提出局部深度一致性损失，依据初始姿态估计结果，提取输入与输出深度图的局部表征，将深度图显式地解耦为以关节点为中心的不同区域.通过有针对性地对不同关节点进行局部优化，减少虚拟与真实深度图之间的固有领域误差对网络学习的影响，增加训练的稳定性.本文方法在NYU数据集上相比基础方法平均关节点误差提升了21.9%.     

基于微分搜索的高光谱图像非线性解混算法

针对线性混合模型在实际高光谱图像解混过程中的局限性,提出一种新的基于微分搜索的非线性高光谱图像解混算法.在广义双线性模型的基础上采用重构误差作为解混的目标函数,将非线性解混问题转化为最优化问题.将目标函数中的待求参数映射为微分搜索过程中的位置变量,利用微分搜索算法对目标函数进行优化求解.在求解过程中,通过执行搜索范围控制等机制满足高光谱图像解混的约束要求,进而求得丰度系数和非线性参数,实现非线性高光谱图像解混.仿真数据和真实遥感数据实验结果表明,所提出的非线性解混算法可以有效克服线性模型下解混算法的局限性,避免了由于使用梯度类优化方法而易陷入局部收敛的问题,较之其它高光谱图像解混算法具有更好的解混精度.     

一种新的基于水平集方法的SAR图像分割算法

本文基于Aubert-Aujol（AA）模型和变分水平集方法提出一个新的SAR图像分割模型;在反应-扩散框架下,将各项同性扩散算子加入到该模型的水平集演化方程中,并提出一个两步分裂水平集演化算法,该算法不需要周期性地更新水平集函数。通过对合成图像和Envisat SAR图像的分割实验,表明本文提出的算法具有较准确的边缘定位能力和噪声抑制能力。     

一种基于IQP的稳定IIR微分器设计新算法

在分析基于常规QP方法来设计稳定IIR微分器而存在的苛刻的稳定性约束和代价函数不可靠两点不足的基础上，本文提出了一种新的基于IQP的稳定IIR微分器设计算法，本算法应用Rouche定理和有关的收敛准则，解决了稳定性和代价函数存在的问题，从而有效地减少了微分器的设计误差，改善了微分器的性能，使得新的设计方法更加完善、可靠。实例证明了这种设计方法的合理性、可行性，从而为它更加宽广的应用前景奠定了基础。     

无线传感器网络中基于接近度的无需测距定位算法

针对当前无需测距定位算法存在定位误差大的问题,本文提出了一种基于接近度的无需测距定位算法,接近度是本文定义的一个用来表示邻居节点距离远近的值.首先根据邻居节点之间的几何特征和邻居关系推导出一个线性函数,函数输出是接近度.然后用锚节点之间的距离和接近度计算一个矫正值,矫正值和邻居节点之间接近度的乘积作为邻居节点之间的估计距离.最后根据估计距离计算未知节点的估计位置.仿真结果表明,本文算法的估计距离误差和定位误差都要低于当前同类型定位算法.     

微处理器控制的纠错分组码之软判决译码

软判决译码提供了一种手段,籍以弥补硬判决界距译码的分组误差控制系统与最大似然译码系统之间的性能差距.但是,根据硬件要求,现有的算法似嫌复杂.在误差捕捉译码的基础上,本文提出了一种软判决译码的新算法.以编码增益和译码延迟的折衷为交换条件,该类软判决译码硬件要求较为简单.此外,本文还描述了用微型处理器控制来实现这些算法,并探讨了译码器的性能以及高斯噪声条件下的折衷办法.     

小波核极限学习机分类器

分析了核极限学习机的原理,提出了一种小波核极限学习机,将小波函数做为极限学习机的核函数,证明了它是一种允许的极限学习机核。通过在双螺旋数据上的测试表明,小波核极限学习机在无训练数据分布的空间也具有分类能力,而高斯核极限学习机在没有训练数据分布的空间不具备分类能力。通过在不同的UCI数据集中的测试得出小波核极限学习机具有较高的分类性能。最后将小波核极限学习机应用到了人脸识别问题上,同样取得了优良的性能,说明小波核极限学习机具有一定的应用价值。     

一种用于前向分组数据业务的新调度算法

该文通过分析前向分组数据业务中应用的各种调度算法的性能,指出调度算法的吞吐量和公平性之间必然存在着折衷关系.在满足给定的公平性要求的情况下,吞吐量累积分布函数曲线越靠近公平性准则,吞吐量越高.基于这个认识,该文提出一种新的调度算法,它可以通过调节参数来改变吞吐量和公平性曲线的关系.而且,从吞吐量和公平性曲线折衷的角度出发,可以比较容易地找出一种近似最优解.     

Online Regularized Classification Algorithms

This paper considers online classification learning algorithms based on regularization schemes in reproducing kernel Hilbert spaces associated with general convex loss functions. A novel capacity independent approach is presented. It verifies the strong convergence of the algorithm under a very weak assumption of the step sizes and yields satisfactory convergence rates for polynomially decaying step sizes. Explicit learning rates with respect to the misclassification error are given in terms of the choice of step sizes and the regularization parameter (depending on the sample size). Error bounds associated with the hinge loss, the least square loss, and the support vector machine q-norm loss are presented to illustrate our method     

基于卷积神经网络的业务识别

基于机器学习的业务识别对扩展网络功能,实现网络的精细化管控具有重要意义.目前基于机器学习的业务识别方法主要通过分析业务流的统计特征来实现,而从业务流中提取有效特征比较困难,因此识别精度不高.针对此问题,首先提出一种基于卷积神经网络(Convolutional Neural Network,CNN)的业务识别方法,并进行...     

基于局部行为搜索策略的半监督学习算法及其应用研究

近年来,半监督学习在模式识别和机器学习领域引起了广泛关注。在这些方法中,半监督支持向量机是非常主流的一类方法。然而,学习过程中热核函数的参数选择问题一直困扰着研究人员,若选取不当,学习性能会显著下降。为了解决该问题,本文提出一种新颖的基于局部行为搜索策略的半监督学习算法。新算法基于人类行为搜索策略,传统的支持向量机被正则化为拉普拉斯图。在搜索到特征空间的局部分布后,行为因子能够映射到样本邻域的潜在概率分布。为验证新算法有效性,本文分别进行了UCI数据集和实际通信辐射源特征数据集实验。实验结果显示与传统方法相比,新算法的分类结果能够更加有效和稳定。      

Hyperparameter Optimization for Machine Learning Models Based on Bayesian Optimization

Hyperparameters are important for machine learning algorithms since they directly control the behaviors of training algorithms and have a significant effect on the performance of machine learning models. Several techniques have been developed and successfully applied for certain application domains. However, this work demands professional knowledge and expert experience. And sometimes it has to resort to the brute-force search. Therefore, if an efficient hyperparameter optimization algorithm can be developed to optimize any given machine learning method, it will greatly improve the efficiency of machine learning. In this paper, we consider building the relationship between the performance of the machine learning models and their hyperparameters by Gaussian processes. In this way, the hyperparameter tuning problem can be abstracted as an optimization problem and Bayesian optimization is used to solve the problem. Bayesian optimization is based on the Bayesian theorem. It sets a prior over the optimization function and gathers the information from the previous sample to update the posterior of the optimization function. A utility function selects the next sample point to maximize the optimization function. Several experiments were conducted on standard test datasets. Experiment results show that the proposed method can find the best hyperparameters for the widely used machine learning models, such as the random forest algorithm and the neural networks, even multi-grained cascade forest under the consideration of time cost.     

Can threshold networks be trained directly?

Neural networks with threshold activation functions are highly desirable because of the ease of hardware implementation. However, the popular gradient-based learning algorithms cannot be directly used to train these networks as the threshold functions are nondifferentiable. Methods available in the literature mainly focus on approximating the threshold activation functions by using sigmoid functions. In this paper, we show theoretically that the recently developed extreme learning machine (ELM) algorithm can be used to train the neural networks with threshold functions directly instead of approximating them with sigmoid functions. Experimental results based on real-world benchmark regression problems demonstrate that the generalization performance obtained by ELM is better than other algorithms used in threshold networks. Also, the ELM method does not need control variables (manually tuned parameters) and is much faster.     

An original approach to positioning with cellular fingerprints based on decision tree ensembles

In addition to being a fundamental infrastructure for communication, cellular networks are increasingly employed for outdoor positioning through signal fingerprinting. In this respect, the choice of the specific strategy used to obtain a position estimation from fingerprints plays a major role in determining the overall accuracy. In this paper, we propose a novel fingerprint comparison method, to be used in dynamic and large-scale contexts, such as the outdoor one, based on a machine learning approach. We explore two possible machine learning solutions, that make use of decision tree ensembles and support vector machines, respectively, and carefully contrast and evaluate them against a set of well-known, state-of-the-art fingerprint comparison functions from the literature. Tests are carried out with different tracking devices and environmental settings. It turns out that the machine learning approach, especially when implemented using decision tree ensembles, provides consistently better estimations than all the other considered strategies.     

一种基于反向学习的约束差分进化算法

差分进化算法是一种结构简单、易用且鲁棒性强的全局搜索启发式优化算法,它可以结合约束处理技术来解决约束优化问题.机器学习在进化算法中,经常可以引导种群的进化,而且被广泛地应用于无约束的差分进化算法中,但对于约束差分进化算法却很少有应用.针对这一情况,提出了一种基于反向学习的约束差分进化算法框架.该算法框架采用基于反向学习的机器学习方法,提高约束差分进化算法的多样性和加速全局收敛速度.最后把该算法框架植入了两个著名的约束差分进化算法:(μ+λ)-CDE和ECHT,并采用CEC 2010的18个Benchmark函数进行了实验评估,实验结果表明:与(μ+λ)-CDE和ECHT相比,植入后的算法具有更强的全局搜索能力、更快的收敛速度和更高的收敛精度.     

基于主动学习的支持向量机算法

针对支持向量机（svM）模型不能有效处理海量数据挖掘的问题,提出一种改进的基于主动学习的支持向量机（AL_SVM）方法。该方法首先将训练集随机划分为多个独立同分布的子集,并选择其中一个子集作为初始训练集来训练SVM得到初始分类器和支持向量集,然后根据已经得到的分类器信息在剩余样本集中选择对于分类器改进作用最大的有价值样本。并与已得到的支持向量集合并构成新训练集,以更新分类器,从而在保留重要支持向量信息的前提下,去除大量不重要的支持向量,一定程度上避免了过学习问题,提高了学习效率。实验表明,AL_SVM方法能够在保持学习器泛化能力的同时提高其学习效率。     

基于旋转学习机制的差分演化算法

为克服反向学习机制仅能搜索反向空间中一个固定点的弊端,通过引入旋转操作将其扩展为一种新的旋转学习机制,新机制通过调整旋转角度能搜索旋转空间中的任意一点,具备更强的勘探能力和多种应用模式.通过嵌入旋转学习算子,并引入参数自适应机制,提出了新的基于旋转学习的差分演化算法.在广泛使用的测试函数集上开展仿真实验,结果验证了旋转学习机制的有效性,与多种知名差分演化算法相比,新算法在寻优性能上竞争优势明显,且具有良好的适用性.     

Intelligent laser welding through representation,prediction, and control learning: An architecture with deep neural networks and reinforcement learning

Laser welding is a widely used but complex industrial process. In this work, we propose the use of an integrated machine intelligence architecture to help address the significant control difficulties that prevent laser welding from seeing its full potential in process engineering and production. This architecture combines three contemporary machine learning techniques to allow a laser welding controller to learn and improve in a self-directed manner. As a first contribution of this work, we show how a deep, auto-encoding neural network is capable of extracting salient, low-dimensional features from real high-dimensional laser welding data. As a second contribution and novel integration step, these features are then used as input to a temporal-difference learning algorithm (in this case a general-value-function learner) to acquire important real-time information about the process of laser welding; temporally extended predictions are used in combination with deep learning to directly map sensor data to the final quality of a welding seam. As a third contribution and final part of our proposed architecture, we suggest that deep learning features and general-value-function predictions can be beneficially combined with actor–critic reinforcement learning to learn context-appropriate control policies to govern welding power in real time. Preliminary control results are demonstrated using multiple runs with a laser-welding simulator. The proposed intelligent laser-welding architecture combines representation, prediction, and control learning: three of the main hallmarks of an intelligent system. As such, we suggest that an integration approach like the one described in this work has the capacity to improve laser welding performance without ongoing and time-intensive human assistance. Our architecture therefore promises to address several key requirements of modern industry. To our knowledge, this architecture is the first demonstrated combination of deep learning and general value functions. It also represents the first use of deep learning for laser welding specifically and production engineering in general. We believe that it would be straightforward to adapt our architecture for use in other industrial and production engineering settings.