CAD package for industrial process identification

A CAD system for off-line industrial process identification is presented. The system has two modules. In the first data acquisition is performed. The second performs the process identification procedure. The functions and facilities of these methods are described, which include: the configuration of the data acquisition procedure to be performed, preliminary data analysis, model structure and parameter estimation method selection, time varying parameter estimation and model validation. An industrial application in petrochemical process identification is presented.     

On-line identification of a heat exchanger with a process computer—A case study

For on-line identification and parameter estimation of industrial processes with process computers an identification program package was developed. Three appropriate identification methods can be selected: recursive least squares, recursive instrumental variables and recursive correlation analysis with least squares. The program package also includes: signal generation, determination of model order and time delay, data filtering for the elimination of low frequent disturbances, model verification and plotting of intermediate and final results. Practical results and comparisons with the identification package are shown for an industrial size steam-heated heat exchanger.     

An iterative algorithm for simulation error based identification of polynomial input–output models using multi-step prediction

Effective identification of polynomial input–output models for applications requiring long-range prediction or simulation performance relies on both careful model selection and accurate parameter estimation. The simulation error minimisation (SEM) approach has been shown to provide significant advantages in the model selection phase by ruling out candidate models with good short-term prediction capabilities but unsuitable long-term dynamics. However, SEM-based parameter estimation has been generally avoided due to excessive computational effort. This article extends to the nonlinear case a computationally efficient approach for this task, that was previously developed for linear models, based on the iterative estimation of predictors with increasing prediction horizon. Conditions for the applicability of the approach to various model classes are also discussed. Finally, some examples are provided to show the effectiveness and computational convenience of the proposed algorithm for polynomial input–output identification, as well as the improvements achievable by enforcing SEM parameter estimation. A benchmark for nonlinear identification is also analysed, with encouraging results.     

Identification of polynomial input/output recursive models with simulation error minimisation methods

Polynomial input/output (I/O) recursive models are widely used in nonlinear model identification for their flexibility and representation capabilities. Several identification algorithms are available in the literature, which deal with both model selection and parameter estimation. Previous works have shown the limitations of the classical prediction error minimisation approach in this context, especially (but not only) when the disturbance contribution is unknown, and suggested the use of a simulation error minimisation (SEM) approach for a better selection of the I/O model. This article goes a step further by integrating the model selection procedure with a simulation-oriented parameter estimation algorithm. Notwithstanding the algorithmic and computational complexity of the proposed method, it is shown that it can sometimes achieve great performance improvements with respect to previously proposed approaches. Two different parameter estimation algorithms are suggested, namely a direct SEM optimisation algorithm, and an approximate method based on multi-step prediction iteration, which displays several convenient properties from the computational point of view. Several simulation examples are shown to demonstrate the effectiveness of the suggested SEM approaches.     

Survey of applications of identification in chemical and physical processes

Applications of system identification techniques to chemical, metallurgical, paper and pulp, cement and glass industries are surveyed. It is demonstrated that identification is a useful tool to determine process dynamics. This is true, particularly for processes which are difficult to model from basic physical laws only, such as blast furnaces, paper machines and cement kilns. Valuable knowledge is provided for design of regulators, as well as for design of new processes or redesign of the actual processes. Problems that play an important role in identification of real processes are discussed from a practical point of view. Experiment design, structure determination, parameter estimation, model verification and data handling are treated. The main conclusion is that interactive programs are very efficient for the handling of all the phases of model building due to its iterative nature.     

基于残差方差的系统阶次和参数辨识算法

系统辨识的研究一般是将系统的阶次辨识和参数估计分开的,但实际应用过程中这两个问题又是紧密相关的。有的模型阶次辨识过程是伴随着模型的参数估计,因此可以对这类阶次辨识方法同参数估计的方法进行融合和扩展。针对输出误差系统,借助辅助模型推导出基于残差方差递推算法,利用该算法辨识出了模型的阶次和参数,减少了传统系统辨识过程的计算量和辨识时间。     

An optimal IV technique for identifying continuous-time transfer function model of multiple input systems

An instrumental variable method for continuous-time model identification is proposed for multiple input single output systems where the characteristic polynomials of the transfer functions associated with each input are not constrained to be identical. An associated model order determination procedure is shown to be reasonably successful. Monte Carlo simulation analyses are used to demonstrate the properties and general robustness of the model order selection and parameter estimation schemes. The results obtained to model a winding process and an industrial binary distillation column illustrate the practical applicability of the proposed identification scheme.     

Multivariable process identification for mpc: the asymptotic method and its applications

In this work we will introduce the asymptotic method (ASYM) of identification and provide two case studies. The ASYM was developed for multivariable process identification for model based control. The method calculates time domain parametric models using frequency domain criterion. Fundamental problems, such as test signal design for control, model order/structure selection, parameter estimation and model error quantification, are solved in a systematic manner. The method can supply not only input/output model and unmeasured disturbance model which are asymptotic maximum likelihood estimates, but also the upper bound matrix for the model errors that can be used for model validation and robustness analysis. To demonstrate the use of the method for model predictive control (MPC), the identification of a Shell benchmark process (a simulated distillation column) and an industrial application to a crude unit atmospheric tower will be presented.     

M-estimator and D-optimality model construction using orthogonal forward regression.

This correspondence introduces a new orthogonal forward regression (OFR) model identification algorithm using D-optimality for model structure selection and is based on an M-estimators of parameter estimates. M-estimator is a classical robust parameter estimation technique to tackle bad data conditions such as outliers. Computationally, The M-estimator can be derived using an iterative reweighted least squares (IRLS) algorithm. D-optimality is a model structure robustness criterion in experimental design to tackle ill-conditioning in model structure. The orthogonal forward regression (OFR), often based on the modified Gram-Schmidt procedure, is an efficient method incorporating structure selection and parameter estimation simultaneously. The basic idea of the proposed approach is to incorporate an IRLS inner loop into the modified Gram-Schmidt procedure. In this manner, the OFR algorithm for parsimonious model structure determination is extended to bad data conditions with improved performance via the derivation of parameter M-estimators with inherent robustness to outliers. Numerical examples are included to demonstrate the effectiveness of the proposed algorithm.     

基于行列式比的阶次和参数同步递推辨识算法

针对输出误差模型,结合辅助模型的思想对原有阶次辨识和参数估计的方法进行融合和扩展,推导出基于辅助模型的行列式比定阶法,同时得出模型的阶次和参数,不仅减少了辨识过程的计算量,也节约了辨识时间。考虑到原有行列式比定阶法可能存在的不准确性,提出了一种系统模型的确认方法,增强了阶次辨识能力。仿真实验也充分表明,对行列式比定阶法的扩展不仅可以准确地辨识出系统的阶次,得出的参数估计值也有较高的精度。     

On time series model selection involving many candidate ARMA models

We study how to perform model selection for time series data where millions of candidate ARMA models may be eligible for selection. We propose a feasible computing method based on the Gibbs sampler. By this method model selection is performed through a random sample generation algorithm, and given a model of fixed dimension the parameter estimation is done through the maximum likelihood method. Our method takes into account several computing difficulties encountered in estimating ARMA models. The method is found to have probability of 1 in the limit in selecting the best candidate model under some regularity conditions. We then propose several empirical rules to implement our computing method for applications. Finally, a simulation study and an example on modelling China's Consumer Price Index (CPI) data are presented for purpose of illustration and verification.     

噪声条件下电子伪装语音还原方法研究

语音的电子伪装是指采用变声设备或语音处理软件改变说话人的个性特征,以达到故意隐藏该说话人身份的目的。电子伪装语音还原是指通过技术手段将伪装语音变回原声,这对基于语音的身份鉴别具有重要意义。本文将频域和时域伪装语音的还原问题抽象为伪装因子的估计问题,通过基于i-vector的自动说话人确认方法估计伪装因子,并引入对称变换进一步提高估计效果。该方法借助于i-vector的噪声鲁棒性,提高了真实含噪场景下伪装因子的估计精度,从而改进了噪声条件下电子伪装语音的还原效果。在干净语音库TIMIT上训练i-vector并在含噪语音库VoxCeleb1上对本文方法进行测试,结果表明,伪装因子估计的错误率从基线系统的9.19%降低为4.49%,还原语音在自动说话人确认等错误率和听觉感知方面也取得了提升。     

On time series model selection involving many candidate ARMA models

We study how to perform model selection for time series data where millions of candidate ARMA models may be eligible for selection. We propose a feasible computing method based on the Gibbs sampler. By this method model selection is performed through a random sample generation algorithm, and given a model of fixed dimension the parameter estimation is done through the maximum likelihood method. Our method takes into account several computing difficulties encountered in estimating ARMA models. The method is found to have probability of 1 in the limit in selecting the best candidate model under some regularity conditions. We then propose several empirical rules to implement our computing method for applications. Finally, a simulation study and an example on modelling China's Consumer Price Index (CPI) data are presented for purpose of illustration and verification.     

Identification of complex systems based on neural and Takagi-Sugeno fuzzy model

The paper describes a neuro-fuzzy identification approach, which uses numerical data as a starting point. The proposed method generates a Takagi-Sugeno fuzzy model, characterized with transparency, high accuracy and a small number of rules. The process of self-organizing of the identification model consists of three phases: clustering of the input-output space using a self-organized neural network; determination of the parameters of the consequent part of a rule from over-determined batch least-squares formulation of the problem, using singular value decomposition algorithm; and on-line adaptation of these parameters using recursive least-squares method. The verification of the proposed identification approach is provided using four different problems: two benchmark identification problems, speed estimation for a dc motor drive, and estimation of the temperature in a tunnel furnace for clay baking.     

Optimal estimates for the operating parameters of an information web portal

We consider the problems of state estimation and Bayesian parameter identification for a stochastic model of an observation system that describes the evolution of one parameter of a web portal. Based on the thread pool control process analysis, we offer a mathematical model for the oscillations of the operating parameters for the portal’s information sources as a nonlinear stochastic observation system of a special kind. We obtain solutions of the optimal estimation problem and give numerical results.     

Study on joint Bayesian model selection and parameter estimation method of GTD model

The Bayesian method is applied to the joint model selection and parameter estimation problem of the GTD model. An algorithm based on RJ-MCMC is designed. This algorithm not only improves the model order selection and parameter estimation accuracy by exploiting the priori information of the GTD model, but also solves the mixed parameter estimation problem of the GTD model properly. Its performance is tested using numerical simulations and data generated by electromagnetic code. It is shown that it gives good model order selection and parameter estimation results, especially for low SNR, closely-spaced components and short data situations.     

Stepwise variable selection and maximum likelihood estimation of smoothing factors of kernel functions for nonparametric discriminant functions evaluated by different criteria

Kernel functions are used to estimate the probability density functions of variables for nonparametric discriminant analysis. In connection with stepwise variable identification a stepwise maximum likelihood estimation procedure for the estimation of smoothing factors of the kernel functions is developed. This procedure allows a step-by-step estimation of smoothing factors for every variable which is considered to be added to the model or which is examined to substitute a variable in a model. Different criteria for model evaluation in stepwise discriminant analysis are discussed. Beside criteria, like distance and dependence functions and the error and nonerror rate, a criterion which considers the ratio of probability densities of different classes at point x is proposed for stepwise variable identification. An application of the procedures described in this study to a medical decision problem shows the importance of stepwise parameter estimation of kernel functions for nonparametric discriminant analysis and the role of different model evaluation criteria for the selection of the best subset of variables.     

混合卷积神经网络的人脸验证

人脸验证对于个人身份认证很重要, 它在系统安全和犯罪识别中具有重要意义. 人脸验证的任务是给定一对人脸图像判断是否为相同的身份(即二进制分类). 传统的验证方法包括两个步骤: 特征提取和人脸验证. 本文提出了一个混合卷积神经网络, 用于进行人脸验证, 主要过程分为三个步骤: 特征提取, 特征选择和人脸验证. 这个模型关键点是直接使用混合卷积神经网络从原始像素直接学习相关的视觉特征, 并通过单变量特征选择和主成分分析(PCA)进一步处理特征. 这样可以实现从原始像素提取到具有较好鲁棒性和表达性的特征. 在顶层使用支持向量机(SVM)判读是否为同一个人. 通过实验可以发现混合卷积神经网络模型与传统方法相比在人脸验证得准确率上有着较好的表现.     

Modelling and parameter estimation of a ship boiler

This paper deals with the identification and parameter estimation part of an adaptive control system for a ship boiler. The adaptive control system should be of such a form that it could be implemented on a minicomputer and easily adjusted to other ship boilers with similar characteristics. A nonlinear model of the process, suitable for parameter estimation purposes will be presented and the Extended Kalman filter approach to the estimation problem will be studied. Results based on plant measurements and simulations will be given.