PAC-learnability of probabilistic deterministic finite state automata in terms of variation distance

We consider the problem of PAC-learning distributions over strings, represented by probabilistic deterministic finite automata (PDFAs). PDFAs are a probabilistic model for the generation of strings of symbols, that have been used in the context of speech and handwriting recognition, and bioinformatics. Recent work on learning PDFAs from random examples has used the KL-divergence as the error measure; here we use the variation distance. We build on recent work by Clark and Thollard, and show that the use of the variation distance allows simplifications to be made to the algorithms, and also a strengthening of the results; in particular that using the variation distance, we obtain polynomial sample size bounds that are independent of the expected length of strings.     

Multiagent learning using a variable learning rate

Learning to act in a multiagent environment is a difficult problem since the normal definition of an optimal policy no longer applies. The optimal policy at any moment depends on the policies of the other agents. This creates a situation of learning a moving target. Previous learning algorithms have one of two shortcomings depending on their approach. They either converge to a policy that may not be optimal against the specific opponents' policies, or they may not converge at all. In this article we examine this learning problem in the framework of stochastic games. We look at a number of previous learning algorithms showing how they fail at one of the above criteria. We then contribute a new reinforcement learning technique using a variable learning rate to overcome these shortcomings. Specifically, we introduce the WoLF principle, “Win or Learn Fast”, for varying the learning rate. We examine this technique theoretically, proving convergence in self-play on a restricted class of iterated matrix games. We also present empirical results on a variety of more general stochastic games, in situations of self-play and otherwise, demonstrating the wide applicability of this method.     

基于约束优化的联想记忆模型学习算法

本文提出了一种对称互连神经元网络的学习策略,利用全局约束优化方法确定连接权。优化过程采用了梯度下降技术。这种学习算法可以保证训练样本成为系统的稳定吸引子,并且具有优化意义上的最大吸引域。本文讨论了网络的存储容量,训练样本的渐近稳定性和吸引域大小。计算机实验结果说明了学习算法的优越性。     

Hierarchical intelligent control with flexible AC transmission systems application

A novel hierarchical intelligent controller configuration is proposed using an artificial neural network as a control-mode classifier in the supervisory level and a set of pre-designed controllers in the lower level. Controller outputs are modified nonlinearly by the classifying signals in a structure resembling one artificial neuron with adaptively changed weights. The lower-level local controllers are implemented using neural networks. An illustrative example of this approach is based on the transient stabilization of a single-machine infinite-bus system studied in Flexible AC Transmission Systems (FACTS) research.     

Distinguished Scientific Awards for an Early Career Contribution to Psychology.

The Early Career Awards recognize the large number of excellent young psychologists. Recipients of this award may not have held a PhD for more than nine years. The areas considered in 1991 were animal learning and behavior, developmental, and personality. The winners for 1991 were Kent C. Berridge, Susan A. Gelman, and Randy J. Larsen. For each winner a citation, biography, and selected bibliography of their works are presented. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Neural Network Feedback Control: Work at UTA’s Automation and Robotics Research Institute

This is an outline of research in neural networks for feedback control done since the mid 1990s at the Automation and Robotics Research Institute (ARRI) of The University of Texas at Arlington (UTA). It shows how the developments of Intelligent Control Systems based on neural networks have followed three main generations. This statement provides a short, broad-brush perspective on the development of intelligent neural feedback controllers.     

A Genetic Dissociation of Learning and Recall in Caenorhabditis elegans.

A learning event can be dissociated into 3 components: acquisition, storage, and recall. When the laboratory wild-type strain of Caenorhabditis elegans (N2 strain) is exposed to benzaldehyde in the absence of food, the worms display a reduction of their attractive response to this volatile odorant. This results from the association between benzaldehyde and a nutrient-deficient environment. Another wild-type isolate, the CB4856 strain, fails to display this decreased response to benzaldehyde after exposure to benzaldehyde in the absence of food. However, like the N2 strain, when tested to isoamyl alcohol after benzaldehyde conditioning, the CB4856 strain displays a decreased isoamyl alcohol response. Therefore, the CB4856 strain does not have an acquisition deficit, but it suffers from a recall deficit specific to benzaldehyde. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Pure perceptual-based sequence learning.

Learning a sequence of target locations when the sequence is uncorrelated with a sequence of responses and target location is not the response dimension (pure perceptual-based sequence learning) was examined. Using probabilistic sequences of target locations, the author shows that such learning can be implicit, is unaffected by distance between target locations, and is mostly limited to first-order transition probabilities. Moreover, the mechanism underlying learning affords processing of information at anticipated target locations and appears to be attention based. Implications for hypotheses of implicit sequence learning are discussed. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Achievement of specificational information usage with true and false feedback in learning a visual relative-mass discrimination task.

Participants' usage of informational variables in learning visual relative-mass discrimination in collisions was tracked by means of PROBIT correlations. Four groups received feedback that was true or accorded with either of three nonspecificational cue variables. A majority in each group adopted the feedback, but several participants defied the false feedback. Unlike in previous research, the fit to data of the relative-mass invariant could not be bettered by post hoc linear combinations of the cues. Discriminability was lower in the use of the invariant. Analytic complexity was rejected as an explanation for discriminability differences. A "smart mechanism" for pickup of the relative-mass invariant was developed as an extension of G. Johansson's (1950/1994) vector model. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Two-tier architecture for unconstrained handwritten character recognition

In this paper, we propose an approach that combines the unsupervised and supervised learning techniques for unconstrained handwritten numeral recognition. This approach uses the Kohonen self-organizing neural network for data classification in the first stage and the learning vector quantization (LVQ) model in the second stage to improve classification accuracy. The combined architecture performs better than the Kohonen self-organizing map alone. In the proposed approach, the collection of centroids at different phases of training plays a vital role in the performance of the recognition system. Four experiments have been conducted and experimental results show that the collection of centroids in the middle of the training gives high performance in terms of speed and accuracy. The systems developed also resolve the confusion between handwritten numerals.