Multiagent learning using a variable learning rate

Learning to act in a multiagent environment is a difficult problem since the normal definition of an optimal policy no longer applies. The optimal policy at any moment depends on the policies of the other agents. This creates a situation of learning a moving target. Previous learning algorithms have one of two shortcomings depending on their approach. They either converge to a policy that may not be optimal against the specific opponents' policies, or they may not converge at all. In this article we examine this learning problem in the framework of stochastic games. We look at a number of previous learning algorithms showing how they fail at one of the above criteria. We then contribute a new reinforcement learning technique using a variable learning rate to overcome these shortcomings. Specifically, we introduce the WoLF principle, “Win or Learn Fast”, for varying the learning rate. We examine this technique theoretically, proving convergence in self-play on a restricted class of iterated matrix games. We also present empirical results on a variety of more general stochastic games, in situations of self-play and otherwise, demonstrating the wide applicability of this method.     

关于高职院校几点教学改革的思考

高等职业技术教育要求把握好理论教学与实践教学的关系，探索适合培养目标的教学方法，综合运用多种教学方法，十分重视搞好实践教学，适度调整教材结构和测评方法，把教书与育人结合起来。     

Appraisal as a Pervasive Determinant of Anger.

L. Berkowitz and E. Harmon-Jones (see record 2004-15096-001) challenge appraisal theories of emotion by describing 2 sets of conditions (physical discomfort and anger-related muscle actions) in which anger appears to be elicited in the absence of theoretically predicted appraisals. In response, the authors discuss the ability of the specific appraisal model they have developed (e.g., C. A. Smith & L. D. Kirby, 2000, 2001; C. A. Smith & R. S. Lazarus, 1990) to account for such instances of anger. First, a number of issues are clarified relevant to the authors' model, including the nature of both the cognitive operations underlying appraisal and the specific appraisals hypothesized to evoke anger. The authors then describe how their model can account for the instances of anger described by L. Berkowitz and E. Harmon-Jones and how both accounts might be tested. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Constructive Sets in Computable Sets

The original interpretation of the constructive set theory CZF in Martin-Loef‘s type theory uses the‘extensional identity types’.It is generally believed that these‘types’do not belong to type theory.In this paper it will be shown that the interpretation goes through without identity types.This paper will also show that the interpretation can be given in an intensional type theory.This reflects the computational nature of the interpretation.This computational aspect is reinforced by an ω-Set moel of CZF.     

Have it your way and mine: The theory of styles

Olsen is right to note what can be done with a good theory and the right machine. His particular theory, however, is not transferable to literary studies. If we need a new model, I would suggest that cognitive science can provide a few interesting ones. I have begun to do some work based on David Marr's VISION, in which he hypothesizes two levels of processing within the visual module. My speculation has been on the parallel existence of distinguishable levels of conceptual or language organization which would correspond to the viewer and object centered perspectives Marr describes for vision. I propose to explore the possibility that we may find here the model for the existence of stylistic individualism within overarching historical stylistic generalizations, and even more, that this may be what feminists are searching for when they try to resist being coopted by the masculine language of objectivity. Ellen Spolsky teaches English literature and literary theory and is the Director of the Lechter Institute for Literary Research at Bar-Ilan University, Israel. Her latest book is Gaps in Nature: Literary Interpretation and the Modular Mind(SUNY Press, 1993).     

WAVELET ALGORITHM FOR INTEGRAL OPERATOR EQUATION AND ITS APPLICATIONS TO ELECTROMAGNETIC PROBLEMS

A brief summary of the basic theory of wavelet is proposed. The properties of wavelet function are discussed. The possible applications of wavelet to electromagnetics are given. Examples show that the wavelet method is feasible and effective for solving electromagnetic problems.     

不含4圈的最大简单图边数的下界

证明了具有不小于6个顶点的不包含4圈的简单图的最大可能边数的下界是2n-5。     

新型蓝绿发光材料ZnSe／BeTe超晶格的能带剪裁

由于器件的快速退化，101.5小时似乎成了Znse基蓝绿色半导体激光器难于逾越的寿命极限。分析退化机制，发现在强电流注入的半导体激光器中，热退化具有重要影响。研究表明，用作载流子限制层的宽带Ⅱ-Ⅵ族四元合金（如ZnMgSSe）只能对ZnSe中的电子有效地限制，无法对空穴很好地限制;而对BeTe，却只能对空穴进行有效的限制，无法对电子很好地限制。这导致ZnSe（或BeTe）活性层空穴（或电子）漏电发热，引起退化。本文提出以ZnSe／BeTe超晶格为蓝绿发光层，并用包络函数理论具体计算了阱宽、垒宽对载流子能级的不同影响，考察了ZnSe、BeTe厚度比和超晶格周期对带隙、载流子限制能力的调节。为研制新型长寿命蓝绿色半导体激光器提供了一条新的途径。     

The factor-analytic approach to intelligence is alive and well: A review of Carroll, J. B. (1993). Human cognitive abilities: A survey of factor-analytic studies.

Reviews the book, Human cognitive abilities: A survey of factor-analytic studies by J. B. Carroll (see record 1993-97611-000). Carroll divides his book into three parts. The first is a historical and conceptual review of psychometric theory. Carroll begins by clearly defining and differentiating key concepts such as ability, aptitude, achievement, latent trait, and intervening variable, although recognizing that in practice it is often difficult to make absolute distinctions. The second part, and the bulk of the book, is a detailed analysis and synthesis of a myriad of findings in the area of cognitive abilities. In the third part of his book, Carroll summarizes his undertaking and addresses traditional concerns and controversies. He compares and contrasts his model of cognitive abilities with that of others. Although Carroll's book does not and indeed cannot resolve the issues and controversies concerning the nature of human cognitive abilities, it does represent a notable contribution to our ongoing endeavours. It undoubtedly is a book that anyone interested in cognitive abilities would wish to explore because of its encyclopedic, in-depth coverage of the topic. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

超高压输电线路分裂导线通道模式理论分析

本对分裂导线传输电磁波的模式理论进行了分析，从所解特征根中选择一组最简单的模分量传递信息，并阐述了传输规律。