A time aggregation approach to Markov decision processes

We propose a time aggregation approach for the solution of infinite horizon average cost Markov decision processes via policy iteration. In this approach, policy update is only carried out when the process visits a subset of the state space. As in state aggregation, this approach leads to a reduced state space, which may lead to a substantial reduction in computational and storage requirements, especially for problems with certain structural properties. However, in contrast to state aggregation, which generally results in an approximate model due to the loss of Markov property, time aggregation suffers no loss of accuracy, because the Markov property is preserved. Single sample path-based estimation algorithms are developed that allow the time aggregation approach to be implemented on-line for practical systems. Some numerical and simulation examples are presented to illustrate the ideas and potential computational savings.     

Algorithm for finding all k nearest neighbors

A very simple algorithm for computing all k nearest neighbors in 2-D is presented. The method does not rely on complicated forms of tessellation, it only requires simple data binning for fast range searching. Its applications range from scattered data interpolation to reverse engineering.     

Scaffolded writing and rewriting in the discipline: A web-based reciprocal peer review system

This paper describes how SWoRD (scaffolded writing and rewriting in the discipline), a web-based reciprocal peer review system, supports writing practice, particularly for large content courses in which writing is considered critical but not feasibly included. To help students gain content knowledge as well as writing and reviewing skills, SWoRD supports the whole cycle of writing, reviews, back-reviews, and rewriting by scaffolding the journal publication process as its authentic practice model. In addition, SWoRD includes algorithms that compute individual reviewer’s review accuracy, which is in turn used to support the various drawbacks of reciprocal peer reviews (e.g., variation in motivation or ability of reviewers). Finally, this paper describes an empirical evaluation showing that the SWoRD approach is effective in improving writing quality in content classes.     

Nicotinic cholinergic system involvement in eyeblink classical conditioning in rabbits.

A nicotinic cholinergic antagonist, mecamylamine (MEC), was administered to rabbits tested on eyeblink classical conditioning (EBCC) in the 750-msec delay paradigm for 10 90-trial sessions. Nicotinic receptors were measured in 3 brain regions in S treatment groups: paired conditioned stimulus–unconditioned stimulus (CS–UCS) presentations with (1) vehicle, young; (2) vehicle, older; (3) 0.5 mg/kg MEC, young; unpaired CS–UCS with (4) 0.5 mg/kg MEC, young; and (5) vehicle, young. Daily MEC injections disrupted acquisition in young rabbits (769 trials to learning criterion vs 323 trials for vehicle-treated young rabbits). MEC-treated young rabbits learned similarly to older rabbits. Brain nicotinic receptors were not affected by 10 daily MEC injections. To our knowledge, this experimental protocol, using a low MEC dose to selectively inhibit nicotinic cholinergic receptors, is the first to demonstrate a role for nicotinic cholinergic receptors in EBCC. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Stability of the unfolding of the predator-prey model

We prove a conjecture of Zeeman that any generic unfolding of the Volterra's original predator-prey model is stable. This well-known two-dimensional model has co-dimension one in the planar Lotka- Volterra system and all its orbits are closed in the region of physical interest. Any generic unfolding of the model locally induces a degenerate Hopf bifurcation, but the presence of a cycle of saddles makes the global stability analysis quite involved. We solve the problem by working in the equivalent replicator system. Our proof of stability uses a family of Lyapunov functions for the unfolding. There are two other co-dimension one bifurcations in the planar replicator (equivalently Lotka- Volterra) system, which involve cycles of saddles and are therefore non-trivial. In one case we prove the stability of the bifurcation and in the other we determine a topologically versa! unfolding of the co-dimension one flow. This then, together with previous work on the subject, completes the study of co-dimension one bifurcations of the system     

Feedback control of coronal plane hip angle in paraplegic subjectsusing functional neuromuscular stimulation

This paper reports on an investigation of feedback control of coronal plane posture in paraplegic subjects who stand using functional neuromuscular stimulation (FNS). A feedback control system directed at regulating coronal plane hip angle in neutral position was designed, implemented, and evaluated in two paraplegic subjects. The control system included sensor mounting and signal processing techniques, a two-stage feedback controller, stimulation hardware, and a set of percutaneous intramuscular electrodes. The feedback controller consisted of two-stages in cascade: a modified discrete-time proportional-integral-derivative (PID) stage and a nonlinear single-input, multiple-output stage to determine the stimulation to be sent to several muscles. The focus of this work was on evaluating the performance of the feedback controller by comparing the response of the feedback-controlled system to that of an open-loop stimulation system. In an evaluation based on temporal response characteristics the controlled system exhibited a 41% reduction in root-mean-squared (rms) error (where error is defined as the deviation from the desired angle), a 52% reduction in steady-state error, and a 22% reduction in hip compliance. In addition, the feedback-controlled system exhibited significant reductions in variability of these measures on several days. These results demonstrate the ability of the feedback controller to improve the temporal response characteristics of the FNS control system.     

Sexualities, technologies, and the teaching of writing: A critical overview

In this introduction to a special issue of Computers and Composition, the authors critically review current literature on computer-assisted writing pedagogies that grapple with issues of sexuality. Although this body of work is small, it points to provocative ways to develop our students’ critical and rhetorical sensibilities about the constructions of sexuality in our culture. Further, such work innovatively addresses the place of networked communication technologies in the interrogation of such constructions. The authors conclude with both an introduction of the work in this special issue that addresses the intersection of sexuality studies and computer-assisted writing studies and with a call for additional work in this field.     

Flexible polymer composite electromagnetic crystals

The dielectric properties of a ceramic powder (BaTiO₃) filled thermoplastic elastomer (EPDM TPE) were investigated for use in a flexible electromagnetic crystal. Materials were produced that had a high dielectric constant (approximately 9) and low loss tangent (less than 0.01). Materials were extruded and injection molded so as to povide low‐cost processing. Mechanical and electromagnetic test results showed the effect of processing conditions on the final quality of the composite. The shear rate during processing and the number of mixing cycles were found to affect the final material characteristics significantly. An electromagnetic crystal woven from extruded rods showed good reflectivity in the 10–15 GHz region.