Learning to Perceive and Act by Trial and Error

This article considers adaptive control architectures that integrate active sensory-motor systems with decision systems based on reinforcement learning. One unavoidable consequence of active perception is that the agent's internal representation often confounds external world states. We call this phoenomenon perceptual aliasingand show that it destabilizes existing reinforcement learning algorithms with respect to the optimal decision policy. We then describe a new decision system that overcomes these difficulties for a restricted class of decision problems. The system incorporates a perceptual subcycle within the overall decision cycle and uses a modified learning algorithm to suppress the effects of perceptual aliasing. The result is a control architecture that learns not only how to solve a task but also where to focus its visual attention in order to collect necessary sensory information.     

Olfactory discrimination of individual littermates in rats (Rattus norvegicus).

Tested the ability of 4 adult male Sprague-Dawley rats to use odors in discrimination among littermates living as a group. Ss were trained in a Y-maze to discriminate the presence of a littermate from its absence. Results from transfer of training in 3 subsequent testing periods indicated that the animals were capable of distinguishing among individuals when relatedness and familiarity were held constant, that this ability was not due to training, and that performance was based solely on odor cues. Results suggest that laboratory rats exhibit odor sensitivities conmensurate with very complex social processes. (17 ref) (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Parallel path consistency

Filtering algorithms are well accepted as a means of speeding up the solution of the consistent labeling problem (CLP). Despite the fact that path consistency does a better job of filtering than arc consistency, AC is still the preferred technique because it has a much lower time complexity. We are implementing parallel path consistency algorithms on multiprocessors and comparing their performance to the best sequential and parallel arc consistency algorithms.^(1,2) (See also work by Kerethoet al. ⁽³⁾ and Kasif⁽⁴⁾) Preliminary work has shown linear performance increases for parallelized path consistency and also shown that in many cases performance is significantly better than the theoretical worst case. These two results lead us to believe that parallel path consistency may be a superior filtering technique. Finally, we have implemented path consistency as an outer product computation and have obtained good results (e.g., linear speedup on a 64K-node Connection Machine 2).     

What We Mean by Future-Proofing

Perhaps the most powerful claim that advocates of fiber can make,on top of the massive bandwidthfiber makes possible today, is that fiber is future-proof. That is, the fiber that is laid today can be upgraded so that the same strands of glass can carry massively more bandwidth in the future.     

Artificial neural network medical decision support tool: predicting transfusion requirements of ER patients.

Blood product transfusion is a financial concern for hospitals and patients. Efficient utilization of this dwindling resource is a critical problem if hospitals are to maximize patient care while minimizing costs. Traditional statistical models do not perform well in this domain. An additional concern is the speed with which transfusion decisions and planning can be made. Rapid assessment in the emergency room (ER) necessarily limits the amount of usable information available (with respect to independent variables available). This study evaluates the efficacy of using artificial neural networks (ANNs) to predict the transfusion requirements of trauma patients using readily available information. A total of 1016 patient records are used to train and test a backpropagation neural network for predicting the transfusion requirements of these patients during the first 2, 2-6, and 6-24 h, and for total transfusions. Sensitivity and specificity analysis are used along with the mean absolute difference between blood units predicted and units transfused to demonstrate that ANNs can accurately predict most ER patient transfusion requirements, while only using information available at the time of entry into the ER.     

Contracting, prompting, and reinforcing substance use disorder continuing care: A randomized clinical trial.

Although continuing care is strongly related to positive treatment outcomes for substance use disorder (SUD), participation rates are low and few effective interventions are available. In a randomized clinical trial with 150 participants (97% men), 75 graduates of a residential Veterans Affairs Medical Center SUD program who received an aftercare contract, attendance prompts, and reinforcers (CPR) were compared to 75 graduates who received standard treatment (STX). Among CPR participants, 55% completed at least 3 months of aftercare, compared to 36% in STX. Similarly, CPR participants remained in treatment longer than those in STX (5.5 vs. 4.4 months). Additionally, CPR participants were more likely to be abstinent compared to STX (57% vs. 37%) after 1 year. The CPR intervention offers a practical means to improve adherence among individuals in SUD treatment. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Serial deployment of attention during visual search.

This study examined whether objects are attended in serial or in parallel during a demanding visual search task. A component of the event-related potential waveform, the N2pc wave, was used as a continuous measure of the allocation of attention to possible targets in the search arrays. Experiment 1 demonstrated that the relative allocation of attention shifts rapidly, favoring one item and then another. In Experiment 2, a paradigm was used that made it possible to track the absolute allocation of attention to individual items. This experiment showed that attention was allocated to one object for 100-150 ms before attention began to be allocated to the next object. These findings support models of attention that posit serial processing in demanding visual search tasks. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Direct synthesis of copper faujasite

Copper containing faujasite has been successfully prepared for the first time using a direct synthesis method. Faujasite type zeolite can be prepared in the presence of copper species by tuning the synthesis conditions. Ammonium hydroxide was used to form a copper complex that was later mixed with the reacting gel. Sodium is required to obtain copper faujasite. The complete elimination of sodium ions from the starting gel produces amorphous material. Crystallization took place at 358 K for 11 days. Crystallization temperature of 373 K produces ANA type zeolite as an impurity. Increasing by two times the amount of copper complex added to the reacting gel increases the crystallization time of Cu-FAU from 11 to 20 days (the crystallization rate decreases). The copper containing faujasite obtained was characterized by XRD, FESEM, EDX, EPR, FT-IR, TPR, and BET. According to the XRD pattern only FAU type zeolite was obtained. According to TPR experiments, the reduction temperature for Cu²⁺ ions present in Cu-FAU prepared by direct synthesis was 70 K more than for Cu-FAU prepared by ion-exchange. This difference can be due to the different location of the copper ions in the supercages or in the sodalite cages of the faujasite.