Learning to Perceive and Act by Trial and Error

This article considers adaptive control architectures that integrate active sensory-motor systems with decision systems based on reinforcement learning. One unavoidable consequence of active perception is that the agent's internal representation often confounds external world states. We call this phoenomenon perceptual aliasingand show that it destabilizes existing reinforcement learning algorithms with respect to the optimal decision policy. We then describe a new decision system that overcomes these difficulties for a restricted class of decision problems. The system incorporates a perceptual subcycle within the overall decision cycle and uses a modified learning algorithm to suppress the effects of perceptual aliasing. The result is a control architecture that learns not only how to solve a task but also where to focus its visual attention in order to collect necessary sensory information.     

Le décodage pondere en tant que procédé de réévaluation d’une distribution de probabilité

We propose to redefine weighted decoding of a redundant code as consisting of reestimating a given prior probability distribution in order to take into account the code constraints. The optimum solution of this problem results from using the « minimum cross-entropy » principle and is shown to coincide with the computation of the probabilities to be compared in order to perform maximum likelihood decoding when the prior distribution is exactly known. The principle however also holds when the prior distribution is approximate or biased, which explains the robustness of decoding with respect to weighting information. Such a redefinition also enables using the intermediate steps of decoding, in the case of codes associated by concatenation or product, as a source of weighting information for the subsequent steps. One is led for simplicity’s sake to an estimate of the posterior probability in separable form with respect to the information symbols ; its definition is given and certain of its applications are discussed.     

Olfactory discrimination of individual littermates in rats (Rattus norvegicus).

Tested the ability of 4 adult male Sprague-Dawley rats to use odors in discrimination among littermates living as a group. Ss were trained in a Y-maze to discriminate the presence of a littermate from its absence. Results from transfer of training in 3 subsequent testing periods indicated that the animals were capable of distinguishing among individuals when relatedness and familiarity were held constant, that this ability was not due to training, and that performance was based solely on odor cues. Results suggest that laboratory rats exhibit odor sensitivities conmensurate with very complex social processes. (17 ref) (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Antimutagenic activity of phenolic compounds, oligosaccharides and quinolizidinic alkaloids from Lupinus campestris seeds.

There are some foods that contain mutagenic or carcinogenic agents, some of which occur naturally and others that may be formed during preparation or cooking. Several foods such as legumes, also contain natural antimutagens and/or anticarcinogens. Lupine is one such legume that contains high amounts of protein (40%) and oils (14%). About 90 species of lupine have been reported throughout Mexico. However, the use of this crop as a source of food has been limited by the presence of antinutritional agents such as phenolic compounds (PC), carbohydrates (CH) and quinolizidinic alkaloids (Qas). It has also been suggested that consuming these compounds can affect human health and may even reduce the risk of disease. The objective of this work was to determine the effect of PC, CH and Qas, isolated and quantified from Lupinus campestris on the mutagenicity of 1-nitropyrene (1-NP) as a model mutagen and we used the Salmonella typhimurium tester strain YG1024 by the Kado microsuspension method. The results indicate that L. campestris seeds have 11 mg (+)catechin equivalent g(-1) seed coat; 120.3 mg g(-1) seeds and 2.13 mg g(-1) seeds of PC, CH and Qas, respectively. 1-NP mutagenicity was inhibited by 86% for PC, 76% for CH and 75% for Qas at concentrations of 200, 512 and 13.6 microg/tube, respectively.     

Probing the thermal decomposition process of layered double hydroxides through in situ <Superscript>57</Superscript>Fe Mössbauer and in situ X-ray diffraction experiments

The thermal decomposition properties of Mg–Fe hydrotalcites were studied through in situ ⁵⁷Fe Mössbauer spectroscopy and in situ X-ray diffraction. Abrupt changes in the quadrupolar splitting measured in the Mössbauer spectra revealed a phase transition from the starting lamellar structure to a new crystalline arrangement. By analyzing the Mössbauer parameters we show that the material is highly disordered in the 300–400 °C temperature range. This hypothesis is confirmed by the X-ray results whose diffractograms indicated the collapse of the lamellar structure and the formation of a solid solution.     

Preparation of gold nanoparticles (GNP) aqueous suspensions by a new method involving Tiron

A new method is proposed to produce gold nanoparticles (GNP) by in situ reduction of a gold salt dissolved in water. The reducing agent used is Tiron instead of the citrate anion most often mentioned in literature. The influence of various parameters has been investigated, such as the content of Tiron with respect to that of the precursor of gold HAuCl₄, or the initial pH of the solution after mixing of reactants. It is shown that Tiron also exerts a positive influence as a dispersant, which impedes agglomeration of gold nanoparticles. The typical average size of GNP synthesized in the present work is close to 7 nm.     

Dissipation in Mesoscopic Superconductors with Ac Magnetic Fields

The response of mesoscopic superconductors to an ac magnetic field is investigated both experimentally and with numerical simulations. We study small square samples with dimensions of the order of the penetration depth. We obtain the ac susceptibitity χ=χ′+iχ″ at microwave frequencies as a function of the dc magnetic field H _dc. We find that the dissipation, given by x″, has a non monotonous behavior in mesoscopic samples. In the numerical simulations we obtain that the dissipation increases before the penetration of vortices and then it decreases abruptly after vortices have entered, the sample. This is verified experimentally, where we find that χ″ has strong oscillations as a function of H _dc in small squares of Pb.     

Parallel path consistency

Filtering algorithms are well accepted as a means of speeding up the solution of the consistent labeling problem (CLP). Despite the fact that path consistency does a better job of filtering than arc consistency, AC is still the preferred technique because it has a much lower time complexity. We are implementing parallel path consistency algorithms on multiprocessors and comparing their performance to the best sequential and parallel arc consistency algorithms.^(1,2) (See also work by Kerethoet al. ⁽³⁾ and Kasif⁽⁴⁾) Preliminary work has shown linear performance increases for parallelized path consistency and also shown that in many cases performance is significantly better than the theoretical worst case. These two results lead us to believe that parallel path consistency may be a superior filtering technique. Finally, we have implemented path consistency as an outer product computation and have obtained good results (e.g., linear speedup on a 64K-node Connection Machine 2).     

Linear demosaicing inspired by the human visual system.

There is an analogy between single-chip color cameras and the human visual system in that these two systems acquire only one limited wavelength sensitivity band per spatial location. We have exploited this analogy, defining a model that characterizes a one-color per spatial position image as a coding into luminance and chrominance of the corresponding three colors per spatial position image. Luminance is defined with full spatial resolution while chrominance contains subsampled opponent colors. Moreover, luminance and chrominance follow a particular arrangement in the Fourier domain, allowing for demosaicing by spatial frequency filtering. This model shows that visual artifacts after demosaicing are due to aliasing between luminance and chrominance and could be solved using a preprocessing filter. This approach also gives new insights for the representation of single-color per spatial location images and enables formal and controllable procedures to design demosaicing algorithms that perform well compared to concurrent approaches, as demonstrated by experiments.