Learning to Perceive and Act by Trial and Error

This article considers adaptive control architectures that integrate active sensory-motor systems with decision systems based on reinforcement learning. One unavoidable consequence of active perception is that the agent's internal representation often confounds external world states. We call this phoenomenon perceptual aliasingand show that it destabilizes existing reinforcement learning algorithms with respect to the optimal decision policy. We then describe a new decision system that overcomes these difficulties for a restricted class of decision problems. The system incorporates a perceptual subcycle within the overall decision cycle and uses a modified learning algorithm to suppress the effects of perceptual aliasing. The result is a control architecture that learns not only how to solve a task but also where to focus its visual attention in order to collect necessary sensory information.     

Comparison of clinical diagnosis and standard laboratory and molecular methods for the diagnosis of genital ulcer disease in Lesotho: association with human immunodeficiency virus infection

A multiplex polymerase chain reaction (M-PCR) assay for Haemophilus ducreyi, Treponema pallidum, and herpes simplex virus (HSV) was compared with clinical and standard laboratory methods for the diagnosis of genital ulcer disease (GUD) in 105 patients; 36% were human immunodeficiency virus (HIV)-seropositive. Chancroid (80%), syphilis (8%), and genital herpes (8%) were the most frequent diagnoses. H. ducreyi and HSV were isolated from ulcers of 43% and 18% of patients, respectively; in 35%, all cultures were negative and the laboratory diagnosis indeterminate. M-PCR detected H. ducreyi, T. pallidum, and HSV in 56%, 23%, and 26% of patients, respectively; (no definitive diagnosis, 6%). The proportion of patients with more than one agent was 4% by culture and 17% by M-PCR (P = .002). Resolved sensitivities of M-PCR for H. ducreyi and HSV cultures were 95% and 93%, respectively. The sensitivities of H. ducreyi and HSV cultures were 75% and 60%, respectively. HSV, detected in 47% of specimens from HIV-infected versus 16% from HIV-uninfected patients (P < .001), may be emerging as a more frequent cause of GUD.     

A population study of the natural history of Wolff-Parkinson-White syndrome in Olmsted County, Minnesota, 1953-1989

BACKGROUND: Virtually all natural history studies of Wolff-Parkinson-White (WPW) syndrome have been case series and, as such, have been constrained by referral biases, skewed age and sex distributions, or brief follow-up periods. The purpose of our study was to examine the natural history, the development of arrhythmias, and the incidence of sudden death in an entire cohort of pediatric and adult WPW patients from a community-based local population. METHODS AND RESULTS: We identified 113 residents of Olmsted County, Minnesota, during the period 1953-1989 using the centralized records-linkage system provided by the Mayo Clinic and the Rochester Epidemiology Program Project. Medical records and ECGs were reviewed to confirm the diagnosis and to establish pathway location by ECG criteria. Follow-up, via record review and telephone interview, was complete in 95% of subjects through 1990. The incidence of newly diagnosed cases was approximately four per 100,000 per year. Preexcitation was not present on the initial ECG of 22% of the cohort. Approximately 50% of the population was asymptomatic at diagnosis, with 30% subsequently having symptoms related to arrhythmia at follow-up. Two sudden cardiac deaths (SCD) occurred over 1,338 patient-years of follow-up, yielding an overall SCD rate of 0.0015 (95% confidence interval, 0.0002-0.0054) per patient-year. No SCD occurred in patients asymptomatic at diagnosis. CONCLUSIONS: The incidence of sudden death in a local community-based population is low and suggests that electrophysiological testing should not be performed routinely in asymptomatic patients with WPW syndrome. Nevertheless, young, asymptomatic patients, particularly those < 40 years old, should return for medical follow-up should symptoms develop.     

A 533-MHz BiCMOS superscalar RISC microprocessor

This 533-MHz BiCMOS very large scale integration (VLSI) implementation of the PowerPC architecture contains three pipelines and a large on-chip secondary cache to achieve a peak performance of 1600 MIPS. The 15 mm×10 mm die contains 2.7 M transistors (2M CMOS and 0.7 M bipolar) and dissipates less than 85 W. The die is fabricated in a six-level metal, 0.5-μm BiCMOS process and requires 3.6 and 2.1 V power supplies     

Small-angle neutron scattering studies of polyethylene crystallized at high pressure

The technique of small-angle neutron scattering (SANS) has been used to study the chain configuration in pressure crystallized polyethylene. Two narrow molecular weight fractions of deuterated molecules (PED) of M_w 23 000 and 54 000 were solution blended with a protonated matrix polymer of M_w 81 500. Although pressure crystallization was shown to have produced a clustering of the PED molecules, the radii of gyration $\text{〈}\text{S}{}^2\text{〉}{}_{\mathrm{z}}{}^{\mathrm{<mtext>1</mtext><mtext>2</mtext>}}$ were, nevertheless, shown to be consistent with a model in which the PED molecules possessed rod-like configurations. The predicted rod lengths were in close agreement with the molecular stem lengths of the PEH matrix polymer, which were independently determined by nitric acid etching. Furthermore, a doubling of the PED molecular weight produced no change in the value of $\text{〈S}{}^2\text{〉}{}_{\mathrm{z}}{}^{\mathrm{<mtext>1</mtext><mtext>2</mtext>}}$. This was interpreted in terms of a chain folding mechanism in which a molecule is bounded by the surfaces of a lamellar block and is therefore unable to increase its' rod length.     

Estimating the Removal of Anthropogenic Organic Chemicals from Raw Drinking Water by Coagulation Flocculation

A mathematical model was developed to estimate the efficacy of coagulation–flocculation treatment for removing neutral hydrophobic organic chemicals from raw drinking water. The model assumed that the only significant removal mechanism was the destabilization and settling of organic matter containing sorbed anthropogenic organic compounds. The model was validated with standard jar tests using compounds with a range of hydrophobicities (log?Kow = 1.89?to?5.48), including contaminant candidate list chemicals, pesticides, pharmaceuticals, and endocrine disrupting chemicals. Final concentrations of test compounds after coagulation and flocculation were in good agreement with model estimations for synthetic waters composed of Aldrich (Milwaukee, WI) humic acid solutions. The final compound concentrations in coagulated natural waters from two drinking water reservoirs were about 80% lower than those estimated with the model. Overestimations of treated water concentrations by the model were attributed to an increase in sorption by natural organic matter when coiled in aluminum hydroxide flocs, compared to sorption to dispersed natural organic matter in untreated water.     

Remote sensing of land surface temperature: the directional viewingeffect

Land surface temperature and emissivity products are currently being derived from satellite and aircraft remote sensing data using a variety of techniques to correct for atmospheric effects. Implicit in the commonly employed approaches is the assumption of isotropy in directional thermal infrared exitance. The authors' theoretical analyses indicate angular variations in apparent infrared temperature will typically yield land surface temperature errors ranging from 1 to 4°C unless corrective measures are applied