New prioritized value iteration for Markov decision processes

The problem of solving large Markov decision processes accurately and quickly is challenging. Since the computational effort incurred is considerable, current research focuses on finding superior acceleration techniques. For instance, the convergence properties of current solution methods depend, to a great extent, on the order of backup operations. On one hand, algorithms such as topological sorting are able to find good orderings but their overhead is usually high. On the other hand, shortest path methods, such as Dijkstra’s algorithm which is based on priority queues, have been applied successfully to the solution of deterministic shortest-path Markov decision processes. Here, we propose an improved value iteration algorithm based on Dijkstra’s algorithm for solving shortest path Markov decision processes. The experimental results on a stochastic shortest-path problem show the feasibility of our approach.     

Androgen Reduces Mitochondrial Respiration in Mouse Brown Adipocytes: A Model for Disordered Energy Balance in Polycystic Ovary Syndrome

Polycystic ovary syndrome (PCOS) is a common endocrinopathy that is associated with an adverse metabolic profile including reduced postprandial thermogenesis. Although abnormalities in adipose tissue function have been widely reported in women with PCOS, less is known about direct effects of androgen on white and, particularly, brown adipocytes. The purpose of this study was to investigate the effect of the nonaromatizable androgen dihydrotestosterone (DHT) on (1) lipid accumulation and expression of adipogenic markers in immortalized mouse brown adipose cell lines (IMBATs), (2) mitochondrial respiration in IMBATs, (3) mitochondrial DNA content and gene expression, (4) expression of brown adipose tissue (BAT) markers and thermogenic activation. In addition, we profiled the relative levels of 38 adipokines secreted from BAT explants and looked at androgen effects on adipokine gene expression in both IMBATs and immortalized mouse white adipose (IMWATs) cell lines. Androgen treatment inhibited IMBAT differentiation in a dose-dependent manner, reduced markers of adipogenesis, and attenuated the β-adrenoceptor-stimulated increase in uncoupling protein-1 (UCP1) expression. In explants of mouse interscapular BAT, androgen reduced expression of UCP1, peroxisome proliferator-activated receptor-γ coactivator-1 (PCG-1) and Cidea. Significantly, as well as affecting genes involved in thermogenesis in BAT, androgen treatment reduced mitochondrial respiration in IMBATs, as measured by the Seahorse XF method. The results of this study suggest a role for excess androgen in inhibiting brown adipogenesis, attenuating the activation of thermogenesis and reducing mitochondrial respiration in BAT. Together, these data provide a plausible molecular mechanism that may contribute to reduced postprandial thermogenesis and the tendency to obesity in women with PCOS.     

A Brownian control problem for a simple queueing system in the Halfin–Whitt regime

We consider a formal diffusion limit for a control problem of a multi-type multi-server queueing system, in the regime proposed by Halfin and Whitt. This takes the form of a control problem where the dynamics are driven by a Brownian motion. In one dimension, a pathwise minimum is obtained and is characterized as the solution to a stochastic differential equation. The pathwise solution to a special multi-dimensional problem (corresponding to a multi-type system) follows.     

Inhibition of the growth of the red microalga porphyridium sp. by limitation of nutrient transfer

The unicellular red alga Porphyridium sp. was cultured in a medium to which increasing concentrations of its cell wall polysaccharide were added. As the polysaccharide concentration in the culture medium increased, algal growth rate and maximum cell number progressively decreased. In a different series of experiments it was shown that the polysaccharide also inhibited the rate of carbon uptake by the cells and as a result photosynthesis was also inhibited. In-vitro experiments showed that the mass transfer coefficient for nitrate, bicarbonate, phosphate and potassium decreased as the polysaccharide concentration increased. The data indicate that the polysaccharide inhibits nutrient transfer from the medium to the cells, resulting in a reduction of the growth rate.     

The chronically ill child in the school.

Focuses on the school attendance and performance problems encountered by chronically ill children (CIC), from the point of their re-entry after diagnosis or treatment. CIC exhibit school related problems, reflected in psychological well being, interaction with peers, academic performance, and higher absenteeism. Inability to attend school may lead to decreased self esteem and hopelessness about the future. Specific aspects of the illness or its treatment, the child's emotional response to the illness, prolonged absence, and learning problems may influence school functioning. Attitudes of parents, teachers, other school personnel and the health care team, and inability of the school to provide necessary daily health care services seriously affect successful school re-entry. School psychologists play an important role in maximizing CIC's success in school, as they prospectively monitor their educational functioning. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

What have we learned about how the alliance develops over the course of therapy?

This is a commentary on Dinger, Strack, Sachsse, and Schauenburg’s (2009) study of how therapist attachment styles and patient factors contribute to the development of the therapeutic alliance. I first address whether the research is useful for clinicians, arguing that it is not, and then discuss how the work could be presented to maximize both its scientific and its clinical impact. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Activity of common marmosets (Callithrix jacchus) in limited spaces: Hand movement characteristics.

The increasing popularity of marmoset monkeys (Callithrix jacchus) in anatomical, behavioral, and electrophysiological studies has called for a detailed analysis of their natural behavior within limited spaces. In the present study, the authors analyzed hand movements during horizontal and vertical progressions in a cylinder. The trajectory of each hand covered the entire cylinder floor during horizontal progressions and the entire cylinder wall during vertical progressions. Different marmosets have different patterns of hand movement. The average maximum angle of hand movements for all marmosets during horizontal and vertical progressions oscillates, although the average over time is constant and similar for both hands, whereas head movements during horizontal progressions become smaller with successive progressions. Another observed difference between rats and monkeys was in the size of head and hand movements at the beginning of each experimental session. During the 1st horizontal progression, all marmosets moved their heads to a greater extent than their hands. This sequential head and hand movement is referred as bistable behavior. The bistable pattern of motor behavior, which was also observed in successive progressions, may be derived from an inherent fear of predators or exploratory interest of a novel environment. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Should childhood be a journey of a race? Response to Harackiewicz et al. (2002).

In this response, the authors, dispel interpretation of their critical review of research on performance-approach goals as support for a dichotomous perspective of achievement goal theory. Second, the authors challenge the suggestion that accepting recent research findings and adopting a multiple goals perspective constitute, a theoretical revision of the assumption that "mastery goals are always good and performance goals are always bad" (J. M. Harickiewicz, K. E. Barron, P. R, Pintrich, P. R. Elliot, & T. M. Thrash. 2002, p. 643). The authors make a distinction between developments that contribute to the explanatory power of the theory and value-laden interpretations of theory and research. The authors argue that phrasing the latter in terms of the former is misleading and that it masks the necessity for a critical discussion over the desired purposes in different types of achievement contexts. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Modeling controlled nutrient release from polymer coated fertilizers: diffusion release from single granules

A comprehensive model describing the complex and "non-Fickian" (mathematically nonlinear) nature of the release from single granules of membrane coated, controlled release fertilizers (CRFs) is proposed consisting of three stages: i. a lag period during which water penetrates the coating of the granule dissolving part of the solid fertilizer in it ii. a period of linear release during which water penetration into and release out occur concomitantly while the total volume of the granules remains practically constant; and iii. a period of "decaying release", starting as the concentration inside the granule starts to decrease. A mathematical model was developed based on vapor and nutrient diffusion equations. The model predicts the release stages in terms of measurable geometrical and chemophysical parameters such as the following: the product of granule radius and coating thickness, water and solute permeability, saturation concentration of the fertilizer, and its density. The model successfully predicts the complex and "sigmoidal" pattern of release that is essential for matching plant temporal demand to ensure high agronomic and environmental effectiveness. It also lends itself to more complex statistical formulations which account for the large variability within large populations of coated CRFs and can serve for further improving CRF production and performance.