Efficient Reinforcement Learning through Symbiotic Evolution

This article presents a new reinforcement learning method called SANE (Symbiotic, Adaptive Neuro-Evolution), which evolves a population of neurons through genetic algorithms to form a neural network capable of performing a task. Symbiotic evolution promotes both cooperation and specialization, which results in a fast, efficient genetic search and discourages convergence to suboptimal solutions. In the inverted pendulum problem, SANE formed effective networks 9 to 16 times faster than the Adaptive Heuristic Critic and 2 times faster than Q-learning and the GENITOR neuro-evolution approach without loss of generalization. Such efficient learning, combined with few domain assumptions, make SANE a promising approach to a broad range of reinforcement learning problems, including many real-world applications.     

Blood Cell Responses Following Heavy Alcohol Consumption Coincide with Changes in Acute Phase Reactants of Inflammation,Indices of Hemolysis and Immune Responses to Ethanol Metabolites

Aberrations in blood cells are common among heavy alcohol drinkers. In order to shed further light on such responses, we compared blood cell status with markers of hemolysis, mediators of inflammation and immune responses to ethanol metabolites in alcohol-dependent patients at the time of admission for detoxification and after abstinence. Blood cell counts, indices of hemolysis (LDH, haptoglobin, bilirubin), calprotectin (a marker of neutrophil activation), suPAR, CD163, pro- and anti-inflammatory cytokines and autoantibodies against protein adducts with acetaldehyde, the first metabolite of ethanol, were measured from alcohol-dependent patients (73 men, 26 women, mean age 43.8 ± 10.4 years) at baseline and after 8 ± 1 days of abstinence. The assessments also included information on the quantities of alcohol drinking and assays for biomarkers of alcohol consumption (CDT), liver function (AST, ALT, ALP, GGT) and acute phase reactants of inflammation. At baseline, the patients showed elevated values of CDT and biomarkers of liver status, which decreased significantly during abstinence. A significant decrease also occurred in LDH, bilirubin, CD163 and IgA and IgM antibodies against acetaldehyde adducts, whereas a significant increase was noted in blood leukocytes, platelets, MCV and suPAR levels. The changes in blood leukocytes correlated with those in serum calprotectin (p < 0.001), haptoglobin (p < 0.001), IL-6 (p < 0.02) and suPAR (p < 0.02). The changes in MCV correlated with those in LDH (p < 0.02), MCH (p < 0.01), bilirubin (p < 0.001) and anti-adduct IgG (p < 0.01). The data indicates that ethanol-induced changes in blood leukocytes are related with acute phase reactants of inflammation and release of neutrophil calprotectin. The studies also highlight the role of hemolysis and immune responses to ethanol metabolites underlying erythrocyte abnormalities in alcohol abusers.