An actor-critic algorithm for constrained Markov decision processes

An actor-critic type reinforcement learning algorithm is proposed and analyzed for constrained controlled Markov decision processes. The analysis uses multiscale stochastic approximation theory and the envelope theorem' of mathematical economics.     

Marmaray project: Tunnels and stations in BC contract

Istanbul is one of the most famous historical cities in the world. However, the project alignment selected as the best of a range of alignments cannot avoid passing beneath the historical and cultural heritages of Istanbul as well as under ancient and densely inhabited areas of the city. This paper will explain some of the challenges related to the bored tunnels.

Historical buildings are vulnerable. Yet many existing residential and office buildings are old and constructed on minimal foundations. As a consequence, it is vital that any drawdown of groundwater and any ground settlements have to be minimized.

In addition, the connection between the immersed and bored tunnels will be made directly and totally underground, without the usual intermediate shafts and beneath the deep waters of the Bosphorus Strait. This operation needs the utmost control of the tunnel excavation face to ensure its stability and to minimize water ingress. Based on such considerations, tunnel excavation by tunnel boring machine (TBM) using a slurry shield and having the ability to operate under high pore pressures was recommended as the method of excavation for the main running tunnels.

The paper will explain how the design team from Avrasyaconsult – the Employer’s Representative – arrived at the final minimum, specific and functional requirements of the bored tunneling works which are to be carried out using the ‘FIDIC EPC/Turnkey Project’ conditions.     

A novel methanol-tolerant Ir-Se chalcogenide electrocatalyst for oyxgen reduction

A novel methanol-tolerant oxygen-reduction catalyst, Iridium-selenium (Ir-Se) chalcogenide, was synthesized by chemical precipitation in an organic solvent. Auger electron spectroscopy (AES) analysis confirmed that the synthesized Ir-Se chalcogenide had a chemical formula of Ir₄Se. This chalcogenide showed strong catalytic activity towards the oxygen reduction reaction (ORR) and a high methanol tolerance. It was found that most of the oxygen could be directly reduced to water through a four-electron pathway with less than 10% hydrogen peroxide (H₂O₂) being produced during the ORR. The improvement in catalytic activity of the Ir-Se chalcogenide in comparison with that of pure Ir might be attributed to the effect of a bimetallic interaction.     

The distribution of anthocyanins in grape skin extracts of port wine cultivars as determined by high performance liquid chromatography

The distribution of anthocyanins in methanolic skin extracts of 16 grape cultivars used for port wine production and grown at five sites in the Douro Valley in Northern Portugal has been assessed by high performance liquid chromatography. Results are confined to the seven most readily separated and identified anthocyanins and are expressed as percentages of their total (88–99% of the total integrated area). Anthocyanins based on malvidin (Mv) predominated. Of these, Mv 3-glucoside was the major pigment (33–60%), being exceeded by Mv 3-p-coumarylglucoside (2–51%) in only two cultivars; Mv 3-acetylglucoside (1–15%) was consistently the lowest. Peonidin 3-glucoside (1–27%) was prominent in four cultivars, but delphinidin 3-glucoside (1–11%), petunidin 3-glucoside (2–11%) and cyanidin 3-glucoside (trace-6%) were of low proportions throughout. The ratio Mv 3-acetylglucoside/total Mv glucosides appeared characteristic of cultivar, independent of site, and a useful aid to identification of grape cultivars. The coloured pulp of some cultivars contained peonidin 3-glucoside as a major component, present in greater proportions than in the skin; the percentage of Mv 3-p-coumarylglucoside was lower in pulp than in skin. The identities of six of the seven anthocyanins were confirmed by fast atom bombardment mass spectrometry and the structures of the Mv derivatives were determined by nuclear magnetic resonance. The formation of formyl and acetyl anthocyanin artefacts is described.     

The CADE-14 ATP System Competition

This paper documents the design, competing systems, results, and conclusions of the CADE-14 ATP System Competition (CASC-14).     

聚酯－聚醚嵌段共聚物的合成及抗静电性能研究

研究和分析了ＰＥＧ分子量、加料次序、反应时间和温度、物料比例、分散剂和固相缩聚等因素对ＰＥＴ－ＰＥＧ嵌段共聚物分子量和耐水性的影响。合成的嵌段共聚酯醚与ＰＥＴ共混纺丝可以显著改善ＰＥＴ纤维的抗静电性能。     

MCS接枝共聚物的结构和形态

将甲基丙烯酸甲酯（ＭＭＡ）、苯乙烯（Ｓ）在氯化聚乙烯（ＣＰＥ）存在下进行悬浮接枝共聚，获得ＭＣＳ树脂。本文着重考察了ＭＣＳ树脂的化学结构及胶粒形态。结果表明，确实发生了接枝共聚。ＣＰＥ用量、ＲＳＨ含量、引发剂浓度、反应温度、溶胀时间及聚合转化率对ＭＣＳ树脂的接枝率、接枝效率均有影响。ＭＣＳ树脂是接枝共聚物、ＭＭＡ／Ｓ共聚物与ＭＭＡ均聚物的混合物，橡胶相ＣＰＥ在ＭＣＳ树脂中的分散情况为“海岛结构”，     

电晕放电注入双向拉伸聚丙烯薄膜驻极性能的探讨

以一种双向拉伸聚丙烯（ＢＯＰＰ）薄膜在不同温度下进行恒温处理，然后进行负电晕驻极。结果表明，ＢＯＰＰ薄膜随恒温处理的温度升高，热刺激电流（ＴＳＣ）峰值愈低。利用经验方法，估算了它们的活化能，并探讨了导致ＴＳＣ峰温变化的原因。     

羧酸酯稀土对聚氯乙烯的热老化稳定作用研究

用热烘法研究了羧酸酯稀土对聚氯乙烯的热老化稳定作用。利用紫外／可见光谱分析跟踪共轭双键在热老化过程中的变化，比较ＣＥＲＥＳ，有机锡及两者的复合稳定剂的热老化稳定性能，发现ＣＥＲＥＳ与有机锡的稳定性能相当，复合稳定剂具有协同效应。     

高能球磨AL─Cu合金固态合成反应研究

采用扫描电镜、能谱分析、Ｘ射线衍射和示差扫描量热分析研究了具有较大负混合焓的Ａｌ＿ｘＣｕ＿（１－ｘ）对称扩散系合金的高能球磨固态合成反应。高能球磨时组元晶粒细化达纳米级，造成纳米晶界亚互溶，为室温固态合成反应创造了条件，球磨强度对反应进程影响显著，在ｘ＝０．３～０．７范围内仅形成一种金属间化合物。