Asynchronous action-reward learning for nonstationary serial supply chain inventory control

Action-reward learning is a reinforcement learning method. In this machine learning approach, an agent interacts with non-deterministic control domain. The agent selects actions at decision epochs and the control domain gives rise to rewards with which the performance measures of the actions are updated. The objective of the agent is to select the future best actions based on the updated performance measures. In this paper, we develop an asynchronous action-reward learning model which updates the performance measures of actions faster than conventional action-reward learning. This learning model is suitable to apply to nonstationary control domain where the rewards for actions vary over time. Based on the asynchronous action-reward learning, two situation reactive inventory control models (centralized and decentralized models) are proposed for a two-stage serial supply chain with nonstationary customer demand. A simulation based experiment was performed to evaluate the performance of the proposed two models. Chang Ouk Kim received his Ph.D. in industrial engineering from Purdue University in 1996 and his B.S. and M.S. degrees from Korea University, Republic of Korea in 1988 and 1990, respectively. From 1998--2001, he was an assistant professor in the Department of Industrial Systems Engineering at Myongji University, Republic of Korea. In 2002, he joined the Department of Information and Industrial Engineering at Yonsei University, Republic of Korea and is now an associate professor. He has published more than 30 articles at international journals. He is currently working on applications of artificial intelligence and adaptive control theory in supply chain management, RFID based logistics information system design, and advanced process control in semiconductor manufacturing. Ick-Hyun Kwon is a postdoctoral researcher in the Department of Civil and Environmental Engineering at University of Illinois at Urbana-Champaign. Previous to this position, Dr. Kwon was a research assistant professor in the Research Institute for Information and Communication Technology at Korea University, Seoul, Republic of Korea. He received his B.S., M.S., and Ph.D. degrees in Industrial Engineering from Korea University, in 1998, 2000, and 2006, respectively. His current research interests are supply chain management, inventory control, production planning and scheduling. Jun-Geol Baek is an assistant professor in the Department of Business Administration at Kwangwoon University, Seoul, Korea. He received his B.S., M.S., and Ph.D. degrees in Industrial Engineering from Korea University, Seoul, Korea, in 1993, 1995, and 2001 respectively. From March 2002 to February 2007, he was an assistant professor in the Department of Industrial Systems Engineering at Induk Institute of Technology, Seoul, Korea. His research interests include machine learning, data mining, intelligent machine diagnosis, and ubiquitous logistics information systems. An erratum to this article can be found at     

Performance of the MAP/G/1 Queue Under the Dyadic Control of Workload and Server Idleness

This paper studies the steady-state queue length process of the MAP/G/1 queue under the dyadic control of the D-policy and multiple server vacations. We derive the probability generating function of the queue length and the mean queue length. We then present computational experiences and compare the MAP queue with the Poisson queue.

Pharmacophore and docking-based combined in-silico study of KDR inhibitors

The growth and metastasis of solid tumors is dependent on angiogenesis. The vascular endothelial growth factor (VEGF) and its cell surface receptor in human KDR (kinase domain containing receptor or VEGFR-2) have particular interest because of their importance in angiogenesis. The development of novel inhibitors of VEGFR-2 would be helpful to check the growth of tumors. Quantitative structure activity relationship (QSAR) analyses used to understand the structural factors affecting inhibitory potency of thiazole-substituted pyrazolone derivatives. Several pharmacophore-based models indicated the importance of steric, hydrophobic and hydrogen bond acceptor groups to inhibitory activity. The comparative molecular field analyses (CoMFA) and comparative molecular similarity indices analyses (CoMSIA) based 3D-QSAR models were derived using pharmacophore-based alignment. Both CoMFA (q² = 0.70, r² = 0.97 and ) and CoMSIA (q² = 0.54, r² = 0.82 and ) gave reasonable results. The molecular docking (receptor-guided technique) with a recently reported receptor structure (PDB = 1YWN) were performed. The docked alignment was subsequently used for 3D-QSAR (CoMFA; q² = 0.56, r² = 0.97, , CoMSIA; q² = 0.58 r² = 0.91, ). The overall both studies were indicated, steric, electrostatic and hydrogen bond acceptor effects contribute to the inhibitory activity. CoMFA and CoMSIA models suggested that a positive bulk with hydrophobic effect is desirable around position 4 and 5 and hydrogen bond acceptor groups around pyrazolones ring will be helpful.     

Proteomic analysis of sera of asymptomatic,early‐stage patients with Wilson's disease

Wilson's disease (WD) is characterized by excessive accumulation of intracellular copper in liver and extrahepatic tissues, leading to significant oxidative stress and tissue damage. To date, several diagnostic biomarkers for WD such as serum ceruloplasmin, serum or urine copper levels and copper content in liver have been identified. However, these biomarkers may not be convincing for the diagnosis in some WD patients. To identify additional novel diagnostic biomarkers, we compared the serum protein profiles of asymptomatic childhood WD patients (n=20), without neurologic manifestation or liver cirrhosis, with normal controls (n=13). Fourteen spots, five up‐regulated and nine down‐regulated (>2‐fold), were differentially expressed in WD patients in comparison to normal control on 2‐DE. Among them, three spots were down‐regulated in both male and female WD. MS/MS analysis revealed that the three spots were complement component C3, complement factor B and alpha‐2 macroglobulin. By comparative proteome analysis, complement component C3, complement factor B and alpha‐2 macroglobulin, which are related to oxidative stress and inflammation, turned out to be good candidates for novel diagnostic biomarkers for early stages of WD.     

Electron beam lithography-assisted fabrication of Au nano-dot array as a substrate of a correlated AFM and confocal Raman spectroscopy

This paper documents a study of an Au nano-dot array that was fabricated by electron beam lithography on a glass wafer. The patterns that had features of 100nm dots in diameter with a 2-mum pitch comprised a total area of 200x200mum(2). The dot-shaped Cr underlayer was open to the air after developing Poly(methyl methacrylate) (PMMA). When dipped into the Cr etchant, the exposed Cr layer was eliminated from the glass wafer in a short period of time. In order to ultimately fabricate the Ti/Au dot arrays, Ti and Au were deposited onto the arrays with a thickness of 2 and 40nm, respectively. The lift-off procedure was carried out in the Cr etchant using sonication in order to completely remove the residual Cr/PMMA layer. The fabricated Au nano-dot array was then immersed in an Ag enhancing solution and then into an ethanol solution containing (N-(6-(Biotinamido)hexyl)-3'-(2'-pyridyldithio)-propionamide (Biotin-HPDP). The substrate was analyzed using a correlated atomic force microscopy (AFM) and confocal Raman spectroscopy. Through this procedure, position-dependent surface-enhanced Raman spectroscopy (SERS) signals could be obtained.     

Effect of deposition temperature on dielectric properties of PECVD Ta2O5 thin film

Tantalum oxide film formation by plasma-enhanced chemical vapour deposition (PECVD) using TaCl₅ as a source material was examined. The effects of deposition temperature on the formation, structure and electric properties of the Ta₂O₅ film were investigated for Al/Ta₂O₅/ p-Si (MTS) capacitors. The deposition rate and refractive index increased with increasing deposition temperature. It was found that the structure of Ta₂O₅ deposited by PECVD was amorphous as-deposited. However, crystalline -Ta₂O₅ of hexagonal structure was formed by a 700 °C, 1 h heat treatment in argon. Capacitance and relative dielectric constant of the PECVD Ta₂O₅ were found to be 2.54 fF m^–2 and 23.5, respectively. The PECVD films obtained in this study have higher dielectric constants and remarkably better general film characteristics than those obtained by other deposition methods.     

Preparation of PbTiO3 thin films using an alkoxide-alkanolamine sol-gel system

The stable range of PbTiO₃ sol and the processing conditions of uniform thin films were investigated using a solution of titanium isopropoxide, three kinds of alkanolamines (monoethanolamine, diethanolamine, triethanolamine), lead acetate trihydrate and isopropanol. Depending on the sol state with various alkanolamine/alkoxide molar ratios, diethanolamine (DEA) was very effective in preparing uniform and dense oxide films through room-temperature reaction, owing to its superior stability during the hydrolysis and condensation reaction. Perovskite PbTiO₃ thin films were obtained on oxidized silicon wafer above 550 °C and completely pure films were obtained at 650 °C using DEA as a complexing agent. The dielectric constant and loss tangent of these thin films fired at 650 °C for 30 min were found to be 240 and 0.01 at 1 kHz, respectively.     

Correlated Quantum Phenomena of Spin–Orbit Coupled Perovskite Oxide Heterostructures: Cases of SrRuO3 and SrIrO3 Based Artificial Superlattices

Unexpected, yet useful functionalities emerge when two or more materials merge coherently. Artificial oxide superlattices realize atomic and crystal structures that are not available in nature, thus providing controllable correlated quantum phenomena. This review focuses on 4d and 5d perovskite oxide superlattices, in which the spin–orbit coupling plays a significant role compared with conventional 3d oxide superlattices. Modulations in crystal structures with octahedral distortion, phonon engineering, electronic structures, spin orderings, and dimensionality control are discussed for 4d oxide superlattices. Atomic and magnetic structures, J_eff = 1/2 pseudospin and charge fluctuations, and the integration of topology and correlation are discussed for 5d oxide superlattices. This review provides insights into how correlated quantum phenomena arise from the deliberate design of superlattice structures that give birth to novel functionalities.     

Metal Ions versus Protons: Tracking of Charge-Carrier Insertion into a Cathode Oxide in Aqueous Rechargeable Batteries

Protons in aqueous electrolytes can perform as an additional type of charge carrier for insertion/extraction in addition to the primary carrier cations in aqueous rechargeable batteries. Despite many diverse claims regarding the effect of protons, mutually conflicting experimental results and their interpretations without direct evidence have been reported over the last decade. Systematic examinations and analyses are thus imperative to clarify the conditions of proton insertion in aqueous rechargeable batteries. Utilizing V₂O₅ as a model cathode and beaker-type cells with a sufficient amount of ZnSO₄ aqueous electrolytes in this work, it is demonstrated that protons are inserted into the cathode prior to Zn-ions in low-pH conditions (pH ≤ 3.0). In stark contrast, the influence of protons on the discharge voltage and capacity is insignificant, when either the pH becomes higher (pH ≥ 4.0) or the electrolyte volume is considerably low in coin-type cells. Similar behavior of pH-dependent proton insertion is also verified in Na–, Mg–, and Al-ion electrolytes. Providing a resolution to the controversy regarding proton insertion, the present study emphasizes that the influence of protons substantially varies depending on the pH and relative volume of electrolytes in aqueous batteries.     

Rational Design and Synthesis of Extremely Efficient Macroporous CoSe2–CNT Composite Microspheres for Hydrogen Evolution Reaction

Uniquely structured CoSe₂–carbon nanotube (CNT) composite microspheres with optimized morphology for the hydrogen‐evolution reaction (HER) are prepared by spray pyrolysis and subsequent selenization. The ultrafine CoSe₂ nanocrystals uniformly decorate the entire macroporous CNT backbone in CoSe₂–CNT composite microspheres. The macroporous CNT backbone strongly improves the electrocatalytic activity of CoSe₂ by improving the electrical conductivity and minimizing the growth of CoSe₂ nanocrystals during the synthesis process. In addition, the macroporous structure resulting from the CNT backbone improves the electrocatalytic activity of the CoSe₂–CNT microspheres by increasing the removal rate of generated H₂ and minimizing the polarization of the electrode during HER. The CoSe₂–CNT composite microspheres demonstrate excellent catalytic activity for HER in an acidic medium (10 mA cm^?2 at an overpotential of ≈174 mV). The bare CoSe₂ powders exhibit moderate HER activity, with an overpotential of 226 mV at 10 mA cm^?2. The Tafel slopes for the CoSe₂–CNT composite and bare CoSe₂ powders are 37.8 and 58.9 mV dec^?1, respectively. The CoSe₂–CNT composite microspheres have a slightly larger Tafel slope than that of commercial carbon‐supported platinum nanoparticles, which is 30.2 mV dec^–1.