Markov decision processes with delays and asynchronous cost collection

Markov decision processes (MDPs) may involve three types of delays. First, state information, rather than being available instantaneously, may arrive with a delay (observation delay). Second, an action may take effect at a later decision stage rather than immediately (action delay). Third, the cost induced by an action may be collected after a number of stages (cost delay). We de rive two results, one for constant and one for random delays, for reducing an MDP with delays to an MDP without delays, which differs only in the size of the state space. The results are based on the intuition that costs may be collected asynchronously, i.e., at a stage other than the one in which they are induced, as long as they are discounted properly.     

Hydrogen Resistance of Steels Alloyed with Nitrogen

We study the resistance of stainless steels with different contents of nitrogen after plasma-arc remelting to hydrogen degradation. The dependence of the mechanical properties of steels on the content of nitrogen is quite complicated, which is explained by changes in the phase composition. In the analyzed collection of steels (Kh18AN9, Kh20AN15, Kh18AG10, and Kh18AG15), Kh18AG15 steel has the best combination of the characteristics of strength and plasticity in hydrogen.     

Challenges in computer architecture evaluation

We focus on problems suited to the current evaluation infrastructure. The current limitation and trends in evaluation techniques are troublesome and could noticeably slow the rate of computer system innovation. New research has been recommended to help and make quantitative evaluations of computer systems manageable. We support research in the areas of simulation frameworks, benchmarking methodologies, analytic methods, and validation techniques.     

Temporal and radial evolution of the populations of CuI levels inthe CuBr vapor laser

Populations of CuI ground state, resonance, and metastable levels have been measured in CuBr laser with and without hydrogen additives. Temporal evolution and spatial distribution populations have been studied during the excitation pulse and also during the interpulse period of time. Addition of hydrogen results in a smaller rate of resonance and metastable levels excitation and smaller depopulation of the ground state during the excitation pulse. Repopulation of the ground state after the excitation pulse with hydrogen is much faster. CuBr molecules have been detected only in the periphery of the active zone. The density of the CuBr molecules had no noticeable change either during the excitation pulse or in the interpulse period     

Cohesive stresses and size effect in quasi-brittle materials

A novel approach to the derivation of Bažant’s size effect law is presented. Contrarily to the original Lagrangian derivation which hinged on energetic consideration, a Newtonian approach based on local stress intensity factors is presented. Through this approach, it is shown that Bažant’s size effect law is the first (and dominant) term in a series expansion for the nominal stress. Furthermore, analytical expressions forB are derived for selected specimen geometries.     

Optimization of the energy index of a heat exchanger

Translated from Khimicheskoe i Neftyannoe Mashinostroenie, No. 1, pp. 7–12, January, 1995.     

Determining the maximum velocity of a gas being discharged out of a nozzle

It is proposed to calculate the maximum discharge velocity of a chemically neutral real gas out of a Laval nozzle with consideration given to the latent heat of vapor formation of the substance in the expansion of the gas within the nozzle to total condensation, as well as to calculate the parameters which correspond to the saturation line. An equation has been derived to determine the maximum velocity of the discharge gas from an energy point of view.Translated from Inzhenerno-Fizicheskii Zhurnal, Vol. 60, No. 3, pp. 391–393, March, 1991.