An on-line learning algorithm for energy efficient delay constrained scheduling over a fading channel

In this paper, we consider the problem of energy efficient scheduling under average delay constraint for a single user fading channel. We propose a new approach for on-line implementation of the optimal packet scheduling algorithm. This approach is based on reformulating the value iteration equation by introducing a virtual state called post-decision state. The resultant value iteration equation becomes amenable to online implementation based on stochastic approximation. This approach has an advantage that an explicit knowledge of the probability distribution of the channel state as well as the arrivals is not required for the implementation. We prove that the on-line algorithm indeed converges to the optimal policy.     

Measurements and analysis of SER-tolerant latch in a 90-nm dual-V/sub T/ CMOS process

We designed a soft error rate (SER) tolerant latch utilizing local redundancy. We implemented a test chip containing both the standard and SER-tolerant latches in a 90-nm dual-V/sub T/ CMOS process. Accelerated measurements with a neutron beam at Los Alamos National Laboratory demonstrated 10/spl times/ better reliability of the SER-tolerant latch over the standard latch at no speed degradation. The worst case energy and area penalties were 39% and 44%, respectively. Both the energy and area penalties are negligible for standard-latch transistor sizes at least double the minimum width. We analyzed the effects of the recovery time, threshold voltage assignment, and leakage on the SER robustness. The proposed latch can improve reliability of critical sequential logic elements in microprocessors and other circuits.     

Microstructure and texture evolution in Mg–1 %Mn–Sr alloys during extrusion

Microstructure and texture evolution in Mg–1 %Mn–Sr alloys during extrusion has been investigated. At 350 °C, the extrusion of Mg–1 %Mn (M1) alloy exhibits the progressive formation of basal texture from the undeformed zone to the die opening. The extruded microstructure of M1 consists of recrystallized grains nucleated by grain boundary bulging and elongated parent grains along with extensive twinning. At 350 °C, the extrusion of M1–1.6Sr alloy results in progressive elongation of Mg–Sr precipitates in the form of stringers from the undeformed zone to the die opening. The final extruded microstructure of this alloy shows extensive recrystallization occurring at the intermetallic stringers by particle-stimulated nucleation (PSN). M1–(0.3–1.6)%Sr alloys display weaker textures due to PSN which creates new grains with random orientations. At 250 °C, the extrusion of M1 creates necklace of small recrystallized grains around large elongated parent grains. M1–1.6Sr alloy extruded at 250 °C exhibits continuous dynamic recrystallization (CDRX) in the Mg matrix and PSN at Mg–Sr precipitates. PSN is less extensive at lower temperature. Both CDRX and PSN grains have random orientations, and therefore, alloy develops random texture.     

Adaptive control of Markov chains, I: Finite parameter set

Consider a controlled Markov chain whose transition probabilities depend upon an unknown parameter α taking values in finite setA. To each α is associated a prespecified stationary control lawphi(alpha). The adaptive control law selects at each timetthe control action indicated byphi(alpha_{t})where αtis the maximum likelihood estimate of α. It is shown that αtconverges to a parameter α^*such that the "closed-loop" transition probabilities corresponding to α^*andphi(alpha^{ast})are the same as those corresponding to α⁰andphi(alpha)where α⁰is the true parameter. The situation when α⁰does not belong to the model setAis briefly discussed.     

Pb and 210Pb in a tropical river environment

The Periyar River in south India receives the major share of Pb and ²¹⁰Pb from effluents released by factories along its bank that process monazite ore and rock phosphate. Their distribution in the river system is influenced by the rains during the monsoon and by salinity during the non-monsoon period. The concentration of both Pb and ²¹⁰Pb in the sediments from the backwater zone was observed to increase during the monsoon due to sediment transport from the upstream industrial zone. The water in the backwater zone showed increased levels of Pb and ²¹⁰Pb in the non-monsoon period, due possibly to solubilization from the sediments as a result of salinity changes. The levels of Pb and ²¹⁰Pb in the river water are much lower than the international standards for safe limits in drinking water. No significant concentration of Pb and ²¹⁰Pb above a background level was observed in fish obtained from the river.     

Influence of copolymer composition on the transport properties of conducting copolymers: poly(aniline-co-o-anisidine)

The effect of different compositions of monomers on the transport properties of copolymers by various techniques such as optical, electrical and magnetic has been investigated and compared with the homopolymers. The UV-visible absorption spectra show a hypsochromic shift with an increase in the o-anisidine content in copolymers indicating a decrease in the extent for conjugation (i.e. an increase in the bandgap). From temperature dependence of electrical conductivity the transport parameters such as charge localization length and average hopping distance are calculated and also the effect of the monomeric composition on the coherence length has been discussed. The magnetic studies show the paramagnetic and diamagnetic nature of homopolymers and copolymers. The X-ray diffraction pattern indicates that the copolymers are of amorphous nature.     

A unified framework for hybrid control: model and optimal controltheory

We propose a very general framework that systematizes the notion of a hybrid system, combining differential equations and automata, governed by a hybrid controller that issues continuous-variable commands and makes logical decisions. We first identify the phenomena that arise in real-world hybrid systems. Then, we introduce a mathematical model of hybrid systems as interacting collections of dynamical systems, evolving on continuous-variable state spaces and subject to continuous controls and discrete transitions. The model captures the identified phenomena, subsumes previous models, yet retains enough structure to pose and solve meaningful control problems. We develop a theory for synthesizing hybrid controllers for hybrid plants in all optimal control framework. In particular, we demonstrate the existence of optimal (relaxed) and near-optimal (precise) controls and derive “generalized quasi-variational inequalities” that the associated value function satisfies. We summarize algorithms for solving these inequalities based on a generalized Bellman equation, impulse control, and linear programming     

A New Learning Algorithm for Optimal Stopping

A linear programming formulation of the optimal stopping problem for Markov decision processes is approximated using linear function approximation. Using this formulation, a reinforcement learning scheme based on a primal-dual method and incorporating a sampling device called ‘split sampling’ is proposed and analyzed. An illustrative example from option pricing is also included.