A time aggregation approach to Markov decision processes

We propose a time aggregation approach for the solution of infinite horizon average cost Markov decision processes via policy iteration. In this approach, policy update is only carried out when the process visits a subset of the state space. As in state aggregation, this approach leads to a reduced state space, which may lead to a substantial reduction in computational and storage requirements, especially for problems with certain structural properties. However, in contrast to state aggregation, which generally results in an approximate model due to the loss of Markov property, time aggregation suffers no loss of accuracy, because the Markov property is preserved. Single sample path-based estimation algorithms are developed that allow the time aggregation approach to be implemented on-line for practical systems. Some numerical and simulation examples are presented to illustrate the ideas and potential computational savings.     

Production of fungal enzymes and proteins from high salt cheese wheys

A fermentation procedure using wheys from buffalo milk, sweet rennet and salted wheys containing up to 15% NaC1, and based on the selection of salt-tolerant fungal cultures for production of microbial proteins and some economically important enzymes, is described. Certain strains of Aspergillus flavus, A. niger, A. ochraceus and A. terreus gave yields of mycelium ranging between 1.5 and 30 g on a dry weight basis. Strong proteolytic activities were exhibited by A. ochraceus, A. flavus and, to a lesser extent, by A. niger in the presence of salt up to 10% as final concentration. Powerful milk-clotting activities were also detected in culture supernatants of A. flavus and A. ochraceus. Extracellular β-galactosidases were released in to the culture fluids of these fungal strains with variable activities, depending upon the salt content of the growth medium. The application of the procedure is discussed.     

Détermination des perturbations induites aux extrémités d’une ligne blindée soumise à une excitation ponctuelle de courant

This article allows the determination of the induced perturbations at the ends of the coaxial line in wide frequency band enough. The perturbation source is a current direct point injection into the cable screen in any position. For this, we have applied the theory of the state variables, with foundation of the quasi-TEM approximation, in order to simulate the coaxial line above a ground level that has a finished conductivity. This allows us to supply the current and voltage expressions at the ends of the line as their analytic forms for any conditions of charge. Next, the elaborate objective is to verify experimentally on concrete applications if the test obtained results confirm the theoretical expectations supplied by calculation code finalizing.     

Algorithm for finding all k nearest neighbors

A very simple algorithm for computing all k nearest neighbors in 2-D is presented. The method does not rely on complicated forms of tessellation, it only requires simple data binning for fast range searching. Its applications range from scattered data interpolation to reverse engineering.     

Effect of doping polyacrylic acid with some dopants as studied by different techniques

The molecular weight of polyacrylic acid (PAA) was determined by a viscometric method using NaNO₃ as solvent at 30°C. The specific electric conductivities (σ) of PAA as well as PAA doped with carbon black (CB), chromium oxide (Cr₂O₃), and cupferron with different concentrations (from 0.25 to 1 wt %) were measured at a temperature range 360–400 K. IR spectra of some polymers were determined and it was shown that when PAA was doped with 0.5 wt % CB, a C? O? C band appeared at 775–875 cm^?1. The positron annihilation lifetime (PAL) spectra in PAA doped with the above‐mentioned dopants were measured as a function of their concentrations. It was observed that the short lifetime intensity I₁ decreased, whereas the intermediate lifetime intensity I₂, which is related to the conductivity of the material, increased with increasing the wt % of Cr₂O₃ and cupferron as well as at low concentrations of CB. These results are discussed in terms of the conducting island model. It was found that there were distinct positive relationships between σ and I₂. © 2002 John Wiley & Sons, Inc. J Appl Polym Sci 84: 877–883, 2002; DOI 10.1002/app.10381     

Scaffolded writing and rewriting in the discipline: A web-based reciprocal peer review system

This paper describes how SWoRD (scaffolded writing and rewriting in the discipline), a web-based reciprocal peer review system, supports writing practice, particularly for large content courses in which writing is considered critical but not feasibly included. To help students gain content knowledge as well as writing and reviewing skills, SWoRD supports the whole cycle of writing, reviews, back-reviews, and rewriting by scaffolding the journal publication process as its authentic practice model. In addition, SWoRD includes algorithms that compute individual reviewer’s review accuracy, which is in turn used to support the various drawbacks of reciprocal peer reviews (e.g., variation in motivation or ability of reviewers). Finally, this paper describes an empirical evaluation showing that the SWoRD approach is effective in improving writing quality in content classes.     

Synthesis and characterization of antioxidants and detergent dispersant based on some polyisobutylene copolymers

Polyisobutylene succinic anhydride-urea/polyamines (PIBSA) copolymers were synthesized as potential antioxidants and detergent dispersant agents for lubricating oils samples (SAE-30). Homogeneity, thermal stability and dispersancy of the solutions were determined. Fully soluble oil compounds that are thermally stable up to 250 °C were achieved. The oxidation stability of lube oil samples in the presence of four designed PIBSA additives (varying in the number of amine groups) was determined for a time period of up to 72 hours. The dependence of the additive efficiency on its concentration was studied to achieve maximum stability. Some PIBSA additives at concentration 3.0 · 10⁴ ppm exhibit the best results. Dispersivity values were measured at predetermined oxidation times. The results proved reliable dispersion capability as the nitrogen content of the additive is increased, i.e. the increase in the basic character of the additive leads to the increase in the neutralization capability. Moreover, the designed PIBSA additives retain their efficiency after long oxidation times, confirming their role as multifunctional nitrogen containing polymeric additive. Electronic Publication     

Biosorption of Phenol onto Posidonia oceanica (L.) Seagrass in Batch System: Equilibrium and Kinetic Modelling

In this research, the biosorption of phenol using the fibres of a Mediterranean seagrass Posidonia oceanica (L.) was studied. Batch experimental procedures were made to investigate the ability of this novel marine biomass to remove phenol from aqueous phase. The influences of pH and contact time at different initial concentrations were evaluated. The results showed that biosorption capacity was enhanced using solution pH equal to 5.2. The modelling results showed that pseudo‐second‐order and Redlich‐Peterson models were found to be the most suitable to satisfactory describe the kinetic and equilibrium adsorption data, respectively.