Editorial: Special issue on approximate dynamic programming and reinforcement learning

We are extremely pleased to present this special issue of the Journal of Control Theory and Applications.Approximate dynamic programming (ADP) is a general and effective approach for solving optimal control and estimation problems by adapting to uncertain environments over time.ADP optimizes the sensing objectives accrued over a future time interval with respect to an adaptive control law,conditioned on prior knowledge of the system,its state,and uncertainties.A numerical search over the present value of the control minimizes a Hamilton-Jacobi-Bellman (HJB) equation providing a basis for real-time,approximate optimal control.     

Polarized light imaging of white matter architecture

Polarized light imaging (PLI) is a method to image fiber orientation in gross histological brain sections based on the birefringent properties of the myelin sheaths. The method uses the transmission of polarized light to quantitatively estimate the fiber orientation and inclination angles at every point of the imaged section. Multiple sections can be assembled into a 3D volume, from which the 3D extent of fiber tracts can be extracted. This article describes the physical principles of PLI and describes two major applications of the method: the imaging of white matter orientation of the rat brain and the generation of fiber orientation maps of the human brain in white and gray matter. The strengths and weaknesses of the method are set out.     

The second order local-image-structure solid

Characterization of second order local image structure by a 6D vector (or jet) of Gaussian derivative measurements is considered. We consider the affect on jets of a group of transformations-affine intensity-scaling, image rotation and reflection, and their compositions-that preserve intrinsic image structure. We show how this group stratifies the jet space into a system of orbits. Considering individual orbits as points, a 3D orbifold is defined. We propose a norm on jet space which we use to induce a metric on the orbifold. The metric tensor shows that the orbifold is intrinsically curved. To allow visualization of the orbifold and numerical computation with it, we present a mildly-distorting but volume-preserving embedding of it into euclidean 3-space. We call the resulting shape, which is like a flattened lemon, the second order local-image-structure solid. As an example use of the solid, we compute the distribution of local structures in noise and natural images. For noise images, analytical results are possible and they agree with the empirical results. For natural images, an excess of locally 1D structure is found.     

Activation of the mouse heart adenosine 5',5"'-P1-P4-tetraphosphate receptor

We have previously demonstrated that mouse brain membrane fractions have a specific, saturable receptor for diadenylated nucleotides. Binding is specific for two adenosines, and the length of the phosphate bridge is critical, with four phosphates being optimal [Hilderman et al. (1991) J. Biol. Chem. 266, 6915-6918]. In this report, we demonstrate that adenosine 5',5"'-P1,P4-tetraphosphate (Ap4A) binding to its receptor is dependent upon an activation step that requires divalent cations and a serine protease. Monoclonal antibodies (Mabs) are identified that inhibit Ap4A binding to its membrane receptor. These antibodies recognize a 212-kDa membrane protein. However, SDS-PAGE analysis of Ap4A cross-linked to membrane fractions reveals that Ap4A is not attached to the 212-kDa peptide but to a 30-kDa polypeptide. Appearance of the 30-kDa polypeptide is dependent on the activation step, and one of the inhibitory antibodies blocks its appearance. We suggest that the protease-dependent processing step involves cleavage of the 212-kDa component with the appearance of an active 30-kDa receptor.     

The measurement of shear compliances for oriented polyethylene terephthalate sheet

Two techniques have been used to measure the shear compliances of one-way drawn uniplanar-axially-oriented polyethylene terephthalate (PET) sheet, draw ratio 51; a torsional method for all three compliancesS ₄₄,S ₅₅ andS ₆₆, and a recently-developed simple-shear method forS ₄₄ andS ₆₆. The two techniques gave values for the compliances in common which agreed very well. An examination of end effects in torsion has also been made. The determination of the three shear compliances complete the determination of all nine independent compliances for this PET sheet. The overall mechanical anisotropy has been considered in the light of existing structural information, and comparison made with the elastic constants of isotropic PET and a highly oriented PET fibre on the basis of the single-phase aggregate model.     

Development of a measure for the information technology infrastructure construct

The goal of this research was to operationalize the information technology infrastructure (ITI) concept by identifying its underlying dimensions and establishing a valid and reliable measure for the construct. In order to accomplish this task with the highest degree of certainty, two approaches were sequentially applied: exploratory factor analysis and confirmatory factor analysis. In evaluating the confirmatory factor model, a step-by-step process was employed, assessing unidimensionality, reliability, discriminant validity, and nomological validity. The dimensions of ITI were determined to be: Chief Information Officer, IT Planning, IT Security, Technology Integration, Advisory Committee, Enterprise Model, and Data Administration. Researchers may now make use of this validated ITI measure to conduct investigations of ITI and other organizational measures. Implications of the ITI measure with other organizational initiatives such as electronic commerce and knowledge management are explored.     

CVT中阻尼器的研究

阐述了电容式电压互感器的各种阻尼器的优缺点,并对速饱和阻尼器设计进行了详述,提出了CVT设计速饱和阻尼器应注意的事项。     

Interfaces are the dominant feature of dielectrics at the nanometric level

It is argued that the behavior of dielectric particles as they shrink in size through micrometric to nanometric scales will be increasingly dominated by the properties of their interfaces with the environment. The various interatomic and intermolecular forces that determine the structure of these interfaces are reviewed with special emphasis on their electrical nature. A number of situations in which passive and dynamic dielectric properties are traceable to nanometric interfacial properties are considered. It is also demonstrated that such interfaces are nanometric electromechanical (NEM) systems which acting collectively also explain piezoelectricity in macroscopic systems. Interfaces are naturally nanometric entities and must have a major role in the future development of nanotechnology. Their ubiquitous employment in living systems is noted and comparison suggests synergistic opportunities.     

An improved method for combined autoradiography and histochemistry: the simultaneous detection of 6-3H thymidine and acid phosphatase activity in cryostat sections of mouse thymus and duodenum

A new method is described that enables the simultaneous detection of 6-³H thymidine incorporation and acid phosphatase activity in the same tissue section. Histochemically, naphthol AS B1 released by tissue based acid phosphatase activity from the substrate naphthyl AS B1 phosphoric acid is coupled with a range of diazonium salts to produce insoluble azo dyes. The azo dye tests result in a particulate localization of lysosomal acid phosphatase and also label diffuse sources associated with cell death. The tests selected permit the application of photographic emulsion without the necessity of an inert barrier layer to separate the emulsion from the histochemically treated cryosections. The localization of 6-³H thymidine incorporation and cell death in mouse thymus and duodenum is demonstrated and comparative counts estimating the distribution of 6-³H thymidine incorporation and hydrolase labelled cell death in the thymus are presented. Young mouse thymus (5 weeks) was found to contain 1·36 ± 0·12% dying cells and 6·78 ± 0·03% thymidine incorporating cells, whilst old mouse thymus (53 weeks) was found to contain 2·34 ± 0·6% dying cells and 5·29 ± 0·37% thymidine incorporating cells.