An efficient initialization approach of Q-learning for mobile robots

This article demonstrates that Q-learning can be accelerated by appropriately specifying initial Q-values using dynamic wave expansion neural network. In our method, the neural network has the same topography as robot work space. Each neuron corresponds to a certain discrete state. Every neuron of the network will reach an equilibrium state according to the initial environment information. The activity of the special neuron denotes the maximum cumulative reward by following the optimal policy from the corresponding state when the network is stable. Then the initial Q-values are defined as the immediate reward plus the maximum cumulative reward by following the optimal policy beginning at the succeeding state. In this way, we create a mapping between the known environment information and the initial values of Q-table based on neural network. The prior knowledge can be incorporated into the learning system, and give robots a better learning foundation. Results of experiments in a grid world problem show that neural network-based Q-learning enables a robot to acquire an optimal policy with better learning performance compared to conventional Q-learning and potential field-based Qlearning.     

Signal tracking method of GNSS receivers for spinning vehicles

A signal tracking method of GNSS receivers for spinning vehicles is proposed in order to eliminate the influence of spinning to the GNSS signal of a vehicle. In the proposed method, a rotation tracking loop is added into the carrier tracking loop of a conventional GNSS receiver. The proposed method was verified through computer simulations and an experiment for live GPS signals. The results show that the proposed method gives an accurate tracking performance.     

Quantum computing via the Bethe ansatz

We recognize quantum circuit model of computation as factorisable scattering model and propose that a quantum computer is associated with a quantum many-body system solved by the Bethe ansatz. As an typical example to support our perspectives on quantum computation, we study quantum computing in one-dimensional nonrelativistic system with delta-function interaction, where the two-body scattering matrix satisfies the factorisation equation (the quantum Yang–Baxter equation) and acts as a parametric two-body quantum gate. We conclude by comparing quantum computing via the factorisable scattering with topological quantum computing.     

Electric field-induced concentration and capture of DNA onto microtips

Simple, high-yield concentration of DNA is important for high-throughput genetic analysis and disease diagnosis. Glass-based microfilters are popular but the process requires centrifugation steps with cumbersome chemical processes. As an alternative, a concentration method using an electric field has been explored previously, but with limited efficiency. In this paper, electric field-induced concentration and capture of DNA are studied by using high-aspect-ratio microtips coated with a gold layer. The microtips are immersed longitudinally into a solution of 100???L containing ??-phage DNA. After DNA concentration using an electric field, the microtips are withdrawn from the solution. Under AC- and biased AC fields, DNA is concentrated by electrophoresis (EP), dielectrophoresis (DEP), and electroosmotic flow (EOF). To reduce capillary effects in the withdrawal process, the microtips are coated with positively charged poly-l-lysine (PLL). The pattern of captured DNA is analyzed by fluorescence microscopy. DEP attracts DNA molecules at the edges of microtips, where the highest gradient of electric field exists. EP attracts DNA onto the surface of microtips following the vectors of an electric field. EOF generates vortexes that deliver DNA onto microtips. Using this method, 85% of DNA is captured on the PLL-coated microtips after three sequential captures. The concentration mechanism can potentially facilitate rapid and simple preparation of DNA for downstream analysis.     

Millisecond-order rapid micromixing with non-equilibrium electrokinetic phenomena

We report an active micromixer utilizing vortex generation due to non-equilibrium electrokinetics near micro/nanochannel interfaces. Its design is relatively simple, consisting of a U-shaped microchannel and a set of nanochannels. We fabricated the micromixer just using a two-step reactive ion etching process. We observed strong vortex generation in fluorescent microscopy experiments. The mixing performance was evident in a combined pressure-driven and electroosmotic flows, compared with the case with a pure pressure-driven flow. We characterized the micromixer for several conditions: different applied voltages, ion concentrations, flow rates, and nanochannel widths. The experimental results show that the mixing performance is better with a higher applied voltage, a lower ion concentration, and a wider nanochannel width. We quantified the mixing characteristics in terms of mixing time. The lowest mixing time was 2 milliseconds with the voltage of 230 V and potassium chloride solutions of 0.1 mM. We expect that the micromixer is beneficial in several applications requiring rapid mixing.     

Parameter identification and design of a robust attitude controller using <Emphasis Type="Italic">H</Emphasis><Subscript>∞</Subscript> methodology for the raptor E620 small-scale helicopter

Rigorous control synthesis for an unmanned aerial vehicle necessitates the availability of a good, reasonable model for such a vehicle. The work reported in this paper focuses on the modeling of a rotary unmanned aerial vehicle (RUAV) and the development of a robust controller that can handle parameter uncertainties and disturbances. The parameters of the plant model are obtained through the use of the prediction error method with real flight data. The response of the identified linear model shows a good match with the measured flight data. The H _∞ control scheme is applied to obtain a robustly stable controller using the identified model. The proposed controller is analyzed using frequency-domain analysis and time-domain simulations. The performance of the proposed H _∞ controller is better than that of the conventional proportional derivative controller in that the proposed controller has a shorter settling time and less overshoot. Furthermore, the degradation of the proposed controller performance is negligible and stability is maintained when the input gains to the plant are doubled, which demonstrates the good performance and robustness of the controller.     

Resonator surface contamination-a cause of frequency fluctuations?

The mass loading effects of adsorbing and desorbing contaminant molecules on the magnitude and characteristics of frequency fluctuations in a thickness-shear resonator are studied. The study is motivated by the observation that the frequency of a thickness-shear resonator is determined predominantly by such mechanical parameters as the thickness of the resonator, elastic stiffnesses, mass loading of the electrodes, and energy trapping. An equation was derived relating the spectral density of frequency fluctuations to: (1) rates of adsorption and desorption of one species of contaminant molecules; (2) mass per unit area of a monolayer of molecules: (3) frequency constant; (4) thickness of resonator; and (5) number of molecular sites on one resonator surface. The induced phase noises were found to be significant in very-high-frequency resonators and are not simple functions of the percentage of area contaminated. The spectral density of frequency fluctuations was inversely proportional to the fourth power of the thickness if other parameters were held constant.     

Synthesis of hydrous SnO2 and SnO2-coated TiO2 powders by the homogeneous precipitation method and their characterization

Hydrous SnO₂ and SnO₂-coated TiO₂ powders were synthesized by the homogeneous precipitation method using urea and the products were characterized by X-ray diffraction, thermogravimetry, differential thermal analysis, scanning electron microscopy and energy- dispersive X-ray microanalysis. Electrical conductivities were measured with an impedance analyser. Hydrous SnO₂ powder prepared under conditions without SO ₄ ^2– ions was a bulky product containing 75 wt% of water. The addition of SO ₄ ^2– ions to the solution changed bulky hydrous SnO₂ to a dense product; approximately spherical particles were obtained with an average particle size of 0.14 ± 0.03 m. with 13.5 wt % of absorbed water. Antimony-doped hydrous SnO₂ prepared under conditions with SO ₄ ^2– ions consisted of approximately spherical particles with an average particle size of 0.17 ± 0.04 m with 15.0 wt % of absorbed water. Hydrous SnO₂-coated TiO₂ powders with a good dispersion state and with various Sn/Ti ratios were prepared under conditions with SO ₄ ^2– ions. All the as-prepared coated powders were white, but the products doped with Sb³⁺ ions were turned to pale blue by heat treatment at 600° C for 1 h and their electrical conductivities increased by orders of about 3.0 in comparison with those of the other two.     

The α- to β-Si3N4 transformation in the presence of liquid silicon

The compacts consisted of , -Si₃N₄ and free silicon are heat treated in the range 1650° C to 1750° C in an argon atmosphere in order to observe the following behaviours; the to phase transformation and variations of the microstructure during heat treatment in silicon nitride. For the microstructural observation of the heat treated specimens, the same grains in the polished surface were investigated before and after eliminating the retained silicon by etching. The to phase transformation, in this case, occurs via silicon melts irrespective of added -Si₃N₄. Both and phases are soluted and precipitated into molten silicon and their morphology are changed from an equiaxed shape to prismatic one. Although elongated grains are precipitated at low temperature or in the early stage of heat treatment, fine precipitated grains are mainly observed with increasing heat treating temperature.     

Amino acid profiles and liposomes: Their role as chemosensory information carriers in the marine environment

Yellowfin tuna enhance their hunting success in the vast pelagic environment by using their sense of smell to detect intact (uninjured) prey that are beyond visual range. However, the olfactory cues that tuna use would normally face huge and rapid dilution in the open ocean. We demonstrate that these prey odors are complexed within biologically derived lipid structures that probably delay the dilution of the amino acids to subthreshold concentrations and provide persistent arousal and search cues for the tuna. This may be the first demonstration of an extracorporeal biological function for liposomes. Tuna may also form chemical search images to maximize feeding efficiency. We demonstrate that the amino acid profiles of various prey species are consistent over time and between schools, which makes the formation of search images feasible.