Audio-visual speech recognition integrating 3D lip information obtained from the Kinect

Audio-visual speech recognition (AVSR) has shown impressive improvements over audio-only speech recognition in the presence of acoustic noise. However, the problems of region-of-interest detection and feature extraction may influence the recognition performance due to the visual speech information obtained typically from planar video data. In this paper, we deviate from the traditional visual speech information and propose an AVSR system integrating 3D lip information. The Microsoft Kinect multi-sensory device was adopted for data collection. The different feature extraction and selection algorithms were applied to planar images and 3D lip information, so as to fuse the planar images and 3D lip feature into the visual-3D lip joint feature. For automatic speech recognition (ASR), the fusion methods were investigated and the audio-visual speech information was integrated into a state-synchronous two stream Hidden Markov Model. The experimental results demonstrated that our AVSR system integrating 3D lip information improved the recognition performance of traditional ASR and AVSR system in acoustic noise environments.     

Compact electrostatic levitator for diffraction measurements with a two axis diffractometer and a laboratory x-ray source

A compact electrostatic levitator was developed for the structural analysis of high-temperature liquids by x-ray diffraction methods. The size of the levitator was 200 mm in diameter and 200 mm in height and can be set up on a two axis diffractometer with a laboratory x-ray source, which is very convenient in performing structural measurements of high-temperature liquids. In particular, since the laboratory x-ray source allows a great amount of user time, preliminary or challenging experiments can be performed with trial and error, which prepares and complements synchrotron x-ray experiments. The present small apparatus also provides the advantage of portability and facility of setting. To demonstrate the capability of this electrostatic levitator, the static structure factors of alumina and silicon samples in their liquid phases were successfully measured.     

Accumulation of triosephosphate isomerase, with sequence homology to Beta amyloid peptides, in vessel walls of the newborn piglet hippocampus

We investigated whether beta-amyloid (Abeta)-like immunoreactivity was seen in the brains of newborn piglets. The immunoreactivity for Abeta(1-42) and Abeta(1-40) proteins, but not Abeta precursor protein, was present in CD68-positive perivascular cells of the hippocampus and in parts of the meninges. It was colocalized with immunoreactivity for receptor for advanced glycation end product and tumor necrosis factor-alpha. The protein with a molecular mass of 27 kDa, which was recognized by the Abeta antibodies, was identified as triosephosphate isomerase (TPI) with sequence homology to Abeta peptides by N-terminal amino acid sequencing, mass fingerprint analysis using matrix-associated laser desorption/ionization mass spectrometry, and Western blotting. Western blotting assay also revealed that detectable expression of Abeta proteins were not seen in the piglet brains. These findings indicate that TPI with sequence homology to Abeta peptides accumulates in perivascular cells of the microglia/macrophage lineage located around arterial vessels of the newborn piglet hippocampus.     

Towards understanding the mechanism of action of the multidrug resistance-linked half-ABC transporter ABCG2: a molecular modeling study

The ATP-binding cassette protein ABCG2 is a member of a broad family of ABC transporters with potential clinical importance as a mediator of multidrug resistance. We carried out a homology and knowledge-based, and mutationally improved molecular modeling study to establish a much needed structural framework for the protein, which could serve as guidance for further genetic, biochemical, and structural analyses. Based on homology with known structures of both full-length and nucleotide-binding domains (NBD) of ABC transporters and structural knowledge of integral membrane proteins, an initial model of ABCG2 was established. Subsequent refinement to conform to the lipophilic index distributions in the transmembrane domain (TMD) and to the results of site-directed mutagenesis experiments led to an improved model. The complete ABCG2 model consists of two identical subunits facing each other in a closed conformation. The dimeric interface in the nucleotide-binding domain (NBD) involves a characteristic nucleotide sandwich and the interface in the TMD consists of the TM helices 1–3 of one subunit and the helices 5 and 6 of the other. The interface between the NBD and the TMD is bridged by the conserved structural motif between TM2 and TM3, the intracellular domain 1 (ICD1), and the terminal β-strand (S6) of the central β-sheet in the NBD. The apparent flexibility of the ICD1 may play a role in transmitting conformational changes from the NBD to the TMD or from the TMD to the NBD.     

Generating Instances for MAX2SAT with Optimal Solutions

A test instance generator (an instance generator for short) for MAX2SAT is a procedure that produces, given a number n of variables, a 2-CNF formula F of n variables (randomly chosen from some reasonably large domain), and simultaneously provides one of the optimal solutions for F. We propose an outline to design an instance generator using an expanding graph of a certain type, called here an "exact 1/2-enlarger". We first show a simple algorithm for constructing an exact 1/2-enlarger, thereby deriving one concrete polynomial-time instance generator GEN. We also show that an exact 1/2-enlarger can be obtained with high probability from graphs randomly constructed. From this fact, we propose another type of instance generator RGEN; it produces a 2-CNF formula with a solution which is optimal for the formula with high probability. However, RGEN produces less structured formulas and a much larger class of formulas than GEN. In fact, we prove the NP-hardness of MAX2SAT over the set of 2-CNF formulas produced by RGEN.     

A Dynamic Motion Control Technique for Human-like Articulated Figures

This paper presents a dynamic motion control technique for human-like articulated figures in a physically based character animation system. This method controls a figure such that the figure tracks input motion specified by a user. When environmental physical input such as an external force or a collision impulse are applied to the figure, this method generates dynamically changing motion in response to the physical input. We have introduced comfort and balance control to compute the angular acceleration of the figure's joints. Our algorithm controls the several parts of a human-like articulated figure separetely through the minimum number of degrees-of-freedom. Using this approach, our algorithm simulates realistic human motions at efficient computational cost. Unlike existing dynamic simulation systems, our method assumes that input motion is already realistic, and is aimed at dynamically changing the input motion in real-time only when unexpected physical input is applied to the figure. As such, our method works efficiently in the framework of current computer games.     

Pathophysiology of experimental nonoliguric acute renal failure

We have identified an integral membrane protein of 145 kD (estimated by SDS-PAGE) of rat liver nuclear envelopes that binds to WGA. We obtained peptide sequence from purified p145 and cloned and sequenced several cDNA clones and one genomic clone. The relative molecular mass of p145 calculated from its complete, cDNA deduced primary structure is 120.7 kD. Antibodies raised against a synthetic peptide represented in p145 reacted monospecifically with p145. In indirect immunofluorescence these antibodies gave punctate staining of the nuclear envelope. Immunogold EM showed specific decoration of the nuclear pores. Thus p145 is an integral membrane protein located specifically in the "pore membrane" domain of the nuclear envelope. To indicate this specific location, and based on its calculated relative molecular mass, the protein is termed POM 121 (pore membrane protein of 121 kD). The 1,199-residue-long primary structure shows a hydrophobic region (residues 29-72) that is likely to form one (or two adjacent) transmembrane segment(s). The bulk of the protein (residues 73-1199) is predicted to be exposed not on the cisternal side but on the pore side of the pore membrane. It contains 36 consensus sites for various kinases. However, its most striking feature is a repetitive pentapeptide motif XFXFG that has also been shown to occur in several nucleoporins. This nucleoporin-like domain of POM 121 is proposed to function in anchoring components of the nuclear pore complex to the pore membrane.     

Strength Analysis of Yttria-Stabilized Tetragonal Zirconia Polycrystals

Tensile strength of Y₂O₃-stabilized ZrO₂ polycrystals (Y-TZP) was measured by a newly developed tensile testing method with a rectangular bar. The tensile strength of Y-TZP was lower than that of the three-point bend strength, and the shape of the tensile strength distribution was quite different from that of the three-point bend strength distribution. It was difficult to predict the distribution curve of the tensile strength using the data of the three-point bend strength by one-modal Weibull distribution. The distribution of the tensile strength was analyzed by two- or three-model Weibull distribution coupled with an analysis of fracture origins. The distribution curve of the three-point bend strength which was estimated by multimodal Weibull distribution agreed favorably with that of the measured three-point bend strength values. A two-modal Weibull distribution function was formulated approximately from the distributions of the tensile and three-point bend strengths, and the estimated two-modal Weibull distribution function for the four-point bend strength agreed well with the measured four-point bend strength.     

Advanced coded-aperture imaging system for nuclear medicine

An advanced coded imaging system is described, and some results of phantom experiments are presented. The advanced method uses a pair of coherent codes (+ 1 and -1 codes) and has many advantages compared with conventional ones. One of the greatest advantages is that there are no sidelobes in the focal plane and only a few in other planes. Therefore, when an object can be regarded as two-dimensional, it is perfectly reconstructed with high detecting efficiency, and this is successfully simulated by a thyroid phantom with 99mTc. Moreover, this system has an ability to reconstruct tomograms, which is also shown by using ring phantoms piled on one another with some cold spots in their shells. From these experimental results it may be concluded that the new system is useful for practical applications, for example, to nuclear medicine.     

Chemical and Chromatic Bases for Preferential Visiting By the Cabbage Butterfly, Pieris rapae, to Rape Flowers

Scent and coloration of corolla were examined as floral attributes responsible for preferential visiting by the cabbage butterfly, Pieris rapae, to rape flower, Brassica rapa. Floral volatile components that release the flower-visiting behavior of the butterfly were identified by chemical analyses, electroantennography (EAG), and two behavioral bioassays: proboscis extension reflex (PER) in response to odor and attraction to artificial flowers. GC and GC-MS analyses of the headspace volatiles from the flowers revealed the presence of six aromatic compounds, benzaldehyde, phenylacetaldehyde, benzyl alcohol, 2-phenylethanol, phenylacetonitrile, and indole in decreasing order of quantity. Of these, phenylacetaldehyde elicited the highest response in the PER assay. While benzyl alcohol, 2-phenylethanol, benzaldehyde, and phenylacetonitrile evoked moderate responses, the PER-eliciting activity of indole was very weak. In two-choice behavioral bioassays, artificial flowers scented with any one of these PER-active compounds attracted significantly more butterflies than control (unscented) flowers, whereas those treated with indole were almost inactive. The EAG activities of the six chemicals were not high and were about the same at a low dose (1 g), but phenylacetaldehyde elicited a much stronger response from both sexes at higher doses (10 and 100 g). An overall profile of EAG responses at a dose of 100 g was analogous to that of PER performance, suggesting that floral volatiles may be involved in close-range location or recognition of flowers rather than long-range attraction. By spectroscopic and UV-photographic examinations of rape flower, the central part of the corolla was found to absorb UV rays in marked contrast to the other parts, which reflected near-UV rays (_max = 350 nm). This indicates that the flower is endowed with a conspicuous nectar guide that is probably an important visual stimulus for attracting foraging adults of P. rapae. Consequently, the present findings strongly suggest that this elaborate pollination strategy of rape flower, characterized by its good combination of olfactory and visual attractiveness, accounts for preferential visiting by the cabbage butterfly to the flower.