Dynamics of learning near singularities in layered networks

We explicitly analyze the trajectories of learning near singularities in hierarchical networks, such as multilayer perceptrons and radial basis function networks, which include permutation symmetry of hidden nodes, and show their general properties. Such symmetry induces singularities in their parameter space, where the Fisher information matrix degenerates and odd learning behaviors, especially the existence of plateaus in gradient descent learning, arise due to the geometric structure of singularity. We plot dynamic vector fields to demonstrate the universal trajectories of learning near singularities. The singularity induces two types of plateaus, the on-singularity plateau and the near-singularity plateau, depending on the stability of the singularity and the initial parameters of learning. The results presented in this letter are universally applicable to a wide class of hierarchical models. Detailed stability analysis of the dynamics of learning in radial basis function networks and multilayer perceptrons will be presented in separate work.     

A novel method for three-dimensional observation of the vascular networks in the whole mouse brain

A novel method for acquiring serial images suitable for three-dimensional reconstruction of vascular networks in the whole brain of mouse was developed. The brain infused with a White India ink-gelatin solution was fixed and embedded in paraffin containing Sudan Black B through xylene also containing Sudan Black B. Each sliced surface of the paraffin block was coated with liquid paraffin and its image was serially acquired. Coating with liquid paraffin extremely improved the quality of the image. The series of serial images was free of distortion and a three-dimensional image was reconstructed without the problem of the alignment and registration of adjacent images. The volume-rendered image indicated three-dimensional distribution of blood vessels in a whole brain. No ghost or shadow was observed on a volume-rendered image of the White India ink-gelatin infused brain. The z-axial resolution examined on the orthogonal sections reconstituted from serial images obtained at an interval of 5 mum showed no cross talk, indicating that the z-axial resolution was no larger than 5 mum. A proper understanding of the vascular system in a whole brain is indispensable to reveal the development of the vascular system in the brain of normal and genetically manipulated mouse and vascular alterations in pathological situation, such as stroke and neurodegenerative disease. Although simple and inexpensive, this method will provide fundamental information on the vascular system in a whole brain.     

Usefulness of newly developed 99mTc-labeled STA-R12 for tumor imaging

We synthesized four new tumor imaging agents, 99mTc-labeled metalloporphyrins (99mTc-STA-R12, -STA-R21, -STA-RN101 and -ATN-12) for the tumor imaging. We compared the differences of tumor imaging potency among these agents in CDF1 mice implanted with colon 26 tumor. Tumor images with these agents were obtained by using digital gamma-camera (RC135-E, Hitachi, Tokyo) and the biodistributions were analyzed by computerized medical radionuclide imageanalyser (RP-200, Hitachi, Tokyo). The highest tumor organ ratio and the excellent tumor image were obtained by 99mTc-STA-R12 (13,17-Bispropanyl aspartic acid-3-ethenyl-8-[N,N',N",N"-tetrakis (carboxylmethyl-2,7,12,18-tetramethyl-porphyrinato]-manga nes e(III). The maximum concentration of 99mTc-STA-R12 in tumor tissue was observed at around 120 minutes after i.v. injection. On the contrary, the uptake rates of other organs and tissues such as liver, brain, muscle, lung, bone and blood continuously decreased. The rapid accumulation of STA-R12 in cancer tissue and the clearance from other tissue suggested a potential usefulness of this compound for tumor imaging agent.     

Cooling of3He-4He dilute solution down to 97 μK. Thermal boundary resistance between dilute solution and metal powder

We have cooled a³He-⁴He dilute solution down to 97 K, which is the lowest temperature ever been achieved in a dilute mixture. However, there is no sign of the superfluid transition of³He quasiparticles in the solution. In the sub-millikelvin region, we have measured the thermal boundary resistance between the solutions and sintered metal powder as a function of temperature T. We find that the thermal boundary resistence is proportional to T^–2 below 1 mK and that the resistance shows a strong dependence on magnetic fields below 0.1 T. These results suggest that the magnetic coupling is dominant in this temperature region. We have also estimated the heat leak into the dilute solution. It is found that the heat leak is proportional to the power of one third of inverse time, and the main source of the heat leak is ascribed to the viscous movement of³He quasiparticles.     

A superhydrophilic titanium implant functionalized by ozone gas modulates bone marrow cell and macrophage responses

Bone-forming cells and M? play key roles in bone tissue repair. In this study, we prepared a superhydrophilic titanium implant functionalized by ozone gas to modulate osteoconductivity and inhibit inflammatory response towards titanium implants. After 24 h of ozone gas treatment, the water contact angle of the titanium surface became zero. XPS analysis revealed that hydroxyl groups were greatly increased, but carbon contaminants were largely decreased 24 h after ozone gas functionalization. Also, ozone gas functionalization did not alter titanium surface topography. Superhydrophilic titanium (O₃–Ti) largely increased the aspect ratio, size and perimeter of cells when compared with untreated titanium (unTi). In addition, O₃–Ti facilitated rat bone marrow derived MSCs differentiation and mineralization evidenced by greater ALP activity and bone-like nodule formation. Interestingly, O₃–Ti did not affect RAW264.7 M? proliferation. However, naive RAW264.7 M? cultured on unTi produced a two-fold larger amount of TNFα than that on O₃–Ti. Furthermore, O₃–Ti greatly mitigated proinflammatory cytokine production, including TNFα and IL-6 from LSP-stimulated RAW264.7 M?. These results demonstrated that a superhydrophilic titanium prepared by simple ozone gas functionalization successfully increased MSCs proliferation and differentiation, and mitigated proinflammatory cytokine production from both naive and LPS-stimulated M?. This superhydrophilic surface would be useful as an endosseous implantable biomaterials and as a biomaterial for implantation into other tissues.     

Isolation and characterization of a novel human pancreas-specific gene, pancpin, that is down-regulated in pancreatic cancer cells

We reviewed 19 children and adolescents with cervical spine congenital synostosis as in Klippel-Feil syndrome (KFS), with an average follow-up of 12.5 years. We paid particular attention to neurologic complications associated with cervical spine abnormalities. Five patients were affected by neurologic complications; four underwent a surgical procedure; and 14 had no neurologic finding. Two had hypermobility at one level, and one had hypermobility at two levels. We found that the more numerous the occipito-C1 abnormalities, the more significant the neurologic risk. In contrast, this risk was not related to the number of "mobile blocks" or to age. Various mechanisms of neural complications have been studied in the literature: medullary abnormality, spinal instability, narrowing of the cervical canal, and vascular dysfunction. Surgery is usually thought to be required in cases with neurologic complications. The indication for surgery is, however, less clear in cases of pure instability without neurologic involvement because surgery is likely to increase the future risks at mobile disks either above or below the fuse level. Careful clinical and radiologic observation is necessary in such patients. Magnetic resonance imaging (MRI) with lateral views in flexion and extension seem to be the best method for detecting impingement of the spine on the cord.     

Relationship of occupation to blood pressure among middle-aged Japanese men--the significance of the differences in body mass index and alcohol consumption

To clarify how and why blood pressure differs between occupations, the proportions of hypertensives, and the measures of blood pressure, body mass index (BMI) and alcohol consumption among the individuals not taking antihypertensive drugs were compared between the eight occupational categories using the data from a health check-up for 589 middle-aged Japanese males, mostly randomly selected from five areas in Japan. After adjusting for age, the relationships of occupation to the proportion of hypertensives and the mean systolic and diastolic blood pressure substantially differed among the five areas. However, after further adjustment for residence, these blood pressure levels (the proportion of hypertensives, and the mean systolic and diastolic blood pressure) were found to be higher for the "Personnel in transport and communications", the "Clerical personnel", the "Managerial and civil personnel" and the "Professional and technical personnel", whereas these values were consistently lowest in the "Service personnel". Age and residence-adjusted mean BMI was also higher for the four occupational categories with the increased blood pressure levels. According to a weighted multiple regression analysis across the eight occupations, the age and residence-adjusted mean BMI was a significant predictor of the age and residence-adjusted mean systolic and diastolic blood pressure (p = 0.068 and 0.018, respectively). These results suggest that the occupation-related changes in BMI may largely contribute to the occupation-related changes in blood pressure.     

Production mechanism of polyzirconocarbo- silane using zirconium(IV)acetylacetonate and its conversion of the polymer into inorganic materials

The reaction of polycarbosilane with zirconium(IV)acetylacetonate proceeded at 573 K in nitrogen atmosphere by the condensation reaction of the Si–H bonds in polycarbosilane and the ligands of zirconium(IV)acetylacetonate accompanied by the evolution of acetylacetone, and then the molecular weight increased by the cross-linking reaction with a formation of Si–Zr bond. The obtained polyzirconocarbosilane showed higher ceramic yield than the polycarbosilane. Zirconium contained in the pyrolysed polyzirconocarbosilane was furthermore found to have the effect of inhibiting crystalline grain growth of -type SiC up to high temperature, so Si–Zr–C–O fibre, which was obtained by the use of polyzirconocarbosilane as precursor, showed high tensile strength up to high temperature.