Spatiotemporal Information Processing Emulated by Multiterminal Neuro‐Transistor Networks

All external sensory stimuli produce a spatiotemporal pattern of action potentials, which is transmitted to the biological neural system to be processed. The relative timing of synaptic spikes from different presynaptic neurons represents the features of the stimuli. A fundamental prerequisite in cortical information processing is the discrimination of different spatiotemporal input sequences. Here, capacitively coupled multiterminal oxide‐based neuro‐transistors are proposed for spatiotemporal information processing, mimicking the dendritic discriminability of different spatiotemporal input sequences. The experimental results demonstrate that such multiterminal neuromorphic devices can act as spatiotemporal information processing compartments for fundamental cortical computation. Also, as an example of spatiotemporal information processing, sound location functionality of the human brain is also emulated by constructing a simple artificial neural network based on such oxide‐based multiterminal neuro‐transistors.     

Luminace, not brightness, determines temporal brightness enhancement with chromatic stimuli.

Brightness-duration relations for chromatic stimuli were studied using three pulse-to-background luminace relations: chromatic equal-luminance pulses (3.2 cd/m2) were presented as increments of 0.3 or 1.0 log units above a lower luminance achromatic background, or were presented in hue substitution, equated in luminance to the achromatic background, so that no spatio-temporal luminance transients occurred during stimulus presentation. Incremental pulses produced temporal brightness enhancement (the Broca-Sulzer phenomenon), but hue substitution pulses did not. Temporal brightness enhancement thus depends upon the occurrence of luminance transients and cannot be produced by pulsed-to-background brightness differences associated solely with chromaticity differences.     

Duration thresholds for chromatic stimuli.

The duration necessary to detect chromatic stimuli was measured for wavelengths between 463 and 620 nm. Stimuli were presented either in hue substitution (replacement of white by a chromatic stimulus of matched luminance) or as increments. Two observers viewed a 1 degrees 45' homogeneous white field. A trial consisted of replacement of the central 40' of the field by a chromatic stimulus. In substitution mode the white field was 2.4 cd/m2., the chromatic replacement was of matched luminance using heterochromatic flicker photometry (HFP). In increment mode, the white field was decreased to 1.2 cd/m2., the chromatic replacement remained at 2.4 cd/m2. In substitution mode, duration threshold varied from approximately 3--4 ms for the spectral extremes to 45--66 ms at 570 nm. Detected stimuli were always seen as a change in chromaticity. In increment mode, thresholds were in the 2--4 ms range with no dependence upon spectral composition. Detected stimuli were seen either as changes in chromaticity or brightness. A control experiment indicated that HFP did establish equivalent luminance for the hue substitution mode. We conclude that duration thresholds in substitution mode reveal chromatic processing channels; duration thresholds in increment mode are mediated by chromatic and/or achromatic processing channels.     

Tone Reproduction in Colour Scales*

Brightness variatio within the complete scale of a given hue, from black to white, can be expressed as a function of dye Concentration (through the intermediate of its spectral analytical densities) by the “brightness curve” which yields a parameter characteristic of each hue, the “brightness contrast γB”. The brightness contrast furnishes quantitative information on the intrinsic brightness of each hue and thus allows to exploin the variability with hue of the effects of exposure variations on tone reproduction in colour photography.     

The Verriest Lecture: color lessons from space, time and motion

The appearance of a chromatic stimulus depends on more than the wavelengths composing it. The scientific literature has countless examples showing that spatial and temporal features of light influence the colors we see. Studying chromatic stimuli that vary over space, time, or direction of motion has a further benefit beyond predicting color appearance: the unveiling of otherwise concealed neural processes of color vision. Spatial or temporal stimulus variation uncovers multiple mechanisms of brightness and color perception at distinct levels of the visual pathway. Spatial variation in chromaticity and luminance can change perceived three-dimensional shape, an example of chromatic signals that affect a percept other than color. Chromatic objects in motion expose the surprisingly weak link between the chromaticity of objects and their physical direction of motion, and the role of color in inducing an illusory motion direction. Space, time, and motion-color's colleagues-reveal the richness of chromatic neural processing.     

Artificial Neuron and Synapse Realized in an Antiferromagnet/Ferromagnet Heterostructure Using Dynamics of Spin–Orbit Torque Switching

Efficient information processing in the human brain is achieved by dynamics of neurons and synapses, motivating effective implementation of artificial spiking neural networks. Here, the dynamics of spin–orbit torque switching in antiferromagnet/ferromagnet heterostructures is studied to show the capability of the material system to form artificial neurons and synapses for asynchronous spiking neural networks. The magnetization switching, driven by a single current pulse or trains of pulses, is examined as a function of the pulse width (1 s to 1 ns), amplitude, number, and pulse‐to‐pulse interval. Based on this dynamics and the unique ability of the system to exhibit binary or analog behavior depending on the device size, key functionalities of a synapse (spike‐timing‐dependent plasticity) and a neuron (leaky integrate‐and‐fire) are reproduced in the same material and on the basis of the same working principle. These results open a way toward spintronics‐based neuromorphic hardware that executes cognitive tasks with the efficiency of the human brain.     

Variant and invariant color perception in the near peripheral retina

Perceived shifts in hue that occur with increasing retinal eccentricity were measured by using an asymmetric color matching paradigm for a range of chromatic stimuli. Across nine observers a consistent pattern of hue shift was found; certain hues underwent large perceived shifts in appearance with increasing eccentricity, while for others little or no perceived shift was measured. In separate color naming experiments, red, blue, and yellow unique hues were found to be correlated with those hues that exhibited little or no perceptual shift with retinal eccentricity. Unique green, however, did not exhibit such a strong correlation. Hues that exhibited the largest perceptual shifts in the peripheral retina were found to correlate with intermediate hues that were equally likely to be identified by adjacent color naming mechanisms. However, once again the correlation was found to be weakest for the green mechanism. These data raise the possibility that perceptually unique hues are linked to color signals that represent the most reliable (minimally variant) chromatic information coming from the retina.     

A multinanodot floating-gate MOSFET circuit for spiking neuron models

Spiking neuron models, which represent information in the form of spatiotemporal patterns in spike pulse trains, have attracted much attention recently in the fields of computational neuroscience and artificial neural networks. The information processing abilities of spiking neuron models have been proven superior to those of the conventional analog-type (rate-coding) neural network models. In particular, the spike response model (SRM), which simplifies the biological neuron operation from the viewpoint of spike response, is important for VLSI implementation and various applications. In the SRM, the generation of post-synaptic potentials (PSPs) is essential. The conventional CMOS devices require complicated circuits in order to realize the function of SRM neurons. In this paper, a new device structure using a MOSFET with multinanodot floating-gate arrays is proposed for the synapse component of SRM neurons. This structure can operate at room temperature, as it utilizes thermal-noise-assisted tunneling between nanodots. The structure generates PSPs by taking advantage of the delay in electron movement due to stochastic tunneling processes. The results of single-electron circuit simulation demonstrate the generation of PSPs. The proposed structure has not yet been fabricated. The aim of this paper is to propose guidelines for the development of new nanoscale devices and fabrication technology for intelligent information processing such as that achieved in the human brain.     

Chromatic shadow compatibility and cone-excitation ratios

Logvinenko [Perception 31, 201 (2002)] asserts that Adelson's wall-of-blocks illusion [Science 262, 2042 (1993)], where identical gray-cube surface tops appear to differ in brightness, arises when the surfaces surrounding the cube tops are shadow compatible, creating a concomitant illusion of transparency. We replicated Logvinenko's main findings in the chromatic domain across three experiments in which observers match cube tops in hue, saturation, and brightness. A second set of stimuli adjusted cone-excitation ratios across the apparent transparency border [Proc. R. Soc. London 257, 115 (1994)], which enhanced lightness and brightness constancy but only when the stimuli varied in both chromaticity and intensity.     

Opponent chromatic mechanisms: relation to photopigments and hue naming.

Opponent chromatic response functions were determined from monochromatic, equal-luminance stimuli from 400 to 700 nm for three observers using a hue cancellation procedure. The same observers scaled the hue of the stimuli using the terms red, green, yellow, and blue. The results showed that the hue scaling was accurately predicted from the cancellation functions using the model of Hurvich and Jameson. Theoretical curves were generated to fit the chromatic response functions with a linear combination of three cone photopigments. The theoretical photopigments were based on an idopsin nomogram with lambdamax at a = 435, beta = 530, and lambda = 562 nm. An estimate of the density of each observer's preretinal optic media was obtained in order to relate the photopigment absorption spectra to the psychophysical data. Good linear fits were obtained for each observer's red-green curve, but not for the yellow-blue curves. A nonlinear model with an expansive exponent was used to fit the yellow-blue response functions with the three theoretical photopigments.     

Psychophysical and physiological responses to gratings with luminance and chromatic components of different spatial frequencies

Gratings that contain luminance and chromatic components of different spatial frequencies were used to study the segregation of signals in luminance and chromatic pathways. Psychophysical detection and discrimination thresholds to these compound gratings, with luminance and chromatic components of the one either half or double the spatial frequency of the other, were measured in human observers. Spatial frequency tuning curves for detection of compound gratings followed the envelope of those for luminance and chromatic gratings. Different grating types were discriminable at detection threshold. Fourier analysis of physiological responses of macaque retinal ganglion cells to compound waveforms showed chromatic information to be restricted to the parvocellular pathway and luminance information to the magnocellular pathway. Taken together, the human psychophysical and macaque physiological data support the strict segregation of luminance and chromatic information in independent channels, with the magnocellular and parvocellular pathways, respectively, serving as likely the physiological substrates.     

M-type potassium conductance controls the emergence of neural phase codes: a combined experimental and neuron modelling study

Rate and phase codes are believed to be important in neural information processing. Hippocampal place cells provide a good example where both coding schemes coexist during spatial information processing. Spike rate increases in the place field, whereas spike phase precesses relative to the ongoing theta oscillation. However, what intrinsic mechanism allows for a single neuron to generate spike output patterns that contain both neural codes is unknown. Using dynamic clamp, we simulate an in vivo-like subthreshold dynamics of place cells to in vitro CA1 pyramidal neurons to establish an in vitro model of spike phase precession. Using this in vitro model, we show that membrane potential oscillation (MPO) dynamics is important in the emergence of spike phase codes: blocking the slowly activating, non-inactivating K⁺ current (I_M), which is known to control subthreshold MPO, disrupts MPO and abolishes spike phase precession. We verify the importance of adaptive I_M in the generation of phase codes using both an adaptive integrate-and-fire and a Hodgkin–Huxley (HH) neuron model. Especially, using the HH model, we further show that it is the perisomatically located I_M with slow activation kinetics that is crucial for the generation of phase codes. These results suggest an important functional role of I_M in single neuron computation, where I_M serves as an intrinsic mechanism allowing for dual rate and phase coding in single neurons.     

An Artificial Sensory Neuron with Tactile Perceptual Learning

Sensory neurons within skin form an interface between the external physical reality and the inner tactile perception. This interface enables sensory information to be organized identified, and interpreted through perceptual learning—the process whereby the sensing abilities improve through experience. Here, an artificial sensory neuron that can integrate and differentiate the spatiotemporal features of touched patterns for recognition is shown. The system comprises sensing, transmitting, and processing components that are parallel to those found in a sensory neuron. A resistive pressure sensor converts pressure stimuli into electric signals, which are transmitted to a synaptic transistor through interfacial ionic/electronic coupling via a soft ionic conductor. Furthermore, the recognition error rate can be dramatically decreased from 44% to 0.4% by integrating with the machine learning method. This work represents a step toward the design and use of neuromorphic electronic skin with artificial intelligence for robotics and prosthetics.     

Adaptive split spectrum processing using a neural network

The polarity thresholding algorithm for split spectrum processing (SSP) is known to work well once properly tuned. However, there are several problems related to the finding of the right split parameters such as the number of filters and the information carrying spectral range. Here we show that the polarity thresholding method can be formulated as a multilayer perceptron (MLP) neural network with binary neurons and binary input signals operating in feedforward mode. Then the method is generalized to process nonbinary data using an adaptive MLP with graded neurons. Experiments with real ultrasonic NDE signals are presented using the conventional backpropagation optimization algorithm (BP) and a second order optimization method (BFGS) with exact line search. Finally, alternative adaptive algorithms based on a decomposition of the network into single neurons or linear discriminants are briefly discussed.     

Stevens's brightness law, contrast gain control, and edge integration in achromatic color perception: a unified model

The brightness of an isolated test patch is related to its luminance by a power law having an exponent of about 1/3, a result known as Stevens's brightness law. The brightness law exponent characterizes the rate at which brightness grows with luminance and can thus be thought of as an "exponential" gain factor. We studied changes in this gain factor for incremental and decremental test squares as a function of the size of a surrounding frame of homogeneous luminance. For incremental targets, the gain decreased as an approximately linear function of the frame width. For decremental targets, the gain increased as an approximately linear function of the frame width. We modeled the brightness of the frame-embedded target with a quantitative theory based on the assumption that the target brightness is determined by the sum of achromatic color induction signals originating from the inner and outer edges of the surround, a theory that has previously been used to account for the results of several other brightness matching experiments. To account for the frame-width-dependent gain changes observed in the present study, we elaborate this edge integration theory by proposing the existence of a cortical contrast gain control mechanism by which the gains applied to neural edge detectors are influenced by the responses of other edge detectors responding to the nearby edges.     

Encoding information using molecular vibronics

Signals carrying information are encoded in molecular vibrational waves (vibronics) rather than in electric currents as widely done in microelectronics. We demonstrate theoretically that signals can be transmitted along a long polypeptide molecule; the signal is modulated in a terahertz carrier corresponding to a frequency of an intrinsic vibrational mode of the backbone of the polypeptide, via amplitude and frequency modulations. The modulated carrier is coupled as a vibrational wave to the polypeptide at one end of the molecule and propagates for more than 168 angstroms towards the other end. Digital signal processing techniques are used to recover the modulated signals.     

Chromatic border distinctness: not an index of hue or saturation differences.

Some investigators have suggested that the distinctness of chromatic borders (i.e., borders visible in photic arrays of uniform luminance) can be used as an index of hue and saturation differences between lights. However, recent evidence indicates that only two types of cones in the trichromatic eye contribute to chromatic border perception. A series of experiments are reported that were designed to discriminate between these alternatives, utilizing mainly the short-wavelength visible spectrum. The results support the notion that only R and G cones in the trichromatic eye mediate the perception of chromatic borders; thus the distinctness of such borders alone cannot be used as an index of either hue or saturation differences, because both of these aspects of color involve contributions from B cones.     

Analysis of order statistic filters applied to ultrasonic flaw detection using split-spectrum processing

Split-spectrum processing of broadband ultrasonic signals coupled with order statistic filtering has proven to be effective in improving the flaw-to-clutter ratio of backscattered signals. It is shown that an optimal rank can be obtained with a prior knowledge of flaw-to-clutter ratio and the underlying distributions. The order statistic filter performs well where the flaw and clutter echoes have good statistical separation in a given quantile region representing a particular rank (e.g. minimum, median, maximum). Order statistic filters are analyzed for the situation in which the observations do not contain equivalent statistical information. Experimental and simulated results are presented to show how effectively the order statistic filter can utilize information contained in different frequency bands to improve flaw detection.     

连续波声呐中的调频信号设计方法及性能分析

相对传统的短时脉冲波主动声呐而言,连续波主动声呐是一种新型体制的声呐设备,允许在扫描周期内发射高占空比的信号,并且在发射信号的同时进行侦听,由此可以对水下目标实现连续照射,消除距离盲区。由于发射和接收机制的不同,连续波主动声呐对发射信号的波形和处理方法也各有差异,一是要考虑到"直达波"抑制问题,二是要在时间带宽积和对目标的照射时间间隔两者之间进行折中。针对上述两个问题,设计了一种在连续波主动声呐中发射的新型脉冲串信号,该类信号由多个相互正交的广义正弦调频信号串组成,以此在频域上消除回波与拷贝信号的相关性;后置处理中对接收回波提供了三种不同的方案,在时间带宽积和照射时间间隔两者之间择优选择最佳检测效果。计算机仿真结果表明:该类信号波形以及相应的处理方法可以有效地抑制直达波干扰并给出目标的速度-距离信息。