The concept of auditory stimulus representation in cognitive neuroscience.

The sequence of neurophysiological processes elicited in the auditory system by a sound is analyzed in search of the stage at which the processes carrying sensory information cross the borderline beyond which they directly underlie sound perception. Neurophysiological data suggest that this transition occurs when the sensory input is mapped onto the physiological basis of sensory memory in the auditory cortex. At this point, the sensory information carried by the stimulus-elicited process corresponds, for the first time, to that contained by the actual sound percept. Before this stage, the sensory stimulus code is fragmentary, lacks the time dimension, cannot enter conscious perception, and is not accessible to top-down processes (voluntary mental operations). On these grounds, 2 distinct stages of auditory sensory processing, prerepresentational and representational, can be distinguished. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Auditory sensory storage in relation to the growth of sensation and acoustic information extraction.

A brief, vivid phase of auditory sensory storage that outlasts the stimulus could be used in perception in two ways: First, all of the neural activity resulting from the stimulus, including that of the sensory store, could contribute to a sensation of growing loudness; second, the sensory store could permit the continued extraction of information about the sound's acoustic properties. This study includes a task for which these two processes lead to different predictions; a third prediction is based on the two processes combined. The task required loudness judgments for two brief tones presented with a variable intertone interval. The results of Experiments 1–3 were as one would expect if both the growth of sensation and information extraction contributed to the pattern of loudness judgments. Experiment 4 strengthened the two-process account by demonstrating the separability of the two processes. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

The cognitive and neural correlates of tactile memory.

Tactile memory systems are involved in the storage and retrieval of information about stimuli that impinge on the body surface and objects that people explore haptically. Here, the authors review the behavioral, neuropsychological, neurophysiological, and neuroimaging research on tactile memory. This body of research reveals that tactile memory can be subdivided into a number of functionally distinct neurocognitive subsystems, just as is the case with auditory and visual memory. Some of these subsystems are peripheral and short lasting and others are more central and long lasting. The authors highlight evidence showing that the representation of tactile information interacts with information about other sensory attributes (e.g., visual, auditory, and kinaesthetic) of objects/events that people perceive. This fact suggests that at least part of the neural network involved in the memory for touch might be shared among different sensory modalities. In particular, multisensory/amodal information-processing networks seem to play a leading role in the storage of tactile information in the brain. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Temporal integration of sequential auditory events: silent period in sound pattern activates human planum temporale

Temporal integration is a fundamental process that the brain carries out to construct coherent percepts from serial sensory events. This process critically depends on the formation of memory traces reconciling past with present events and is particularly important in the auditory domain where sensory information is received both serially and in parallel. It has been suggested that buffers for transient auditory memory traces reside in the auditory cortex. However, previous studies investigating "echoic memory" did not distinguish between brain response to novel auditory stimulus characteristics on the level of basic sound processing and a higher level involving matching of present with stored information. Here we used functional magnetic resonance imaging in combination with a regular pattern of sounds repeated every 100 ms and deviant interspersed stimuli of 100-ms duration, which were either brief presentations of louder sounds or brief periods of silence, to probe the formation of auditory memory traces. To avoid interaction with scanner noise, the auditory stimulation sequence was implemented into the image acquisition scheme. Compared to increased loudness events, silent periods produced specific neural activation in the right planum temporale and temporoparietal junction. Our findings suggest that this area posterior to the auditory cortex plays a critical role in integrating sequential auditory events and is involved in the formation of short-term auditory memory traces. This function of the planum temporale appears to be fundamental in the segregation of simultaneous sound sources.     

Serial recall versus recall by categories in short-term memory.

C. G. Penney (1980) reported that serial recall of a list containing both auditorily and visually presented verbal items produced a lower level of recall than did separate recall of auditory and visual items. This finding was interpreted as support for the hypothesis that auditory and visual items are processed in separate streams in short-term memory, and that it is difficult to integrate these 2 streams into 1 sequence for rehearsal. The present study tested an alternate interpretation of the earlier results, the hypothesis that retention of order information is facilitated by S's being able to organize the list into 2 short sequences rather than 1 long sequence. Three experiments (72 university students) were carried out in which spatial location or category of stimulus material (letters or digits) was used to establish 2 types of items. Total recall from a list did not differ significantly between the serial and category recall conditions. Results rule out the organizational interpretation of the bisensory experiment and, therefore, provide indirect support for the separate streams hypothesis. (French abstract) (6 ref) (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Dream recall and dream recall failure: An arousal-retrieval model.

Proposes an arousal/retrieval model to account for difficulties in sleep learning and dream recall. The model is based on 2-stage memory theory, which assumes that information processing in a short-term memory store facilitates subsequent retrieval from long-term memory storage. It is proposed that the effectiveness of processing of target material is impaired during sleep. Thus, dreams and information contained in stimulus presentations to a sleeping person very likely can only be retrieved if an awakening occurs during the life of the short-term memory trace. It is further proposed that experiences occurring during or shortly after awakening compete with the target material for space in the limited-capacity processing system, with the most salient of the set favored in the competition. Interference and repression effects are assumed as additional factors in retrieval from long-term storage. (11/2 p ref) (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

The sensory nature of episodic memory: Sensory priming effects due to memory trace activation.

The aim of this study was to provide evidence that memory and perceptual processing are underpinned by the same mechanisms. Specifically, the authors conducted 3 experiments that emphasized the sensory aspect of memory traces. They examined their predictions with a short-term priming paradigm based on 2 distinct phases: a learning phase consisting of the association between a geometrical shape and a white noise and a priming phase examining the priming effect of the geometrical shape, seen in the learning phase, on the processing of target tones. In the 3 experiments, the authors found that only the prime associated with the sound in the learning phase had an effect on the target processing. The perceptual nature of the auditory component reactivated by the prime was shown in Experiments 1 and 2 via manipulation of the white noise duration in the learning phase and the stimulus onset asynchrony in the priming phase. Moreover, Experiment 3 highlighted the importance of the simultaneous association of sensory components in the learning phase, which makes it possible to integrate these components in a memory trace. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Mismatch negativity and auditory sensory memory evaluation: a new faster paradigm

A new faster paradigm to measure the duration of auditory sensory memory, as indexed by mismatch negativity (MMN) suppression to stimuli presented at increasing inter-stimulus intervals (ISI), is proposed. Trains of three stimuli were delivered at very short ISI (300 ms). The inter-train interval varied according to the memory probe interval (MPI) tested. Trains started randomly with a deviant or standard stimulus (50% each), with their event-related brain potentials subtracted to obtain the MMN. The new paradigm provided MMNs identical to the conventional one at MPIs of 0.4 and 4.0 s in young subjects, and revealed MMN suppression when the MPI was increased to 5.0 s in older subjects. The new paradigm estimates auditory sensory memory duration in one-third the time of conventional MMN.     

Immediate memory in sequential tasks.

Factors effecting the memory capacity are basic to understanding sequential tasks. The evidence indicates immediate memory is sometimes subject to decay, but that interference from interpolated items has a much larger effect. Interference effects are particularly great when the S must hold items in store while responding to previously stored material within an ongoing serial task. The ability of S to use time to reorganize the stimuli for storage works against the decay tendency. Only in rare instances does S store a pure representation of the stimulus; rather he must be viewed as an active information handler applying his knowledge of the nature of the stimulus and response to reduce his memory load. (56 ref.) (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

The role of inferior parietal and inferior frontal cortex in working memory.

Verbal working memory involves two major components: a phonological store that holds auditory-verbal information very briefly and an articulatory rehearsal process that allows that information to be refreshed and thus held longer in short-term memory (A. Baddeley, 1996, 2000; A. Baddeley & G. Hitch, 1974). In the current study, the authors tested two groups of patients who were chosen on the basis of their relatively focal lesions in the inferior parietal (IP) cortex or inferior frontal (IF) cortex. Patients were tested on a series of tasks that have been previously shown to tap phonological storage (span, auditory rhyming, and repetition) and articulatory rehearsal (visual rhyming and a 2-back task). As predicted, IP patients were disproportionately impaired on the span, rhyming, and repetition tasks and thus demonstrated a phonological storage deficit. IF patients, however, did not show impairment on these storage tasks but did exhibit impairment on the visual rhyming task, which requires articulatory rehearsal. These findings lend further support to the working memory model and provide evidence of the roles of IP and IF cortex in separable working memory processes. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Emotional memory systems in the brain

The neural mechanisms of emotion and memory have long been thought to reside side by side, if not in overlapping structures, of the limbic system. However, the limbic system concept is no longer acceptable as an account of the neural basis of memory or emotion and is being replaced with specific circuit accounts of specific emotional and memory processes. Emotional memory, a special category of memory involving the implicit (probably unconscious) learning and storage of information about the emotional significance of events, is modeled in rodent experiments using aversive classical conditioning techniques. The neural system underlying emotional memory critically involves the amygdala and structures with which it is connected. Afferent inputs from sensory processing areas of the thalamus and cortex mediate emotional learning in situations involving specific sensory cues, whereas learning about the emotional significance of more general, contextual cues involves projections to the amygdala from the hippocampal formation. Within the amygdala, the lateral nucleus (AL) is the sensory interface and the central nucleus the linkage with motor systems involved in the control of species-typical emotional behaviors and autonomic responses. Studies of cellular mechanisms in these pathways have focused on the direct relay to the lateral amygdala from the auditory thalamus. These studies show that single cells in AL respond to both conditioned stimulus and unconditioned stimulus inputs, leading to the notion that AL might be a critical site of sensory-sensory integration in emotional learning. The thalamo-amygdala pathway also exhibits long-term potentiation, a form of synaptic plasticity that might underlie the emotional learning functions of the circuit. The thalamo-amygdala pathway contains and uses the amino acid glutamate in synaptic transmission, suggesting the possibility that an amino-acid mediated form of synaptic plasticity is involved in the emotional learning functions of the pathway. We are thus well on the way to a systems level and a cellular understanding of at least one form of emotional learning and memory.     

Exposure to a rhythmic auditory stimulus facilitates memory formation for the passive avoidance task in the day-old chick.

Previous research regarding the beneficial effects of auditory stimuli on learning and memory in humans has been inconsistent. In the current study, day-old chicks were used to reduce the impact of individual differences on responses. Chicks were trained on a passive avoidance task and exposed to various auditory stimuli. Exposure to a complex rhythmic sequence for 1 min strongly facilitated chicks' long-term memory. The optimal time of presentation of the stimulus was between 10 min before and 20 min after training. Moreover, the enhancing effect was not generalized to the other auditory stimuli tested. It is suggested that this effect may be due to arousal because arousal hormones are critical to long-term memory formation. This study indicates that the temporal characteristics and type of stimulus may be important considerations when investigating the effects of auditory stimuli on cognitive functioning. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Exploring auditory saltation using the "reduced-rabbit" paradigm.

Sensory saltation is a spatiotemporal illusion in which the judged positions of stimuli are shifted toward subsequent stimuli that follow closely in time. So far, studies on saltation in the auditory domain have usually employed subjective rating techniques, making it difficult to exactly quantify the extent of saltation. In this study, temporal and spatial properties of auditory saltation were investigated using the "reduced-rabbit" paradigm and a direct-location method. In 3 experiments, listeners judged the position of the 2nd sound within sequences of 3 short sounds by using a hand pointer. When the delay between the 2nd and 3rd sound was short, the target sound was shifted toward the subsequent sound. The magnitude of displacement increased when the temporal and spatial distance between the sounds was reduced. In a 4th experiment, a modified reduced-rabbit paradigm was used to test the hypothesis that auditory saltation is associated with an impairment of target sound localization. The findings are discussed with regard to a spatiotemporal integration approach in which the processing of auditory information is combined with information from subsequent stimuli. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Temporal-order discrimination for selected auditory and visual stimulus dimensions

Thresholds for the discrimination of temporal order were determined for selected auditory and visual stimulus dimensions in 10 normal-adult volunteers. Auditory stimuli consisted of binary pure tones varying in frequency or sound pressure level, and visual stimuli consisted of binary geometric forms varying in size, orientation, or color. We determined the effect of psychophysical method and the reliability of performance across stimulus dimensions. Using a single-track adaptive procedure, Experiment 1 showed that temporal-order thresholds (TOTs) varied with stimulus dimension, being lowest for auditory frequency, intermediate for size, orientation, and auditory level, and longest for color. Test performance improved over sessions and the profile of thresholds across stimulus dimensions had a modest reliability. Experiment 2 used a double-interleaved adaptive procedure and TOTs were similarly ordered as in Experiment 1. However, TOTs were significantly lower for initially ascending versus descending tracks. With this method, the reliability of the profile across stimulus dimensions and tracks was relatively low. In Experiment 3, psychometric functions were obtained for each of the stimulus dimensions and thresholds were defined as the interpolated 70.7% correct point. The relative ordering of TOTs was similar to those obtained in the first two experiments. Non-monotonicities were found in some of the psychometric functions, with the most prominent being for the color dimension. A cross-experiment comparison of results demonstrates that TOTs and their reliability are significantly influenced by the psychophysical method. Taken together, these results support the notion that the temporal resolution of ordered stimuli involves perceptual mechanisms specific to a given sensory modality or submodality.     

Short-term memory: A comparison between frontal and nonfrontal right- and left-hemisphere brain-damaged patients.

Tested 2 groups of brain-damaged patients (n = 60 and 17) and 2 groups of controls (n = 28 and 7) on 4 different short-term memory tasks, each designed to measure the amount of information registered (0-sec delay recall) and retained after a delay of 10 sec. in 1 of 3 (visual, auditory, and kinesthetic) sensory modalities, using a variety of stimulus materials. Differences between the brain-damaged and control groups were largely due to the reduced capacity of the brain damaged to register information. Ss with anterior cerebral damage did more poorly than Ss with posterior damage on both visual and auditory short-term memory tasks. No significant differences were found between right- and left-hemisphere-damaged Ss. (26 ref.) (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

A central capacity limit to the simultaneous storage of visual and auditory arrays in working memory.

If working memory is limited by central capacity (e.g., the focus of attention; N. Cowan, 2001), then storage limits for information in a single modality should apply also to the simultaneous storage of information from different modalities. The authors investigated this by combining a visual-array comparison task with a novel auditory-array comparison task in 5 experiments. Participants were to remember only the visual, only the auditory (unimodal memory conditions), or both arrays (bimodal memory conditions). Experiments 1 and 2 showed significant dual-task tradeoffs for visual but not for auditory capacity. In Experiments 3-5, the authors eliminated modality-specific memory by using postperceptual masks. Dual-task costs occurred for both modalities, and the number of auditory and visual items remembered together was no more than the higher of the unimodal capacities (visual: 3-4 items). The findings suggest a central capacity supplemented by modality- or code-specific storage and point to avenues for further research on the role of processing in central storage. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

A theory of visual information acquisition and visual memory with special application to intensity-duration trade-offs.

Describes a theory of memory for visual material in which the visual system acts as a linear filter operating on a stimulus to produce a function, a(t), relating some sensory response to t (the time since stimulus onset). Stimulus information is acquired at a rate proportional to the product of the magnitude by which a(t) exceeds some threshold, and the amount of as-yet-unacquired information. Recall performance is assumed to equal the proportion of acquired information. The theory accounts for data from 2 digit-recall experiments in which stimulus temporal waveform was manipulated. The authors comment on the theory's account of the relation between 2 perceptual events: the phenomenological experience of the stimulus, and the memory representation that accrues from stimulus presentation. It is asserted that these 2 events, although influenced by different variables, can be viewed as resulting from 2 characteristics of the same sensory-response function. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Physiological memory in primary auditory cortex: characteristics and mechanisms

"Physiological memory" is enduring neuronal change sufficiently specific to represent learned information. It transcends both sensory traces that are detailed but transient and long-term physiological plasticities that are insufficiently specific to actually represent cardinal details of an experience. The specificity of most physiological plasticities has not been comprehensively studied. We adopted receptive field analysis from sensory physiology to seek physiological memory in the primary auditory cortex of adult guinea pigs. Receptive fields for acoustic frequency were determined before and at various retention intervals after a learning experience, typified by single-tone delay classical conditioning, e.g., 30 trials of tone-shock pairing. Subjects rapidly (5-10 trials) acquire behavioral fear conditioned responses, indexing acquisition of an association between the conditioned and the unconditioned stimuli. Such stimulus-stimulus association produces receptive field plasticity in which responses to the conditioned stimulus frequency are increased in contrast to responses to other frequencies which are decreased, resulting in a shift of tuning toward or to the frequency of the conditioned stimulus. This receptive field plasticity is associative, highly specific, acquired within a few trials, and retained indefinitely (tested to 8 weeks). It thus meets criteria for "physiological memory." The acquired importance of the conditioned stimulus is thought to be represented by the increase in tuning to this stimulus during learning, both within cells and across the primary auditory cortex. Further, receptive field plasticity develops in several tasks, one-tone and two-tone discriminative classical and instrumental conditioning (habituation produces a frequency-specific decrease in the receptive field), suggesting it as a general process for representing the acquired meaning of a signal stimulus. We have proposed a two-stage model involving convergence of the conditioned and unconditioned stimuli in the magnocellular medial geniculate of the thalamus followed by activation of the nucleus basalis, which in turn releases acetylcholine that engages muscarinic receptors in the auditory cortex. This model is supported by several recent findings. For example, tone paired with NB stimulation induces associative, specific receptive field plasticity of at least a 24-h duration. We propose that physiological memory in auditory cortex is not "procedural" memory, i.e., is not tied to any behavioral conditioned response, but can be used flexibly.     

The influence of stimulus properties on multisensory processing in the awake primate superior colliculus.

Evaluated the influence of physical properties of sensory stimuli (visual intensity, direction, and velocity; auditory intensity and location) on sensory activity and multisensory integration of superior colliculus (SC) neurons in awake, behaving primates. Two male monkeys were trained to fixate a central visual fixation point while visual and/or auditory stimuli were presented in the periphery. Visual stimuli were always presented within the contralateral receptive field of the neuron whereas auditory stimuli were presented at either ipsi- or contralateral locations. 66 of the 84 SC neurons responsive to these sensory stimuli had stronger responses when the visual and auditory stimuli were combined at contralateral locations than when the auditory stimulus was located on the ipsilateral side. This trend was significant across the population of auditory-responsive neurons. In addition, 31 SC neurons were presented a battery of tests in which the quality of one stimulus of a pair was systematically manipulated. Eight of these neurons showed preferential responses to stimuli with specific physical properties, and these preferences were not significantly altered when multisensory stimulus combinations were presented. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Working memory and work with memory: visual-spatial and further components of processing

Empirical and theoretical evidence for the concept of working memory is considered. We argue that the major weakness of this concept is its loose connection with the knowledge about background perceptive and cognitive processes. Results of two relevant experiments are provided. The first study demonstrated the classical chunking effect in a speeded visual search and comparison task, the proper domain of a large-capacity very short term sensory store. Our second study was a kind of extended levels-of-processing experiment. We attempted to manipulate visual, phonological, and (different) executive components of long-term memory in the hope of finding some systematic relationships between these forms of processing. Indeed, the results demonstrated a high degree of systematicity without any apparent need for a concept such as working memory for the explanation. Accordingly, the place for working memory is at all the interfaces where our metacognitive strategies interfere with mostly domain-specific cognitive mechanisms. Working memory is simply our work with memory.