Storage of features, conjunctions, and objects in visual working memory.

Working memory can be divided into separate subsystems for verbal and visual information. Although the verbal system has been well characterized, the storage capacity of visual working memory has not yet been established for simple features or for conjunctions of features. The authors demonstrate that it is possible to retain information about only 3–4 colors or orientations in visual working memory at one time. Observers are also able to retain both the color and the orientation of 3–4 objects, indicating that visual working memory stores integrated objects rather than individual features. Indeed, objects defined by a conjunction of four features can be retained in working memory just as well as single-feature objects, allowing many individual features to be retained when distributed across a small number of objects. Thus, the capacity of visual working memory must be understood in terms of integrated objects rather than individual features. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

The capacity of visual working memory for features and conjunctions

Short-term memory storage can be divided into separate subsystems for verbal information and visual information, and recent studies have begun to delineate the neural substrates of these working-memory systems. Although the verbal storage system has been well characterized, the storage capacity of visual working memory has not yet been established for simple, suprathreshold features or for conjunctions of features. Here we demonstrate that it is possible to retain information about only four colours or orientations in visual working memory at one time. However, it is also possible to retain both the colour and the orientation of four objects, indicating that visual working memory stores integrated objects rather than individual features. Indeed, objects defined by a conjunction of four features can be retained in working memory just as well as single-feature objects, allowing sixteen individual features to be retained when distributed across four objects. Thus, the capacity of visual working memory must be understood in terms of integrated objects rather than individual features, which places significant constraints on cognitive and neurobiological models of the temporary storage of visual information.     

Perceptual learning style and learning proficiency: A test of the hypothesis.

Given the potential importance of using modality preference with instruction, the authors tested whether learning style preference correlated with memory performance in each of 3 sensory modalities: visual, auditory, and kinesthetic. In Study 1, participants completed objective measures of pictorial, auditory, and tactile learning and learning style self-assessments. The results indicate that objective test performance did not correlate with learning style preference. In Study 2, the authors examined in more detail the information participants used to answer the learning style self-assessment. The findings indicate that participants answered the inventory using general memories and beliefs rather than specific examples of learning in different modalities. These results challenge the hypothesis that individuals learn best with material presented in a particular sensory modality. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

A central capacity limit to the simultaneous storage of visual and auditory arrays in working memory.

If working memory is limited by central capacity (e.g., the focus of attention; N. Cowan, 2001), then storage limits for information in a single modality should apply also to the simultaneous storage of information from different modalities. The authors investigated this by combining a visual-array comparison task with a novel auditory-array comparison task in 5 experiments. Participants were to remember only the visual, only the auditory (unimodal memory conditions), or both arrays (bimodal memory conditions). Experiments 1 and 2 showed significant dual-task tradeoffs for visual but not for auditory capacity. In Experiments 3-5, the authors eliminated modality-specific memory by using postperceptual masks. Dual-task costs occurred for both modalities, and the number of auditory and visual items remembered together was no more than the higher of the unimodal capacities (visual: 3-4 items). The findings suggest a central capacity supplemented by modality- or code-specific storage and point to avenues for further research on the role of processing in central storage. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

To what extent do Gestalt grouping principles influence tactile perception?

Since their formulation by the Gestalt movement more than a century ago, the principles of perceptual grouping have primarily been investigated in the visual modality and, to a lesser extent, in the auditory modality. The present review addresses the question of whether the same grouping principles also affect the perception of tactile stimuli. Although, to date, only a few studies have explicitly investigated the existence of Gestalt grouping principles in the tactile modality, we argue that many more studies have indirectly provided evidence relevant to this topic. Reviewing this body of research, we argue that similar principles to those reported previously in visual and auditory studies also govern the perceptual grouping of tactile stimuli. In particular, we highlight evidence showing that the principles of proximity, similarity, common fate, good continuation, and closure affect tactile perception in both unimodal and crossmodal settings. We also highlight that the grouping of tactile stimuli is often affected by visual and auditory information that happen to be presented simultaneously. Finally, we discuss the theoretical and applied benefits that might pertain to the further study of Gestalt principles operating in both unisensory and multisensory tactile perception. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

振动触觉编码的研究现状

触觉作为人的一种独特的感官通道具有独特的优势，它不仅能最大限度的贴合人体的生理构造，传递硬度、大小、纹理、形状、温度等视听觉无法传递的信息，而且拥有快速准确的特性，触觉不仅可以实现全方位的感知，而且能够有效感知一些很难被视觉或听觉形式表达的更真实复杂的信息，和外界环境进行一系列的交互。振动触觉编码的设计是开发触觉的一个重要途径，也是未来人机交互的一种重要手段。本文从振动触觉感知机理入手，讨论了不同振动参数的振动触觉分辨率和振动信息编码理论，并按照方向导航和文字交互的应用对振动信息编码进行归纳总结，介绍了振动信息编码的实验手段和结论，最后展望了振动信息编码领域未来的发展前景。      

Journeying beyond classical somatosensory cortex.

Visual cortical areas are involved in a variety of somatosensory tasks in the sighted, including tactile perception of two-dimensional patterns and motion, and haptic perception of three-dimensional objects. It is still unresolved whether visual imagery or modality-independent representations can better explain such cross-modal recruitment. However, these explanations are not necessarily in conflict with each other and might both be true, if imagery processes can access modality-independent representations. Greater visual cortical engagement in blind compared to sighted people is commonplace during language tasks, and also seems to occur during processing of tactile spatial information. Such engagement is even greater in the congenitally blind compared to the late blind, indicative of enhanced cross-modal plasticity during early development. At the other extreme, short-term visual deprivation of the normally sighted also leads to cross-modal plasticity. Altogether, the boundaries between sensory modalities appear to be flexible rather than immutable. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Multisensory exploration and object individuation in infancy.

Recent research indicates that by 4.5 months, infants use shape and size information as the basis for individuating objects but that it is not until 11.5 months that they use color information for this purpose. The present experiments investigated the extent to which infants' sensitivity to color information could be increased through select experiences. Five experiments were conducted with 10.5- and 9.5-month-olds. The results revealed that multimodal (visual and tactile), but not unimodal (visual only), exploration of the objects prior to the individuation task increased 10.5-month-olds' sensitivity to color differences. These results suggest that multisensory experience with objects facilitates infants' use of color information when individuating objects. In contrast, 9.5-month-olds did not benefit from the multisensory procedure; possible explanations for this finding are explored. Together, these results reveal how an everyday experience--combined visual and tactile exploration of objects--can promote infants' use of color information as the basis for individuating objects. More broadly, these results shed light on the nature of infants' object representations and the cognitive mechanisms that support infants' changing sensitivity to color differences. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Modified sensory features of social stimulation alter the perceptual responsiveness of bobwhite quail chicks (Colinus virginianus).

This study examined the sensory features of postnatal social experience that bobwhite quail chicks (Colinus virginianus) require to maintain species-typical responding to maternal auditory–visual cues. Chicks were reared in 1 of 3 conditions after hatching: altered tactile, auditory, or visual experience with siblings. Findings revealed that altered tactile, auditory, or visual experience during the first 36 or the first 72 hr following hatching modified chicks' preferential responding to species-specific maternal cues. During the second 36 hr, altered tactile or auditory experience disrupted chicks' perceptual development, whereas altered visual experience did not affect species-typical responsiveness. Results indicate that (a) timing of early postnatal visual experience can affect early filial responsiveness to maternal cues and (b) normal sensory experience derived from early social interaction affects species-typical perceptual development. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Effects of the novelty or familiarity of visual stimuli on the expression of the immediate early gene c-fos in rat brain

To investigate substrates of recognition memory, the cellular expression of Fos protein in rat brain has been studied after groups of rats were either shown sets of novel or highly familiar objects, or were exposed to the same pattern of illumination without objects being shown. Counts of stained nuclei were made in eight brain regions, where information about novel or familiar visual stimuli is likely to be processed or stored. The counts were relatively high in occipital visual association cortex and area TE of temporal cortex, intermediate in perirhinal cortex, entorhinal cortex, anterior cingulate cortex and the diagonal band of Broca, and low in the hippocampal formation and mediodorsal nucleus of the thalamus. The number of Fos-stained cells was significantly higher for the rats shown novel objects than for those shown familiar objects in perirhinal cortex, area TE, occipital cortex and anterior cingulate cortex. Arguments are advanced that these differences in counts indicate areas involved in the processing and/or storage of information about the novelty or familiarity of visual stimuli, information important to recognition memory.     

Neuronal activity of somatosensory cortex in a cross-modal (visuo-haptic) memory task

Studies have shown that in the monkey's associative cerebral cortex, cells undergo sustained activation of discharge while the animal retains information for a subsequent action. Recent work has revealed the presence of such "memory cells" in the anterior parietal cortex (Brodmann's areas 3a, 3b, 1, and 2)--the early stage of the cortical somatosensory system. Here we inferred that, in a cross-modal visuo-haptic short-term memory task, somatosensory cells would react to visual stimuli associated with tactile features. Single-unit discharge was recorded from the anterior parietal cortex--including areas of hand representation--of monkeys performing a visuo-haptic delayed matching-to-sample task. Units changed firing frequency during the presentation of a visual cue that the animal had to remember for making a correct tactile choice between two objects at the end of a delay (retention period). Some units showed sustained activation during the delay. In some of them that activation differed depending on the cue. These findings suggest that units in somatosensory cortex react to visual stimuli behaviorally associated with tactile information. Further, the results suggest that some of these neurons are involved in short-term active memory and may, therefore, be part of cross-modal memory networks.     

Modality specific Type 2 theta production in the immobile rat.

The purpose of the present study was to compare the relative effectiveness of stimulation of different sensory modalities in eliciting Type 2 theta in the rat in the presence or absence of a ferret. Visual, auditory, and tactile stimuli were presented to rats in both conditions. Tactile stimulation produced more movement than either visual or auditory stimuli when the ferret was present. In both conditions, however, more Type 2 theta was observed in response to tactile or visual stimulation than to auditory stimulation. In the arousal condition, stimulation of tactile and auditory modalities resulted in significant increases in the amount of Type 2 theta produced. Input to the visual modality produced high levels of Type 2 theta production in both low- and high-arousal conditions. It is argued that Type 2 theta is not necessarily a precursor to movement but rather sensory processing while in a high state of arousal. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

A behavioral study of distraction by vibrotactile novelty.

Past research has demonstrated that the occurrence of unexpected task-irrelevant changes in the auditory or visual sensory channels captured attention in an obligatory fashion, hindering behavioral performance in ongoing auditory or visual categorization tasks and generating orientation and re-orientation electrophysiological responses. We report the first experiment extending the behavioral study of cross-modal distraction to tactile novelty. Using a vibrotactile-visual cross-modal oddball task and a bespoke hand-arm vibration device, we found that participants were significantly slower at categorizing the parity of visually presented digits following a rare and unexpected change in vibrotactile stimulation (novelty distraction), and that this effect extended to the subsequent trial (postnovelty distraction). These results are in line with past research on auditory and visual novelty and fit the proposition of common and amodal cognitive mechanisms for the involuntary detection of change. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

Translating visual art into tactile art to produce equivalent aesthetic experiences.

An argument is put forward to show that visual art may actually be translated into tactile objects that produce equivalent aesthetic experiences for blind or visually impaired people. This is shown by delineating the information required for such a translation in general, demonstrating that such a translation is already achievable from color vision to color vision and theoretically possible from spatial vision to spatial touch, and outlining that an analogous procedure could be applied to aesthetic experience. Limitations of such translations of visual works of art into tactile objects, and implications of such a procedure for artistic experience and education, are also mentioned. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

The multisensory image and emotion in poetry.

The manner in which multisensory aspects of complex linguistic imagery cohere was examined. A total of 377 participants brought to mind a meaningful, vivid, mental image and then constructed a prose paragraph and a poem about the image. Those aspects of sensory imagery and expressed emotions that cohere in forming the linguistic units were identified. Visual images are most likely to be the trigger that accesses information about a specific episode, with tactile and auditory images next in order of importance. Correlational analysis using the categories of sensory imagery and emotion found that romantic/sensual/sexual emotions were strongly linked to olfactory and taste sensory images. Embarrassment was significantly correlated with tactile imagery, while tactile imagery showed a negative relationship with love/family/friendship. It was concluded that mental imagery is a pervasive form of subjective experience that structures and creates order, with powerful mnemonic and hypermnesic potential. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Sensorimotor prediction and memory in object manipulation.

Notes that when people lift objects of different size but equal weight, they initially employ too much force for the large object and too little force for the small object. However, over repeated lifts of the two objects, they learn to suppress the size–weight association used to estimate force requirements and appropriately scale their lifting forces to the true and equal weights of the objects. Thus, sensorimotor memory from previous lifts comes to dominate visual size information in terms of force prediction. Here the authors ask whether this sensorimotor memory is transient, preserved only long enough to perform the task, or more stable. After completing an initial lift series in which they lifted equally weighted large and small objects in alternation, 24 18–28 yr olds then repeated the lift series after delays of 15 min or 24 hrs. In both cases, participants retained information about the weights of the objects and used this information to predict the appropriate fingertip forces. This preserved sensorimotor memory suggests that participants acquired internal models of the size–weight stimuli that could be used for later prediction. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Schemas and images as memory aids: Two modes of processing social information.

Proposes that schemas, informational structures characterized as verbal or propositional, are more effective as memory aids for information about the self than for information about other people. It is also proposed that images, informational structures characterized as visual or imaginal, are more effective as memory aids for information about other people than for information about the self. Two parallel experiments were performed. In Exp I, 24 undergraduates who were asked to decide whether various trait adjectives described either themselves or other people showed superior subsequent recall for the self-referent words. In Exp II, 24 undergraduates asked to form mental images of either themselves or other people interacting with various concrete objects showed inferior subsequent recall for the self-referent words. These divergent results and several current findings suggest that schemas and images may involve different cognitive principles and constitute 2 modes of processing social information. (38 ref) (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

The role of inferior parietal and inferior frontal cortex in working memory.

Verbal working memory involves two major components: a phonological store that holds auditory-verbal information very briefly and an articulatory rehearsal process that allows that information to be refreshed and thus held longer in short-term memory (A. Baddeley, 1996, 2000; A. Baddeley & G. Hitch, 1974). In the current study, the authors tested two groups of patients who were chosen on the basis of their relatively focal lesions in the inferior parietal (IP) cortex or inferior frontal (IF) cortex. Patients were tested on a series of tasks that have been previously shown to tap phonological storage (span, auditory rhyming, and repetition) and articulatory rehearsal (visual rhyming and a 2-back task). As predicted, IP patients were disproportionately impaired on the span, rhyming, and repetition tasks and thus demonstrated a phonological storage deficit. IF patients, however, did not show impairment on these storage tasks but did exhibit impairment on the visual rhyming task, which requires articulatory rehearsal. These findings lend further support to the working memory model and provide evidence of the roles of IP and IF cortex in separable working memory processes. (PsycINFO Database Record (c) 2010 APA, all rights reserved)