Coordination in visual working memory

Coordination of mental procedures is considered in terms of control processes (Baddeley, 1989) in visual working memory and appears to be a separable aspect of the demand imposed by cascaded serial processes (Carlson & Lundy, 1992). The main task required subjects to indicate whether symbolically suggested rotations and reflections correctly describe the difference between matrix patterns of filled-in squares within a 3 x 3 grid or between line drawings. Experiments were carried out to show that coordination is a separable component in this transformation task. A marker for coordination is the difference between the time taken to execute two transformations as a whole and the sum of the component transformations in isolation. The separate coordination demand was found in an experiment with matrix patterns mentioned, in an experiment with letter-like line drawings, and also in an experiment that forced subjects to maintain whole-pattern representations. A last experiment checked whether coordination is carried out by an autonomous control unit. There was a self-paced control of serial presentation of transformation symbols instead of a simultaneous presentation of those symbols. This additional external triggering resulted in a substantial decrease in the demand for coordination. Coordination of mental procedures and temporary representations is a fundamental constraint on the use of working-memory processes.     

Task constraints and visual feature binding

Tel.: 00 44 1904 433135; fax: 00 44 1904 433181; e-mail: ptql@york.ac.uk. Experimental variations on the paradigm described by Kahneman, D., Treisman, A., Gibbs, B.J., 1992. Cognitive Psychology 24, 175-219 are reported. With these techniques two coloured letters are briefly presented, in a preview field. Following a short blank interval, a single coloured letter (the target) is presented. In the first experiment, reported here, subjects named the target letter, and in the second they named the target's colour. In neither of the experiments did the colour relationships between the target and preview items influence performance, but in both cases the shape relationships were important. Further experiments explored the notion that performance in the tasks was only an imperfect reflection of underlying perceptual processes because of the constraint of having to name the letters. When subjects were presented with unfamiliar characters and named the target's colour, then the colour relationships in the displays were important; residual effects of shape preview were also found. In final studies visually similar letters were used and different groups of subjects either named the target letter or the colour of the target. Of main interest was that the colour relations between the items exerted an effect when subjects named the target's colour. The theoretical and methodological implications of these results are discussed and the limitations of the original experiments are considered in the light of the reported findings.     

Coordination processes in visual working memory

Starting with a discussion on the coordination problem from different points of view within cognition the question is raised whether there is a dissociation of coordination demand of a task and the mental load for executing mental procedures. Three investigations are carried out with the paradigm of sequential mental transformations of patterns. Results of the first experiment show that coordination really requires additional mental effort beside the time necessary for mental transformation. In a further study the transfer of a coordination mechanism is proved. The influence of segmented information presentation demonstrates that amount of coordination is related to the stability and clarity of mental representations. Plans for further experiments are presented. The results are related to the current literature on working memory research.     

Impaired visual working memory consolidation in schizophrenia.

This study investigated working memory (WM) consolidation, that is, the time required to create durable WM representations, at different levels of WM load in schizophrenia. Twenty-three schizophrenia spectrum patients and 16 control subjects participated in a change-detection task in which a sample array of 1-3 squares appeared followed by a delay and a test array. An array of pattern masks was inserted into the delay interval--covering the locations of the sample-array squares--100-800 ms after the offset of the sample array. If a durable WM representation is formed prior to mask onset, the mask should not impair performance. The degree of masking at an interval reflects the degree of WM consolidation at that time. Neither group showed masking at set size 1. Unlike controls, patients demonstrated robust masking effects at set size 2. Both groups showed masking at set size 3, but masking effects were larger and longer lasting in patients. These data demonstrate abnormally prolonged WM consolidation in schizophrenia. This impairment may slow the formation of stable representations of the visual environment, impacting everyday visually guided behavior. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Discrete resource allocation in visual working memory.

Are resources in visual working memory allocated in a continuous or a discrete fashion? On one hand, flexible resource models suggest that capacity is determined by a central resource pool that can be flexibly divided such that items of greater complexity receive a larger share of resources. On the other hand, if capacity in working memory is defined in terms of discrete storage “slots,” then observers may be able to determine which items are assigned to a slot but not how resources are divided between stored items. To test these predictions, the authors manipulated the relative complexity of the items to be stored while holding the number items constant. Although mnemonic resolution declined when set size increased (Experiment 1), resolution for a given item was unaffected by large variations in the complexity of the other items to be stored when set size was held constant (Experiments 2–4). Thus, resources in visual working memory are distributed in a discrete slot-based fashion, even when interitem variations in complexity motivate an asymmetrical division of resources across items. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Exploring developmental differences in visual short-term memory and working memory.

Although visuospatial short-term memory tasks have been found to engage more executive resources than do their phonological counterparts, it remains unclear whether this is due to intrinsic differences between the tasks or differences in participants’ experience with them. The authors found 11-year-olds’ performances on both visual short-term and working memory tasks to be more greatly impaired by an executive suppression task (random number generation) than were those of 8-year-olds. Similar findings with adults (e.g., Kane & Engle, 2000) suggest that the imposition of a suppression task may have overloaded the older children’s executive resources, which would otherwise be used for deploying strategies for performing the primary tasks. Conversely, the younger children, who probably never had the capacity or know-how to engage these facilitative strategies in the first place, performed more poorly in the single task condition but were less affected in the dual task condition. These findings suggest that differences in the children’s ability to deploy task-relevant strategy are likely to account for at least part of the executive resource requirements of visual memory tasks. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Orienting attention in visual working memory reduces interference from memory probes.

Given a changing visual environment, and the limited capacity of visual working memory (VWM), the contents of VWM must be in constant flux. Using a change detection task, the authors show that VWM is subject to obligatory updating in the face of new information. Change detection performance is enhanced when the item that may change is retrospectively cued 1 s after memory encoding and 0.5 s before testing. The retro-cue benefit cannot be explained by memory decay or by a reduction in interference from other items held in VWM. Rather, orienting attention to a single memory item makes VWM more resistant to interference from the test probe. The authors conclude that the content of VWM is volatile unless it receives focused attention, and that the standard change detection task underestimates VWM capacity. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Familiarity enhances visual working memory for faces.

Although it is intuitive that familiarity with complex visual objects should aid their preservation in visual working memory (WM), empirical evidence for this is lacking. This study used a conventional change-detection procedure to assess visual WM for unfamiliar and famous faces in healthy adults. Across experiments, faces were upright or inverted and a low- or high-load concurrent verbal WM task was administered to suppress contribution from verbal WM. Even with a high verbal memory load, visual WM performance was significantly better and capacity estimated as significantly greater for famous versus unfamiliar faces. Face inversion abolished this effect. Thus, neither strategic, explicit support from verbal WM nor low-level feature processing easily accounts for the observed benefit of high familiarity for visual WM. These results demonstrate that storage of items in visual WM can be enhanced if robust visual representations of them already exist in long-term memory. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

The time course of consolidation in visual working memory.

How long does it take to form a durable representation in visual working memory? Several theorists have proposed that this consolidation process is very slow. Here, we measured the time course of consolidation. Observers performed a change-detection task for colored squares, and shortly after the presentation of the first array, pattern masks were presented at the locations of each of the colored squares to disrupt representations that had not yet been consolidated. Performance on the memory task was impaired when the delay between the colored squares and the masks was short, and this effect became larger when the number of colored squares was increased. The rate of consolidation was approximately 50 ms per item, which is considerably faster than previous proposals. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

A core knowledge architecture of visual working memory.

[Correction Notice: An erratum for this article was reported in Vol 37(3) of Journal of Experimental Psychology: Human Perception and Performance (see record 2011-10888-001). The supplemental materials DOI is incorrect. The correct DOI for the supplemental materials is provided in the erratum.] Visual working memory (VWM) is widely thought to contain specialized buffers for retaining spatial and object information: a 'spatial-object architecture.' However, studies of adults, infants, and nonhuman animals show that visual cognition builds on core knowledge systems that retain more specialized representations: (1) spatiotemporal representations for object tracking, (2) object identity representations for object recognition, and (3) view-dependent snapshots for place recognition. In principle, these core knowledge systems may retain information separately from one another. Consistent with this hypothesis, this study provides evidence that these three types of information are subject to independent working memory storage limits. These results, combined with those from previous studies, indicate that VWM contains three specialized buffers for retaining spatiotemporal information, object identity information, and snapshot information. Thus, VWM buffers parallel core knowledge systems. This 'core knowledge architecture' links the study of visual working memory to the study of the biological foundations of visual cognition. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

Is the binding of visual features in working memory resource-demanding?

The episodic buffer component of working memory is assumed to play a role in the binding of features into chunks. A series of experiments compared memory for arrays of colors or shapes with memory for bound combinations of these features. Demanding concurrent verbal tasks were used to investigate the role of general attentional processes, producing load effects that were no greater on memory for feature combinations than for the features themselves. However, the binding condition was significantly less accurate with sequential rather than simultaneous presentation, especially for items earlier in the sequence. The findings are interpreted as evidence of a relatively automatic but fragile visual feature binding mechanism in working memory. Implications for the concept of an episodic buffer are discussed. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

The capacity of visual working memory for features and conjunctions

Short-term memory storage can be divided into separate subsystems for verbal information and visual information, and recent studies have begun to delineate the neural substrates of these working-memory systems. Although the verbal storage system has been well characterized, the storage capacity of visual working memory has not yet been established for simple, suprathreshold features or for conjunctions of features. Here we demonstrate that it is possible to retain information about only four colours or orientations in visual working memory at one time. However, it is also possible to retain both the colour and the orientation of four objects, indicating that visual working memory stores integrated objects rather than individual features. Indeed, objects defined by a conjunction of four features can be retained in working memory just as well as single-feature objects, allowing sixteen individual features to be retained when distributed across four objects. Thus, the capacity of visual working memory must be understood in terms of integrated objects rather than individual features, which places significant constraints on cognitive and neurobiological models of the temporary storage of visual information.     

Automatic guidance of visual attention from verbal working memory.

Previous studies have shown that visual attention can be captured by stimuli matching the contents of working memory (WM). Here, the authors assessed the nature of the representation that mediates the guidance of visual attention from WM. Observers were presented with either verbal or visual primes (to hold in memory, Experiment 1; to verbalize, Experiment 2; or merely to attend, Experiment 3) and subsequently were required to search for a target among different distractors, each embedded within a colored shape. In half of the trials, an object in the search array matched the prime, but this object never contained the target. Despite this, search was impaired relative to a neutral baseline in which the prime and search displays did not match. An interesting finding is that verbal primes were effective in generating the effects, and verbalization of visual primes elicited similar effects to those elicited when primes were held in WM. However, the effects were absent when primes were only attended. The data suggest that there is automatic encoding into WM when items are verbalized and that verbal as well as visual WM can guide visual attention. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Compression in visual working memory: Using statistical regularities to form more efficient memory representations.

The information that individuals can hold in working memory is quite limited, but researchers have typically studied this capacity using simple objects or letter strings with no associations between them. However, in the real world there are strong associations and regularities in the input. In an information theoretic sense, regularities introduce redundancies that make the input more compressible. The current study shows that observers can take advantage of these redundancies, enabling them to remember more items in working memory. In 2 experiments, covariance was introduced between colors in a display so that over trials some color pairs were more likely to appear than other color pairs. Observers remembered more items from these displays than from displays where the colors were paired randomly. The improved memory performance cannot be explained by simply guessing the high-probability color pair, suggesting that observers formed more efficient representations to remember more items. Further, as observers learned the regularities, their working memory performance improved in a way that is quantitatively predicted by a Bayesian learning model and optimal encoding scheme. These results suggest that the underlying capacity of the individuals’ working memory is unchanged, but the information they have to remember can be encoded in a more compressed fashion. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

The comparison of visual working memory representations with perceptual inputs.

The human visual system can notice differences between memories of previous visual inputs and perceptions of new visual inputs, but the comparison process that detects these differences has not been well characterized. In this study, the authors tested the hypothesis that differences between the memory of a stimulus array and the perception of a new array are detected in a manner that is analogous to the detection of simple features in visual search tasks. That is, just as the presence of a task-relevant feature in visual search can be detected in parallel, triggering a rapid shift of attention to the object containing the feature, the presence of a memory–percept difference along a task-relevant dimension can be detected in parallel, triggering a rapid shift of attention to the changed object. Supporting evidence was obtained in a series of experiments in which manual reaction times, saccadic reaction times, and event-related potential latencies were examined. However, these experiments also showed that a slow, limited-capacity process must occur before the observer can make a manual change detection response. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Do the contents of visual working memory automatically influence attentional selection during visual search?

In many theories of cognition, researchers propose that working memory and perception operate interactively. For example, in previous studies researchers have suggested that sensory inputs matching the contents of working memory will have an automatic advantage in the competition for processing resources. The authors tested this hypothesis by requiring observers to perform a visual search task while concurrently maintaining object representations in visual working memory. The hypothesis that working memory activation produces a simple but uncontrollable bias signal leads to the prediction that items matching the contents of working memory will automatically capture attention. However, no evidence for automatic attentional capture was obtained; instead, the participants avoided attending to these items. Thus, the contents of working memory can be used in a flexible manner for facilitation or inhibition of processing. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

The role of visual working memory in attentive tracking of unique objects.

When tracking moving objects in space humans usually attend to the objects’ spatial locations and update this information over time. To what extent do surface features assist attentive tracking? In this study we asked participants to track identical or uniquely colored objects. Tracking was enhanced when objects were unique in color. The benefit was greater when the distance between distractors and targets was smaller, but was eliminated when the objects changed colors 1 to 4 times per second, even though at any instant they were always uniquely colored. In addition, tracking uniquely colored objects impaired a secondary color-memory task more than tracking identical objects, and holding several colors in working memory eliminated the advantage of tracking uniquely colored objects. Contrary to previous studies showing that feature information is poorly retained during tracking, these findings indicate that surface properties are stored in visual working memory to facilitate tracking performance. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Functional neuroimaging of working memory in schizophrenia: Task performance as a moderating variable.

Functional neuroimaging studies in schizophrenia have demonstrated abnormal activation of dorsolateral prefrontal cortex (DLPFC) during working memory (WM) performance. However, findings of increased and decreased activity have been reported. The authors used meta-analysis to investigate whether diverging results arise as a function of differential WM task performance between patients and control participants. Results indicate that the magnitude of the group difference in WM performance is a moderator of DLPFC activation differences, and concepts such as hypo- or hyperfrontality do not universally characterize WM findings in schizophrenia. Thus, the variability in the WM activation findings between participants with schizophrenia and control participants reflects the specific conditions under which WM functions are evaluated, not just the WM construct per se. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Storage of features, conjunctions, and objects in visual working memory.

Working memory can be divided into separate subsystems for verbal and visual information. Although the verbal system has been well characterized, the storage capacity of visual working memory has not yet been established for simple features or for conjunctions of features. The authors demonstrate that it is possible to retain information about only 3–4 colors or orientations in visual working memory at one time. Observers are also able to retain both the color and the orientation of 3–4 objects, indicating that visual working memory stores integrated objects rather than individual features. Indeed, objects defined by a conjunction of four features can be retained in working memory just as well as single-feature objects, allowing many individual features to be retained when distributed across a small number of objects. Thus, the capacity of visual working memory must be understood in terms of integrated objects rather than individual features. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Task experience and children's working memory performance: A perspective from recall timing.

Working memory is an important theoretical construct among children, and measures of its capacity predict a range of cognitive skills and abilities. Data from 9- and 11-year-old children illustrate how a chronometric analysis of recall can complement and elaborate recall accuracy in advancing our understanding of working memory. A reading span task was completed by 130 children, 75 of whom were tested on 2 occasions, with sequence length either increasing or decreasing during test administration. Substantial pauses occur during participants' recall sequences, and they represent consistent performance traits over time, while also varying with recall circumstances and task history. Recall pauses help to predict reading and number skills, alongside as well as separate from levels of recall accuracy. The task demands of working memory change as a function of task experience, with a combination of accuracy and response timing in novel task situations being the strongest predictor of cognitive attainment. (PsycINFO Database Record (c) 2010 APA, all rights reserved)