Visual search for faces with emotional expressions.

The goal of this review is to critically examine contradictory findings in the study of visual search for emotionally expressive faces. Several key issues are addressed: Can emotional faces be processed preattentively and guide attention? What properties of these faces influence search efficiency? Is search moderated by the emotional state of the observer? The authors argue that the evidence is consistent with claims that (a) preattentive search processes are sensitive to and influenced by facial expressions of emotion, (b) attention guidance is influenced by a dynamic interplay of emotional and perceptual factors, and (c) visual search for emotional faces is influenced by the emotional state of the observer to some extent. The authors also argue that the way in which contextual factors interact to determine search performance needs to be explored further to draw sound conclusions about the precise influence of emotional expressions on search efficiency. Methodological considerations (e.g., set size, distractor background, task set) and ecological limitations of the visual search task are discussed. Finally, specific recommendations are made for future research directions. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Selective attention to emotional faces following recovery from depression.

This study was designed to examine attentional biases in the processing of emotional faces in currently and formerly depressed participants and healthy controls. Using a dot-probe task, the authors presented faces expressing happy or sad emotions paired with emotionally neutral faces. Whereas both currently and formerly depressed participants selectively attended to the sad faces, the control participants selectively avoided the sad faces and oriented toward the happy faces, a positive bias that was not observed for either of the depressed groups. These results indicate that attentional biases in the processing of emotional faces are evident even after individuals have recovered from a depressive episode. Implications of these findings for understanding the roles of cognitive and interpersonal functioning in depression are discussed. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Attentional capture by irrelevant emotional distractor faces.

We establish attentional capture by emotional distractor faces presented as a “singleton” in a search task in which the emotion is entirely irrelevant. Participants searched for a male (or female) target face among female (or male) faces and indicated whether the target face was tilted to the left or right. The presence (vs. absence) of an irrelevant emotional singleton expression (fearful, angry, or happy) in one of the distractor faces slowed search reaction times compared to the singleton absent or singleton target conditions. Facilitation for emotional singleton targets was found for the happy expression but not for the fearful or angry expressions. These effects were found irrespective of face gender and the failure of a singleton neutral face to capture attention among emotional faces rules out a visual odd-one-out account for the emotional capture. The present study thus establishes irrelevant, emotional, attentional capture. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

Conditioning-induced attentional bias for face stimuli measured with the emotional Stroop task.

People with anxiety disorder display attentional bias toward threat-related objects. Using classical fear conditioning, the authors investigated the possible source of such bias in normal participants. Following differential fear conditioning in which an angry face of either male or female (conditioned stimulus: CS+) was paired with mild electric fingershock (unconditioned stimulus: US) but the angry face of the other gender and all other facial expressions unpaired (CS-), an emotional Stroop task was administered. In the Stroop task, participants were required to identify the color of the facial stimuli (red, green, blue, or yellow). Response latency was significantly longer for the CS+ angry face than the other unpaired facial stimuli (CS-). Furthermore, this acquired attentional bias was positively correlated with the level of trait-anxiety measured before the conditioning and the degree of self-reported aversiveness of the US. Our results demonstrated that attentional bias could be induced in normal individuals through a simple associative learning procedure, and the acquisition is modulated by the level of trait anxiety and the level of perceived fear of the aversive US. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Classical conditioning of autonomic fear responses is independent of contingency awareness.

The role of contingency awareness in classical conditioning experiments using human subjects is currently under debate. This study took a novel approach to manipulating contingency awareness in a differential Pavlovian conditioning paradigm. Complex sine wave gratings were used as visual conditional stimuli (CS). By manipulating the fundamental spatial frequency of the displays, we were able to construct pairs of stimuli that varied in discriminability. One group of subjects was given an “easy” discrimination, and another was exposed to a “difficult” CS+ and CS–. A 3rd group was exposed to a stimulus that was paired with the unconditional stimulus (UCS) 50% of the time and served as a control. Skin conductance response (SCR) and continuous UCS expectancy data were measured concurrently throughout the experiment. Differential UCS expectancy was found only in the easy discrimination group. Differential SCRs were found in the easy discrimination group as well as in the difficult discrimination group, but not in the 50% contingency control. The difficult discrimination group did not exhibit differential UCS expectancy but did show clear differential SCR. These observations support a dual process interpretation of classical conditioning whereby conditioning on an implicit level can occur without explicit knowledge about the contingencies. The role of contingency awareness in classical conditioning experiments using human subjects is currently under debate. This study took a novel approach to manipulating contingency awareness in a differential Pavlovian conditioning paradigm. Complex sine wave gratings were used as visual conditional stimuli (CS). By manipulating the fundamental spatial frequency of the displays, we were able to construct pairs of stimuli that varied in discriminability. One group of subjects was given an “easy” discrimination, and another was exposed to a “difficult” CS+ and CS–. A 3rd group was exposed to a stimulus that was paired with the unconditional stimulus (UCS) 50% of the time and served as a control. Skin conductance response (SCR) and continuous UCS expectancy data were measured concurrently throughout the experiment. Differential UCS expectancy was found only in the easy discrimination group. Differential SCRs were found in the easy discrimination group as well as in the difficult discrimination group, but not in the 50% contingency control. The difficult discrimination group did not exhibit differential UCS expectancy but did show clear differential SCR. These observations support a dual process interpretation of classical conditioning whereby conditioning on an implicit level can occur without explicit knowledge about the contingencies. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Attention for emotional faces under restricted awareness revisited: Do emotional faces automatically attract attention?

Theoretical models of attention for affective information have assigned a special status to the cognitive processing of emotional facial expressions. One specific claim in this regard is that emotional faces automatically attract visual attention. In three experiments, the authors investigated attentional cueing by angry, happy, and neutral facial expressions that were presented under conditions of limited awareness. In these experiments, facial expressions were presented in a masked (14 ms or 34 ms, masked by a neutral face) and unmasked fashion (34 ms or 100 ms). Compared with trials containing neutral cues, delayed responding was found on trials with emotional cues in the unmasked, 100-ms condition, suggesting stronger allocation of cognitive resources to emotional faces. However, in both masked and unmasked conditions, the hypothesized cueing of visual attention to the location of emotional facial expression was not found. In contrary, attentional cueing by emotional faces was less strong compared with neutral faces in the unmasked, 100-ms condition. These data suggest that briefly presented emotional faces influence cognitive processing but do not automatically capture visual attention. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Masked fearful faces modulate the orienting of covert spatial attention.

Dot probe studies indicate that masked fearful faces modulate spatial attention. However, without a baseline to compare congruent and incongruent reaction times, it is unclear which aspect(s) of attention (orienting or disengagement) is affected. Additionally, backward masking studies commonly use a neutral face as the mask stimulus. This method results in greater perceptual inconsistencies for fearful as opposed to neutral faces. Therefore, it is currently unclear whether the effects of backward masked fearful faces are due to the fearful nature of the face or perceptual inconsistencies. Equally unclear, is whether this spatial attention effect is due to orienting or disengagement. Two modified dot probe experiments with neutral (closed mouth in Experiment 1) and smiling (open mouth in Experiment 2) masks were used to determine the role of perceptual inconsistencies in mediating the spatial attention effects elicited by masked fearful faces. The results indicate that masked fearful faces modulate the orienting of spatial attention, and it appears that this effect is due to the fearful nature of the face rather than perceptual inconsistencies between the initial faces and masks. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Differential subjective and psychophysiological responses to socially and nonsocially generated emotional stimuli.

Sociality may determine the subjective experience and physiological response to emotional stimuli. Film segments induced socially and nonsocially generated emotions. Comedy (social positive), bereavement (social negative), pizza scenes (nonsocial positive), and wounded bodies (nonsocial negative) elicited four distinct emotional patterns. Per subjective report, joy, sadness, appetite, and disgust were elicited by the targeted stimulus condition. The social/nonsocial dimension influenced which emotional valence(s) elicited a skin conductance response, a finding that could not be explained by differences in subjective arousal. Heart rate deceleration was more responsive to nonsocially generated emotions. Taken together, these findings suggest that sociality affects the physiological profile of responses to emotional valence. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Detection of emotional faces: Salient physical features guide effective visual search.

In this study, the authors investigated how salient visual features capture attention and facilitate detection of emotional facial expressions. In a visual search task, a target emotional face (happy, disgusted, fearful, angry, sad, or surprised) was presented in an array of neutral faces. Faster detection of happy and, to a lesser extent, surprised and disgusted faces was found both under upright and inverted display conditions. Inversion slowed down the detection of these faces less than that of others (fearful, angry, and sad). Accordingly, the detection advantage involves processing of featural rather than configural information. The facial features responsible for the detection advantage are located in the mouth rather than the eye region. Computationally modeled visual saliency predicted both attentional orienting and detection. Saliency was greatest for the faces (happy) and regions (mouth) that were fixated earlier and detected faster, and there was close correspondence between the onset of the modeled saliency peak and the time at which observers initially fixated the faces. The authors conclude that visual saliency of specific facial features--especially the smiling mouth--is responsible for facilitated initial orienting, which thus shortens detection. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Awareness of faces is modulated by their emotional meaning.

A central question in perception is how stimuli are selected for access to awareness. This study investigated the impact of emotional meaning on detection of faces using the attention blink paradigm. Experiment 1 showed that fearful faces were detected more frequently than neutral faces, and Experiment 2 revealed preferential detection of fearful faces compared with happy faces. To rule out image artifacts as a cause for these results, Experiment 3 manipulated the emotional meaning of neutral faces through fear conditioning and showed a selective increase in detection of conditioned faces. These results extend previous reports of preferential detection of emotional words or schematic objects and suggest that fear conditioning can modulate detection of formerly neutral stimuli. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Fearful expressions gain preferential access to awareness during continuous flash suppression.

Rapid evaluation of ecologically relevant stimuli may lead to their preferential access to awareness. Continuous flash suppression allows assessment of affective processing under conditions in which stimuli have been rendered invisible due to the strongly suppressive nature of dynamic noise relative to static images. The authors investigated whether fearful expressions emerge from suppression into awareness more quickly than images of neutral or happy expressions. Fearful faces were consistently detected faster than neutral or happy faces. Responses to inverted faces were slower than those to upright faces but showed the same effect of emotional expression, suggesting that some key feature or features in the inverted faces remained salient. When using stimuli solely representing the eyes, a similar bias for detecting fear emerged, implicating the importance of information from the eyes in the preconscious processing of fear expressions. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Detecting emotional faces and features in a visual search paradigm: Are faces special?

In 2 experiments, participants were presented schematic faces with emotional expressions (threatening, friendly) in a neutral-faces context or neutral expressions in an emotional-faces context. These conditions were compared with detection performance in displays containing key features of emotional faces not forming the perceptual gestalt of a face. Supporting the notion of a threat detection advantage, Experiment 1 found that threatening faces were faster detected than friendly faces, whereas no difference emerged between the corresponding feature conditions. Experiment 2 increased task difficulty with a backward masking procedure and found corresponding results. In neither of the studies was the threat detection advantage associated with reduced accuracy. However, features were, in general, detected faster than faces when task difficulty was high. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Subjective responses to emotional stimuli during labeling, reappraisal, and distraction.

Although multiple neuroimaging studies suggest that affect labeling (i.e., putting feelings into words) can dampen affect-related responses in the amygdala, the consequences of affect labeling have not been examined in other channels of emotional responding. We conducted four studies examining the effect of affect labeling on self-reported emotional experience. In study one, self-reported distress was lower during affect labeling, compared to passive watching, of negative emotional pictures. Studies two and three added reappraisal and distraction conditions, respectively. Affect labeling showed similar effects on self-reported distress as both of these intentional emotion regulation strategies. In each of the first three studies, however, participant predictions about the effects of affect labeling suggest that unlike reappraisal and distraction, people do not believe affect labeling to be an effective emotion regulation strategy. Even after having the experience of affect labels leading to lower distress, participants still predicted that affect labeling would increase distress in the future. Thus, affect labeling is best described as an incidental emotion regulation process. Finally, study four employed positive emotional pictures and here, affect labeling was associated with diminished self-reported pleasure, relative to passive watching. This suggests that affect labeling tends to dampen affective responses in general, rather than specifically alleviating negative affect. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

Neural responses to masked fear faces: Sex differences and trauma exposure in posttraumatic stress disorder.

Although women have a greater propensity than men to develop posttraumatic stress disorder (PTSD) following trauma, sex differences in neural activations to threat have received little investigation. This study tested the prediction that trauma would heighten activity in automatic fear-processing networks to a greater extent in women than in men. Functional magnetic resonance imaging (fMRI) data were recorded in 23 participants with PTSD (13 women, 10 men), 21 trauma-exposed controls (9 women, 12 men), and 42 non-trauma-exposed controls (22 women, 20 men) while they viewed masked facial expressions of fear. Exposure to trauma was associated with enhanced brainstem activity to fear in women, regardless of the presence of PTSD, but in men, it was associated only with the development of PTSD. Men with PTSD displayed greater hippocampal activity to fear than did women. Both men and women with PTSD showed enhanced amygdala activity to fear relative to controls. The authors conclude that greater brainstem activation to threat stimuli may contribute to the greater prevalence of PTSD in women, and greater hippocampal activation in men may subserve an enhanced capacity for contextualizing fear-related stimuli. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

The affiliation motive and perceptual sensitivity to faces.

An attempt was made to predict from imaginative measures of the affiliation motive the frequency with which S selects human faces from similar but nonhuman figures in a perceptual task. The Ss were 93 male undergraduates who responded to pictures with imaginative stories scored for n Affiliation. A month later they were introduced to the perceptual task which required that they state which of 4 figures flashed on a screen was clearest, all stimuli being below the recognition threshold. On each trial 1 of the 4 stimuli was a face and the others were similar but affiliation-neutral. Ss high in n Affiliation recognized faces significantly more frequently than those low in n Affiliation. Thus, the predicted relationship between motivation and the perceptual selection of motive-relevant stimuli was supported. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Binocular rivalry: A window into emotional processing in aging.

Previous binocular rivalry studies with younger adults have shown that emotional stimuli dominate perception over neutral stimuli. Here we investigated the effects of age on patterns of emotional dominance during binocular rivalry. Participants performed a face/house rivalry task where the emotion of the face (happy, angry, neutral) and orientation (upright, inverted) of the face and house stimuli were varied systematically. Age differences were found with younger adults showing a general emotionality effect (happy and angry faces were more dominant than neutral faces) and older adults showing inhibition of anger (neutral faces were more dominant than angry faces) and positivity effects (happy faces were more dominant than both angry and neutral faces). Age differences in dominance patterns were reflected by slower rivalry rates for both happy and angry compared to neutral face/house pairs in younger adults, and slower rivalry rates for happy compared to both angry and neutral face/house pairs in older adults. Importantly, these patterns of emotional dominance and slower rivalry rates for emotional-face/house pairs disappeared when the stimuli were inverted. This suggests that emotional valence, and not low-level image features, were responsible for the emotional bias in both age groups. Given that binocular rivalry has a limited role for voluntary control, the findings imply that anger suppression and positivity effects in older adults may extend to more automatic tasks. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

Flanker effects with faces may depend on perceptual as well as emotional differences.

Do threatening or negative faces capture attention? The authors argue that evidence from visual search, spatial cuing, and flanker tasks is equivocal and that perceptual differences may account for effects attributed to emotional categories. Empirically, the authors examine the flanker task. Although they replicate previous results in which a positive face flanked by negative faces suffers more interference than a negative face flanked by positive faces, further results indicate that face perception is not necessary for the flanker-effect asymmetry and that the asymmetry also occurs with nonemotional stimuli. The authors conclude that the flanker-effect asymmetry with affective faces cannot be unambiguously attributed to emotional differences and may well be due to purely perceptual differences between the stimuli. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Conditioning with masked stimuli affects the timecourse of skin conductance responses.

In Pavlovian fear conditioning, an aversive unconditional stimulus (UCS) is repeatedly paired with a neutral conditional stimulus (CS). As a consequence, the subject begins to show conditional responses (CRs) to the CS that indicate expectation and fear. There are currently two general models competing to explain the role of subjective awareness in fear conditioning. Proponents of the single-process model assert that a single propositional learning process mediates CR expression and UCS expectancy. Proponents of a dual-process model assert that these behavioral responses are expressions of two independent learning processes. We used backward masking to block perception of our visual CSs and measured the effect of this training on subsequent unmasked performance. In two separate experiments we show a dissociation between CR expression and UCS expectancy following differential delay conditioning with masked CSs. In Experiment I, we show that masked training facilitates CR expression when the same CSs are presented during a subsequent unmasked reacquisition task. In Experiment II we show that masked training retards learning when the CS+ is presented as part of a compound CS during a subsequent unmasked blocking task. Our results suggest that multiple memory systems operate in a parallel, independent manner to encode emotional memories. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Temporal processing of emotional stimuli: The capture and release of attention by angry faces.

Neuroimaging data suggest that emotional information, especially threatening faces, automatically captures attention and receives rapid processing. While this is consistent with the majority of behavioral data, behavioral studies of the attentional blink (AB) additionally reveal that aversive emotional first target (T1) stimuli are associated with prolonged attentional engagement or “dwell” time. One explanation for this difference is that few AB studies have utilized manipulations of facial emotion as the T1. To address this, schematic faces varying in expression (neutral, angry, happy) served as the T1 in the current research. Results revealed that the blink associated with an angry T1 face was, primarily, of greater magnitude than that associated with either a neutral or happy T1 face, and also that initial recovery from this processing bias was faster following angry, compared with happy, T1 faces. The current data therefore provide important information regarding the time-course of attentional capture by angry faces: Angry faces are associated with both the rapid capture and rapid release of attention. (PsycINFO Database Record (c) 2011 APA, all rights reserved)