Does Facial Expression Affect Attention Orienting by Gaze Direction Cues?

In 6 experiments, the authors investigated whether attention orienting by gaze direction is modulated by the emotional expression (neutral, happy, angry, or fearful) on the face. The results showed a clear spatial cuing effect by gaze direction but no effect by facial expression. In addition, it was shown that the cuing effect was stronger with schematic faces than with real faces, that gaze cuing could be achieved at very short stimulus onset asynchronies (14 ms), and that there was no evidence for a difference in the strength of cuing triggered by static gaze cues and by cues involving apparent motion of the pupils. In sum, the results suggest that in normal, healthy adults, eye direction processing for attention shifts is independent of facial expression analysis. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

The combined effect of gaze direction and facial expression on cueing spatial attention.

Empirical evidence shows an effect of gaze direction on cueing spatial attention, regardless of the emotional expression shown by a face, whereas a combined effect of gaze direction and facial expression has been observed on individuals' evaluative judgments. In 2 experiments, the authors investigated whether gaze direction and facial expression affect spatial attention depending upon the presence of an evaluative goal. Disgusted, fearful, happy, or neutral faces gazing left or right were followed by positive or negative target words presented either at the spatial location looked at by the face or at the opposite spatial location. Participants responded to target words based on affective valence (i.e., positive/negative) in Experiment 1 and on letter case (lowercase/uppercase) in Experiment 2. Results showed that participants responded much faster to targets presented at the spatial location looked at by disgusted or fearful faces but only in Experiment 1, when an evaluative task was used. The present findings clearly show that negative facial expressions enhance the attentional shifts due to eye-gaze direction, provided that there was an explicit evaluative goal present. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Attention to gaze and emotion in schizophrenia.

Objective: Individuals with schizophrenia have difficulty interpreting social and emotional cues such as facial expression, gaze direction, body position, and voice intonation. Nonverbal cues are powerful social signals but are often processed implicitly, outside the focus of attention. The aim of this research was to assess implicit processing of social cues in individuals with schizophrenia. Method: Patients with schizophrenia or schizoaffective disorder and matched controls performed a primary task of word classification with social cues in the background. Participants were asked to classify target words (LEFT/RIGHT) by pressing a key that corresponded to the word, in the context of facial expressions with eye gaze averted to the left or right. Results: Although facial expression and gaze direction were irrelevant to the task, these facial cues influenced word classification performance. Participants were slower to classify target words (e.g., LEFT) that were incongruent to gaze direction (e.g., eyes averted to the right) compared to target words (e.g., LEFT) that were congruent to gaze direction (e.g., eyes averted to the left), but this only occurred for expressions of fear. This pattern did not differ for patients and controls. Conclusion: The results showed that threat-related signals capture the attention of individuals with schizophrenia. These data suggest that implicit processing of eye gaze and fearful expressions is intact in schizophrenia. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Effects of Direct and Averted Gaze on the Perception of Facially Communicated Emotion.

Research has largely neglected the effects of gaze direction cues on the perception of facial expressions of emotion. It was hypothesized that when gaze direction matches the underlying behavioral intent (approach-avoidance) communicated by an emotional expression, the perception of that emotion would be enhanced (i.e., shared signal hypothesis). Specifically, the authors expected that (a) direct gaze would enhance the perception of approach-oriented emotions (anger and joy) and (b) averted eye gaze would enhance the perception of avoidance-oriented emotions (fear and sadness). Three studies supported this hypothesis. Study 1 examined emotional trait attributions made to neutral faces. Study 2 examined ratings of ambiguous facial blends of anger and fear. Study 3 examined the influence of gaze on the perception of highly prototypical expressions. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Emotional expression modulates perceived gaze direction.

Gaze perception is an important social skill, as it portrays information about what another person is attending to. Gaze direction has been shown to affect interpretation of emotional expression. Here the authors investigate whether the emotional facial expression has a reciprocal influence on interpretation of gaze direction. In a forced-choice yes-no task, participants were asked to judge whether three faces expressing different emotions (anger, fear, happiness, and neutral) in different viewing angles were looking at them or not. Happy faces were more likely to be judged as looking at the observer than were angry, fearful, or neutral faces. Angry faces were more often judged as looking at the observer than were fearful and neutral expressions. These findings are discussed on the background of approach and avoidance orientation of emotions and of the self-referential positivity bias. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

The look of fear and anger: Facial maturity modulates recognition of fearful and angry expressions.

The current series of studies provide converging evidence that facial expressions of fear and anger may have co-evolved to mimic mature and babyish faces in order to enhance their communicative signal. In Studies 1 and 2, fearful and angry facial expressions were manipulated to have enhanced babyish features (larger eyes) or enhanced mature features (smaller eyes) and in the context of a speeded categorization task in Study 1 and a visual noise paradigm in Study 2, results indicated that larger eyes facilitated the recognition of fearful facial expressions, while smaller eyes facilitated the recognition of angry facial expressions. Study 3 manipulated facial roundness, a stable structure that does not vary systematically with expressions, and found that congruency between maturity and expression (narrow face-anger; round face-fear) facilitated expression recognition accuracy. Results are discussed as representing a broad co-evolutionary relationship between facial maturity and fearful and angry facial expressions. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Anxiety meets fear in perception of dynamic expressive gaze.

This study investigated in 2 experiments whether reflexive cuing of attention that occurs after perception of a gaze cue is greater for fearful than for happy faces in normal participants, as hypothesized from a social neuroscience perspective. To increase neuroecological validity, dynamic stimulus presentation was used to display faces that simultaneously morphed from a neutral expression into a happy or fearful one and shifted eye gaze from the center to the periphery. Shifts of attention resulting from a natural fearful gaze were expected to be related to participants' anxiety traits, in agreement with the often found increased selective attention to threat in anxious participants. Both hypotheses were confirmed: Fearful faces induced stronger gaze cuing than happy faces, and the strength of this cuing effect was correlated to participants' anxiety levels. These results suggest a neural network, which integrates the processing of gaze, expression, and emotional states to adaptively prime vigilance under threatening circumstances. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Orienting to Eye Gaze and Face Processing.

The author conducted 7 experiments to examine possible interactions between orienting to eye gaze and specific forms of face processing. Participants classified a letter following either an upright or inverted face with averted, uninformative eye gaze. Eye gaze orienting effects were recorded for upright and inverted faces, irrespective of whether the faces were simple, schematic faces or more realistic faces. In contrast, inversion affected orienting to targets appearing along the vertical axis. Switching the contrast between the iris and sclera reversed orienting to eye gaze. Lifting the eyelid to expose more of the iris-sclera contrast led to a potentiation of orienting to eye gaze. Raising the eyebrow alone without the eyelid did not affect orienting. The findings suggest that local perceptual information is critical for orienting to eye gaze and that the effect can occur with a degree of independence from certain types of face processing. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

Detection of emotional faces: Salient physical features guide effective visual search.

In this study, the authors investigated how salient visual features capture attention and facilitate detection of emotional facial expressions. In a visual search task, a target emotional face (happy, disgusted, fearful, angry, sad, or surprised) was presented in an array of neutral faces. Faster detection of happy and, to a lesser extent, surprised and disgusted faces was found both under upright and inverted display conditions. Inversion slowed down the detection of these faces less than that of others (fearful, angry, and sad). Accordingly, the detection advantage involves processing of featural rather than configural information. The facial features responsible for the detection advantage are located in the mouth rather than the eye region. Computationally modeled visual saliency predicted both attentional orienting and detection. Saliency was greatest for the faces (happy) and regions (mouth) that were fixated earlier and detected faster, and there was close correspondence between the onset of the modeled saliency peak and the time at which observers initially fixated the faces. The authors conclude that visual saliency of specific facial features--especially the smiling mouth--is responsible for facilitated initial orienting, which thus shortens detection. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Fearful faces but not fearful eyes alone delay attention disengagement in 7-month-old infants.

Adult-like attentional biases toward fearful faces can be observed in 7-month-old infants. It is possible, however, that infants merely allocate attention to simple features such as enlarged fearful eyes. In the present study, 7-month-old infants (n = 15) were first shown individual emotional faces to determine their visual scanning patterns of the expressions. Second, an overlap task was used to examine the latency of attention disengagement from centrally presented faces. In both tasks, the stimuli were fearful, happy, and neutral facial expressions, and a neutral face with fearful eyes. Eye-tracking data from the first task showed that infants scanned the eyes more than other regions of the face; however, there were no differences in scanning patterns across expressions. In the overlap task, infants were slower in disengaging attention from fearful as compared to happy and neutral faces and also to neutral faces with fearful eyes. Together, these results provide evidence that threat-related stimuli tend to hold attention preferentially in 7-month-old infants and that the effect does not reflect a simple response to differentially salient eyes in fearful faces. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

When time stands still: Fear-specific modulation of temporal bias due to threat.

The current study was designed to test the fear-specific nature of temporal bias due to threat. A temporal bisection procedure was used in which participants (N = 46) were initially trained to recognize short (400 ms) and long (1,600 ms) standard durations. In the test phase, participants were asked to judge whether the duration of computer-generated faces drawn to appear threatening, fearful, and neutral, was closer to either the short or long duration they had learnt earlier. Past research was replicated—the durations of the arousing facial expressions were overestimated relative to a low arousal (neutral) expression. Overestimation for threat was positively correlated with individual differences in fearfulness, trait anxiety, and distress. Multiple regression analyses were carried out to test the hypothesis was that individual differences in anxiety and fearfulness but not other traits would uniquely predict temporal overestimation due to threat. The results showed that fearfulness but not other traits (trait anxiety, anger, distress, activity, and sociability) was a unique and strong (partial r = .47) predictor of increased overestimation for both threatening and fearful expressions. The findings support the hypothesis that threat-related expressions activate a fear-specific system (?hman & Mineka, 2001) or fear representations (Beck & Clark, 1997) in fearful individuals. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

Gaze direction modulates the disengagement of attention from facial expression in 10-month-olds.

This study investigated whether the disengagement of attention from facial expression is modulated by gaze direction in infants. To this end, we measured the saccadic reaction time required for the 10-month-olds to disengage their attention from angry and happy expressions combined with either straight or averted gaze. The 10-month-olds' disengagement of their attention from happy faces was modulated by gaze direction. This finding indicates that gaze direction strongly influences infants' allocation of attention to facial expressions. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Detection of directed gaze in rhesus monkeys (Macaca mulatta).

To examine the ability of monkeys to detect the direction of attention of other individuals, the authors quantitatively investigated the visual scanning pattern of rhesus monkeys (Macaca mulatta) in response to visually presented images of a human frontal face. The present results demonstrated not only that monkeys predominantly gaze at the eyes as compared with other facial areas in terms of duration and number of fixations, but also that they gaze at the eyes for a longer time period and more frequently when a human face, presented as a stimulus, gazed at them than when the gaze was shifted. These results indicate that rhesus monkeys are sensitive to the directed gaze of humans, suggesting that monkeys pay more attention to the human whose attention is directed to them. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

A functional MRI study of human amygdala responses to facial expressions of fear versus anger.

Functional magnetic resonance imaging (fMRI) of the human brain was used to compare changes in amygdala activity associated with viewing facial expressions of fear and anger. Pictures of human faces bearing expressions of fear or anger, as well as faces with neutral expressions, were presented to 8 healthy participants. The blood oxygen-level dependent (BOLD) fMRI signal within the dorsal amygdala was significantly greater to Fear versus Anger, in a direct contrast. Significant BOLD signal changes in the ventral amygdala were observed in contrasts of Fear versus Neutral expressions and, in a more spatially circumscribed region, to Anger versus Neutral expressions. Thus, activity in the amygdala is greater to fearful facial expressions when contrasted with either neutral or angry faces. Furthermore, directly contrasting fear with angry faces highlighted involvement of the dorsal amygdaloid region. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Age-related changes in the integration of gaze direction and facial expressions of emotion.

Gaze direction influences younger adults' perception of emotional expressions, with direct gaze enhancing the perception of anger and joy, while averted gaze enhances the perception of fear. Age-related declines in emotion recognition and eye-gaze processing have been reported, indicating that there may be age-related changes in the ability to integrate these facial cues. As there is evidence of a positivity bias with age, age-related difficulties integrating these cues may be greatest for negative emotions. The present research investigated age differences in the extent to which gaze direction influenced explicit perception (e.g., anger, fear and joy; Study 1) and social judgments (e.g., of approachability; Study 2) of emotion faces. Gaze direction did not influence the perception of fear in either age group. In both studies, age differences were found in the extent to which gaze direction influenced judgments of angry and joyful faces, with older adults showing less integration of gaze and emotion cues than younger adults. Age differences were greatest when interpreting angry expressions. Implications of these findings for older adults' social functioning are discussed. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Attentional bias to brief threat-related faces revealed by saccadic eye movements.

According to theories of emotion and attention, we are predisposed to orient rapidly toward threat. However, previous examination of attentional cueing by threat showed no enhanced capture at brief durations, a finding that may be related to the sensitivity of the manual response measure used. Here we investigated the time course of orienting attention toward fearful faces in the exogenous cueing task. Cue duration (20 ms or 100 ms) and response mode (saccadic or manual) were manipulated. In the saccade mode, both enhanced attentional capture and impaired disengagement from fearful faces were evident and limited to 20 ms, suggesting that saccadic cueing effects emerge rapidly and are short lived. In the manual mode, fearful faces impacted only upon the disengagement component of attention at 100 ms, suggesting that manual cueing effects emerge over longer periods of time. Importantly, saccades could reveal threat biases at brief cue durations consistent with current theories of emotion and attention. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Gaze perception requires focused attention: Evidence from an interference task.

The direction of another person's gaze is difficult to ignore when presented at the center of attention. In 6 experiments, perception of unattended gaze was investigated. Participants made directional (left-right) judgments to gazing-face or pointing-hand targets, which were accompanied by a distractor face or hand. Processing of the distractor was assessed via congruency effects on target response times. Congruency effects were found from the direction of distractor hands but not from the direction of distractor gazes (Experiment 1). This pattern persisted even when distractor sizes were increased to compensate for their peripheral presentation (Experiments 2 and 5). In contrast, congruency effects were exerted by profile heads (Experiments 3 and 4). In Experiment 6, isolated eye region distractors produced no congruency effects, even when they were presented near the target. These results suggest that, unlike other facial information, gaze direction cannot be perceived outside the focus of attention. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

A tale of two negatives: Differential memory modulation by threat-related facial expressions.

Facial expressions serve as cues that encourage viewers to learn about their immediate environment. In studies assessing the influence of emotional cues on behavior, fearful and angry faces are often combined into one category, such as “threat-related,” because they share similar emotional valence and arousal properties. However, these expressions convey different information to the viewer. Fearful faces indicate the increased probability of a threat, whereas angry expressions embody a certain and direct threat. This conceptualization predicts that a fearful face should facilitate processing of the environment to gather information to disambiguate the threat. Here, we tested whether fearful faces facilitated processing of neutral information presented in close temporal proximity to the faces. In Experiment 1, we demonstrated that, compared with neutral faces, fearful faces enhanced memory for neutral words presented in the experimental context, whereas angry faces did not. In Experiment 2, we directly compared the effects of fearful and angry faces on subsequent memory for emotional faces versus neutral words. We replicated the findings of Experiment 1 and extended them by showing that participants remembered more faces from the angry face condition relative to the fear condition, consistent with the notion that anger differs from fear in that it directs attention toward the angry individual. Because these effects cannot be attributed to differences in arousal or valence processing, we suggest they are best understood in terms of differences in the predictive information conveyed by fearful and angry facial expressions. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

Masked fearful faces modulate the orienting of covert spatial attention.

Dot probe studies indicate that masked fearful faces modulate spatial attention. However, without a baseline to compare congruent and incongruent reaction times, it is unclear which aspect(s) of attention (orienting or disengagement) is affected. Additionally, backward masking studies commonly use a neutral face as the mask stimulus. This method results in greater perceptual inconsistencies for fearful as opposed to neutral faces. Therefore, it is currently unclear whether the effects of backward masked fearful faces are due to the fearful nature of the face or perceptual inconsistencies. Equally unclear, is whether this spatial attention effect is due to orienting or disengagement. Two modified dot probe experiments with neutral (closed mouth in Experiment 1) and smiling (open mouth in Experiment 2) masks were used to determine the role of perceptual inconsistencies in mediating the spatial attention effects elicited by masked fearful faces. The results indicate that masked fearful faces modulate the orienting of spatial attention, and it appears that this effect is due to the fearful nature of the face rather than perceptual inconsistencies between the initial faces and masks. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Selective Attention to Angry Faces in Clinical Social Phobia.

This study investigated the time course of attentional responses to emotional facial expressions in a clinical sample with social phobia. With a visual probe task, photographs of angry, happy, and neutral faces were presented at 2 exposure durations: 500 and 1,250 ms. At 500 ms, the social phobia group showed enhanced vigilance for angry faces, relative to happy and neutral faces, in comparison with normal controls. In the 1,250-ms condition, there were no significant attentional biases in the social phobia group. Results are consistent with a bias in initial orienting to threat cues in social anxiety. Findings are discussed in relation to recent cognitive models of anxiety disorders. (PsycINFO Database Record (c) 2010 APA, all rights reserved)