Garner interference reveals dependencies between emotional expression and gaze in face perception.

The relationship between facial expression and gaze processing was investigated with the Garner selective attention paradigm. In Experiment 1, participants performed expression judgments without interference from gaze, but expression interfered with gaze judgments. Experiment 2 replicated these results across different emotions. In both experiments, expression judgments occurred faster than gaze judgments, suggesting that expression was processed before gaze could interfere. In Experiments 3 and 4, the difficulty of the emotion discrimination was increased in two different ways. In both cases, gaze interfered with emotion judgments and vice versa. Furthermore, increasing the difficulty of the emotion discrimination resulted in gaze and expression interactions. Results indicate that expression and gaze interactions are modulated by discriminability. Whereas expression generally interferes with gaze judgments, gaze direction modulates expression processing only when facial emotion is difficult to discriminate. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Revisiting the relationship between the processing of gaze direction and the processing of facial expression.

There is mixed evidence on the nature of the relationship between the perception of gaze direction and the perception of facial expressions. Major support for shared processing of gaze and expression comes from behavioral studies that showed that observers cannot process expression or gaze and ignore irrelevant variations in the other dimension. However, these studies have not considered the role of head orientation, which is known to play a key role in the processing of gaze direction. In a series of experiments, the relationship between the processing of expression and gaze was tested both with head orientation held constant and with head orientation varied between trials, making it a relevant source of information for computing gaze direction. Results show that when head orientation varied between trials, the processing of facial expression was not interfered with gaze direction, and conversely, the processing of gaze could be made without being interfered from irrelevant variations in expression. These findings suggest that the processing of gaze and the processing of expression are not functionally interconnected as was previously assumed. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

A direct link between gaze perception and social attention.

How information is exchanged between the cognitive mechanisms responsible for gaze perception and social attention is unclear. These systems could be independent; the “gaze cueing” effect could emerge from the activation of a general-purpose attentional mechanism that is ignorant of the social nature of the gaze cue. Alternatively, orienting to social gaze direction might be directly determined by the operation of cognitive mechanisms specifically dedicated to gaze perception. This second notion is the dominant assumption in the literature, but there is little direct support for this account. Here, we systematically manipulated observers' perception of gaze direction by implementing a gaze adaptation paradigm. Gaze cueing was reduced only in conditions where perception of specific averted gaze stimuli was impaired (Experiment 1). Adaptation to a pointing stimulus failed to impact gaze cueing (Experiment 2). Overall, these data suggest a direct link between the specific operation of gaze perception mechanisms and the consequential orienting of attention. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

The combined effect of gaze direction and facial expression on cueing spatial attention.

Empirical evidence shows an effect of gaze direction on cueing spatial attention, regardless of the emotional expression shown by a face, whereas a combined effect of gaze direction and facial expression has been observed on individuals' evaluative judgments. In 2 experiments, the authors investigated whether gaze direction and facial expression affect spatial attention depending upon the presence of an evaluative goal. Disgusted, fearful, happy, or neutral faces gazing left or right were followed by positive or negative target words presented either at the spatial location looked at by the face or at the opposite spatial location. Participants responded to target words based on affective valence (i.e., positive/negative) in Experiment 1 and on letter case (lowercase/uppercase) in Experiment 2. Results showed that participants responded much faster to targets presented at the spatial location looked at by disgusted or fearful faces but only in Experiment 1, when an evaluative task was used. The present findings clearly show that negative facial expressions enhance the attentional shifts due to eye-gaze direction, provided that there was an explicit evaluative goal present. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Are you looking at me? Measuring the cone of gaze.

The processing of gaze cues plays an important role in social interactions, and mutual gaze in particular is relevant for natural as well as video-mediated communications. Mutual gaze occurs when an observer looks at or in the direction of the eyes of another person. The authors chose the metaphor of a cone of gaze to characterize this range of gaze directions that constitutes "looking at" another person. In 4 experiments using either a real person or a virtual head, the authors investigated the influences of observer distance, head orientation, visibility of the eyes, and the presence of a 2nd head on the perceived direction and width of the gaze cone. The direction of the gaze cone was largely affected by all experimental manipulations, whereas its angular width remained comparatively stable. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Orienting to Eye Gaze and Face Processing.

The author conducted 7 experiments to examine possible interactions between orienting to eye gaze and specific forms of face processing. Participants classified a letter following either an upright or inverted face with averted, uninformative eye gaze. Eye gaze orienting effects were recorded for upright and inverted faces, irrespective of whether the faces were simple, schematic faces or more realistic faces. In contrast, inversion affected orienting to targets appearing along the vertical axis. Switching the contrast between the iris and sclera reversed orienting to eye gaze. Lifting the eyelid to expose more of the iris-sclera contrast led to a potentiation of orienting to eye gaze. Raising the eyebrow alone without the eyelid did not affect orienting. The findings suggest that local perceptual information is critical for orienting to eye gaze and that the effect can occur with a degree of independence from certain types of face processing. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

Children's use of the temporal dimension of gaze for inferring preference.

This study examined 4- and 5-year-olds' ability to spontaneously use the relative duration and frequency of another's object-directed gaze for inferring that person's preference. In Experiment 1, analysis revealed a strong age effect for judgment accuracy, which could not be accounted for by cue-monitoring proficiency. Reducing the saliency of the objects in Experiment 2 yielded significant improvement in the younger children's performance. Thus, at 4 years, children already show signs of attending to the temporal dimension of gaze for making mentalistic inferences of preferential liking, but their competence may be undermined by the object choices themselves. By 5 years, they appear to overcome this competition. The obtained developmental difference is discussed in terms of concurrent transitions in attention regulation. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Gaze direction modulates the disengagement of attention from facial expression in 10-month-olds.

This study investigated whether the disengagement of attention from facial expression is modulated by gaze direction in infants. To this end, we measured the saccadic reaction time required for the 10-month-olds to disengage their attention from angry and happy expressions combined with either straight or averted gaze. The 10-month-olds' disengagement of their attention from happy faces was modulated by gaze direction. This finding indicates that gaze direction strongly influences infants' allocation of attention to facial expressions. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Tell-tale eyes: Children's attribution of gaze aversion as a lying cue.

This study examined whether the well-documented adult tendency to perceive gaze aversion as a lying cue is also evident in children. In Experiment 1, 6-year-olds, 9-year-olds, and adults were shown video vignettes of speakers who either maintained or avoided eye contact while answering an interviewer's questions. Participants evaluated whether the speaker was telling the truth or lying on each trial. The results revealed that at both ages, children were more likely to attribute lying to speakers in the gaze aversion condition; however, the effect was significantly greater among 9-year-olds. Significant gender differences were also uncovered, with girls demonstrating strongest sensitivity to the gaze cue. Experiment 2 replicated the gender effect in 6-year-olds but found that when the speakers' verbal responses were removed, boys' use of the gaze cue increased and the gender difference disappeared. These findings indicate that at 6 years old, children interpret interpersonal gaze behavior as a socially informative cue. Furthermore, the growing appreciation of the stereotypic gaze behavior associated with lying and the reputed female advantage in gaze sensitivity may reflect differential processing of multimodal communication. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Anxiety and sensitivity to gaze direction in emotionally expressive faces.

This study investigated the role of neutral, happy, fearful, and angry facial expressions in enhancing orienting to the direction of eye gaze. Photographs of faces with either direct or averted gaze were presented. A target letter (T or L) appeared unpredictably to the left or the right of the face, either 300 ms or 700 ms after gaze direction changed. Response times were faster in congruent conditions (i.e., when the eyes gazed toward the target) relative to incongruent conditions (when the eyes gazed away from the target letter). Facial expression did influence reaction times, but these effects were qualified by individual differences in self-reported anxiety. High trait-anxious participants showed an enhanced orienting to the eye gaze of faces with fearful expressions relative to all other expressions. In contrast, when the eyes stared straight ahead, trait anxiety was associated with slower responding when the facial expressions depicted anger. Thus, in anxiety-prone people attention is more likely to be held by an expression of anger, whereas attention is guided more potently by fearful facial expressions. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Age-related changes in the integration of gaze direction and facial expressions of emotion.

Gaze direction influences younger adults' perception of emotional expressions, with direct gaze enhancing the perception of anger and joy, while averted gaze enhances the perception of fear. Age-related declines in emotion recognition and eye-gaze processing have been reported, indicating that there may be age-related changes in the ability to integrate these facial cues. As there is evidence of a positivity bias with age, age-related difficulties integrating these cues may be greatest for negative emotions. The present research investigated age differences in the extent to which gaze direction influenced explicit perception (e.g., anger, fear and joy; Study 1) and social judgments (e.g., of approachability; Study 2) of emotion faces. Gaze direction did not influence the perception of fear in either age group. In both studies, age differences were found in the extent to which gaze direction influenced judgments of angry and joyful faces, with older adults showing less integration of gaze and emotion cues than younger adults. Age differences were greatest when interpreting angry expressions. Implications of these findings for older adults' social functioning are discussed. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Perception of pictorial eye gaze by baboons ( Papio papio).

Pictorial-faces looking left or right were presented to baboons (Papio papio) before the display of a target letter in the left or right hemifield of a monitor screen. Baboons had to provide go or no-go responses taking into account the identity of the target letter. The 1st 6 experiments showed no reliable effect of eye gaze on discrimination speed, using either schematic gazes or pictures of real gazes. Experiment 7 showed that eye gazes facilitated target processing when eye cues were perfect predictors of target location. Findings suggest that baboons do not spontaneously process eye-gaze direction but can learn to do so if the gaze has a predictive value. Implications of these findings on baboons' perspective-taking abilities are discussed. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Age-related declines in basic social perception: Evidence from tasks assessing eye-gaze processing.

Previous research has investigated age differences in complex social perception tasks such as theory of mind and emotion recognition, with predominant findings of age-related declines. The present study investigated whether there are also age-related changes in basic aspects of social perception. Individuals' ability both to detect subtle differences in eye-gaze direction (e.g., where someone is looking in the environment) and to subsequently use these gaze cues to engage in joint attention with others was assessed. Age-related declines were found in the detection of the most subtle differences in gaze aversion. The ability to engage in joint attention by following gaze cues also declined with age. These age differences were not solely attributable to age impairments in visual perception and visual attention. The potential role of age-related neural declines in social perception problems was considered, along with the implications that age deficits in these basic social skills may have for older adults' social perception. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Self-relevance processing in the human amygdala: Gaze direction, facial expression, and emotion intensity.

How the processing of emotional expression is influenced by perceived gaze remains a debated issue. Discrepancies between previous results may stem from differences in the nature of stimuli and task characteristics. Here we used a highly controlled set of computer-generated animated faces combining dynamic emotional expressions with varying intensity, and gaze shifts either directed at or averted from the observer. We predicted that perceived self-relevance of fearful faces would be higher with averted gaze—signaling a nearby danger; whereas conversely, direct gaze would be more relevant for angry faces—signaling aggressiveness. This interaction pattern was observed behaviorally for emotion intensity ratings, and neurally for functional magnetic resonance imaging activation in amygdala, as well as fusiform and medial prefrontal cortices, but only for mild- and not high-intensity expressions. These results support an involvement of human amygdala in the appraisal of self-relevance and reveal a crucial role of expression intensity in emotion and gaze interactions. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Structural resemblance to emotional expressions predicts evaluation of emotionally neutral faces.

[Correction Notice: An erratum for this article was reported in Vol 9(4) of Emotion (see record 2009-11528-009). In this article a symbol was incorrectly omitted from Figure 1, part C. To see the complete article with the corrected figure, please go to http://dx.doi.org/10.1037/a0014681.] People make trait inferences based on facial appearance despite little evidence that these inferences accurately reflect personality. The authors tested the hypothesis that these inferences are driven in part by structural resemblance to emotional expressions. The authors first had participants judge emotionally neutral faces on a set of trait dimensions. The authors then submitted the face images to a Bayesian network classifier trained to detect emotional expressions. By using a classifier, the authors can show that neutral faces perceived to possess various personality traits contain objective resemblance to emotional expression. In general, neutral faces that are perceived to have positive valence resemble happiness, faces that are perceived to have negative valence resemble disgust and fear, and faces that are perceived to be threatening resemble anger. These results support the idea that trait inferences are in part the result of an overgeneralization of emotion recognition systems. Under this hypothesis, emotion recognition systems, which typically extract accurate information about a person's emotional state, are engaged during the perception of neutral faces that bear subtle resemblance to emotional expressions. These emotions could then be misattributed as traits. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Emotional versus neutral expressions and perceptions of social dominance and submissiveness.

Emotional expressions influence social judgments of personality traits. The goal of the present research was to show that it is of interest to assess the impact of neutral expressions in this context. In 2 studies using different methodologies, the authors found that participants perceived men who expressed neutral and angry emotions as higher in dominance when compared with men expressing sadness or shame. Study 1 showed that this is also true for men expressing happiness. In contrast, women expressing either anger or happiness were perceived as higher in dominance than were women showing a neutral expression who were rated as less dominant. However, sadness expressions by both men and women clearly decreased the extent to which they were perceived as dominant, and a trend in this direction emerged for shame expressions by men in Study 2. Thus, neutral expressions seem to be perceived as a sign of dominance in men but not in women. The present findings extend our understanding of the way different emotional expressions affect perceived dominance and the signal function of neutral expressions—which in the past have often been ignored. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Attention to gaze and emotion in schizophrenia.

Objective: Individuals with schizophrenia have difficulty interpreting social and emotional cues such as facial expression, gaze direction, body position, and voice intonation. Nonverbal cues are powerful social signals but are often processed implicitly, outside the focus of attention. The aim of this research was to assess implicit processing of social cues in individuals with schizophrenia. Method: Patients with schizophrenia or schizoaffective disorder and matched controls performed a primary task of word classification with social cues in the background. Participants were asked to classify target words (LEFT/RIGHT) by pressing a key that corresponded to the word, in the context of facial expressions with eye gaze averted to the left or right. Results: Although facial expression and gaze direction were irrelevant to the task, these facial cues influenced word classification performance. Participants were slower to classify target words (e.g., LEFT) that were incongruent to gaze direction (e.g., eyes averted to the right) compared to target words (e.g., LEFT) that were congruent to gaze direction (e.g., eyes averted to the left), but this only occurred for expressions of fear. This pattern did not differ for patients and controls. Conclusion: The results showed that threat-related signals capture the attention of individuals with schizophrenia. These data suggest that implicit processing of eye gaze and fearful expressions is intact in schizophrenia. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Detection of directed gaze in rhesus monkeys (Macaca mulatta).

To examine the ability of monkeys to detect the direction of attention of other individuals, the authors quantitatively investigated the visual scanning pattern of rhesus monkeys (Macaca mulatta) in response to visually presented images of a human frontal face. The present results demonstrated not only that monkeys predominantly gaze at the eyes as compared with other facial areas in terms of duration and number of fixations, but also that they gaze at the eyes for a longer time period and more frequently when a human face, presented as a stimulus, gazed at them than when the gaze was shifted. These results indicate that rhesus monkeys are sensitive to the directed gaze of humans, suggesting that monkeys pay more attention to the human whose attention is directed to them. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Orienting and maintenance of gaze to facial expressions in social anxiety.

In 2 experiments, the authors tested predictions from cognitive models of social anxiety regarding attentional biases for social and nonsocial cues by monitoring eye movements to pictures of faces and objects in high social anxiety (HSA) and low social anxiety (LSA) individuals. Under no-stress conditions (Experiment 1), HSA individuals initially directed their gaze toward neutral faces, relative to objects, more often than did LSA participants. However, under social-evaluative stress (Experiment 2), HSA individuals showed reduced biases in initial orienting and maintenance of gaze on faces (cf. objects) compared with the LSA group. HSA individuals were also relatively quicker to look at emotional faces than neutral faces but looked at emotional faces for less time, compared with LSA individuals, consistent with a vigilant-avoidant pattern of bias. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Emotional scene content drives the saccade generation system reflexively.

The authors assessed whether parafoveal perception of emotional content influences saccade programming. In Experiment 1, paired emotional and neutral scenes were presented to parafoveal vision. Participants performed voluntary saccades toward either of the scenes according to an imperative signal (color cue). Saccadic reaction times were faster when the cue pointed toward the emotional picture rather than toward the neutral picture. Experiment 2 replicated these findings with a reflexive saccade task, in which abrupt luminosity changes were used as exogenous saccade cues. In Experiment 3, participants performed vertical reflexive saccades that were orthogonal to the emotional–neutral picture locations. Saccade endpoints and trajectories deviated away from the visual field in which the emotional scenes were presented. Experiment 4 showed that computationally modeled visual saliency does not vary as a function of scene content and that inversion abolishes the rapid orienting toward the emotional scenes. Visual confounds cannot thus explain the results. The authors conclude that early saccade target selection and execution processes are automatically influenced by emotional picture content. This reveals processing of meaningful scene content prior to overt attention to the stimulus. (PsycINFO Database Record (c) 2010 APA, all rights reserved)