The role of the nucleus accumbens core in impulsive choice, timing, and reward processing.

The present series of experiments aimed to pinpoint the source of nucleus accumbens core (AcbC) effects on delay discounting. Rats were trained with an impulsive choice procedure between an adjusting smaller sooner reward and a fixed larger later reward. The AcbC-lesioned rats produced appropriate choice behavior when the reward magnitude was equal. An increase in reward magnitude resulted in a failure to increase preference for the larger later reward in the AcbC-lesioned rats, whereas a decrease in the larger later reward duration resulted in normal alterations in choice behavior in AcbC-lesioned rats. Subsequent experiments with a peak timing (Experiments 2 and 3) and a behavioral contrast (Experiment 4) indicated that the AcbC-lesioned rats suffered from decreased incentive motivation during changes in reward magnitude (Experiments 2 and 4) and when expected rewards were omitted (Experiments 2 and 3), but displayed intact anticipatory timing of reward delays (Experiments 2 and 3). The results indicate that the nucleus accumbens core is critical for determining the incentive value of rewards, but does not participate in the timing of reward delays. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Magnitude and shift of reward in instrumental aversive learning in rats.

Conducted 3 experiments in which 4 groups of female hooded rats (N = 192) were given 35 classical fear-conditioning trials in 1 side of a 2-compartment box. Ss were then allowed to jump a hurdle to the adjacent box and escape the fear-eliciting stimuli. Reward magnitude (fear reduction) during hurdle jumping for 2 groups was either large or small throughout while for 2 groups it was increased or decreased after some training. Manipulated and nonmanipulated reward varied between experiments. Preshift performance was better with large than with small reward. Positive contrast effects were not found, but a negative contrast effect was obtained in Exp. III. The concepts of incentive motivation and frustration, used to account for performance in appetitively motivated learning tasks, are applied to the findings. (27 ref.) (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Goal-directed instrumental action: contingency and incentive learning and their cortical substrates

Instrumental behaviour is controlled by two systems: a stimulus-response habit mechanism and a goal-directed process that involves two forms of learning. The first is learning about the instrumental contingency between the response and reward, whereas the second consists of the acquisition of incentive value by the reward. Evidence for contingency learning comes from studies of reward devaluation and from demonstrations that instrumental performance is sensitive not only the probability of contiguous reward but also to the probability of unpaired rewards. The process of incentive learning is evident in the acquisition of control over performance by primary motivational states. Preliminary lesion studies of the rat suggest that the prelimbic area of prefrontal cortex plays a role in the contingency learning, whereas the incentive learning for food rewards involves the insular cortex.     

Incentive downshifts evoke search repertoires in rats.

Negative incentive contrast effects (NCEs) have typically been attributed to frustration or the decremental generalization of learned associations. The purpose of these experiments was to clarify the relation of NCEs to the repertoires of functional search behaviors evoked by incentive downshifts. Rats shifted from 32% to 4% sucrose-solution decreased consummatory responses but increased nose-down locomotion, orientation, location entries, and sampling of alternatives relative to unshifted controls. These changes in behavior were terminated or failed to occur under incentive upshifts. Furthermore, reward downshifts did not produce avoidance of the location of the shifted incentive. Increased search occurred whether or not alternative reward locations were available. Together the evidence suggests that NCEs are related to evoked search modes supporting a repertoire of functional behaviors related to finding food. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Effects of punishment on response latency in extraverts.

Previous findings indicate that in comparison to introverts, extraverts are prone to form responses that are resistant to interruption by punishment. Because the tendency to stop and reflect following punishment may be crucial for subsequent learning, the present study examined differences between introverts' and extraverts' reactions to punishment using response latency on the trial following punishment as the dependent variable. 66 extraverted and 66 introverted male undergraduates, selected on the basis of Eysenck Personality Questionnaire scores, performed a pattern-matching task in which they received noncontingent 50% success and 50% failure feedback under 3 incentive conditions: reward only, punishment only, or both. As predicted, a significant interaction was found in the both incentive condition, reflecting the tendency of extraverts to respond more quickly and introverts more slowly following punishment than reward. No significant effects were found in the other 2 conditions, although extraverts tended to respond more quickly overall when only reward was given. A 2nd experiment, with 101 male undergraduates, that used reward-only and punishment-only feedback replicated this finding and yielded a significant group?×?condition interaction. Results indicate that in contrast to introverts, extraverts are activated by the availability of reward and, paradoxically, that punishment may facilitate rather than interrupt extraverts' reward-seeking behavior. (20 ref) (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Summation of symbols by pigeons (Columba livia): The importance of number and mass of reward items.

In each of 3 experiments, different sets of 4 pigeons (Columba livia) were trained to discriminate between 2 visual symbols that covered wells containing food items that varied in number, mass, or both. In Experiment 1, the symbols were associated with 0, 1, 3, 5, 7, or 9 pieces of grain reward. The pigeons learned to choose the symbol corresponding to the larger reward, and on summation tests, they chose the pair of symbols that summed to the larger total reward. When number of food pellets was varied but mass of reward was held constant in Experiment 2, preference for the larger number symbols failed to appear. When number was held constant and mass was varied in Experiment 3, the pigeons showed a clear preference for the larger mass symbols on single-symbol and summation tests. These findings show that pigeons summate the value of symbols and are more likely to represent symbols by mass of food reward than by number of food items. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Components of reward in social dilemmas.

Two experiments with 324 undergraduates investigated components of reward in social dilemmas, which are defined as situations in which individuals are faced with a conflict between maximizing selfish interests and maximizing collective interests. The dilemma is based on the fact that, if all choose to maximize selfish interests, all are worse off than if all choose to maximize collective interests. Using 3-person decomposed games, 2 types of incentives were contrasted: a positive incentive (bonus) for cooperative choices and a negative incentive (penalty) for noncooperative choices. Results show that the positive incentive evoked a higher level of cooperation than the negative incentive. Findings are discussed in terms of nonadditive utility components, D. G. Pruitt's (see record 1970-07717-001) motivational interpretation, and H. H. Kelley and J. W. Thibaut's (1978) theory of interdependence. (22 ref) (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Delay of gratification in psychopathic and nonpsychopathic offenders.

Delay of gratification is a prototypical measure of self-control that merits systematic investigation in psychopaths. White male prisoners were provided with repeated opportunities to select an immediate response with uncertain reward or a delayed response with a higher rate of reward under 1 of 3 incentive conditions. Psychopaths' performance depended on their level of trait anxiety and incentive condition: Whereas low-anxious psychopaths were relatively unwilling to delay when omission of expected rewards also incurred monetary punishments, they displayed relative superior performance when the task involved rewards only. Findings complement those for passive avoidance learning in psychopaths and suggest that inhibitory self-control in low-anxious psychopaths is somewhat impaired under conditions involving a combination of monetary rewards and punishments. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Achievement striving, social class, and test anxiety.

It was hypothesized that compared to working-class Ss, middle-class Ss would show little improvement in test performance under financial incentive. Tests used were a simple motor test and an intelligence test. Ss were high school juniors and seniors. Results with both tests support the hypothesis that middle-class test performance is more highly generalized and less subject to improvement through increased striving for material reward. "The main difference between the two groups seems to be that while working-class striving and performance tend to rise uniformly in response to reward stimuli, in the middle-class reward-induced increases in striving may either raise the level of performance or touch off anxiety responses that lower it." (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Dissociation of Pavlovian and instrumental incentive learning under dopamine antagonists.

The administration of the dopamine antagonists, pimozide and α-flupenthixol, to rats reduced Pavlovian–instrumental transfer when a conditioned stimulus (CS) that had been paired with a noncontingent food reward was tested on instrumental performance. The administration of the antagonists during Pavlovian conditioning and/or testing abolished the enhancement of instrumental performance by the CS. The effect of both antagonists on instrumental incentive learning was then examined. After training in which the rats performed 2 responses for different food rewards, they consumed 1 type food under the antagonists and the other type under vehicle during reexposure. When instrumental responding was subsequently tested in extinction, performance was unaffected by whether the rats had been reexposed to the training reward under the antagonists. These results suggest that Pavlovian and instrumental incentive learning are not mediated by a common process. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Control of Variation by Reward Probability.

Two bar-press experiments with rats tested the rule that reducing expectation of reward increases the variation from which reward selects. Experiment 1 used a discrete-trial random-interval schedule, with trials signaled by light or sound. One signal always ended with reward; the other signal ended with reward less often. The 2 signals were randomly mixed. Bar-press duration (how long the bar was held down) varied more during the signal with the lower probability of reward. Experiment 2 closely resembled Experiment 1 but used a random-ratio schedule rather than a random-interval schedule. Again, bar-press duration varied more during the signal with the lower probability of reward. The results support the rule--the first well-controlled comparisons to do so. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Orbitofrontal cortex and basolateral amygdala lesions result in suboptimal and dissociable reward choices on cue-guided effort in rats.

The orbitofrontal cortex (OFC) and basolateral nucleus of the amygdala (BLA) are important neural regions in responding adaptively to changes in the incentive value of reward. Recent evidence suggests these structures may be differentially engaged in effort and cue-guided choice behavior. In 2 T-maze experiments, we examined the effects of bilateral lesions of either BLA or OFC on (1) effortful choices in which rats could climb a barrier for a high reward or select a low reward with no effort and (2) effortful choices when a visual cue signaled changes in reward magnitude. In both experiments, BLA rats displayed transient work aversion, choosing the effortless low reward option. OFC rats were work averse only in the no cue conditions, displaying a pattern of attenuated recovery from the cue conditions signaling reward unavailability in the effortful arm. Control measures rule out an inability to discriminate the cue in either lesion group. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?

What roles do mesolimbic and neostriatal dopamine systems play in reward? Do they mediate the hedonic impact of rewarding stimuli? Do they mediate hedonic reward learning and associative prediction? Our review of the literature, together with results of a new study of residual reward capacity after dopamine depletion, indicates the answer to both questions is 'no'. Rather, dopamine systems may mediate the incentive salience of rewards, modulating their motivational value in a manner separable from hedonia and reward learning. In a study of the consequences of dopamine loss, rats were depleted of dopamine in the nucleus accumbens and neostriatum by up to 99% using 6-hydroxydopamine. In a series of experiments, we applied the 'taste reactivity' measure of affective reactions (gapes, etc.) to assess the capacity of dopamine-depleted rats for: 1) normal affect (hedonic and aversive reactions), 2) modulation of hedonic affect by associative learning (taste aversion conditioning), and 3) hedonic enhancement of affect by non-dopaminergic pharmacological manipulation of palatability (benzodiazepine administration). We found normal hedonic reaction patterns to sucrose vs. quinine, normal learning of new hedonic stimulus values (a change in palatability based on predictive relations), and normal pharmacological hedonic enhancement of palatability. We discuss these results in the context of hypotheses and data concerning the role of dopamine in reward. We review neurochemical, electrophysiological, and other behavioral evidence. We conclude that dopamine systems are not needed either to mediate the hedonic pleasure of reinforcers or to mediate predictive associations involved in hedonic reward learning. We conclude instead that dopamine may be more important to incentive salience attributions to the neural representations of reward-related stimuli. Incentive salience, we suggest, is a distinct component of motivation and reward. In other words, dopamine systems are necessary for 'wanting' incentives, but not for 'liking' them or for learning new 'likes' and 'dislikes'.     

Self-stimulating rats combine subjective reward magnitude and subjective reward rate multiplicatively.

For rats that bar pressed for intracranial electrical stimulation in a 2-lever matching paradigm with concurrent variable interval schedules of reward, the authors found that the time allocation ratio is based on a multiplicative combination of the ratio of subjective reward magnitudes and the ratio of the rates of reward. Multiplicative combining was observed in a range covering approximately 2 orders of magnitude in the ratio of the rates of reward (from about 1:10 to 10:1) and an order of magnitude change in the size of rewards. After determining the relation between the pulse frequency of stimulation and subjective reward magnitude, the authors were able to predict from knowledge of the subjective magnitudes of the rewards and the obtained relative rates of reward the subject's time allocation ratio over a range in which it varied by more than 3 orders of magnitude. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Reward magnitude and partial reinforcement effects in a single runway.

The partial reinforcement acquisition effect (PRAE) in running speeds and the frustration effect (activity following nonreward compared with reward) were measured simultaneously in an alley whose goal-box floor was a stabilimeter. Experimental groups of 9 male Charles River albino rats each received 50 or 100% reinforcement combined factorially with 3 magnitudes of reward (1, 3, or 9 pellets). A control group of 18 Ss was never rewarded. The size of the PRAE was a direct function of reward magnitude, and crossing of 50 and 100% curves was found for all alley segments, including the goal segment. The frustration effect (FE) was present by the 2nd day of training for the 3- and 9-pellet groups, and the size of the FE was directly related to reward magnitude. The present study is unique in that (a) the findings were free from the effects of reward contrast, (b) behavior antecedent to the goal indicated that incentive was effectively manipulated, and (c) an unrewarded control group was used. (31 ref) (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Instrumental and Pavlovian incentive processes have dissociable effects on components of a heterogeneous instrumental chain.

Two experiments compared the effects of Pavlovian stimuli and incentive learning on the performance of a heterogeneous chain of instrumental actions. Using a Pavlovian-instrumental transfer design, the authors found that only a stimulus paired with the same outcome as that earned by performance of the chain produced positive transfer, an effect that was restricted to the action in the chain most proximal to reward delivery. In contrast, after a shift to a nondeprived state, only animals that had previously consumed the instrumental outcome when they were nondeprived decreased instrumental performance. Furthermore, this effect of the incentive learning treatment was limited to performance of the distal action. Together these data suggest that Pavlovian and instrumental incentive manipulations have dissociable effects on instrumental performance. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Competition and summation between rewarding effects of sucrose and lateral hypothalamic stimulation in the rat.

Rats were offered a forced choice between a train of brain stimulation that varied in strength from trial to trial and a fixed standard reward. This standard reward consisted of an intraoral sucrose infusion presented either alone or paired with an equipreferred train of brain stimulation. Postingestional effects were minimized by opening a gastric cannula. The presence of a sucrose standard led the Ss to forgo trains of brain stimulation for which they had responded when the sucrose was absent. The strength of the brain stimulation required to balance the compound reward exceeded the stimulation strength required to balance a reward consisting of sucrose alone. These results imply that the rewarding effects of brain stimulation and intraoral sucrose can be evaluated in a common system of measurement and combined. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Motivation sharpens exogenous spatial attention.

[Correction Notice: An erratum for this article was reported in Vol 7(4) of Emotion (see record 2007-17748-024). The supplemental materials link is as follows: http://dx.doi.org/10.1037/1528-3542.7.3.668.supp.] Although both attention and motivation affect behavior, how these 2 systems interact is currently unknown. To address this question, 2 experiments were conducted in which participants performed a spatially cued forced-choice localization task under varying levels of motivation. Participants were asked to indicate the location of a peripherally cued target while ignoring a distracter. Motivation was manipulated by varying magnitude and valence (reward and punishment) of an incentive linked to task performance. Attention was manipulated via a peripheral cue, which correctly predicted the presence of a target stimulus on 70% of the trials. Taken together, our findings revealed that the signal detection measure, reflecting perceptual sensitivity, increased as a function of incentive value during both valid and invalid trials. In addition, trend analyses revealed a linear increase in detection sensitivity as a function of incentive magnitude for both reward and punishment conditions. Our results suggest that elevated motivation leads to improved efficiency in orienting and reorienting of exogenous spatial attention and that one mechanism by which attention and motivation interact involves the sharpening of attention during motivationally salient conditions. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Functional connections between medial prefrontal cortex and caudate-putamen in brain-stimulation reward of rats.

Rats were trained to self-stimulate for trains of cathodal pulses delivered via electrodes placed in the medial prefrontal cortex (MPFC) and caudate-putamen (CPu). When the pulses were delivered via 9 ipsilateral MPFC and CPu sites alternately, summation varied from 13% to 40%. However, the overall summation for 2 contralateral MPFC-CPu pairs was 5%, thus indicating a greater integration of ipsilateral than contralateral reward signals. When the interval between alternate pulses decreased in 4 of the 9 ipsilateral pairs, the summation also decreased, an outcome consistent with collision of action potentials passing between the MPFC and CPu sites. The size of the collision effect ranged from 15% to 33%. Estimates of conduction velocity varied between 0.4 to 5.4 m/sec, with a 1.7 m/sec average. According to these values, the neurons connecting the MPFC and CPu self-stimulation sites appear to be slower than the ones that have been shown to link reward fibers that course between posterior brain regions. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Parametric analysis of brain stimulation reward in the rat: II. Temporal summation in the reward system.

Defines reward summation functions as the empirical functions relating running speed in a runway and waiting-box paradigm to the number or current intensity of the electrical pulses a rat receives for running. In an experiment with male white rats, repeated determination of such functions, with another parameter of stimulation varied between determinations, yielded parameter trade-off functions. These functions describe the amount of change required in 1 parameter to compensate for a change in another parameter. These functions place quantitative constraints on the neurophysiological events underlying the reward effect. Results suggest that such constraints mediate the identification of the neurophysiological substrate for the reward effect in self-stimulation. (PsycINFO Database Record (c) 2010 APA, all rights reserved)