Self-administered cocaine causes long-lasting increases in impulsive choice in a delay discounting task.

Cocaine use is associated with high levels of impulsive choice (preference for immediate over delayed rewards), but it is not clear whether cocaine use causes elevated impulsive choice, or whether elevated impulsive choice is solely a predisposing factor for cocaine use. This study examined the effects of prior cocaine self-administration on rats performing a delay discounting task commonly used to measure impulsive choice. Male Long-Evans rats were implanted with intravenous catheters, and following recovery, were trained to self-administer 30 mg/kg/day cocaine HCl (approx. 0.5 mg/kg/infusion) for 14 consecutive days (a control group received yoked intravenous saline infusions). Following three weeks of withdrawal, all rats were food-restricted and began training on the delay discounting task in standard operant chambers. On each trial, rats were given a choice between two levers. A press on one lever delivered a small food reward immediately, and a press on the other delivered a large food reward after a variable delay period. Rats that self-administered cocaine displayed greater impulsive choice (enhanced preference for the small immediate over the large delayed reward, as reflected by shorter indifference points) compared to controls, but were no different from controls on a “probabilistic discounting” task in which they chose between small certain and large uncertain rewards. These data suggest that self-administered cocaine can cause lasting elevations in impulsive choice, and that the high levels of impulsive choice observed in human cocaine users may be due in part to long-term effects of cocaine on brain function. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Impulsive choice as a predictor of acquisition of IV cocaine self- administration and reinstatement of cocaine-seeking behavior in male and female rats.

Drug abuse and impulsive choice are related in humans. In female rats, impulsive choice predicted the rate of acquisition of IV cocaine self-administration. The objectives of the present experiments were to: (a) compare impulsive choice in males and females, (b) extend previous research on impulsive choice and acquisition of cocaine self-administration to males, and (c) compare males and females during maintenance, extinction, and reinstatement of cocaine-seeking behavior. Male and female rats were trained on an adjusting delay task in which a response on one of two levers yielded one food pellet immediately, and a response on the other resulted in three pellets after an adjusting delay that decreased after responses on the immediate lever and increased after responses on the delay lever. A mean adjusted delay (MAD) was used as the quantitative measure of impulsivity. In Experiment 1, MADs were analyzed for sex differences. In Experiment 2, acquisition of cocaine self-administration was examined in rats selected for high (HiI; MADs ≤9 seconds) or low (LoI; MADs ≥13 seconds) impulsivity. In Experiment 3, HiI and LoI groups were compared on maintenance and extinction of cocaine self-administration and cocaine-primed reinstatement of drug-seeking behavior. There were no sex differences in impulsive choice; however, HiI male and female rats acquired cocaine self-administration faster than their LoI counterparts. LoI females responded more on a cocaine-associated lever during maintenance and extinction than HiI females, but HiI females showed greater reinstatement of cocaine-seeking behavior than all other groups at the highest dose tested (15 mg/kg). Thus, individual differences in impulsive choice were associated with differences in cocaine-seeking behavior. Impulsive choice and sex may be additive vulnerability factors in certain phases of drug abuse. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Context extinction following conditioning with delayed reward enhances subsequent instrumental responding.

In Experiment 1, delayed reward generated low response rates relative to immediate reward delivered with the same frequency. Lister rats exposed to delayed reward subsequently responded at a higher rate in extinction if they received nonreinforced exposure to the conditioned context after instrumental training and prior to test, compared with animals that received home cage exposure. In Experiment 2, a signaled delay of reinforcement resulted in higher rates than an unsignaled delay. Nonreinforced exposure to the conditioning context elevated response rate for subjects in the unsignaled condition relative to a home cage group, but had no effect on response rates for subjects that had received the signaled delay. In Experiment 3, following an unsignaled reinforcement delay, groups receiving either no event or signaled food in the context responded faster in extinction than groups receiving no context exposure or unsignaled food. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Decreased phospholipase D (PLD) activity in ceramide-induced apoptosis of human keratinocyte cell line HaCaT

Autoshaping conditioned responses (CRs) are reflexive and targeted motor responses expressed as a result of experience with reward. To evaluate the hypothesis that autoshaping may be a form of impulsive responding, within-subjects correlations between performance on autoshaping and impulsivity tasks were assessed in 15 Long-Evans hooded rats. Autoshaping procedures [insertion of retractable lever conditioned stimulus (CS) followed by the response-independent delivery of food (US)] were followed by testing for impulsive-like responding in a two-choice lever-press operant delay-of-reward procedure (immediate small food reward versus delayed large food reward). Delay-of-reward functions revealed two distinct subject populations. Subjects in the Sensitive group (n=7) were more impulsive-like, increasing immediate reward choices at longer delays for large reward, while those in the Insensitive group (n=8) responded predominantly on only one lever. During the prior autoshaping phase, the Sensitive group had performed more autoshaping CRs, and correlations revealed that impulsive subjects acquired the autoshaping CR in fewer trials. In the Sensitive group, acute injections of ethanol (0, 0.25, 0.50, 1.00, 1.50 g/kg) given immediately before delay-of-reward sessions yielded an inverted U-shaped dose-response curve with increased impulsivity induced by the 0.25, 0.50, and 1.00 g/kg doses of ethanol, while choice strategy of the Insensitive group was not influenced by ethanol dose. Ethanol induced impulsive-like responding only in rats that were flexible in their response strategy (Sensitive group), and this group also performed more autoshaping CRs. Data support the hypothesis that autoshaping and impulsivity are linked.     

The role of the nucleus accumbens core in impulsive choice, timing, and reward processing.

The present series of experiments aimed to pinpoint the source of nucleus accumbens core (AcbC) effects on delay discounting. Rats were trained with an impulsive choice procedure between an adjusting smaller sooner reward and a fixed larger later reward. The AcbC-lesioned rats produced appropriate choice behavior when the reward magnitude was equal. An increase in reward magnitude resulted in a failure to increase preference for the larger later reward in the AcbC-lesioned rats, whereas a decrease in the larger later reward duration resulted in normal alterations in choice behavior in AcbC-lesioned rats. Subsequent experiments with a peak timing (Experiments 2 and 3) and a behavioral contrast (Experiment 4) indicated that the AcbC-lesioned rats suffered from decreased incentive motivation during changes in reward magnitude (Experiments 2 and 4) and when expected rewards were omitted (Experiments 2 and 3), but displayed intact anticipatory timing of reward delays (Experiments 2 and 3). The results indicate that the nucleus accumbens core is critical for determining the incentive value of rewards, but does not participate in the timing of reward delays. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Yoked delivery of cocaine is aversive and protects against the motivation for drug in rats.

In Experiment 1, water-deprived rats had 5-min access to saccharin followed by active or yoked intravenous delivery of saline or cocaine (0.33 mg/infusion). Both cocaine groups avoided intake of the saccharin cue following saccharin–cocaine pairings; however, the rats in the yoked condition exhibited greater avoidance of the taste cue than did the actively administering rats. Experiment 2 evaluated subsequent self-administration behavior on fixed- and progressive-ratio schedules of reinforcement. The results showed that prior yoked exposure to cocaine reduced subsequent drug-taking behavior on a progressive-ratio but not on a fixed-ratio schedule. Finally, Experiment 3 used a choice test to determine the impact of yoked drug delivery on the relative preference for cocaine versus water. The results showed that rats with a history of self-administering cocaine preferred to perform operant behaviors on the side of the chamber previously paired with cocaine, whereas the rats with a history of yoked delivery of cocaine avoided this side. These data show that, in most rats, the unpredictable, uncontrollable delivery of cocaine protects against the subsequent motivation for cocaine through an aversive mechanism. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Reward discounting as a measure of impulsive behavior in a psychiatric outpatient population.

Impulsivity has been operationalized as a choice of an immediate smaller reward over a larger delayed or uncertain reward. This study examined a procedure that measures reward preference under these contingencies in psychiatric outpatients considered either at a high or low risk for engaging in impulsive behavior depending on their psychiatric diagnoses. The participants' rates of delay and uncertainty reward discounting were compared with their performances on a behavioral inhibition task and responses on a self-report personality impulsivity measure. The high-risk participants discounted delayed rewards more sharply and scored higher on the self-report impulsivity measure relative to the low-risk participants. Delay and uncertainty discounting were modestly correlated, but no other relationships were found between the other measures. Results from this study indicate that delay-discounting tasks may be sensitive to at least one form of impulsive behavior. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Effect of short-term hormone replacement therapy on left ventricular mass and contractile function

This study examined the effects of neonatal cocaine exposure on the rewarding properties of play in a modified T-maze. Animals were artificially reared from postnatal day (PND) 4-9 with drug concentrated in four daily feeds. There were four treatment groups, 40 mg/kg/day cocaine, 20 mg/kg/day cocaine, an artificially reared control and a surgery control. From PND 38-42, subjects were tested with a food reward (EXP 1) or a play reward (EXP 2). No deficits in learning were seen when the reward was food. The 20 mg/kg/day cocaine group, however, showed impaired learning and altered play behavior when the reward was access to a play partner. Neonatal cocaine exposure thus appears to differentially affect learning based on the type of reward presented.     

Differential effects on effort discounting induced by inactivations of the nucleus accumbens core or shell.

The authors investigated the contribution of the nucleus accumbens (NAc) core and shell to effort-based decision making using a discounting procedure. Selection of 1 lever delivered a smaller, 2-pellet reward immediately, whereas the other lever delivered a 4-pellet reward after a fixed ratio of presses (2, 5, 10, or 20) that increased over 4 blocks of 10 discrete choice trials. Subsequent testing employed an equivalent delays procedure, whereby the relative delay to reward delivery after selection of either option was equalized. In well-trained rats, inactivation of the core, but not the shell, via infusion of GABA A/B agonists muscimol/baclofen reduced preference for the high-effort option under standard conditions and also when rats were tested using an equivalent delays procedure. However, inactivation of the core did not alter preference for 4-pellet versus 2-pellet rewards when the relative costs of each option were the same (1 press). Thus, the NAc core, but not the shell, appears to be part of a neural circuit that biases choice toward larger rewards associated with a greater effort cost. Furthermore, the contributions by the NAc core to this form of decision making can be dissociated from its role in delay discounting. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Competition between the conditioned rewarding effects of cocaine and novelty.

Access to novelty might provide an alternative learning history that competes with conditioned drug reward. We tested this suggestion in rats using a place conditioning procedure with cocaine and novelty. In Experiment 1, rats were conditioned with cocaine to prefer one side of an apparatus. In a subsequent phase, cocaine exposure continued; however, on the unpaired side, separate group of rats had access to novel objects, cocaine injections, or saline with no objects. Pairings with novel objects or cocaine shifted a preference away from the cocaine-paired environment during drug-free and drug-challenge tests. Experiment 2 tested novelty's impact when cocaine exposure was discontinued. The identical procedures were used except drug exposure ceased on the cocaine-paired side during the second phase. Both groups expressed a preference for the cocaine compartment. This preference was maintained for rats that did not have novel objects; however, rats that experienced novelty spent similar amounts of time in both compartments during both tests. Overall, the conditioned rewarding effects of novelty competed with those of cocaine as evidenced by a change in choice behaviors motivated by drug reward. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Interactions between the prefrontal cortex and amygdala during delay discounting and reversal.

Interactions between the prefrontal cortex and amygdala are thought to be critical for reward anticipation. Alterations in reward anticipation that lead to an inability to wait for rewards or a diminished capacity to change behavior when doing so would be optimal are often termed impulsivity and compulsivity, respectively. Distinct regions of the prefrontal cortex may support decreased impulsivity through self-control and decreased compulsivity through flexibility. However, both self-control and flexibility appear to involve the amygdala. Using a delay discounting paradigm, the current investigation found that inactivation and disconnection of the medial prefrontal cortex and basolateral amygdala led rats to become more impulsive by affecting preference for smaller immediate over larger delayed rewards. Conversely, inactivation and disconnection of the orbitofrontal cortex and amygdala led rats to become more compulsive as demonstrated by an inability to flexibly reverse stimulus–reward relationships in an odor reversal task. The current findings support a double dissociation between orbitofrontal cortex–amygdala interactions for odor reversal and medial prefrontal cortex–amygdala interactions for delay discounting. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Delay of punishment and choice behavior in the rat.

Trained 4 groups of female Sprague-Dawley albino rats (N = 24) to press each of 2 bars for reward delayed 120 sec. A different set of distinctive cues prevailed between bar press and food depending on which bar was pressed. For experimental Ss shocks were then introduced following each response to the preferred bar. The response-shock interval was 1.5, 12, or 96 sec. Experimental Ss' preference shifted from the shock bar; preference remained the same for no-shock controls. The rate of changes was a negative function of delay of shock, but final percentage of responses to the nonshock bar was the same for all delays. Results support the hypothesis that delay of punishment as such has no effect on choice at asymptote. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Effects of pramipexole on impulsive choice in male wistar rats.

Clinical reports, primarily with Parkinson's disease patients, note an association between the prescribed use of pramipexole (and other direct-acting dopamine agonist medications) and impulse control disorders, particularly pathological gambling. Two experiments examined the effects of acute pramipexole on rats' impulsive choices where impulsivity was defined as selecting a smaller–sooner over a larger–later food reward. In Experiment 1, pramipexole (0.1 to 0.3 mg/kg) significantly increased impulsive choices in a condition in which few impulsive choices were made during a stable baseline. In a control condition, in which impulsive choices predominated during baseline, pramipexole did not significantly change the same rats' choices. Experiment 2 explored a wider range of doses (0.01 to 0.3 mg/kg) using a choice procedure in which delays to the larger–later reinforcer delivery increased across trial blocks within each session. At the doses used in Experiment 1, pramipexole shifted choice toward indifference regardless of the operative delay. At lower doses of pramipexole (0.01 and 0.03 mg/kg), a trend toward more impulsive choice was observed at the 0.03 mg/kg dose. The difference in outcomes across experiments may be due to the more complex discriminations required in Experiment 2, that is, multiple discriminations between changing delays within each session. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Locomotor Activity Predicts Acquisition of Self-Administration Behavior but Not Cocaine Intake.

The current study investigates locomotor activity in a novel environment and correlates these activity levels with cocaine self-administration in rats that were either trained or untrained on a lever-pressing task prior to cocaine self-administration. The authors report that it is the rate of learning the lever-pressing task, not cocaine self-administration, that correlates with locomotor activity. The results suggest that a correlation between locomotor activity and cocaine self-administration is secondary to a link between locomotor activity and rate of learning to lever press for a reward. The authors conclude that locomotor activity is not necessarily an indicator of propensity to self-administer cocaine and demonstrate that environmental novelty and rate of learning an operant task are important considerations when designing experiments on drug-seeking behaviors. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Response acquisition with delayed reinforcement.

Discrete responses of experimentally naive, food-deprived White Carneaux pigeons (key pecks) or Sprague-Dawley rats (bar or omnidirectional lever presses) initiated unsignaled delay periods that terminated with food delivery. Each subject first was trained to eat from the food source, but no attempt was made to shape or to otherwise train the response. In both species, the response developed and was maintained. Control procedures excluded the simple passage of time, response elicitation or induction by food presentation, type of operandum, food delivery device location, and adventitious immediate reinforcement of responding as the basis for the effects. Results revealed that neither training nor immediate reinforcement is necessary to establish new behavior. The conditions that give rise to both the first and second response are discussed, and the results are related to other studies of the delay of reinforcement and to explanations of behavior based on contingency or correlation and contiguity. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Competition between novelty and cocaine conditioned reward is sensitive to drug dose and retention interval.

The conditioned rewarding effects of novelty compete with those of cocaine for control over choice behavior using a place conditioning task. The purpose of the present study was to use multiple doses of cocaine to determine the extent of this competition and to determine whether novelty’s impact on cocaine reward was maintained over an abstinence period. In Experiment 1, rats were conditioned with cocaine (7.5, 20, or 30 mg/kg ip) to prefer one side of an unbiased place conditioning apparatus relative to the other. In a subsequent phase, all rats received alternating daily confinements to the previously cocaine paired and unpaired sides of the apparatus. During this phase, half the rats had access to a novel object on their initially unpaired side; the remaining rats did not receive objects. The ability of novelty to compete with cocaine in a drug free and cocaine challenge test was sensitive to cocaine dose. In Experiment 2, a place preference was established with 10 mg/kg cocaine and testing occurred after 1, 14, or 28 day retention intervals. Findings indicate that choice behaviors mediated by cocaine conditioning are reduced with the passing of time. Taken together, competition between cocaine and novelty conditioned rewards are sensitive to drug dose and retention interval. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Positive mood effects on delay discounting.

Delay discounting is the process by which the value of an expected reward decreases as the delay to obtaining that reward increases. Individuals with higher discounting rates tend to prefer smaller immediate rewards over larger delayed rewards. Previous research has indicated that personality can influence an individual's discounting rates, with higher levels of Extraversion predicting a preference for immediate gratification. The current study examined how this relationship would be influenced by situational mood inductions. While main effects were observed for both Extraversion and cognitive ability in the prediction of discounting rates, a significant interaction was also observed between Extraversion and positive affect. Extraverted individuals were more likely to prefer an immediate reward when first put in a positive mood. Extraverts thus appear particularly sensitive to impulsive, incentive-reward-driven behavior by temperament and by situational factors heightening positive affect. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Intravenous gestational cocaine in rats: effects on offspring development and weanling behavior

Pregnant rats were injected with cocaine (CN; 6 mg/kg) or an equal volume of saline (SAL), via the tail vein, on gestation days 8-20. A third group was untreated (UT). Maternal weight gain was not affected by dam treatment despite slight differences in food intake. Litter characteristics (e.g., litter size, pup weight) did not differ among groups. Indices of fetal mortality were not affected by the treatments. Developmental tests, initiated on postnatal day (PND) 2, indicated slight delays in the negative geotaxic response and eye opening in cocaine-exposed pups. Open-field and tail-flick tests were performed on PND 21. Pups were acutely injected with cocaine (10 mg/kg, IP), saline, or received no treatment before placement in a novel open field; morphine (1.5 mg/kg, SC) or saline was injected prior to the tail flick test. Pups from CN dams exhibited a significant decrease in spontaneous exploratory behavior compared to both controls, and a time-dependent increase in rearing compared to pups from UT dams. The acute cocaine injection prior to placement in the open field did not alter locomotion or rearing among dam treatment groups. However, the acute cocaine injection did increase stereotypy ratings for female pups from CN dams compared to similarly treated males, and females from SAL and UT dams. No differences were observed among groups in the tail-flick test. These data suggest that the IV route of administration provides a viable method of cocaine delivery in pregnant rats, and provides further evidence of the developmental and behavioral teratogenicity of prenatal cocaine exposure.     

Delay and reward choice in ADHD: An experimental test of the role of delay aversion.

Children with attention deficit/hyperactivity disorder (ADHD) choose smaller sooner (SS) over larger later (LL) rewards more than controls. Here we assess the contributions of impulsive drive for immediate rewards (IDIR) and delay aversion (DAv) to this pattern. We also explore the characteristics of, and the degree of familiality in, ADHD SS responders. We had 360 ADHD probands; 349 siblings and 112 controls (aged between 6 to 17 years) chose between SS (1 point after 2 s) and LL reward (2 points after 30 s) outcomes on the Maudsley Index of Delay Aversion (Kuntsi, Oosterlaan, & Stevenson, 2001): Under one condition SS choice led to less overall trial delay under another it did not. ADHD participants chose SS more than controls under both conditions. This effect was larger when SS choice reduced trial delay. ADHD SS responders were younger, had lower IQ, more conduct disorder and had siblings who were more likely to be SS responders themselves. The results support a dual component model in which both IDIR and DAv contribute to SS choice in ADHD. SS choice may be a marker of an ADHD motivational subtype. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Music-induced context preference following cocaine conditioning in rats.

Traditional models of drug-seeking behavior have shown that exposure to associated environmental cues can trigger relapse. These learned associations take place during repeated drug administration, resulting in conditioned reinforcement. Although considerable investigation has occurred regarding simple conditioned stimuli, less is known about complex environmental cues, particularly those that may be salient in human addiction. Recent studies indicate that music can serve as a contextual conditioned stimulus in rats and influence drug-seeking behavior during abstinence. The purpose of the present study was to further assess the effectiveness of music as a conditioned stimulus in rats, to determine rats' preferences for two contrasting pieces of music, and to determine rats' preferences for music versus silence. To this end, we created an apparatus that gave instrumental control of musical choice (Miles Davis vs. Beethoven) to the rats themselves. After determining baseline musical preference, animals were conditioned with cocaine (10 mg/kg) to the music they initially preferred least, with alternating conditioning sessions pairing saline with the music preferred most. The animals were subsequently tested in a drug-free state to determine what effect this conditioning had on musical preference. The results indicate that music serves as an effective contextual conditioned stimulus, significantly increasing both musical preference and locomotor activity after repeated cocaine conditioning. Furthermore, we found that rats initially favor silence over music, but that this preference can be altered as a result of cocaine-paired conditioning. These findings demonstrate that, after repeated association with reward (cocaine), music can engender a conditioned context preference in rats; these findings are consistent with other evidence showing that musical contextual cues can reinstate drug-seeking behavior in rats. (PsycINFO Database Record (c) 2011 APA, all rights reserved)