Delay discounting of real and hypothetical rewards.

The degree to which real and hypothetical rewards were discounted across delays ranging from 6 hr to 1 year was explored in a within-subjects design. An adjusting-amounts procedure was used to estimate the subjective value of real and hypothetical rewards at each delay. A hyperbolic discounting function provided a significantly better fit to individual participants' preferences than did an exponential function. No significant effect of reward type on degree of hyperbolic discounting or area under the discounting curves was detected. These findings offer some support for the validity of using hypothetical rewards to estimate discounting rates in substance-abusing and other populations, but caution is suggested because this support is gleaned from a failure to detect an effect of reward type. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Discounting of delayed rewards in opioid-dependent outpatients: Exponential or hyperbolic discounting functions?

Recent theories of substance abuse have used value discounting of delayed rewards to partly explain the decision to take drugs. Normative-economic theory holds that an exponential function describes the effects of delay on discounting, whereas the matching law posits a hyperbolic discounting function. The ability of these functions to describe 18 human heroin-dependent individuals' monetary- and heroin-reward delay-discounting functions was assessed. In the 1st condition, participants chose between immediate and delayed hypothetical monetary rewards. Delayed rewards were $1,000, and the immediate reward amount was adjusted until choices reflected indifference. In the 2nd condition, participants chose between immediate and delayed heroin (the delayed amount was that which each participant reported he or she could purchase with $1,000). The hyperbolic function produced significantly higher R2 values and significantly lower sums of squared error values. Consistent with previous findings, delayed heroin rewards were discounted at a significantly higher rate than were delayed monetary rewards. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Moderate drug use and delay discounting: A comparison of heavy, light, and never smokers.

Delay discounting was examined in light smokers (10 or fewer cigarettes per day) and compared with previously published delay discounting data for heavy and never smokers. Participants evaluated several hypothetical outcomes: money gains and loses ($10, $100, and $1,000), health gains and losses (durations of improved and impoverished health subjectively equivalent to $1,000), cigarette gains and losses (amounts subjectively equivalent to $1,000), and potentially real rewards ($10 and $100). Light smokers discounted money significantly more than never smokers, but light smokers did not differ from heavy smokers. The 3 groups did not statistically differ in discounting of health consequences. Similarly, the 2 smoking groups were not found to differ in discounting of cigarettes. Like heavy smokers, light smokers discounted cigarettes significantly more than money and health. Several significant, positive correlations were found between smoking rate and various discounting measures in the heavy smokers but not in the light smokers. Several previous findings were replicated, helping to validate the present results: the sign effect (greater discounting of gains than losses), the magnitude effect (greater discounting of smaller rewards), reliability of discounting measures over time, and the consistency of hypothetical and potentially real rewards. These data suggest that even moderate levels of drug use may be associated with high delay discounting levels. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Effects of methylphenidate on discounting of delayed rewards in attention deficit/hyperactivity disorder.

Impulsivity is a central component of attention deficit/hyperactivity disorder (ADHD). Delay discounting, or a preference for smaller, immediate rewards over larger, delayed rewards, is considered an important aspect of impulsivity, and delay-related impulsivity has been emphasized in etiological models of ADHD. In this study, we examined whether stimulant medication, an effective treatment for ADHD, reduced discounting of delayed experiential and hypothetical rewards among 49 children (ages 9–12 years) with ADHD. After a practice day, participants completed a 3-day double-blind placebo-controlled acute medication assessment. Active doses were long-acting methylphenidate (Concerta), with the nearest equivalents of 0.3 and 0.6 mg/kg TID immediate-release methylphenidate. On each testing day, participants completed experiential (real-world money in real time) and hypothetical discounting tasks. Relative to placebo, methylphenidate reduced discounting of delayed experiential rewards but not hypothetical rewards. Broadly consistent with etiological models that emphasize delay-related impulsivity among children with ADHD, these findings provide initial evidence that stimulant medication reduces delay discounting among those with the disorder. The results also draw attention to task parameters that may influence the sensitivity of various delay discounting measures to medication effects. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Discounting of hypothetical and potentially real outcomes in nicotine-dependent and nondependent samples.

Discounting is a behavioral phenomenon in which the value of an outcome diminishes as a function of its increased delay or decreased probability and is related to substance abuse research because of its theoretical ties with behavioral models of impulsive choice. Research to date suggests that hypothetical outcomes used in discounting research yield data that are indistinguishable from those using potentially real outcomes. However, the extant literature focuses primarily on delay discounting in non-drug-using humans and has not examined whether hypothetical outcomes yield disproportionate numbers of nonsystematic response patterns. In two experiments, we compared hypothetical and potentially real monetary outcomes in delay and probability discounting tasks in terms of rates of discounting and the frequency of nonsystematic response patterns. In Experiment 1, 61 adults reported no smoking, binge drinking, or illicit drug use in the past year. Experiment 2 included a community sample of nicotine-dependent adults (N = 36). In both experiments, discounting for hypothetical and potentially real outcomes yielded similar data, replicating and extending a growing literature pointing to the empirical equivalence of these outcomes. These findings are relevant to research on discounting that is frequently used in the study of substance use and other impulse-control behaviors. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

Temporal horizons in decision making.

The perception of duration is crucial when we make choices between immediate and delayed rewards. Immediate rewards are valued more than the same rewards if they are delayed. Preferences for earlier rewards become even stronger when the reward can be received within a subjectively proximate time frame. A “rational” decision to wait for a delayed reward may be overruled by an “impulsive” choice when the option for the closer reward falls within this proximate time range. Based on findings on circadian and circannual physiological rhythms, we suggest that there are 2 time units that are both biologically and culturally determined and have an impact on human experience and behavior: the day and the year. We highlight results of a neuroimaging study showing that rewards with delays up to 1 year are discounted differently than reward delays longer than 1 year. This duration-dependent discounting is associated with specific brain activation in the striatum. We present various conceptualizations of subjective time incorporated in parametric models of intertemporal decisions that may lead to a better understanding of human choice behavior. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Amount of reward has opposite effects on the discounting of delayed and probabilistic outcomes.

Previous research has shown that the value of large future rewards is discounted less steeply than is the value of small future rewards. These experiments extended this line of research to probabilistic rewards. Two experiments replicated the standard findings for delayed rewards but demonstrated that amount has an opposite effect on the discounting of probabilistic rewards. That is, large probabilistic amounts were discounted at the same or higher rates than small amounts. Although amount had opposite effects on the discounting of delayed and probabilistic rewards, nevertheless, the same form of mathematical function accurately described discounting of both types of reward. The findings suggest that fundamentally similar, but not identical, processes are involved in decision making regarding delayed and probabilistic rewards. The implications of these findings for impulsivity and self-control are discussed. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Positive mood effects on delay discounting.

Delay discounting is the process by which the value of an expected reward decreases as the delay to obtaining that reward increases. Individuals with higher discounting rates tend to prefer smaller immediate rewards over larger delayed rewards. Previous research has indicated that personality can influence an individual's discounting rates, with higher levels of Extraversion predicting a preference for immediate gratification. The current study examined how this relationship would be influenced by situational mood inductions. While main effects were observed for both Extraversion and cognitive ability in the prediction of discounting rates, a significant interaction was also observed between Extraversion and positive affect. Extraverted individuals were more likely to prefer an immediate reward when first put in a positive mood. Extraverts thus appear particularly sensitive to impulsive, incentive-reward-driven behavior by temperament and by situational factors heightening positive affect. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Impulsive decision making and working memory.

Decision making that favors short-term over long-term consequences of action, defined as impulsive or temporally myopic, may be related to individual differences in the executive functions of working memory (WM). In the first 2 experiments, participants made delay discounting (DD) judgments under different WM load conditions. In a 3rd experiment, participants high or low on standardized measures of impulsiveness and dysexecutive function were asked to make DD judgments. A final experiment examined WM load effects on DD when monetary rewards were real rather than hypothetical. The results showed that higher WM load led to greater discounting of delayed monetary rewards. Further, a strong direct relation was found between measures of impulsiveness, dysexecutive function, and discounting of delayed rewards. Thus, limits on WM function, either intrinsic or extrinsic, are predictive of a more impulsive decision-making style. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Pathological gamblers, with and without substance abuse disorders, discount delayed rewards at high rates.

Pathological gambling is classified as a disorder of impulse control, yet little research has evaluated behavioral indices of impulsivity in gamblers. The rates at which rewards delayed in time are subjectively devalued may be a behavioral marker of impulsivity. This study evaluated delay discounting in 60 pathological gamblers and 26 control participants. Gamblers were divided into those with (n?=?21) and without (n?=?39) substance use disorders. A hypothetical $1,000 reward was delayed at intervals ranging from 6 hr to 25 years, and immediate rewards varied from $1 to $999. Pathological gamblers discounted delayed rewards at higher rates than control participants, and gamblers with substance use disorders discounted delayed rewards at higher rates than non-substance-abusing gamblers. These data provide further evidence that rapid discounting of delayed rewards may be a feature central to impulse control and addictive disorders, including pathological gambling. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Alcohol demand, delayed reward discounting, and craving in relation to drinking and alcohol use disorders.

A behavioral economic approach to alcohol use disorders (AUDs) emphasizes both individual and environmental determinants of alcohol use. The current study examined individual differences in alcohol demand (i.e., motivation for alcohol under escalating conditions of price) and delayed reward discounting (i.e., preference for immediate small rewards compared to delayed larger rewards) in 61 heavy drinkers (62% with an AUD). In addition, based on theoretical accounts that emphasize the role of craving in reward valuation and preferences for immediate rewards, craving for alcohol was also examined in relation to these behavioral economic variables and the alcohol-related variables. Intensity of alcohol demand and delayed reward discounting were significantly associated with AUD symptoms, but not with quantitative measures of alcohol use, and were also moderately correlated with each other. Likewise, craving was significantly associated with AUD symptoms, but not with alcohol use, and was also significantly correlated with both intensity of demand and delayed reward discounting. These findings further emphasize the relevance of behavioral economic indices of motivation to AUDs and the potential importance of craving for alcohol in this relationship. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Temporal discounting in choice between delayed rewards: The role of age and income.

This study examined the effects of age and income on temporal discounting (i.e., the decrease in the subjective value of a reward as the delay to its receipt increases). The value of delayed hypothetical monetary rewards was discounted at similar rates by adults of different ages but similar income levels, but at different rates by adults of similar age but different income levels. Specifically, lower income older adults showed a greater degree of temporal discounting than did either upper income older adults or upper income younger adults, but there were no age differences in discounting between the upper income groups. Comparison of these findings with those of a previous study (Green, Fry, & Myerson, 1994) suggests that impulsivity in decision making declines rapidly in young adulthood, reaching stable levels in the 30s. Further, age and income appear to interact in determining the impulsivity of decision making by adults. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

The role of the nucleus accumbens core in impulsive choice, timing, and reward processing.

The present series of experiments aimed to pinpoint the source of nucleus accumbens core (AcbC) effects on delay discounting. Rats were trained with an impulsive choice procedure between an adjusting smaller sooner reward and a fixed larger later reward. The AcbC-lesioned rats produced appropriate choice behavior when the reward magnitude was equal. An increase in reward magnitude resulted in a failure to increase preference for the larger later reward in the AcbC-lesioned rats, whereas a decrease in the larger later reward duration resulted in normal alterations in choice behavior in AcbC-lesioned rats. Subsequent experiments with a peak timing (Experiments 2 and 3) and a behavioral contrast (Experiment 4) indicated that the AcbC-lesioned rats suffered from decreased incentive motivation during changes in reward magnitude (Experiments 2 and 4) and when expected rewards were omitted (Experiments 2 and 3), but displayed intact anticipatory timing of reward delays (Experiments 2 and 3). The results indicate that the nucleus accumbens core is critical for determining the incentive value of rewards, but does not participate in the timing of reward delays. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Delay discounting in current and former marijuana-dependent individuals.

Studies have found that a variety of drug-dependent groups discount delayed rewards more than matched controls. This study compared delay discounting for a hypothetical $1,000 reward among dependent marijuana users, former dependent marijuana users, and matched controls. Discounting of marijuana was also assessed in the currently marijuana-dependent group. No significant differences in discounting were detected among the groups; however, currently dependent users showed a trend to discount money more than the other 2 groups. Within the dependent marijuana group, marijuana was discounted more than money, and discounting for money and marijuana was significantly and positively correlated. Regression analyses indicated that delay discounting was more closely associated with tobacco use than marijuana use. A variety of questionnaires were also administered, including impulsivity questionnaires. Dependent marijuana users scored as significantly more impulsive on the Impulsiveness subscale of the Eysenck Impulsiveness–Venturesomeness–Empathy questionnaire than controls. However, the 3 groups did not significantly differ on several other personality questionnaires, including the Barratt Impulsivity Scale—11. The Stanford Time Perception Inventory Present–Fatalistic subscale was positively correlated with money and marijuana discounting, indicating that a greater sense of powerlessness over the future is related to greater delay discounting. Results suggest that current marijuana dependence may be associated with a trend toward increased delay discounting, but this effect size appears to be smaller for marijuana than for previously examined drugs. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Affect regulation and temporal discounting: Interactions between primed, state, and trait affect.

Previous research has largely focused on the influence of experienced affect on decision making; however, other sources of affective information may also shape decisions. In two studies, we examine the interacting influences of affective information, state affect, and personality on temporal discounting rates (i.e., the tendency to choose small rewards today rather than larger rewards in the future). In Study 1, participants were primed with either positive or negative affect adjectives before making reward choices. In Study 2, participants underwent either a positive or negative affect induction before making reward choices. Results in both studies indicate that neuroticism interacts with state unpleasant affect and condition (i.e., positive or negative primes or induction) to predict discounting rates. Moreover, the nature of the interactions depends on the regulatory cues of the affective information available. These results suggest that irrelevant (i.e., primes) and stable (i.e., personality traits) sources of affective information also shape judgments and decision making. Thus, current affect levels are not the only source of affective information that guides individuals when making decisions. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

Impulsive and self-control choices in opioid-dependent patients and non-drug-using control patients: Drug and monetary rewards.

Delay discounting was investigated in opioid-dependent and non-drug-using control participants. The latter participants were matched to the former on age, gender, education, and IQ. Participants in both groups chose between hypothetical monetary rewards available either immediately or after a delay. Delayed rewards were $ 1,000, and the immediate-reward amount was adjusted until choices reflected indifference. This procedure was repeated at each of 7 delays (1 week to 25 years). Opioid-dependent participants were given a second series of choices between immediate and delayed heroin, using the same procedures (i.e., the amount of delayed heroin was that which could be purchased with $1,000). Opioid-dependent participants discounted delayed monetary rewards significantly more than did non-drug-using participants. Furthermore opioid-dependent participants discounted delayed heroin significantly more than delayed money. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Interactions between the prefrontal cortex and amygdala during delay discounting and reversal.

Interactions between the prefrontal cortex and amygdala are thought to be critical for reward anticipation. Alterations in reward anticipation that lead to an inability to wait for rewards or a diminished capacity to change behavior when doing so would be optimal are often termed impulsivity and compulsivity, respectively. Distinct regions of the prefrontal cortex may support decreased impulsivity through self-control and decreased compulsivity through flexibility. However, both self-control and flexibility appear to involve the amygdala. Using a delay discounting paradigm, the current investigation found that inactivation and disconnection of the medial prefrontal cortex and basolateral amygdala led rats to become more impulsive by affecting preference for smaller immediate over larger delayed rewards. Conversely, inactivation and disconnection of the orbitofrontal cortex and amygdala led rats to become more compulsive as demonstrated by an inability to flexibly reverse stimulus–reward relationships in an odor reversal task. The current findings support a double dissociation between orbitofrontal cortex–amygdala interactions for odor reversal and medial prefrontal cortex–amygdala interactions for delay discounting. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Heroin addicts have higher discount rates for delayed rewards than non-drug-using controls.

Fifty-six heroin addicts and 60 age-matched controls were offered choices between monetary rewards ($11–$80) available immediately and larger rewards ($25–$85) available after delays ranging from 1 week to 6 months. Participants had a 1-in-6 chance of winning a reward that they chose on one randomly selected trial. Delay-discounting rates were estimated from the pattern of participants' choices. The discounting model of impulsiveness (G. Ainslie, 1975) implies that delay-discounting rates are positively correlated with impulsiveness. On average, heroin addicts' discount rates were twice those of controls (p?=?.004), and discount rates were positively correlated with impulsivity as measured by self-report questionnaires (p?     

Impulsivity and rapid discounting of delayed hypothetical rewards in cocaine-dependent individuals.

In this study, crack/cocaine-dependent (CD) and non-drug-using matched control (MC) participants were presented with hypothetical immediate and delayed rewards, with 16 delay conditions ranging from 5 min to 25 years. All participants were presented with hypothetical monetary rewards; however, the CD group was also presented with hypothetical crack/ cocaine rewards. The objective value of the rewards ranged from $1 to $1,000. Hyperbolic discounting functions provided a good fit of the data. The CD group discounted monetary rewards at a higher rate than the MC group did, and the CD group discounted crack/cocaine rewards at a higher rate than it did monetary rewards. Moreover, scores on self-report measures indicated greater impulsivity in the CD group when compared with the MC group. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Temporal Discounting When the Choice Is Between Two Delayed Rewards.

The present experiments extend the temporal discounting paradigm from choice between an immediate and a delayed reward to choice between 2 delayed rewards: a smaller amount of money available sooner and a larger amount available later. Across different amounts and delays, the data were consistently well described by a hyperbola-like discounting function, and the degree of discounting decreased systematically as the delay to the sooner reward increased. Three theoretical models (the elimination-by-aspects, present-value comparison, and common-aspect attenuation hypotheses) were evaluated. The best account of the data was provided by the common-aspect attenuation hypothesis, according to which the common aspect of the choice alternatives (i.e., the time until the sooner reward is available) receives less weight in the decision-making process. (PsycINFO Database Record (c) 2010 APA, all rights reserved)