Unblocking in Pavlovian appetitive conditioning.

Two experiments, with 280 Sprague-Dawley rats, demonstrated unblocking in an appetitive conditioning preparation. One stimulus, A, was first paired with either a low-value reinforcer (1 food pellet) or a high-value reinforcer (1 food pellet followed by 2 more food pellets). A 2nd stimulus, X, was then added to A, and the compound was reinforced with either the high- or low-value reinforcer. Conditioning to X was blocked if the same reinforcer was used in both phases of the experiment, but there was substantial conditioning to X when the reinforcer value was shifted either up or down when X was introduced. Exp I demonstrated this unblocking phenomenon using a design that minimized the potential contribution of generalization decrement. Exp II examined the effects of a variety of posttraining manipulations on conditioned responding to the added X cue after unblocking procedures. Among Ss that received downshifts in reinforcer value when X was introduced, responding was affected by several posttraining manipulations, including changes in context value. Those manipulations had smaller effects on the responding of Ss that received upshifts in reinforcer value and no effects on responding in control conditions. Findings are considered in relation to the model of conditioning outlined by R. A. Rescorla and A. R. Wagner (1972). (40 ref) (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Superordinate categorization via learned stimulus equivalence: Quantity of reinforcement, hedonic value, and the nature of the mediator.

Three experiments examined superordinate categorization via stimulus equivalence training in pigeons. Experiment 1 established superordinate categories by association with a common number of food pellet reinforcers, plus it established generalization to novel photographic stimuli. Experiment 2 documented generalization of choice responding from stimuli signaling different numbers of food pellets to stimuli signaling different delays to food reinforcement. Experiment 3 indicated that different numbers of food pellets did not substitute as discriminative stimuli for the photographic stimuli with which the food pellets had been paired. The collective results suggest that the effective mediator of superordinate categories that are established via learned stimulus equivalence is not likely to be an accurate representation of the reinforcer, neither is it likely to be a distinctive response that is made to the discriminative stimulus. Motivational or emotional mediation is a more likely account. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Reinforcement contrast effects in rats following experimental definition of a dimension of reinforcement magnitude.

Administered magazine training in 2 experiments to female albino Sprague-Dawley rats under 1 of 3 basic conditions: a 3,000-Hz tone followed by (a) 1 food pellet, (b) 10 food pellets, or (c) a quasi-random mixture of both 1 and 10 food pellets. Ss then learned to press a lever for either a 1-pellet or a 10-pellet reward. Results reveal significant and long-lasting negative-reinforcement contrast. When Ss pressed for 1 pellet after a mixed 1-and-10 pellet pattern during magazine training, they learned to lever-press more slowly than if they had been magazine trained with just the 1-pellet reward. Data do not show positive contrast, however. Results suggest that rats may form "abstractions" about patterns of reinforcing events to which a given reinforcer is compared when it is used to facilitate the acquisition of a new response. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Intertrial interval as a contextual stimulus: Further analysis of a novel asymmetry in temporal discrimination learning.

Four experiments investigated discrimination learning when the duration of the intertrial interval (ITI) signaled whether or not the next conditional stimulus (CS) would be paired with food pellets. Rats received presentations of a 10-s CS separated half the time by long ITIs and half the time by short ITIs. When the long ITI signaled that the CS would be reinforced and the short interval signaled that it would not be (Long+/Short?), rats learned the discrimination readily. However, when the short ITI signaled that the CS would be reinforced and the long interval signaled that it would not (Short+/Long?), discrimination learning was much slower. Experiment 1 compared Long+/Short? and Short+/Long? discrimination learning with 16-min/4-min or 4-min/1-min ITI combinations. Experiment 2 found no evidence that Short+/Long? learning is inferior because the temporal cue corresponding to the short interval is ambiguous. Experiment 3 found no evidence that Short+/Long? learning is poor because the end of a long ITI signals a substantial reduction in delay to the next reinforcer. Long+/Short? learning may be faster than Short+/Long?because elapsing time involves exposure to a sequence of hypothetical stimulus elements (e.g., A then B), and feature-positive discriminations (AB+/A?) are learned quicker than feature-negative discriminations (A+/AB?). Consistent with this view, Experiment 4 found a robust feature-positive effect when sequentially presented CSs played the role of elements A and B. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Motivational control of blocking.

Hungry and thirsty rats lever pressed for food pellets in 1 visual stimulus (V1) and for a saline solution in another stimulus (V2). In a 2nd phase, the rats were made either hungry or thirsty and pressed for a starch solution in 2 stimulus compounds, each containing 1 of the visual cues and an auditory cue, that is, V1A1 and V2A2. On test, rats responded less to A1 than to A2 when hungry but less to A2 than to A1 when thirsty. Two further experiments replicated this selective blocking effect when the rats were both hungry and thirsty during Phase 2 and demonstrated that the magnitude of blocking was comparable to that observed when the reinforcer identity was held constant across the 2 phases. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

Investigating the devaluation explanation for negative anticipatory contrast.

This study addressed whether negative anticipatory contrast results in a decrease in the value of the low-valued substance. Rats responded in training conditions designed to produce negative contrast. They then responded in test sessions in which the low-valued substance from the training sessions was the reinforcer for an operant response. Despite the finding of contrast in the training conditions, the low-valued substance was a more effective reinforcer early in testing after training conditions in which it had been followed by access to the high-valued substance than after training conditions in which it had not. The findings question the devaluation explanation for contrast but may be similar to other findings of reversals of "preference." (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

Context conditional flavor preferences in the rat based on fructose and maltodextrin reinforcers.

In three experiments, rats were exposed to a flavor preference procedure in which flavor A was paired with the reinforcer and flavor B presented alone in Context 1, while in Context 2 flavor A was presented alone and flavor B with the reinforcer. With fructose as the reinforcer both two- and one-bottle training procedures produced a context-dependent preference (Experiments 1 and 2). With maltodextrin as the reinforcer two-bottle training produced a context-dependent preference (Experiment 1). Following one-bottle training with maltodextrin reinforcement rats demonstrated a context-dependent preference when the conditioned stimulus (CS)- was presented with a dilute solution of the reinforcer during training (Experiment 3B) but not when the CS- was presented alone (Experiments 2 and 3A). The pattern of results with maltodextrin reinforcement suggests that there was competition between the cue flavors and the taste of the maltodextrin as predictors of the postingestive consequences of the maltodextrin reinforcer. The fact that rats were able to display context-dependent flavor preferences is consistent with the idea that learned flavor preferences rely on the sort of cue-consequence associations that underpin other forms of conditioning which produce accurate performance on biconditional tasks. The differences between fructose- and maltodextrin-based preferences are discussed in terms of configural and elemental learning processes. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Selective associations produced solely with appetitive contingencies: the stimulus-reinforcer interaction revisited

In studies reporting stimulus-reinforcer interactions in traditional conditioning paradigms, when a tone-light compound was associated with food the light gained stimulus control, but when the compound was paired with shock avoidance the tone gained control. However, the physical nature of the reinforcer-related events (food vs. shock) presented in the presence of the tone-light compound was always confounded with the conditioned hedonic value of the compound's presence relative to its absence. When the compound was paired with shock, its presence was negative relative to its absence (which was shock-free). In contrast, when the compound was paired with food, its presence was positive relative to its absence (which was food-free). The present experiment dealt with this confounding effect by conditioning a tone-light compound to be positive or negative, relative to its absence, solely with food reinforcement. One group of rats received food for responding in the presence of the tone-light compound and no food in its absence. The other group also responded in the presence of the compound, but received food only in its absence. These rats were trained on a chained schedule in which responding in the presence of the tone-light compound produced a terminal link signaled by the absence of the compound; responding ceased in the terminal link because it delayed food delivery. In a test session to assess stimulus control by the elements of the compound, tone and light were presented separately under extinction conditions. Rats that had been exposed to a positive correlation between food and the compound emitted almost double the responses in the presence of the light as in the presence of the tone. In comparison, rats that had been exposed to a negative correlation emitted only two thirds as many responses in the presence of the light as in the presence of the tone. Because this selective association was produced using only food, it appears that the contingencies under which a reinforcer is presented, rather than (or as well as) its physical properties, can generate the selective associations previously attributed to "stimulus-reinforcer interactions." This could mean that regardless of the class of reinforcer that ultimately maintains responding (appetitive or aversive), the contingency-generated hedonic value of the compound stimulus may influence the dominant modality of stimulus control.     

Response–reinforcer versus stimulus–reinforcer pretraining influences S+ versus S– discriminative control.

In 2 experiments, 60 male Long-Evans rats trained on a visual discrimination task (leverpresses reinforced) received stimulus–reinforcer (noise–food) trials, no training, or response–reinforcer (reinforcement of keypressing) training. Ss then learned an auditory discrimination (keypresses reinforced), in which the positive stimulus (S+) was a noise (N) and the negative stimulus (S–) was a tone (T). Noise–food training resulted in the greatest enhancement of leverpressing on N trials and the least suppression on T trials during a summation test. Prior training of keypress responses produced the opposite pattern of results. Findings are interpreted as reflecting the operation of the combination laws that R. A. Rescorla and A. R. Wagner (1972) proposed to account for intracompound dynamics in classical conditioning. (36 ref) (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

Aftereffects of the surprising presentation and omission of appetitive reinforcers on key-pecking performance in pigeons.

The reinforcement-omission effect (ROE), also known as frustration effect, refers to greater response strength immediately after nonreinforcement (N) than reinforcement (R). The ROE was traditionally interpreted as transient invigoration after N induced by primary frustration. Pigeons demonstrate similar ROEs whether outcomes are surprising (partial R) or expected (discrimination training) in runway (Experiment 1) and Skinner box situations (Experiments 2-3). Variations in the interval between N and the opportunity to respond indicate that the ROE results from an aftereffect of food consumption (Experiment 4). Increasing reinforcer magnitude increased the after-R effect, without modifying the after-N function (Experiment 5). These results are reviewed in the context of comparative research on spaced-trial successive negative contrast and related phenomena that have failed to appear in experiments involving nonmammalian vertebrates. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Amount of training and cue-evoked taste-reactivity responding in reinforcer devaluation.

In two experiments, rats received minimal (16) pairings of one auditory conditioned stimulus (CS) cue with a sucrose reinforcer, and extensive (112) pairings of another auditory CS with that reinforcer. After sucrose was devalued by pairing it with lithium chloride in some rats (Devalue groups) but not others (Maintain groups), taste reactivity (TR) and other responses to unflavored water were assessed in the presence of the auditory CSs alone. The minimally trained CS controlled substantially more evaluative TR responses than the extensively trained CS. Those TR responses were hedonic (positive) in the Maintain groups, but aversive (negative) in the Devalue groups. By contrast, food cup entry and other responses thought not to reflect evaluative taste processing were controlled more by the extensively trained cue. These responses were reduced by sucrose devaluation comparably, regardless of the amount of training. The results suggest rapid changes in the content of learning as conditioning proceeds. Early in training, CSs may be capable of activating preevaluative processing of an absent food reinforcer that includes information about its palatability, but that capability is lost as training proceeds. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Alteration of classically conditioned heart rate by operant reinforcement in monkeys.

Ran 6 adolescent male rhesus monkeys alternately on classical conditioning and on operant heart rate training schedules. The classical unconditioned stimulus (UCS) was identical to the operant negative reinforcement. After operant training, some Ss changed their heart rate responses to the classical conditioned stimulus (CS). When both the operant and the classical schedules were in force simultaneously, all Ss changed their previous heart rate responses to the classical CS without significantly changing their blood pressure responses to this stimulus. The changes in heart rate response to the CS sometimes persisted long after the operant schedules were no longer in force. These results show that a classically conditioned response can be altered by operant reinforcement, and they suggest that the classical UCS actually may be an operant reinforcer. (29 ref) (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Motivational Control of Second-Order Conditioning.

Two experiments examined the motivational specificity of the associations that support 2nd-order conditioning. In the 1st phase of each experiment rats were exposed to 2 visual conditioned stimuli (CSs) paired with either a saline or food pellet unconditioned stimulus (US) prior to exposure to 2nd-order conditioning using 2 auditory CSs, 1 paired with each visual CS. Rats' motivational state was then shifted prior to a test such that if and only if specific motivational features of the 1st-order training US played a role in the 2nd-order associative structure would responding to the 2nd-order cues shift appropriately with the state change. Even when the US was irrelevant to the training motivational state, shifts in state revealed that it was encoded within the associative structure supporting 2nd-order responding. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Examination of bilateral eyeblink conditioning in rats.

This experiment monitored eyelid responses bilaterally during delay eyeblink conditioning in rats. Rats were given paired or unpaired training with a tone or light conditioned stimulus (CS) and a unilateral periorbital shock unconditioned stimulus (US). Rats given paired training acquired high levels of conditioned responses (CRs), which occurred in both eyelids. However, acquisition was faster, and the overall percentage of CRs was greater in the eyelid that was ipsilateral to the US. CRs in the eyelid ipsilateral to the US also had shorter onset latencies and larger amplitudes than CRs in the contralateral eyelid. Both eyelids consistently showed high percentages of unconditioned responses (UR) to the US, and the UR amplitude decreased across training sessions in the paired group. The present study demonstrated that CRs occur robustly in both eyelids of rats given eyeblink conditioning, which is similar to previous findings in humans and monkeys. The results also showed that conditioning occurs more prominently in the eyelid that is ipsilateral to the US, which is similar to previous findings in humans, monkeys, dogs, and rabbits. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Reinforcer devaluation in palatability-based learned flavor preferences.

Rats exposed to simultaneous compounds of 1 neutral flavor with dilute (2%) sucrose and a 2nd flavor with dilute (2%) maltodextrin subsequently consumed both flavors in preference to a 3rd flavor that was never paired with a palatable taste. Brief training exposure under ad lib food and water minimized the postingestive effects of nutrients, emphasizing the contribution of palatability to these preferences. Devaluation of sucrose or maltodextrin by pairing with illness (Experiment 1) or sensory-specific satiety (Experiment 2) selectively reduced the preference for the flavor previously paired with the devalued reinforcer. Such reinforcer-specific devaluation effects suggest that palatability-based learned flavor preferences are underpinned by a Pavlovian process whereby the cue flavor is associated with the taste of the concurrently consumed palatable reinforcer. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Instrumental performance following a shift in primary motivation depends on incentive learning.

In 5 experiments the role of incentive learning in instrumental performance following a shift in primary motivation was examined. In Exps 1 and 2, rats trained to perform an instrumental action reinforced by either pellets or maltodextrin when in a low-deprivation state were shifted to a high-deprivation state and tested in extinction. This shift in deprivation increased performance only if the animals had been exposed to the reinforcer in the high deprivation state prior to instrumental training. Exps 3, 4, and 5 examined the reverse, shift training in a high-deprivation state and testing in a low-deprivation state, and found, similarly, that performance was only sensitive to this shift if animals were previously exposed to the reinforcer while in the low-deprivation state. These experiments support the conclusion that instrumental performance following revaluation of the reinforcer depends on a process of incentive learning. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Involvement of retrosplenial cortex in forming associations between multiple sensory stimuli.

The retrosplenial cortex (RSP) is highly interconnected with medial temporal lobe structures, yet relatively little is known about its specific contributions to learning and memory. One possibility is that RSP is involved in forming associations between multiple sensory stimuli. Indeed, damage to RSP disrupts learning about spatial or contextual cues and also impairs learning about co-occurring conditioned stimuli (CSs). Two experiments were conducted to test this notion more rigorously. In Experiment 1, rats were trained in a serial feature negative discrimination task consisting of reinforced presentations of a tone alone and nonreinforced serial presentations of a light followed by the tone. Thus, in contrast to prior studies, this paradigm involved serial presentation of conditioned stimuli (CS), rather than simultaneous presentation. Rats with damage to RSP failed to acquire the discrimination, indicating that RSP is required for forming associations between sensory stimuli regardless of whether they occur serially or simultaneously. In Experiment 2, a sensory preconditioning task was used to determine if RSP was necessary for forming associations between stimuli even in the absence of reinforcement. During the first phase of this procedure, one auditory stimulus was paired with a light while a second auditory stimulus was presented alone. In the next phase of training, the same light was paired with food. During the final phase of the procedure both auditory stimuli were presented alone during a single session. Control, but not RSP-lesioned rats, exhibited more food cup behavior following presentation of the auditory cue that was previously paired with light compared with the unpaired auditory stimulus, indicating that a stimulus-stimulus association was formed during the first phase of training. These results support the idea that RSP has a fundamental role in forming associations between environmental stimuli. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

Acquisition of conditional associations and operant delayed spatial response alternation: Effects of lesions in the medial prefrontal cortex.

8 male rats received bilateral lesions of the medial prefrontal cortex, another 8 rats were control operated. Three weeks after surgery, they were exposed to an autoshaping procedure in which the insertion of a lever into the experimental chamber (conditioned stimulus) always preceded the delivery of a response-independent food pellet (unconditioned stimulus). Ss with lesions acquired this conditional association faster than control. Ss as evidenced by the fact that they were more likely than control Ss to contact the conditioned stimulus at higher rates. Locomotor activity, observed in a standard open-field preceding autoshaping sessions, decreased for both groups of Ss with repeated exposure to the open-field, whereas differences between groups were not observed. Ss were also exposed to an operant delayed spatial response alternation procedure in which they were required to alternate responding between two levers that were inserted into the experimental chamber after delay intervals of either 5, 10, or 20 s had elapsed. Alternation response accuracy of Ss with lesions and control Ss decreased as a function of the duration of the delay interval, but control-operated Ss responded more accurately at each interval duration. Response accuracy increased with prolonged training for both groups of Ss, but faster for control than for Ss with lesions. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Combining CSs associated with the same or different USs

In three experiments, hungry rats received appetitive training with four stimuli, A, B, X, and Y. In each Experiment, A and B were paired with one unconditioned stimulus (US; e.g. food pellets) whereas X and Y were paired with a second US (e.g. sucrose). Subsequently, rats responded more vigorously to combinations of stimuli associated with different USs (A-Y & X-B) than to combinations of stimuli associated with the same US (A-B & X-Y; Experiments 1, 2, & 3). This effect was observed when the stimuli were presented simultaneously and during the second elements of serial compounds (Experiments 2 & 3). Moreover, combining CSs associated with different USs resulted in a more marked CR than combining CSs that had each been paired with both US1 and US2 (Experiment 3). These results suggest that the sensory properties of appetitive reinforcers have an important influence on performance.     

Appetitive memory restoration after electroconvulsive shock in the rat.

Previous studies have demonstrated that noncontingent aversive stimulation can produce recovery from amnesia induced by electroconvulsive shock (ECS) for passive avoidance training. The present 2 experiments with a total of 120 male albino Sprague-Dawley rats examined the stimulus characteristics necessary to restore appetitive memory after ECS. In a 1-trial appetitive task, posttraining ECS proved to be an effective amnestic agent. Memory was restored by (a) 1 60-sec exposure to the appetitive reinforcer outside of the training situation and (b) 3 135-sec exposures to the training apparatus in the absence of the reinforcer. These results indicate that the "reminder effect" is not a consequence of generalization of learning that occurs during the reminder treatment. Data suggest that stimuli specific to the training situation are potential agents for reversing experimental amnesia. It is concluded that this class of recovery agents is better characterized as reminders than as stressors. A mechanism for recovery from experimental amnesia is proposed. (17 ref) (PsycINFO Database Record (c) 2010 APA, all rights reserved)