Presence/absence-sample matching by pigeons: Divergent retention functions may result from the similarity of behavior during the absence sample and the retention interval.

Divergent choose-absence retention functions typically found in pigeons following presence/absence-sample matching have been attributed to the development of a single-code/default coding strategy. However, such effects may result from adventitious differential responding to the samples. In Experiment 1, retention functions were divergent only when differential sample responding could serve as the basis for comparison choice. In Experiment 2, when pecking did not occur during the retention interval, a choose-absence bias was found, but when pecking occurred during the retention interval, a choose-presence bias resulted. In Experiment 3, positive transfer was found when a stimulus associated with the absence of pecking replaced the absence sample but not when a stimulus associated with pecking replaced the presence sample. Thus, presence/absence-sample matching may not encourage the development of a single-code/default coding strategy in pigeons. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Importance of trials versus accumulating time across trials in partially reinforced appetitive conditioning.

Four experiments with rats examined partial reinforcement in appetitive conditioning. In Experiment 1, adding nonreinforced trials to a continuous reinforcement schedule slowed acquisition, whereas deleting reinforcers did not. Trial massing suppressed performance and learning. In Experiment 2, conditioning with a short conditioned stimulus (CS) was rapid, and partial reinforcement with a short CS was as effective as continuous reinforcement with equal accumulated time in the CS. In Experiment 3, conditioning was nevertheless influenced by the probability of reinforcement. In Experiments 3 and 4, conditioning was especially disrupted when nonreinforced trials preceded reinforced trials closely in time. The results underscore the importance of temporal variables in conditioning but are more consistent with trial-based accounts than time-accumulation accounts of conditioning. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Noncontingent brain stimulation enhancement of reward value of a conditioned stimulus associated with rewarding brain stimulation.

Tested the hypothesis that the difficulty of demonstrating secondary reinforcement using brain stimulation as a primary reward may be due to the absence of stimulation-induced motivational conditions during testing. 7 Sprague-Dawley albino rats were conditioned to make a response for a CS plus brain stimulation, then were extinguished. This was repeated 4 times with different extinction conditions (response yields CS or does not, with or without noncontingent brain stimulation). Results support the hypothesis. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Mechanisms underlying the effects of unsignaled delayed reinforcement on key pecking of pigeons under variable-interval schedules

Three experiments were conducted to test an interpretation of the response-rate-reducing effects of unsignaled nonresetting delays to reinforcement in pigeons. According to this interpretation, rates of key pecking decrease under these conditions because key pecks alternate with hopper-observing behavior. In Experiment 1, 4 pigeons pecked a food key that raised the hopper provided that pecks on a different variable-interval-schedule key met the requirements of a variable-interval 60-s schedule. The stimuli associated with the availability of the hopper (i.e., houselight and keylight off, food key illuminated, feedback following food-key pecks) were gradually removed across phases while the dependent relation between hopper availability and variable-interval-schedule key pecks was maintained. Rates of pecking the variable-interval-schedule key decreased to low levels and rates of food-key pecks increased when variable-interval-schedule key pecks did not produce hopper-correlated stimuli. In Experiment 2, pigeons initially pecked a single key under a variable-interval 60-s schedule. Then the dependent relation between hopper presentation and key pecks was eliminated by arranging a variable-time 60-s schedule. When rates of pecking had decreased to low levels, conditions were changed so that pecks during the final 5 s of each interval changed the keylight color from green to amber. When pecking produced these hopper-correlated stimuli, pecking occurred at high rates, despite the absence of a peck-food dependency. When peck-produced changes in keylight color were uncorrelated with food, rates of pecking fell to low levels. In Experiment 3, details (obtained delays, interresponse-time distributions, eating times) of the transition from high to low response rates produced by the introduction of a 3-s unsignaled delay were tracked from session to session in 3 pigeons that had been initially trained to peck under a conventional variable-interval 60-s schedule. Decreases in response rates soon after the transition to delayed reinforcement were accompanied by decreases in eating times and alterations in interresponse-time distributions. As response rates decreased and became stable, eating times increased and their variability decreased. These findings support an interpretation of the effects of delayed reinforcement that emphasizes the importance of hopper-observing behavior.     

Context reinforcement degrades discriminative control: A memory approach.

This study measured effects of context reinforcement on a visual discrimination. Five pigeons responded to 1 key in the presence of 6 shorter wavelengths and to another key for 6 longer wavelengths. Psychometric functions provided measures of discriminative sensitivity (d') and overall stimulus control. Sensitivity and control were slightly but significantly better when 20% of correct choices yielded reinforcement than when 5% did. Reinforcement of pecks to the sample stimulus reduced control substantially and sensitivity slightly; noncontingent reinforcement during intertrial intervals also reduced control, whether such reinforcement was signaled or not. Accuracy was excellent during an extinction session, but it fell substantially when reinforcement for sample pecks was added during choice extinction. Simulations based on a memory model of the discrimination process reproduced most of the experimental findings. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Attenuation and enhancement of instrumental responding by signals for reinforcement on a variable interval schedule.

In three experiments we used pigeons responding on a variable interval schedule to examine the effects of signaling reinforcement on instrumental performance. Using a four-component multiple schedule, we found in Experiment 1 that when reinforcement was delayed by 0.5 s for two of the components, response rates were attenuated by signaling reinforcement relative to performance in the unsignaled delay condition. A delay of 3 s in the remaining two components resulted in an enhancement of responding when the delay was signaled. An enhancement of responding occurred when we used a scheduled 0.5-s delay when the procedure ensured that responding was prevented during the delay interval by extinguishing the keylight (Experiment 2) or by resetting the delay timer when responses were emitted during the delay (Experiment 3). These results are discussed with reference to the theories of signaling reinforcement during instrumental responding. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Duration of signals for intertrial reinforcement and nonreinforcement in random control procedures.

In the random control procedure, responding to a conditioned stimulus (target CS) is prevented when the probability of unsignaled, unconditioned stimuli (UCS) in the intertrial interval (ITI) is equal to the probability of the UCS in the presence of the target CS. Three experiments used an autoshaping procedure with White Carneaux pigeons to examine the effects of the temporal duration of signals for the ITI UCS (cover CSs) and for concomitant periods of nonreinforcement. In Experiment 1, a short duration cover, but not a long duration cover, resulted in responding to the target CS. In Experiment 2, an explicit CS– cue during periods of nonreinforcement did not affect target acquisition. In Experiment 3, a long CS–, but not a short cover CS, was a sufficient condition for the acquisition of responding to the target CS. These results imply that the acquisition of responding to a target CS requires a discriminable period of nonreinforcement that is long relative to the target CS duration. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Disinhibition and spontaneous recovery of response decrements produced by free reinforcement in rats.

Conducted 3 experiments with a total of 16 Holtzman albino and 48 hooded male rats. After the Ss had been trained to barpress on a variable interval schedule of reinforcement, response rates were reduced by the introduction either of extinction or of a response-independent (free) reinforcement schedule. Spontaneous recovery was consistently obtained in extinction, especially when session durations were long. Under free reinforcement conditions there was little sign of spontaneous recovery, even when with high reinforcement rates response reduction was almost as rapid as in extinction. In disinhibition tests the introduction of noise produced increased responding under free reinforcement conditions but not in extinction. Results are interpreted as demonstrating a dissociation between spontaneous recovery and disinhibition. (23 ref) (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Acquisition, maintenance and reinstatement of intravenous cocaine self-administration under a second-order schedule of reinforcement in rats: effects of conditioned cues and continuous access to cocaine

Second order schedules of IV cocaine reinforcement in rats provide a reliable method for evaluating the effects of conditioned stimuli on cocaine-seeking behaviour, and for measuring the motivational aspects of cocaine reinforcement. In the procedure established here, each infusion of cocaine (0.25 mg/infusion) was initially made contingent on a lever press and was paired with a 20-s light conditioned stimulus (CS). When rats acquired stable rates of cocaine self-administration, the response requirement for cocaine was increased progressively to a second-order schedule of the type FI15 min(FR10:S), whereby the IV cocaine infusion was self-administered following the completion of the first FR10 responses (and CS presentation) after a 15-min fixed interval (FI) had elapsed. Evaluation of the animals' responding during the first, drug-free interval of each daily session provided a measure of cocaine-seeking behaviour, independent of other pharmacological effects of the self-administered drug. Thus, a dose-response study (dose range: 0.083, 0.25 and 0.50 mg/infusion) revealed that responding under this schedule during the initial, drug-free interval changed monotonically with dose, whereas an inverse relationship between cocaine dose and response level tended to appear during the rest of the session, after rats had self-administered the drug. Responding under this schedule was also shown to occur under the control of the CS, which had acquired conditioned reinforcing properties. Thus, a decrease in responding and an increase in the latency to initiate responding followed the omission of the CS for 3 consecutive days. In addition, extinction of cocaine-seeking behaviour was slower when contingent CS presentations occurred compared to extinction when the CS was not present. Furthermore, the reinstatement of responding for cocaine, which followed a brief period of non-contingent CS presentations, was retarded when this conditioned reinforcer had been extinguished together with cocaine. Finally, cocaine-seeking behaviour decreased markedly for the first 6 h that followed a 12-h period of continuous access to cocaine, when compared to responding 6 h after a 90-min session of limited access to the drug. Responding subsequently increased to baseline levels within 72 h. These results emphasise the utility of second-order schedules for studying drug-seeking behaviour and the importance of drug-associated cues in maintaining such responding for cocaine.     

Reinforced variability and operant learning.

Reinforcement of variability may help to explain operant learning. Three groups of rats were reinforced, in different phases, whenever the following target sequences of left (L) and right (R) lever presses occurred: LR, RLL, LLR, RRLR, RLLRL, and in Experiment 2, LLRRL. One group (variability [VAR]) was concurrently reinforced once per minute for sequence variations, a second group also once per minute but independently of variations, that is, for any sequences (ANY), and a control group (CON) received no additional reinforcers. The 3 groups learned the easiest targets equally. For the most difficult targets, CON animals' responding extinguished whereas both VAR and ANY responded at high rates. Only the VAR animals learned, however. Thus, concurrent reinforcers—contingent on variability or not—helped to maintain responding when difficult sequences were reinforced, but learning those sequences depended on reinforcement of variations. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Environmental and pharmacological factors in the development of noncontingent tolerance to cocaine in pigeons.

Previous research with rats and monkeys has shown that tolerance to behavioral effects of cocaine developed if the drug was administered before behavioral test sessions but not if it was administered after sessions, a finding known as contingent tolerance. In contrast, a recent experiment using pigeons found that they showed tolerance resulting from postsession drug administration (noncontingent tolerance). The 4 experiments reported in this article were conducted to examine that result more fully. Experiment 1 found that immediate presession administration of cocaine to pigeons reliably led to tolerance to effects on food-reinforced operant key pecking and that immediate postsession administration of cocaine also led to tolerance in half the subjects, those whose key pecking was not suppressed by postsession dosing. Experiment 2 showed that eating in the home cage under the effects of postsession cocaine was not necessary for tolerance to develop to effects of postsession cocaine and that the majority of subjects developed tolerance from postsession cocaine administration. Experiment 3 found that mere drug exposure in the home cage without exposure to an experimental session did not reliably produce tolerance during the behavioral session. Experiment 4 showed that tolerance from postsession cocaine administration could be observed even when daily dosing was discontinued during dose–response curve assessment. Therefore, the combined results showed that pigeons often developed tolerance to effects of cocaine during the behavioral session when cocaine was administered postsession and that this tolerance was not the result of feeding under effects of the drug. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Effect of a stimulus intervening between CS and US in autoshaping.

Five experiments explored the effect of placing a stimulus between the termination of a key light (CS) and the onset of a food (UCS) with female Carneaux pigeons in an autoshaping preparation. Whether that stimulus was itself a key light evoking pecking or an auditory event failing to evoke pecking, it facilitated performance to the CS. The use of a within-Ss design made differential conditioning of background cues and stimulus generalization unlikely accounts. Exp III found that extinction of the intervening stimulus did not remove the facilitative effect. Exp IV found that pairing the CS with food and the intervening stimulus did not produce the effect unless both occurred on the same trial. Together, these experiments rule out an account in terms of 2nd-order conditioning of the CS by the intervening stimulus. Exp V used an intervening stimulus in a 2nd-order conditioning design to demonstrate that the stimulus acted to improve the association between the CS and the reinforcer. Results document a kind of catalytic effect of the intervening stimulus on the CS-reinforcer association. (23 ref) (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Effects of contingency violations on the extinction of a conditioned fear inhibitor and a conditioned fear excitor.

In 4 experiments, 192 male Holtzman and Sprague-Dawley rats were used in a conditioned-suppression paradigm to assess the effects of contingency variations on responding to a conditioned stimulus (CS) inhibitor (CS–) and a conditioned stimulus excitor (CS+). In Exp I, various unconditioned stimulus/stimuli (UCS) frequencies were equated across the presence and absence of a CS– in the context of either background cues (continuous-trial procedure) or an explicit neutral event (discrete-trial procedure). With both procedures, a CS-alone treatment enhanced inhibition, whereas treatments involving 50 or 100% reinforcement for the CS– eliminated inhibition without conditioning excitation to that CS. The latter outcome also occurred in Exp II, with discrete-trial training equating considerably reduced UCS frequencies for the presence and absence of the CS–. In further evidence that inhibition was eliminated without conditioning excitation to the CS–, Exp III showed that a novel CS did not acquire excitation when 25, 50, or 100% reinforcement was equated across the presence and absence of that CS in the context of a discrete-trial event. Using the procedures of Exp I, Exp IV showed that a CS+ was extinguished by a CS-alone treatment but was substantially maintained by treatments involving 50 or 100% uncorrelated reinforcement. These effects for a CS+ and a CS– implicate CS–UCS contiguity, rather than contingency, as the factor determining the extinction of a CS. (33 ref) (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Spontaneous recovery and dishabituation of ethanol-reinforced responding in alcohol-preferring rats.

This study examined whether habituation, a decrease in responsiveness to a repeatedly presented stimulus, occurs to ethanol reinforcers in alcohol-preferring (P) rats. Three fundamental properties of habituation were evaluated: generality, spontaneous recovery, and dishabituation. In each experiment, P rats' lever pressing was reinforced by 10% ethanol on a variable-interval 15-s schedule during 50-min sessions. Experiment 1 evaluated the generality of habituation to repeatedly presented stimuli by using ethanol and water reinforcers. Rates of responding were higher for ethanol than they were for water. Additionally, the within-session patterns of responding differed for each reinforcer, suggesting that the pattern of responding was specific to the exact nature of the repeatedly presented reinforcer. Experiment 2 examined spontaneous recovery, an increase in responsiveness to a habituated stimulus when that stimulus is not presented for a time, by separating experimental sessions by 5 min, 2 hr, or 24 hr. Early-session rates of responding during Session 2 were slower than the corresponding rates during Session 1 when sessions were separated by 5 min or 2 hr. Response rates and within-session patterns of responding during Sessions 1 and 2 were similar when sessions were separated by 24 hr. Experiment 3 tested for dishabituation, a restoration of responsiveness following the presentation of an extraneous stimulus, by presenting a tone or a light 24 min and 55 s into the session. Rates of responding temporarily increased after the tone was presented. The results of these experiments support the idea that habituation contributes to the regulation of ethanol consumption. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Apparatus Exposure Produces Profound Declines in Conditioned Nictitating-Membrane Responses to Discrete Conditioned Stimuli by the Rabbit (Oryctolagus cuniculus).

The present experiments demonstrated that in the rabbit (Oryctolagus cuniculus) nictitacing-membrane (NM) preparation, exposure to the experimental apparatus produces profound declines in conditioned responding to a discrete conditioned stimulus (CS; Experiments 1, 2A, and 3). Moreover, this decremental effect is at most attenuated in only a minor way when the unconditioned stimulus (US) is presented during exposure to the apparatus (Experiment 2B). Controls for retention loss (Experiments 1 and 3) and for handling and placement in a different context (Experiment 3) did not produce significant declines in responding. These findings challenge theories of extinction that rely primarily on context-US associations but are more consistent with theories that assume context-CS-US associations. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

The role of the rat hippocampal system in several effects of context in extinction.

The effect of fornix lesions on some effects of manipulating the context on performance in extinction were studied. In renewal, subjects' responding to an extinguished CS recovered when the CS was presented in the context in which it had been conditioned after extinction in a different context. In reinstatement, it recovered when the CS was tested after independent presentation of the unconditioned stimulus (UCS; an effect mediated by contextual conditioning.) In spontaneous recovery, it recovered after the passage of time, that is, when the CS was tested in a new temporal context. In the conditioned suppression method, fornix lesions had no effect on conditioning, extinction, renewal, or spontaneous recovery; however, they abolished the reinstatement effect. The results suggest that the hippocampal system may be important in the formation of context–UCS associations, but not in other types of learning about the context. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Response-independent events in the behavior stream

The metaphor of the behavior stream provides a framework for studying the effects of response-independent food presentations intruded into an environment in which operant responding of pigeons was maintained by variable-interval schedules. In the first two experiments, response rates were reduced when response-independent food was intruded during the variable-interval schedule according to a concomitantly present fixed-time schedule. These reductions were not always an orderly function of the percentage of response-dependent food. Negatively accelerated patterns of key pecking across the fixed-time period occurred in Experiment 1 under the concomitant fixed-time variable-interval schedules. In Experiment 2, positively and negatively accelerated and linear response patterns occurred even though the schedules were similar to those used in Experiment 1. The variable findings in the first two experiments led to three subsequent experiments that were designed to further illuminate the controlling variables of the effects of intruded response-independent events. When the fixed and variable schedules were correlated with distinct operanda by employing a concurrent fixed-interval variable-interval schedule (Experiment 3) or with distinct discriminative stimuli (Experiments 4 and 5), negatively accelerated response patterns were obtained. Even in these latter cases, however, the response patterns were a joint function of the physical separation of the two schedules and the ratio of fixed-time or fixed-interval to variable-interval schedule food presentations. The results of the five experiments are discussed in terms of the contributions of both reinforcement variables and discriminative stimuli in determining the effects of intruding response-independent food into a stream of operant behavior.     

Renewal and spontaneous recovery, but not latent inhibition, are mediated by gamma-aminobutyric acid in appetitive conditioning.

Previous research has reported a role for the neurotransmitter gamma-aminobutyric acid (GABA) in the extinction and renewal of conditioned fear. Here, the authors examine whether GABA is involved in the acquisition, extinction, renewal, spontaneous recovery, and latent inhibition of appetitive conditioning. Using Long-Evans rats, systemic injection of the GABA A receptor inverse agonist FG 7142 was shown to eliminate ABA renewal (Experiment 1) and spontaneous recovery (Experiment 4) of appetitive responding by selectively reducing the recovery of extinguished magazine approach. Furthermore, treatment with FG 7142 had no effects on acquisition or single-session extinction (Experiment 3) or on the context-specific expression of latent inhibition (Experiment 2). These data suggest that ABA renewal and spontaneous recovery, but not latent inhibition or responding during acquisition and an initial extinction session, are mediated by GABAergic mechanisms in appetitive Pavlovian conditioning. They provide support for the view that renewal and spontaneous recovery share a common psychological mechanism. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Using visual reinforcement to establish stimulus control of responding of Siamese fighting fish (Betta splendens).

Stimulus control of ring swimming was studied with male Siamese fighting fish (Betta splendens) using 2-component multiple schedules in which the components were correlated with the presence or absence of air bubbles in the water. In Experiment 1, either response-independent mirror presentations or extinction was juxtaposed with immediate response-dependent mirror presentations. Rates of ring swimming generally were higher with immediate reinforcement than with either response-independent mirror presentations or extinction. In Experiment 2, different durations of response-dependent mirror presentations were juxtaposed. Generally, higher rates of ring swimming occurred with 15-s than with 0-, 1-, or 3-s durations. Results demonstrate that stimulus control of responding can be established with these fish under several conditions of differential reinforcement. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

The effects of cocaine, amphetamine, and the dopamine D1 receptor agonist SKF 38393 on fear extinction as measured with potentiated startle: implications for psychomotor stimulant psychosis

Using Pavlovian conditioned increases in the amplitude of the acoustic startle reflex as a behavioral indicator of fear motivation, the authors previously showed a resistance to extinction after repeated associations of cocaine with the fear-evoking conditioned stimulus (CS). In Experiment 1, acute administration of cocaine, amphetamine, and the dopamine (DA) D1 receptor agonist SKF 38393 produced a similar fear enhancement. In Experiment 2, a noncontingent injection of cocaine and SKF 38393 provoked a CS potentiation of acoustic startle in fear-extinguished laboratory rats. Potential behavioral, neurochemical, and neuroendocrine explanations for the effects of psychomotor stimulants on conditional fear were discussed. It was suggested that DA agonist drugs increase fear expression possibly by activating mesoamygdaloid associative neurocircuitry involved in excitatory conditioned fear reactions.