Temporal context and conditioned reinforcement value.

The effectiveness of a stimulus as a conditioned reinforcer depends on the temporal context of reinforcement, that is, the overall rate of reinforcement in the situation. The dominant view has been that context determines the learned value of a stimulus directly, according to delay-reduction theory. By contrast, the contextual choice model (CCM) maintains that value is independent of context and incorporates the effects of context on choice in the framework of the matching law. The authors report 2 experiments with pigeons as subjects that use transfer tests to assess the value of stimuli in the concurrent-chains procedure. Results strongly support the assumption of CCM that pigeons learn the temporal relations between events independently of context but that context modulates the expression of that learning as choice. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Reward- and nonreward-produced stimuli and performance to patterned reinforcement in rats.

Ran 12 groups of 6 male Sprague-Dawley albino rats in a straight alley to assess the effect of bidirectional manipulation of length of successive nonrewarded trials. 2 N-length values were factorially manipulated from pre- to postshift training. To allow for the repeated measurement of postshift performance on test stimuli, postshift groups were further subdivided into intertrial repetition, delay, and reward conditions. Data demonstrate an N-length extinction phenomenon in the absence of any demonstrable effect of stimulus change per se. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Summation of reinforcement rates when conditioned stimuli are presented in compound.

Three experiments used delay conditioning of magazine approach in rats to examine the summation of responding when two conditioned stimuli (CSs) are presented together as a compound. The duration of each CS varied randomly from trial-to-trial around a mean that differed between the CSs. This meant that the rats' response rate to each CS was systematically related to the reinforcement rate of that CS, but remained steady as time elapsed during the CS (Harris & Carpenter, 2011; Harris, Gharaei, & Pincham, 2011). When the rats were presented with a compound of two CSs that had been conditioned separately, they responded more during the compound than during either of the CSs individually. More significantly, however, in all three experiments, the rats responded to the compound at the same rate as they responded to a third CS that had been reinforced at a rate equal to the sum of the reinforcement rates of the two CSs in compound. We discuss the implications of this finding for associative models (e.g., Rescorla & Wagner, 1972) and rate-based models (Gallistel & Gibbon, 2000) of conditioning. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

Memory for the conditioned response: The proactive effect of preexposure to potential conditioning stimuli and context change.

Three experiments with 48 cats investigated memory for CR as a function of proactive inhibition. The proactive operation was the preexposure to quasi-random presentations of the potential CS and UCS. The possible CSs were light and tone, and the UCSs were brief mild shocks to either the right or left paw, which produced a brisk leg jerk. In Exp I, all possible combinations of CS and UCS components of the eventual CR were present in the preexposure period for one or another group as in the traditional interference paradigms of human paired-associate memory research. Exp II demonstrated that the decline cannot be attributed to a strategy type of interpretation that asserts that when the retention–extinction situation occurs, Ss "backward scan" and judge themselves to be once again in the preexposure period. Performance immediately after reaching the conditioning criterion did not differ between the controls that experienced no preexposure and the experimentals, but it did so after the 10-wk retention interval. Exp III investigated the role of context in the memory deficits by maintaining the same context in the preexposure, conditioning, and memory test situations or giving the preexposure experience in an environment different from the other 2 situations. Context change greatly reduced but did not eliminate the proactive inhibition. It is concluded that the CR is readily forgotten given appropriate interference and does not differ from other kinds of learning in this respect. (27 ref) (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Discrimination behavior in the rat: Differential effects of reinforcement and nonreinforcement.

Gave information to a total of 12 male Sprague-Dawley albino rats in 3 experiments about the location of reinforcement and nonreinforcement. Ss then performed a discrimination task choosing among reinforced, nonreinforced, and a 3rd location. In all cases, avoidance of nonreinforcement was substantially greater than approach to reinforcement, indicating the crucial role of nonreinforcement in directing this discrimination behavior. Results of introducing a 50-min delay between information and discrimination trials and presenting other combinations of information confirm these conclusions. (23 ref.) (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Duration of signals for intertrial reinforcement and nonreinforcement in random control procedures.

In the random control procedure, responding to a conditioned stimulus (target CS) is prevented when the probability of unsignaled, unconditioned stimuli (UCS) in the intertrial interval (ITI) is equal to the probability of the UCS in the presence of the target CS. Three experiments used an autoshaping procedure with White Carneaux pigeons to examine the effects of the temporal duration of signals for the ITI UCS (cover CSs) and for concomitant periods of nonreinforcement. In Experiment 1, a short duration cover, but not a long duration cover, resulted in responding to the target CS. In Experiment 2, an explicit CS– cue during periods of nonreinforcement did not affect target acquisition. In Experiment 3, a long CS–, but not a short cover CS, was a sufficient condition for the acquisition of responding to the target CS. These results imply that the acquisition of responding to a target CS requires a discriminable period of nonreinforcement that is long relative to the target CS duration. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Evaluative conditioning in the picture–picture paradigm with random assignment of conditioned stimuli to unconditioned stimuli.

Human participants were allocated to 1 of 3 groups. In the conditioning group, each conditioned stimulus (CS)–unconditioned stimulus (UCS) pair was presented 7 times during the acquisition phase. Participants who were assigned to the extinction group saw 5 additional presentations of each CS in isolation after the 7 presentations of each CS–UCS pair. In the latent inhibition group, the CS-only trials were presented before the CS–UCS trials. Overall, a significant evaluative conditioning effect was observed. This effect cannot be dismissed on the basis of the arguments developed by A. P. Field and G. C. L. Davey (see records 1997-42912-009, 1998-11983-008, and 1999-10526-006), and the results thus provide strong evidence for the associative nature of evaluative conditioning. The results are also in line with other findings, which showed that evaluative conditioning is resistant to extinction. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Transfer of negative occasion setting and conditioned inhibition across conditioned and unconditioned stimuli.

The transfer of negative occasion setting and conditioned inhibition across conditioned stimuli (CSs) and unconditioned stimuli (USs) was examined in four experiments that used Pavlovian appetitive feature negative discrimination training procedures with rats. After training with simultaneous compounds (A+, XA–), X inhibited conditioned responding (CRs) elicited by other CSs and CRs supported by other appetitive USs that had not been involved in discrimination training. After training with serial compounds (A+, X→A–), X's power to set the occasion for nonresponding transferred across CSs and USs only if those events had also been involved in serial feature negative discrimination training. The results supported the suggestion that the acquisition of negative occasion setting involves the representation of individual events in a higher order memory system, separate from that involved in simple association, and that negative occasion setters act only on events that are represented in that system. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Dissociation of conditioned locomotion and Fos induction in response to stimuli formerly paired with cocaine.

A discrete stimulus (flashing light) was paired with cocaine (20 mg/kg) to induce conditioned locomotion. To identify brain regions activated during this response, Fos was measured with immunohistochemistry. Although paired subjects displayed robust conditioned locomotion, Fos was not increased in any limbic brain regions analyzed. In contrast, pairing of cocaine with generalized contextual cues (whole room) produced conditioned locomotion and Fos activation in the prelimbic portion of prefrontal cortex and the nucleus accumbens core. These results suggest that the pattern of neuronal activation during cocaine-conditioned activity differs depending on whether a discrete or contextual stimulus is used as a conditioned stimulus. The possibility that expectancy and frustrative nonreward contribute to Fos expression in rats conditioned to contextual cues is discussed. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Effects of suramin on neuroendocrine and behavioural responses to conditioned fear stimuli

Conditioned fear stimuli suppress motor activity. The fear stimuli suppress vasopressin and facilitate oxytocin and prolactin release. These fear responses are impaired by selective destruction of noradrenergic neurones. Adenosine 5'-triphosphate is co-released from noradrenergic nerve terminals with noradrenaline. Thus the possibility arises that the behavioural and neuroendocrine responses may be mediated by purinergic rather than noradrenergic synapses. We examined whether suramin, an inhibitor of P2 and NMDA receptors, blocks conditioned fear responses. Suramin injected i.c.v. 30 min before testing stimuli impaired conditioned fear responses. The role of purinergic P2 receptors in expression of the behavioural and neuroendocrine responses to conditioned fear stimuli is discussed.     

Pavlovian appetitive contingencies and approach versus withdrawal to conditioned stimuli in pigeons.

Investigated the directed skeletal movements of 21 female White Carneaux pigeons toward signals of food or no food in 3 experiments. Ss approached and pecked an illuminated key that was positively correlated with food delivery, and positioned themselves relatively far from an illuminated key that was negatively correlated with food delivery. Key illuminations alone, random presentations of key illuminations and food, and backward pairings of key illuminations and food did not produce keypecking or consistent approach-withdrawal. Therefore, directed skeletal behavior-often believed to be conditioned and maintained primarily or exclusively by operant procedures-also emerges on Pavlovian procedures. Several kinds of alternative explanations (e.g., conditioned reinforcement effects, and stimulus substitution) for these phenomena are considered, and some potential implications for operant discrimination learning are briefly explored. (17 ref) (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Effect of reinforcement on infants' performance in an auditory detection task.

Localization responses to octave-band noises with center frequencies at 400 and 4,000 Hz were obtained from 12-mo-old infants, first without reinforcement and with a 5-sec response interval and then with reinforcement and an unlimited response interval. The percentage of correct responses was substantially greater in the reinforced than in the nonreinforced condition. In Exp II, 12-mo-old Ss were tested in nonreinforced and reinforced sessions, as in Exp I, except that both sessions incorporated the 5-sec response interval. Again, performance was superior in the reinforced session. It is suggested that auditory detection techniques that omit reinforcement may be yielding attentional thresholds rather than thresholds of audibility. (11 ref) (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Persistence of conditioned flavor preferences is not due to inadvertent food reinforcement.

Almond preferences were produced by giving rats a mixture of almond and sucrose (Experiments 1-4) or saccharin (Experiment 4). A subsequent extinction procedure consisted of either repeated 2-bottle almond versus water tests (Experiment 1) or repeated exposure to almond alone (Experiments 2-4). The main independent variable was whether access to food following a session was given immediately, 30 min later, or 120 min later. No effect of extinction was found in any experiment. An important finding was that varying the delay until food access had no detectable effect. It was concluded that inadvertent flavor-food associations do not maintain preference for the flavor under extinction conditions. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Modulation of the acquisition of the rabbit eyeblink conditioned response by conditioned contextual stimuli.

Three experiments were conducted to ask if conditioned emotional responses (CERs) controlled by contextual cues modulate the acquisition of eyelid conditioned responses (CRs) to discrete conditioned stimuli (CSs). Experiment 1 showed that 30-s auditory stimuli that were paired with aversive shocks to one paraorbital region or the other controlled discriminated CERs, as measured by potentiation of a startle response. In Experiments 2 and 3, similarly trained 30-s stimuli served as contexts in which 1,050-ms CSs were paired with a paraorbital unconditioned stimulus (US). Reinforced contexts both impaired (Experiments 2A and 2B) and facilitated (Experiment 3B) acquisition of the eyeblink CR, depending on the locus of the USs involved. The data are consistent with the interpretation that CERs controlled by contextual cues facilitate CR acquisition, but do so in the face of blocking effects of CR tendencies also conditioned to the contextual cues. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

The observing-response procedure: A novel method to study drug-associated conditioned reinforcement.

In this experiment, the observing-response procedure was adapted for use with drug self-administration. Rats' responding for oral ethanol was sometimes reinforced on a random-ratio schedule, whereas at other times it had no effect (i.e., extinction). Behavior producing stimuli associated with the otherwise unsignaled random-ratio and extinction periods (i.e., observing behavior) was acquired and maintained. In a vehicle control condition, both self-administration and observing behavior decreased, but observing decreased less rapidly proportionally to baseline than vehicle consumption. Thus, conditioned reinforcers may have persistent effects that are relatively independent of the current status of the primary reinforcer. The procedure allows long-term study of drug-associated conditioned reinforcement and provides independent indexes of the conditioned reinforcing and discriminative stimulus effects of drug stimuli. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Reinstatement of fear to an extinguished conditioned stimulus: Two roles for context.

The authors studied the role of context in reinstatement. Freezing was reinstated when the conditioned stimulus (CS) was extinguished in 1 context and rats moved to another context for reexposure to the shock unconditioned stimulus (US) and test. It was also reinstated (rather than renewed) when rats were shocked in the extinction context and moved to another context for test. This reinstatement was CS specific and reduced by nonreinforced exposures to the extinction context. Rats shocked in the context in which a stimulus had been preexposed froze when tested in another context. These findings suggest 2 roles for context in reinstatement: conditioning of the test context (M. E. Bouton, 1993) and mediated conditioning by the extinction context (P. C. Holland, 1990). (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Extending conditioned stimuli before versus after unconditioned stimuli: Implications for real-time models of conditioning.

In four experiments using the conditioned suppression procedure with rats, we compared the effects of extending conditioned stimuli (CSs) before versus after reinforcement (called B vs. A extensions). In Experiments 1 and 2, Group 0 (no extension) received 2-min noise CS trials (3 per day in Experiment 1, 1 per day in Experiment 2) that terminated with a 1-s grid shock unconditioned stimulus (US). For Group B, the CS began 12 min before the US; for Group A, the CS began 2 min before the US but persisted for 10 min past US termination. In Experiments 3 and 4, similar trials (3 per day in Experiment 3, 1 per day in Experiment 4) included a 2-min light CS that always terminated with the US; thus the noise CS became a systematically manipulated context cue in which light-shock pairings were embedded. In Experiments 1 and 2 we found asymmetrical effects of CS extensions: B extensions weakened conditioning more than did A extensions. In Experiments 3 and 4 we found symmetrical effects: A and B extensions weakened context conditioning equally. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Involvement of the retrosplenial cortex in processing multiple conditioned stimuli.

Lesions of retrosplenial cortex (RSP) disrupt spatial and contextual learning, suggesting that RSP may have a fundamental role in processing overlapping, or simultaneously presented stimuli. If so, then RSP lesions might also be expected to disrupt learning that requires the concurrent processing of phasic conditioned stimuli. In Experiment 1, rats were trained in a compound feature negative discrimination task in which a tone was presented and immediately followed by food on some trials, while on other trials a visual stimulus was simultaneously presented along with the tone and not reinforced. Normal rats learned to discriminate between the trials but RSP-lesioned rats exhibited low levels of conditioning on both types of trials. Experiment 2 demonstrated that this effect was not simply due to a general inability to form associations, since RSP-lesioned rats exhibited normal responding when the visual stimulus was presented alone and paired with food. These findings support the view that RSP has an important role in learning that involves the processing of simultaneously presented stimuli and have implications for understanding the functional relationship between the hippocampus and RSP. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Some parameters affecting shuttle-box avoidance responding with rats receiving serially presented conditioned stimuli.

Gave 48 male Blue Spruce rats shuttle-box training with serial or nonserial CS procedures. The serial CS condition (S1/S1S2), which involved a single stimulus for the 1st 1/2 of a 16-sec CS-UCS interval and 2 stimuli for the latter 1/2, produced shorter avoidance latencies and more avoidance responses when compared with a serial condition (S1/S2), in which the latter 1/2 of the interval involved only 1 stimulus. Both serial conditions resulted in longer avoidance latencies when compared to nonserial conditions. Exp. II with 144 Ss demonstrated that the above latency differences could be eliminated with shorter CS-UCS intervals, and Exp. III with 72 Ss suggested that avoidance-latency differences obtained at longer CS-UCS intervals were independent of the CS duration ratio between serial components. These and other findings were predicted from a generalization-decrement hypothesis. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Septal lesions potentiate freezing behavior to contextual but not to phasic conditioned stimuli in rats.

The effects on freezing behavior elicited by contextual and phasic conditioned stimuli (CSs) were examined in rats with septal lesions. Two wks after surgery, blocks of 2 conditioning trials consisting of a tone (10 kHz, 75 dB, 20 sec) paired with a footshock (500 msec, 0.5 mA) were presented on 2 consecutive days. Tone-alone trials were presented each day thereafter until extinction criterion was met. Septal lesions were found to potentiate the freezing response elicited by contextual stimuli but had no effect on freezing elicited by the phasic CS. The septum thus appears to be involved in the acquisition and/or expression of defensive behaviors elicited by contextual stimuli. (PsycINFO Database Record (c) 2010 APA, all rights reserved)