Timed excitatory conditioning under zero and negative contingencies.

Rats (rattus norvegicus) anticipated the arrival of a food pellet unconditioned stimulus (US) even when the conditioned stimulus (CS) signaled no overall change or a substantial decrease in the overall rate of US occurrence. Pellet USs were scheduled probabilistically in the intertrial interval at either an equivalent rate (Experiment 1) or a four times higher rate (Experiments 2 and 3) than in the CS, which included one fixed-time target US. Conditioning has been said to involve learning "whether" (contingency) the CS signals a change in the US, and if so, "when" (contiguity) the US is scheduled to arrive. Our results suggest that "when" trumps "whether," challenging the received view that a positive CS-US contingency is necessary for successful conditioning. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

I like it because I said that I like it: Evaluative conditioning effects can be based on stimulus-response learning.

Evaluative conditioning (EC) effects are often assumed to be based on a learned mental link between the CS (conditioned stimulus) and the US (unconditioned stimulus). We demonstrate that this link is not the only one that can underlie EC effects, but that if evaluative responses are actually given during the learning phase also a direct link between the CS and an evaluative response—a CS-ER link—can be learned and lead to EC effects. In Experiment 1, CSs were paired with USs and participants were asked to evaluate the pairs during the conditioning phase. Resulting EC effects were unaffected by a later revaluation of the USs, suggesting that these EC effects can be attributed to CS-ER learning rather than to CS-US learning. Experiment 2 replicated Experiment 1 with the difference that no evaluative responses were given during the learning phase. EC effects in this study were influenced by US revaluation, suggesting that these EC effects are mainly based on CS-US learning. In Experiment 3, it was shown that EC effects can be found even if the USs are entirely removed from the procedure and the CSs are only paired with enforced evaluative responses. Together the experiments show that the valence of a stimulus can change because of a contingency with an evaluative response. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

Pavlovian contingencies and temporal information.

The effects of altering the contingency between the conditioned stimulus (CS) and the unconditioned stimulus (US) on the acquisition of autoshaped responding was investigated by changing the frequency of unsignaled USs during the intertrial interval. The addition of the unsignaled USs had an effect on acquisition speed comparable with that of massing trials. The effects of these manipulations can be understood in terms of their effect on the amount of information (number of bits) that the average CS conveys to the subject about the timing of the next US. The number of reinforced CSs prior to acquisition is inversely related to the information content of the CS. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Extending conditioned stimuli before versus after unconditioned stimuli: Implications for real-time models of conditioning.

In four experiments using the conditioned suppression procedure with rats, we compared the effects of extending conditioned stimuli (CSs) before versus after reinforcement (called B vs. A extensions). In Experiments 1 and 2, Group 0 (no extension) received 2-min noise CS trials (3 per day in Experiment 1, 1 per day in Experiment 2) that terminated with a 1-s grid shock unconditioned stimulus (US). For Group B, the CS began 12 min before the US; for Group A, the CS began 2 min before the US but persisted for 10 min past US termination. In Experiments 3 and 4, similar trials (3 per day in Experiment 3, 1 per day in Experiment 4) included a 2-min light CS that always terminated with the US; thus the noise CS became a systematically manipulated context cue in which light-shock pairings were embedded. In Experiments 1 and 2 we found asymmetrical effects of CS extensions: B extensions weakened conditioning more than did A extensions. In Experiments 3 and 4 we found symmetrical effects: A and B extensions weakened context conditioning equally. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Redundant treatment of neutral and excitatory stimuli in autoshaping.

Five autoshaping experiments with pigeons exposed excitatory and neutral stimuli to treatments that made those stimuli uninformative with respect to the unconditioned stimulus (US). Experiment 1 found that adding sufficient USs in the absence of the conditioned stimulus (CS) to make it uninformative prevented conditioning of that CS but did not undermine conditioning of a previously trained CS. Experiment 2 found a similar data pattern when an excitatory or neutral B stimulus was embedded in an A+/BA+ paradigm with an excitatory A. Experiments 3–5 verified that finding when the salience of A and B or the conditioning level of B was varied. These results, which are largely unanticipated by current theories of conditioning, suggest that the consequences of making a stimulus redundant depend on its conditioning level prior to that treatment. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Response rate and reinforcement rate in Pavlovian conditioning.

Four experiments used delay conditioning of magazine approach in rats to investigate the relationship between the rate of responding, R, to a conditioned stimulus (CS) and the rate, r, at which the CS is reinforced with the unconditioned stimulus (US). Rats were concurrently trained with four variable-duration CSs with different rs, either as a result of differences in the mean CS-US interval or in the proportion of CS presentations that ended with the US. In each case, R was systematically related to r, and the relationship was very accurately characterized by a hyperbolic function, R = Ar/(r +c). Accordingly, the reciprocal of these two variables—response interval, I (= 1/R), and CS-US interval, i (= 1/r) – were related by a simple affine (straight line) transformation, I = mi+b. This latter relationship shows that each increment in the time that the rats had to wait for food produced a linear increment in the time they waited between magazine entries. We discuss the close agreement between our findings and the Matching Law (Herrnstein, 1970) and consider their implications for both associative theories (e.g., Rescorla & Wagner, 1972) and nonassociative theories (Gallistel & Gibbon, 2000) of conditioning. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

Comparative electrophysiologic findings between responders and nonresponders to class III antiarrhythmic drugs among patients with ventricular tachyarrhythmia

Rabbits received conditional discrimination training using contextual stimuli to set the occasion for stimulus pairings during eyelid conditioning. Specifically, animals were exposed to either the presence or the absence of an oscillating chamber light throughout the intertrial interval (50 +/- 10 s). For half the animals, this light signaled paired presentations of a discrete tone conditioned stimulus (CS) and air puff unconditioned stimulus (US) while darkness signaled presentations of only the tone CS. The remaining animals experienced the opposite contextual relationship to the conditioning stimuli. These trial types occurred pseudo-randomly across a session, with all transitions between contextual settings (i.e., light or dark) taking place immediately at the CS-US offset. Under these conditions, animals successfully utilized the contextual stimuli as conditional cues for differential responding to the shared CS. Moreover, both light and dark were equally effective as discriminative stimuli. A subset of animals received further training in which the contextual contingency was removed by restricting all conditioning to the CS-alone context. Without the contingency in place, subsequent CS presentations (paired and CS-alone) evoked equivalent conditioned responding across three sessions of training. Following the reinstatement of the contextual contingencies, discriminatory responding was immediately observed and returned to previous levels within three sessions. Finally, animals appeared to use the static representation of the conditional cue, rather than the phasic transition between cues, for discriminatory responding. These findings are discussed in terms of current neurobiological models of eyelid conditioning.     

Hippocampectomy disrupts auditory trace fear conditioning and contextual fear conditioning in the rat

The hippocampus is believed to be an important structure for learning tasks that require temporal processing of information. The trace classical conditioning paradigm requires temporal processing because the conditioned stimulus (CS) and the unconditioned stimulus (US) are temporally separated by an empty trace interval. The present study sought to determine whether the hippocampus was necessary for rats to perform a classical trace fear conditioning task in which each of 10 trials consisted of an auditory tone CS (1 5-s duration) followed by an empty 30-s trace interval and then a fear-producing floor-shock US (0.5-s duration). Several weeks prior to training, animals were anesthetized and given aspiration lesions of the neocortex (NEO; n = 6), hippocampus and overlying neocortex (HIPP; n = 7), or no lesions at all (control; n = 6). Approximately 24 h after trace conditioning, NEO and control animals showed a significant decrease in movement to a CS-alone presentation that was indicative of a conditioned fear response. Animals in the HIPP group did not show conditioned fear responses to the CS alone, nor did a pseudoconditioning group (n = 7) that was trained with unpaired CSs and USs. Furthermore, all groups except the HIPP group showed conditioned fear responses to the original context in which they received shock USs. One week later, HIPP, NEO, and control animals received delay fear-conditioning trials with no trace interval separating the CS and US. Six of seven HIPP animals could perform the delay version, but none could perform the trace version. This result suggests that the trace fear task is a reliable and useful model for examining the neural mechanisms of hippocampally dependent learning.     

Blocking of a CS–US association by a US–US association.

Pigeons were autoshaped with a keylight as the conditioned stimulus (CS) and food as the unconditioned stimulus (US). Preexposure to repeated US presentations was followed by training sessions in which a single US preceded a single CS–US pairing. Preexposure blocked conditioning to the CS only when the interval between the prior US and the US in the US–CS pairing (critical interval) was equal to the US–US interval in preexposure. Blocking was examined as a function of the length of the critical interval and the amount of preexposure. The hypothesis that blocking occurs because prior US predicts the time of arrival of the US in the CS–US pairing was supported by a reduction in blocking when USs separated by intervals longer than the critical interval were added to preexposure sessions. Certain other interpretations of these results were tested and rejected. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Temporal location of unsignaled food deliveries: Effects on conditioned withdrawal (inhibition) in pigeon signtracking.

Standard models of Pavlovian conditioning neglect local effects of unsignaled unconditioned stimuli (USs) on learning and performance. Using the approach-withdrawal behavior of pigeons toward keylights as conditioned stimuli (CSs), the authors varied the specific times (5–210 s) that USs occurred before or after a CS. Withdrawal from a CS generally increased as the time between a US before and/or after the CS was lengthened. Combinations of 2 distant USs produced more withdrawal from the CS than either US alone, whereas combinations of a distant and a nearby US yielded behavior intermediate between that for either US alone. Postacquisition retardation tests supported similar conclusions. Based on the temporal isolation of CSs and USs, a tentative model was offered to summarize these data. The results and the model suggest that a more molecular, possibly perceptual approach to Pavlovian excitation and inhibition is needed. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

The CS–US interval and taste aversion learning: A brief look.

Temporal parameters of taste aversion learning are known to differ markedly from other learning paradigms in that acquisition occurs despite lengthy delays between exposure to conditioned (CS) and unconditioned stimulus (US). Far less consideration has been paid to very brief CS-US intervals and the possibility that this learning may also be distinguished by an ineffectiveness of close temporal contiguity between CS and US. The effectiveness of a very brief CS-US interval (10 s) was compared with that of 2 lengthier intervals (15 and 30 min). Temporal control of CS delivery (0.15% saccharin solution) into the oral cavity and US delivery (7.5 mg/kg apomorphine hydrochloride) into circulation involved infusion pumps and indwelling catheters. Using a 1-trial learning paradigm, CS-US delays of 15 and 30 min led to significant aversions whereas the 10-s CS-US interval did not, suggesting that close temporal contiguity between CS and US is neither necessary nor sufficient for conditioned taste aversion acquisition. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Aware and (Dis)Liking: Item-Based Analyses Reveal That Valence Acquisition via Evaluative Conditioning Emerges Only When There Is Contingency Awareness.

Evaluative conditioning (EC) refers to changes in the liking of an affectively neutral stimulus (the conditioned stimulus, or CS) following the pairing of that stimulus with another stimulus of affective value (the unconditioned stimulus, or US). In 3 experiments, the authors assessed contingency awareness, that is, awareness of the CS-US associations, by relying on participants' responses to individual items rather than using a global method of assessment. They found that EC emerged on contingency aware CSs only. Of note, whether the CSs were evaluated explicitly (Experiments 1 and 2) or implicitly (Experiment 3) did not make a difference. This pattern supports the idea that awareness of the CS-US associations may be required for valence acquisition via EC. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Temporal Learning in Random Control Procedures.

Experiments 1 and 2 delivered conditioned stimuli (CSs) at random times and unconditioned stimuli (USs) at either fixed (Experiment 1) or random (Experiment 2) intervals. In Experiment 3, CS duration was manipulated, and US deliveries occurred at random during the background. In all 3 experiments, the mean rate of responding (head entries into the food cup) in the background was determined by the mean US-US interval, and the mean rate during the CS was a linear combination of responding controlled by the mean US-US and mean CS onset-US intervals; the pattern of responding in time was determined by the interval distribution form (fixed or random). An event-based timing account, Packet theory, provided an explanation of the results. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Second-order conditioning with and without unconditioned stimulus presentation

The effects of presenting various episodes after serial presentation of two conditioned stimuli (CS2-CS1 sequences) on second-order conditioning to CS2 were examined in three experiments using rat subjects in an appetitive conditioning situation. In Experiment 1, presentation of food unconditioned stimuli (USs) immediately after CS2-CS1 sequences interfered with second-order conditioning of CS2. In Experiment 2, postsequence presentation of a "surprising" US interfered with second-order conditioning more than did presentation of an "expected" US; similarly, less second-order conditioning of CS2 was observed when postsequence nonpresentation of a US was surprising than when US omission was expected. In Experiment 3, the interfering effect of US presentation on second-order conditioning was smaller when a brief delay was introduced between presentation of the CS2-CS-1 sequence and the US. The results are discussed in terms of an information-processing theory recently proposed by Wagner and his colleagues.     

Haloperidol attenuates rewarding and aversively conditioned suppression of saccharin solution intake: Reevaluation of the anhedonia hypothesis of dopamine blocking.

The dopamine (DA) antagonist, haloperidol, affected the conditioned suppression of a saccharin solution intake (the conditioned stimulus, CS) induced by amphetamine (AMPH) and lithium chloride (LiCl) unconditioned stimuli (USs). Four experiments showed that (a) haloperidol by itself did not reduce saccharin solution intake. (b) When haloperidol was injected between the CS and the US, the conditioned suppression was attenuated; however, (c) this did not occur when haloperidol was injected after the US, indicating that haloperidol affected the perception of the US. (d) This attenuation was found with both rewarding AMPH and aversive LiCl treatments, indicating that the valence of the US was unimportant. Thus, the so-called "anhedonia response" might be due to weakening of US impact. A general salient-stimulus hypothesis was proposed, with the anhedonia hypothesis of DA blocking as its subset. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Unconditioned stimulus devaluation effects in nutrient-conditioned flavor preferences.

Experiments with different temporal relations between the conditioned stimulus (CS) and the unconditioned stimulus (US) in conditioning assessed whether US devaluation effects can be obtained after nutrient-conditioned flavor preference learning. One flavor (CScarb) was paired with a carbohydrate, Polycose; a 2nd flavor (CSprot) was paired with a protein, casein; and a 3rd flavor (CS-) was presented by itself. Following conditioning, one of the nutrients was devalued through pairings with lithium chloride in the absence of the CS flavors. In a subsequent 2-bottle test, rats preferred CScarb over CSprot; however, this preference was smaller when the carbohydrate was devalued than when the protein was devalued. Results suggest that CS flavors are able to form associations with the sensory features of nutrient USs under a wide variety of circumstances. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Combining CSs associated with the same or different USs

In three experiments, hungry rats received appetitive training with four stimuli, A, B, X, and Y. In each Experiment, A and B were paired with one unconditioned stimulus (US; e.g. food pellets) whereas X and Y were paired with a second US (e.g. sucrose). Subsequently, rats responded more vigorously to combinations of stimuli associated with different USs (A-Y & X-B) than to combinations of stimuli associated with the same US (A-B & X-Y; Experiments 1, 2, & 3). This effect was observed when the stimuli were presented simultaneously and during the second elements of serial compounds (Experiments 2 & 3). Moreover, combining CSs associated with different USs resulted in a more marked CR than combining CSs that had each been paired with both US1 and US2 (Experiment 3). These results suggest that the sensory properties of appetitive reinforcers have an important influence on performance.     

Bridging temporal gaps between CS and US in autoshaping: Insertion of other stimuli before, during, and after CS.

In 4 experiments, female White Carneaux pigeons were exposed to key-light illuminations separated from food delivery by 12–60 sec. Approach to the key light did not develop on conventional trace-conditioning arrangements but occurred consistently whenever some auditory or visual stimulus filled the CS–UCS gap (serial conditioning) or was always present except during the gap. The CS approach was strong only when the stimulus present during the intertrial interval remained on until the termination of CS; if the stimulus ended at CS onset, conditioning did not occur. Although discriminability of CS–UCS gaps from intertrial periods seemed necessary for conditioning to occur in the absence of close CS–UCS contiguity, the outcome of the final experiment indicates that such discriminability was not sufficient for conditioning. Results are discussed in terms of possible 2nd-order conditioning effects and the changes in the associative strength of the "local context" existing when the CS appears, which may lead to superconditioning of CS. (35 ref) (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Classical conditioning and brain systems: the role of awareness

Classical conditioning of the eye-blink response, perhaps the best studied example of associative learning in vertebrates, is relatively automatic and reflexive, and with the standard procedure (simple delay conditioning), it is intact in animals with hippocampal lesions. In delay conditioning, a tone [the conditioned stimulus (CS)] is presented just before an air puff to the eye [the unconditioned stimulus (US)]. The US is then presented, and the two stimuli coterminate. In trace conditioning, a variant of the standard paradigm, a short interval (500 to 1000 ms) is interposed between the offset of the CS and the onset of the US. Animals with hippocampal lesions fail to acquire trace conditioning. Amnesic patients with damage to the hippocampal formation and normal volunteers were tested on two versions of delay conditioning and two versions of trace conditioning and then assessed for the extent to which they became aware of the temporal relationship between the CS and the US. Amnesic patients acquired delay conditioning at a normal rate but failed to acquire trace conditioning. For normal volunteers, awareness was unrelated to successful delay conditioning but was a prerequisite for successful trace conditioning. Trace conditioning is hippocampus dependent because, as in other tasks of declarative memory, conscious knowledge must be acquired across the training session. Trace conditioning may provide a means for studying awareness in nonhuman animals, in the context of current ideas about multiple memory systems and the function of the hippocampus.