Models of ratio schedule performance.

Predictions of P. R. Killeen's (1994) mathematical principles of reinforcement were tested for responding on ratio reinforcement schedules. The type of response key, the number of sessions per condition, and first vs. second half of a session had negligible effects on responding. Longer reinforcer durations and larger grain types engendered more responding, affecting primarily the parameter a (specific activation). Key pecking was faster than treadle pressing, affecting primarily the parameter δ (response time). Longer intertrial intervals led to higher overall response rates and shorter postreinforcement pauses and higher running rates, and ruled out some competing explanations. The treadle data required a distinction between the energetic requirements and rate-limiting properties of extended responses. The theory was extended to predict pause durations and run rates on ratio schedules. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Response rate and sensitivity to the molar feedback function relating response and reinforcement rate on VI+ schedules of reinforcement.

In 5 experiments, the author examined rats' sensitivity to the molar feedback function relating response rate to reinforcement rate on schedules of reinforcement. These studies demonstrated that, at lower rates of responding, rats' performance on variable ratio (VR), variable interval (VI), and variable interval with linear feedback loop (VI+) schedules was determined largely by reinforcement of interresponse times; response rates were faster on VR than on both VI and VI+ schedules. In contrast, when procedures were adopted to maintain high rates of response, rats showed sensitivity to the molar characteristics of the schedules; they responded as fast on a VI+ schedule as on a VR schedule and faster on both of these schedules than on a yoked VI schedule. When the variance of response rate was manipulated, this factor was noted as an important element in determining sensitivity to the molar characteristics of the schedule. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Effects of serotonergic manipulations on cocaine self-administration in rats

Rats were trained to self-administer cocaine (0.5 mg/kg/infusion) and were then pretreated with the 5-HT1A agonist 8-OH-DPAT (0.125, 0.25 or 0.5 mg/kg, SC). 8-OH-DPAT pretreatment produced a decrease in reinforced response rates. When the effect of 8-OH-DPAT (0.5 mg/kg, SC) on responding for a range of cocaine doses was assessed, the drug produced a decrease in response rates when lower doses of cocaine served as the reinforcer. Fluoxetine (10 mg/kg, IV), an indirect 5-HT agonist, also reduced reinforced response rates for a low dose infusion of cocaine. Rates of responding for infusions of higher cocaine doses were not affected by fluoxetine pretreatment during an FR1 schedule of reinforcement. When an FR10 schedule of reinforcement was imposed, reinforced response rates for infusions of higher doses of cocaine were also reduced. Thus, under conditions that produce high rates of responding (low dose infusion or high ratio requirements for an infusion) fluoxetine reduced responding. This effect may be due to the effects at the 5-HT1A receptor, since 8-OH-DPAT produced a similar effect on cocaine self-administration. Given that the effects of these 5-HT agonists are observed only when low doses of cocaine serve as the reinforcer or when task demands are high, it is possible that the suppression of responding reflects an effect that is not specific to the reinforcing impact of cocaine. An alternative explanation for these effects incorporates a concept of unit cost/cocaine infusion that allows for direct comparison across studies that employ different reinforcement schedules.     

Interresponse-time reinforcement and behavior under aperiodic reinforcement schedules: A case study using computer modeling.

Computer modeling was used to investigate the extent to which response rates under variable-interval and variable-ratio schedules are compatible with a simple process of interresponse time (IRT) reinforcement, as argued by Peele, Casey, and Silberberg (1984). Their computer model was duplicated, as well as its principal result of a large response rate difference between the interval and ratio schedules. After their model was run under a variety of interval and ratio schedules, it was found that the response rates produced did not exhibit patterns of sensitivity to schedule parameter variation found experimentally. Furthermore, the model predicted a large response rate difference between a variable-ratio and a "linear feedback" variable-interval schedule, contrary to the results of McDowell and Wixted (1986). We concluded that simple IRT reinforcement was probably not adequate as an explanation of schedule effects under aperiodic interval and ratio schedules, although a modification of the Peele et al. model incorporating behaviors that were not measured operants could exhibit schedule sensitivity. This suggested that realistic molecular models of schedule phenomena must involve more than simple IRT reinforcement. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

An investigation of responding on schedules of electrical brain-stimulation reinforcement.

In Exp I, the leverpressing responses of rats (8 male hooded Long-Evans) were maintained by reinforcement consisting of single trains of electrical stimulation of the brain (ESB) presented on random-interval (RI) schedules ranging in value from RI 3-min to RI 10-min. Both the cumulative response patterns and the relationship of response rates to reinforcement density were similar to those observed for Ss reinforced conventionally. In Exp II with 19 male hooded Long-Evans rats, leverpressing was reinforced with single trains of signalled ESB, unsignalled response-contiguous ESB, or sweetened condensed milk presented on random-ratio schedules. Most of the ESB-reinforced Ss and half of the milk-reinforced Ss stopped responding at ratio values exceeding 50:1, while the remaining Ss responded at higher ratios. Response rates were higher at lower ratio values for the ESB groups than for the milk group, but as ratio values increased, all groups showed similar decreases in rate. All Ss were observed to initiate responding faster than inexperienced controls, and priming was not required. (French summary) (24 ref) (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Using visual reinforcement to establish stimulus control of responding of Siamese fighting fish (Betta splendens).

Stimulus control of ring swimming was studied with male Siamese fighting fish (Betta splendens) using 2-component multiple schedules in which the components were correlated with the presence or absence of air bubbles in the water. In Experiment 1, either response-independent mirror presentations or extinction was juxtaposed with immediate response-dependent mirror presentations. Rates of ring swimming generally were higher with immediate reinforcement than with either response-independent mirror presentations or extinction. In Experiment 2, different durations of response-dependent mirror presentations were juxtaposed. Generally, higher rates of ring swimming occurred with 15-s than with 0-, 1-, or 3-s durations. Results demonstrate that stimulus control of responding can be established with these fish under several conditions of differential reinforcement. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Response suppression on DRL by rats with septal damage.

The effectiveness of the DRL contingency in suppressing response rates of septal and normal male Long-Evans hooded rats was investigated by using a multiple-DRL-yoked-VI schedule. The yoking procedure equated the interreinforcement times on the 2 schedules. Each schedule was in effect for half of each session, and the change in schedule was signaled by the presence or absence of a cue light. Schedule order and DRL delay requirement were varied. For both normal and septal rats, the response rates were higher in the VI than in the DRL component; this demonstrated that the responding of septals as well as normals was suppressed by the differential reinforcement of a particular class of IRTs. A sharp difference in the level of responding occurred at the point of transition from one component of the multiple schedule to the other, thus providing evidence of a discrimination between the 2 schedules for both normals and septals. It is concluded that the responding of septals is suppressed by the DRL contingency and not controlled solely by the density and distribution of reinforcement. (23 ref) (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Correction to Killeen et al. (2009).

Reports an error in "Progressive ratio schedules of reinforcement" by Peter R. Killeen, Diana Posadas-Sanchez, Espen Borg? Johansen and Eric A. Thrailkill (Journal of Experimental Psychology: Animal Behavior Processes, 2009[Jan], Vol 35[1], 35-50). The URL provided for the supplemental material was incomplete. The complete URL is http://dx.doi.org/10.1037/a0012497.supp (The following abstract of the original article appeared in record 2009-00257-007.) Pigeons' pecks produced grain under progressive ratio (PR) schedules, whose response requirements increased systematically within sessions. Experiment 1 compared arithmetic (AP) and geometric (GP) progressions. Response rates increased as a function of the component ratio requirement, then decreased linearly (AP) or asymptotically (GP). Experiment 2 found the linear decrease in AP rates to be relatively independent of step size. Experiment 3 showed pausing to be controlled by the prior component length, which predicted the differences between PR and regressive ratio schedules found in Experiment 4. When the longest component ratios were signaled by different key colors, rates at moderate ratios increased, demonstrating control by forthcoming context. Models for response rate and pause duration based on Bizo and Killeen (1997) described performance on AP schedules; GP schedules required an additional parameter representing the contextual reinforcement. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Behavioral contrast in pigeons depends upon the operant.

Reinforced 3 male Carneaux pigeons for depressing a foot treadle according to multiple VI/VI schedules. After rates of responding stabilized, the schedule in 1 component was changed to extinction. This manipulation resulted in either no change or a decrease in rate of responding in the unchanged component. The Ss were then reinforced for key pecking under the same procedure. When key pecking was the operant, the experimental manipulation resulted in behavioral contrast. Results are discussed in terms of Pavlovian * Instrumental interactions. (17 ref.) (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Several effects of behavioral cost on pigeons' reactivity to food and to Pavlovian signals for food.

The effects of behavioral cost of obtaining food on pigeons' responsiveness to Pavlovian signals and food were investigated in three free-feeding experiments. During 10-hr sessions a pigeon could produce a 10-s keylight followed by 10-s access to a grain hopper by stepping on a foot treadle. Cost was manipulated by using four different fixed ratio (Experiment 1) or variable ratio (Experiment 2) schedules to vary the number of treadle presses required. The number of consecutive trials on which the cost was low or high was varied in Experiment 3. The rates of keypecking and eating were both found to be positively related to the average cost (Experiments 1 and 2). When cost varied from trial to trial (Experiments 2 and 3), keypecking rate was inversely related to the cost on a trial. Results of Experiment 3 indicated that keypecking tended to decrease over a series of low-cost trials and to increase over a series of high-cost trials. It was proposed that the pigeons continually update their estimate of average cost and that the cost on each trial is compared with that estimate. Furthermore, signal-directed responding (a) is potentiated when cost on a trial is less than the average and (b) is reduced when cost on a trial is greater than the average cost. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Appetitively motivated instrumental learning in SynGAP heterozygous knockout mice.

The synaptic Ras/Rap-GTPase-activating protein (SynGAP) regulates specific intracellular events following N-methyl-d-aspartate receptor (NMDAR) activation. Here, the impact of SynGAP heterozygous knockout (SG+/?) on NMDAR-dependent functions was assessed using different positive reinforcement schedules in instrumental conditioning. The knockout did not affect the temporal control of operant responding under a fixed interval (FI) schedule, but led to a putative enhancement in response vigor and/or disinhibition. When examined on differential reinforcement of low rates of response (DRL) schedules, SG+/? mice showed increased responding under DRL-4s and DRL-8s, without impairing the response efficiency (total rewards/total lever presses) because both rewarded and nonrewarded presses were elevated. Motivation was unaffected as evaluated using a progressive ratio (PR) schedule. Yet, SG+/? mice persisted in responding during extinction at the end of PR training, although an equivalent phenotype was not evident in extinction learning following FI-20s training. This extinction phenotype is therefore schedule-specific and cannot be generalized to Pavlovian conditioning. In conclusion, constitutive SynGAP reduction increases vigor in the execution of learned operant behavior without compromising its temporal control, yielding effects readily distinguishable from NMDAR blockade. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Effort as a determinant of choice in rats.

Studied the effect of response effort on rate of responding and choice behavior in a 2-bar situation in 2 experiments with 17 male Sprague-Dawley rats. Exp I used a limited test session and tested at a single FR ratio. Exp II employed a free behavior situation, in which total daily water intake was obtained by barpressing. Ratio requirements beginning with continuous reinforcement and followed by sessions of FR 5, 10, 20, 40, 80, 120, and 160 were tested. Relations between response rate and preference behavior were schedule dependent. On low-ratio schedules the highest response rates and preference were for the light bar. As the ratios were increased, however, response rates became higher and preference was switched to the heavy bar. (19 ref) (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Progressive ratio schedules of reinforcement.

[Correction Notice: An erratum for this article was reported in Vol 35(2) of Journal of Experimental Psychology: Animal Behavior Processes (see record 2009-05154-003). The URL provided for the supplemental material was incomplete. The complete URL is http://dx.doi.org/10.1037/a0012497.supp] Pigeons' pecks produced grain under progressive ratio (PR) schedules, whose response requirements increased systematically within sessions. Experiment 1 compared arithmetic (AP) and geometric (GP) progressions. Response rates increased as a function of the component ratio requirement, then decreased linearly (AP) or asymptotically (GP). Experiment 2 found the linear decrease in AP rates to be relatively independent of step size. Experiment 3 showed pausing to be controlled by the prior component length, which predicted the differences between PR and regressive ratio schedules found in Experiment 4. When the longest component ratios were signaled by different key colors, rates at moderate ratios increased, demonstrating control by forthcoming context. Models for response rate and pause duration based on Bizo and Killeen (1997) described performance on AP schedules; GP schedules required an additional parameter representing the contextual reinforcement. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Hypothalamic self-stimulation in rats following immunosympathectomy or central nerve growth factor antiserum injection.

In Exp I 5 immunosympathectomized rats self-stimulated at a much lower rate on high variable ratio schedules of reinforcement than 7 injected controls. No differences were found for responding on continuous reinforcement or low variable-ratio reinforcement schedules. In Exp II, using 2 groups of 9 naive Sprague-Dawley rats, a similar reduction in variable-ratio response rate was found for Ss centrally injected with nerve growth factor antiserum relative to controls. Results suggest a reduction in central catecholamine levels as a result of antiserum treatment. (20 ref) (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Enhanced response acceleration or suppression produced by response-independent food presentations in rats with septal lesions

In two separate experiments, the response rates of rats with septal lesions were compared with those of control rats when response-independent food was presented while subjects were responding on a differential-reinforcement-of-low-rate schedule of reinforcement (Experiment 1) or according to a conjunctive differential-reinforcement-of-high-rate, fixed-ratio schedule (Experiment 2). Free-food deliveries resulted in acceleration of responding of subjects working on the low-rate schedule and in suppression of responding of those animals working on the high-rate schedule. Both of these effects were localized to a brief time period immediately following the free-food deliveries, and baseline rates of responding were not altered. The acceleration and suppression of responding that occurred on the respective schedules were greatly enhanced in rats with septal lesions. This finding supports the suggestion that these animals are hyperreactive to the reinforcing and/or eliciting properties of discrete stimulus events.     

Comparison of reinforcement schedules in the reduction of stereotypy with supported routines

The rates and durations of stereotypic behaviors in four adolescents with severe mental retardation were measured during two daily vocational training sessions and during contiguous periods of leisure in their special education classrooms. Vocational training was conducted in two different tasks, alternating across days. The task requirements for each participant were matched to each participant's learning and performance characteristics. The participants were exposed to a fixed ratio schedule of tokens exchangeable for food items on one task and to a variable interval schedule for the same consequences on the second task. The schedules were chosen as an initial test of a matching-law based prediction by Myerson and Hale (1984): Variable interval reinforcement for adaptive behavior will produce less allocation of responding to maladaptive behavior than will a ratio-based intervention. When work performances stabilized, the schedules of token delivery were reversed across the tasks and performances again stabilized. Results are reported for periods when work performances met stability criteria. Stereotypy occurred more during leisure than during vocational training under either schedule. The major differences in stereotypy between leisure and vocational training were differences in episode length rather than rate of onset. Onset of stereotypy in vocational training, however, occurred at higher rates under the interval schedule than under the ratio schedule in both tasks. The results are discussed in terms of Myerson and Hale's prediction and implications for further research and application.     

The cytoskeleton of the vertebrate smooth muscle cell

Four experiments were conducted to determine the effects of dopamine (DA) antagonists and DA depletions on progressive-ratio responding for food reinforcement. On this schedule, ratio requirement increased by one response after each reinforcer was obtained, and rats were tested in 30-min sessions. Response rates and highest ratio completed were reduced in a dose-related manner by systemic injections of the D1 antagonist SCH 23390, and also by the D2 antagonists haloperidol and raclopride. Drug-treated rats also showed reductions in time to complete the last ratio, demonstrating that they had stopped responding before the end of the session. DA depletions produced by injections of 6-OHDA directly into the nucleus accumbens substantially decreased both the number of responses and the highest ratio completed. The deficits in response number and highest ratio completed induced by DA depletions persisted through the first 3 weeks of postsurgical testing, with some recovery by the fourth week. However, the deficits resulting from dopamine depletions were largely a manifestation of a decrease in response rate; although time to complete the last ratio was significantly reduced by dopamine depletions in the first few days of testing, rats recovered on this measure by the fifth day after surgery. Although previous work has shown that performance on several schedules (e.g., continuous, low value ratios, variable interval) is relatively unaffected by accumbens DA depletions, the present data demonstrate that such depletions do produce a substantial and persistent impairment of progressive ratio response output. Rats with accumbens DA depletions appear to have deficits in maintaining the high work output necessary for responding at large ratio values. The relative sparing of responding on some simple schedules, together with the present progressive ratio results, suggest that rats with accumbens DA depletions remain directed toward the acquisition and consumption of food, but they show deficits in work output for food.     

Disinhibition and spontaneous recovery of response decrements produced by free reinforcement in rats.

Conducted 3 experiments with a total of 16 Holtzman albino and 48 hooded male rats. After the Ss had been trained to barpress on a variable interval schedule of reinforcement, response rates were reduced by the introduction either of extinction or of a response-independent (free) reinforcement schedule. Spontaneous recovery was consistently obtained in extinction, especially when session durations were long. Under free reinforcement conditions there was little sign of spontaneous recovery, even when with high reinforcement rates response reduction was almost as rapid as in extinction. In disinhibition tests the introduction of noise produced increased responding under free reinforcement conditions but not in extinction. Results are interpreted as demonstrating a dissociation between spontaneous recovery and disinhibition. (23 ref) (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Effects of changes in response requirement and deprivation on the parameters of the matching law equation: New data and review.

The relation between response rate and reinforcement rate is described by the matching law equation. For an experiment in which there is just 1 explicit source of reinforcement, the equation has 2 parameters. The magnitude of 1 is equal to the response rate asymptote; the magnitude of the other is equal to the rate of reinforcement that maintains a one-half asymptotic response rate. This report describes experimental manipulations that affect these 2 parameters. Rats were trained on a series of variable-interval reinforcement schedules that provided reinforcement rates ranging from about 20 to 700 reinforcements per hour. The response was a lever press, and the reinforcer was water. In Exp I, the duration of the deprivation period was varied. Response rates maintained by the lower reinforcement rates showed the largest changes, and the parameter that is equal to the reinforcement rate for a one-half asymptotic response rate changed. In Exp II, the weight of the lever was varied. Response rates changed independently of reinforcement rate, and the parameter that is equal to the asymptotic response rate changed. In Exp III, manipulations from Exps I and II were combined. Results replicated those of Exps I and II. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Molecular mechanisms resulting in pathogenic anti-mouse erythrocyte antibodies in New Zealand black mice

A procedure was developed with pigeons to extend the experimental analysis of punished behavior and the effects of anxiolytic drugs. Under this procedure the completion of a fixed-ratio requirement on a changeover key switched between two variable-interval schedules of reinforcement that were programmed on a second response key. Under one schedule, correlated with a green keylight, key pecks produced only food; under the second schedule, correlated with a red keylight, key pecks produced both food and electric shock. Pigeons were switched into the component with shock if they did not enter that component within 5 min. Parameter values of the variable-interval schedules were manipulated systematically and the effects of two clinically active anxiolytic drugs, buspirone and chlordiazepoxide, were examined. Responding was suppressed during the component with shock (punishment) and, under non-drug conditions, pigeons infrequently switched into the punishment component; changeover responses occurred rapidly when switched into the punishment component. Both buspirone (0.1-3.0 mg/kg) and chlordiazepoxide (3.0-30 mg/kg) increased punished responding at doses that had little effect on unpunished responding; d-amphetamine (0.3-5.6 mg/kg), which was studied only under one parameter of the variable-interval schedule, produced greater decreases in rates of punished responding than in unpunished responding.(ABSTRACT TRUNCATED AT 250 WORDS)