Learned predictiveness effects in humans: A function of learning, performance, or both?

[Correction Notice: An erratum for this article was reported in Vol 36(1) of Journal of Experimental Psychology: Animal Behavior Processes (see record 2010-02315-003). In the article “Learned predictiveness effects in humans: A function of learning, performance, or both?” by M. E. Le Pelley, M. B. Suret, and T. Beesley (Journal of Experimental Psychology: Animal Behavior Processes, 35, 312–327), an incorrect equation was printed. The correct version of Equation 2 is: Δαp > 0 if |λ - Vp| VQ| and Δαp Vp| > |λ - VQ|.] Many previous studies of animal and human learning indicate a processing advantage for cues previously experienced as good predictors of outcomes over those experienced as poorer predictors. Four studies of human associative learning investigated whether learned predictiveness acts at the level of learning (modulating the rate at which cue–outcome associations form), performance (modulating the strength of behavioral responses), or both. In Experiments 1–3, it was found that retrospectively altering the learned predictiveness of cues influenced responding to those cues, demonstrating that learned predictiveness influences performance. Experiment 4 indicates that learned predictiveness also influences learning by demonstrating that the learned predictiveness of a cue affects the acquisition of an association between a novel cue and the outcome with which it is paired. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

“Learned predictiveness effects in humans: A function of learning, performance, or both?”: Correction.

Reports an error in "Learned predictiveness effects in humans: A function of learning, performance, or both" by M. E. Le Pelley, M. B. Suret and T. Beesley (Journal of Experimental Psychology: Animal Behavior Processes, 2009[Jul], Vol 35[3], 312-327). In the article “Learned predictiveness effects in humans: A function of learning, performance, or both?” by M. E. Le Pelley, M. B. Suret, and T. Beesley (Journal of Experimental Psychology: Animal Behavior Processes, 35, 312–327), an incorrect equation was printed. The correct version of Equation 2 is: Δαp > 0 if |λ - Vp| VQ| and Δαp Vp| > |λ - VQ|. (The following abstract of the original article appeared in record 2009-10283-002.) Many previous studies of animal and human learning indicate a processing advantage for cues previously experienced as good predictors of outcomes over those experienced as poorer predictors. Four studies of human associative learning investigated whether learned predictiveness acts at the level of learning (modulating the rate at which cue–outcome associations form), performance (modulating the strength of behavioral responses), or both. In Experiments 1–3, it was found that retrospectively altering the learned predictiveness of cues influenced responding to those cues, demonstrating that learned predictiveness influences performance. Experiment 4 indicates that learned predictiveness also influences learning by demonstrating that the learned predictiveness of a cue affects the acquisition of an association between a novel cue and the outcome with which it is paired. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Stereotype formation: Biased by association.

We propose that biases in attitude and stereotype formation might arise as a result of learned differences in the extent to which social groups have previously been predictive of behavioral or physical properties. Experiments 1 and 2 demonstrate that differences in the experienced predictiveness of groups with respect to evaluatively neutral information influence the extent to which participants later form attitudes and stereotypes about those groups. In contrast, Experiment 3 shows no influence of predictiveness when using a procedure designed to emphasize the use of higher level reasoning processes, a finding consistent with the idea that the root of the predictiveness bias is not in reasoning. Experiments 4 and 5 demonstrate that the predictiveness bias in formation of group beliefs does not depend on participants making global evaluations of groups. These results are discussed in relation to the associative mechanisms proposed by Mackintosh (1975) to explain similar phenomena in animal conditioning and associative learning. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Blocking and Unblocking in Human Causal Learning.

Three experiments sought to develop the suggestion that, under some circumstances, common associative learning mechanisms might underlie animal conditioning and human causal learning, by demonstrating, in humans, an effect analogous to the unblocking by reinforcer omission observed in animal conditioning. Experiment 1 found no such effect. Experiment 2, designed to prevent inhibitory influences that might have masked excitatory unblocking in Experiment 1, demonstrated unblocking, indicating common human-animal associative learning mechanisms in which the associability of a stimulus varies as a function of its predictive history. Experiment 3, using a similar design but with a procedure promoting application of rational inference processes, failed to detect the same unblocking effect, indicating that associative and cognitive mechanisms may influence human causal learning. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Comparing learned predictiveness effects within and across compound discriminations.

In four human learning experiments, we examined the extent to which learned predictiveness depends upon direct comparison between relatively good and poor predictors. Participants initially solved (a) linear compound discriminations in which one or both of the stimuli in each compound were predictive of the correct outcome, (b) biconditional discriminations where only the configurations of the stimuli were predictive of the correct outcome, or (c) pseudodiscriminations in which no stimulus features were predictive. In each experiment, subsequent learning and test stages were used to assay changes in the associability of each stimulus brought about by its role in the initial discriminations. Although learned predictiveness effects were observed in all experiments (i.e., previously predictive cues were more readily associated with a new outcome than previously nonpredictive cues), the same changes in associability were observed regardless of whether the stimulus was initially learned about in the presence of an equally predictive, more predictive, or less predictive stimulus. The results suggest that learned associability is not controlled by competitive allocation of attention, but rather by the absolute predictiveness of each individual cue. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

Differential outcome effects in Pavlovian biconditional and ambiguous occasion setting tasks.

Three experiments with rats explored the differential outcome effect (DOE) using a Pavloian magazine approach conditioning preparation. Experiment 1 compared groups trained on a biconditional discrimination (AX+, AY?, BX?, BY+) with differential or nondifferential outcomes, and Experiment 2 examined this using an ambiguous occasion setting task (e.g., AX+, X?, Y+, AY?). In both experiments, subjects trained with differential outcomes learned the tasks better than subjects trained with nondifferential outcomes. Furthermore, subjects given differential outcome training learned the positive occasion setting component of the ambiguous task more efficiently than the negative occasion setting component, although both were enhanced by differential outcome training. Experiment 3 demonstrated that the ambiguous occasion setting task was reversed more readily when the target–outcome relations (as opposed to the modulator–outcome relations) were maintained during the reversal phase. These data suggest that an acquired distinctiveness effect may be responsible for the DOE in Pavlovian learning. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

I like it because I said that I like it: Evaluative conditioning effects can be based on stimulus-response learning.

Evaluative conditioning (EC) effects are often assumed to be based on a learned mental link between the CS (conditioned stimulus) and the US (unconditioned stimulus). We demonstrate that this link is not the only one that can underlie EC effects, but that if evaluative responses are actually given during the learning phase also a direct link between the CS and an evaluative response—a CS-ER link—can be learned and lead to EC effects. In Experiment 1, CSs were paired with USs and participants were asked to evaluate the pairs during the conditioning phase. Resulting EC effects were unaffected by a later revaluation of the USs, suggesting that these EC effects can be attributed to CS-ER learning rather than to CS-US learning. Experiment 2 replicated Experiment 1 with the difference that no evaluative responses were given during the learning phase. EC effects in this study were influenced by US revaluation, suggesting that these EC effects are mainly based on CS-US learning. In Experiment 3, it was shown that EC effects can be found even if the USs are entirely removed from the procedure and the CSs are only paired with enforced evaluative responses. Together the experiments show that the valence of a stimulus can change because of a contingency with an evaluative response. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

Releaser-induced recognition learning.

A variant of Pavlovian conditioning, termed the releaser-induced recognition-learning model, is introduced, described, and evaluated for generality and efficacy in accounting for learning phenomena. Elements of the innate releasing mechanism of classical ethology are combined in the model with the transfer-of-control version of Pavlovian stimulus substitution. The resulting mechanism, assumed to underlie simple recognition learning, essentially appears to induce a transfer between stimuli of control over the release of preorganized responses. Another proposition of the model concerns the relative taxic direction of originally released and redirected responses. The hypothesis that stimulus relationships other than temporal predictiveness can produce learned behavior is also considered. The proposed model provides a unitary account of recognition learning that includes imprinting and social learning as well as Pavlovian conditioning and some forms of instrumental conditioning. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Feedback Specificity, Learning Opportunities, and Learning.

Although increasing feedback specificity is generally beneficial for immediate performance, it can undermine certain aspects of the learning needed for later, more independent performance. The results of the present transfer experiment demonstrate that the effects of increasing feedback specificity on learning depended on what was to be learned, and these effects were partially mediated through the opportunities to learn how to respond to different task conditions during practice. More specific feedback was beneficial for learning how to respond to good performance and detrimental for learning how to respond to poor performance. The former relationship was partially mediated by feedback specificity's effect on learning opportunities during practice. The results have implications for designing feedback interventions and training to maximize the learning of various aspects of a task. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Experimental renewal in human participants.

Two experiments with human participants are presented that differentiate renewal from other behavioral effects that can produce a response after extinction. Participants played a video game and learned to suppress their behavior when sensor stimuli predicted an attack. Contexts (A, B, & C) were provided by fictitious galaxies where the game play took place. In Experiment 1, participants who received conditioning in A, extinction in B, and testing in A showed some context specificity of conditioning during extinction and a recovery of suppression on test. Experiment 2 demonstrated recovery of extinguished responding when participants were conditioned in A, extinguished in B, and tested in C, a third, neutral context. The experiment also demonstrated that the context of extinction did not control performance by becoming inhibitory. Results are discussed in terms of mechanisms that can produce a response recovery after extinction. The experiments demonstrated a renewal effect: a response recovery that was not attributable to the contexts acting as simple conditioned stimuli and is the first work with human participants to conclusively do so. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Outcome Additivity and Outcome Maximality Influence Cue Competition in Human Causal Learning.

Recent research suggests that outcome additivity pretraining modulates blocking in human causal learning. However, the existing evidence confounds outcome additivity and outcome maximality. Here the authors present evidence for the influence of presenting information about outcome maximality (Experiment 1) and outcome additivity (Experiment 2) on subsequent forward blocking. The results of Experiment 3 confirm that, with outcome maximality controlled, outcome additivity affects backward blocking but not release from overshadowing. Finally, the results of Experiment 4 demonstrate that information about outcome additivity has a similar effect on forward blocking if presented after the blocking training instead of before. The results are compatible with the idea that blocking results from inferential processes at the time of testing and not from a failure to acquire associative strength during training. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Pavlovian to instrumental transfer of control in a human learning task.

Pavlovian learning tasks have been widely used as tools to understand basic cognitive and emotional processes in humans. The present studies investigated one particular task, Pavlovian-to-instrumental transfer (PIT), with human participants in an effort to examine potential cognitive and emotional effects of Pavlovian cues upon instrumentally trained performance. In two experiments, subjects first learned two separate instrumental response-outcome relationships (i.e., R1-O1 and R2-O2) and then were exposed to various stimulus-outcome relationships (i.e., S1-O1, S2-O2, S3-O3, and S4-) before the effects of the Pavlovian stimuli on instrumental responding were assessed during a non-reinforced test. In Experiment 1, instrumental responding was established using a positive-reinforcement procedure, whereas in Experiment 2, a quasi-avoidance learning task was used. In both cases, the Pavlovian stimuli exerted selective control over instrumental responding, whereby S1 and S2 selectively elevated the instrumental response with which it shared an outcome. In addition, in Experiment 2, S3 exerted a nonselective transfer of control effect, whereby both responses were elevated over baseline levels. These data identify two ways, one specific and one general, in which Pavlovian processes can exert control over instrumental responding in human learning paradigms, suggesting that this method may serve as a useful tool in the study of basic cognitive and emotional processes in human learning. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

Especial Skills: Their Emergence With Massive Amounts of Practice.

Differing viewpoints concerning the specificity and generality of motor skill representations in memory were compared by contrasting versions of a skill having either extensive or minimal specific practice. In Experiments 1 and 2, skilled basketball players more accurately performed set shots at the foul line than would be predicted on the basis of the performance at the nearby locations, suggesting considerable specificity at this distance. This effect was replicated even when the lines on the court were obscured (in Experiment 2). However, the effect was absent when jump shots were executed in Experiment 3. The authors argue that massive levels of practice at 1 particular member of a class of actions produce specific effects that allow this skill to stand out from the other members of the class, giving it the status of an especial skill. Various theoretical views are proposed to account for the development of these skills. (PsycINFO Database Record (c) 2011 APA, all rights reserved)     

Causal inference and related statistical methods

Statistical approaches for evaluating causal effects and for discovering causal networks are discussed in this paper.A causal relation between two variables is different from an association or correlation between them.An association measurement between two variables and may be changed dramatically from positive to negative by omitting a third variable,which is called Yule-Simpson paradox.We shall discuss how to evaluate the causal effect of a treatment or exposure on an outcome to avoid the phenomena of Yule-Simpson paradox. Surrogates and intermediate variables are often used to reduce measurement costs or duration when measurement of endpoint variables is expensive,inconvenient,infeasible or unobservable in practice.There have been many criteria for surrogates.However,it is possible that for a surrogate satisfying these criteria,a treatment has a positive effect on the surrogate,which in turn has a positive effect on the outcome,but the treatment has a negative effect on the outcome,which is called the surrogate paradox.We shall discuss criteria for surrogates to avoid the phenomena of the surrogate paradox. Causal networks which describe the causal relationships among a large number of variables have been applied to many research fields.It is important to discover structures of causal networks from observed data.We propose a recursive approach for discovering a causal network in which a structural learning of a large network is decomposed recursively into learning of small networks.Further to discover causal relationships,we present an active learning approach in terms of external interventions on some variables.When we focus on the causes of an interest outcome, instead of discovering a whole network,we propose a local learning approach to discover these causes that affect the outcome.     

Flexible use of recent information in causal and predictive judgments.

Associative and statistical theories of causal and predictive learning make opposite predictions for situations in which the most recent information contradicts the information provided by older trials (e.g., acquisition followed by extinction). Associative theories predict that people will rely on the most recent information to best adapt their behavior to the changing environment. Statistical theories predict that people will integrate what they have learned in the two phases. The results of this study showed one or the other effect as a function of response mode (trial by trial vs. global), type of question (contiguity, causality, or predictiveness), and postacquisition instructions. That is, participants are able to give either an integrative judgment, or a judgment that relies on recent information as a function of test demands. The authors concluded that any model must allow for flexible use of information once it has been acquired. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Reevaluating evaluative conditioning: A nonassociative explanation of conditioning effects in the visual evaluative conditioning paradigm.

In 2 studies, the authors investigated whether evaluative conditioning (EC) is an associative phenomenon. Experiment 1 compared a standard EC paradigm with nonpaired and no-treatment control conditions. EC effects were obtained only when the conditioned stimulus (CS) and unconditioned stimulus (UCS) were rated as perceptually similar. However, similar EC effects were obtained in both control groups. An earlier failure to obtain EC effects was reanalyzed in Experiment 2. Conditioning-like effects were found when comparing a CS with the most perceptually similar UCSs used in the procedure but not when analyzing a CS rating with respect to the UCS with which it was paired during conditioning. The implications are that EC effects found in many studies are not due to associative learning and that the special characteristics of EC (conditioning without awareness and resistance to extinction) are probably nonassociative artifacts of the EC paradigm. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Learned avoidance of flavors signaling reduction in a nutrient.

Food-deprived rats learned to avoid a flavor negatively correlated with access to a rich nutrient, 20% maltodextrin (20M) solution. This avoidance in two-bottle choice tests was produced by training consisting of either an unpaired condition where sessions of unflavored 20M were intermixed with sessions of 2 or 3% maltodextrin (2M or 3M) flavored with salt (Experiment 1) or almond (Experiments 3 and 4) or a differential conditioning procedure where one flavor was mixed with 20M and another with 2M (Experiment 2). Avoidance was counter-conditioned by mixing the target flavor with 20M (Experiment 1), generalized to a neutral context (Experiment 3), and displayed strong resistance to extinction (Experiment 4). The results demonstrated that food avoidance learning can occur in the absence of an aversive unconditioned stimulus and indicated that unpaired control groups and differential conditioning procedures may be misleading in flavor preference learning research when further control conditions are absent. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Reasoning rats: Forward blocking in Pavlovian animal conditioning is sensitive to constraints of causal inference.

Forward blocking is one of the best-documented phenomena in Pavlovian animal conditioning. According to contemporary associative learning theories, forward blocking arises directly from the hardwired basic learning rules that govern the acquisition or expression of associations. Contrary to this view, here the authors demonstrate that blocking in rats is flexible and sensitive to constraints of causal inference, such as violation of additivity and ceiling considerations. This suggests that complex cognitive processes akin to causal inferential reasoning are involved in a well-established Pavlovian animal conditioning phenomenon commonly attributed to the operation of basic associative processes. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Overshadowing and the outcome-alone exposure effect counteract each other.

Three conditioned lever-press suppression experiments with rats investigated the interaction between overshadowing and outcome-alone exposure effects. Experiment 1 found in first-order conditioning that combined overshadowing and outcome-preexposure treatments attenuate the response deficit produced by either treatment alone. Experiments 2 and 3 investigated the interaction between overshadowing and outcome pre- and postexposure effects in sensory preconditioning, varying retention intervals to engage recency and primacy effects with respect to treatment order. Contrary to when a solitary cue is conditioned, responding to a cue conditioned in compound appeared positively correlated with the context's associative status. These findings suggested that some of the basic laws of learning applicable to cues conditioned alone do not similarly apply to a component of a compound cue. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Effects of ethanol on encoding, consolidation, and expression of extinction following contextual fear conditioning.

Studies of contextual fear conditioning have found that ethanol administered prior to a conditioning session impairs the conditioned freezing response during a test session the next day. The present experiments examined the effects of ethanol on extinction, the loss of conditioned responding that occurs as the animal learns that a previously conditioned context no longer signals shock. Ethanol (1.5 g/kg) administered prior to single (Experiment 1) or multiple (Experiment 2) extinction sessions impaired extinction. Ethanol administered prior to a test session disrupted the expression of freezing after extinction (Experiments 3-5). There was some evidence that ethanol served as an internal stimulus signaling the operation of conditioning or extinction contingencies (Experiments 4-5). In Experiment 6, postsession injections of 1.5 g/kg ethanol had no effect on extinction with brief (3 min) or long (24 min) exposures to the context, but injections of 3 g/kg after long exposures impaired extinction. Together, these results indicate that ethanol affects extinction by acting on multiple learning and performance processes, including attention, memory encoding, and memory expression. (PsycINFO Database Record (c) 2010 APA, all rights reserved)