Accurate tests of statistical significance for rWG and average deviation interrater agreement indexes.

The authors demonstrated that the most common statistical significance test used with rWG-type interrater agreement indexes in applied psychology, based on the chi-square distribution, is flawed and inaccurate. The chi-square test is shown to be extremely conservative even for modest, standard significance levels (e.g., .05). The authors present an alternative statistical significance test, based on Monte Carlo procedures, that produces the equivalent of an approximate randomization test for the null hypothesis that the actual distribution of responding is rectangular and demonstrate its superiority to the chi-square test. Finally, the authors provide tables of critical values and offer downloadable software to implement the approximate randomization test for rWG type and for average deviation (AD)-type interrater agreement indexes. The implications of these results for studying a broad range of interrater agreement problems in applied psychology are discussed. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Assessing interrater agreement on the job relevance of a test: A comparison of CVI, T, rWG(J)}, and r*WG(J)} indexes.

This article examines the problem of estimating interrater agreement about the job relevance of test items by examining 4 different indexes: C. H. Lawshe's (1975) Content Validity Index (CVI); H. E. A. Tinsley and D. J. Weiss's (1975) T; L. R. James, R. G. Demaree, and G. Wolf's (1984) r{wg(j)}; and M. K. Lindell, C. J. Brandt, and D. J. Whitney's (1999) r*{wg(j)}. These 4 indexes are shown to be systematically related to each other, but r*{wg(j)} is computationally simpler and is more generally applicable than the other indexes. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

rwg: An assessment of within-group interrater agreement.

F. L. Schmidt and J. E. Hunter (1989) critiqued the within-group interrater reliability statistic (rwg) described by L. R. James et al (1984). S. W. Kozlowski and K. Hattrup (1992) responded to the Schmidt and Hunter critique and argued that rwg is a suitable index of interrater agreement. This article focuses on the interpretation of rwg as a measure of agreement among judges' ratings of a single target. A new derivation of rwg is given that underscores this interpretation. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Testing the significance of Kendall's τ and Spearman's r[s]..

An overview of procedures for testing the significance of Kendall's τ and Spearman's r[s], as presented in well-known textbooks for the behavioral sciences, is given. Testing Kendall's τ proceeds in an almost uniform way and seldom leads to erroneous conclusions. For N?>?20, the exact test can be replaced by an approximate z test. Testing Spearman's r[s] varies from textbook to textbook. Some textbooks present tables with significant values that are in error; this seems partly due to the discrete character of r[s]. The well-known Statistical Package for the Social Sciences computer package presents false results, both for τ and for r[s], when N is small. Although tables for exact tests of r[s] for N?=?12(1)16 exist, they seem to be unknown to textbook writers, except Zar (1984). Testing ΣD–2 instead of r[s] prevents a clear view of the degree of dependence. For these reasons, a table with exact values of r[s] for α?=?.01 and .05, one- and two-tailed, is presented for N?=?4(1)16. For N?>?16, an approximate t test may be used, although Zar's (1972, 1984) approximation yields slightly better results. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Killeen's (2005) prep coefficient: Logical and mathematical problems.

In his article, “An alternative to null-hypothesis significance tests,” Killeen (2005) urged the discipline to abandon the practice of pobs-based null hypothesis testing and to quantify the signal-to-noise characteristics of experimental outcomes with replication probabilities. He described the coefficient that he invented, prep, as the probability of obtaining “an effect of the same sign as that found in an original experiment” (Killeen, 2005, p. 346). The journal Psychological Science quickly came to encourage researchers to employ prep, rather than pobs, in the reporting of their experimental findings. In the current article, we (a) establish that Killeen's derivation of prep contains an error, the result of which is that prep is not, in fact, the probability that Killeen set out to derive; (b) establish that prep is not a replication probability of any kind but, rather, is a quasi-power coefficient; and (c) suggest that Killeen has mischaracterized both the relationship between replication probabilities and statistical inference, and the kinds of claims that are licensed by knowledge of the value assumed by the replication probability that he attempted to derive. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

When effect sizes disagree: The case of r and d.

The increased use of effect sizes in single studies and meta-analyses raises new questions about statistical inference. Choice of an effect-size index can have a substantial impact on the interpretation of findings. The authors demonstrate the issue by focusing on two popular effect-size measures, the correlation coefficient and the standardized mean difference (e.g., Cohen's d or Hedges's g), both of which can be used when one variable is dichotomous and the other is quantitative. Although the indices are often practically interchangeable, differences in sensitivity to the base rate or variance of the dichotomous variable can alter conclusions about the magnitude of an effect depending on which statistic is used. Because neither statistic is universally superior, researchers should explicitly consider the importance of base rates to formulate correct inferences and justify the selection of a primary effect-size statistic. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Direct estimates of SDy and the implications for utility analysis.

Utility analysis suggests that human resources policies can have an economically significant impact on business organizations. Confidence in such conclusions, however, requires an accurate estimate of SDy. This article provides a validity check on prevailing subjective methods of SDy estimation by directly estimating SDy from unique field data. Using both simulated and field data, the range of potential bias associated with predictor unreliability in regression analyis is illustrated, and how to calculate corrected values is shown. The methodological problems of directly estimating SDy with organizational data is discussed, and a range of estimates for SDy is provided. Direct estimation of SDy yielded values ranging from 74% to 100% of mean salary, which are considerably greater than conventional subjective judgments. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

A model-averaging approach to replication: The case of prep.

The purpose of the recently proposed prep statistic is to estimate the probability of concurrence, that is, the probability that a replicate experiment yields an effect of the same sign (Killeen, 2005a). The influential journal Psychological Science endorses prep and recommends its use over that of traditional methods. Here we show that prep overestimates the probability of concurrence. This is because prep was derived under the assumption that all effect sizes in the population are equally likely a priori. In many situations, however, it is advisable also to entertain a null hypothesis of no or approximately no effect. We show how the posterior probability of the null hypothesis is sensitive to a priori considerations and to the evidence provided by the data; and the higher the posterior probability of the null hypothesis, the smaller the probability of concurrence. When the null hypothesis and the alternative hypothesis are equally likely a priori, prep may overestimate the probability of concurrence by 30% and more. We conclude that prep provides an upper bound on the probability of concurrence, a bound that brings with it the danger of having researchers believe that their experimental effects are much more reliable than they actually are. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Photoluminescent properties of Ca2Gd8（SiO4）6O2： Dy^3＋ phosphor films prepared by sol-gel process

There are growing interests on phosphor thin films owing to their potential application in high-resolution devices such as cathode ray tubes and flat panel display devices. The solution-based sol-gel method is one of the most important techniques for the synthesis of various functional coating films. Compounds with the apatite structure are very suitable host lattices for various luminescent ions. Ca2RE8（SiO4）6O2 （ RE=Y, Gd, La ） is a kind of ternary rare-earth-metal silicate with oxyapatite structure, which has been used as host material for the luminescence of various rare earth and mercury-like ions. In this article, Ca2Gd8（SiO4）6O2：Dy^3＋phosphor films were dip-coated on quartz glass substrates through the sol-gel process. X-ray diffraction （XRD）, atomic force microscopy （AFM）, photoluminescence （PL） spectra, as well as lifetimes were used to characterize the resulting films. AFM study revealed that the phosphor films consisted of homogeneous particles. The Dy^3＋ showed its characteristic emission in crystalline phosphor films, i.e., ^4F9/2-^6H15/2 and ^4F9/2-^6H13/2.     

Luminescent properties of Eu~（3＋） doped Gd_2WO_6 and Gd_2（WO_4）_3 nanophosphors prepared via co-precipitation method

Eu3+ doped Gd2WO6 and Gd2(WO4)3 nanophosphors with different concentrations were prepared via a co-precipitation method. The structure and morphology of the nanocrystal samples were characterized by using X-ray diffraction (XRD) and field emission scanning electron microscopy (FE-SEM), respectively. The emission spectra and excitation spectra of samples were measured. J-O parameters and quantum efficiencies of Eu3+ 5D0 energy level were calculated, and the concentration quenching of Eu3+ luminescence in different matrixes were studied. The results indicated that effective Eu3+:5D0-7F2 red luminescence could be achieved while excited by 395 nm near-UV light and 465 nm blue light in Gd2WO6 host, which was similar to the familiar Gd2(WO4)3:Eu. Therefore, the Gd2WO6:Eu red phosphors might have a potential application for white LED.     

Depression or social desirability: Comments on Edward's appraisal of the D30 scale.

4 content-specific SD measures from Edwards' 39-item SD scale were correlated with each other, SD scale scores, D30 scores, and Depression ratings for 40 Peace Corps trainees. Low intercorrelations among SD measures (r = .31) suggested that SD as a general response tendency may be relatively unimportant vis-a-vis SD tendencies in specific content areas. Part-whole r's showed that Edwards' scale scores reflected differences for Affect and Interpersonal items, not for Health or Cognitive items, suggesting that the total scale is not a measure of general SD response tendencies. Highly significant correlations with Depression ratings indicate that both the D30 scale and 1 component of the SD scale (Affect) are meaningful measures of clinical depression. Edwards' interpretation of D30 as an SD measure was discarded. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Some properties of requivalent: A simple effect size indicator.

One version of requivalent, calculated from Fisher's exact test p values and recommended for small samples, is considered "a more realistic . . . [and] a more accurate estimate of the population correlation than . . . the sample correlation, rsample" (R. Rosenthal & D. B. Rubin, 2003, p. 494). Small sample properties of rsample and of two effect size estimators (requivalent* and rhybrid) that use requivalent were examined: rsample is preferable to requivalent* (defined as requivalent used without restrictions) in terms of bias and mean squared error (MSE); rhybrid (defined as requivalent only when rsample = 1.0) is generally preferable to requivalent*, and preferable to rsample in terms of MSEs, except when population correlations are very large. Conditions favoring rsample over requivalent* and rhybrid in meta-analyses are noted. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Crystal Growth and Spectral Properties of Yb^3＋ ：KY（WO4 ）2

Laser crystal Yb:KYW was grown by the Kyropoulos method. A grown crystal was identified as β-Yb:KYW by XRD. By TG-DTA the melting point and transition point of the crystal are 1045 and 1010 °C, respectively. Infrared spectrum and Raman spectrum were measured, and the vibrational frequencies of infrared and Raman active modes for Yb:KYW crystal were assigned. Absorption spectrum of Yb:KYW shows that there are two intensive absorption peaks at 940 and 980 nm, respectively, and the absorption cross section is 1.34 × 10⁻¹⁹ cm² at chief peak of 980 nm. There exist three intensive emission peaks in Yb:KYW at 990, 1010 and 1030 nm, respectively, and the emission line width of the chief peak 1030 nm runs up to 16 nm. It was calculated that the peak emission cross section is 3.1 × 10⁻²⁰ cm² at 1030 nm.     

Toward Improved Statistical Reporting in the Journal of Consulting and Clinical Psychology.

Philip Kendall's (1997) editorial encouraged authors in the Journal of Consulting and Clinical Psychology (JCCP) to report effect sizes and clinical significance. The present authors assessed the influence of that editorial--and other American Psychological Association initiatives to improve statistical practices--by examining 239 JCCP articles published from 1993 to 2001. For analysis of variance, reporting of means and standardized effect sizes increased over that period, but the rate of effect size reporting for other types of analyses surveyed remained low. Confidence interval reporting increased little, reaching 17% in 2001. By 2001, the percentage of articles considering clinical (not only statistical) significance was 40%, compared with 36% in 1996. In a follow-up survey of JCCP authors (N=62), many expressed positive attitudes toward statistical reform. Substantially improving statistical practices may require stricter editorial policies and further guidance for authors on reporting and interpreting measures. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Egomania rageosis: A proposed new syndrome for the Diagnostic and Statistical Manual of Mental Disorders (V).

This paper describes a serious new disorder--Egomania Rageosis--which is approaching epidemic incidence in academia. The symptoms, epidemiology, and treatment of Egomania are described, and empirical work is reviewed. It is proposed that the syndrome be included in the Diagnostic and Statistical Manual of Mental Disorders (V). Those persons in whom a prolonged relationship with academia has given rise to deep-seated, unconscious feelings of irreverence will find the paper of both heuristic and therapeutic value. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Amphetamine and the adenosine A2A antagonist KW-6002 enhance the effects of conditional temporal probability of a stimulus in rats.

As the length of foreperiod preceding an imperative signal increases, reaction time decreases and anticipatory (prior to the signal) responding increases. The authors designed a task to dissociate the effect of elapsing time in the foreperiod and conditional temporal probability of the imperative stimulus. The effects of 2 drugs--amphetamine and KW-6002--known to enhance the effect of foreperiod were compared. Three groups of rats were trained to respond to an auditory signal presented at 1 of 3 foreperiods, unpredictable from trial to trial. The length of preparation time was different for each group, but conditional temporal probability was the same. Reaction times were faster as a function of increased preparation time, whereas anticipatory responses were strongly modulated by conditional probability. Both amphetamine and KW-6002 speeded reaction times and increased anticipatory responding. The pattern of behavior was consistent with the suggestion that they enhanced the motor preparatory effects of conditional probability rather than speeded a timing process. The authors concluded that preparation time and expectancy (conditional temporal probability of an imperative signal) have differential effects on performance and that amphetamine and KW-6002 enhance the effect of expectancy. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

ACTH and ACTH4–20 modification of neophobia and taste aversion responses in the rat.

A series of 6 experiments assessed the effects of ACTH and the ACTH analog ACTH4–20 on drinking in conditioned taste aversion and neophobic situations using a total of 168 male Sprague-Dawley rats as Ss. Both substances delayed the extinction of a conditioned taste aversion established by a single pairing of lithium chloride with milk (Exp I). However, in this situation, the ACTH parent peptide was more potent behaviorally. ACTH supressed milk consumption in Ss with no toxicosis experience (Exp II). This effect was apparently not due to the conditioning of a taste aversion (Exp III) with ACTH serving as a weak aversive UCS. Exogenous ACTH (Exp IV) or ACTH4–20 (Exp V) did not enhance neophobia; however, repeated injections of ACTH suppressed drinking. This ACTH suppression was related to the familiarity/novelty of the substance being consumed. The neophobic response to milk was not accompanied by pituitary-adrenal activation (Exp VI). Both neophobic and conditioned taste aversion situations appear to be useful for assessing peptide effects on consummatory behavior. (36 ref) (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Jubilee of the Psychological Review: Fifty volumes of the Psychological Review..

Presents a historical overview of the Psychological Review, and discusses the environment in which it was founded in 1894 and its subsequent evolution. The roles of J. M. Cattell and J. M. Baldwin in founding the Psychological Review are discussed. Key early contributors and their papers are also briefly reviewed. (PsycINFO Database Record (c) 2010 APA, all rights reserved)     

Modified Prenatal Sensory Stimulation Influences Postnatal Behavioral and Perceptual Responsiveness in Bobwhite Quail Chicks (Colinus virginianus).

Asynchronous bimodal stimulation during prenatal development elicits higher levels of behavioral and physiological arousal in precocial avian embryos than does unimodal sensory stimulation. To investigate whether the increased arousal associated with prenatal bimodal stimulation has enduring effects into postnatal development, bobwhite quail (Colinus virginianus) embryos received no supplemental stimulation, unimodal auditory stimulation, or bimodal (audiovisual) stimulation prior to hatching. Embryos exposed to concurrent bimodal stimulation demonstrated greater levels of behavioral activity and failed to use maternal visual cues to successfully direct species-specific perceptual preferences following hatching. These results provide initial evidence that asynchronous bimodal sensory stimulation during prenatal development can have enduring effects on early postnatal behavioral arousal and perceptual responsiveness and suggest that developmental limitations on prenatal sensory stimulation play an important role in the emergence of species-typical behavior. (PsycINFO Database Record (c) 2010 APA, all rights reserved)