Acceleration of citing behavior after the millennium? Exemplary bibliometric reference analyses for psychology journals

With reference to social constructivist approaches on citing behavior in the sciences, the hypothesis of acceleration of citing behavior after the millennium was empirically tested for a stratified random sample of exemplary psychology journal articles. The sample consists of 45 English and 45 German articles published in the years 1985 versus 1995 versus 2005 in high impact journals on developmental psychology, psychological diagnosis and assessment, and social psychology. Content analyses of the reference lists refer to the total number of references cited in the articles and the publication years of all references. In addition, the number of self-references, the number of pages, and the number of authors were determined for each article. Results show that there is no acceleration of citing behavior; rather, on the contrary, a significant trend is revealed for an increase in authors’ citing somewhat older references in the newer journal articles. Significant main effects point also at more citations of somewhat older references in the English (vs. German) journal articles as well as in articles on social psychology and psychological diagnosis (vs. on developmental psychology). Complementary analyses show that multiple authorships and the number of pages as well as the total number of references and the number of self-references increase significantly with time. However, percentage of self-references remains quite stable at about 10%. Some methodological and statistical traps in bibliometric testing the starting hypothesis are considered. Thus, the talk that has been circulating among psychology colleagues and students on the potential millennium effects on citing behavior in the sciences (which can, however, become a self-fulfilling prophecy) are not confirmed—at least for psychology journals.     

A comparison of the scientific performance of the U.S. and the European union at the turn of the 21st century

In this paper, scientific performance is identified with the impact that journal articles have through the citations they receive. In 15 disciplines, as well as in all sciences as a whole, the EU share of total publications is greater than that of the U.S. However, as soon as the citations received by these publications are taken into account the picture is completely reversed. Firstly, the EU share of total citations is still greater than the U.S. in only seven fields. Secondly, the mean citation rate in the U.S. is greater than in the EU in every one of the 22 fields studied. Thirdly, since standard indicators—such as normalized mean citation ratios—are silent about what takes place in different parts of the citation distribution, this paper compares the publication shares of the U.S. and the EU at every percentile of the world citation distribution in each field. It is found that in seven fields the initial gap between the U.S. and the EU widens as we advance towards the more cited articles, while in the remaining 15 fields—except for Agricultural Sciences—the U.S. always surpasses the EU when it counts, namely, at the upper tail of citation distributions. Finally, for all sciences as a whole the U.S. publication share becomes greater than that of the EU for the top 50% of the most highly cited articles. The data used refers to 3.6 million articles published in 1998–2002, and the more than 47 million citations they received in 1998–2007.     

Galton 2011 revisited: a bibliometric journey in the footprints of a universal genius

Commemorating the 100th death anniversary of Francis Galton, this paper is a bibliometric impact analysis of the works of this outstanding scientist and predecessor of scientometrics. Citation analysis was done in Web of Science, Scopus and Google Scholar (Publish or Perish) in order to retrieve the most cited books and journal articles. Additionally references were identified where Galton was rather mentioned than cited in order to analyze the phenomenon of obliteration by incorporation. Finally occurrence counts of Galton’s works in obituaries, Festschrift, the website Galton.org, major encyclopaedias and biographical indexes were compared to citation counts. As an outcome Galton’s works are increasingly cited or mentioned. Obliteration (use of eponyms) applies to one-third of Galton’s works and seems to be typical for fields like mathematics or statistics, whereas citations are more common in psychology. The most cited books and journal articles are also the most mentioned with remarkable correlation. Overall citation analysis and occurrence counting are complementary useful methods for the impact analysis of the works of “giants”.     

Citation patterns in the Kuwaiti journal Medical Principles and Practice: The first 12 years, 1989-2000

This study investigates the citation patterns in the journal, Medical Principles and Practice from its inception in 1989 through 2000 (volumes 1-9). The data set includes 4740 references appended to the 221 original research articles. All of the citations were entered into a ProCite database for analysis. Specifically, this study addresses: (1) bibliometric patterns of cited works in terms of publication format, subject scatter, authorship characteristics, age of citations, geographic distribution, and language distribution; (2) productivity of journal titles; (3) the role of self-citation; and (4) how selected bibliometric indicators apply. Some of the findings include: journal articles are most frequently cited; English language publications dominate the literature; there is a trend of multiple authorship; and the pattern of aging is below the norm for medical literature. The results of the study can provide a benchmark to measure the user behavior of a particular group of researchers as well as for the provision of collection development and management decisions. This revised version was published online in August 2006 with corrections to the Cover Date.     

In matters of quantitative studies of science the fault of theorists is offering too little and asking too much

In this paper we take position in the ‘citation theory’ debate. First we revisit relevant earlier work of our group and try to assemble the findings. We criticise the constructivist fashion in sociology of science concerning citation practices. With statistical arguments we show the strong limitations of any ‘citation theory’ at the ‘citer side’. We emphasize that citations should be conceived of as ‘binding properties’ of an individual publication, from which many types of structuring follow. As keywords also have such binding properties at the same time, and as there are empirically established relations between the citation domain and the word domain, it is useless to develop a model concerning citations only. We envisage an interesting development, both theoretically and empirically, of what we would like to call ‘bibliometric chemistry’.     

Citation patterns in little science and big science

The classification of citations by their context, previously formulated and used for other studies, is employed here to see if the citation patterns of big and little science are different or not. Theoretical physics articles in 1935 and 1955 are thus compared. No significant differences were found except in the number of references per article which increased significantly from 1935 to 1955, and again to 1968. It is found, however, that the German journal Zeitschrift für Physik has considerably higher percentages of conceptual, organic, and evolutionary citations, both in 1935 and in 1955, than The Physical Review. The interpretation of this difference remains unclear.     

A study on the citation situation within the citing paper: citation distribution of references according to mention frequency

Citation impact indicators play a significant role in evaluating the scientific research activity. Most of citation impact indicators are based on the citation count that the publication is cited as a reference in the other publications, but the difference between each citation situation was not considered. Normally, the number of citations that a publication is cited in the other publications may represent the formal quality of the publication. Similarly, the number of times that a publication is really mentioned within the citing publication, it may also represent the formal quality of the citation. We have examined about how many times each reference was really mentioned within the citing publications and studied about the citation situation within the citing publications. We verified that the citation distribution of references according to the mention frequency follows the Generalized Pareto distribution. The results showed that about 20% of total references were mentioned three and more times, and the number of citation mentions for the about 50% of total references were from about 20% of the total references in the citing publications.     

Characterizing a scientific elite (B): publication and citation patterns of the most highly cited scientists in environmental science and ecology

Science is principally driven by the efforts of a vanishingly small fraction of researchers publishing the majority of scientific research and garnering the majority of citations. Despite this well-established trend, knowledge of exactly how many articles these researchers publish, how highly they are cited, and how they achieved their distinctive accomplishments is meager. This article examines the publication and citation patterns of the world’s most highly cited environmental scientists and ecologists, inquiring into their levels of scientific productivity and visibility, examining relationships between scientific productivity and quality within their research programs, and considering how different publication strategies contribute to these distinctive successes. Generally speaking, highly cited researchers are also highly productive, publishing on average well over 100 articles each. Furthermore, articles published by this group are more highly cited on average than articles published in premier generalist journal like Nature and Science, and their citation to publication ratios are more equitably distributed than is typical. Research specialization and primacy of authorship are important determinants of citation frequency, while geographic differences and collaborative propensity matter less. The article closes with a set of suggestions for those wishing to increase the use of their research by the scientific community.     

The nature and relationship between the productivity of journals and their citations in semiconductor literature

The purpose of this study was to investigate the relationship between journals" productivity and their citations in the field of semiconductors. Journal samples were gathered from the INSPEC database, 1978 to 1997 while the data of citation frequency, impact factor, cited half-life and citing half-life were obtained from Science Citation Index, Journal Citation Reports 1997 CD-ROM edition. One thousand and eight hundred and seventy seven journals publishing articles on semiconductors were retrieved. The nature for the data of journal productivity, impact factor, cited half-life and citing half-life are explored. Among these journals, only 672 journals that were covered in JCR were compared. Moreover, statistical tests of more productive journals with cumulative publication in semiconductor >100 were also conducted on the basis of all articles they published annually (for 1997). The results of the study showed that there is a significant correlation between journal productivity and citation frequency and between journal productivity and impact factor. However, there are no associations between journal productivity and cited half-life and between journal productivity and citing half-life. This revised version was published online in August 2006 with corrections to the Cover Date.     

Renewable energy research 1995–2009: a case study of wind power research in EU, Spain, Germany and Denmark

The paper reports the developments and citation patterns over three time periods of research on Renewable Energy generation and Wind Power 1995–2011 in EU, Spain, Germany and Denmark. Analyses are based on Web of Science and incorporate journal articles as well as conference proceeding papers. Scientometric indicators include publication collaboration ratios, top-player distribution as well as citedness and correspondence analyses of citing publications, relative citation impact, distributions of top-cited as well as top-citing institutions and publication sources and cluster analysis of citing title terms to map knowledge export areas. Findings show an increase in citation impact for Renewable Energy and Wind Power research albeit hampered by scarcely cited conference papers. Although EU maintains its global top position in producing Renewable Energy and Wind Power research the developments of EU and German world shares as well as citation impact are negative during the most recent 7 year period. During the same time the citation impact of Spain and Denmark increase and place both nations among the top-ranking countries in Wind Power research. Spain is the only EU country that increases its world production share from 2000. China is currently ranked three after EU and USA in research output, however with a very low citation impact. Spain, Denmark and Germany each demonstrates distinct collaboration patterns and publication source and citation distribution profiles. More than half the citations to EU Wind Power research are EU-self citations. An expected intensified EU collaboration in the Wind Energy field does not come about. The most productive research institutions in Denmark and Spain are also the most cited ones.     

The motivation for citing specific references by social scientists in Korea: The phenomenon of co-existing references

This study, based on the premise that references are a social product that reflects the social environment of a society, is an attempt to explore the co-existence of Korean and non-Korean literature in the references to Korean papers. 321 authors (papers) who published in 43 issues of 24 Korean journals focused on the social sciences were surveyed about their research channels and citation motivations, and the 11,358 references in the papers were analyzed. The findings were as follows : (1) The extent of the co-existence was that non-Korean literature was cited 1.9 times (65.3%) more often than Korean literature; (2) Research channel was the most common non-Korean channel orientation (55.8%); (3) The motivation for citations was significantly dependent on whether the literature cited was Korean or non-Korean. Non-Korean literature was chiefly cited for conceptual (20.7%), perfunctory (16.0%), and persuasive (15.1%) motivations; (4) The citations and citation motivations behind non-Korean literature were significantly influenced by research channel, discipline, focus of research, publishing career, and type of paper. Of these variables, research channel was frequently related to the citation of non-Korean literature. Finally, this study is very suggestive on two counts: (1) Citation motivation might constitute a new approach for exploring the production of knowledge by researchers. (2) This study has demonstrated, in particular, an empirical relationship between knowledge produced by Korean social scientists and non-Korean knowledge through the analysis of citation motivation.     

What factors are associated with increasing co-authorship in the social sciences? A case study of Danish Economics and Political Science

We examine the relative strength of short-term citation counts, bibliometric measures such as journal impact factors, and journal rankings in terms of predicting long-run citations. Using a set of articles published in sixty of the highest reputation economics journals in 1994, we find that citations received over fairly short windows (between 1 and 2 years after publication) are much stronger predictors of long-run citation counts compared with journal impact factors or other journal rankings. Our results are robust to a series of robustness checks. These findings suggest department heads and tenure and promotion committees should place greater weight on short-term citations as opposed to article placement when making personnel decisions.     

Citation time window choice for research impact evaluation

This paper aims to inform choice of citation time window for research evaluation, by answering three questions: (1) How accurate is it to use citation counts in short time windows to approximate total citations? (2) How does citation ageing vary by research fields, document types, publication months, and total citations? (3) Can field normalization improve the accuracy of using short citation time windows? We investigate the 31-year life time non-self-citation processes of all Thomson Reuters Web of Science journal papers published in 1980. The correlation between non-self-citation counts in each time window and total non-self-citations in all 31 years is calculated, and it is lower for more highly cited papers than less highly cited ones. There are significant differences in citation ageing between different research fields, document types, total citation counts, and publication months. However, the within group differences are more striking; many papers in the slowest ageing field may still age faster than many papers in the fastest ageing field. Furthermore, field normalization cannot improve the accuracy of using short citation time windows. Implications and recommendations for choosing adequate citation time windows are discussed.     

The impact of internet resources on scholarly communication: A citation analysis

The quality and credibility of Internet resources has been a concern in scholarly communication. This paper reports a quantitative analysis of the use of Internet resources in journal articles and addresses the concerns for the use of Internet resources scholarly journals articles. We collected the references listed in 35,698 articles from 14 journals published during 1996 to 2005, which resulted in 1,000,724 citations. The citation data was divided into two groups: traditional citations and Web citations, and examined based on frequencies of occurrences by domain and type of Web citation sources. The findings included: (1) The number of Web citations in the journals investigated had been increasing steadily, though the quantity was too small to draw an inclusive conclusion on the data about their impact on scientific research; (2) A great disparity existed among different disciplines in terms of using information on the Web. Applied disciplines and interdisciplinary sciences tended to cite more information on the Web, while classical and experimental disciplines cited little of Web information; (3) The frequency of citations was related to the reputation of the author or the institution issuing the information, and not to the domain or webpage types; and (4) The researchers seemed to lack confidence in Internet resources, and Web information was not as frequently cited as reported in some publications before. The paper also discusses the need for developing a guideline system to evaluate Web resources regarding their authority and quality that lies in the core of credibility of Web information.     

Scientific linkage of science research and technology development: a case of genetic engineering research

In this study, the author tried to demonstrate the linkage between science research and technology development through non-patent citation analysis to reveal that the important knowledge resources from science research had significant impact on technology development. Genetic engineering technology was the field examined in this study. From the references listed in the patents, it was observed that the technology development in genetic engineering was influenced heavily by the research done by public sector. Over 90% of the citations were non-patent literatures, and the majority of non-patent citations were journal articles. Citing preferences, such as country preference and institute preference were observed from the data included in this study.     

Effects of disciplines and countries on citation habits. An analysis of empirical papers in behavioural sciences

The theoretical introductions in empirical journal articles have been analyzed looking for factors determining citation habits. Own-country-biases and English-American predominance in citations were not regularly found. Preferred language of the cited publications and absolute citation frequencies were dependent upon both the disciplines and the countries where the journals are published. However, relative citation frequencies (citations related to the length of the text available) have been found to be rather constant across countries (within psychology and psychiatry, respectively) which indicates no such dependence.     

Characteristics of papers published in journals: an analysis of open access journals,country of publication,and languages used

This study explores how the citation of open access (OA) journal articles occurs by analyzing the impact of certain journal characteristics, namely, whether the journal is OA and whether its country of publication is the same as the affiliation of a paper’s author. As the language of a paper is an important factor contributing to paper citations, this study uses papers in English. This analysis included publications from 77 countries from 2010 to 2012. This analysis included 19,530 journals and 3,215,742 papers without duplication. The results showed that papers published in OA and international journals were cited in more countries than non-OA and domestic journals, and a higher percentage of these were being cited by foreign countries. From these findings, it was determined that the more widely accessible OA journals were effectively being accessed by researchers from multiple countries. However, of the top 10% most cited papers in international journals, a higher percentage of these came from non-OA compared to OA journals. Among domestic journals, no such difference was found. Papers published in non-OA international journals were most cited in foreign countries with a large number of published papers. Hence, the effect of OA’s expanded accessibility, while having an apparent effect on heightening the interest of foreign readership, has a limited impact in terms of increasing citations.     

Publication delays in the science field and their relationship to the ageing of scientific literature

This article presents an exploratory analysis of publication delays in the science field. Publication delay is defined as the time period between submission and publication of an article for a scientific journal. We obtained a first indication that these delays are longer with regard to journals in the fields of mathematics and technical sciences than they are in other fields of science. We suggest the use of data on publication delays in the analysis of the effects of electronic publishing on reference/citation patterns. A preliminary analysis on a small sample suggests that—under rather strict assumptions—the cited half-life of references may be reduced with a factor of about 2 if publication delays decrease radically.     

The citation impact of social sciences and humanities upon patentable technology

This paper examines the citation impact of papers published in scientific-scholarly journals upon patentable technology, as reflected in examiner- or inventor-given references in granted patents. It analyses data created by SCImago Research Group, linking PATSTAT’s scientific non-patent references (SNPRs) to source documents indexed in Scopus. The frequency of patent citations to journal papers is calculated per discipline, year, institutional sector, journal subject category, and for “top” journals. PATSTAT/Scopus-based statistics are compared to those derived from Web of Science/USPTO linkage. A detailed assessment is presented of the technological impact of research publications in social sciences and humanities (SSH). Several subject fields perform well in terms of the number of citations from patents, especially Library and Information Science, Language and Linguistics, Education, and Law, but many of the most cited journals find themselves in the interface between SSH and biomedical or natural sciences. Analyses of the titles of citing patents and cited papers are presented that shed light upon the cognitive content of patent citations. It is proposed to develop more advanced indicators of citation impact of papers upon patents, and ways to combine citation counts with citation content and context analysis.