Vitaly L. Ginzburg—A Bibliometric Study

In this study the impact of the works of Vitaly Ginzburg has been analyzed by bibliometric methods. The time-dependent number of mentions of his name, the overall citation impact and the citation numbers of single articles and books have been investigated. The impact time curves of his most frequently cited articles and books are presented and discussed. The scientific contributions of the most influential Ginzburg works are analyzed, in particular their impact on recent research.     

Comparison of citation and usage indicators: the case of oncology journals

It is the objective of this article to examine in which aspects journal usage data differ from citation data. This comparison is conducted both at journal level and on a paper by paper basis. At journal level, we define a so-called usage impact factor and a usage half-life in analogy to the corresponding Thomson’s citation indicators. The usage data were provided from Science Direct, subject category “oncology”. Citation indicators were obtained from JCR, article citations were retrieved from SCI and Scopus. Our study shows that downloads and citations have different obsolescence patterns. While the average cited half-life was 5.6 years, we computed a mean usage half-life of 1.7 years for the year 2006. We identified a strong correlation between the citation frequencies and the number of downloads for our journal sample. The relationship was lower when performing the analysis on a paper by paper basis because of existing variances in the citation-download-ratio among articles. Also the correlation between the usage impact factor and Thomson’s journal impact factor was “only” moderate because of different obsolescence patterns between downloads and citations.     

Citation analysis of Ted Nelson’s works and his influence on hypertext concept

This study investigates Ted Nelson’s works and the influence of his hypertext concept through citation analysis, including citation counting, characteristics of citing articles on language, document type, citing year, discipline, and citation content. The selection of the Nelson’s works was based on searching Library Literature & Information Science, Library and Information Science Abstracts, Google and Yahoo search engines. The citation data were compiled from the database of Web of Science. The results of the study reveal that hypertext has directly great impact on information retrieval and world wide web; therefore, the concept has had profound influence on information, library and computer science disciplines. Moreover, the influence of Nelson’s works spreads to other disciplines variously, especially on education, literature, business and economics, engineering, sociology, psychology, etc. The citation context analysis of citing articles on information and library science reveals that (1) definition, orientation and general introduction of hypertext; (2) relation of Vannevar Bush and Ted Nelson in terms of hypertext; (3) Nelson’s Xanadu system and its component of hypertext; (4) the application of hypertext in information science and library science are four most citing purpose.     

The multi-dimensionality of journal impact

In recent studies the issue of the relatedness between journal impact factors and other measures of journal impact have been raised and discussed from both merely empirical and theoretical perspectives. Models of the underlying citation processes suggest distributions with two or more free parameters. Proceeding from the relation between the journals’ mean citation rate and uncitedness and the assumption of an underlying Generalised Waring Distribution (GWD) model, it is found that the journal impact factor alone does not sufficiently describe a journal’s citation impact, while a two-parameter solution appropriately reflects its main characteristics. For the analysis of highly cited publications an additional model derived from the same GWD is suggested. This approach results in robust, comprehensible and interpretable solutions that can readily be applied in evaluative bibliometrics.     

National research contributions: A case study on Finnish biomedical research

The long-term influence and contribution of research can be evaluated relatively reliably by bibliometric citation analysis. Previously, productivity of nations has been estimated by using either the number of published articles or journal impact factors and/or citation data. These studies show certain trends, but detailed analysis is not possible due to the assumption that all articles in a journal were equally cited. Here we describe the first comprehensive, longterm, nationwide analysis of scientific performance. We studied the lifetime research output of 748 Finnish principal investigators in biomedicine during the years 1966–2000, analysed national trends, and made a comparison with international research production. Our results indicate that analyses of the scientific contribution of persons, disciplines, or nations should be based on actual publication and citation counts rather than on derived information like impact factors. 51% of the principal investigators have published altogether 75% of the articles; however, the whole scientific community has contributed to the growth of biomedical research in Finland since the Second World War.     

Journals of general &; internal medicine and surgery: An analysis and comparison of citation

Summary The purpose of this study is to analyze and compare journal citation data, from Journal Citation Reports on the Web 2000, of general and internal medicine and surgery. The source items and five kinds of citation data, i.e. citation counts, impact factor, immediacy index, citing half-life and cited half-life are examined and the correlation between each of the fifteen pairs of citation data is determined based on the Pearson correlation tests. The Fishers Z-transform was employed to test the significant difference between the Pearson correlation coefficient for each pair of citation data of these two subject areas. The following results of this work reveal: the frequently published journals are cited more frequently and also with high impact factor and immediacy index, in addition, they are usually accompanied with short citing half-life (i.e., usually cite current literature). The impact factor and immediacy index has significant correlation with citation counts. A significant correlation also exists between impact factor and immediacy index. However there is no correlation between cited half-life and other citation data, except citing half-life. For journals of general and internal medicine and surgical medicine, there are no significant difference of the Pearson correlation coefficient for the following pair of citation data: source items and citation counts, source items and impact factor, source items and citing half-life, citation counts and citing half-life, impact factor and citing half-life, immediacy index and citing half-life, and cited half-life and citing half-life.     

A bibliometric analysis and comparison on three information science journals: JASIST,IPM, JOD, 1998–2008

Employing a citation analysis, this study explored and compared the bibliometric characteristics and the subject relationship with other disciplines of and among the three leading information science journals, Journal of the American Society for Information Science and Technology (JASIST), Information Processing and Management and Journal of Documentation. The citation data were drawn from references of each article of the three journals during 1998 and 2008. The Ulrich’s Periodical Directory, Library of Congress Subject Heading, retrieved from the WorldCat, and LISA database were used to identify the main class, subclass and subject of cited journals and books. Quantitative results on the number of JASIST, IPM and JOD literature references, average number of references cited per paper, document type of cited literature and the journal self-citation rate are reported. Moreover, the highly cited journals and books, the main classes and subclasses of cited journals and books in papers of the three journals, the highly cited subjects in journals and books of library and information science were identified and analyzed. Comparison on the characteristics of cited journals and books confirmed that all the three journals under study are information science oriented, except JOD which is library science orientation. JASIST and IPM are very much in common and diffuse to other disciplines more deeply than JOD.     

Characteristics and impact of grant-funded research: a case study of the library and information science field

This paper reports on a bibliometric study of the characteristics and impact of research in the library and information science (LIS) field which was funded through research grant programs, and compares it with research that received no extra funding. Seven core LIS journals were examined to identify articles published in 1998 that acknowledge research grant funding. The distribution of these articles by various criteria (e.g., topic, affiliation, funding agency) was determined. Their impact as indicated by citation counts during 1998–2008 was evaluated against that of articles without acknowledging extra funding and published in the same journals in the same year using citation data collected from Scopus’ Citation Tracker. The impact of grant-funded research as measured by citation counts was substantially higher than that of other research, both overall and in each journal individually. Scholars from outside LIS core institutions contributed heavily to grant-funded research. The two highest-impact publications by far reported non-grant-based research, and grant-based funding of research reported in core LIS journals was biased towards the information retrieval (IR) area, particularly towards research on IR systems. The percentage of articles reporting grant-funded research was substantially higher in information-oriented journals than in library-focused ones.     

Citer analysis as a measure of research impact: library and information science as a case study

The investigators studied author research impact using the number of citers per publication an author’s research has been able to attract, as opposed to the more traditional measure of citations. A focus on citers provides a complementary measure of an author’s reach or influence in a field, whereas citations, although possibly numerous, may not reflect this reach, particularly if many citations are received from a small number of citers. In this exploratory study, Web of Science was used to tally citer and citation-based counts for 25 highly cited researchers in information studies in the United States and 26 highly cited researchers from the United Kingdom. Outcomes of the tallies based on several measures, including an introduced ch-index, were used to determine whether differences arise in author rankings when using citer-based versus citation-based counts. The findings indicate a strong correlation between some citation and citer-based measures, but not with others. The findings of the study have implications for the way authors’ research impact may be assessed.     

A comparison of the scientific performance of the U.S. and the European union at the turn of the 21st century

In this paper, scientific performance is identified with the impact that journal articles have through the citations they receive. In 15 disciplines, as well as in all sciences as a whole, the EU share of total publications is greater than that of the U.S. However, as soon as the citations received by these publications are taken into account the picture is completely reversed. Firstly, the EU share of total citations is still greater than the U.S. in only seven fields. Secondly, the mean citation rate in the U.S. is greater than in the EU in every one of the 22 fields studied. Thirdly, since standard indicators—such as normalized mean citation ratios—are silent about what takes place in different parts of the citation distribution, this paper compares the publication shares of the U.S. and the EU at every percentile of the world citation distribution in each field. It is found that in seven fields the initial gap between the U.S. and the EU widens as we advance towards the more cited articles, while in the remaining 15 fields—except for Agricultural Sciences—the U.S. always surpasses the EU when it counts, namely, at the upper tail of citation distributions. Finally, for all sciences as a whole the U.S. publication share becomes greater than that of the EU for the top 50% of the most highly cited articles. The data used refers to 3.6 million articles published in 1998–2002, and the more than 47 million citations they received in 1998–2007.     

Use of citation per publication as an indicator to evaluate contingent valuation research

This is the first article using bibliometrics to study the field of contingent valuation research. The purpose of this study was to evaluate the contingent valuation research performance based on all the related articles in SCI and SSCI databases from 1991 to 2005. An indicator named citation per publication (CPP) was presented in this study to assess the impact of article output per year, different countries, institutes, and authors from the worldwide. Publication per institute (PPI) in a country was used to be an indicator to compare institute’s research performance by country. Citation analysis was made to select the most frequently cited articles since publication to 2005 of each year. A citation model was applied to describe the relationship between the cumulative number of citations and article life. The results indicate that with the increase article output per year, the CPP decreased slightly since 1997. The USA produced 55% of all pertinent articles. Institutes from the UK had a higher PPI. The most prolific institutes and authors, and the most frequently cited articles per year were all listed. In addition, a citation model was successfully applied to evaluate performance of each year, and the most frequently cited articles of each year were also compared by the model.     

International contribution to library and information science in Poland: A bibliometric analysis

This article reports findings from the study of the international contribution to the system of library and information science communication in Poland in the years 2003–2005. The sample consists of articles published both in selected journals and collective works. Two important dimensions determining the internationalization of local scholarly communication are considered: direct contribution (foreign authors’ articles and papers and their translations published in Poland) and indirect contribution (citedness of foreign authors’ documents in articles and papers published in Poland). Bibliographic data about the geographical distribution and affiliation of foreign authors are gathered and analyzed. Furthermore, the findings of citation analysis are presented to determine the percentage share of citations received by foreign documents as well as to find out what is the structure of such citations regarding the language and form, which thematic areas are most replete with such citations and which foreign journals are most cited in Poland.     

On the validity of citation counting in science evaluation: Content analyses of references and citations in psychological publications

In reference to the increasing significance of citation counting in evaluations of scientists and science institutes as well as in science historiography, it is analyzed empirically what is cited in which frequency and what types of citations in scientific texts are used. Content analyses refer to numbers of references, self-references, publication language of references cited, publication types of references cited, and type of citation within the texts. Validity of citation counting is empirically analyzed with reference to random samples of English and German journal articles as well as German textbooks, encyclopedias, and test-manuals from psychology. Results show that 25% of all citations are perfunctory, more than 50% of references are journal articles and up to 40% are books and book-chapters, 10% are self-references. Differences between publications from various psychological sub-disciplines, publication languages, and types of publication are weak. Thus, validity of evaluative citation counting is limited because at least one quarter refers to perfunctory citations exhibiting a very low information utility level and by the fact that existing citation-databases refer to journal articles only.     

Article-count impact factor of materials science journals in SCI database

This article proposed a new index, so-called “Article-Count Impact Factor” (ACIF) for evaluating journal quality in light of citation behaviour in comparison with the ISI journal impact factors. The ACIF index was the ratio of the number of articles that were cited in the current year to the source items published in that journal during the previous two years. In this work, we used 171 journal titles in materials categories published in the years of 2001–2004 in international journals indexed in the Science Citation Index Expanded (SCI) database as data source. It was found that ACIF index could be used as an alternative tool in assessing the journal quality, particularly in the case where the assessed journals had the same (equal or similar) JIF values. The experimental results suggested that the higher the ACIF value, the more the number of articles being cited. The changes in ACIF values were more dependent on the JIF values rather than the total number of articles. Polymer Science had the greatest ACIF values, suggesting that the articles in Polymer Science had greater “citation per article” than those in Metallurgical Engineering and Ceramics. It was also suggested that in order to increase a JIF value of 1.000, Ceramics category required more articles to be cited as compared to Metallurgical Engineering and Polymer Science categories.     

Filling the citation gap: measuring the multidimensional impact of the academic book at institutional level with PlumX

More than 5 years after their emergence, altmetrics are still seen as a promise to complement traditional citation-based indicators. However, no study has focused on their potential usefulness to capture the impact of scholarly books. While recent literature shows that citation indicators cannot fully capture the impact of books, other studies have suggested alternative indicators such as usage, publishers’ prestige or library holdings. In this paper, we calculate 18 indicators which range from altmetrics to library holdings, views, downloads or citations to the production of monographs of a Spanish university using the bibliometric suite PlumX from EBSCO. The objective of the study is to adopt a multidimensional perspective on the analysis of books and understand the level of complementarity between these different indicators. Also, we compare the overview offered by this range of indicators when applied to monographs with the traditional bibliometric perspective focused on journal articles and citation impact. We observe a low presence of altmetric indicators for monographs, even lower than for journal articles and a predominance of library holdings, confirming this indicator as the most promising one towards the analysis of the impact of books.     

Understanding the impact change of a highly cited article: a content-based citation analysis

Researchers tend to cite highly cited articles, but how these highly cited articles influence the citing articles has been underexplored. This paper investigates how one highly cited essay, Hirsch’s “h-index” article (H-article) published in 2005, has been cited by other articles. Content-based citation analysis is applied to trace the dynamics of the article’s impact changes from 2006 to 2014. The findings confirm that citation context captures the changing impact of the H-article over time in several ways. In the first two years, average citation mention of H-article increased, yet continued to decline with fluctuation until 2014. In contrast with citation mention, average citation count stayed the same. The distribution of citation location over time also indicates three phases of the H-article “Discussion,” “Reputation,” and “Adoption” we propose in this study. Based on their locations in the citing articles and their roles in different periods, topics of citation context shifted gradually when an increasing number of other articles were co-mentioned with the H-article in the same sentences. These outcomes show that the impact of the H-article manifests in various ways within the content of these citing articles that continued to shift in nine years, data that is not captured by traditional means of citation analysis that do not weigh citation impacts over time.     

Selecting scientific excellence through committee peer review - A citation analysis of publications previously published to approval or rejection of post-doctoral research fellowship applicants

Summary We investigated committee peer review for awarding long-term fellowships to post-doctoral researchers as practiced by the Boehringer Ingelheim Fonds (B.I.F.) - a foundation for the promotion of basic research in biomedicine. Assessing the validity of selection decisions requires a generally accepted criterion for research impact. A widely used approach is to use citation counts as a proxy for the impact of scientific research. Therefore, a citation analysis for articles published previous to the applicants' approval or rejection for a B.I.F. fellowship was conducted. Based on our model estimation (negative binomial regression model), journal articles that had been published by applicants approved for a fellowship award (n = 64) prior to applying for the B.I.F. fellowship award can be expected to have 37% (straight counts of citations) and 49% (complete counts of citations) more citations than articles that had been published by rejected applicants (n = 333). Furthermore, comparison with international scientific reference values revealed (a) that articles published by successful and non-successful applicants are cited considerably more often than the “average” publication and (b) that excellent research performance can be expected more of successful than non-successful applicants. The findings confirm that the foundation is not only achieving its goal of selecting the best junior scientists for fellowship awards, but also successfully attracting highly talented young scientists to apply for B.I.F. fellowships.     

The most highly cited Library and Information Science articles: Interdisciplinarity,first authors and citation patterns

Highly cited articles are interesting because of the potential association between high citation counts and high quality research. This study investigates the 82 most highly cited Information Science and Library Science’ (IS&LS) articles (the top 0.1%) in the Web of Science from the perspectives of disciplinarity, annual citation patterns, and first author citation profiles. First, the relative frequency of these 82 articles was much lower for articles solely in IS&LS than for those in IS&LS and at least one other subject, suggesting that that the promotion of interdisciplinary research in IS&LS may be conducive to improving research quality. Second, two thirds of the first authors had an h-index in IS&LS of less than eight, show that much significant research is produced by researchers without a high overall IS&LS research productivity. Third, there is a moderate correlation (0.46) between citation ranking and the number of years between peak year and year of publication. This indicates that high quality ideas and methods in IS&LS often are deployed many years after being published.     

The citation impact of social sciences and humanities upon patentable technology

This paper examines the citation impact of papers published in scientific-scholarly journals upon patentable technology, as reflected in examiner- or inventor-given references in granted patents. It analyses data created by SCImago Research Group, linking PATSTAT’s scientific non-patent references (SNPRs) to source documents indexed in Scopus. The frequency of patent citations to journal papers is calculated per discipline, year, institutional sector, journal subject category, and for “top” journals. PATSTAT/Scopus-based statistics are compared to those derived from Web of Science/USPTO linkage. A detailed assessment is presented of the technological impact of research publications in social sciences and humanities (SSH). Several subject fields perform well in terms of the number of citations from patents, especially Library and Information Science, Language and Linguistics, Education, and Law, but many of the most cited journals find themselves in the interface between SSH and biomedical or natural sciences. Analyses of the titles of citing patents and cited papers are presented that shed light upon the cognitive content of patent citations. It is proposed to develop more advanced indicators of citation impact of papers upon patents, and ways to combine citation counts with citation content and context analysis.