Measuring knowledge transfer between fields of science

In this paper we report on the results of an exploratory study of knowledge exchange between disciplines and subfields of science, based on bibliometric methods. The goal of this analysis is twofold. Firstly, we consider knowledge exchange between disciplines at a global level, by analysing cross-disciplinary citations in journal articles, based on the world publication output in 1999. Among others a central position of the Basic Life Sciences within the Life Sciences and of Physics within the Exact Sciences is shown. Limitations of analyses of interdisciplinary impact at the journal level are discussed. A second topic is a discussion of measures which may be used to quantify the rate of knowledge transfer between fields and the importance of work in a given field or for other disciplines. Two measures are applied, which appear to be proper indicators of impact of research on other fields. These indicators of interdisciplinary impact may be applied at other institutional levels as well. This revised version was published online in August 2006 with corrections to the Cover Date.     

Web Impact Factors for Australasian universities

In this paper we report on the results of an exploratory study of knowledge exchange between disciplines and subfields of science, based on bibliometric methods. The goal of this analysis is twofold. Firstly, we consider knowledge exchange between disciplines at a global level, by analysing cross-disciplinary citations in journal articles, based on the world publication output in 1999. Among others a central position of the Basic Life Sciences within the Life Sciences and of Physics within the Exact Sciences is shown. Limitations of analyses of interdisciplinary impact at the journal level are discussed. A second topic is a discussion of measures which may be used to quantify the rate of knowledge transfer between fields and the importance of work in a given field or for other disciplines. Two measures are applied, which appear to be proper indicators of impact of research on other fields. These indicators of interdisciplinary impact may be applied at other institutional levels as well. This revised version was published online in August 2006 with corrections to the Cover Date.     

On the validity of citation counting in science evaluation: Content analyses of references and citations in psychological publications

In reference to the increasing significance of citation counting in evaluations of scientists and science institutes as well as in science historiography, it is analyzed empirically what is cited in which frequency and what types of citations in scientific texts are used. Content analyses refer to numbers of references, self-references, publication language of references cited, publication types of references cited, and type of citation within the texts. Validity of citation counting is empirically analyzed with reference to random samples of English and German journal articles as well as German textbooks, encyclopedias, and test-manuals from psychology. Results show that 25% of all citations are perfunctory, more than 50% of references are journal articles and up to 40% are books and book-chapters, 10% are self-references. Differences between publications from various psychological sub-disciplines, publication languages, and types of publication are weak. Thus, validity of evaluative citation counting is limited because at least one quarter refers to perfunctory citations exhibiting a very low information utility level and by the fact that existing citation-databases refer to journal articles only.     

Open access in ethics research: an analysis of open access availability and author self-archiving behaviour in light of journal copyright restrictions

The current state of open access to journal publications within research areas belonging to the humanities has received relatively little research attention. This study provides a detailed mapping of the bibliometric state of open access to journal publications among ethicists, taking into account not only open access publishing in journals directly, but also where and in what form ethicists make their journal articles available elsewhere on the web. As part of the study 297 ethicists affiliated with top-ranking philosophy departments were identified and their journal publication information for the years 2010–2015 were recorded (1682 unique articles). The journal articles were then queried for through Google Scholar in order to establish open access status (web locations, document versions) of each publication record. Publication records belonging to the 20 most frequently used journal outlets (subset of 597 unique articles) were put under closer inspection with regards to alignment with publisher copyright restrictions as well as measuring unused potential to share articles. The results show that slightly over half of recent journal publications are available to read for free. PhilPapers and academic social networks (Academia.edu and ResearchGate) were found to be key platforms for research dissemination in ethics research. The representation of institutional repositories as providers of access was found to be weak, receiving the second lowest frequency rating among the eight discrete web location categories. Further, the study reveals that ethicists are at the same time prone to copyright infringement and undersharing their scholarly work.     

Materials influence on design: A decade of development

This review paper evaluates the current status of the exploitation of engineering materials for design purposes with respect to developments in the respective disciplines, through a structured review of the content of Materials & Design journal over 30 years of publication. This review updates strategically the two previous reviews, with an emphasis this time placed on changes occurring over the last 10 years, making appropriate reference to the earlier investigations to explain noteworthy developments. The new information presented is again derived from the abundance of technical knowledge contained from within the many varied and growing number of high quality articles in the journal, supplemented by the author’s personal comments and experience of the field.     

Contradicting incentives for research collaboration

This study describes the Danish publication award system (BFI), investigates whether its built-in incentives have had an effect on publication behavior at the University of Southern Denmark, and discusses the possible future implications on researcher incentives should universities wish to measure BFI on the individual level. We analyzed publication data from the university CRIS system (Pure) and from SciVal. Several studies indicate that co-authored scholarly journal articles attract more citations than single author articles. The reason for this are not clear, however, research collaboration across institutions and countries is commonly accepted in the research community and among university managements as one way of increasing the researcher’s and institution’s reputation and impact. The BFI system is designed to award scholarly publication activity at Danish universities, especially publication in international journals of high status. However, we find that the built-in incentives leave the researcher and his or her institution with a dilemma: If the researchers optimize their performance by forming author groups with external collaborators, the optimal way of doing so for the researchers is not the optimal way seen from the perspective of the university. Our analysis shows that the typical article has 6.5 authors, two of which are internal, and that this has remained stable since the introduction of the BFI. However, there is variation across the disciplines. While ‘the Arts and Humanities’ and ‘the Social Sciences’ seem to compose author groups in a way which does not optimize the performance of the institution, both ‘Health’ and ‘the Natural Sciences’ seem to optimize according to criteria other than those specified in the BFI.     

Reconsidering the gold open access citation advantage postulate in a multidisciplinary context: an analysis of the subject categories in the Web of Science database 2009–2014

Since Lawrence in 2001 proposed the open access (OA) citation advantage, the potential benefit of OA in relation to citation impact has been discussed in depth. The methodology to test this postulate ranges from comparing the impact factors of OA journals versus traditional ones, to comparing citations of OA versus non-OA articles published in the same non-OA journals. However, conclusions are not entirely consistent among fields, and two possible explications have been suggested in those fields where a citation advantage has been observed for OA: the early view and the selection bias postulates. In this study, a longitudinal and multidisciplinary analysis of gold OA citation advantage is developed. All research articles in all journals for all subject categories in the multidisciplinary database Web of Science are considered. A total of 1,138,392 articles—60,566 (5.3%) OA articles and 1,077,826 (94.7%) non-OA articles—published in 2009 are analysed. The citation window considered goes from 2009 to 2014, and data are aggregated for the 249 disciplines (subject categories). At journal level, we also study the evolution of journal impact factors for OA and non-OA journals in those disciplines whose OA prevalence is higher (top 36 subject categories). As the main conclusion, there is no generalizable gold OA citation advantage, neither at article nor at journal level.     

An analysis of Malaysian retracted papers: Misconduct or mistakes?

Retracted publications are a crucial, yet overlooked, issue in the scientific community. The purpose of this study was to analyze the prevalence, characteristics and reasons of Malaysian retracted papers. The Web of Science and Scopus databases were queried to identify Malaysian retracted publications. Available versions of original articles and publication notices were accessed from journal websites. The publications were assessed for various characteristics, including reason for retraction, based on the Committee on Publication Ethics guidelines, and the authority calling for the retractions. From 2009 to June 2017, 125 Malaysian publications comprising (33 journal articles and 92 conference papers) were retracted. There was a spike in the prevalence of retracted articles in 2010 and 2012 with 42 articles (33.6%) and 41 articles (32.8%) respectively from the 125 retracted articles. The mean time from electronic publication to retraction was 1 year. There is no significant relationship between a journal quartile and the mean number of months to retraction (P = 0.842). The reason for retraction for conference papers was specified as “violation of publication principle”. Journal articles were retracted mainly for duplicate publication, plagiarism, compromised peer review process, and self-plagiarism. Most retracted articles do not contain flawed data; and only 2 retracted articles have been accused of scientific mistakes. The study concludes that retractions were mostly due to the authors misconduct. Despite the increases, the proportion of published scholarly literature affected by retraction remains very small, indicating that retraction represents an uncommon, yet potentially increasing and incipient, issue within Malaysian papers, which publishers as well as editors may have consistently and sufficiently addressed.     

Data Envelopment Analysis of OR/MS journals

Summary This paper presents the results of a Data Envelopment Analysis of Operations Research/ Management Science journals on two questions: the duration of the refereeing/publication process and the relation between the length of the articles published and their impact. The second question uses data publicly available through the ISI Journal Citation Reports database and through the journals contents while for the first question data had to be gathered from the journal editors through an e-mail survey. The analysis gives cues about the amount each journal should aim to reduce their lead times, setting efficiency targets both on the average time from submission to first editorial decision and on the time from final editorial decision to publication. Similarly, for each journal, efficiency targets for the average article length are obtained. Our promoting of refereeing efficiency and paper length efficiency assumes that no loss of quality in the peer review process or in the knowledge transmission process needs to happen.     

Scientometric evaluation of the scientific performance at the Faculty of Natural Sciences,Kossuth Lajos University,Debrecen, Hungary

The standard of research at different departments of the Faculty of Natural Sciences of Kossuth Lajos University has been assessed by a scientometric evaluation of the publication activities of the departments. The essence of our approach is the consideration of the number and quality of the papers published. For a measure of this quality we regarded the impact factor of the journal, in which a paper was published. The rather different range of the impact factors of different fields were taken into account during the evaluation. As a whole, no considerable difference was found between the publication activity (impact per number of researchers) of the research institutes of the Hungarian Academy of Sciences and the corresponding departments of our Faculty, although, significant differences occur in certain fields. Based on this study, changes in the publication strategies of the different departments were recommended.Dedicated to the memory of Michael J. MoravscikThe Hungarian version was published in Felsoktatási Szemle, 7–8(1984) 395–411.     

Global competition and technological transition in electrical,electronic, information and communication engineering: quantitative analysis of periodicals and conference proceedings of the IEEE

This study analysed the technical and publication activities of the Institute of Electrical and Electronics Engineering (IEEE), the most influential academic publisher in engineering. We first constructed an original comprehensive database of periodicals (journal and magazine) and conference proceedings published by the IEEE between 1980 and 2008, which comprised approximately 0.36 million periodical articles and 1.14 million conference articles. We analysed the transitions in technical innovations from two perspectives: trends within (1) individual countries and (2) specialized fields represented in IEEE societies. The number of published periodical articles increased fourfold between 1980 and 2008, while that of published conference articles increased nearly 20-fold in the same period. In particular, the number of conference articles published by China increased dramatically from 2002, exceeding even the number published by the US in 2008. The IEEE has increasingly shifted away from its US-centred origins to literally becoming the ‘electrical and electronics association of the world’. The proportion of articles published by authors in North America, Europe and East Asia has increasingly balanced, thus leading to the formation of a tri-polar structure of IEEE technological activities. This comprehensive analysis of IEEE publications over a period of almost 30 years revealed that with the emergence of more active international competition, ‘glocalisation’ is occurring among publications and research activities of the IEEE. Consequently, quantitative analysis revealed structural changes in global competition and technological transition characterized by five phases.     

A new reference standard for citation analysis in chemistry and related fields based on the sections of <Emphasis Type="Italic">Chemical Abstracts</Emphasis>

Citation analysis for evaluative purposes requires reference standards, as publication activity and citation habits differ considerably among fields. Reference standards based on journal classification schemes are fraught with problems in the case of multidisciplinary and general journals and are limited with respect to their resolution of fields. To overcome these shortcomings of journal classification schemes, we propose a new reference standard for chemistry and related fields that is based on the sections of the Chemical Abstracts database. We determined the values of the reference standard for research articles published in 2000 in the biochemistry sections of Chemical Abstracts as an example. The results show that citation habits vary extensively not only between fields but also within fields. Overall, the sections of Chemical Abstracts seem to be a promising basis for reference standards in chemistry and related fields for four reasons: (1) The wider coverage of the pertinent literature, (2) the quality of indexing, (3) the assignment of papers published in multidisciplinary and general journals to their respective fields, and (4) the resolution of fields on a lower level (e.g. mammalian biochemistry) than in journal classification schemes (e.g. biochemistry & molecular biology).     

Learning about learning: patterns of sharing of research knowledge among Education,Border, and Cognitive Science fields

This study explores the patterns of exchange of research knowledge among Education Research, Cognitive Science, and what we call “Border Fields.” We analyze a set of 32,121 articles from 177 selected journals, drawn from five sample years between 1994 and 2014. We profile the references that those articles cite, and the papers that cite them. We characterize connections among the fields in sources indexed by Web of Science (WoS) (e.g., peer-reviewed journal articles and proceedings), and connections in sources that are not (e.g., conference talks, chapters, books, and reports). We note five findings—first, over time the percentage of Education Research papers that extensively cite Cognitive Science has increased, but the reverse is not true. Second, a high percentage of Border Field papers extensively cite and are cited by the other fields. Border Field authors’ most cited papers overlap those most cited by Education Research and Cognitive Science. There are fewer commonalities between Educational research and Cognitive Science most cited papers. This is consistent with Border Fields being a bridge between fields. Third, over time the Border Fields have moved closer to Education Research than to Cognitive Science, and their publications increasingly cite, and are cited by, other Border Field publications. Fourth, Education Research is especially strongly represented in the literature published outside those WoS-indexed publications. Fifth, the rough patterns observed among these three fields when using a more restricted dataset drawn from the WoS are similar to those observed with the dataset lying outside the WoS, but Education Research shows a far heavier influence than would be indicated by looking at WoS records alone.

     

A bibliometric analysis of the performance of <Emphasis Type="Italic">Water Research</Emphasis>

This paper presents a detailed chronological survey of papers published in the journal titled Water Research which started publication since 1967. This current investigation reviews publication patterns between 1967 and 2008. An analysis of the research performance according to publication output, distribution of words in article title, author keywords, and keywords plus. Performances of countries, institutes, and authors, including total, single, collaborative, first author, and corresponding author publications were analyzed. The most-frequently cited articles each year and the articles of the highest impact in 2008 were also reported. Results showed that “activated sludge” was the most frequently used author keyword, followed by “adsorption,” and “drinking water.” Authors from 114 different countries/territories published in the journal, with the most articles submitted by authors from the USA.     

Institution bias in the New England Journal of Medicine? A bibliometric analysis of publications (1997–2016)

There are three main reasons for retraction: (1) ethical misconduct (e.g. duplicate publication, plagiarism, missing credit, no IRB, ownership issues, authorship issues, interference in the review process, citation manipulation); (2) scientific distortion (e.g. data manipulation, fraudulent data, unsupported conclusions, questionable data validity, non-replicability, data errors—even if unintended); (3) administrative error (e.g. article published in wrong issue, not the final version published, publisher errors). The first category, although highly deplorable has almost no effect on the advancement of science, the third category is relatively minor. The papers belonging to the second category are most troublesome from the scientific point of view, as they are misleading and have serious negative implications not only on science but also on society. In this paper, we explore some temporal characteristics of retracted articles, including time of publication, years to retract, growth of post retraction citations over time and social media attention by the three major categories. The data set comprises 995 retracted articles retrieved in October 2014 from Elsevier’s ScienceDirect. Citations and Mendeley reader counts were retrieved four times within 4 years, which allowed us to examine post-retraction longitudinal trends not only for citations, but also for Mendeley reader counts. The major findings are that both citation counts and Mendeley reader counts continue to grow after retraction.     

A scientometric analysis of the effectiveness of Taiwan’s educational research projects

The seeking of evidence for revealing the research performance of Education in Taiwan, in response to the stimulus by the national research projects, is presented and interpreted. More than 70,000 publication records over the years 1990–2011 from Web of Science were downloaded and analyzed. The overview analysis by data aggregation and country ranking shows that Taiwan has significantly improved its publication productivity and citation impact over the last decade. The drill-down analysis based on journal bibliographic coupling, information visualization, and diversity and trend indexes, reveals that e-Learning and Science Education are two fast growing subfields that attract global interests and that Taiwan is among the top-ranked countries in these two fields in terms of research productivity. Implications of the analysis are discussed with an emphasis on the subfield characteristics from which more insightful interpretations can be obtained, such as the regional or cultural characteristics that may affect the performance ranking.     

The story behind Oncotarget? A bibliometric analysis

Being the most proliferative journal of oncology a cancer research of the past decade, the Open Access journal Oncotarget had reached more than 20,000 publications and a relatively high impact factor score in the past years. In 2018, the journal citation report decided to withdraw the status of an impact factor journal. Since there was a large discussion in the scientific community and specific reasons for the withdrawal were not stated, this bibliometric analysis was performed to assess if Oncotarget exhibits any differences in its bibliometric structure compared to other journals. For this purpose, we used the “New Quality and Quantity Indices in Sciences” platform and analyzed 20,000 Oncotarget articles. Density equalizing mapping technique helps to construct maps of cancer research in Oncotarget and shows that it has led to a unique global landscape which is not asymmetrically dominated by the Western hemisphere but exhibits a publishing architecture with a pronounced emphasis on Chinese articles.

     

Publication delays in the science field and their relationship to the ageing of scientific literature

This article presents an exploratory analysis of publication delays in the science field. Publication delay is defined as the time period between submission and publication of an article for a scientific journal. We obtained a first indication that these delays are longer with regard to journals in the fields of mathematics and technical sciences than they are in other fields of science. We suggest the use of data on publication delays in the analysis of the effects of electronic publishing on reference/citation patterns. A preliminary analysis on a small sample suggests that—under rather strict assumptions—the cited half-life of references may be reduced with a factor of about 2 if publication delays decrease radically.