Scientific evaluations of citation quality of international research articles in the SCI database: Thailand case study

Summary Quantitative and qualitative scientific evaluations of the research performance of Thai researchers were carried out with regards to their international publications and citations in four different subject categories; namely Clinical Medicine, Chemistry, Material Sciences, and Engineering. This work used citations to publications of Thai researchers in the Science Citation Index (SCI) database during 1998-2002 as a data source. The calculations and comparisons of article impact factors (AIF), position impact factors (PIF) and journal impact factors (JIF) were attempted for quantitative evaluation.The positions and significance levels (cited contents) of the citations were considered for qualitative assessment.For quantitative evaluation, the highest article quantity and number of times cited were given by Thai researchers in Clinical Medicine, the lowest being for Material Sciences. Clinical Medicine had the highest AIF value, while Engineering exhibited the lowest. Each article by Thai researchers was found to be cited more than once within a citing article, especially articles in Clinical Medicine. For qualitative assessment, most articles from Thai scholars were cited in Introduction and Results & Discussion sections of the citing articles. Only non-Thai researchers in Clinical Medicine preferred to use Discussion from Thais' articles for discussion of their work whereas those in Chemistry, Material Sciences and Engineering were referred as general references. Less than 1.5% of research works of Thai scholars were cited as “the pioneer”for the research communities of the subject categories of interest.     

Korean journals in the Science Citation Index: What do they reveal about the intellectual structure of S&T in Korea?

During the last decade, we have witnessed a sustained growth of South Korea’s research output in terms of the world share of publications in the Science Citation Index database. However, Korea’s citation performance is not yet as competitive as publication performance. In this study, the authors examine the intellectual structure of Korean S&T field based on social network analysis of journal-journal citation data using the ten Korean SCI journals as seed journals. The results reveal that Korean SCI journals function more like publication places, neither research channels nor information sources among national scientists. Thus, these journals may provide Korean scholars with access to international scientific communities by facilitating the respective entry barriers. However, there are no citation relations based on their Korean background. Furthermore, we intend to draw some policy implications which may be helpful to increase Korea’s research potential.     

Use of citation per publication as an indicator to evaluate contingent valuation research

This is the first article using bibliometrics to study the field of contingent valuation research. The purpose of this study was to evaluate the contingent valuation research performance based on all the related articles in SCI and SSCI databases from 1991 to 2005. An indicator named citation per publication (CPP) was presented in this study to assess the impact of article output per year, different countries, institutes, and authors from the worldwide. Publication per institute (PPI) in a country was used to be an indicator to compare institute’s research performance by country. Citation analysis was made to select the most frequently cited articles since publication to 2005 of each year. A citation model was applied to describe the relationship between the cumulative number of citations and article life. The results indicate that with the increase article output per year, the CPP decreased slightly since 1997. The USA produced 55% of all pertinent articles. Institutes from the UK had a higher PPI. The most prolific institutes and authors, and the most frequently cited articles per year were all listed. In addition, a citation model was successfully applied to evaluate performance of each year, and the most frequently cited articles of each year were also compared by the model.     

Categorization and trend of materials science research from Science Citation Index (SCI) database: A case study of ceramics,metallurgy, and polymer subfields

This article offers information on the characteristics and number of materials research articles indexed in the Science Citation Index (SCI) database in the year of 2004. 22,843 articles in full-text forms from 169 journals from the materials field (which included ceramics, metallurgy, and polymer journals) were retrieved from the SCI database and exported to EndNote software. The retrieved articles were carefully analyzed by eight scientists and experts in those subfields and categorized using SPSS into eight different categories, being (1) New materials, (2) Materials characterizations, (3) Materials improvement, (4) New process and/or process improvement, (5) Mathematical and theoretical models and/or computer simulations, (6) Novel and comprehensive explanations, (7) Testing conditions, and (8) Comparative studies, whose definitions were clearly indicated. The results were then considered in terms of the percentage of the number of articles in each materials subfield, country of corresponding author, and number of authors. The overall results suggested that, most materials articles published in 2004 were focused on new process and process improvement (27%), while materials characterizations (23%) and testing conditions (12%) took the 2nd and 3rd places, especially for the ceramics and polymer articles. The highest numbers of articles in the ceramics and polymer subfields were focused on new processes and/or process improvement, and those for the metallurgy subfield were on materials characterization. In the SCI database, the largest number of materials articles was authored from Asian scientists although the majority of the materials journals were run by editors from Europe in North America/Canada continents. There was no coherent relationship between the authors’ and editors’ affiliations. China, Japan and the United States of America (USA) were shown to be the top three countries which had the highest publication numbers in the materials field. Japan had the highest publication numbers in the ceramics subfield while China possessed most publications in polymer and metallurgy subfields. However, when considering the journal impact factors, the leading positions of the countries changed. The results from this work could assist materials scientists to select suitable international journals in relevant association with the contents of their to-publish works. Finally, it was noted that most material research articles were written by 3–4 authorships.     

High-impact papers presented in the subject category of water resources in the essential science indicators database of the institute for scientific information

The Essential Science Indicators (ESI) database is widely used to evaluate institutions and researchers. The objective of this study was to analyze trends and characteristics of papers in the subject category of water resources in the ESI database of the Institute for Scientific Information (ISI). Distributions of document type, language of publication, scientific output, and publication of journals are reported in this article. Five indicators (the number and ranking of total papers, first-author papers, corresponding-author papers, independent papers, and collaborative papers) were applied to evaluate country, institute, and author performances. In addition, the numbers of authors cited, numbers of institutes cited, numbers of countries cited, and numbers of subject areas cited were also used to evaluate ESI papers. Results showed that 265 papers, all written in English, were listed in 27 journals in the field of water resources. A review paper was more likely to be included in the ESI than a research paper. Journal of Hydrology published the most papers. The USA and UK were the two leading nations. ESI papers published in the US were more likely to involve inter-institutional collaboration than papers published in the UK. The University of Arizona was the most productive institute. Some papers that were almost excluded from the ESI database appear to have consistently received annual high frequencies of citation. Perhaps the 10 year criterion for inclusion in the ESI should be reassessed.     

Institutional change and scientific research: A preliminary bibliometric analysis of institutional influences on Turkey’s recent social science publications

This paper provides a detailed assessment of recent indexed journal publications by Turkish social scientists. We first present information on SCI, SSCI and AHCI indexed journal articles that were published by Turkish researchers over the past three decades. An inspection of publication statistics indicates a considerable improvement, especially during the last five years of the 1973–2005 period that we examine, in Turkey’s publication record in terms of number of articles authored or co-authored by Turkish researchers. In the next step, we scrutinize institutional sources of this improvement, emphasizing regulatory and organizational changes that have both forced researchers to publish in indexed journals and remunerated those who did so. Finally, we provide a qualitative assessment of recent improvement in publication performance of Turkish researchers by focusing on a particular behavioral consequence of institutional changes and its implications for impact that research from Turkey has on global research activity. Bibliometric analysis of articles published by Turkish researchers in SSCI-indexed journals during 2000–2005 shows that recent regulatory and organizational changes seem to have instituted a particular publication habit, publishing in journals with lower impact factor, which was earlier observed in other parts of the world where publication counts were used for performance evaluation, and that signs of improvement in our select indicators of impact are yet to be observed.     

Productivity, impact and publication habits by gender in the area of Materials Science

Summary A comparative analysis of the scientific performance of male and female scientists in the area of Materials Science at the Spanish Council for Scientific Research (CSIC) is presented. Publications of 333 scientists during 1996-2000 are downloaded from the international database Science Citation Index and the national one ICYT. Scientific performance of scientists is studied through different indicators of productivity (number of SCI and ICYT publications), international visibility (average impact factor of publications, percentage of documents in “top journals”) and publication practices (%international publications, signing order of authors in the documents and different collaboration measures). Inter-gender differences in the research performance of scientists are studied. Influence of professional category and age are analysed. Although women are less productive than men, no significant differences in productivity are found within each professional category. However, a different life-cycle of productivity is found for men and woman and the most important inter-gender differences in productivity occur at the ages of 40-59.     

Estimate of global research trends and performance in family therapy in Social Science Citation Index

The main purpose of this study was to evaluate the global progress and quantitative assessment of current research trends on family therapy, using a bibliometric approach and exploring related literature in the Social Science Citation Index (SSCI) database from 1992 to 2009. This study used the bibliometric arrropach to learn about the subject categories, core journals, top countries and leading research institutes in publication, most frequently used author keywords, and most frequently used KeyWords Plus. Also, this study used a “word cluster analysis” method to locate research hot topics. A majority of the subject categories were located in clinical psychology and family studies. The core journals for family therapy located in Journal of Marital and Family Therapy, Contemporary Family Therapy, and Journal of Family Therapy. The US ranked as the top country of world articles with the highest h-index, followed distantly by the UK and Germany. The leading research institutes were Purdue University, University of Miami, and Brigham Young University. “Adolescents” and “adolescent” were highly used words in article titles. Next, the top three most frequently used author keywords were “anorexia nervosa”, “adolescents”, and “psychotherapy”. Finally, the top three most frequently used KeyWords Plus were “psychotherapy”, “children”, and “intervention”. Based on “word cluster analysis” to determine the research hotspots, the research hot topics of family therapy fall into three categories: treated subjects, treated matters, and treatment issues. The research trend in family therapy seems to involve the therapist often treating adolescents or children for eating disorders, substance abuse, depression, or schizophrenia. During treatment or therapy, therapists and researchers must pay attention to the issues of gender, training, and therapeutic alliance.     

Science publication indicators for India: Questions of interpretation

We comment on a letter toNature in 1996 on the long term decline of Indian science pointing out methodological reasons why the (SCI) data used by the authors do not unambiguously lead to their stated conclusions. Our arguments are based on the contention that no valid statement on change in a country's output may be made for a period in which the journal coverage from that country in SCI has changed significantly. We have suggested that for longitudinal comparisons of country level performance, it should be verified that the journals from that country in SCI remained constant within the period. This could be ensured if the country of publication of journals could be included as a field in the SCI database. We define a Visibility Index as the cumulated impact and derive a relation to estimate change in visibility combining changes in output and average impact. In the period during which Indian journal coverage remained unchanged, a detailed analysis of output for two years (1990–94) leads us to conclude that, with the exception of Agriculture, there has been an increase in publication in virtually every field, with significant increase in the overall mean Impact Factor. At least 25 subfields have been identified with statistically significant increase in mean Impact Factor and Visibility. The impact of foreign collaboration on visibility has also been considered. In conclusion we touch upon the question of citation as a performance indicator for Third World countries as high citation and relevance may be in conflict as objectives.     

A new input indicator for the assessment of science &; technology research?

Traditional input indicators of research performance, such as research funding, number of active scientists, and international collaborations, have been widely used to assess countries’ publication output. However, while publication in today’s English-only research world requires sound research in readable English, English proficiency may be a problem for the productivity of non-native English-speaking (NNES) countries. Data provided by the Brazilian National Research Council (CNPq) containing the academic profile of 51,223 Brazilian researchers show a correlation between English proficiency and publication output. According to our results, traditional input indicators may fall short of providing an accurate representation of the research performance of NNES developing countries.     

Measuring recent research performance for Chinese universities using bibliometric methods

This paper focuses on measuring the academic research performance of Chinese universities by using Scopus database from 2007 to 2010. We have provided meaningful indicators to measure the research performance of Chinese universities as compared to world class universities of the US and the European region. Using these indicators, we first measure the quantity and quality of the research outcomes of the universities and then examine the internationalization of research by using international collaborations, international citations and international impact metrics. Using all of this data, we finally present an overall score called research performance point to measure the comprehensive research strength of the universities for the selected subject categories. The comparison identifies the gap between Chinese universities and top-tier universities from selected regions across various subject areas. We find that Chinese universities are doing well in terms of publication volume but receive less citations from their published work. We also find that the Chinese universities have relative low percentage of publications at high impact venues, which may be the reason that they are not receiving more citations. Therefore, a careful selection of publication venues may help the Chinese universities to compete with world class universities and increase their research internationalization.     

Article-count impact factor of materials science journals in SCI database

This article proposed a new index, so-called “Article-Count Impact Factor” (ACIF) for evaluating journal quality in light of citation behaviour in comparison with the ISI journal impact factors. The ACIF index was the ratio of the number of articles that were cited in the current year to the source items published in that journal during the previous two years. In this work, we used 171 journal titles in materials categories published in the years of 2001–2004 in international journals indexed in the Science Citation Index Expanded (SCI) database as data source. It was found that ACIF index could be used as an alternative tool in assessing the journal quality, particularly in the case where the assessed journals had the same (equal or similar) JIF values. The experimental results suggested that the higher the ACIF value, the more the number of articles being cited. The changes in ACIF values were more dependent on the JIF values rather than the total number of articles. Polymer Science had the greatest ACIF values, suggesting that the articles in Polymer Science had greater “citation per article” than those in Metallurgical Engineering and Ceramics. It was also suggested that in order to increase a JIF value of 1.000, Ceramics category required more articles to be cited as compared to Metallurgical Engineering and Polymer Science categories.     

Bibliometric analysis of tsunami research

The use of the bibilometric analytical technique for examining tsunami research does not exist in the literature. The objective of the study was to perform a bibliometric analysis of all tsunami-related publications in the Science Citation Index (SCI). Analyzed parameters included document type, language of publication, publication output, authorship, publication patterns, distribution of subject category, distribution of author keywords, country of publication, most-frequently cited article, and document distribution after the Indonesia tsunami. The US and Japan produced 53% of the total output where the seven major industrial countries accounted for the majority of the total production. English was the dominant language, comprising 95% of articles. A simulation model was applied to describe the relationship between the number of authors and the number of articles, the number of journals and the number of articles, and the percentage of total articles and the number of times a certain keyword was used. Moreover the tsunami publication patterns in the first 8 months after the Indonesia tsunami occurred on 26 December 2004 indicated a high percentage of non-article publications and more documents being published in journals with higher impact factors.     

An item-by-item subject classification of papers published in journals covered by the SSCI database using reference analysis

A serious shortcoming of bibliometric studies based on theSocial Sciences Citation Index is the lack of a universally applicable subject classification scheme as individual papers are concerned. Moreover, the selective coverage of more than thousand scientific journals per annum proved to be an insuperable obstacle in the delimitation of social science subject areas. Subject classification of papers on the basis of assigning journals to subject categories (like those found in the various supplements of ISI databases) works well in case of fully covered and highly specialised journals in the social sciences, too, but fails for multidisciplinary and selectively covered journals. This study presents the results of an item-by-item subject classification approach, where assignment is based on the analysis of the subject categories of reference literature. This analysis extends the results of an earlier study by the authors on the possibility of delimiting subfields in the hard and life sciences based on reference analysis. The assignment proved also reliable for a considerable share of literature in the social sciences. Due to the peculiarities of the database this share is lower in the SSCI than that in the SCI. Although an iterated application of the procedure is expected to increase the number of classifiable publications, it is suggested that in the sociated sciences the method should be used in combination with other means of subject assignment.     

Trends and performance of oxidative stress research from 1991 to 2010

A bibliometric analysis was performed in this work to determine research trends of oxidative stress publications published between 1991 and 2010 in journals of all the subject categories of the Science citation index. Publication trends were analyzed by the retrieved results in publication type and language, characteristics of articles outputs, country, subject categories and journals, and the frequency of title-words and keywords used. Over the years, there was a significant growth in article outputs, with more countries participating and collaborating. The seven major industrialized countries (G7) published the majority of the world articles while the USA contributed about one-third of the total. Chinese and Indian outputs grew much faster than those of other countries in the past 5 years. Oxidative stress research in food and environmental related fields gradually became the mainstream of the research. An analysis of the title-words, author keywords and keywords plus showed that antioxidants in human or rat cells were the hot topic in the field. In addition, “reaction oxygen species”, “apoptosis”, and “nitric-oxide” were major topics of oxidative stress research recently. More articles dealt with diseases that had a strong relationship with oxidative stress, such as inflammation, Alzheimer’s disease, diabetes, and atherosclerosis.     

Do new SCI journals have a different national bias?

National shares of worldwide publications in the Science Citation Index (SCI) have shifted recently. The long-term decline in U.S. share accelerated in the mid-1990s, and now the EU has joined this decline. Not coincidentally, the shares of some countries have increased sharply, particularly those of China, S. Korea, Taiwan, and Singapore. Since the SCI constantly adds new journals, one reason might be that newly added journals were more favorable to them. To test this, the database was partitioned into “old journals” (added before 1995) and “new journals,” added afterward. The analysis was done for eight of the 20 fields of science defined by the National Science Indicator CD. In some fields, new journals were indeed much more favorable to the Asians. In some fields, however, new journals were actually more favorable to the U.S. In aggregate over the eight fields analyzed, the size of this effect was too small to account for much of the sharp changes in national shares. Furthermore tests between old and new journals find that differences in most fields are not statistically significant. The results provide evidence that the SCI can be used to accurately track national publication changes over time.     

Research trends analysis by comparing data mining and customer relationship management through bibliometric methodology

There are few comprehensive studies and categorization schemes to discuss the characteristics for both data mining and customer relationship management (CRM) although they have already become more important recently. Using a bibliometric approach, this paper analyzes data mining and CRM research trends from 1989 to 2009 by locating headings “data mining” and “customer relationship management” or “CRM” in topics in the SSCI database. The bibliometric analytical technique was used to examine these two topics in SSCI journals from 1989 to 2009, we found 1181 articles with data mining and 1145 articles with CRM. This paper implemented and classified data mining and CRM articles using the following eight categories—publication year, citation, country/territory, document type, institute name, language, source title and subject area—for different distribution status in order to explore the differences and how data mining and CRM technologies have developed in this period and to analyze data mining and CRM technology tendencies under the above result. Also, the paper performs the K–S test to check whether the analysis follows Lotka’s law. The research findings can be extended to investigate author productivity by analyzing variables such as chronological and academic age, number and frequency of previous publications, access to research grants, job status, etc. In such a way characteristics of high, medium and low publishing activity of authors can be identified. Besides, these findings will also help to judge scientific research trends and understand the scale of development of research in data mining and CRM through comparing the increases of the article author. Based on the above information, governments and enterprises may infer collective tendencies and demands for scientific researcher in data mining and CRM to formulate appropriate training strategies and policies in the future. This analysis provides a roadmap for future research, abstracts technology trends and facilitates knowledge accumulations so that data mining and CRM researchers can save some time since core knowledge will be concentrated in core categories. This implies that the phenomenon “success breeds success” is more common in higher quality publications.     

Global knowledge management research: A bibliometric analysis

The present study characterizes the dynamic publication activity of global knowledge management (KM) by data collected through a search restricted to articles in ISI Web of Science.A total of 2727 unique authors had contributed 1407 publications since 1975. The overwhelming majority (2349 or 86%) of them wrote one publication. The productive authors, their contribution and authorship position are listed to indicate their productivity and degree of involvement in their research publications. The sum of research output of the first or responsible authors from USA, UK and Germany reaches 57% of the total productivity. The distribution of articles is rather widespread - they published in 462 titles of serials, spanning 110 Journal Citation Reports subject categories. The higher quality journals make publication of findings more visible. A Pearson's correlation coefficient is statistically found to be significant between citation frequency of article and impact factor of journal, instead of authorship pattern. The results also indicate that R&D expenditures were actually not proportional to research productivity or citation counts. As the subject highly interacts with other disciplines, the field of KM has not yet developed its own body of literature. KM might have been evolving an interdisciplinary theory that is developing at the boundaries of scientific disciplines. This revised version was published online in June 2006 with corrections to the Cover Date.     

Characteristics of research in China assessed with Essential Science Indicators

To provide an overview of the characteristics of research in China, a bibliometric evaluation of highly cited papers with high-level representation was conducted during the period from 1999 to 2009 based on the Essential Science Indicators (ESI) database. A comprehensive assessment covered overall performance, journals, subject categories, internationally collaborative countries, national inter-institutionally collaborative institutions, and most-cited papers in 22 scientific fields. China saw a strong growth in scientific publications in the last decade, to some extent due to increasing research and development expenditure. China has been more active in ESI fields of chemistry and physics, but more excellent in materials science, engineering and mathematics. Most publications were concerned with the common Science Citation Index subject categories of multidisciplinary chemistry, multidisciplinary materials and science, and physical chemistry. About one half China’s ESC papers were internationally collaborative and the eight major industrialized countries (the USA, Germany, the UK, Japan, France, Canada, Russia, and Italy) played a prominent role in scientific collaboration with China, especially the USA. The Chinese Academy of Sciences took the leading position of institutions with many branches. The “985 Project” stimulated the most productive institutions for academic research with a huge funding injection and the universities in Hong Kong showed good scientific performance. The citation impact of internationally collaborative papers differed among fields and international collaborations made positive contributions to academic research in China.     

A bibliometric study of the trend in articles related to eutrophication published in Science Citation Index

A keyword analysis was applied in this work to evaluate research trends of eutrophication papers published between 1991 and 2010 in any journal of all the subject categories of the Science Citation Index compiled by Institute for Scientific Information, Philadelphia, USA. Eutrophication was used as a keyword to search parts of titles, abstracts, or keywords. The published output analysis showed that eutrophication research steadily increased over the past 20 years and the annual publication output in 2008, 2009, 2010 were about four times that of 1991. The whole paper published by China ranked at 3rd, but these papers’ IF were lower than the average of the world. “Water Framework Directive” and “Life Cycle Assessment” were two of the most frequently used author keywords in the period between 1999 and 2010 whilst they did not appear before 1998. These new conception indicated eutrophication research trend was changing to policy and management from technological researches.