69 (3), 591-606.
Full Text: 2006\Scientometrics69, 591.pdf
Abstract: Peer reviews are highly valued in academic life, but are notoriously unreliable. A major problem is the substantial measurement error due to the idiosyncratic responses when large numbers of different assessors each evaluate only a single or a few submissions (e.g., journal articles, grants, etc.). To address this problem. the main funding body of academic research in Australia conducted a trial ‘reader system’ in which each of a small number of senior academics read all proposals within their subdiscipline. The traditional peer review process for 1996 (2,989 proposals, 6,233 assessors) resulted in unacceptably low reliabilities comparable with those found in other research (0.475 for research project, 0.572 for researcher). For proposals from psychology and education in 1997, the new reader system resulted in substantially higher reliabilities: 0.643 and 0.881, respectively. In comparison to the traditional peer review approach, the new reader system is substantially more reliable, timely, and cost efficient - and applicable to many peer review situations.
Keywords: Australia, Context, Cost, Decisions, Education, Experiment, Interjudgmental Reliability, Journals, Life, Manuscript, Measurement, Peters, Proposals, Ratings, Research, Review, Reviews, Science, Validity
? Ceci, A., De Marchi, M. and Rocchi, M. (2006), A note on innovation in the chemical industry in Italy. Scientometrics, 69 (3), 607-614.
Full Text: 2006\Scientometrics69, 607.pdf
Abstract: In our analysis we have recalled the general results of recent studies on innovation according to which innovation within the manufacturing industry is a complex phenomenon which does not lend itself to description or explanation utilising simplistic analytical models. We have then taken into account clues garnered from various descriptions of the innovative behaviour of companies Utilising several indicators of how innovative they are. Our results confirm the belief that notable differences exist between the two sub-sectors into which the chemical industry is divided: pharmaceutical and basic chemicals. Regarding the policy implications of our research, the close correlation between patents and basic research expenditure suggests that the Italian Fund for Basic Research might play a useful role in promoting innovation in the chemical industry.
Keywords: Analysis, Basic Research, Chemical, Chemicals, Complex, Correlation, Indicators, Italy, Manufacturing, Models, Policy, Policy Implications, Recent, Research, Science
? Balaban, A.T. and Klein, D.J. (2006), Is chemistry ‘The Central Science’? How are different sciences related? Co-citations, reductionism, emergence, and posets. Scientometrics, 69 (3), 615-637.
Full Text: 2006\Scientometrics69, 615.pdf
Abstract: According to a widely used introductory chemistry text by T. E. Brown et al.,(1) chemistry is ‘The Central Science’. But scientometric co-citation analyses indicate that biochemistry seems presently to be more interconnected to other sciences. On the other hand, mathematics is considered by many to permeate all sciences and hence might compete as the choice for centrality. A critical commentary and argument leads to a proposal for an alternative partially ordered hierarchical ‘framework’ map of sciences. This argument is supplemented by a scientometric approach based on university Course requirements for different curricula, so as to support our partially ordered map. This alternative ‘framework’ mapping then is seen to indicate a special position for chemistry, as where significant branching begins.
Keywords: Biochemistry, Biology, Co-Citation, Cocitation, Curricula, dec, Emergence, Hand, Mapping, Position, Requirements, Sciences, Scientific Literatures, Support, Understanding Life
? Peña-Rey, I., Pérez-Farinós, N. and Campos, P.M. (2006), Scientific production on tetrachloro-dibenzo-dioxins: A bibliometric study. Scientometrics, 69 (3), 639-650.
Full Text: 2006\Scientometrics69, 639.pdf
Abstract: Tetrachloro-dibenzo-dioxins were declared as human carcinogenic substances in 1997. Objective: to analyse the scientific production about tetrachloro-dibenzo-dioxins between 1976 and 2005. Sella Price and Bradford models were applied. Different aspects of papers were analysed. Impact factor of journals was studied. 3484 articles were found. The number of articles published each year is fitted to Solla Price model. It has been shown the scientific literature dispersion. Specialisation of some journals of Nucleus and 1(st) Bradford Zone has been shown.
Keywords: Bibliometric, Bibliometric Study, Cancer, Carcinogenic, DEC, Dispersion, Human, Index, Journals, Law, Model, Models, Population, Production, Scientific Production
? Maier, G. (2006), Impact factors and peer judgment: The case of regional science journals. Scientometrics, 69 (3), 651-667.
Full Text: 2006\Scientometrics69, 651.pdf
Abstract: This paper discusses the relationship between Journal Impact Factors and the scientific community’s judgment of the quality of journals in regional science, a discipline closely related to economics and geography. The paper compares the results of a survey inquiring the quality of journals in the discipline with the impact factors of these journals for a total of five years. The comparison shows that no significant positive correlation between the impact factors and the peer judgments can be found. In many cases the correlation turns out to be negative - in some cases even significantly.
Keywords: Bibliometric Indicators, Citation, Comparison, Correlation, Criteria, DEC, Economics, Geography, Impact, Impact Factors, Journals, Market, Paper, Quality, Ranking, Ratings, Regional, Science, Survey, Universities
? Bollen, J., Rodriguez, M.A. and Van De Sompel, H. (2006), Journal status. Scientometrics, 69 (3), 669-687.
Full Text: 2006\Scientometrics69, 669.pdf
Abstract: The status of an actor in a social context is commonly defined in terms of two factors: the total number of endorsements the actor receives from other actors and the prestige of the endorsing actors. These two factors indicate the distinction between popularity and expert appreciation of the actor. respectively. We refer to the former as popularity and to the latter as prestige. These notions of popularity and prestige also apply to the domain of scholarly assessment. The ISI Impact Factor (ISI IF) is defined as the mean number of citations a journal receives over a 2 year period. By merely Counting the amount of citations and disregarding the prestige of the citing journals, the ISI IF is a metric of popularity, not of prestige. We demonstrate how a weighted version of the popular PageRank algorithm can be used to obtain a metric that reflects prestige. We contrast the rankings Of journals according to their ISI IF and their Weighted PageRank, and we provide an analysis that reveals both significant overlaps and differences. Furthermore, we introduce the Y-factor which is a simple combination of both the ISI IF and the weighted PageRank, and find that the resulting journal rankings correspond well to a general understanding of journal status.
Keywords: Algorithm, Analysis, Assessment, Impact Factor, Index, Quality, Research Output, Researchers, Social
? Contreras, C., Edwards, G. and Mizala, A. (2006), The Current Impact Factor and the long-term impact of scientific journals by discipline: A logistic diffusion model estimation. Scientometrics, 69 (3), 689-695.
Full Text: 2006\Scientometrics69, 689.pdf
Abstract: This paper estimates the long-term impact of journals aggregated in 24 different fields, using a simple logistic diffusion model, and relates the results to the current impact factor. Results show that while the current and the long-term impact factors have a high cot-relation coefficient, some fields are systematically slower-moving than others, as they often differ in the proportion of the overall impact through time that occurs in the short term.
Keywords: Diffusion, Estimation, Impact, Impact Factors, Model, Paper
? Galvez, C. and Moya-Anegon, F. (2007), Standardizing formats of corporate source data. Scientometrics, 70 (1), 3-26.
Full Text: 2007\Scientometrics70, 3.pdf
Abstract: This paper describe an approach for improving the data quality of corporate sources when databases are used for bibliometric purposes. Research management relies on bibliographic databases and citation index systems as analytical tools, yet the raw resources for bibliometric studies are plagued by a lack of consistency in fied formatting for institution data. The present contribution puts forth a Natural Language Processing (NLP)-oriented method for the identification of the structures guiding corporate data and their mapping into a standardized format. The proposed unification process is based on the definition of address patterns and the ensuing application of Enhanced Finite-State Transducers (E-FST). Our procedure was tested on address formats downloaded from the INSPEC, MEDLINE and CAB Abstracts. The results demonstrate the helpfulness of the method as long as close control of errors is exercised as far as the formats to be unified. The computational efficacy of the model is noteworthy, due to the fact that it is firmly guided by the definition of data in the application domain.
Keywords: Analytical Tools, Application Domain, Bibliographic Databases, Bibliometric, Bibliometric Indicators, Bibliometric Studies, Citation, Citation Analysis, Computational, Control, Databases, Delimitation, Efficacy, Errors, Identification, Index, Information, Institutions, Management, Mapping, Medline, Model, Output, Paper, Process, Publications, Quality, Research Performance, Source, Sources, Strategies, Tools
? Lee, Y.G., Lee, J.D., Song, Y.I. and Lee, S.J. (2007), An in-depth empirical analysis of patent citation counts using zero-inflated count data model: The case of KIST. Scientometrics, 70 (1), 27-39.
Full Text: 2007\Scientometrics70, 27.pdf
Abstract: Patent citation counts represent an aspect of patent quality and knowledge flow. Especially, citation data of US patents contain most valuable pieces of the information among other patents. This paper identifies the factors affecting patent citation counts using US patents belonging to Korea Institute of Science and Technology (KIST). For patent citation count model, zero-inflated models are announced to handle the excess zero data. For explanatory factors, research team characteristics, invention-specific characteristics, and geographical domain related characteristics are suggested. As results, the size of invention and the degree of dependence upon Japanese technological domain significantly affect patent citation counts of KIST.
Keywords: Analysis, Dependence, Flow, Information, Innovation, Inventors, Knowledge, Knowledge Flows, Model, Models, Paper, Quality, Regression, Research, Science, Spillovers, Technology, US
Albert, A., Granadino, B. and Plaza, L.M. (2007), Scientific and technological performance evaluation of the Spanish Council for Scientific Research (CSIC) in the field of Biotechnology. Scientometrics, 70 (1), 41-51.
Full Text: 2007\Scientometrics70, 41.pdf
Abstract: An evaluation of the Spanish CSIC performance in Biotechnology, as compared with those of the French CNRS and the Italian CNR, has been carried out to determine the balance between the generation of scientific knowledge and the transfer of technology. This study shows a high scientific productivity mostly in journals with moderate impact factor, a low generation of patents and an insufficient transfer of knowledge to the Spanish companies. Other indicators confirm the existence of competitive human resources in biotechnological research producing scientific knowledge of interest for the development of patents and that cooperates successfully at European level.
Keywords: Development, Evaluation, Human, Impact, Indicators, Knowledge, Performance, Productivity, Research, Science, Sectors, Transfer
Aleixandre-Benavent, R., Zurian, J.C.V., Miguel-Dasit, A., Arroyo, A.A. and Gomez, M.C. (2007), Hypothetical influence of non-indexed Spanish medical journals on the impact factor of the Journal Citation Reports-indexed journals. Scientometrics, 70 (1), 53-66.
Full Text: 2007\Scientometrics70, 53.pdf
Abstract: The purpose of this study is to analyze the hypothetical changes in the 2002 impact factor (IF) of the biomedical journals included in the Science Citation Index-Journal Citation Reports (SCI-JCR) by also taking into account cites coming from 83 non-indexed Spanish journals on different medical specialties. A further goal of the study is to identify the subject categories of the SCI-JCR with the largest increase in their IF, and to estimate the 2002 hypothetical impact factor (2002 HIF) of these 83 non-indexed Spanish journals. It is demonstrated that the inclusion of cites from a selection of non SCI-JCR-indexed Spanish medical journals in the SCI-JCR-indexed journals produces a slight increase in their 2002 IF, specially in journals edited in the USA and in the UK. More than half of the non-indexed Spanish journals has a higher 2002 HIF than that of the SCI-JCR-indexed journal with the lowest IF in the same subject category.
Keywords: Bias, Bibliometric Indicators, Biomedical Journals, Goal, Impact, Impact Factor, Inclusion, Information, Journal, Journals, Medical, Medical Journals, Medical Specialties, Publications, Quality, SCI, Science, Scientific Activity, Selection, Tool, UK, USA
? Lin, C.T. and Chiang, C.T. (2007), Evaluating the performance of sponsored Chinese herbal medicine research. Scientometrics, 70 (1), 67-84.
Full Text: 2007\Scientometrics70, 67.pdf
Abstract: Chinese herbal medicine has recently become a hot research field internationally, an increasing number of pharmaceutical researchers and scientists have dedicated themselves to such research work. Based on papers in the American Journal of Chinese Medicine from 2002 to 2004, 60% of papers published in the journal were sponsored by different institutions in the authors’ countries. This fact indicates that researchers receive sponsorship for their work, and sponsors should pay more attention on the control of the researchers to use financial support more efficiency. This study applied Analytic Hierarchy Process, AHP to evaluating the performance of sponsored Chinese herbal medicine research, and this method can help sponsors weight evaluation elements without having to change the system of every category of research. To explain the process and application of AHP, a Taiwanese case study is presented. The analytical results presented in this study, provide a reference for institutes supporting research on Chinese Herbal Medicine.
Keywords: AHP, Attention, Case Study, Chinese, Control, Efficiency, Elements, Evaluation, Institutions, Performance, Research, Research Impact, Taiwanese
? Zabala-Iturriagagoitia, J.M., Jimenez-Saez, F., Castro-Martinez, E. and Gutierrez-Gracia, A. (2007), What indicators do (or do not) tell us about Regional Innovation Systems. Scientometrics, 70 (1), 85-106.
Full Text: 2007\Scientometrics70, 85.pdf
Abstract: This paper analyses some of the methodologies and R&D and innovation indicators used to measure Regional Innovative Capacity in Spain for the period 1996-2000. The results suggest that the approaches examined are not sufficiently rigorous, they vary depending on the methodology and indicators employed. Therefore, we would suggest that the right balance between quantitative and qualitative approaches could produce a better evaluation of innovation system performance which would be more useful to policy makers and other stakeholders.
Keywords: Evaluation, Indicators, Methodology, Nations, Paper, Performance, Policy, Qualitative, Spain
? Guan, J.C. and Ma, N. (2007), A bibliometric study of China’s semiconductor literature compared with other major Asian countries. Scientometrics, 70 (1), 107-124.
Full Text: 2007\Scientometrics70, 107.pdf
Abstract: In this paper we compare the scientific research in the semiconductor-related field in China with some other major nations in Asia. It is based on the bibliometric information from SCI-Expanded database during the time period of 1995-2004. We show that China has been developing fast in semiconductor research, and become the second productive country in Asia as reflected by the publication profile. The evidences indicate a significant increasing trend in the research efforts and readership among Asian countries. Similar to the scientists in Japan and South Korea, Chinese scientists were more inclined to work in larger groups, typically 4 or more authors. The assessment of research quality is further conducted based on citation-based measures. As benchmarks, two western countries, namely USA and Germany, have been compared in the citation analysis. It is revealed that the impacts of research outputs in the Asian countries, except for Japan, have been badly incommensurate with their devoted research efforts compared with USA and Germany. Like most of other Asian countries the research results of Chinese scientists in semiconductor have a low international visibility despite their strong research efforts and increasingly large domestic readership. The application of Leimkuhler curve illustrates vividly the inequality of citation times among the compared countries. Furthermore, the Gini Indices of each country and each pair of countries are calculated which illustrates again the inequality of informetric productivities.
Keywords: Analysis, Asia, Asian, Assessment, Basic Research, Bibliometric, Bibliometric Study, China, Chinese, Citation, Citation Analysis, Citation Impact, Germany, GINI Index, Groups, Impacts, Indicators, Information, Japan, Journals, Korea, Low, Paper, Profile, Publication, Publication Output, Quality, Research, Research Performance, Research Quality, Research Results, Science, South Korea, Trend, USA, Visibility
? Heinze, T., Shapira, P., Senker, J. and Kuhlmann, S. (2007), Identifying creative research accomplishments: Methodology and results for nanotechnology and human genetics. Scientometrics, 70 (1), 125-152.
Full Text: 2007\Scientometrics70, 125.pdf
Abstract: Motivated by concerns about the organizational and institutional conditions that foster research creativity in science, we focus on how creative research can be defined, operationalized, and empirically identified. A functional typology of research creativity is proposed encompassing theoretical, methodological and empirical developments in science. We then apply this typology through a process of creative research event identification in the fields of nanotechnology and human genetics in Europe and the United States, combining nominations made by several hundred experts with data on prize winners. Characteristics of creative research in the two respective fields are analyzed, and there is a discussion of broader insights offered by our approach.
Keywords: Europe, Genetics, Human, Identification, Made, Organizational, Research, Science, Scientific Creativity, Typology, United States
? Pasterkamp, G., Rotmans, J.I., de Kleijn, D.V.P. and Borst, C. (2007), Citation frequency: A biased measure of research impact significantly influenced by the geographical origin of research articles. Scientometrics, 70 (1), 153-165.
Full Text: 2007\Scientometrics70, 153.pdf
Abstract: Context. The use of citation frequency and impact factor as measures of research quality and journal prestige is being criticized. Citation frequency is augmented by self-citation and for most journals the majority of citations originate from a minority of papers. We hypothesized that citation frequency is also associated with the geographical origin of the research publication. Objective. We determined whether citations originate more frequently from institutes that are located in the same country as the authors of the cited publication than would be expected by chance. Design. We screened citations referring to 1200 cardiovascular publications in the 7 years following their publication. For the 1200 citation recipient publications we documented the country where the research originated (9 countries/regions) and the total number of received citations. For a selection of 8864 citation donor papers we registered the country/region where the citing paper originated. Results. Self-citation was common in cardiovascular journals (n = 1534, 17.8%). After exclusion of self-citation, however, the number of citations that originated from the same country as the author of the citation recipient was found to be on average 31.6% higher than would be expected by chance (p < 0.01 for all countries/regions). In absolute numbers, nation oriented citation bias was most pronounced in the USA, the country with the largest research output (p < 0.001). Conclusion. Citation frequency was significantly augmented by nation oriented citation bias. This nation oriented citation behaviour seems to mainly influence the cumulative citation number for papers originating from the countries with a larger research output.
Keywords: Bias, Cardiovascular, Impact, Journal Impact, Output, Paper, Quality, Research, Research Articles, Research Quality, Science, Selection, USA
? Egghe, L. (2007), Probabilities for encountering genius, basic, ordinary or insignificant papers based on the cumulative nth citation distribution. Scientometrics, 70 (1), 167-181.
Full Text: 2007\Scientometrics70, 167.pdf
Abstract: This article calculates probabilities for the occurrence of different types of papers such as genius papers, basic papers, ordinary papers or insignificant papers. The basis of these calculations are the formulae for the cumulative n(th) citation distribution, being the cumulative distribution of times at which articles receive their n(th) (n = 1,2,3,...) citation. These formulae (proved in previous papers) are extended to allow for different aging rates of the papers. These new results are then used to define different importance classes of papers according to the different values of n, in function of time t. Examples are given in case of a classification into four parts: genius papers, basic papers, ordinary papers and (almost) insignificant papers. The fact that, in these examples, the size of each class is inversely related to the importance of the journals in this class is proved in a general mathematical context in which we have an arbitrary number of classes and where the threshold values of n in each class are defined according to the natural law of Weber-Fechner.
Keywords: Aging, Classification, Distribution, Importance, Law, Natural, Sleeping Beauties, Threshold
? Lo, S.C. (2007), Patent analysis of genetic engineering research in Japan, Korea and Taiwan. Scientometrics, 70 (1), 183-200.
Full Text: 2007\Scientometrics70, 183.pdf
Abstract: The aim of this study is to reveal the research growth, the distribution of research productivity and impact of genetic engineering research in Japan, Korea and Taiwan by taking patent bibliometrics approach. This study uses quantitative methods adopt from bibliometrics to analyze the patents granted to Japan, Korea and Taiwan by United States Patent and Trademark Office (USPTO) from 1991 to 2002. In addition to patent and citation count, Bradford’s Law is applied to identify core assignees in genetic engineering. Patent coupling approach is taken to further analyze the patents granted to the core assignees to enclose the correlations among the core assignees. 13,055 genetic engineering patents were granted during the period of 1991 to 2002. Japan, Korea and Taiwan own 841 patents and Japan owns most of them. 270 assignees shared 841 patents and 16 core assignees are identified by the Bradford’s Law. 18,490 patents were cited by the 13,055 patents and 1,146 out of the 18,490 cited patents were granted to Japan, Korea and Taiwan. The results show Japan performs best in productivity and research impact among three countries. The core assignees are also Japan based institutions and four technical clusters are identified by patent coupling.
Keywords: Analysis, Bibliometrics, Biotechnology, Citation, Clusters, Core, Correlations, Coupling, Distribution, Engineering, Genetic, Genetic Engineering, Growth, Impact, Indicators, Institutions, Japan, Knowledge, Korea, Methods, Patents, Productivity, Research, Research Productivity, Scientific Papers, Sectors, Statistics, Taiwan, United States
? Schubert, A. (2007), Successive h-indices. Scientometrics,
Share with your friends: |