Personal Research Database

Full Text: 1996\Scientometrics36, 379.pdf

Abstract: An approach for evaluation of research is described that integrates output indicators of four stages downstream the innovation process: immediate, intermediate, pre- ultimate and ultimate outputs. Indexes of leading output indicators are constructed. The indexes are integrated cumulatively to form an overall index of key output indicators, which is the integrated figure of merit (IFM). Data for the indicators are obtained from records and key informants, and the indicators are grouped by normalized weights. The paper also discusses the limitations and the methodological, conceptual and political/organizational issues of such an approach to research evaluation.

Keywords: Academic Research, Evaluation, Indexes, Indicators, Industrial-Innovation, Innovation, Process, Research, Research Evaluation, Research-and-Development, Technology

van Raan, A.F.J. (1996), Advanced bibliometric methods as quantitative core of peer review based evaluation and foresight exercises. Scientometrics, 36 (3), 397-420.

Full Text: 1996\Scientometrics36, 397.pdf

Abstract: This paper gives an overview of the potentials and limitations of bibliometric methods for the assessment of strengths and weaknesses in research performance, and for monitoring scientific developments. We distinguish two different methods. In the first application, research performance assessment, the bibliometric method is based on advanced analysis of publication and citation data. We show that the resulting indicators are very useful, and in fact an indispensable element next to peer review in research evaluation procedures. Indicators based on advanced bibliometric methods offer much more than ‘only numbers’. They provide insight into the position of actors at the research front in terms of influence and specializations, as well as into patterns of scientific communication and processes of knowledge dissemination. After a discussion of technical and methodological problems, we present practical examples of the use of research performance indicators. In the second application, monitoring scientific developments, bibliometric methods based on advanced mapping techniques are essential. We discuss these techniques briefly and indicate their most important potentials, particularly their role in foresight exercises. Finally, we give a first outline of how both bibliometric approaches can be combined to a broader and powerful methodology to observe scientific advancement and the role of actors.

Keywords: Research Performance, Indicators

? Miller, R. and Manseau, A. (1996), Bibliometric indicators and the competitive environment of R&D laboratories. Scientometrics, 36 (3), 421-433.

Full Text: 1996\Scientometrics36, 421.pdf

Abstract: The R&D laboratory organization attempts to shape and is influenced by complex and changing environments. New contexts affect the types of evaluation required. Traditional approaches to the R&D laboratory evaluation are thus to be questioned. The changing competitive contexts of R&D organization suggest four worlds of innovation: (i) technology races, (II) efficiency in technological systems, (iii) technical parity and (iv) marker contests. In the emerging competitive arena, the R&D laboratory is evolving toward a network type of organization linked to many different partners and acting as a semi-autonomous business unit. New roles are expected from these kinds of laboratories. They have to develop core strategic competencies, offer competitive outputs, meet clients specifications, create new technology standards and maintain or increase their leadership positions. Bibliometric analysis need to be used in complement with many other methods.

Keywords: Bibliometric, Bibliometric Analysis, Bibliometric Indicators, Complex, Core, Environment, Evaluation, Indicators, Innovation, Leadership, Methods, Productivity, R&D, Standards, Technology

? MacRoberts, M.H. and MacRoberts, B.R. (1996), Problems of citation analysis. Scientometrics, 36 (3), 435-444.

Full Text: 1996\Scientometrics36, 435.pdf

Keywords: Analysis, Citation, Citation Analysis, Citer Motivations, Ortega Hypothesis, Science, Scientific Knowledge, Sociology

? Brown, E.A. (1996), Conforming the government R&D function with the requirements of the government performance and results act - Planning the unplannable? Measuring the unmeasurable? Scientometrics, 36 (3), 445-470.

Full Text: 1996\Scientometrics36, 445.pdf

Abstract: The Army Research Laboratory (ARL) was designated a Pilot Project for Performance Planning under the Government Performance and Results Act of 1993. Of the more than 80 such pilot projects government-wide, ARL was the only organization to represent the R&D community. As such, it was required to break new ground in both the planning and the evaluation of basic and applied research. This paper discusses the efforts made by ARL in both these areas, the insights drawn from these efforts, and the lessons learned.

Keywords: As, Evaluation, Government, Performance, R&D, Research

Campanario, J.M. (1996), Using Citation Classics to study the incidence of serendipity in scientific discovery. Scientometrics, 37 (1), 3-24.

Full Text: 1996\Scientometrics37, 3.pdf

Abstract: The main sociological, philosophical and historical approaches only ascribe a relative importance to the role of chance, error, or accident in scientific progress. The literature on this topic tends to be anecdotal, sometimes hagiographic and rarely systematic. The main goal of this paper is to introduce a new approach to the study of serendipity in scientific discovery. This new approach is based in the study of highly cited papers obtained from the Citation Classics feature of Current Contents. This paper re-examines 205 Citation Classics commentaries from the 400 most-cited papers in the recent history of science. Authors of 17 Citation Classics commentaries (8.3%) mention some kind of serendipity in performing the research reported in the highly cited paper. Commentaries are classified and discussed in detail. In addition, I have examinated the original papers identified above. In 5 from the original highly cited papers authors explained or gave enough hints on the way the serendipitous discovery was done.

Keywords: Most-Cited Papers, SCI 1945-1988, Delayed Recognition, Time, Science, History

Six, J. and Bustamante, M.C. (1996), Bibliometric analysis of publications in experimental particle physics on cosmic rays and with accelerators. Scientometrics, 37 (1), 25-37.

Full Text: 1996\Scientometrics37, 25.pdf

Abstract: In the first part, the present paper presents a quantitative analysis of physics publications in the domain of experimental particle physics, before the Second World War in the field of cosmic rays physics and for the modem times in the field of accelerator and collision rings experiments. In the second part, a more general study is made on publications in the various fields of physics separating contributions from experiment, theory and techniques. Three aspects of physics are enlightened: physics of exploration, physics of applications, and forefront physics.

? Christensen, F.H. and Ingwersen, P. (1996), Online citation analysis - A methodological approach. Scientometrics, 37 (1), 39-62.

Full Text: 1996\Scientometrics37, 39.pdf

Abstract: The paper investigates the online citation analysis possibilities and limitations. The following online processing tools: RANK, MAP, and TARGET, provided by Dialog, are incorporated in order to perform analyses of citations to and from isolated sets of documents as well as to carry out diachrone journal analyses. These analyses imply further to determine journal impact factors of ISI journals. Measures of the scope of internationalisation of journals are proposed and demonstrated. By the combined application of the RANK and TARGET commands we demonstrate a hitherto overlooked possibility of working with bibliographic coupling online and mapping of scientific fields.

Keywords: Analysis, Bibliographic, Bibliographic Coupling, Citation, Citation Analysis, Citations, Impact, Impact Factors, Information, Internationalisation, ISI, Journal, Journal Impact, Journal Impact Factors, Journals, Map, Mapping, Rank, Target

? Rivas, A.L., Deshler, D., Colle, R.D., Gonzalez, R.N. and Quimby, F.W. (1996), Indicators of disciplinary differentiation: Interdisciplinary linkages and adoption rate of biological innovations. Scientometrics, 37 (1), 63-86.

Full Text: 1996\Scientometrics37, 63.pdf

Abstract: Two indicators regarded to reflect the status of disciplinary differentiation were assessed through citation analysis. Adoption of scientific innovations (publications utilizing new scientific information) and interdisciplinary linkages (percentage of total publications of single disciplines which are cross-referenced by other disciplines) were investigated in selected biological professions. Findings indicated: 1) a significant delay in the use of innovations and a significant difference in the emphasis of interdisciplinary linkages in several professions and disciplines; 2) faster adoption of innovations and greater interdisciplinary linkages in areas with broader disciplinary contents; 3) an inter-personal communication pattern; and 4) slower adoption in applied than in basic fields.

Keywords: Analysis, Cell, Citation, Citation Analysis, Communication, Differentiation, Indicators, Information, Interdisciplinary, Publications, Scientific Information

? Raj, C.B.C. (1996), Publications, cost and a proposition. Scientometrics, 37 (1), 87-103.

Full Text: 1996\Scientometrics37, 87.pdf

Abstract: The cause and effect that led to the enormous growth of research journals during the past few decades are analyzed. These factors seem to have contributed to the financial pressure on the academic library system and the ‘publishing pressure’ on the researchers. Overall, the higher educational system in chemistry, as well as all sciences and humanities, seem to have been affected. Printing practices of a few research journals, mostly in chemistry and chemical engineering, are compared in terms of price per standardized page which indicate that savings of several million dollars should be possible worldwide through a coherent effort of the various members of the research community. Certain simple propositions to cut down the volume of publications have been discussed. More propositions are likely to be put forward by those who start to think about journal proliferation and the underlying issues.

Keywords: Growth, Journal, Journals, Pressure, Publications, Publishing, Research, Researchers, Sciences, Unnecessary Journals

? Moed, H.F., vanLeeuwen, T.N. and Reedijk, J. (1996), A critical analysis of the journal impact factors of Angewandte Chemie and the Journal of the American Chemical Society - Inaccuracies in published impact factors based on overall citations only. Scientometrics, 37 (1), 105-116.

Full Text: 1996\Scientometrics37, 105.pdf

Abstract: it is shown that the Journal Impact Factor as published by ISI - an indicator increasingly used as an measure for the quality of scientific journals - is misleading when two leading journals in chemistry, Angew. Chem., and J. Am. Chem. Sec., are compared. A detailed analysis of the various kinds publications in both journals over the period 1982-1994 shows that the overall impact factors based on publications and citations in two consecutive years for JACS communications (5.27 for 1993) are significantly higher than those of Angew. Chem. (3.26 for 1993). Even when all types of articles, i.e. including reviews, are included in the impact factors, JACS has a higher score than Angew. Chem. (5.07 vs. 4.03 in 1993). Critical and accurate analyses of citation figures is required when such data are used in science policy decisions, such as library subscriptions. It is proposed that when IF values for several journals are compared, only similar publication types are considered.

Keywords: Analysis, Articles, Citation, Citations, Critical, Impact, Impact Factor, Impact Factors, ISI, Journal, Journal Impact, Journal Impact Factors, Journals, Policy, Publication, Publications, Quality, Science, Science Policy, Scientific Journals

Korevaar, J.C. and Moed, H.F. (1996), Validation of bibliometric indicators in the field of mathematics. Scientometrics, 37 (1), 117-130.

Full Text: 1996\Scientometrics37, 117.pdf

Abstract: Bibliometric analyses of scientific publications provide quantitative information that enables evaluators to obtain a useful picture of a team’s research visibility. In combination with peer judgements and other qualitative background knowledge, these analyses can serve as a basis for discussions about research performance quality. However, many mathematicians are not convinced that citation counts do in fact provide useful information in the field of mathematics. According to these mathematicians, citation and publication habits differ completely from scholarly fields such as chemistry or physics. Therefore, it is impossible to derive valid information regarding research performance from citation counts. The aim of this study is to obtain more insight into the significance of citation-based indicators in the field of mathematics. To which extent do citation-scores mirror to the opinions of experts concerning the quality of a paper or a journal? A survey was conducted to answer this question. Top journals, as qualified by experts, receive significantly higher citation rates than good journals. These good journals, in rum, have significantly higher scores than journals with the qualification less good. Top publications, recorded in the ISI database. receive on the average 15 times more citations than the mean score within the field of mathematics as a whole. In conclusion, the experts’ views on top publications or top journals correspond very well to bibliometric indicators based on citation counts

Keywords: Bibliometric, Citation, Citations, English, Journal, Journals, Publication, Research, Research Performance, SCI, Science, Scientific Publications, Scientometrics, Visibility

? Plaza, L.M., Martín, M.J. and Rey, J. (1996), Scientific relations between Spain and Central-Eastern European countries for the period 1982-1992. Scientometrics, 37 (1), 131-142.

Full Text: 1996\Scientometrics37, 131.pdf

Abstract: This paper analyzes the scientific relationships between Spain and the Eastern European countries (EEc), including the former USSR, from 1982 to 1992. The study considers the number of co-authored papers as well as the number of stays which reflect to the exchange of scientists among them. The total number of co-authored papers of Spanish scientists with their colleagues of those countries is 664 as recorded in the Science Citation Index. During the last three years, a significative increase in the number of co-signed papers has been observed. From the sample considered, the percentage of bilateral and multilateral co-authored papers is 43.8 and 56.2 respectively. In absolute figures, USSR and Poland are the countries with highest number of collaborative papers with Spain. However, in relation to their scientific output, Poland and Hungary show a higher percentage of co-authored papers than the rest of EEc. On the other hand, previous data, provided by the Spanish Secretary of State for Research and Universities (SEUI), related to the flow of scientists on sabbatical year to and from Spain,(1) showed that from 1984 to 1994, a total of 213 researchers come from the EEc to Spain, while the number of Spanish scientists going to those countries was extremely scarce.

Keywords: Citation, Countries, Hand, Hungary, Papers, Research, Researchers, Science, Science Citation Index, Scientific Output, Spain, Universities

? Papadopoulos, S. (1996), Evaluation of industrial research. Scientometrics, 37 (1), 143-151.

Full Text: 1996\Scientometrics37, 143.pdf

Keywords: Evaluation, Research

? Persson, O. and Melin, G. (1996), Equalization, growth and integration of science. Scientometrics, 37 (1), 153-157.

Full Text: 1996\Scientometrics37, 153.pdf

Abstract: A study of the production of scientific papers, co-authorships, and R&D-expenditures shows that science is becoming more equally distributed among the OECD-countries. Papers in the journal Science are more unequally distributed than papers in Science Citation Index as a whole or the distribution of R&D-investments. Scientific collaboration, is a major factor affecting the distribution of scientific papers.

Keywords: Citation, Co-Authorships, Collaboration, Growth, Integration, Journal, OECD Countries, OECD-Countries, Papers, Science, Science Citation Index, Scientific Collaboration

Uzun, A. and Ozel, M.E. (1996), Publication patterns of Turkish astronomers. Scientometrics, 37 (1), 159-169.

Full Text: 1996\Scientometrics37, 159.pdf

Abstract: We studied 187 papers published in the journals on astronomy and astrophysics indexed in the Science Citation Index (SCI) for the decade period 1985-1994. These have been the papers that included at least one author listing an address from an institution in Turkey. We found that a great majority of the papers, whether theoretical or observational, went to only very small number (three) of a total set of 34 journals in the area. The distribution of papers by institutions revealed that about three fourths of the papers came from two universities: the Aegean University, and the Middle East Technical University (METU). We also found that the fraction of multiple authored papers has increased appreciably and the number of citations an ‘average’ paper received has decreased gradually during the period considered.

Keywords: Turkey

? Breimer, L.H. (1996), Age, sex and standards of current doctoral theses by Swedish medical graduates. Scientometrics, 37 (1), 171-176.

Full Text: 1996\Scientometrics37, 171.pdf

Abstract: Recent Swedish publication-based doctoral dissertations by medical practitioners contained an average of four published papers and one manuscript per theses. The average number of authors per paper was four. The candidate was the first author on 83% of papers indicating that the same paper was not used to support several theses. 82% of the candidates had completed their specialist training: 24% of these were women; surgeons were the biggest single group. The average age in years was: surgeons 40 (34-48); non-surgeons 41 (34-49); and 35 (32-36) for those who had just completed their basic post-qualification registration. These findings are in keeping with the Swedish tradition of scientific and evidence based medicine.

Keywords: Age, Author, Authors, Dissertations, Doctoral Theses, Medical, Medicine, Papers, Registration, Sex, Standards, Training, Women

? Zhang, H.Q. (1996), Research performance in key medical universities in China observed from the scientific productivity. Scientometrics, 37 (1), 177-190.

Full Text: 1996\Scientometrics37, 177.pdf

Abstract: Research activities in the lift: sciences during the past few years, have increased appreciably in China, both in regard to relative output of publications and in their impact on the international research community. The purpose of this study is to analyze and evaluate quantitatively the scientific productivity of key medical universities in China by using CBMdisc, MEDLINE and SCI databases. The results showed that Tongji Medical University ranks first in terms of paper output in Chinese and in English languages, while Beijing Medical University is placed second in output but is first in citation impact. Shanghai Medical University had the top annual paper output per scientist, with 2.53 papers in Chinese and 0.13 papers in English. The results also showed that the coverage of Chinese biomedical publications by western indexing services is very poor.

Keywords: Life Sciences, Publication, Japan

? van Raan, A.F.J. (1996), Introduction to the proceedings of the Fourth International Conference on Science and Technology Indicators. Scientometrics, 37 (2), 191-193.

Full Text: 1996\Scientometrics37, 191.pdf

Keywords: Conference, Indicators, International, Science, Technology

? Glanzel, W. and Czerwon, H.J. (1996), A new methodological approach to bibliographic coupling and its application to the national, regional and institutional level. Scientometrics, 37 (2), 195-221.

Full Text: 1996\Scientometrics37, 195.pdf

Abstract: In an earlier study the authors have shown that bibliographic coupling techniques can be used to identify ‘hot’ research topics. The methodology is based on appropriate thresholds for both number of related documents and the strength of bibliographic links. Those papers are called core documents that have more than 9 links of at Least the strength 0.25 according to Salton’s measure, provided they are articles, notes or reviews. This choice resulted in a selection of nearly one per cent of all papers of the above types recorded in the 1992 annual cumulation of the SCI. Core documents proved important nodes in the network of documented science communication. In the present study, the set of core documents is analysed by journals, subfields and corporate addresses. The latter analysis is conducted on both national and regional-institutional level. First all countries which have published at least 20 core documents in 1992 are investigated in terms of their research profiles, their international collaboration patterns and their citation impact. Finally, those eight members of the European Union which have published at least 20 core documents in 1992 are analysed in respect of regional and institutional distribution of core documents.

Keywords: Analysis, Articles, Authors, Bibliographic, Bibliographic Coupling, Citation, Citation Impact, Co-Citation, Collaboration, Communication, Core Documents, Core-Documents, Countries, Impact, Indicators, International Collaboration, Journals, Methodology, Network, Papers, Research, Research Topics, SCI, Science, Science Communication, Strength, Topics

? Zitt, M. and Bassecoulard, E. (1996), Reassessment of co-citation methods for science indicators: Effect of methods improving recall rates. Scientometrics, 37 (2), 223-244.

Full Text: 1996\Scientometrics37, 223.pdf

Abstract: wAlthough co-citation techniques are very powerful structuring tools, the use of science policy indicators based on co-citation has often been criticized, especially on ISI research fronts. A major issue is the small fraction of literature retrieved, i.e. the “recall rate” problem. Our investigations indicate that at the level of micro/meso studies high recall rates can be achieved by (a) the use of appropriate clustering techniques limiting singletons and (b) the enrichment of cocited cores by medium-cited items. This combination of appropriate clustering and extension of recall proves to be efficient, provided that careful trade-offs are sought between the extension and relevance of recall. It leads to a reassessment of the performance of the co-citation approach for structuring scientific fields and providing related indicators not limited to the ‘leading edge’. It also opens new opportunities for comparison/combination with other relational methods such as co-word analysis.

Keywords: Analysis, Clustering, Cocitation, Cocitation Analysis, Fraction, Index, Indicators, ISI, Literature, Policy, Research, Science, Science Policy, Scientific Literatures

? Niwa, F. and Tomizawa, H. (1996), A trial of general indicator of science and technology: Methodological study of overall estimation of national S&T activity. Scientometrics,