Benchmarking international scientific excellence: Are highly cited research papers an appropriate frame of reference? View Full Text


Ontology type: schema:ScholarlyArticle     


Article Info

DATE

2002-07

AUTHORS

Robert J. W. Tijssen, Martijn S. Visser, Thed N. van Leeuwen

ABSTRACT

This paper introduces a citation-based "systems approach" for analyzing the various institutional and cognitive dimensions of scientific excellence within national research systems. The methodology, covering several aggregate levels, focuses on the most highly cited research papers in the international journal literature. The distribution of these papers across institutions and disciplines enables objective comparisons their (possible) international-level scientific excellence. By way of example, we present key results from a recent series of analyses of the research system in the Netherlands in the mid 1990s, focussing on the performance of the universities across the various major scientific disciplines within the context of the entire system"s scientific performance. Special attention is paid to the contribution in the world"s top 1% and top 10% most highly cited research papers. The findings indicate that these high performance papers provide a useful analytical framework - both in terms of transparency, cognitive and institutional differentiation, as well as its scope for domestic and international comparisons - providing new indicators for identifying "world class" scientific excellence at the aggregate level. The average citation scores of these academic "Centres of Scientific Excellence" appear to be an inadequate predictor of their production of highly cited papers. However, further critical reflection and in-depth validation studies are needed to establish the true potential of this approach for science policy analyses and evaluation of research performance. More... »

PAGES

381-397

Journal

TITLE

Scientometrics

ISSUE

3

VOLUME

54

Author Affiliations

Identifiers

URI

http://scigraph.springernature.com/pub.10.1023/a:1016082432660

DOI

http://dx.doi.org/10.1023/a:1016082432660

DIMENSIONS

https://app.dimensions.ai/details/publication/pub.1042763852


Indexing Status Check whether this publication has been indexed by Scopus and Web Of Science using the SN Indexing Status Tool
Incoming Citations Browse incoming citations for this publication using opencitations.net

JSON-LD is the canonical representation for SciGraph data.

TIP: You can open this SciGraph record using an external JSON-LD service: JSON-LD Playground Google SDTT

[
  {
    "@context": "https://springernature.github.io/scigraph/jsonld/sgcontext.json", 
    "about": [
      {
        "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/1402", 
        "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
        "name": "Applied Economics", 
        "type": "DefinedTerm"
      }, 
      {
        "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/14", 
        "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
        "name": "Economics", 
        "type": "DefinedTerm"
      }
    ], 
    "author": [
      {
        "affiliation": {
          "alternateName": "Leiden University", 
          "id": "https://www.grid.ac/institutes/grid.5132.5", 
          "name": [
            "Centre for Science and Technology Studies (CWTS), Leiden University, Leiden, (The Netherlands)"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Tijssen", 
        "givenName": "Robert J. W.", 
        "id": "sg:person.012700347665.67", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.012700347665.67"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "Leiden University", 
          "id": "https://www.grid.ac/institutes/grid.5132.5", 
          "name": [
            "Centre for Science and Technology Studies (CWTS), Leiden University, Leiden, (The Netherlands)"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Visser", 
        "givenName": "Martijn S.", 
        "id": "sg:person.012212471611.14", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.012212471611.14"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "Leiden University", 
          "id": "https://www.grid.ac/institutes/grid.5132.5", 
          "name": [
            "Centre for Science and Technology Studies (CWTS), Leiden University, Leiden, (The Netherlands)"
          ], 
          "type": "Organization"
        }, 
        "familyName": "van Leeuwen", 
        "givenName": "Thed N.", 
        "id": "sg:person.015311136760.01", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.015311136760.01"
        ], 
        "type": "Person"
      }
    ], 
    "citation": [
      {
        "id": "sg:pub.10.1007/bf02129599", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1002541679", 
          "https://doi.org/10.1007/bf02129599"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/bf02129599", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1002541679", 
          "https://doi.org/10.1007/bf02129599"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1177/030631277600600102", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1005445212"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1177/030631277600600102", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1005445212"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1016/s0048-7333(98)00026-2", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1006415756"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1002/(sici)1097-4571(198909)40:5<342::aid-asi7>3.0.co;2-u", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1008687221"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1177/030631282012002005", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1016152426"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1177/030631282012002005", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1016152426"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/bf02017064", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1024229857", 
          "https://doi.org/10.1007/bf02017064"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/bf02017064", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1024229857", 
          "https://doi.org/10.1007/bf02017064"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/bf02458391", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1026815203", 
          "https://doi.org/10.1007/bf02458391"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/bf02458391", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1026815203", 
          "https://doi.org/10.1007/bf02458391"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1016/s0048-7333(98)00088-2", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1042407046"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1002/(sici)1097-4571(199210)43:9<628::aid-asi5>3.0.co;2-0", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1046135794"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/bf02461121", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1053441591", 
          "https://doi.org/10.1007/bf02461121"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/bf02461121", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1053441591", 
          "https://doi.org/10.1007/bf02461121"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1001/jama.263.10.1438", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1054151060"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1177/007327537901700202", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1063712098"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1177/007327537901700202", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1063712098"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.3152/147154499781777711", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1071059183"
        ], 
        "type": "CreativeWork"
      }
    ], 
    "datePublished": "2002-07", 
    "datePublishedReg": "2002-07-01", 
    "description": "This paper introduces a citation-based \"systems approach\" for analyzing the various institutional and cognitive dimensions of scientific excellence within national research systems. The methodology, covering several aggregate levels, focuses on the most highly cited research papers in the international journal literature. The distribution of these papers across institutions and disciplines enables objective comparisons their (possible) international-level scientific excellence. By way of example, we present key results from a recent series of analyses of the research system in the Netherlands in the mid 1990s, focussing on the performance of the universities across the various major scientific disciplines within the context of the entire system\"s scientific performance. Special attention is paid to the contribution in the world\"s top 1% and top 10% most highly cited research papers. The findings indicate that these high performance papers provide a useful analytical framework - both in terms of transparency, cognitive and institutional differentiation, as well as its scope for domestic and international comparisons - providing new indicators for identifying \"world class\" scientific excellence at the aggregate level. The average citation scores of these academic \"Centres of Scientific Excellence\" appear to be an inadequate predictor of their production of highly cited papers. However, further critical reflection and in-depth validation studies are needed to establish the true potential of this approach for science policy analyses and evaluation of research performance.", 
    "genre": "research_article", 
    "id": "sg:pub.10.1023/a:1016082432660", 
    "inLanguage": [
      "en"
    ], 
    "isAccessibleForFree": false, 
    "isPartOf": [
      {
        "id": "sg:journal.1089056", 
        "issn": [
          "0138-9130", 
          "1588-2861"
        ], 
        "name": "Scientometrics", 
        "type": "Periodical"
      }, 
      {
        "issueNumber": "3", 
        "type": "PublicationIssue"
      }, 
      {
        "type": "PublicationVolume", 
        "volumeNumber": "54"
      }
    ], 
    "name": "Benchmarking international scientific excellence: Are highly cited research papers an appropriate frame of reference?", 
    "pagination": "381-397", 
    "productId": [
      {
        "name": "readcube_id", 
        "type": "PropertyValue", 
        "value": [
          "cbb3cbf4ecb5fa5ccce3b523acfd41856998eb8295293c23aee483c662775a3b"
        ]
      }, 
      {
        "name": "doi", 
        "type": "PropertyValue", 
        "value": [
          "10.1023/a:1016082432660"
        ]
      }, 
      {
        "name": "dimensions_id", 
        "type": "PropertyValue", 
        "value": [
          "pub.1042763852"
        ]
      }
    ], 
    "sameAs": [
      "https://doi.org/10.1023/a:1016082432660", 
      "https://app.dimensions.ai/details/publication/pub.1042763852"
    ], 
    "sdDataset": "articles", 
    "sdDatePublished": "2019-04-10T18:19", 
    "sdLicense": "https://scigraph.springernature.com/explorer/license/", 
    "sdPublisher": {
      "name": "Springer Nature - SN SciGraph project", 
      "type": "Organization"
    }, 
    "sdSource": "s3://com-uberresearch-data-dimensions-target-20181106-alternative/cleanup/v134/2549eaecd7973599484d7c17b260dba0a4ecb94b/merge/v9/a6c9fde33151104705d4d7ff012ea9563521a3ce/jats-lookup/v90/0000000001_0000000264/records_8675_00000507.jsonl", 
    "type": "ScholarlyArticle", 
    "url": "http://link.springer.com/10.1023/A:1016082432660"
  }
]
 

Download the RDF metadata as:  json-ld nt turtle xml License info

HOW TO GET THIS DATA PROGRAMMATICALLY:

JSON-LD is a popular format for linked data which is fully compatible with JSON.

curl -H 'Accept: application/ld+json' 'https://scigraph.springernature.com/pub.10.1023/a:1016082432660'

N-Triples is a line-based linked data format ideal for batch operations.

curl -H 'Accept: application/n-triples' 'https://scigraph.springernature.com/pub.10.1023/a:1016082432660'

Turtle is a human-readable linked data format.

curl -H 'Accept: text/turtle' 'https://scigraph.springernature.com/pub.10.1023/a:1016082432660'

RDF/XML is a standard XML format for linked data.

curl -H 'Accept: application/rdf+xml' 'https://scigraph.springernature.com/pub.10.1023/a:1016082432660'


 

This table displays all metadata directly associated to this object as RDF triples.

118 TRIPLES      21 PREDICATES      40 URIs      19 LITERALS      7 BLANK NODES

Subject Predicate Object
1 sg:pub.10.1023/a:1016082432660 schema:about anzsrc-for:14
2 anzsrc-for:1402
3 schema:author N2e7fa1500ccb4810a248cc65e073b93b
4 schema:citation sg:pub.10.1007/bf02017064
5 sg:pub.10.1007/bf02129599
6 sg:pub.10.1007/bf02458391
7 sg:pub.10.1007/bf02461121
8 https://doi.org/10.1001/jama.263.10.1438
9 https://doi.org/10.1002/(sici)1097-4571(198909)40:5<342::aid-asi7>3.0.co;2-u
10 https://doi.org/10.1002/(sici)1097-4571(199210)43:9<628::aid-asi5>3.0.co;2-0
11 https://doi.org/10.1016/s0048-7333(98)00026-2
12 https://doi.org/10.1016/s0048-7333(98)00088-2
13 https://doi.org/10.1177/007327537901700202
14 https://doi.org/10.1177/030631277600600102
15 https://doi.org/10.1177/030631282012002005
16 https://doi.org/10.3152/147154499781777711
17 schema:datePublished 2002-07
18 schema:datePublishedReg 2002-07-01
19 schema:description This paper introduces a citation-based "systems approach" for analyzing the various institutional and cognitive dimensions of scientific excellence within national research systems. The methodology, covering several aggregate levels, focuses on the most highly cited research papers in the international journal literature. The distribution of these papers across institutions and disciplines enables objective comparisons their (possible) international-level scientific excellence. By way of example, we present key results from a recent series of analyses of the research system in the Netherlands in the mid 1990s, focussing on the performance of the universities across the various major scientific disciplines within the context of the entire system"s scientific performance. Special attention is paid to the contribution in the world"s top 1% and top 10% most highly cited research papers. The findings indicate that these high performance papers provide a useful analytical framework - both in terms of transparency, cognitive and institutional differentiation, as well as its scope for domestic and international comparisons - providing new indicators for identifying "world class" scientific excellence at the aggregate level. The average citation scores of these academic "Centres of Scientific Excellence" appear to be an inadequate predictor of their production of highly cited papers. However, further critical reflection and in-depth validation studies are needed to establish the true potential of this approach for science policy analyses and evaluation of research performance.
20 schema:genre research_article
21 schema:inLanguage en
22 schema:isAccessibleForFree false
23 schema:isPartOf N33495e36cab646f5967952beb8a71706
24 Ne290e39f2edc42c0bac8ff6fc52f3191
25 sg:journal.1089056
26 schema:name Benchmarking international scientific excellence: Are highly cited research papers an appropriate frame of reference?
27 schema:pagination 381-397
28 schema:productId N2f2939d98a6645fab89066edf68fa91e
29 N82b992f147904fcab02728b231737917
30 Nb2b5301a89f042e7b488fdf64ffc7aa6
31 schema:sameAs https://app.dimensions.ai/details/publication/pub.1042763852
32 https://doi.org/10.1023/a:1016082432660
33 schema:sdDatePublished 2019-04-10T18:19
34 schema:sdLicense https://scigraph.springernature.com/explorer/license/
35 schema:sdPublisher N885563f678824a02b669d5943e3ccbba
36 schema:url http://link.springer.com/10.1023/A:1016082432660
37 sgo:license sg:explorer/license/
38 sgo:sdDataset articles
39 rdf:type schema:ScholarlyArticle
40 N2e7fa1500ccb4810a248cc65e073b93b rdf:first sg:person.012700347665.67
41 rdf:rest Nbd70aa2d7279419faf6e54b3c5a8955e
42 N2f2939d98a6645fab89066edf68fa91e schema:name dimensions_id
43 schema:value pub.1042763852
44 rdf:type schema:PropertyValue
45 N33495e36cab646f5967952beb8a71706 schema:issueNumber 3
46 rdf:type schema:PublicationIssue
47 N82b992f147904fcab02728b231737917 schema:name doi
48 schema:value 10.1023/a:1016082432660
49 rdf:type schema:PropertyValue
50 N885563f678824a02b669d5943e3ccbba schema:name Springer Nature - SN SciGraph project
51 rdf:type schema:Organization
52 Nb2b5301a89f042e7b488fdf64ffc7aa6 schema:name readcube_id
53 schema:value cbb3cbf4ecb5fa5ccce3b523acfd41856998eb8295293c23aee483c662775a3b
54 rdf:type schema:PropertyValue
55 Nbd70aa2d7279419faf6e54b3c5a8955e rdf:first sg:person.012212471611.14
56 rdf:rest Ndbb50ae7c8cf4364b93bf753ba12a35a
57 Ndbb50ae7c8cf4364b93bf753ba12a35a rdf:first sg:person.015311136760.01
58 rdf:rest rdf:nil
59 Ne290e39f2edc42c0bac8ff6fc52f3191 schema:volumeNumber 54
60 rdf:type schema:PublicationVolume
61 anzsrc-for:14 schema:inDefinedTermSet anzsrc-for:
62 schema:name Economics
63 rdf:type schema:DefinedTerm
64 anzsrc-for:1402 schema:inDefinedTermSet anzsrc-for:
65 schema:name Applied Economics
66 rdf:type schema:DefinedTerm
67 sg:journal.1089056 schema:issn 0138-9130
68 1588-2861
69 schema:name Scientometrics
70 rdf:type schema:Periodical
71 sg:person.012212471611.14 schema:affiliation https://www.grid.ac/institutes/grid.5132.5
72 schema:familyName Visser
73 schema:givenName Martijn S.
74 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.012212471611.14
75 rdf:type schema:Person
76 sg:person.012700347665.67 schema:affiliation https://www.grid.ac/institutes/grid.5132.5
77 schema:familyName Tijssen
78 schema:givenName Robert J. W.
79 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.012700347665.67
80 rdf:type schema:Person
81 sg:person.015311136760.01 schema:affiliation https://www.grid.ac/institutes/grid.5132.5
82 schema:familyName van Leeuwen
83 schema:givenName Thed N.
84 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.015311136760.01
85 rdf:type schema:Person
86 sg:pub.10.1007/bf02017064 schema:sameAs https://app.dimensions.ai/details/publication/pub.1024229857
87 https://doi.org/10.1007/bf02017064
88 rdf:type schema:CreativeWork
89 sg:pub.10.1007/bf02129599 schema:sameAs https://app.dimensions.ai/details/publication/pub.1002541679
90 https://doi.org/10.1007/bf02129599
91 rdf:type schema:CreativeWork
92 sg:pub.10.1007/bf02458391 schema:sameAs https://app.dimensions.ai/details/publication/pub.1026815203
93 https://doi.org/10.1007/bf02458391
94 rdf:type schema:CreativeWork
95 sg:pub.10.1007/bf02461121 schema:sameAs https://app.dimensions.ai/details/publication/pub.1053441591
96 https://doi.org/10.1007/bf02461121
97 rdf:type schema:CreativeWork
98 https://doi.org/10.1001/jama.263.10.1438 schema:sameAs https://app.dimensions.ai/details/publication/pub.1054151060
99 rdf:type schema:CreativeWork
100 https://doi.org/10.1002/(sici)1097-4571(198909)40:5<342::aid-asi7>3.0.co;2-u schema:sameAs https://app.dimensions.ai/details/publication/pub.1008687221
101 rdf:type schema:CreativeWork
102 https://doi.org/10.1002/(sici)1097-4571(199210)43:9<628::aid-asi5>3.0.co;2-0 schema:sameAs https://app.dimensions.ai/details/publication/pub.1046135794
103 rdf:type schema:CreativeWork
104 https://doi.org/10.1016/s0048-7333(98)00026-2 schema:sameAs https://app.dimensions.ai/details/publication/pub.1006415756
105 rdf:type schema:CreativeWork
106 https://doi.org/10.1016/s0048-7333(98)00088-2 schema:sameAs https://app.dimensions.ai/details/publication/pub.1042407046
107 rdf:type schema:CreativeWork
108 https://doi.org/10.1177/007327537901700202 schema:sameAs https://app.dimensions.ai/details/publication/pub.1063712098
109 rdf:type schema:CreativeWork
110 https://doi.org/10.1177/030631277600600102 schema:sameAs https://app.dimensions.ai/details/publication/pub.1005445212
111 rdf:type schema:CreativeWork
112 https://doi.org/10.1177/030631282012002005 schema:sameAs https://app.dimensions.ai/details/publication/pub.1016152426
113 rdf:type schema:CreativeWork
114 https://doi.org/10.3152/147154499781777711 schema:sameAs https://app.dimensions.ai/details/publication/pub.1071059183
115 rdf:type schema:CreativeWork
116 https://www.grid.ac/institutes/grid.5132.5 schema:alternateName Leiden University
117 schema:name Centre for Science and Technology Studies (CWTS), Leiden University, Leiden, (The Netherlands)
118 rdf:type schema:Organization
 




Preview window. Press ESC to close (or click here)


...