Benchmarking international scientific excellence: Are highly cited research papers an appropriate frame of reference? View Full Text


Ontology type: schema:ScholarlyArticle     


Article Info

DATE

2002-07

AUTHORS

Robert J. W. Tijssen, Martijn S. Visser, Thed N. van Leeuwen

ABSTRACT

This paper introduces a citation-based "systems approach" for analyzing the various institutional and cognitive dimensions of scientific excellence within national research systems. The methodology, covering several aggregate levels, focuses on the most highly cited research papers in the international journal literature. The distribution of these papers across institutions and disciplines enables objective comparisons their (possible) international-level scientific excellence. By way of example, we present key results from a recent series of analyses of the research system in the Netherlands in the mid 1990s, focussing on the performance of the universities across the various major scientific disciplines within the context of the entire system"s scientific performance. Special attention is paid to the contribution in the world"s top 1% and top 10% most highly cited research papers. The findings indicate that these high performance papers provide a useful analytical framework - both in terms of transparency, cognitive and institutional differentiation, as well as its scope for domestic and international comparisons - providing new indicators for identifying "world class" scientific excellence at the aggregate level. The average citation scores of these academic "Centres of Scientific Excellence" appear to be an inadequate predictor of their production of highly cited papers. However, further critical reflection and in-depth validation studies are needed to establish the true potential of this approach for science policy analyses and evaluation of research performance. More... »

PAGES

381-397

Journal

TITLE

Scientometrics

ISSUE

3

VOLUME

54

Author Affiliations

Identifiers

URI

http://scigraph.springernature.com/pub.10.1023/a:1016082432660

DOI

http://dx.doi.org/10.1023/a:1016082432660

DIMENSIONS

https://app.dimensions.ai/details/publication/pub.1042763852


Indexing Status Check whether this publication has been indexed by Scopus and Web Of Science using the SN Indexing Status Tool
Incoming Citations Browse incoming citations for this publication using opencitations.net

JSON-LD is the canonical representation for SciGraph data.

TIP: You can open this SciGraph record using an external JSON-LD service: JSON-LD Playground Google SDTT

[
  {
    "@context": "https://springernature.github.io/scigraph/jsonld/sgcontext.json", 
    "about": [
      {
        "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/1402", 
        "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
        "name": "Applied Economics", 
        "type": "DefinedTerm"
      }, 
      {
        "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/14", 
        "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
        "name": "Economics", 
        "type": "DefinedTerm"
      }
    ], 
    "author": [
      {
        "affiliation": {
          "alternateName": "Leiden University", 
          "id": "https://www.grid.ac/institutes/grid.5132.5", 
          "name": [
            "Centre for Science and Technology Studies (CWTS), Leiden University, Leiden, (The Netherlands)"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Tijssen", 
        "givenName": "Robert J. W.", 
        "id": "sg:person.012700347665.67", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.012700347665.67"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "Leiden University", 
          "id": "https://www.grid.ac/institutes/grid.5132.5", 
          "name": [
            "Centre for Science and Technology Studies (CWTS), Leiden University, Leiden, (The Netherlands)"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Visser", 
        "givenName": "Martijn S.", 
        "id": "sg:person.012212471611.14", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.012212471611.14"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "Leiden University", 
          "id": "https://www.grid.ac/institutes/grid.5132.5", 
          "name": [
            "Centre for Science and Technology Studies (CWTS), Leiden University, Leiden, (The Netherlands)"
          ], 
          "type": "Organization"
        }, 
        "familyName": "van Leeuwen", 
        "givenName": "Thed N.", 
        "id": "sg:person.015311136760.01", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.015311136760.01"
        ], 
        "type": "Person"
      }
    ], 
    "citation": [
      {
        "id": "sg:pub.10.1007/bf02129599", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1002541679", 
          "https://doi.org/10.1007/bf02129599"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/bf02129599", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1002541679", 
          "https://doi.org/10.1007/bf02129599"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1177/030631277600600102", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1005445212"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1177/030631277600600102", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1005445212"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1016/s0048-7333(98)00026-2", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1006415756"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1002/(sici)1097-4571(198909)40:5<342::aid-asi7>3.0.co;2-u", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1008687221"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1177/030631282012002005", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1016152426"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1177/030631282012002005", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1016152426"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/bf02017064", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1024229857", 
          "https://doi.org/10.1007/bf02017064"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/bf02017064", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1024229857", 
          "https://doi.org/10.1007/bf02017064"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/bf02458391", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1026815203", 
          "https://doi.org/10.1007/bf02458391"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/bf02458391", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1026815203", 
          "https://doi.org/10.1007/bf02458391"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1016/s0048-7333(98)00088-2", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1042407046"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1002/(sici)1097-4571(199210)43:9<628::aid-asi5>3.0.co;2-0", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1046135794"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/bf02461121", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1053441591", 
          "https://doi.org/10.1007/bf02461121"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/bf02461121", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1053441591", 
          "https://doi.org/10.1007/bf02461121"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1001/jama.263.10.1438", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1054151060"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1177/007327537901700202", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1063712098"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1177/007327537901700202", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1063712098"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.3152/147154499781777711", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1071059183"
        ], 
        "type": "CreativeWork"
      }
    ], 
    "datePublished": "2002-07", 
    "datePublishedReg": "2002-07-01", 
    "description": "This paper introduces a citation-based \"systems approach\" for analyzing the various institutional and cognitive dimensions of scientific excellence within national research systems. The methodology, covering several aggregate levels, focuses on the most highly cited research papers in the international journal literature. The distribution of these papers across institutions and disciplines enables objective comparisons their (possible) international-level scientific excellence. By way of example, we present key results from a recent series of analyses of the research system in the Netherlands in the mid 1990s, focussing on the performance of the universities across the various major scientific disciplines within the context of the entire system\"s scientific performance. Special attention is paid to the contribution in the world\"s top 1% and top 10% most highly cited research papers. The findings indicate that these high performance papers provide a useful analytical framework - both in terms of transparency, cognitive and institutional differentiation, as well as its scope for domestic and international comparisons - providing new indicators for identifying \"world class\" scientific excellence at the aggregate level. The average citation scores of these academic \"Centres of Scientific Excellence\" appear to be an inadequate predictor of their production of highly cited papers. However, further critical reflection and in-depth validation studies are needed to establish the true potential of this approach for science policy analyses and evaluation of research performance.", 
    "genre": "research_article", 
    "id": "sg:pub.10.1023/a:1016082432660", 
    "inLanguage": [
      "en"
    ], 
    "isAccessibleForFree": false, 
    "isPartOf": [
      {
        "id": "sg:journal.1089056", 
        "issn": [
          "0138-9130", 
          "1588-2861"
        ], 
        "name": "Scientometrics", 
        "type": "Periodical"
      }, 
      {
        "issueNumber": "3", 
        "type": "PublicationIssue"
      }, 
      {
        "type": "PublicationVolume", 
        "volumeNumber": "54"
      }
    ], 
    "name": "Benchmarking international scientific excellence: Are highly cited research papers an appropriate frame of reference?", 
    "pagination": "381-397", 
    "productId": [
      {
        "name": "readcube_id", 
        "type": "PropertyValue", 
        "value": [
          "cbb3cbf4ecb5fa5ccce3b523acfd41856998eb8295293c23aee483c662775a3b"
        ]
      }, 
      {
        "name": "doi", 
        "type": "PropertyValue", 
        "value": [
          "10.1023/a:1016082432660"
        ]
      }, 
      {
        "name": "dimensions_id", 
        "type": "PropertyValue", 
        "value": [
          "pub.1042763852"
        ]
      }
    ], 
    "sameAs": [
      "https://doi.org/10.1023/a:1016082432660", 
      "https://app.dimensions.ai/details/publication/pub.1042763852"
    ], 
    "sdDataset": "articles", 
    "sdDatePublished": "2019-04-10T18:19", 
    "sdLicense": "https://scigraph.springernature.com/explorer/license/", 
    "sdPublisher": {
      "name": "Springer Nature - SN SciGraph project", 
      "type": "Organization"
    }, 
    "sdSource": "s3://com-uberresearch-data-dimensions-target-20181106-alternative/cleanup/v134/2549eaecd7973599484d7c17b260dba0a4ecb94b/merge/v9/a6c9fde33151104705d4d7ff012ea9563521a3ce/jats-lookup/v90/0000000001_0000000264/records_8675_00000507.jsonl", 
    "type": "ScholarlyArticle", 
    "url": "http://link.springer.com/10.1023/A:1016082432660"
  }
]
 

Download the RDF metadata as:  json-ld nt turtle xml License info

HOW TO GET THIS DATA PROGRAMMATICALLY:

JSON-LD is a popular format for linked data which is fully compatible with JSON.

curl -H 'Accept: application/ld+json' 'https://scigraph.springernature.com/pub.10.1023/a:1016082432660'

N-Triples is a line-based linked data format ideal for batch operations.

curl -H 'Accept: application/n-triples' 'https://scigraph.springernature.com/pub.10.1023/a:1016082432660'

Turtle is a human-readable linked data format.

curl -H 'Accept: text/turtle' 'https://scigraph.springernature.com/pub.10.1023/a:1016082432660'

RDF/XML is a standard XML format for linked data.

curl -H 'Accept: application/rdf+xml' 'https://scigraph.springernature.com/pub.10.1023/a:1016082432660'


 

This table displays all metadata directly associated to this object as RDF triples.

118 TRIPLES      21 PREDICATES      40 URIs      19 LITERALS      7 BLANK NODES

Subject Predicate Object
1 sg:pub.10.1023/a:1016082432660 schema:about anzsrc-for:14
2 anzsrc-for:1402
3 schema:author N64de6fa061444fce80b9e890c3052778
4 schema:citation sg:pub.10.1007/bf02017064
5 sg:pub.10.1007/bf02129599
6 sg:pub.10.1007/bf02458391
7 sg:pub.10.1007/bf02461121
8 https://doi.org/10.1001/jama.263.10.1438
9 https://doi.org/10.1002/(sici)1097-4571(198909)40:5<342::aid-asi7>3.0.co;2-u
10 https://doi.org/10.1002/(sici)1097-4571(199210)43:9<628::aid-asi5>3.0.co;2-0
11 https://doi.org/10.1016/s0048-7333(98)00026-2
12 https://doi.org/10.1016/s0048-7333(98)00088-2
13 https://doi.org/10.1177/007327537901700202
14 https://doi.org/10.1177/030631277600600102
15 https://doi.org/10.1177/030631282012002005
16 https://doi.org/10.3152/147154499781777711
17 schema:datePublished 2002-07
18 schema:datePublishedReg 2002-07-01
19 schema:description This paper introduces a citation-based "systems approach" for analyzing the various institutional and cognitive dimensions of scientific excellence within national research systems. The methodology, covering several aggregate levels, focuses on the most highly cited research papers in the international journal literature. The distribution of these papers across institutions and disciplines enables objective comparisons their (possible) international-level scientific excellence. By way of example, we present key results from a recent series of analyses of the research system in the Netherlands in the mid 1990s, focussing on the performance of the universities across the various major scientific disciplines within the context of the entire system"s scientific performance. Special attention is paid to the contribution in the world"s top 1% and top 10% most highly cited research papers. The findings indicate that these high performance papers provide a useful analytical framework - both in terms of transparency, cognitive and institutional differentiation, as well as its scope for domestic and international comparisons - providing new indicators for identifying "world class" scientific excellence at the aggregate level. The average citation scores of these academic "Centres of Scientific Excellence" appear to be an inadequate predictor of their production of highly cited papers. However, further critical reflection and in-depth validation studies are needed to establish the true potential of this approach for science policy analyses and evaluation of research performance.
20 schema:genre research_article
21 schema:inLanguage en
22 schema:isAccessibleForFree false
23 schema:isPartOf N62c3bdae37454a57856164b98bd3dd80
24 Nd8993a20e022442fab32478bd514e71c
25 sg:journal.1089056
26 schema:name Benchmarking international scientific excellence: Are highly cited research papers an appropriate frame of reference?
27 schema:pagination 381-397
28 schema:productId N79e6bf2b746f4f9da1fb40ce93e12132
29 N9fafe39537af4524878d86cb1c5a09f2
30 Nf19b9a6045204c889a9d7cb37e561ee5
31 schema:sameAs https://app.dimensions.ai/details/publication/pub.1042763852
32 https://doi.org/10.1023/a:1016082432660
33 schema:sdDatePublished 2019-04-10T18:19
34 schema:sdLicense https://scigraph.springernature.com/explorer/license/
35 schema:sdPublisher N1f8bdf07010940978fcfe25bf76f4af3
36 schema:url http://link.springer.com/10.1023/A:1016082432660
37 sgo:license sg:explorer/license/
38 sgo:sdDataset articles
39 rdf:type schema:ScholarlyArticle
40 N1f8bdf07010940978fcfe25bf76f4af3 schema:name Springer Nature - SN SciGraph project
41 rdf:type schema:Organization
42 N62c3bdae37454a57856164b98bd3dd80 schema:volumeNumber 54
43 rdf:type schema:PublicationVolume
44 N64de6fa061444fce80b9e890c3052778 rdf:first sg:person.012700347665.67
45 rdf:rest Nf63431e829b74bd48ba97ff2892001e2
46 N79e6bf2b746f4f9da1fb40ce93e12132 schema:name readcube_id
47 schema:value cbb3cbf4ecb5fa5ccce3b523acfd41856998eb8295293c23aee483c662775a3b
48 rdf:type schema:PropertyValue
49 N9fafe39537af4524878d86cb1c5a09f2 schema:name dimensions_id
50 schema:value pub.1042763852
51 rdf:type schema:PropertyValue
52 Nd73dfe9665e04295b80e8997a8d6a1e1 rdf:first sg:person.015311136760.01
53 rdf:rest rdf:nil
54 Nd8993a20e022442fab32478bd514e71c schema:issueNumber 3
55 rdf:type schema:PublicationIssue
56 Nf19b9a6045204c889a9d7cb37e561ee5 schema:name doi
57 schema:value 10.1023/a:1016082432660
58 rdf:type schema:PropertyValue
59 Nf63431e829b74bd48ba97ff2892001e2 rdf:first sg:person.012212471611.14
60 rdf:rest Nd73dfe9665e04295b80e8997a8d6a1e1
61 anzsrc-for:14 schema:inDefinedTermSet anzsrc-for:
62 schema:name Economics
63 rdf:type schema:DefinedTerm
64 anzsrc-for:1402 schema:inDefinedTermSet anzsrc-for:
65 schema:name Applied Economics
66 rdf:type schema:DefinedTerm
67 sg:journal.1089056 schema:issn 0138-9130
68 1588-2861
69 schema:name Scientometrics
70 rdf:type schema:Periodical
71 sg:person.012212471611.14 schema:affiliation https://www.grid.ac/institutes/grid.5132.5
72 schema:familyName Visser
73 schema:givenName Martijn S.
74 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.012212471611.14
75 rdf:type schema:Person
76 sg:person.012700347665.67 schema:affiliation https://www.grid.ac/institutes/grid.5132.5
77 schema:familyName Tijssen
78 schema:givenName Robert J. W.
79 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.012700347665.67
80 rdf:type schema:Person
81 sg:person.015311136760.01 schema:affiliation https://www.grid.ac/institutes/grid.5132.5
82 schema:familyName van Leeuwen
83 schema:givenName Thed N.
84 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.015311136760.01
85 rdf:type schema:Person
86 sg:pub.10.1007/bf02017064 schema:sameAs https://app.dimensions.ai/details/publication/pub.1024229857
87 https://doi.org/10.1007/bf02017064
88 rdf:type schema:CreativeWork
89 sg:pub.10.1007/bf02129599 schema:sameAs https://app.dimensions.ai/details/publication/pub.1002541679
90 https://doi.org/10.1007/bf02129599
91 rdf:type schema:CreativeWork
92 sg:pub.10.1007/bf02458391 schema:sameAs https://app.dimensions.ai/details/publication/pub.1026815203
93 https://doi.org/10.1007/bf02458391
94 rdf:type schema:CreativeWork
95 sg:pub.10.1007/bf02461121 schema:sameAs https://app.dimensions.ai/details/publication/pub.1053441591
96 https://doi.org/10.1007/bf02461121
97 rdf:type schema:CreativeWork
98 https://doi.org/10.1001/jama.263.10.1438 schema:sameAs https://app.dimensions.ai/details/publication/pub.1054151060
99 rdf:type schema:CreativeWork
100 https://doi.org/10.1002/(sici)1097-4571(198909)40:5<342::aid-asi7>3.0.co;2-u schema:sameAs https://app.dimensions.ai/details/publication/pub.1008687221
101 rdf:type schema:CreativeWork
102 https://doi.org/10.1002/(sici)1097-4571(199210)43:9<628::aid-asi5>3.0.co;2-0 schema:sameAs https://app.dimensions.ai/details/publication/pub.1046135794
103 rdf:type schema:CreativeWork
104 https://doi.org/10.1016/s0048-7333(98)00026-2 schema:sameAs https://app.dimensions.ai/details/publication/pub.1006415756
105 rdf:type schema:CreativeWork
106 https://doi.org/10.1016/s0048-7333(98)00088-2 schema:sameAs https://app.dimensions.ai/details/publication/pub.1042407046
107 rdf:type schema:CreativeWork
108 https://doi.org/10.1177/007327537901700202 schema:sameAs https://app.dimensions.ai/details/publication/pub.1063712098
109 rdf:type schema:CreativeWork
110 https://doi.org/10.1177/030631277600600102 schema:sameAs https://app.dimensions.ai/details/publication/pub.1005445212
111 rdf:type schema:CreativeWork
112 https://doi.org/10.1177/030631282012002005 schema:sameAs https://app.dimensions.ai/details/publication/pub.1016152426
113 rdf:type schema:CreativeWork
114 https://doi.org/10.3152/147154499781777711 schema:sameAs https://app.dimensions.ai/details/publication/pub.1071059183
115 rdf:type schema:CreativeWork
116 https://www.grid.ac/institutes/grid.5132.5 schema:alternateName Leiden University
117 schema:name Centre for Science and Technology Studies (CWTS), Leiden University, Leiden, (The Netherlands)
118 rdf:type schema:Organization
 




Preview window. Press ESC to close (or click here)


...