Negative results are disappearing from most disciplines and countries View Full Text


Ontology type: schema:ScholarlyArticle      Open Access: True


Article Info

DATE

2011-09-11

AUTHORS

Daniele Fanelli

ABSTRACT

Concerns that the growing competition for funding and citations might distort science are frequently discussed, but have not been verified directly. Of the hypothesized problems, perhaps the most worrying is a worsening of positive-outcome bias. A system that disfavours negative results not only distorts the scientific literature directly, but might also discourage high-risk projects and pressure scientists to fabricate and falsify their data. This study analysed over 4,600 papers published in all disciplines between 1990 and 2007, measuring the frequency of papers that, having declared to have “tested” a hypothesis, reported a positive support for it. The overall frequency of positive supports has grown by over 22% between 1990 and 2007, with significant differences between disciplines and countries. The increase was stronger in the social and some biomedical disciplines. The United States had published, over the years, significantly fewer positive results than Asian countries (and particularly Japan) but more than European countries (and in particular the United Kingdom). Methodological artefacts cannot explain away these patterns, which support the hypotheses that research is becoming less pioneering and/or that the objectivity with which results are produced and published is decreasing. More... »

PAGES

891-904

Identifiers

URI

http://scigraph.springernature.com/pub.10.1007/s11192-011-0494-7

DOI

http://dx.doi.org/10.1007/s11192-011-0494-7

DIMENSIONS

https://app.dimensions.ai/details/publication/pub.1038218031


Indexing Status Check whether this publication has been indexed by Scopus and Web Of Science using the SN Indexing Status Tool
Incoming Citations Browse incoming citations for this publication using opencitations.net

JSON-LD is the canonical representation for SciGraph data.

TIP: You can open this SciGraph record using an external JSON-LD service: JSON-LD Playground Google SDTT

[
  {
    "@context": "https://springernature.github.io/scigraph/jsonld/sgcontext.json", 
    "about": [
      {
        "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/16", 
        "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
        "name": "Studies in Human Society", 
        "type": "DefinedTerm"
      }, 
      {
        "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/1608", 
        "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
        "name": "Sociology", 
        "type": "DefinedTerm"
      }
    ], 
    "author": [
      {
        "affiliation": {
          "alternateName": "ISSTI-Institute for the Study of Science, Technology and Innovation, The University of Edinburgh, Old Surgeons\u2019 Hall, EH1 1LZ, Edinburgh, Scotland, UK", 
          "id": "http://www.grid.ac/institutes/grid.4305.2", 
          "name": [
            "ISSTI-Institute for the Study of Science, Technology and Innovation, The University of Edinburgh, Old Surgeons\u2019 Hall, EH1 1LZ, Edinburgh, Scotland, UK"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Fanelli", 
        "givenName": "Daniele", 
        "id": "sg:person.01153356672.10", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.01153356672.10"
        ], 
        "type": "Person"
      }
    ], 
    "citation": [
      {
        "id": "sg:pub.10.1186/1471-2288-6-37", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1045249096", 
          "https://doi.org/10.1186/1471-2288-6-37"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/s11192-010-0312-7", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1051366571", 
          "https://doi.org/10.1007/s11192-010-0312-7"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/s11192-009-0423-1", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1011833995", 
          "https://doi.org/10.1007/s11192-009-0423-1"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1038/ng749", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1045063649", 
          "https://doi.org/10.1038/ng749"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1038/463142a", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1048922114", 
          "https://doi.org/10.1038/463142a"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/s11192-010-0202-z", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1019383944", 
          "https://doi.org/10.1007/s11192-010-0202-z"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/s11192-007-1786-9", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1026484606", 
          "https://doi.org/10.1007/s11192-007-1786-9"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1186/1745-6215-11-64", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1019592464", 
          "https://doi.org/10.1186/1745-6215-11-64"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1038/422554a", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1027535992", 
          "https://doi.org/10.1038/422554a"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/bf02696303", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1013372120", 
          "https://doi.org/10.1007/bf02696303"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1038/422259a", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1038550578", 
          "https://doi.org/10.1038/422259a"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1038/430311a", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1015713065", 
          "https://doi.org/10.1038/430311a"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1186/1741-7015-8-24", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1046672154", 
          "https://doi.org/10.1186/1741-7015-8-24"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/s11192-010-0233-5", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1049598483", 
          "https://doi.org/10.1007/s11192-010-0233-5"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1023/a:1010508510398", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1026596400", 
          "https://doi.org/10.1023/a:1010508510398"
        ], 
        "type": "CreativeWork"
      }
    ], 
    "datePublished": "2011-09-11", 
    "datePublishedReg": "2011-09-11", 
    "description": "Concerns that the growing competition for funding and citations might distort science are frequently discussed, but have not been verified directly. Of the hypothesized problems, perhaps the most worrying is a worsening of positive-outcome bias. A system that disfavours negative results not only distorts the scientific literature directly, but might also discourage high-risk projects and pressure scientists to fabricate and falsify their data. This study analysed over 4,600 papers published in all disciplines between 1990 and 2007, measuring the frequency of papers that, having declared to have \u201ctested\u201d a hypothesis, reported a positive support for it. The overall frequency of positive supports has grown by over 22% between 1990 and 2007, with significant differences between disciplines and countries. The increase was stronger in the social and some biomedical disciplines. The United States had published, over the years, significantly fewer positive results than Asian countries (and particularly Japan) but more than European countries (and in particular the United Kingdom). Methodological artefacts cannot explain away these patterns, which support the hypotheses that research is becoming less pioneering and/or that the objectivity with which results are produced and published is decreasing.", 
    "genre": "article", 
    "id": "sg:pub.10.1007/s11192-011-0494-7", 
    "isAccessibleForFree": true, 
    "isFundedItemOf": [
      {
        "id": "sg:grant.2768192", 
        "type": "MonetaryGrant"
      }
    ], 
    "isPartOf": [
      {
        "id": "sg:journal.1089056", 
        "issn": [
          "0138-9130", 
          "1588-2861"
        ], 
        "name": "Scientometrics", 
        "publisher": "Springer Nature", 
        "type": "Periodical"
      }, 
      {
        "issueNumber": "3", 
        "type": "PublicationIssue"
      }, 
      {
        "type": "PublicationVolume", 
        "volumeNumber": "90"
      }
    ], 
    "keywords": [
      "positive support", 
      "European countries", 
      "Asian countries", 
      "countries", 
      "United States", 
      "disciplines", 
      "most disciplines", 
      "support", 
      "funding", 
      "scientific literature", 
      "high-risk projects", 
      "objectivity", 
      "project", 
      "scientists", 
      "methodological artifacts", 
      "science", 
      "concern", 
      "research", 
      "competition", 
      "paper", 
      "state", 
      "literature", 
      "hypothesis", 
      "citations", 
      "problem", 
      "years", 
      "patterns", 
      "study", 
      "data", 
      "bias", 
      "differences", 
      "system", 
      "results", 
      "positive results", 
      "artifacts", 
      "biomedical disciplines", 
      "worsening", 
      "significant differences", 
      "increase", 
      "overall frequency", 
      "negative results", 
      "frequency", 
      "hypothesized problems", 
      "positive-outcome bias", 
      "frequency of papers"
    ], 
    "name": "Negative results are disappearing from most disciplines and countries", 
    "pagination": "891-904", 
    "productId": [
      {
        "name": "dimensions_id", 
        "type": "PropertyValue", 
        "value": [
          "pub.1038218031"
        ]
      }, 
      {
        "name": "doi", 
        "type": "PropertyValue", 
        "value": [
          "10.1007/s11192-011-0494-7"
        ]
      }
    ], 
    "sameAs": [
      "https://doi.org/10.1007/s11192-011-0494-7", 
      "https://app.dimensions.ai/details/publication/pub.1038218031"
    ], 
    "sdDataset": "articles", 
    "sdDatePublished": "2022-08-04T16:59", 
    "sdLicense": "https://scigraph.springernature.com/explorer/license/", 
    "sdPublisher": {
      "name": "Springer Nature - SN SciGraph project", 
      "type": "Organization"
    }, 
    "sdSource": "s3://com-springernature-scigraph/baseset/20220804/entities/gbq_results/article/article_553.jsonl", 
    "type": "ScholarlyArticle", 
    "url": "https://doi.org/10.1007/s11192-011-0494-7"
  }
]
 

Download the RDF metadata as:  json-ld nt turtle xml License info

HOW TO GET THIS DATA PROGRAMMATICALLY:

JSON-LD is a popular format for linked data which is fully compatible with JSON.

curl -H 'Accept: application/ld+json' 'https://scigraph.springernature.com/pub.10.1007/s11192-011-0494-7'

N-Triples is a line-based linked data format ideal for batch operations.

curl -H 'Accept: application/n-triples' 'https://scigraph.springernature.com/pub.10.1007/s11192-011-0494-7'

Turtle is a human-readable linked data format.

curl -H 'Accept: text/turtle' 'https://scigraph.springernature.com/pub.10.1007/s11192-011-0494-7'

RDF/XML is a standard XML format for linked data.

curl -H 'Accept: application/rdf+xml' 'https://scigraph.springernature.com/pub.10.1007/s11192-011-0494-7'


 

This table displays all metadata directly associated to this object as RDF triples.

164 TRIPLES      21 PREDICATES      84 URIs      61 LITERALS      6 BLANK NODES

Subject Predicate Object
1 sg:pub.10.1007/s11192-011-0494-7 schema:about anzsrc-for:16
2 anzsrc-for:1608
3 schema:author Naa609f6bb7fb4a7895601bb6134064b3
4 schema:citation sg:pub.10.1007/bf02696303
5 sg:pub.10.1007/s11192-007-1786-9
6 sg:pub.10.1007/s11192-009-0423-1
7 sg:pub.10.1007/s11192-010-0202-z
8 sg:pub.10.1007/s11192-010-0233-5
9 sg:pub.10.1007/s11192-010-0312-7
10 sg:pub.10.1023/a:1010508510398
11 sg:pub.10.1038/422259a
12 sg:pub.10.1038/422554a
13 sg:pub.10.1038/430311a
14 sg:pub.10.1038/463142a
15 sg:pub.10.1038/ng749
16 sg:pub.10.1186/1471-2288-6-37
17 sg:pub.10.1186/1741-7015-8-24
18 sg:pub.10.1186/1745-6215-11-64
19 schema:datePublished 2011-09-11
20 schema:datePublishedReg 2011-09-11
21 schema:description Concerns that the growing competition for funding and citations might distort science are frequently discussed, but have not been verified directly. Of the hypothesized problems, perhaps the most worrying is a worsening of positive-outcome bias. A system that disfavours negative results not only distorts the scientific literature directly, but might also discourage high-risk projects and pressure scientists to fabricate and falsify their data. This study analysed over 4,600 papers published in all disciplines between 1990 and 2007, measuring the frequency of papers that, having declared to have “tested” a hypothesis, reported a positive support for it. The overall frequency of positive supports has grown by over 22% between 1990 and 2007, with significant differences between disciplines and countries. The increase was stronger in the social and some biomedical disciplines. The United States had published, over the years, significantly fewer positive results than Asian countries (and particularly Japan) but more than European countries (and in particular the United Kingdom). Methodological artefacts cannot explain away these patterns, which support the hypotheses that research is becoming less pioneering and/or that the objectivity with which results are produced and published is decreasing.
22 schema:genre article
23 schema:isAccessibleForFree true
24 schema:isPartOf Nbc5b992c9b53493bb755068175179b95
25 Ne8c260c8b8cd410c9e1d612e0d4f3f84
26 sg:journal.1089056
27 schema:keywords Asian countries
28 European countries
29 United States
30 artifacts
31 bias
32 biomedical disciplines
33 citations
34 competition
35 concern
36 countries
37 data
38 differences
39 disciplines
40 frequency
41 frequency of papers
42 funding
43 high-risk projects
44 hypothesis
45 hypothesized problems
46 increase
47 literature
48 methodological artifacts
49 most disciplines
50 negative results
51 objectivity
52 overall frequency
53 paper
54 patterns
55 positive results
56 positive support
57 positive-outcome bias
58 problem
59 project
60 research
61 results
62 science
63 scientific literature
64 scientists
65 significant differences
66 state
67 study
68 support
69 system
70 worsening
71 years
72 schema:name Negative results are disappearing from most disciplines and countries
73 schema:pagination 891-904
74 schema:productId N1b05e83bb8224e9f8f678db829cf7f33
75 Ndcca15c17f314adea147b312f6707cb4
76 schema:sameAs https://app.dimensions.ai/details/publication/pub.1038218031
77 https://doi.org/10.1007/s11192-011-0494-7
78 schema:sdDatePublished 2022-08-04T16:59
79 schema:sdLicense https://scigraph.springernature.com/explorer/license/
80 schema:sdPublisher N7b758063248d4935bc11e65a844a7fcc
81 schema:url https://doi.org/10.1007/s11192-011-0494-7
82 sgo:license sg:explorer/license/
83 sgo:sdDataset articles
84 rdf:type schema:ScholarlyArticle
85 N1b05e83bb8224e9f8f678db829cf7f33 schema:name dimensions_id
86 schema:value pub.1038218031
87 rdf:type schema:PropertyValue
88 N7b758063248d4935bc11e65a844a7fcc schema:name Springer Nature - SN SciGraph project
89 rdf:type schema:Organization
90 Naa609f6bb7fb4a7895601bb6134064b3 rdf:first sg:person.01153356672.10
91 rdf:rest rdf:nil
92 Nbc5b992c9b53493bb755068175179b95 schema:issueNumber 3
93 rdf:type schema:PublicationIssue
94 Ndcca15c17f314adea147b312f6707cb4 schema:name doi
95 schema:value 10.1007/s11192-011-0494-7
96 rdf:type schema:PropertyValue
97 Ne8c260c8b8cd410c9e1d612e0d4f3f84 schema:volumeNumber 90
98 rdf:type schema:PublicationVolume
99 anzsrc-for:16 schema:inDefinedTermSet anzsrc-for:
100 schema:name Studies in Human Society
101 rdf:type schema:DefinedTerm
102 anzsrc-for:1608 schema:inDefinedTermSet anzsrc-for:
103 schema:name Sociology
104 rdf:type schema:DefinedTerm
105 sg:grant.2768192 http://pending.schema.org/fundedItem sg:pub.10.1007/s11192-011-0494-7
106 rdf:type schema:MonetaryGrant
107 sg:journal.1089056 schema:issn 0138-9130
108 1588-2861
109 schema:name Scientometrics
110 schema:publisher Springer Nature
111 rdf:type schema:Periodical
112 sg:person.01153356672.10 schema:affiliation grid-institutes:grid.4305.2
113 schema:familyName Fanelli
114 schema:givenName Daniele
115 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.01153356672.10
116 rdf:type schema:Person
117 sg:pub.10.1007/bf02696303 schema:sameAs https://app.dimensions.ai/details/publication/pub.1013372120
118 https://doi.org/10.1007/bf02696303
119 rdf:type schema:CreativeWork
120 sg:pub.10.1007/s11192-007-1786-9 schema:sameAs https://app.dimensions.ai/details/publication/pub.1026484606
121 https://doi.org/10.1007/s11192-007-1786-9
122 rdf:type schema:CreativeWork
123 sg:pub.10.1007/s11192-009-0423-1 schema:sameAs https://app.dimensions.ai/details/publication/pub.1011833995
124 https://doi.org/10.1007/s11192-009-0423-1
125 rdf:type schema:CreativeWork
126 sg:pub.10.1007/s11192-010-0202-z schema:sameAs https://app.dimensions.ai/details/publication/pub.1019383944
127 https://doi.org/10.1007/s11192-010-0202-z
128 rdf:type schema:CreativeWork
129 sg:pub.10.1007/s11192-010-0233-5 schema:sameAs https://app.dimensions.ai/details/publication/pub.1049598483
130 https://doi.org/10.1007/s11192-010-0233-5
131 rdf:type schema:CreativeWork
132 sg:pub.10.1007/s11192-010-0312-7 schema:sameAs https://app.dimensions.ai/details/publication/pub.1051366571
133 https://doi.org/10.1007/s11192-010-0312-7
134 rdf:type schema:CreativeWork
135 sg:pub.10.1023/a:1010508510398 schema:sameAs https://app.dimensions.ai/details/publication/pub.1026596400
136 https://doi.org/10.1023/a:1010508510398
137 rdf:type schema:CreativeWork
138 sg:pub.10.1038/422259a schema:sameAs https://app.dimensions.ai/details/publication/pub.1038550578
139 https://doi.org/10.1038/422259a
140 rdf:type schema:CreativeWork
141 sg:pub.10.1038/422554a schema:sameAs https://app.dimensions.ai/details/publication/pub.1027535992
142 https://doi.org/10.1038/422554a
143 rdf:type schema:CreativeWork
144 sg:pub.10.1038/430311a schema:sameAs https://app.dimensions.ai/details/publication/pub.1015713065
145 https://doi.org/10.1038/430311a
146 rdf:type schema:CreativeWork
147 sg:pub.10.1038/463142a schema:sameAs https://app.dimensions.ai/details/publication/pub.1048922114
148 https://doi.org/10.1038/463142a
149 rdf:type schema:CreativeWork
150 sg:pub.10.1038/ng749 schema:sameAs https://app.dimensions.ai/details/publication/pub.1045063649
151 https://doi.org/10.1038/ng749
152 rdf:type schema:CreativeWork
153 sg:pub.10.1186/1471-2288-6-37 schema:sameAs https://app.dimensions.ai/details/publication/pub.1045249096
154 https://doi.org/10.1186/1471-2288-6-37
155 rdf:type schema:CreativeWork
156 sg:pub.10.1186/1741-7015-8-24 schema:sameAs https://app.dimensions.ai/details/publication/pub.1046672154
157 https://doi.org/10.1186/1741-7015-8-24
158 rdf:type schema:CreativeWork
159 sg:pub.10.1186/1745-6215-11-64 schema:sameAs https://app.dimensions.ai/details/publication/pub.1019592464
160 https://doi.org/10.1186/1745-6215-11-64
161 rdf:type schema:CreativeWork
162 grid-institutes:grid.4305.2 schema:alternateName ISSTI-Institute for the Study of Science, Technology and Innovation, The University of Edinburgh, Old Surgeons’ Hall, EH1 1LZ, Edinburgh, Scotland, UK
163 schema:name ISSTI-Institute for the Study of Science, Technology and Innovation, The University of Edinburgh, Old Surgeons’ Hall, EH1 1LZ, Edinburgh, Scotland, UK
164 rdf:type schema:Organization
 




Preview window. Press ESC to close (or click here)


...