ISRIA statement: ten-point guidelines for an effective process of research impact assessment View Full Text


Ontology type: schema:ScholarlyArticle      Open Access: True


Article Info

DATE

2018-12

AUTHORS

Paula Adam, Pavel V. Ovseiko, Jonathan Grant, Kathryn E. A. Graham, Omar F. Boukhris, Anne-Maree Dowd, Gert V. Balling, Rikke N. Christensen, Alexandra Pollitt, Mark Taylor, Omar Sued, Saba Hinrichs-Krapels, Maite Solans‐Domènech, Heidi Chorzempa, for the International School on Research Impact Assessment (ISRIA)

ABSTRACT

As governments, funding agencies and research organisations worldwide seek to maximise both the financial and non-financial returns on investment in research, the way the research process is organised and funded is becoming increasingly under scrutiny. There are growing demands and aspirations to measure research impact (beyond academic publications), to understand how science works, and to optimise its societal and economic impact. In response, a multidisciplinary practice called research impact assessment is rapidly developing. Given that the practice is still in its formative stage, systematised recommendations or accepted standards for practitioners (such as funders and those responsible for managing research projects) across countries or disciplines to guide research impact assessment are not yet available.In this statement, we propose initial guidelines for a rigorous and effective process of research impact assessment applicable to all research disciplines and oriented towards practice. This statement systematises expert knowledge and practitioner experience from designing and delivering the International School on Research Impact Assessment (ISRIA). It brings together insights from over 450 experts and practitioners from 34 countries, who participated in the school during its 5-year run (from 2013 to 2017) and shares a set of core values from the school's learning programme. These insights are distilled into ten-point guidelines, which relate to (1) context, (2) purpose, (3) stakeholders' needs, (4) stakeholder engagement, (5) conceptual frameworks, (6) methods and data sources, (7) indicators and metrics, (8) ethics and conflicts of interest, (9) communication, and (10) community of practice.The guidelines can help practitioners improve and standardise the process of research impact assessment, but they are by no means exhaustive and require evaluation and continuous improvement. The prima facie effectiveness of the guidelines is based on the systematised expert and practitioner knowledge of the school's faculty and participants derived from their practical experience and research evidence. The current knowledge base has gaps in terms of the geographical and scientific discipline as well as stakeholder coverage and representation. The guidelines can be further strengthened through evaluation and continuous improvement by the global research impact assessment community. More... »

PAGES

8

References to SciGraph publications

  • 2010-03. Let's make science metrics more scientific in NATURE
  • 2015-12. Does health intervention research have real world policy and practice impacts: testing a new impact assessment tool in HEALTH RESEARCH POLICY AND SYSTEMS
  • 2015-12. A new resource for identifying and assessing the impacts of research in BMC MEDICINE
  • 2015-12. How long does biomedical research take? Studying the time taken between biomedical and health research and its translation into products, policy, and practice in HEALTH RESEARCH POLICY AND SYSTEMS
  • 2016-12. A global call for action to include gender in research impact assessment in HEALTH RESEARCH POLICY AND SYSTEMS
  • 1999-12. Science's new social contract with society in NATURE
  • 2007-12. A systematic evaluation of payback of publicly funded health and health services research in Hong Kong in BMC HEALTH SERVICES RESEARCH
  • 2015-12. Research impact in the community-based health sciences: an analysis of 162 case studies from the 2014 UK Research Excellence Framework in BMC MEDICINE
  • 2013-12. Impact of clinical and health services research projects on decision-making: a qualitative study in HEALTH RESEARCH POLICY AND SYSTEMS
  • 2014-12. Estimating the returns to UK publicly funded cancer-related research in terms of the net value of improved health outcomes in BMC MEDICINE
  • 2009-12. The feasibility of determining the impact of primary health care research projects using the Payback Framework in HEALTH RESEARCH POLICY AND SYSTEMS
  • 2010-12. Examining the impact of health research facilitated by small peer-reviewed research operating grants in a women's and children's health centre in BMC RESEARCH NOTES
  • 2016-12. Quantifying the economic impact of government and charity funding of medical research on private research and development funding in the United Kingdom in BMC MEDICINE
  • 2010-08. In Retrospect: <i>Science — The Endless Frontier</i> in NATURE
  • 2016-12. Research impact: a narrative review in BMC MEDICINE
  • 2011-12. Conceptual frameworks and empirical approaches used to assess the impact of health research: an overview of reviews in HEALTH RESEARCH POLICY AND SYSTEMS
  • 2013-12. Policy and practice impacts of applied research: a case study analysis of the New South Wales Health Promotion Demonstration Research Grants Scheme 2000–2006 in HEALTH RESEARCH POLICY AND SYSTEMS
  • 2015-05. The open access advantage considering citation, article usage and social media attention in SCIENTOMETRICS
  • 2017-12. Understanding relevance of health research: considerations in the context of research impact assessment in HEALTH RESEARCH POLICY AND SYSTEMS
  • 2017-12. The impact on healthcare, policy and practice from 36 multi-project research programmes: findings from two reviews in HEALTH RESEARCH POLICY AND SYSTEMS
  • 2015-12. A narrative review of research impact assessment models and methods in HEALTH RESEARCH POLICY AND SYSTEMS
  • 2016-12. An assessment of health research impact in Iran in HEALTH RESEARCH POLICY AND SYSTEMS
  • 2012-12. Assessing research impact in academic clinical medicine: a study using Research Excellence Framework pilot impact indicators in BMC HEALTH SERVICES RESEARCH
  • 2011-12. What research impacts do Australian primary health care researchers expect and achieve? in HEALTH RESEARCH POLICY AND SYSTEMS
  • 2012-03. Must try harder in NATURE
  • 2017-01-10. A manifesto for reproducible science in NATURE HUMAN BEHAVIOUR
  • 2015-04-22. Bibliometrics: The Leiden Manifesto for research metrics in NATURE
  • 2010-06-10. Science economics: What science is really worth in NATURE
  • 2004-12. Proposed methods for reviewing the outcomes of health research: the impact of funding by the UK's 'Arthritis Research Campaign' in HEALTH RESEARCH POLICY AND SYSTEMS
  • 2010-06. Unknown quantities in NATURE
  • 2003-12. The utilisation of health research in policy-making: concepts, examples and methods of assessment in HEALTH RESEARCH POLICY AND SYSTEMS
  • Identifiers

    URI

    http://scigraph.springernature.com/pub.10.1186/s12961-018-0281-5

    DOI

    http://dx.doi.org/10.1186/s12961-018-0281-5

    DIMENSIONS

    https://app.dimensions.ai/details/publication/pub.1100922343

    PUBMED

    https://www.ncbi.nlm.nih.gov/pubmed/29422063


    Indexing Status Check whether this publication has been indexed by Scopus and Web Of Science using the SN Indexing Status Tool
    Incoming Citations Browse incoming citations for this publication using opencitations.net

    JSON-LD is the canonical representation for SciGraph data.

    TIP: You can open this SciGraph record using an external JSON-LD service: JSON-LD Playground Google SDTT

    [
      {
        "@context": "https://springernature.github.io/scigraph/jsonld/sgcontext.json", 
        "about": [
          {
            "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/1303", 
            "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
            "name": "Specialist Studies In Education", 
            "type": "DefinedTerm"
          }, 
          {
            "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/13", 
            "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
            "name": "Education", 
            "type": "DefinedTerm"
          }, 
          {
            "inDefinedTermSet": "https://www.nlm.nih.gov/mesh/", 
            "name": "Evaluation Studies as Topic", 
            "type": "DefinedTerm"
          }, 
          {
            "inDefinedTermSet": "https://www.nlm.nih.gov/mesh/", 
            "name": "Guidelines as Topic", 
            "type": "DefinedTerm"
          }, 
          {
            "inDefinedTermSet": "https://www.nlm.nih.gov/mesh/", 
            "name": "Health Impact Assessment", 
            "type": "DefinedTerm"
          }, 
          {
            "inDefinedTermSet": "https://www.nlm.nih.gov/mesh/", 
            "name": "Humans", 
            "type": "DefinedTerm"
          }, 
          {
            "inDefinedTermSet": "https://www.nlm.nih.gov/mesh/", 
            "name": "Research", 
            "type": "DefinedTerm"
          }, 
          {
            "inDefinedTermSet": "https://www.nlm.nih.gov/mesh/", 
            "name": "Research Design", 
            "type": "DefinedTerm"
          }, 
          {
            "inDefinedTermSet": "https://www.nlm.nih.gov/mesh/", 
            "name": "Translational Medical Research", 
            "type": "DefinedTerm"
          }
        ], 
        "author": [
          {
            "affiliation": {
              "name": [
                "Agency for Health Quality and Assessment of Catalonia (AQuAS), Carrer de Roc Boronat, 81, ES-08005, Barcelona, Spain"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Adam", 
            "givenName": "Paula", 
            "id": "sg:person.0670777613.15", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.0670777613.15"
            ], 
            "type": "Person"
          }, 
          {
            "affiliation": {
              "name": [
                "Radcliffe Department of Medicine, University of Oxford, John Radcliffe Hospital, OX3 9DU, Oxford, United Kingdom"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Ovseiko", 
            "givenName": "Pavel V.", 
            "id": "sg:person.0730120066.75", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.0730120066.75"
            ], 
            "type": "Person"
          }, 
          {
            "affiliation": {
              "alternateName": "King's College London", 
              "id": "https://www.grid.ac/institutes/grid.13097.3c", 
              "name": [
                "The Policy Institute, King\u2019s College London, Strand Campus, WC2R 2LS, London, United Kingdom"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Grant", 
            "givenName": "Jonathan", 
            "id": "sg:person.01055471415.15", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.01055471415.15"
            ], 
            "type": "Person"
          }, 
          {
            "affiliation": {
              "alternateName": "Alberta Innovates", 
              "id": "https://www.grid.ac/institutes/grid.488584.d", 
              "name": [
                "Alberta Innovates, 10104-103 Avenue NW, T5J 4A7, Edmonton, AB, Canada"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Graham", 
            "givenName": "Kathryn E. A.", 
            "type": "Person"
          }, 
          {
            "affiliation": {
              "alternateName": "Qatar Foundation", 
              "id": "https://www.grid.ac/institutes/grid.418818.c", 
              "name": [
                "Qatar National Research Fund, PO Box 5825, Doha, Qatar"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Boukhris", 
            "givenName": "Omar F.", 
            "id": "sg:person.015121127511.08", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.015121127511.08"
            ], 
            "type": "Person"
          }, 
          {
            "affiliation": {
              "alternateName": "Commonwealth Scientific and Industrial Research Organisation", 
              "id": "https://www.grid.ac/institutes/grid.1016.6", 
              "name": [
                "Commonwealth Scientific and Industrial Research Organisation, Kenmore, PO Box 883, 4069, Brisbane, Australia"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Dowd", 
            "givenName": "Anne-Maree", 
            "id": "sg:person.010436707375.70", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010436707375.70"
            ], 
            "type": "Person"
          }, 
          {
            "affiliation": {
              "name": [
                "Novo Nordisk Foundation, Tuborg Havnevej 19, DK-2900, Hellerup, Denmark"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Balling", 
            "givenName": "Gert V.", 
            "id": "sg:person.015764623311.69", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.015764623311.69"
            ], 
            "type": "Person"
          }, 
          {
            "affiliation": {
              "name": [
                "Novo Nordisk Foundation, Tuborg Havnevej 19, DK-2900, Hellerup, Denmark"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Christensen", 
            "givenName": "Rikke N.", 
            "type": "Person"
          }, 
          {
            "affiliation": {
              "alternateName": "King's College London", 
              "id": "https://www.grid.ac/institutes/grid.13097.3c", 
              "name": [
                "The Policy Institute, King\u2019s College London, Strand Campus, WC2R 2LS, London, United Kingdom"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Pollitt", 
            "givenName": "Alexandra", 
            "id": "sg:person.01335400150.85", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.01335400150.85"
            ], 
            "type": "Person"
          }, 
          {
            "affiliation": {
              "alternateName": "National Institute for Health Research", 
              "id": "https://www.grid.ac/institutes/grid.451056.3", 
              "name": [
                "National Institute for Health Research, Central Commissioning Facility, Grange House 15, Church Street, TW1 3NL, Twickenham, United Kingdom"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Taylor", 
            "givenName": "Mark", 
            "type": "Person"
          }, 
          {
            "affiliation": {
              "alternateName": "Fundaci\u00f3n Hu\u00e9sped", 
              "id": "https://www.grid.ac/institutes/grid.491017.a", 
              "name": [
                "Fundaci\u00f3n Hu\u00e9sped, Pasaje A. Peluffo 3932, C1202ABB, Buenos Aires, Argentina"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Sued", 
            "givenName": "Omar", 
            "id": "sg:person.0637710460.34", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.0637710460.34"
            ], 
            "type": "Person"
          }, 
          {
            "affiliation": {
              "alternateName": "King's College London", 
              "id": "https://www.grid.ac/institutes/grid.13097.3c", 
              "name": [
                "The Policy Institute, King\u2019s College London, Strand Campus, WC2R 2LS, London, United Kingdom"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Hinrichs-Krapels", 
            "givenName": "Saba", 
            "id": "sg:person.0750116265.53", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.0750116265.53"
            ], 
            "type": "Person"
          }, 
          {
            "affiliation": {
              "name": [
                "Agency for Health Quality and Assessment of Catalonia (AQuAS), Carrer de Roc Boronat, 81, ES-08005, Barcelona, Spain"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Solans\u2010Dom\u00e8nech", 
            "givenName": "Maite", 
            "id": "sg:person.01124162634.00", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.01124162634.00"
            ], 
            "type": "Person"
          }, 
          {
            "affiliation": {
              "alternateName": "Alberta Innovates", 
              "id": "https://www.grid.ac/institutes/grid.488584.d", 
              "name": [
                "Alberta Innovates, 10104-103 Avenue NW, T5J 4A7, Edmonton, AB, Canada"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Chorzempa", 
            "givenName": "Heidi", 
            "type": "Person"
          }, 
          {
            "familyName": "for the International School on Research Impact Assessment\u00a0(ISRIA)", 
            "type": "Person"
          }
        ], 
        "citation": [
          {
            "id": "https://doi.org/10.2307/259247", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1000126868"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1016/s0140-6736(13)62229-1", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1000556529"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.3402/gha.v9.29866", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1001146318"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1016/s0140-6736(13)62297-7", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1001270672"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1016/j.evalprogplan.2010.07.001", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1001901259"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1503/cmaj.090016", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1002871957"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1503/cmaj.090016", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1002871957"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1186/1472-6963-12-478", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1004964974", 
              "https://doi.org/10.1186/1472-6963-12-478"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1186/1741-7015-12-99", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1006565540", 
              "https://doi.org/10.1186/1741-7015-12-99"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1093/heapol/czm013", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1007684451"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1186/1478-4505-11-5", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1009885990", 
              "https://doi.org/10.1186/1478-4505-11-5"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1097/00004424-199409000-00013", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1010107019"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1097/00004424-199409000-00013", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1010107019"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1097/00004424-199409000-00013", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1010107019"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1186/1478-4505-11-15", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1010979409", 
              "https://doi.org/10.1186/1478-4505-11-15"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1136/bmjopen-2015-009022", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1011010080"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1186/s12916-016-0564-z", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1011671285", 
              "https://doi.org/10.1186/s12916-016-0564-z"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1136/bmj.323.7312.528", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1012690232"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1038/s41562-016-0021", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1016358111", 
              "https://doi.org/10.1038/s41562-016-0021"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1258/jrsm.2011.110180", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1020182210"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1258/jrsm.2011.110180", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1020182210"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1038/466922a", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1020934336", 
              "https://doi.org/10.1038/466922a"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1136/bmjopen-2015-010916", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1021544275"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1038/464488a", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1021793668", 
              "https://doi.org/10.1038/464488a"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1038/464488a", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1021793668", 
              "https://doi.org/10.1038/464488a"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1093/reseval/rvs027", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1024329551"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1071/ah11057", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1024388106"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1186/s12961-016-0129-9", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1024425483", 
              "https://doi.org/10.1186/s12961-016-0129-9"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1186/s12961-016-0129-9", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1024425483", 
              "https://doi.org/10.1186/s12961-016-0129-9"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1016/s0140-6736(13)62329-6", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1026101451"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1016/s0140-6736(13)62228-x", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1026123782"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1016/s0140-6736(13)62296-5", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1029210049"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1186/s12916-015-0364-x", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1029854206", 
              "https://doi.org/10.1186/s12916-015-0364-x"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1186/s12916-015-0364-x", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1029854206", 
              "https://doi.org/10.1186/s12916-015-0364-x"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1186/s12916-015-0364-x", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1029854206", 
              "https://doi.org/10.1186/s12916-015-0364-x"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1038/465682a", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1031947515", 
              "https://doi.org/10.1038/465682a"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1038/520429a", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1033957063", 
              "https://doi.org/10.1038/520429a"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1186/s12961-016-0126-z", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1037028963", 
              "https://doi.org/10.1186/s12961-016-0126-z"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1186/s12961-016-0126-z", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1037028963", 
              "https://doi.org/10.1186/s12961-016-0126-z"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1186/1472-6963-7-121", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1037216393", 
              "https://doi.org/10.1186/1472-6963-7-121"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1038/35011576", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1037338372", 
              "https://doi.org/10.1038/35011576"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1038/35011576", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1037338372", 
              "https://doi.org/10.1038/35011576"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1093/reseval/rvs024", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1037928423"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1111/j.1467-842x.2001.tb00325.x", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1038046228"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/s11192-015-1547-0", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1038604978", 
              "https://doi.org/10.1007/s11192-015-1547-0"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1186/1478-4505-7-11", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1039112208", 
              "https://doi.org/10.1186/1478-4505-7-11"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1177/1077800416679143", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1040246609"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1177/1077800416679143", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1040246609"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1186/1478-4505-13-3", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1040349623", 
              "https://doi.org/10.1186/1478-4505-13-3"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1186/1478-4505-9-26", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1040575460", 
              "https://doi.org/10.1186/1478-4505-9-26"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1186/s12916-016-0620-8", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1041054780", 
              "https://doi.org/10.1186/s12916-016-0620-8"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1186/1478-4505-9-40", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1041082424", 
              "https://doi.org/10.1186/1478-4505-9-40"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1186/s12961-015-0003-1", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1041322205", 
              "https://doi.org/10.1186/s12961-015-0003-1"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1186/s12961-015-0003-1", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1041322205", 
              "https://doi.org/10.1186/s12961-015-0003-1"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1016/j.socscimed.2012.03.044", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1043535359"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1186/1756-0500-3-107", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1043554550", 
              "https://doi.org/10.1186/1756-0500-3-107"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1080/14719030410001675722", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1045308845"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1186/1478-4505-13-1", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1046498955", 
              "https://doi.org/10.1186/1478-4505-13-1"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1038/483509a", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1047020437", 
              "https://doi.org/10.1038/483509a"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1038/465665b", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1047248411", 
              "https://doi.org/10.1038/465665b"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1016/s0140-6736(13)62227-8", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1048210329"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1186/1478-4505-1-2", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1052367250", 
              "https://doi.org/10.1186/1478-4505-1-2"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1186/1478-4505-2-4", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1052749567", 
              "https://doi.org/10.1186/1478-4505-2-4"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1186/s12916-015-0467-4", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1053671169", 
              "https://doi.org/10.1186/s12916-015-0467-4"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1093/reseval/rvv022", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1060004513"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1126/science.1201865", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1062464441"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1126/science.156.3782.1571", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1062491466"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1126/science.769161", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1062648426"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1177/1098214007309280", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1063979972"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1177/1098214007309280", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1063979972"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.2307/3440244", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1070325125"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.3152/095820210x12827366906562", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1071058517"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.3152/095820211x12941371876742", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1071058556"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.3152/095820211x13118583635756", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1071058561"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.3163/1536-5050.98.1.008", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1071063451"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.5694/mja13.10798", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1073073563"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.5694/mja13.10798", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1073073563"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1177/135581969600100107", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1074346452"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1177/135581969600100107", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1074346452"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://app.dimensions.ai/details/publication/pub.1076992046", 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://app.dimensions.ai/details/publication/pub.1077175990", 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://app.dimensions.ai/details/publication/pub.1077205944", 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.5694/j.1326-5377.2006.tb00238.x", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1077205944"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://app.dimensions.ai/details/publication/pub.1077287083", 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.5694/j.1326-5377.2006.tb00533.x", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1077287083"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://app.dimensions.ai/details/publication/pub.1079391092", 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://app.dimensions.ai/details/publication/pub.1079391256", 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://app.dimensions.ai/details/publication/pub.1079391379", 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1093/reseval/rvx003", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1083934274"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1186/s12961-017-0191-y", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1084251447", 
              "https://doi.org/10.1186/s12961-017-0191-y"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1186/s12961-017-0191-y", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1084251447", 
              "https://doi.org/10.1186/s12961-017-0191-y"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1186/s12961-017-0188-6", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1084863702", 
              "https://doi.org/10.1186/s12961-017-0188-6"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1186/s12961-017-0188-6", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1084863702", 
              "https://doi.org/10.1186/s12961-017-0188-6"
            ], 
            "type": "CreativeWork"
          }
        ], 
        "datePublished": "2018-12", 
        "datePublishedReg": "2018-12-01", 
        "description": "As governments, funding agencies and research organisations worldwide seek to maximise both the financial and non-financial returns on investment in research, the way the research process is organised and funded is becoming increasingly under scrutiny. There are growing demands and aspirations to measure research impact (beyond academic publications), to understand how science works, and to optimise its societal and economic impact. In response, a multidisciplinary practice called research impact assessment is rapidly developing. Given that the practice is still in its formative stage, systematised recommendations or accepted standards for practitioners (such as funders and those responsible for managing research projects) across countries or disciplines to guide research impact assessment are not yet available.In this statement, we propose initial guidelines for a rigorous and effective process of research impact assessment applicable to all research disciplines and oriented towards practice. This statement systematises expert knowledge and practitioner experience from designing and delivering the International School on Research Impact Assessment (ISRIA). It brings together insights from over 450 experts and practitioners from 34 countries, who participated in the school during its 5-year run (from 2013 to 2017) and shares a set of core values from the school's learning programme. These insights are distilled into ten-point guidelines, which relate to (1) context, (2) purpose, (3) stakeholders' needs, (4) stakeholder engagement, (5) conceptual frameworks, (6) methods and data sources, (7) indicators and metrics, (8) ethics and conflicts of interest, (9) communication, and (10) community of practice.The guidelines can help practitioners improve and standardise the process of research impact assessment, but they are by no means exhaustive and require evaluation and continuous improvement. The prima facie effectiveness of the guidelines is based on the systematised expert and practitioner knowledge of the school's faculty and participants derived from their practical experience and research evidence. The current knowledge base has gaps in terms of the geographical and scientific discipline as well as stakeholder coverage and representation. The guidelines can be further strengthened through evaluation and continuous improvement by the global research impact assessment community.", 
        "genre": "non_research_article", 
        "id": "sg:pub.10.1186/s12961-018-0281-5", 
        "inLanguage": [
          "en"
        ], 
        "isAccessibleForFree": true, 
        "isFundedItemOf": [
          {
            "id": "sg:grant.5494471", 
            "type": "MonetaryGrant"
          }
        ], 
        "isPartOf": [
          {
            "id": "sg:journal.1032049", 
            "issn": [
              "1478-4505"
            ], 
            "name": "Health Research Policy and Systems", 
            "type": "Periodical"
          }, 
          {
            "issueNumber": "1", 
            "type": "PublicationIssue"
          }, 
          {
            "type": "PublicationVolume", 
            "volumeNumber": "16"
          }
        ], 
        "name": "ISRIA statement: ten-point guidelines for an effective process of research impact assessment", 
        "pagination": "8", 
        "productId": [
          {
            "name": "readcube_id", 
            "type": "PropertyValue", 
            "value": [
              "dd94d85c6bbf892da000421d911b1f7fad82422400e411650aecdb840718e3bf"
            ]
          }, 
          {
            "name": "pubmed_id", 
            "type": "PropertyValue", 
            "value": [
              "29422063"
            ]
          }, 
          {
            "name": "nlm_unique_id", 
            "type": "PropertyValue", 
            "value": [
              "101170481"
            ]
          }, 
          {
            "name": "doi", 
            "type": "PropertyValue", 
            "value": [
              "10.1186/s12961-018-0281-5"
            ]
          }, 
          {
            "name": "dimensions_id", 
            "type": "PropertyValue", 
            "value": [
              "pub.1100922343"
            ]
          }
        ], 
        "sameAs": [
          "https://doi.org/10.1186/s12961-018-0281-5", 
          "https://app.dimensions.ai/details/publication/pub.1100922343"
        ], 
        "sdDataset": "articles", 
        "sdDatePublished": "2019-04-10T22:25", 
        "sdLicense": "https://scigraph.springernature.com/explorer/license/", 
        "sdPublisher": {
          "name": "Springer Nature - SN SciGraph project", 
          "type": "Organization"
        }, 
        "sdSource": "s3://com-uberresearch-data-dimensions-target-20181106-alternative/cleanup/v134/2549eaecd7973599484d7c17b260dba0a4ecb94b/merge/v9/a6c9fde33151104705d4d7ff012ea9563521a3ce/jats-lookup/v90/0000000001_0000000264/records_8690_00000484.jsonl", 
        "type": "ScholarlyArticle", 
        "url": "http://link.springer.com/10.1186/s12961-018-0281-5"
      }
    ]
     

    Download the RDF metadata as:  json-ld nt turtle xml License info

    HOW TO GET THIS DATA PROGRAMMATICALLY:

    JSON-LD is a popular format for linked data which is fully compatible with JSON.

    curl -H 'Accept: application/ld+json' 'https://scigraph.springernature.com/pub.10.1186/s12961-018-0281-5'

    N-Triples is a line-based linked data format ideal for batch operations.

    curl -H 'Accept: application/n-triples' 'https://scigraph.springernature.com/pub.10.1186/s12961-018-0281-5'

    Turtle is a human-readable linked data format.

    curl -H 'Accept: text/turtle' 'https://scigraph.springernature.com/pub.10.1186/s12961-018-0281-5'

    RDF/XML is a standard XML format for linked data.

    curl -H 'Accept: application/rdf+xml' 'https://scigraph.springernature.com/pub.10.1186/s12961-018-0281-5'


     

    This table displays all metadata directly associated to this object as RDF triples.

    466 TRIPLES      21 PREDICATES      112 URIs      28 LITERALS      16 BLANK NODES

    Subject Predicate Object
    1 sg:pub.10.1186/s12961-018-0281-5 schema:about N141f24f8e8054a0dab5ff36eeaf1b0e4
    2 N370c688f20ba4f5ebbc73e5c6b2a7a4f
    3 Nab9d53cd5db448049cd606c26538dabb
    4 Nadb0bf80a21241d08dfa8cfca1816f23
    5 Nb9c932df258d42efac9c7cd04ebb6d1f
    6 Nd8e9546572ec472db7b05cfd30e605f1
    7 Nfd90b626c27a49edbebf1ef585f3575e
    8 anzsrc-for:13
    9 anzsrc-for:1303
    10 schema:author N6d5c46dee0cc4235886a80158cc7aeec
    11 schema:citation sg:pub.10.1007/s11192-015-1547-0
    12 sg:pub.10.1038/35011576
    13 sg:pub.10.1038/464488a
    14 sg:pub.10.1038/465665b
    15 sg:pub.10.1038/465682a
    16 sg:pub.10.1038/466922a
    17 sg:pub.10.1038/483509a
    18 sg:pub.10.1038/520429a
    19 sg:pub.10.1038/s41562-016-0021
    20 sg:pub.10.1186/1472-6963-12-478
    21 sg:pub.10.1186/1472-6963-7-121
    22 sg:pub.10.1186/1478-4505-1-2
    23 sg:pub.10.1186/1478-4505-11-15
    24 sg:pub.10.1186/1478-4505-11-5
    25 sg:pub.10.1186/1478-4505-13-1
    26 sg:pub.10.1186/1478-4505-13-3
    27 sg:pub.10.1186/1478-4505-2-4
    28 sg:pub.10.1186/1478-4505-7-11
    29 sg:pub.10.1186/1478-4505-9-26
    30 sg:pub.10.1186/1478-4505-9-40
    31 sg:pub.10.1186/1741-7015-12-99
    32 sg:pub.10.1186/1756-0500-3-107
    33 sg:pub.10.1186/s12916-015-0364-x
    34 sg:pub.10.1186/s12916-015-0467-4
    35 sg:pub.10.1186/s12916-016-0564-z
    36 sg:pub.10.1186/s12916-016-0620-8
    37 sg:pub.10.1186/s12961-015-0003-1
    38 sg:pub.10.1186/s12961-016-0126-z
    39 sg:pub.10.1186/s12961-016-0129-9
    40 sg:pub.10.1186/s12961-017-0188-6
    41 sg:pub.10.1186/s12961-017-0191-y
    42 https://app.dimensions.ai/details/publication/pub.1076992046
    43 https://app.dimensions.ai/details/publication/pub.1077175990
    44 https://app.dimensions.ai/details/publication/pub.1077205944
    45 https://app.dimensions.ai/details/publication/pub.1077287083
    46 https://app.dimensions.ai/details/publication/pub.1079391092
    47 https://app.dimensions.ai/details/publication/pub.1079391256
    48 https://app.dimensions.ai/details/publication/pub.1079391379
    49 https://doi.org/10.1016/j.evalprogplan.2010.07.001
    50 https://doi.org/10.1016/j.socscimed.2012.03.044
    51 https://doi.org/10.1016/s0140-6736(13)62227-8
    52 https://doi.org/10.1016/s0140-6736(13)62228-x
    53 https://doi.org/10.1016/s0140-6736(13)62229-1
    54 https://doi.org/10.1016/s0140-6736(13)62296-5
    55 https://doi.org/10.1016/s0140-6736(13)62297-7
    56 https://doi.org/10.1016/s0140-6736(13)62329-6
    57 https://doi.org/10.1071/ah11057
    58 https://doi.org/10.1080/14719030410001675722
    59 https://doi.org/10.1093/heapol/czm013
    60 https://doi.org/10.1093/reseval/rvs024
    61 https://doi.org/10.1093/reseval/rvs027
    62 https://doi.org/10.1093/reseval/rvv022
    63 https://doi.org/10.1093/reseval/rvx003
    64 https://doi.org/10.1097/00004424-199409000-00013
    65 https://doi.org/10.1111/j.1467-842x.2001.tb00325.x
    66 https://doi.org/10.1126/science.1201865
    67 https://doi.org/10.1126/science.156.3782.1571
    68 https://doi.org/10.1126/science.769161
    69 https://doi.org/10.1136/bmj.323.7312.528
    70 https://doi.org/10.1136/bmjopen-2015-009022
    71 https://doi.org/10.1136/bmjopen-2015-010916
    72 https://doi.org/10.1177/1077800416679143
    73 https://doi.org/10.1177/1098214007309280
    74 https://doi.org/10.1177/135581969600100107
    75 https://doi.org/10.1258/jrsm.2011.110180
    76 https://doi.org/10.1503/cmaj.090016
    77 https://doi.org/10.2307/259247
    78 https://doi.org/10.2307/3440244
    79 https://doi.org/10.3152/095820210x12827366906562
    80 https://doi.org/10.3152/095820211x12941371876742
    81 https://doi.org/10.3152/095820211x13118583635756
    82 https://doi.org/10.3163/1536-5050.98.1.008
    83 https://doi.org/10.3402/gha.v9.29866
    84 https://doi.org/10.5694/j.1326-5377.2006.tb00238.x
    85 https://doi.org/10.5694/j.1326-5377.2006.tb00533.x
    86 https://doi.org/10.5694/mja13.10798
    87 schema:datePublished 2018-12
    88 schema:datePublishedReg 2018-12-01
    89 schema:description As governments, funding agencies and research organisations worldwide seek to maximise both the financial and non-financial returns on investment in research, the way the research process is organised and funded is becoming increasingly under scrutiny. There are growing demands and aspirations to measure research impact (beyond academic publications), to understand how science works, and to optimise its societal and economic impact. In response, a multidisciplinary practice called research impact assessment is rapidly developing. Given that the practice is still in its formative stage, systematised recommendations or accepted standards for practitioners (such as funders and those responsible for managing research projects) across countries or disciplines to guide research impact assessment are not yet available.In this statement, we propose initial guidelines for a rigorous and effective process of research impact assessment applicable to all research disciplines and oriented towards practice. This statement systematises expert knowledge and practitioner experience from designing and delivering the International School on Research Impact Assessment (ISRIA). It brings together insights from over 450 experts and practitioners from 34 countries, who participated in the school during its 5-year run (from 2013 to 2017) and shares a set of core values from the school's learning programme. These insights are distilled into ten-point guidelines, which relate to (1) context, (2) purpose, (3) stakeholders' needs, (4) stakeholder engagement, (5) conceptual frameworks, (6) methods and data sources, (7) indicators and metrics, (8) ethics and conflicts of interest, (9) communication, and (10) community of practice.The guidelines can help practitioners improve and standardise the process of research impact assessment, but they are by no means exhaustive and require evaluation and continuous improvement. The prima facie effectiveness of the guidelines is based on the systematised expert and practitioner knowledge of the school's faculty and participants derived from their practical experience and research evidence. The current knowledge base has gaps in terms of the geographical and scientific discipline as well as stakeholder coverage and representation. The guidelines can be further strengthened through evaluation and continuous improvement by the global research impact assessment community.
    90 schema:genre non_research_article
    91 schema:inLanguage en
    92 schema:isAccessibleForFree true
    93 schema:isPartOf N4600bcaaa73e4851bd44913e06175b5c
    94 N5fe042367f9f42d386985d24ec815b1e
    95 sg:journal.1032049
    96 schema:name ISRIA statement: ten-point guidelines for an effective process of research impact assessment
    97 schema:pagination 8
    98 schema:productId N2d748108942243c2ac3cdf93a672baff
    99 N3b97dc6c4e8d490393ae4f55275d4a83
    100 N640eec4de2aa4d69bc99c36daaa6394a
    101 N723c1003f2fb42dc84e9323cc7151b9a
    102 N9505d41f1fc24656ad55e216a91d8ca0
    103 schema:sameAs https://app.dimensions.ai/details/publication/pub.1100922343
    104 https://doi.org/10.1186/s12961-018-0281-5
    105 schema:sdDatePublished 2019-04-10T22:25
    106 schema:sdLicense https://scigraph.springernature.com/explorer/license/
    107 schema:sdPublisher Nc60ee33d54794ffcbd6ada7081ab0b96
    108 schema:url http://link.springer.com/10.1186/s12961-018-0281-5
    109 sgo:license sg:explorer/license/
    110 sgo:sdDataset articles
    111 rdf:type schema:ScholarlyArticle
    112 N0041297092d44e15b106db2ae4b33549 rdf:first sg:person.0637710460.34
    113 rdf:rest N6ffba4127b164b96b8b81c1305a8a6a4
    114 N02b110c010ed4750beca2696227d674e rdf:first sg:person.01055471415.15
    115 rdf:rest Ncce5c5961ad84b2c9665bad4ec5a5692
    116 N141f24f8e8054a0dab5ff36eeaf1b0e4 schema:inDefinedTermSet https://www.nlm.nih.gov/mesh/
    117 schema:name Guidelines as Topic
    118 rdf:type schema:DefinedTerm
    119 N1a116c606fbe49ec929b645147d443d2 schema:name Agency for Health Quality and Assessment of Catalonia (AQuAS), Carrer de Roc Boronat, 81, ES-08005, Barcelona, Spain
    120 rdf:type schema:Organization
    121 N2ac0dcca619a4399a0f0662d6b61d009 rdf:first sg:person.01335400150.85
    122 rdf:rest Nf22731366aac4b339eefe8bd1c5af4fb
    123 N2d748108942243c2ac3cdf93a672baff schema:name dimensions_id
    124 schema:value pub.1100922343
    125 rdf:type schema:PropertyValue
    126 N35bce9255a004da1bda1467cba090cd5 schema:name Novo Nordisk Foundation, Tuborg Havnevej 19, DK-2900, Hellerup, Denmark
    127 rdf:type schema:Organization
    128 N370c688f20ba4f5ebbc73e5c6b2a7a4f schema:inDefinedTermSet https://www.nlm.nih.gov/mesh/
    129 schema:name Health Impact Assessment
    130 rdf:type schema:DefinedTerm
    131 N3b97dc6c4e8d490393ae4f55275d4a83 schema:name readcube_id
    132 schema:value dd94d85c6bbf892da000421d911b1f7fad82422400e411650aecdb840718e3bf
    133 rdf:type schema:PropertyValue
    134 N4600bcaaa73e4851bd44913e06175b5c schema:volumeNumber 16
    135 rdf:type schema:PublicationVolume
    136 N52391e2513e64255810424ec8e849976 rdf:first sg:person.010436707375.70
    137 rdf:rest N96eaa61578994fb9b3d29597c9c1da22
    138 N536ee5e775074d4c85de14ceedf7dabc schema:name Novo Nordisk Foundation, Tuborg Havnevej 19, DK-2900, Hellerup, Denmark
    139 rdf:type schema:Organization
    140 N54df2d68cc2743bcbcbbb43510c44bde schema:affiliation https://www.grid.ac/institutes/grid.488584.d
    141 schema:familyName Chorzempa
    142 schema:givenName Heidi
    143 rdf:type schema:Person
    144 N55a92795bf494f468f945549d17418bc rdf:first sg:person.015121127511.08
    145 rdf:rest N52391e2513e64255810424ec8e849976
    146 N5fe042367f9f42d386985d24ec815b1e schema:issueNumber 1
    147 rdf:type schema:PublicationIssue
    148 N63a4ed027d1643b698b2ad5d842457ad rdf:first sg:person.0730120066.75
    149 rdf:rest N02b110c010ed4750beca2696227d674e
    150 N640eec4de2aa4d69bc99c36daaa6394a schema:name pubmed_id
    151 schema:value 29422063
    152 rdf:type schema:PropertyValue
    153 N6d5c46dee0cc4235886a80158cc7aeec rdf:first sg:person.0670777613.15
    154 rdf:rest N63a4ed027d1643b698b2ad5d842457ad
    155 N6ffba4127b164b96b8b81c1305a8a6a4 rdf:first sg:person.0750116265.53
    156 rdf:rest Ne7f8be0a6a4844da9efe459af5d22a94
    157 N723c1003f2fb42dc84e9323cc7151b9a schema:name nlm_unique_id
    158 schema:value 101170481
    159 rdf:type schema:PropertyValue
    160 N7ec56f43e6004259a4846d2e8965442e schema:name Radcliffe Department of Medicine, University of Oxford, John Radcliffe Hospital, OX3 9DU, Oxford, United Kingdom
    161 rdf:type schema:Organization
    162 N7ffdcee239184adc925b35cad387486b schema:name Agency for Health Quality and Assessment of Catalonia (AQuAS), Carrer de Roc Boronat, 81, ES-08005, Barcelona, Spain
    163 rdf:type schema:Organization
    164 N91ca096d1d594a2d8f92252d1e3a78aa schema:affiliation https://www.grid.ac/institutes/grid.488584.d
    165 schema:familyName Graham
    166 schema:givenName Kathryn E. A.
    167 rdf:type schema:Person
    168 N9505d41f1fc24656ad55e216a91d8ca0 schema:name doi
    169 schema:value 10.1186/s12961-018-0281-5
    170 rdf:type schema:PropertyValue
    171 N96eaa61578994fb9b3d29597c9c1da22 rdf:first sg:person.015764623311.69
    172 rdf:rest N985d934ca1854fa3981e7496e0f44665
    173 N985d934ca1854fa3981e7496e0f44665 rdf:first Nc742c7fdf82049fd9074ec83070eae69
    174 rdf:rest N2ac0dcca619a4399a0f0662d6b61d009
    175 Nab9d53cd5db448049cd606c26538dabb schema:inDefinedTermSet https://www.nlm.nih.gov/mesh/
    176 schema:name Research
    177 rdf:type schema:DefinedTerm
    178 Nadb0bf80a21241d08dfa8cfca1816f23 schema:inDefinedTermSet https://www.nlm.nih.gov/mesh/
    179 schema:name Research Design
    180 rdf:type schema:DefinedTerm
    181 Nb9c932df258d42efac9c7cd04ebb6d1f schema:inDefinedTermSet https://www.nlm.nih.gov/mesh/
    182 schema:name Translational Medical Research
    183 rdf:type schema:DefinedTerm
    184 Nbe18554a443845d7bd304abcaaa4d434 rdf:first Nfc2333e8ff184831aa1b52a73d8f5230
    185 rdf:rest rdf:nil
    186 Nc60ee33d54794ffcbd6ada7081ab0b96 schema:name Springer Nature - SN SciGraph project
    187 rdf:type schema:Organization
    188 Nc742c7fdf82049fd9074ec83070eae69 schema:affiliation N35bce9255a004da1bda1467cba090cd5
    189 schema:familyName Christensen
    190 schema:givenName Rikke N.
    191 rdf:type schema:Person
    192 Nc85c5ef2e0df4592a3cf700db4917fd2 schema:affiliation https://www.grid.ac/institutes/grid.451056.3
    193 schema:familyName Taylor
    194 schema:givenName Mark
    195 rdf:type schema:Person
    196 Ncce5c5961ad84b2c9665bad4ec5a5692 rdf:first N91ca096d1d594a2d8f92252d1e3a78aa
    197 rdf:rest N55a92795bf494f468f945549d17418bc
    198 Nd8e9546572ec472db7b05cfd30e605f1 schema:inDefinedTermSet https://www.nlm.nih.gov/mesh/
    199 schema:name Humans
    200 rdf:type schema:DefinedTerm
    201 Ne7f8be0a6a4844da9efe459af5d22a94 rdf:first sg:person.01124162634.00
    202 rdf:rest Nf4477454c4eb4ba988fb2c3fb2ca3da4
    203 Nf22731366aac4b339eefe8bd1c5af4fb rdf:first Nc85c5ef2e0df4592a3cf700db4917fd2
    204 rdf:rest N0041297092d44e15b106db2ae4b33549
    205 Nf4477454c4eb4ba988fb2c3fb2ca3da4 rdf:first N54df2d68cc2743bcbcbbb43510c44bde
    206 rdf:rest Nbe18554a443845d7bd304abcaaa4d434
    207 Nfc2333e8ff184831aa1b52a73d8f5230 schema:familyName for the International School on Research Impact Assessment (ISRIA)
    208 rdf:type schema:Person
    209 Nfd90b626c27a49edbebf1ef585f3575e schema:inDefinedTermSet https://www.nlm.nih.gov/mesh/
    210 schema:name Evaluation Studies as Topic
    211 rdf:type schema:DefinedTerm
    212 anzsrc-for:13 schema:inDefinedTermSet anzsrc-for:
    213 schema:name Education
    214 rdf:type schema:DefinedTerm
    215 anzsrc-for:1303 schema:inDefinedTermSet anzsrc-for:
    216 schema:name Specialist Studies In Education
    217 rdf:type schema:DefinedTerm
    218 sg:grant.5494471 http://pending.schema.org/fundedItem sg:pub.10.1186/s12961-018-0281-5
    219 rdf:type schema:MonetaryGrant
    220 sg:journal.1032049 schema:issn 1478-4505
    221 schema:name Health Research Policy and Systems
    222 rdf:type schema:Periodical
    223 sg:person.010436707375.70 schema:affiliation https://www.grid.ac/institutes/grid.1016.6
    224 schema:familyName Dowd
    225 schema:givenName Anne-Maree
    226 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010436707375.70
    227 rdf:type schema:Person
    228 sg:person.01055471415.15 schema:affiliation https://www.grid.ac/institutes/grid.13097.3c
    229 schema:familyName Grant
    230 schema:givenName Jonathan
    231 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.01055471415.15
    232 rdf:type schema:Person
    233 sg:person.01124162634.00 schema:affiliation N7ffdcee239184adc925b35cad387486b
    234 schema:familyName Solans‐Domènech
    235 schema:givenName Maite
    236 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.01124162634.00
    237 rdf:type schema:Person
    238 sg:person.01335400150.85 schema:affiliation https://www.grid.ac/institutes/grid.13097.3c
    239 schema:familyName Pollitt
    240 schema:givenName Alexandra
    241 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.01335400150.85
    242 rdf:type schema:Person
    243 sg:person.015121127511.08 schema:affiliation https://www.grid.ac/institutes/grid.418818.c
    244 schema:familyName Boukhris
    245 schema:givenName Omar F.
    246 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.015121127511.08
    247 rdf:type schema:Person
    248 sg:person.015764623311.69 schema:affiliation N536ee5e775074d4c85de14ceedf7dabc
    249 schema:familyName Balling
    250 schema:givenName Gert V.
    251 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.015764623311.69
    252 rdf:type schema:Person
    253 sg:person.0637710460.34 schema:affiliation https://www.grid.ac/institutes/grid.491017.a
    254 schema:familyName Sued
    255 schema:givenName Omar
    256 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.0637710460.34
    257 rdf:type schema:Person
    258 sg:person.0670777613.15 schema:affiliation N1a116c606fbe49ec929b645147d443d2
    259 schema:familyName Adam
    260 schema:givenName Paula
    261 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.0670777613.15
    262 rdf:type schema:Person
    263 sg:person.0730120066.75 schema:affiliation N7ec56f43e6004259a4846d2e8965442e
    264 schema:familyName Ovseiko
    265 schema:givenName Pavel V.
    266 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.0730120066.75
    267 rdf:type schema:Person
    268 sg:person.0750116265.53 schema:affiliation https://www.grid.ac/institutes/grid.13097.3c
    269 schema:familyName Hinrichs-Krapels
    270 schema:givenName Saba
    271 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.0750116265.53
    272 rdf:type schema:Person
    273 sg:pub.10.1007/s11192-015-1547-0 schema:sameAs https://app.dimensions.ai/details/publication/pub.1038604978
    274 https://doi.org/10.1007/s11192-015-1547-0
    275 rdf:type schema:CreativeWork
    276 sg:pub.10.1038/35011576 schema:sameAs https://app.dimensions.ai/details/publication/pub.1037338372
    277 https://doi.org/10.1038/35011576
    278 rdf:type schema:CreativeWork
    279 sg:pub.10.1038/464488a schema:sameAs https://app.dimensions.ai/details/publication/pub.1021793668
    280 https://doi.org/10.1038/464488a
    281 rdf:type schema:CreativeWork
    282 sg:pub.10.1038/465665b schema:sameAs https://app.dimensions.ai/details/publication/pub.1047248411
    283 https://doi.org/10.1038/465665b
    284 rdf:type schema:CreativeWork
    285 sg:pub.10.1038/465682a schema:sameAs https://app.dimensions.ai/details/publication/pub.1031947515
    286 https://doi.org/10.1038/465682a
    287 rdf:type schema:CreativeWork
    288 sg:pub.10.1038/466922a schema:sameAs https://app.dimensions.ai/details/publication/pub.1020934336
    289 https://doi.org/10.1038/466922a
    290 rdf:type schema:CreativeWork
    291 sg:pub.10.1038/483509a schema:sameAs https://app.dimensions.ai/details/publication/pub.1047020437
    292 https://doi.org/10.1038/483509a
    293 rdf:type schema:CreativeWork
    294 sg:pub.10.1038/520429a schema:sameAs https://app.dimensions.ai/details/publication/pub.1033957063
    295 https://doi.org/10.1038/520429a
    296 rdf:type schema:CreativeWork
    297 sg:pub.10.1038/s41562-016-0021 schema:sameAs https://app.dimensions.ai/details/publication/pub.1016358111
    298 https://doi.org/10.1038/s41562-016-0021
    299 rdf:type schema:CreativeWork
    300 sg:pub.10.1186/1472-6963-12-478 schema:sameAs https://app.dimensions.ai/details/publication/pub.1004964974
    301 https://doi.org/10.1186/1472-6963-12-478
    302 rdf:type schema:CreativeWork
    303 sg:pub.10.1186/1472-6963-7-121 schema:sameAs https://app.dimensions.ai/details/publication/pub.1037216393
    304 https://doi.org/10.1186/1472-6963-7-121
    305 rdf:type schema:CreativeWork
    306 sg:pub.10.1186/1478-4505-1-2 schema:sameAs https://app.dimensions.ai/details/publication/pub.1052367250
    307 https://doi.org/10.1186/1478-4505-1-2
    308 rdf:type schema:CreativeWork
    309 sg:pub.10.1186/1478-4505-11-15 schema:sameAs https://app.dimensions.ai/details/publication/pub.1010979409
    310 https://doi.org/10.1186/1478-4505-11-15
    311 rdf:type schema:CreativeWork
    312 sg:pub.10.1186/1478-4505-11-5 schema:sameAs https://app.dimensions.ai/details/publication/pub.1009885990
    313 https://doi.org/10.1186/1478-4505-11-5
    314 rdf:type schema:CreativeWork
    315 sg:pub.10.1186/1478-4505-13-1 schema:sameAs https://app.dimensions.ai/details/publication/pub.1046498955
    316 https://doi.org/10.1186/1478-4505-13-1
    317 rdf:type schema:CreativeWork
    318 sg:pub.10.1186/1478-4505-13-3 schema:sameAs https://app.dimensions.ai/details/publication/pub.1040349623
    319 https://doi.org/10.1186/1478-4505-13-3
    320 rdf:type schema:CreativeWork
    321 sg:pub.10.1186/1478-4505-2-4 schema:sameAs https://app.dimensions.ai/details/publication/pub.1052749567
    322 https://doi.org/10.1186/1478-4505-2-4
    323 rdf:type schema:CreativeWork
    324 sg:pub.10.1186/1478-4505-7-11 schema:sameAs https://app.dimensions.ai/details/publication/pub.1039112208
    325 https://doi.org/10.1186/1478-4505-7-11
    326 rdf:type schema:CreativeWork
    327 sg:pub.10.1186/1478-4505-9-26 schema:sameAs https://app.dimensions.ai/details/publication/pub.1040575460
    328 https://doi.org/10.1186/1478-4505-9-26
    329 rdf:type schema:CreativeWork
    330 sg:pub.10.1186/1478-4505-9-40 schema:sameAs https://app.dimensions.ai/details/publication/pub.1041082424
    331 https://doi.org/10.1186/1478-4505-9-40
    332 rdf:type schema:CreativeWork
    333 sg:pub.10.1186/1741-7015-12-99 schema:sameAs https://app.dimensions.ai/details/publication/pub.1006565540
    334 https://doi.org/10.1186/1741-7015-12-99
    335 rdf:type schema:CreativeWork
    336 sg:pub.10.1186/1756-0500-3-107 schema:sameAs https://app.dimensions.ai/details/publication/pub.1043554550
    337 https://doi.org/10.1186/1756-0500-3-107
    338 rdf:type schema:CreativeWork
    339 sg:pub.10.1186/s12916-015-0364-x schema:sameAs https://app.dimensions.ai/details/publication/pub.1029854206
    340 https://doi.org/10.1186/s12916-015-0364-x
    341 rdf:type schema:CreativeWork
    342 sg:pub.10.1186/s12916-015-0467-4 schema:sameAs https://app.dimensions.ai/details/publication/pub.1053671169
    343 https://doi.org/10.1186/s12916-015-0467-4
    344 rdf:type schema:CreativeWork
    345 sg:pub.10.1186/s12916-016-0564-z schema:sameAs https://app.dimensions.ai/details/publication/pub.1011671285
    346 https://doi.org/10.1186/s12916-016-0564-z
    347 rdf:type schema:CreativeWork
    348 sg:pub.10.1186/s12916-016-0620-8 schema:sameAs https://app.dimensions.ai/details/publication/pub.1041054780
    349 https://doi.org/10.1186/s12916-016-0620-8
    350 rdf:type schema:CreativeWork
    351 sg:pub.10.1186/s12961-015-0003-1 schema:sameAs https://app.dimensions.ai/details/publication/pub.1041322205
    352 https://doi.org/10.1186/s12961-015-0003-1
    353 rdf:type schema:CreativeWork
    354 sg:pub.10.1186/s12961-016-0126-z schema:sameAs https://app.dimensions.ai/details/publication/pub.1037028963
    355 https://doi.org/10.1186/s12961-016-0126-z
    356 rdf:type schema:CreativeWork
    357 sg:pub.10.1186/s12961-016-0129-9 schema:sameAs https://app.dimensions.ai/details/publication/pub.1024425483
    358 https://doi.org/10.1186/s12961-016-0129-9
    359 rdf:type schema:CreativeWork
    360 sg:pub.10.1186/s12961-017-0188-6 schema:sameAs https://app.dimensions.ai/details/publication/pub.1084863702
    361 https://doi.org/10.1186/s12961-017-0188-6
    362 rdf:type schema:CreativeWork
    363 sg:pub.10.1186/s12961-017-0191-y schema:sameAs https://app.dimensions.ai/details/publication/pub.1084251447
    364 https://doi.org/10.1186/s12961-017-0191-y
    365 rdf:type schema:CreativeWork
    366 https://app.dimensions.ai/details/publication/pub.1076992046 schema:CreativeWork
    367 https://app.dimensions.ai/details/publication/pub.1077175990 schema:CreativeWork
    368 https://app.dimensions.ai/details/publication/pub.1077205944 schema:CreativeWork
    369 https://app.dimensions.ai/details/publication/pub.1077287083 schema:CreativeWork
    370 https://app.dimensions.ai/details/publication/pub.1079391092 schema:CreativeWork
    371 https://app.dimensions.ai/details/publication/pub.1079391256 schema:CreativeWork
    372 https://app.dimensions.ai/details/publication/pub.1079391379 schema:CreativeWork
    373 https://doi.org/10.1016/j.evalprogplan.2010.07.001 schema:sameAs https://app.dimensions.ai/details/publication/pub.1001901259
    374 rdf:type schema:CreativeWork
    375 https://doi.org/10.1016/j.socscimed.2012.03.044 schema:sameAs https://app.dimensions.ai/details/publication/pub.1043535359
    376 rdf:type schema:CreativeWork
    377 https://doi.org/10.1016/s0140-6736(13)62227-8 schema:sameAs https://app.dimensions.ai/details/publication/pub.1048210329
    378 rdf:type schema:CreativeWork
    379 https://doi.org/10.1016/s0140-6736(13)62228-x schema:sameAs https://app.dimensions.ai/details/publication/pub.1026123782
    380 rdf:type schema:CreativeWork
    381 https://doi.org/10.1016/s0140-6736(13)62229-1 schema:sameAs https://app.dimensions.ai/details/publication/pub.1000556529
    382 rdf:type schema:CreativeWork
    383 https://doi.org/10.1016/s0140-6736(13)62296-5 schema:sameAs https://app.dimensions.ai/details/publication/pub.1029210049
    384 rdf:type schema:CreativeWork
    385 https://doi.org/10.1016/s0140-6736(13)62297-7 schema:sameAs https://app.dimensions.ai/details/publication/pub.1001270672
    386 rdf:type schema:CreativeWork
    387 https://doi.org/10.1016/s0140-6736(13)62329-6 schema:sameAs https://app.dimensions.ai/details/publication/pub.1026101451
    388 rdf:type schema:CreativeWork
    389 https://doi.org/10.1071/ah11057 schema:sameAs https://app.dimensions.ai/details/publication/pub.1024388106
    390 rdf:type schema:CreativeWork
    391 https://doi.org/10.1080/14719030410001675722 schema:sameAs https://app.dimensions.ai/details/publication/pub.1045308845
    392 rdf:type schema:CreativeWork
    393 https://doi.org/10.1093/heapol/czm013 schema:sameAs https://app.dimensions.ai/details/publication/pub.1007684451
    394 rdf:type schema:CreativeWork
    395 https://doi.org/10.1093/reseval/rvs024 schema:sameAs https://app.dimensions.ai/details/publication/pub.1037928423
    396 rdf:type schema:CreativeWork
    397 https://doi.org/10.1093/reseval/rvs027 schema:sameAs https://app.dimensions.ai/details/publication/pub.1024329551
    398 rdf:type schema:CreativeWork
    399 https://doi.org/10.1093/reseval/rvv022 schema:sameAs https://app.dimensions.ai/details/publication/pub.1060004513
    400 rdf:type schema:CreativeWork
    401 https://doi.org/10.1093/reseval/rvx003 schema:sameAs https://app.dimensions.ai/details/publication/pub.1083934274
    402 rdf:type schema:CreativeWork
    403 https://doi.org/10.1097/00004424-199409000-00013 schema:sameAs https://app.dimensions.ai/details/publication/pub.1010107019
    404 rdf:type schema:CreativeWork
    405 https://doi.org/10.1111/j.1467-842x.2001.tb00325.x schema:sameAs https://app.dimensions.ai/details/publication/pub.1038046228
    406 rdf:type schema:CreativeWork
    407 https://doi.org/10.1126/science.1201865 schema:sameAs https://app.dimensions.ai/details/publication/pub.1062464441
    408 rdf:type schema:CreativeWork
    409 https://doi.org/10.1126/science.156.3782.1571 schema:sameAs https://app.dimensions.ai/details/publication/pub.1062491466
    410 rdf:type schema:CreativeWork
    411 https://doi.org/10.1126/science.769161 schema:sameAs https://app.dimensions.ai/details/publication/pub.1062648426
    412 rdf:type schema:CreativeWork
    413 https://doi.org/10.1136/bmj.323.7312.528 schema:sameAs https://app.dimensions.ai/details/publication/pub.1012690232
    414 rdf:type schema:CreativeWork
    415 https://doi.org/10.1136/bmjopen-2015-009022 schema:sameAs https://app.dimensions.ai/details/publication/pub.1011010080
    416 rdf:type schema:CreativeWork
    417 https://doi.org/10.1136/bmjopen-2015-010916 schema:sameAs https://app.dimensions.ai/details/publication/pub.1021544275
    418 rdf:type schema:CreativeWork
    419 https://doi.org/10.1177/1077800416679143 schema:sameAs https://app.dimensions.ai/details/publication/pub.1040246609
    420 rdf:type schema:CreativeWork
    421 https://doi.org/10.1177/1098214007309280 schema:sameAs https://app.dimensions.ai/details/publication/pub.1063979972
    422 rdf:type schema:CreativeWork
    423 https://doi.org/10.1177/135581969600100107 schema:sameAs https://app.dimensions.ai/details/publication/pub.1074346452
    424 rdf:type schema:CreativeWork
    425 https://doi.org/10.1258/jrsm.2011.110180 schema:sameAs https://app.dimensions.ai/details/publication/pub.1020182210
    426 rdf:type schema:CreativeWork
    427 https://doi.org/10.1503/cmaj.090016 schema:sameAs https://app.dimensions.ai/details/publication/pub.1002871957
    428 rdf:type schema:CreativeWork
    429 https://doi.org/10.2307/259247 schema:sameAs https://app.dimensions.ai/details/publication/pub.1000126868
    430 rdf:type schema:CreativeWork
    431 https://doi.org/10.2307/3440244 schema:sameAs https://app.dimensions.ai/details/publication/pub.1070325125
    432 rdf:type schema:CreativeWork
    433 https://doi.org/10.3152/095820210x12827366906562 schema:sameAs https://app.dimensions.ai/details/publication/pub.1071058517
    434 rdf:type schema:CreativeWork
    435 https://doi.org/10.3152/095820211x12941371876742 schema:sameAs https://app.dimensions.ai/details/publication/pub.1071058556
    436 rdf:type schema:CreativeWork
    437 https://doi.org/10.3152/095820211x13118583635756 schema:sameAs https://app.dimensions.ai/details/publication/pub.1071058561
    438 rdf:type schema:CreativeWork
    439 https://doi.org/10.3163/1536-5050.98.1.008 schema:sameAs https://app.dimensions.ai/details/publication/pub.1071063451
    440 rdf:type schema:CreativeWork
    441 https://doi.org/10.3402/gha.v9.29866 schema:sameAs https://app.dimensions.ai/details/publication/pub.1001146318
    442 rdf:type schema:CreativeWork
    443 https://doi.org/10.5694/j.1326-5377.2006.tb00238.x schema:sameAs https://app.dimensions.ai/details/publication/pub.1077205944
    444 rdf:type schema:CreativeWork
    445 https://doi.org/10.5694/j.1326-5377.2006.tb00533.x schema:sameAs https://app.dimensions.ai/details/publication/pub.1077287083
    446 rdf:type schema:CreativeWork
    447 https://doi.org/10.5694/mja13.10798 schema:sameAs https://app.dimensions.ai/details/publication/pub.1073073563
    448 rdf:type schema:CreativeWork
    449 https://www.grid.ac/institutes/grid.1016.6 schema:alternateName Commonwealth Scientific and Industrial Research Organisation
    450 schema:name Commonwealth Scientific and Industrial Research Organisation, Kenmore, PO Box 883, 4069, Brisbane, Australia
    451 rdf:type schema:Organization
    452 https://www.grid.ac/institutes/grid.13097.3c schema:alternateName King's College London
    453 schema:name The Policy Institute, King’s College London, Strand Campus, WC2R 2LS, London, United Kingdom
    454 rdf:type schema:Organization
    455 https://www.grid.ac/institutes/grid.418818.c schema:alternateName Qatar Foundation
    456 schema:name Qatar National Research Fund, PO Box 5825, Doha, Qatar
    457 rdf:type schema:Organization
    458 https://www.grid.ac/institutes/grid.451056.3 schema:alternateName National Institute for Health Research
    459 schema:name National Institute for Health Research, Central Commissioning Facility, Grange House 15, Church Street, TW1 3NL, Twickenham, United Kingdom
    460 rdf:type schema:Organization
    461 https://www.grid.ac/institutes/grid.488584.d schema:alternateName Alberta Innovates
    462 schema:name Alberta Innovates, 10104-103 Avenue NW, T5J 4A7, Edmonton, AB, Canada
    463 rdf:type schema:Organization
    464 https://www.grid.ac/institutes/grid.491017.a schema:alternateName Fundación Huésped
    465 schema:name Fundación Huésped, Pasaje A. Peluffo 3932, C1202ABB, Buenos Aires, Argentina
    466 rdf:type schema:Organization
     




    Preview window. Press ESC to close (or click here)


    ...