A novel performance monitoring framework for health research systems: experiences of the National Institute for Health Research in England View Full Text


Ontology type: schema:ScholarlyArticle      Open Access: True


Article Info

DATE

2011-12

AUTHORS

Anas El Turabi, Michael Hallsworth, Tom Ling, Jonathan Grant

ABSTRACT

BACKGROUND: The National Institute for Health Research (NIHR) was established in 2006 with the aim of creating an applied health research system embedded within the English National Health Service (NHS). NIHR sought to implement an approach for monitoring its performance that effectively linked early indicators of performance with longer-term research impacts. We attempted to develop and apply a conceptual framework for defining appropriate key performance indicators for NIHR. METHOD: Following a review of relevant literature, a conceptual framework for defining performance indicators for NIHR was developed, based on a hybridisation of the logic model and balanced scorecard approaches. This framework was validated through interviews with key NIHR stakeholders and a pilot in one division of NIHR, before being refined and applied more widely. Indicators were then selected and aggregated to create a basket of indicators aligned to NIHR's strategic goals, which could be reported to NIHR's leadership team on a quarterly basis via an oversight dashboard. RESULTS: Senior health research system managers and practitioners endorsed the conceptual framework developed and reported satisfaction with the breadth and balance of indicators selected for reporting. CONCLUSIONS: The use of the hybrid conceptual framework provides a pragmatic approach to defining performance indicators that are aligned to the strategic aims of a health research system. The particular strength of this framework is its capacity to provide an empirical link, over time, between upstream activities of a health research system and its long-term strategic objectives. More... »

PAGES

13

References to SciGraph publications

Identifiers

URI

http://scigraph.springernature.com/pub.10.1186/1478-4505-9-13

DOI

http://dx.doi.org/10.1186/1478-4505-9-13

DIMENSIONS

https://app.dimensions.ai/details/publication/pub.1017213264

PUBMED

https://www.ncbi.nlm.nih.gov/pubmed/21435265


Indexing Status Check whether this publication has been indexed by Scopus and Web Of Science using the SN Indexing Status Tool
Incoming Citations Browse incoming citations for this publication using opencitations.net

JSON-LD is the canonical representation for SciGraph data.

TIP: You can open this SciGraph record using an external JSON-LD service: JSON-LD Playground Google SDTT

[
  {
    "@context": "https://springernature.github.io/scigraph/jsonld/sgcontext.json", 
    "about": [
      {
        "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/1503", 
        "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
        "name": "Business and Management", 
        "type": "DefinedTerm"
      }, 
      {
        "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/15", 
        "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
        "name": "Commerce, Management, Tourism and Services", 
        "type": "DefinedTerm"
      }
    ], 
    "author": [
      {
        "affiliation": {
          "alternateName": "University of Cambridge", 
          "id": "https://www.grid.ac/institutes/grid.5335.0", 
          "name": [
            "Cambridge Centre for Health Services Research, Institute of Public Health, University of Cambridge, Robinson Way, CB2 0SR, Cambridge, UK", 
            "AND Europe, Westbrook Centre, Milton Road, CB4 1YG, Cambridge, UK"
          ], 
          "type": "Organization"
        }, 
        "familyName": "El Turabi", 
        "givenName": "Anas", 
        "id": "sg:person.07401505166.67", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.07401505166.67"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "Institute for Government", 
          "id": "https://www.grid.ac/institutes/grid.493369.2", 
          "name": [
            "Institute for Government, 2 Carlton Gardens, SW1Y 5AA, London, UK"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Hallsworth", 
        "givenName": "Michael", 
        "id": "sg:person.01372447253.82", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.01372447253.82"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "name": [
            "AND Europe, Westbrook Centre, Milton Road, CB4 1YG, Cambridge, UK"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Ling", 
        "givenName": "Tom", 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "name": [
            "AND Europe, Westbrook Centre, Milton Road, CB4 1YG, Cambridge, UK"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Grant", 
        "givenName": "Jonathan", 
        "id": "sg:person.01055471415.15", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.01055471415.15"
        ], 
        "type": "Person"
      }
    ], 
    "citation": [
      {
        "id": "https://doi.org/10.1258/1355819011927530", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1000481182"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1258/1355819011927530", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1000481182"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1186/1478-4505-6-1", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1006562712", 
          "https://doi.org/10.1186/1478-4505-6-1"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1136/bmj.320.7242.1107", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1010284812"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1186/1478-4505-8-11", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1011466134", 
          "https://doi.org/10.1186/1478-4505-8-11"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.7861/clinmedicine.6-5-435", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1018867386"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1186/1472-6963-6-135", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1034210497", 
          "https://doi.org/10.1186/1472-6963-6-135"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1056/nejm199009273231311", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1045334967"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.2307/2393553", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1069908817"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://app.dimensions.ai/details/publication/pub.1075290721", 
        "type": "CreativeWork"
      }
    ], 
    "datePublished": "2011-12", 
    "datePublishedReg": "2011-12-01", 
    "description": "BACKGROUND: The National Institute for Health Research (NIHR) was established in 2006 with the aim of creating an applied health research system embedded within the English National Health Service (NHS). NIHR sought to implement an approach for monitoring its performance that effectively linked early indicators of performance with longer-term research impacts. We attempted to develop and apply a conceptual framework for defining appropriate key performance indicators for NIHR.\nMETHOD: Following a review of relevant literature, a conceptual framework for defining performance indicators for NIHR was developed, based on a hybridisation of the logic model and balanced scorecard approaches. This framework was validated through interviews with key NIHR stakeholders and a pilot in one division of NIHR, before being refined and applied more widely. Indicators were then selected and aggregated to create a basket of indicators aligned to NIHR's strategic goals, which could be reported to NIHR's leadership team on a quarterly basis via an oversight dashboard.\nRESULTS: Senior health research system managers and practitioners endorsed the conceptual framework developed and reported satisfaction with the breadth and balance of indicators selected for reporting.\nCONCLUSIONS: The use of the hybrid conceptual framework provides a pragmatic approach to defining performance indicators that are aligned to the strategic aims of a health research system. The particular strength of this framework is its capacity to provide an empirical link, over time, between upstream activities of a health research system and its long-term strategic objectives.", 
    "genre": "research_article", 
    "id": "sg:pub.10.1186/1478-4505-9-13", 
    "inLanguage": [
      "en"
    ], 
    "isAccessibleForFree": true, 
    "isPartOf": [
      {
        "id": "sg:journal.1032049", 
        "issn": [
          "1478-4505"
        ], 
        "name": "Health Research Policy and Systems", 
        "type": "Periodical"
      }, 
      {
        "issueNumber": "1", 
        "type": "PublicationIssue"
      }, 
      {
        "type": "PublicationVolume", 
        "volumeNumber": "9"
      }
    ], 
    "name": "A novel performance monitoring framework for health research systems: experiences of the National Institute for Health Research in England", 
    "pagination": "13", 
    "productId": [
      {
        "name": "readcube_id", 
        "type": "PropertyValue", 
        "value": [
          "5202ffd04a2f714f18bc2f570670abfb159a4ba67caa6792a0836ab4342b38d9"
        ]
      }, 
      {
        "name": "pubmed_id", 
        "type": "PropertyValue", 
        "value": [
          "21435265"
        ]
      }, 
      {
        "name": "nlm_unique_id", 
        "type": "PropertyValue", 
        "value": [
          "101170481"
        ]
      }, 
      {
        "name": "doi", 
        "type": "PropertyValue", 
        "value": [
          "10.1186/1478-4505-9-13"
        ]
      }, 
      {
        "name": "dimensions_id", 
        "type": "PropertyValue", 
        "value": [
          "pub.1017213264"
        ]
      }
    ], 
    "sameAs": [
      "https://doi.org/10.1186/1478-4505-9-13", 
      "https://app.dimensions.ai/details/publication/pub.1017213264"
    ], 
    "sdDataset": "articles", 
    "sdDatePublished": "2019-04-10T19:15", 
    "sdLicense": "https://scigraph.springernature.com/explorer/license/", 
    "sdPublisher": {
      "name": "Springer Nature - SN SciGraph project", 
      "type": "Organization"
    }, 
    "sdSource": "s3://com-uberresearch-data-dimensions-target-20181106-alternative/cleanup/v134/2549eaecd7973599484d7c17b260dba0a4ecb94b/merge/v9/a6c9fde33151104705d4d7ff012ea9563521a3ce/jats-lookup/v90/0000000001_0000000264/records_8678_00000549.jsonl", 
    "type": "ScholarlyArticle", 
    "url": "http://link.springer.com/10.1186%2F1478-4505-9-13"
  }
]
 

Download the RDF metadata as:  json-ld nt turtle xml License info

HOW TO GET THIS DATA PROGRAMMATICALLY:

JSON-LD is a popular format for linked data which is fully compatible with JSON.

curl -H 'Accept: application/ld+json' 'https://scigraph.springernature.com/pub.10.1186/1478-4505-9-13'

N-Triples is a line-based linked data format ideal for batch operations.

curl -H 'Accept: application/n-triples' 'https://scigraph.springernature.com/pub.10.1186/1478-4505-9-13'

Turtle is a human-readable linked data format.

curl -H 'Accept: text/turtle' 'https://scigraph.springernature.com/pub.10.1186/1478-4505-9-13'

RDF/XML is a standard XML format for linked data.

curl -H 'Accept: application/rdf+xml' 'https://scigraph.springernature.com/pub.10.1186/1478-4505-9-13'


 

This table displays all metadata directly associated to this object as RDF triples.

125 TRIPLES      21 PREDICATES      38 URIs      21 LITERALS      9 BLANK NODES

Subject Predicate Object
1 sg:pub.10.1186/1478-4505-9-13 schema:about anzsrc-for:15
2 anzsrc-for:1503
3 schema:author N1dc119f8e6a1464097debe033c5702d0
4 schema:citation sg:pub.10.1186/1472-6963-6-135
5 sg:pub.10.1186/1478-4505-6-1
6 sg:pub.10.1186/1478-4505-8-11
7 https://app.dimensions.ai/details/publication/pub.1075290721
8 https://doi.org/10.1056/nejm199009273231311
9 https://doi.org/10.1136/bmj.320.7242.1107
10 https://doi.org/10.1258/1355819011927530
11 https://doi.org/10.2307/2393553
12 https://doi.org/10.7861/clinmedicine.6-5-435
13 schema:datePublished 2011-12
14 schema:datePublishedReg 2011-12-01
15 schema:description BACKGROUND: The National Institute for Health Research (NIHR) was established in 2006 with the aim of creating an applied health research system embedded within the English National Health Service (NHS). NIHR sought to implement an approach for monitoring its performance that effectively linked early indicators of performance with longer-term research impacts. We attempted to develop and apply a conceptual framework for defining appropriate key performance indicators for NIHR. METHOD: Following a review of relevant literature, a conceptual framework for defining performance indicators for NIHR was developed, based on a hybridisation of the logic model and balanced scorecard approaches. This framework was validated through interviews with key NIHR stakeholders and a pilot in one division of NIHR, before being refined and applied more widely. Indicators were then selected and aggregated to create a basket of indicators aligned to NIHR's strategic goals, which could be reported to NIHR's leadership team on a quarterly basis via an oversight dashboard. RESULTS: Senior health research system managers and practitioners endorsed the conceptual framework developed and reported satisfaction with the breadth and balance of indicators selected for reporting. CONCLUSIONS: The use of the hybrid conceptual framework provides a pragmatic approach to defining performance indicators that are aligned to the strategic aims of a health research system. The particular strength of this framework is its capacity to provide an empirical link, over time, between upstream activities of a health research system and its long-term strategic objectives.
16 schema:genre research_article
17 schema:inLanguage en
18 schema:isAccessibleForFree true
19 schema:isPartOf N26f5cf4c6dd1494981ca6fcb50602077
20 Nc393fe450d9243a489059e515760f8f5
21 sg:journal.1032049
22 schema:name A novel performance monitoring framework for health research systems: experiences of the National Institute for Health Research in England
23 schema:pagination 13
24 schema:productId N1ae28d8b84024be6ac1b789fbe57015a
25 N740df67bf03c47d9be7603be0f89804d
26 N855ae066c52240eda4a02e736b61742c
27 Na7f1553ed679497e9ec398557d479204
28 Nb8567642a83c46369c51947b2c26a200
29 schema:sameAs https://app.dimensions.ai/details/publication/pub.1017213264
30 https://doi.org/10.1186/1478-4505-9-13
31 schema:sdDatePublished 2019-04-10T19:15
32 schema:sdLicense https://scigraph.springernature.com/explorer/license/
33 schema:sdPublisher Nd2b9f5c298b84bc69a093a109d5ed797
34 schema:url http://link.springer.com/10.1186%2F1478-4505-9-13
35 sgo:license sg:explorer/license/
36 sgo:sdDataset articles
37 rdf:type schema:ScholarlyArticle
38 N0c03fbb9203440cb8388d07e98614bd1 rdf:first sg:person.01055471415.15
39 rdf:rest rdf:nil
40 N1ae28d8b84024be6ac1b789fbe57015a schema:name readcube_id
41 schema:value 5202ffd04a2f714f18bc2f570670abfb159a4ba67caa6792a0836ab4342b38d9
42 rdf:type schema:PropertyValue
43 N1dc119f8e6a1464097debe033c5702d0 rdf:first sg:person.07401505166.67
44 rdf:rest Nbb23d0b8a9594e0786182e573d887f13
45 N26f5cf4c6dd1494981ca6fcb50602077 schema:volumeNumber 9
46 rdf:type schema:PublicationVolume
47 N2e3190f6de93429e9c31178c8253f8b1 schema:affiliation Nda3b15e5e2624feca8dd339e123157d5
48 schema:familyName Ling
49 schema:givenName Tom
50 rdf:type schema:Person
51 N740df67bf03c47d9be7603be0f89804d schema:name nlm_unique_id
52 schema:value 101170481
53 rdf:type schema:PropertyValue
54 N855ae066c52240eda4a02e736b61742c schema:name doi
55 schema:value 10.1186/1478-4505-9-13
56 rdf:type schema:PropertyValue
57 Na7f1553ed679497e9ec398557d479204 schema:name pubmed_id
58 schema:value 21435265
59 rdf:type schema:PropertyValue
60 Na8bed616a82c49a08faf7767af0b8c55 rdf:first N2e3190f6de93429e9c31178c8253f8b1
61 rdf:rest N0c03fbb9203440cb8388d07e98614bd1
62 Nb8567642a83c46369c51947b2c26a200 schema:name dimensions_id
63 schema:value pub.1017213264
64 rdf:type schema:PropertyValue
65 Nbb23d0b8a9594e0786182e573d887f13 rdf:first sg:person.01372447253.82
66 rdf:rest Na8bed616a82c49a08faf7767af0b8c55
67 Nc393fe450d9243a489059e515760f8f5 schema:issueNumber 1
68 rdf:type schema:PublicationIssue
69 Nd2b9f5c298b84bc69a093a109d5ed797 schema:name Springer Nature - SN SciGraph project
70 rdf:type schema:Organization
71 Nda3b15e5e2624feca8dd339e123157d5 schema:name AND Europe, Westbrook Centre, Milton Road, CB4 1YG, Cambridge, UK
72 rdf:type schema:Organization
73 Nf708137c39584702a49dd24b0a842aed schema:name AND Europe, Westbrook Centre, Milton Road, CB4 1YG, Cambridge, UK
74 rdf:type schema:Organization
75 anzsrc-for:15 schema:inDefinedTermSet anzsrc-for:
76 schema:name Commerce, Management, Tourism and Services
77 rdf:type schema:DefinedTerm
78 anzsrc-for:1503 schema:inDefinedTermSet anzsrc-for:
79 schema:name Business and Management
80 rdf:type schema:DefinedTerm
81 sg:journal.1032049 schema:issn 1478-4505
82 schema:name Health Research Policy and Systems
83 rdf:type schema:Periodical
84 sg:person.01055471415.15 schema:affiliation Nf708137c39584702a49dd24b0a842aed
85 schema:familyName Grant
86 schema:givenName Jonathan
87 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.01055471415.15
88 rdf:type schema:Person
89 sg:person.01372447253.82 schema:affiliation https://www.grid.ac/institutes/grid.493369.2
90 schema:familyName Hallsworth
91 schema:givenName Michael
92 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.01372447253.82
93 rdf:type schema:Person
94 sg:person.07401505166.67 schema:affiliation https://www.grid.ac/institutes/grid.5335.0
95 schema:familyName El Turabi
96 schema:givenName Anas
97 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.07401505166.67
98 rdf:type schema:Person
99 sg:pub.10.1186/1472-6963-6-135 schema:sameAs https://app.dimensions.ai/details/publication/pub.1034210497
100 https://doi.org/10.1186/1472-6963-6-135
101 rdf:type schema:CreativeWork
102 sg:pub.10.1186/1478-4505-6-1 schema:sameAs https://app.dimensions.ai/details/publication/pub.1006562712
103 https://doi.org/10.1186/1478-4505-6-1
104 rdf:type schema:CreativeWork
105 sg:pub.10.1186/1478-4505-8-11 schema:sameAs https://app.dimensions.ai/details/publication/pub.1011466134
106 https://doi.org/10.1186/1478-4505-8-11
107 rdf:type schema:CreativeWork
108 https://app.dimensions.ai/details/publication/pub.1075290721 schema:CreativeWork
109 https://doi.org/10.1056/nejm199009273231311 schema:sameAs https://app.dimensions.ai/details/publication/pub.1045334967
110 rdf:type schema:CreativeWork
111 https://doi.org/10.1136/bmj.320.7242.1107 schema:sameAs https://app.dimensions.ai/details/publication/pub.1010284812
112 rdf:type schema:CreativeWork
113 https://doi.org/10.1258/1355819011927530 schema:sameAs https://app.dimensions.ai/details/publication/pub.1000481182
114 rdf:type schema:CreativeWork
115 https://doi.org/10.2307/2393553 schema:sameAs https://app.dimensions.ai/details/publication/pub.1069908817
116 rdf:type schema:CreativeWork
117 https://doi.org/10.7861/clinmedicine.6-5-435 schema:sameAs https://app.dimensions.ai/details/publication/pub.1018867386
118 rdf:type schema:CreativeWork
119 https://www.grid.ac/institutes/grid.493369.2 schema:alternateName Institute for Government
120 schema:name Institute for Government, 2 Carlton Gardens, SW1Y 5AA, London, UK
121 rdf:type schema:Organization
122 https://www.grid.ac/institutes/grid.5335.0 schema:alternateName University of Cambridge
123 schema:name AND Europe, Westbrook Centre, Milton Road, CB4 1YG, Cambridge, UK
124 Cambridge Centre for Health Services Research, Institute of Public Health, University of Cambridge, Robinson Way, CB2 0SR, Cambridge, UK
125 rdf:type schema:Organization
 




Preview window. Press ESC to close (or click here)


...