A novel performance monitoring framework for health research systems: experiences of the National Institute for Health Research in England View Full Text


Ontology type: schema:ScholarlyArticle      Open Access: True


Article Info

DATE

2011-12

AUTHORS

Anas El Turabi, Michael Hallsworth, Tom Ling, Jonathan Grant

ABSTRACT

BACKGROUND: The National Institute for Health Research (NIHR) was established in 2006 with the aim of creating an applied health research system embedded within the English National Health Service (NHS). NIHR sought to implement an approach for monitoring its performance that effectively linked early indicators of performance with longer-term research impacts. We attempted to develop and apply a conceptual framework for defining appropriate key performance indicators for NIHR. METHOD: Following a review of relevant literature, a conceptual framework for defining performance indicators for NIHR was developed, based on a hybridisation of the logic model and balanced scorecard approaches. This framework was validated through interviews with key NIHR stakeholders and a pilot in one division of NIHR, before being refined and applied more widely. Indicators were then selected and aggregated to create a basket of indicators aligned to NIHR's strategic goals, which could be reported to NIHR's leadership team on a quarterly basis via an oversight dashboard. RESULTS: Senior health research system managers and practitioners endorsed the conceptual framework developed and reported satisfaction with the breadth and balance of indicators selected for reporting. CONCLUSIONS: The use of the hybrid conceptual framework provides a pragmatic approach to defining performance indicators that are aligned to the strategic aims of a health research system. The particular strength of this framework is its capacity to provide an empirical link, over time, between upstream activities of a health research system and its long-term strategic objectives. More... »

PAGES

13

References to SciGraph publications

Identifiers

URI

http://scigraph.springernature.com/pub.10.1186/1478-4505-9-13

DOI

http://dx.doi.org/10.1186/1478-4505-9-13

DIMENSIONS

https://app.dimensions.ai/details/publication/pub.1017213264

PUBMED

https://www.ncbi.nlm.nih.gov/pubmed/21435265


Indexing Status Check whether this publication has been indexed by Scopus and Web Of Science using the SN Indexing Status Tool
Incoming Citations Browse incoming citations for this publication using opencitations.net

JSON-LD is the canonical representation for SciGraph data.

TIP: You can open this SciGraph record using an external JSON-LD service: JSON-LD Playground Google SDTT

[
  {
    "@context": "https://springernature.github.io/scigraph/jsonld/sgcontext.json", 
    "about": [
      {
        "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/1503", 
        "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
        "name": "Business and Management", 
        "type": "DefinedTerm"
      }, 
      {
        "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/15", 
        "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
        "name": "Commerce, Management, Tourism and Services", 
        "type": "DefinedTerm"
      }
    ], 
    "author": [
      {
        "affiliation": {
          "alternateName": "University of Cambridge", 
          "id": "https://www.grid.ac/institutes/grid.5335.0", 
          "name": [
            "Cambridge Centre for Health Services Research, Institute of Public Health, University of Cambridge, Robinson Way, CB2 0SR, Cambridge, UK", 
            "AND Europe, Westbrook Centre, Milton Road, CB4 1YG, Cambridge, UK"
          ], 
          "type": "Organization"
        }, 
        "familyName": "El Turabi", 
        "givenName": "Anas", 
        "id": "sg:person.07401505166.67", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.07401505166.67"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "Institute for Government", 
          "id": "https://www.grid.ac/institutes/grid.493369.2", 
          "name": [
            "Institute for Government, 2 Carlton Gardens, SW1Y 5AA, London, UK"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Hallsworth", 
        "givenName": "Michael", 
        "id": "sg:person.01372447253.82", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.01372447253.82"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "name": [
            "AND Europe, Westbrook Centre, Milton Road, CB4 1YG, Cambridge, UK"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Ling", 
        "givenName": "Tom", 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "name": [
            "AND Europe, Westbrook Centre, Milton Road, CB4 1YG, Cambridge, UK"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Grant", 
        "givenName": "Jonathan", 
        "id": "sg:person.01055471415.15", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.01055471415.15"
        ], 
        "type": "Person"
      }
    ], 
    "citation": [
      {
        "id": "https://doi.org/10.1258/1355819011927530", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1000481182"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1258/1355819011927530", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1000481182"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1186/1478-4505-6-1", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1006562712", 
          "https://doi.org/10.1186/1478-4505-6-1"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1136/bmj.320.7242.1107", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1010284812"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1186/1478-4505-8-11", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1011466134", 
          "https://doi.org/10.1186/1478-4505-8-11"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.7861/clinmedicine.6-5-435", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1018867386"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1186/1472-6963-6-135", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1034210497", 
          "https://doi.org/10.1186/1472-6963-6-135"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1056/nejm199009273231311", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1045334967"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.2307/2393553", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1069908817"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://app.dimensions.ai/details/publication/pub.1075290721", 
        "type": "CreativeWork"
      }
    ], 
    "datePublished": "2011-12", 
    "datePublishedReg": "2011-12-01", 
    "description": "BACKGROUND: The National Institute for Health Research (NIHR) was established in 2006 with the aim of creating an applied health research system embedded within the English National Health Service (NHS). NIHR sought to implement an approach for monitoring its performance that effectively linked early indicators of performance with longer-term research impacts. We attempted to develop and apply a conceptual framework for defining appropriate key performance indicators for NIHR.\nMETHOD: Following a review of relevant literature, a conceptual framework for defining performance indicators for NIHR was developed, based on a hybridisation of the logic model and balanced scorecard approaches. This framework was validated through interviews with key NIHR stakeholders and a pilot in one division of NIHR, before being refined and applied more widely. Indicators were then selected and aggregated to create a basket of indicators aligned to NIHR's strategic goals, which could be reported to NIHR's leadership team on a quarterly basis via an oversight dashboard.\nRESULTS: Senior health research system managers and practitioners endorsed the conceptual framework developed and reported satisfaction with the breadth and balance of indicators selected for reporting.\nCONCLUSIONS: The use of the hybrid conceptual framework provides a pragmatic approach to defining performance indicators that are aligned to the strategic aims of a health research system. The particular strength of this framework is its capacity to provide an empirical link, over time, between upstream activities of a health research system and its long-term strategic objectives.", 
    "genre": "research_article", 
    "id": "sg:pub.10.1186/1478-4505-9-13", 
    "inLanguage": [
      "en"
    ], 
    "isAccessibleForFree": true, 
    "isPartOf": [
      {
        "id": "sg:journal.1032049", 
        "issn": [
          "1478-4505"
        ], 
        "name": "Health Research Policy and Systems", 
        "type": "Periodical"
      }, 
      {
        "issueNumber": "1", 
        "type": "PublicationIssue"
      }, 
      {
        "type": "PublicationVolume", 
        "volumeNumber": "9"
      }
    ], 
    "name": "A novel performance monitoring framework for health research systems: experiences of the National Institute for Health Research in England", 
    "pagination": "13", 
    "productId": [
      {
        "name": "readcube_id", 
        "type": "PropertyValue", 
        "value": [
          "5202ffd04a2f714f18bc2f570670abfb159a4ba67caa6792a0836ab4342b38d9"
        ]
      }, 
      {
        "name": "pubmed_id", 
        "type": "PropertyValue", 
        "value": [
          "21435265"
        ]
      }, 
      {
        "name": "nlm_unique_id", 
        "type": "PropertyValue", 
        "value": [
          "101170481"
        ]
      }, 
      {
        "name": "doi", 
        "type": "PropertyValue", 
        "value": [
          "10.1186/1478-4505-9-13"
        ]
      }, 
      {
        "name": "dimensions_id", 
        "type": "PropertyValue", 
        "value": [
          "pub.1017213264"
        ]
      }
    ], 
    "sameAs": [
      "https://doi.org/10.1186/1478-4505-9-13", 
      "https://app.dimensions.ai/details/publication/pub.1017213264"
    ], 
    "sdDataset": "articles", 
    "sdDatePublished": "2019-04-10T19:15", 
    "sdLicense": "https://scigraph.springernature.com/explorer/license/", 
    "sdPublisher": {
      "name": "Springer Nature - SN SciGraph project", 
      "type": "Organization"
    }, 
    "sdSource": "s3://com-uberresearch-data-dimensions-target-20181106-alternative/cleanup/v134/2549eaecd7973599484d7c17b260dba0a4ecb94b/merge/v9/a6c9fde33151104705d4d7ff012ea9563521a3ce/jats-lookup/v90/0000000001_0000000264/records_8678_00000549.jsonl", 
    "type": "ScholarlyArticle", 
    "url": "http://link.springer.com/10.1186%2F1478-4505-9-13"
  }
]
 

Download the RDF metadata as:  json-ld nt turtle xml License info

HOW TO GET THIS DATA PROGRAMMATICALLY:

JSON-LD is a popular format for linked data which is fully compatible with JSON.

curl -H 'Accept: application/ld+json' 'https://scigraph.springernature.com/pub.10.1186/1478-4505-9-13'

N-Triples is a line-based linked data format ideal for batch operations.

curl -H 'Accept: application/n-triples' 'https://scigraph.springernature.com/pub.10.1186/1478-4505-9-13'

Turtle is a human-readable linked data format.

curl -H 'Accept: text/turtle' 'https://scigraph.springernature.com/pub.10.1186/1478-4505-9-13'

RDF/XML is a standard XML format for linked data.

curl -H 'Accept: application/rdf+xml' 'https://scigraph.springernature.com/pub.10.1186/1478-4505-9-13'


 

This table displays all metadata directly associated to this object as RDF triples.

125 TRIPLES      21 PREDICATES      38 URIs      21 LITERALS      9 BLANK NODES

Subject Predicate Object
1 sg:pub.10.1186/1478-4505-9-13 schema:about anzsrc-for:15
2 anzsrc-for:1503
3 schema:author N7f541929a4114f01997bdb4579a1ee47
4 schema:citation sg:pub.10.1186/1472-6963-6-135
5 sg:pub.10.1186/1478-4505-6-1
6 sg:pub.10.1186/1478-4505-8-11
7 https://app.dimensions.ai/details/publication/pub.1075290721
8 https://doi.org/10.1056/nejm199009273231311
9 https://doi.org/10.1136/bmj.320.7242.1107
10 https://doi.org/10.1258/1355819011927530
11 https://doi.org/10.2307/2393553
12 https://doi.org/10.7861/clinmedicine.6-5-435
13 schema:datePublished 2011-12
14 schema:datePublishedReg 2011-12-01
15 schema:description BACKGROUND: The National Institute for Health Research (NIHR) was established in 2006 with the aim of creating an applied health research system embedded within the English National Health Service (NHS). NIHR sought to implement an approach for monitoring its performance that effectively linked early indicators of performance with longer-term research impacts. We attempted to develop and apply a conceptual framework for defining appropriate key performance indicators for NIHR. METHOD: Following a review of relevant literature, a conceptual framework for defining performance indicators for NIHR was developed, based on a hybridisation of the logic model and balanced scorecard approaches. This framework was validated through interviews with key NIHR stakeholders and a pilot in one division of NIHR, before being refined and applied more widely. Indicators were then selected and aggregated to create a basket of indicators aligned to NIHR's strategic goals, which could be reported to NIHR's leadership team on a quarterly basis via an oversight dashboard. RESULTS: Senior health research system managers and practitioners endorsed the conceptual framework developed and reported satisfaction with the breadth and balance of indicators selected for reporting. CONCLUSIONS: The use of the hybrid conceptual framework provides a pragmatic approach to defining performance indicators that are aligned to the strategic aims of a health research system. The particular strength of this framework is its capacity to provide an empirical link, over time, between upstream activities of a health research system and its long-term strategic objectives.
16 schema:genre research_article
17 schema:inLanguage en
18 schema:isAccessibleForFree true
19 schema:isPartOf N2db8cb58cbca416abfba9a8336ebaceb
20 Nea14760aaf2144129984a8a1eff71d95
21 sg:journal.1032049
22 schema:name A novel performance monitoring framework for health research systems: experiences of the National Institute for Health Research in England
23 schema:pagination 13
24 schema:productId N235e13ff2b604b90bc76986b76b5779b
25 N34bc259287b343568b04040365fe011d
26 N463135d5c4394f7ca08dbbcc5a38c904
27 N72882f6af69b4b91bb2b0b9b66af5b6f
28 Nff5adda3ab5b41acbddda2f14962648d
29 schema:sameAs https://app.dimensions.ai/details/publication/pub.1017213264
30 https://doi.org/10.1186/1478-4505-9-13
31 schema:sdDatePublished 2019-04-10T19:15
32 schema:sdLicense https://scigraph.springernature.com/explorer/license/
33 schema:sdPublisher N58be3cd4307f4f83aff22cb708ff29d5
34 schema:url http://link.springer.com/10.1186%2F1478-4505-9-13
35 sgo:license sg:explorer/license/
36 sgo:sdDataset articles
37 rdf:type schema:ScholarlyArticle
38 N04065403fd384c31a792537d70a658f9 schema:name AND Europe, Westbrook Centre, Milton Road, CB4 1YG, Cambridge, UK
39 rdf:type schema:Organization
40 N235e13ff2b604b90bc76986b76b5779b schema:name nlm_unique_id
41 schema:value 101170481
42 rdf:type schema:PropertyValue
43 N2db8cb58cbca416abfba9a8336ebaceb schema:issueNumber 1
44 rdf:type schema:PublicationIssue
45 N30d47fa3ec73461383774b4967984940 rdf:first sg:person.01372447253.82
46 rdf:rest N46d9758ddf834724ba0bd173e579e81d
47 N34bc259287b343568b04040365fe011d schema:name pubmed_id
48 schema:value 21435265
49 rdf:type schema:PropertyValue
50 N463135d5c4394f7ca08dbbcc5a38c904 schema:name dimensions_id
51 schema:value pub.1017213264
52 rdf:type schema:PropertyValue
53 N46d9758ddf834724ba0bd173e579e81d rdf:first Nf49a37e696fb4a258fdd6b9cc506dd2e
54 rdf:rest N7e3acf6a274d48168f6aa15888b9a2c9
55 N58be3cd4307f4f83aff22cb708ff29d5 schema:name Springer Nature - SN SciGraph project
56 rdf:type schema:Organization
57 N682b1136bb3a47bf8da4816359271727 schema:name AND Europe, Westbrook Centre, Milton Road, CB4 1YG, Cambridge, UK
58 rdf:type schema:Organization
59 N72882f6af69b4b91bb2b0b9b66af5b6f schema:name readcube_id
60 schema:value 5202ffd04a2f714f18bc2f570670abfb159a4ba67caa6792a0836ab4342b38d9
61 rdf:type schema:PropertyValue
62 N7e3acf6a274d48168f6aa15888b9a2c9 rdf:first sg:person.01055471415.15
63 rdf:rest rdf:nil
64 N7f541929a4114f01997bdb4579a1ee47 rdf:first sg:person.07401505166.67
65 rdf:rest N30d47fa3ec73461383774b4967984940
66 Nea14760aaf2144129984a8a1eff71d95 schema:volumeNumber 9
67 rdf:type schema:PublicationVolume
68 Nf49a37e696fb4a258fdd6b9cc506dd2e schema:affiliation N04065403fd384c31a792537d70a658f9
69 schema:familyName Ling
70 schema:givenName Tom
71 rdf:type schema:Person
72 Nff5adda3ab5b41acbddda2f14962648d schema:name doi
73 schema:value 10.1186/1478-4505-9-13
74 rdf:type schema:PropertyValue
75 anzsrc-for:15 schema:inDefinedTermSet anzsrc-for:
76 schema:name Commerce, Management, Tourism and Services
77 rdf:type schema:DefinedTerm
78 anzsrc-for:1503 schema:inDefinedTermSet anzsrc-for:
79 schema:name Business and Management
80 rdf:type schema:DefinedTerm
81 sg:journal.1032049 schema:issn 1478-4505
82 schema:name Health Research Policy and Systems
83 rdf:type schema:Periodical
84 sg:person.01055471415.15 schema:affiliation N682b1136bb3a47bf8da4816359271727
85 schema:familyName Grant
86 schema:givenName Jonathan
87 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.01055471415.15
88 rdf:type schema:Person
89 sg:person.01372447253.82 schema:affiliation https://www.grid.ac/institutes/grid.493369.2
90 schema:familyName Hallsworth
91 schema:givenName Michael
92 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.01372447253.82
93 rdf:type schema:Person
94 sg:person.07401505166.67 schema:affiliation https://www.grid.ac/institutes/grid.5335.0
95 schema:familyName El Turabi
96 schema:givenName Anas
97 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.07401505166.67
98 rdf:type schema:Person
99 sg:pub.10.1186/1472-6963-6-135 schema:sameAs https://app.dimensions.ai/details/publication/pub.1034210497
100 https://doi.org/10.1186/1472-6963-6-135
101 rdf:type schema:CreativeWork
102 sg:pub.10.1186/1478-4505-6-1 schema:sameAs https://app.dimensions.ai/details/publication/pub.1006562712
103 https://doi.org/10.1186/1478-4505-6-1
104 rdf:type schema:CreativeWork
105 sg:pub.10.1186/1478-4505-8-11 schema:sameAs https://app.dimensions.ai/details/publication/pub.1011466134
106 https://doi.org/10.1186/1478-4505-8-11
107 rdf:type schema:CreativeWork
108 https://app.dimensions.ai/details/publication/pub.1075290721 schema:CreativeWork
109 https://doi.org/10.1056/nejm199009273231311 schema:sameAs https://app.dimensions.ai/details/publication/pub.1045334967
110 rdf:type schema:CreativeWork
111 https://doi.org/10.1136/bmj.320.7242.1107 schema:sameAs https://app.dimensions.ai/details/publication/pub.1010284812
112 rdf:type schema:CreativeWork
113 https://doi.org/10.1258/1355819011927530 schema:sameAs https://app.dimensions.ai/details/publication/pub.1000481182
114 rdf:type schema:CreativeWork
115 https://doi.org/10.2307/2393553 schema:sameAs https://app.dimensions.ai/details/publication/pub.1069908817
116 rdf:type schema:CreativeWork
117 https://doi.org/10.7861/clinmedicine.6-5-435 schema:sameAs https://app.dimensions.ai/details/publication/pub.1018867386
118 rdf:type schema:CreativeWork
119 https://www.grid.ac/institutes/grid.493369.2 schema:alternateName Institute for Government
120 schema:name Institute for Government, 2 Carlton Gardens, SW1Y 5AA, London, UK
121 rdf:type schema:Organization
122 https://www.grid.ac/institutes/grid.5335.0 schema:alternateName University of Cambridge
123 schema:name AND Europe, Westbrook Centre, Milton Road, CB4 1YG, Cambridge, UK
124 Cambridge Centre for Health Services Research, Institute of Public Health, University of Cambridge, Robinson Way, CB2 0SR, Cambridge, UK
125 rdf:type schema:Organization
 




Preview window. Press ESC to close (or click here)


...