Ki67 reproducibility using digital image analysis: an inter-platform and inter-operator study View Full Text


Ontology type: schema:ScholarlyArticle     


Article Info

DATE

2018-09-04

AUTHORS

Balazs Acs, Vasiliki Pelekanou, Yalai Bai, Sandra Martinez-Morilla, Maria Toki, Samuel C. Y. Leung, Torsten O. Nielsen, David L. Rimm

ABSTRACT

Ki67 expression has been a valuable prognostic variable in breast cancer, but has not seen broad adoption due to lack of standardization between institutions. Automation could represent a solution. Here we investigate the reproducibility of Ki67 measurement between three image analysis platforms with supervised classifiers performed by the same operator, by multiple operators, and finally we compare their accuracy in prognostic potential. Two breast cancer patient cohorts were used for this study. The standardization was done with the 30 cases of ER+ breast cancer that were used in phase 3 of International Ki67 in Breast Cancer Working Group initiatives where blocks were centrally cut and stained for Ki67. The outcome cohort was from 149 breast cancer cases from the Yale Pathology archives. A tissue microarray was built from representative tissue blocks with median follow-up of 120 months. The Mib-1 antibody (Dako) was used to detect Ki67 (dilution 1:100). HALO (IndicaLab), QuantCenter (3DHistech), and QuPath (open source software) digital image analysis (DIA) platforms were used to evaluate Ki67 expression. Intraclass correlation coefficient (ICC) was used to measure reproducibility. Between-DIA platform reproducibility was excellent (ICC: 0.933, CI: 0.879-0.966). Excellent reproducibility was found between all DIA platforms and the reference standard Ki67 values of Spectrum Webscope (QuPath-Spectrum Webscope ICC: 0.970, CI: 0.936-0.986; HALO-Spectrum Webscope ICC: 0.968, CI: 0.933-0.985; QuantCenter-Spectrum Webscope ICC: 0.964, CI: 0.919-0.983). All platforms showed excellent intra-DIA reproducibility (QuPath ICC: 0.992, CI: 0.986-0.996; HALO ICC: 0.972, CI: 0.924-0.988; QuantCenter ICC: 0.978, CI: 0.932-0.991). Comparing each DIA against outcome, the hazard ratios were similar. The inter-operator reproducibility was particularly high (ICC: 0.962-0.995). Our results showed outstanding reproducibility both within and between-DIA platforms, including one freely available DIA platform (QuPath). We also found the platforms essentially indistinguishable with respect to prediction of breast cancer patient outcome. Results justify multi-institutional DIA studies to assess clinical utility. More... »

PAGES

1-11

References to SciGraph publications

  • 2017-12. Ki-67 as a controversial predictive and prognostic marker in breast cancer patients treated with neoadjuvant chemotherapy in DIAGNOSTIC PATHOLOGY
  • 2010-07. Imaging plant growth in 4D: robust tissue reconstruction and lineaging at cell resolution in NATURE METHODS
  • 2014-04. A methodology to ensure and improve accuracy of Ki67 labelling index estimation by automated digital image analysis in breast cancer tissue in BREAST CANCER RESEARCH
  • 2016-07. Proliferation assessment in breast carcinomas using digital image analysis based on virtual Ki67/cytokeratin double staining in BREAST CANCER RESEARCH AND TREATMENT
  • 2001-10. Random Forests in MACHINE LEARNING
  • 2016-12. Analytical validation of a standardized scoring protocol for Ki67: phase 3 of an international multicenter collaboration in NPJ BREAST CANCER
  • 2018-01. Reproducibility and Prognostic Potential of Ki-67 Proliferation Index when Comparing Digital-Image Analysis with Standard Semi-Quantitative Evaluation in Breast Cancer in PATHOLOGY & ONCOLOGY RESEARCH
  • 2016-04. Digital image analysis outperforms manual biomarker assessment in breast cancer in MODERN PATHOLOGY
  • 2017-12. QuPath: Open source software for digital pathology image analysis in SCIENTIFIC REPORTS
  • 2011-12. How to measure diagnosis-associated information in virtual slides in DIAGNOSTIC PATHOLOGY
  • 2015-06. An international study to increase concordance in Ki67 scoring in MODERN PATHOLOGY
  • 2014-01. Quantitative assessment Ki-67 score for prediction of response to neoadjuvant chemotherapy in breast cancer in LABORATORY INVESTIGATION
  • 2018-05. Digital image analysis of Ki67 proliferation index in breast cancer using virtual dual staining on whole tissue sections: clinical validation and inter-platform agreement in BREAST CANCER RESEARCH AND TREATMENT
  • Identifiers

    URI

    http://scigraph.springernature.com/pub.10.1038/s41374-018-0123-7

    DOI

    http://dx.doi.org/10.1038/s41374-018-0123-7

    DIMENSIONS

    https://app.dimensions.ai/details/publication/pub.1106644705

    PUBMED

    https://www.ncbi.nlm.nih.gov/pubmed/30181553


    Indexing Status Check whether this publication has been indexed by Scopus and Web Of Science using the SN Indexing Status Tool
    Incoming Citations Browse incoming citations for this publication using opencitations.net

    JSON-LD is the canonical representation for SciGraph data.

    TIP: You can open this SciGraph record using an external JSON-LD service: JSON-LD Playground Google SDTT

    [
      {
        "@context": "https://springernature.github.io/scigraph/jsonld/sgcontext.json", 
        "about": [
          {
            "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/1112", 
            "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
            "name": "Oncology and Carcinogenesis", 
            "type": "DefinedTerm"
          }, 
          {
            "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/11", 
            "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
            "name": "Medical and Health Sciences", 
            "type": "DefinedTerm"
          }
        ], 
        "author": [
          {
            "affiliation": {
              "alternateName": "Yale University", 
              "id": "https://www.grid.ac/institutes/grid.47100.32", 
              "name": [
                "Department of Pathology, Yale School of Medicine, New Haven, CT, USA"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Acs", 
            "givenName": "Balazs", 
            "id": "sg:person.010167507274.29", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010167507274.29"
            ], 
            "type": "Person"
          }, 
          {
            "affiliation": {
              "alternateName": "Sanofi (United States)", 
              "id": "https://www.grid.ac/institutes/grid.417555.7", 
              "name": [
                "Department of Pathology, Yale School of Medicine, New Haven, CT, USA", 
                "Precision Oncology, Sanofi US Services Inc, Cambridge, MA, USA"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Pelekanou", 
            "givenName": "Vasiliki", 
            "id": "sg:person.0670132035.19", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.0670132035.19"
            ], 
            "type": "Person"
          }, 
          {
            "affiliation": {
              "alternateName": "Yale University", 
              "id": "https://www.grid.ac/institutes/grid.47100.32", 
              "name": [
                "Department of Pathology, Yale School of Medicine, New Haven, CT, USA"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Bai", 
            "givenName": "Yalai", 
            "id": "sg:person.01117274053.25", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.01117274053.25"
            ], 
            "type": "Person"
          }, 
          {
            "affiliation": {
              "alternateName": "Yale University", 
              "id": "https://www.grid.ac/institutes/grid.47100.32", 
              "name": [
                "Department of Pathology, Yale School of Medicine, New Haven, CT, USA"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Martinez-Morilla", 
            "givenName": "Sandra", 
            "id": "sg:person.01120223114.98", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.01120223114.98"
            ], 
            "type": "Person"
          }, 
          {
            "affiliation": {
              "alternateName": "Yale University", 
              "id": "https://www.grid.ac/institutes/grid.47100.32", 
              "name": [
                "Department of Pathology, Yale School of Medicine, New Haven, CT, USA"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Toki", 
            "givenName": "Maria", 
            "id": "sg:person.011532335565.35", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.011532335565.35"
            ], 
            "type": "Person"
          }, 
          {
            "affiliation": {
              "alternateName": "University of British Columbia", 
              "id": "https://www.grid.ac/institutes/grid.17091.3e", 
              "name": [
                "Department of Pathology and Laboratory Medicine, University of British Columbia, Vancouver, BC, Canada"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Leung", 
            "givenName": "Samuel C. Y.", 
            "id": "sg:person.01120302235.50", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.01120302235.50"
            ], 
            "type": "Person"
          }, 
          {
            "affiliation": {
              "alternateName": "University of British Columbia", 
              "id": "https://www.grid.ac/institutes/grid.17091.3e", 
              "name": [
                "Department of Pathology and Laboratory Medicine, University of British Columbia, Vancouver, BC, Canada"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Nielsen", 
            "givenName": "Torsten O.", 
            "id": "sg:person.0617136146.33", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.0617136146.33"
            ], 
            "type": "Person"
          }, 
          {
            "affiliation": {
              "alternateName": "Yale University", 
              "id": "https://www.grid.ac/institutes/grid.47100.32", 
              "name": [
                "Department of Pathology, Yale School of Medicine, New Haven, CT, USA"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Rimm", 
            "givenName": "David L.", 
            "id": "sg:person.0754207153.13", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.0754207153.13"
            ], 
            "type": "Person"
          }
        ], 
        "citation": [
          {
            "id": "sg:pub.10.1038/modpathol.2015.38", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1001793556", 
              "https://doi.org/10.1038/modpathol.2015.38"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1093/jnci/djt306", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1007448888"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1186/1746-1596-6-s1-s9", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1007787125", 
              "https://doi.org/10.1186/1746-1596-6-s1-s9"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1080/21681163.2014.885120", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1009308221"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1038/npjbcancer.2016.14", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1010212957", 
              "https://doi.org/10.1038/npjbcancer.2016.14"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1016/j.breast.2013.11.007", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1013328584"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1093/jnci/djs438", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1016226448"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1093/annonc/mdv298", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1022951845"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1371/journal.pone.0094137", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1023385375"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1093/jnci/djr393", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1024075504"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1023/a:1010933404324", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1024739340", 
              "https://doi.org/10.1023/a:1010933404324"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1371/journal.pone.0150505", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1026981914"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1371/journal.pone.0150505", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1026981914"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1371/journal.pone.0150505", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1026981914"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1186/bcr3639", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1027024600", 
              "https://doi.org/10.1186/bcr3639"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1038/labinvest.2013.128", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1027726525", 
              "https://doi.org/10.1038/labinvest.2013.128"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1111/his.12795", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1031281639"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1016/j.breast.2008.02.002", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1032864891"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1038/modpathol.2016.34", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1036028479", 
              "https://doi.org/10.1038/modpathol.2016.34"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1038/nmeth.1472", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1037563696", 
              "https://doi.org/10.1038/nmeth.1472"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1038/nmeth.1472", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1037563696", 
              "https://doi.org/10.1038/nmeth.1472"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.2144/000113382", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1038561153"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1200/jco.2015.65.2289", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1045222004"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1158/1078-0432.ccr-14-1283", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1045571310"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/s10549-016-3852-6", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1048798250", 
              "https://doi.org/10.1007/s10549-016-3852-6"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/s10549-016-3852-6", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1048798250", 
              "https://doi.org/10.1007/s10549-016-3852-6"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1002/path.1711680404", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1051457357"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1002/path.1711680404", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1051457357"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1109/34.745739", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1061156908"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.2307/2529310", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1069974986"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://app.dimensions.ai/details/publication/pub.1074873071", 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1186/s13000-017-0608-5", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1083854047", 
              "https://doi.org/10.1186/s13000-017-0608-5"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1186/s13000-017-0608-5", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1083854047", 
              "https://doi.org/10.1186/s13000-017-0608-5"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/s12253-017-0220-8", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1084741139", 
              "https://doi.org/10.1007/s12253-017-0220-8"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/s12253-017-0220-8", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1084741139", 
              "https://doi.org/10.1007/s12253-017-0220-8"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1002/cyto.a.23124", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1085138788"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1093/annonc/mdx016", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1085371691"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1093/annonc/mdx016", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1085371691"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1093/annonc/mdx016", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1085371691"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1038/s41598-017-17204-5", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1093066740", 
              "https://doi.org/10.1038/s41598-017-17204-5"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1111/his.13452", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1099627353"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/s10549-018-4669-2", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1100468053", 
              "https://doi.org/10.1007/s10549-018-4669-2"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/s10549-018-4669-2", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1100468053", 
              "https://doi.org/10.1007/s10549-018-4669-2"
            ], 
            "type": "CreativeWork"
          }
        ], 
        "datePublished": "2018-09-04", 
        "datePublishedReg": "2018-09-04", 
        "description": "Ki67 expression has been a valuable prognostic variable in breast cancer, but has not seen broad adoption due to lack of standardization between institutions. Automation could represent a solution. Here we investigate the reproducibility of Ki67 measurement between three image analysis platforms with supervised classifiers performed by the same operator, by multiple operators, and finally we compare their accuracy in prognostic potential. Two breast cancer patient cohorts were used for this study. The standardization was done with the 30 cases of ER+ breast cancer that were used in phase 3 of International Ki67 in Breast Cancer Working Group initiatives where blocks were centrally cut and stained for Ki67. The outcome cohort was from 149 breast cancer cases from the Yale Pathology archives. A tissue microarray was built from representative tissue blocks with median follow-up of 120 months. The Mib-1 antibody (Dako) was used to detect Ki67 (dilution 1:100). HALO (IndicaLab), QuantCenter (3DHistech), and QuPath (open source software) digital image analysis (DIA) platforms were used to evaluate Ki67 expression. Intraclass correlation coefficient (ICC) was used to measure reproducibility. Between-DIA platform reproducibility was excellent (ICC: 0.933, CI: 0.879-0.966). Excellent reproducibility was found between all DIA platforms and the reference standard Ki67 values of Spectrum Webscope (QuPath-Spectrum Webscope ICC: 0.970, CI: 0.936-0.986; HALO-Spectrum Webscope ICC: 0.968, CI: 0.933-0.985; QuantCenter-Spectrum Webscope ICC: 0.964, CI: 0.919-0.983). All platforms showed excellent intra-DIA reproducibility (QuPath ICC: 0.992, CI: 0.986-0.996; HALO ICC: 0.972, CI: 0.924-0.988; QuantCenter ICC: 0.978, CI: 0.932-0.991). Comparing each DIA against outcome, the hazard ratios were similar. The inter-operator reproducibility was particularly high (ICC: 0.962-0.995). Our results showed outstanding reproducibility both within and between-DIA platforms, including one freely available DIA platform (QuPath). We also found the platforms essentially indistinguishable with respect to prediction of breast cancer patient outcome. Results justify multi-institutional DIA studies to assess clinical utility.", 
        "genre": "research_article", 
        "id": "sg:pub.10.1038/s41374-018-0123-7", 
        "inLanguage": [
          "en"
        ], 
        "isAccessibleForFree": false, 
        "isPartOf": [
          {
            "id": "sg:journal.1017964", 
            "issn": [
              "0023-6837", 
              "1530-0307"
            ], 
            "name": "Laboratory Investigation", 
            "type": "Periodical"
          }
        ], 
        "name": "Ki67 reproducibility using digital image analysis: an inter-platform and inter-operator study", 
        "pagination": "1-11", 
        "productId": [
          {
            "name": "readcube_id", 
            "type": "PropertyValue", 
            "value": [
              "aa90f780a24672817bf84ce8c2026e1317e65f60dd43a58ecda0a10e77d699a7"
            ]
          }, 
          {
            "name": "pubmed_id", 
            "type": "PropertyValue", 
            "value": [
              "30181553"
            ]
          }, 
          {
            "name": "nlm_unique_id", 
            "type": "PropertyValue", 
            "value": [
              "0376617"
            ]
          }, 
          {
            "name": "doi", 
            "type": "PropertyValue", 
            "value": [
              "10.1038/s41374-018-0123-7"
            ]
          }, 
          {
            "name": "dimensions_id", 
            "type": "PropertyValue", 
            "value": [
              "pub.1106644705"
            ]
          }
        ], 
        "sameAs": [
          "https://doi.org/10.1038/s41374-018-0123-7", 
          "https://app.dimensions.ai/details/publication/pub.1106644705"
        ], 
        "sdDataset": "articles", 
        "sdDatePublished": "2019-04-10T19:17", 
        "sdLicense": "https://scigraph.springernature.com/explorer/license/", 
        "sdPublisher": {
          "name": "Springer Nature - SN SciGraph project", 
          "type": "Organization"
        }, 
        "sdSource": "s3://com-uberresearch-data-dimensions-target-20181106-alternative/cleanup/v134/2549eaecd7973599484d7c17b260dba0a4ecb94b/merge/v9/a6c9fde33151104705d4d7ff012ea9563521a3ce/jats-lookup/v90/0000000001_0000000264/records_8678_00000566.jsonl", 
        "type": "ScholarlyArticle", 
        "url": "https://www.nature.com/articles/s41374-018-0123-7"
      }
    ]
     

    Download the RDF metadata as:  json-ld nt turtle xml License info

    HOW TO GET THIS DATA PROGRAMMATICALLY:

    JSON-LD is a popular format for linked data which is fully compatible with JSON.

    curl -H 'Accept: application/ld+json' 'https://scigraph.springernature.com/pub.10.1038/s41374-018-0123-7'

    N-Triples is a line-based linked data format ideal for batch operations.

    curl -H 'Accept: application/n-triples' 'https://scigraph.springernature.com/pub.10.1038/s41374-018-0123-7'

    Turtle is a human-readable linked data format.

    curl -H 'Accept: text/turtle' 'https://scigraph.springernature.com/pub.10.1038/s41374-018-0123-7'

    RDF/XML is a standard XML format for linked data.

    curl -H 'Accept: application/rdf+xml' 'https://scigraph.springernature.com/pub.10.1038/s41374-018-0123-7'


     

    This table displays all metadata directly associated to this object as RDF triples.

    230 TRIPLES      21 PREDICATES      59 URIs      18 LITERALS      7 BLANK NODES

    Subject Predicate Object
    1 sg:pub.10.1038/s41374-018-0123-7 schema:about anzsrc-for:11
    2 anzsrc-for:1112
    3 schema:author N1e974f5ad06f4706aa3fa565e16e3c5d
    4 schema:citation sg:pub.10.1007/s10549-016-3852-6
    5 sg:pub.10.1007/s10549-018-4669-2
    6 sg:pub.10.1007/s12253-017-0220-8
    7 sg:pub.10.1023/a:1010933404324
    8 sg:pub.10.1038/labinvest.2013.128
    9 sg:pub.10.1038/modpathol.2015.38
    10 sg:pub.10.1038/modpathol.2016.34
    11 sg:pub.10.1038/nmeth.1472
    12 sg:pub.10.1038/npjbcancer.2016.14
    13 sg:pub.10.1038/s41598-017-17204-5
    14 sg:pub.10.1186/1746-1596-6-s1-s9
    15 sg:pub.10.1186/bcr3639
    16 sg:pub.10.1186/s13000-017-0608-5
    17 https://app.dimensions.ai/details/publication/pub.1074873071
    18 https://doi.org/10.1002/cyto.a.23124
    19 https://doi.org/10.1002/path.1711680404
    20 https://doi.org/10.1016/j.breast.2008.02.002
    21 https://doi.org/10.1016/j.breast.2013.11.007
    22 https://doi.org/10.1080/21681163.2014.885120
    23 https://doi.org/10.1093/annonc/mdv298
    24 https://doi.org/10.1093/annonc/mdx016
    25 https://doi.org/10.1093/jnci/djr393
    26 https://doi.org/10.1093/jnci/djs438
    27 https://doi.org/10.1093/jnci/djt306
    28 https://doi.org/10.1109/34.745739
    29 https://doi.org/10.1111/his.12795
    30 https://doi.org/10.1111/his.13452
    31 https://doi.org/10.1158/1078-0432.ccr-14-1283
    32 https://doi.org/10.1200/jco.2015.65.2289
    33 https://doi.org/10.1371/journal.pone.0094137
    34 https://doi.org/10.1371/journal.pone.0150505
    35 https://doi.org/10.2144/000113382
    36 https://doi.org/10.2307/2529310
    37 schema:datePublished 2018-09-04
    38 schema:datePublishedReg 2018-09-04
    39 schema:description Ki67 expression has been a valuable prognostic variable in breast cancer, but has not seen broad adoption due to lack of standardization between institutions. Automation could represent a solution. Here we investigate the reproducibility of Ki67 measurement between three image analysis platforms with supervised classifiers performed by the same operator, by multiple operators, and finally we compare their accuracy in prognostic potential. Two breast cancer patient cohorts were used for this study. The standardization was done with the 30 cases of ER+ breast cancer that were used in phase 3 of International Ki67 in Breast Cancer Working Group initiatives where blocks were centrally cut and stained for Ki67. The outcome cohort was from 149 breast cancer cases from the Yale Pathology archives. A tissue microarray was built from representative tissue blocks with median follow-up of 120 months. The Mib-1 antibody (Dako) was used to detect Ki67 (dilution 1:100). HALO (IndicaLab), QuantCenter (3DHistech), and QuPath (open source software) digital image analysis (DIA) platforms were used to evaluate Ki67 expression. Intraclass correlation coefficient (ICC) was used to measure reproducibility. Between-DIA platform reproducibility was excellent (ICC: 0.933, CI: 0.879-0.966). Excellent reproducibility was found between all DIA platforms and the reference standard Ki67 values of Spectrum Webscope (QuPath-Spectrum Webscope ICC: 0.970, CI: 0.936-0.986; HALO-Spectrum Webscope ICC: 0.968, CI: 0.933-0.985; QuantCenter-Spectrum Webscope ICC: 0.964, CI: 0.919-0.983). All platforms showed excellent intra-DIA reproducibility (QuPath ICC: 0.992, CI: 0.986-0.996; HALO ICC: 0.972, CI: 0.924-0.988; QuantCenter ICC: 0.978, CI: 0.932-0.991). Comparing each DIA against outcome, the hazard ratios were similar. The inter-operator reproducibility was particularly high (ICC: 0.962-0.995). Our results showed outstanding reproducibility both within and between-DIA platforms, including one freely available DIA platform (QuPath). We also found the platforms essentially indistinguishable with respect to prediction of breast cancer patient outcome. Results justify multi-institutional DIA studies to assess clinical utility.
    40 schema:genre research_article
    41 schema:inLanguage en
    42 schema:isAccessibleForFree false
    43 schema:isPartOf sg:journal.1017964
    44 schema:name Ki67 reproducibility using digital image analysis: an inter-platform and inter-operator study
    45 schema:pagination 1-11
    46 schema:productId N0a8fa90b3b5345a1bf058218656a6357
    47 N1789baff90a049eab24ffdb3faf1221a
    48 N250a2926cc4245999b5e1666638fa9b8
    49 N75db5c8adcbe416c96c594fe3bc7f6d2
    50 Nc2ef17fe918d44aca8b30948072378fb
    51 schema:sameAs https://app.dimensions.ai/details/publication/pub.1106644705
    52 https://doi.org/10.1038/s41374-018-0123-7
    53 schema:sdDatePublished 2019-04-10T19:17
    54 schema:sdLicense https://scigraph.springernature.com/explorer/license/
    55 schema:sdPublisher N3606ea7d313d454f94f221fdfcb6c1b6
    56 schema:url https://www.nature.com/articles/s41374-018-0123-7
    57 sgo:license sg:explorer/license/
    58 sgo:sdDataset articles
    59 rdf:type schema:ScholarlyArticle
    60 N0557e2d7a70e4bd28d30e98bc5f74f11 rdf:first sg:person.01120223114.98
    61 rdf:rest Nc6c07d4154254ceb939ef4979f1f19b7
    62 N070a5b1457cd4ff7b1a19c391609caf9 rdf:first sg:person.0617136146.33
    63 rdf:rest N1a6c8d36d264452b86271f1f523aac3e
    64 N0a8fa90b3b5345a1bf058218656a6357 schema:name readcube_id
    65 schema:value aa90f780a24672817bf84ce8c2026e1317e65f60dd43a58ecda0a10e77d699a7
    66 rdf:type schema:PropertyValue
    67 N1789baff90a049eab24ffdb3faf1221a schema:name doi
    68 schema:value 10.1038/s41374-018-0123-7
    69 rdf:type schema:PropertyValue
    70 N1a6c8d36d264452b86271f1f523aac3e rdf:first sg:person.0754207153.13
    71 rdf:rest rdf:nil
    72 N1e974f5ad06f4706aa3fa565e16e3c5d rdf:first sg:person.010167507274.29
    73 rdf:rest N6eb4c5820b6c47cf9accf808762a2a0f
    74 N250a2926cc4245999b5e1666638fa9b8 schema:name nlm_unique_id
    75 schema:value 0376617
    76 rdf:type schema:PropertyValue
    77 N3606ea7d313d454f94f221fdfcb6c1b6 schema:name Springer Nature - SN SciGraph project
    78 rdf:type schema:Organization
    79 N6eb4c5820b6c47cf9accf808762a2a0f rdf:first sg:person.0670132035.19
    80 rdf:rest Nb3f7a9d9a031469883b7d6744a8cd4b6
    81 N75db5c8adcbe416c96c594fe3bc7f6d2 schema:name dimensions_id
    82 schema:value pub.1106644705
    83 rdf:type schema:PropertyValue
    84 N7ff65f1f7f3a41d8811ff2fa00bd0481 rdf:first sg:person.01120302235.50
    85 rdf:rest N070a5b1457cd4ff7b1a19c391609caf9
    86 Nb3f7a9d9a031469883b7d6744a8cd4b6 rdf:first sg:person.01117274053.25
    87 rdf:rest N0557e2d7a70e4bd28d30e98bc5f74f11
    88 Nc2ef17fe918d44aca8b30948072378fb schema:name pubmed_id
    89 schema:value 30181553
    90 rdf:type schema:PropertyValue
    91 Nc6c07d4154254ceb939ef4979f1f19b7 rdf:first sg:person.011532335565.35
    92 rdf:rest N7ff65f1f7f3a41d8811ff2fa00bd0481
    93 anzsrc-for:11 schema:inDefinedTermSet anzsrc-for:
    94 schema:name Medical and Health Sciences
    95 rdf:type schema:DefinedTerm
    96 anzsrc-for:1112 schema:inDefinedTermSet anzsrc-for:
    97 schema:name Oncology and Carcinogenesis
    98 rdf:type schema:DefinedTerm
    99 sg:journal.1017964 schema:issn 0023-6837
    100 1530-0307
    101 schema:name Laboratory Investigation
    102 rdf:type schema:Periodical
    103 sg:person.010167507274.29 schema:affiliation https://www.grid.ac/institutes/grid.47100.32
    104 schema:familyName Acs
    105 schema:givenName Balazs
    106 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010167507274.29
    107 rdf:type schema:Person
    108 sg:person.01117274053.25 schema:affiliation https://www.grid.ac/institutes/grid.47100.32
    109 schema:familyName Bai
    110 schema:givenName Yalai
    111 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.01117274053.25
    112 rdf:type schema:Person
    113 sg:person.01120223114.98 schema:affiliation https://www.grid.ac/institutes/grid.47100.32
    114 schema:familyName Martinez-Morilla
    115 schema:givenName Sandra
    116 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.01120223114.98
    117 rdf:type schema:Person
    118 sg:person.01120302235.50 schema:affiliation https://www.grid.ac/institutes/grid.17091.3e
    119 schema:familyName Leung
    120 schema:givenName Samuel C. Y.
    121 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.01120302235.50
    122 rdf:type schema:Person
    123 sg:person.011532335565.35 schema:affiliation https://www.grid.ac/institutes/grid.47100.32
    124 schema:familyName Toki
    125 schema:givenName Maria
    126 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.011532335565.35
    127 rdf:type schema:Person
    128 sg:person.0617136146.33 schema:affiliation https://www.grid.ac/institutes/grid.17091.3e
    129 schema:familyName Nielsen
    130 schema:givenName Torsten O.
    131 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.0617136146.33
    132 rdf:type schema:Person
    133 sg:person.0670132035.19 schema:affiliation https://www.grid.ac/institutes/grid.417555.7
    134 schema:familyName Pelekanou
    135 schema:givenName Vasiliki
    136 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.0670132035.19
    137 rdf:type schema:Person
    138 sg:person.0754207153.13 schema:affiliation https://www.grid.ac/institutes/grid.47100.32
    139 schema:familyName Rimm
    140 schema:givenName David L.
    141 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.0754207153.13
    142 rdf:type schema:Person
    143 sg:pub.10.1007/s10549-016-3852-6 schema:sameAs https://app.dimensions.ai/details/publication/pub.1048798250
    144 https://doi.org/10.1007/s10549-016-3852-6
    145 rdf:type schema:CreativeWork
    146 sg:pub.10.1007/s10549-018-4669-2 schema:sameAs https://app.dimensions.ai/details/publication/pub.1100468053
    147 https://doi.org/10.1007/s10549-018-4669-2
    148 rdf:type schema:CreativeWork
    149 sg:pub.10.1007/s12253-017-0220-8 schema:sameAs https://app.dimensions.ai/details/publication/pub.1084741139
    150 https://doi.org/10.1007/s12253-017-0220-8
    151 rdf:type schema:CreativeWork
    152 sg:pub.10.1023/a:1010933404324 schema:sameAs https://app.dimensions.ai/details/publication/pub.1024739340
    153 https://doi.org/10.1023/a:1010933404324
    154 rdf:type schema:CreativeWork
    155 sg:pub.10.1038/labinvest.2013.128 schema:sameAs https://app.dimensions.ai/details/publication/pub.1027726525
    156 https://doi.org/10.1038/labinvest.2013.128
    157 rdf:type schema:CreativeWork
    158 sg:pub.10.1038/modpathol.2015.38 schema:sameAs https://app.dimensions.ai/details/publication/pub.1001793556
    159 https://doi.org/10.1038/modpathol.2015.38
    160 rdf:type schema:CreativeWork
    161 sg:pub.10.1038/modpathol.2016.34 schema:sameAs https://app.dimensions.ai/details/publication/pub.1036028479
    162 https://doi.org/10.1038/modpathol.2016.34
    163 rdf:type schema:CreativeWork
    164 sg:pub.10.1038/nmeth.1472 schema:sameAs https://app.dimensions.ai/details/publication/pub.1037563696
    165 https://doi.org/10.1038/nmeth.1472
    166 rdf:type schema:CreativeWork
    167 sg:pub.10.1038/npjbcancer.2016.14 schema:sameAs https://app.dimensions.ai/details/publication/pub.1010212957
    168 https://doi.org/10.1038/npjbcancer.2016.14
    169 rdf:type schema:CreativeWork
    170 sg:pub.10.1038/s41598-017-17204-5 schema:sameAs https://app.dimensions.ai/details/publication/pub.1093066740
    171 https://doi.org/10.1038/s41598-017-17204-5
    172 rdf:type schema:CreativeWork
    173 sg:pub.10.1186/1746-1596-6-s1-s9 schema:sameAs https://app.dimensions.ai/details/publication/pub.1007787125
    174 https://doi.org/10.1186/1746-1596-6-s1-s9
    175 rdf:type schema:CreativeWork
    176 sg:pub.10.1186/bcr3639 schema:sameAs https://app.dimensions.ai/details/publication/pub.1027024600
    177 https://doi.org/10.1186/bcr3639
    178 rdf:type schema:CreativeWork
    179 sg:pub.10.1186/s13000-017-0608-5 schema:sameAs https://app.dimensions.ai/details/publication/pub.1083854047
    180 https://doi.org/10.1186/s13000-017-0608-5
    181 rdf:type schema:CreativeWork
    182 https://app.dimensions.ai/details/publication/pub.1074873071 schema:CreativeWork
    183 https://doi.org/10.1002/cyto.a.23124 schema:sameAs https://app.dimensions.ai/details/publication/pub.1085138788
    184 rdf:type schema:CreativeWork
    185 https://doi.org/10.1002/path.1711680404 schema:sameAs https://app.dimensions.ai/details/publication/pub.1051457357
    186 rdf:type schema:CreativeWork
    187 https://doi.org/10.1016/j.breast.2008.02.002 schema:sameAs https://app.dimensions.ai/details/publication/pub.1032864891
    188 rdf:type schema:CreativeWork
    189 https://doi.org/10.1016/j.breast.2013.11.007 schema:sameAs https://app.dimensions.ai/details/publication/pub.1013328584
    190 rdf:type schema:CreativeWork
    191 https://doi.org/10.1080/21681163.2014.885120 schema:sameAs https://app.dimensions.ai/details/publication/pub.1009308221
    192 rdf:type schema:CreativeWork
    193 https://doi.org/10.1093/annonc/mdv298 schema:sameAs https://app.dimensions.ai/details/publication/pub.1022951845
    194 rdf:type schema:CreativeWork
    195 https://doi.org/10.1093/annonc/mdx016 schema:sameAs https://app.dimensions.ai/details/publication/pub.1085371691
    196 rdf:type schema:CreativeWork
    197 https://doi.org/10.1093/jnci/djr393 schema:sameAs https://app.dimensions.ai/details/publication/pub.1024075504
    198 rdf:type schema:CreativeWork
    199 https://doi.org/10.1093/jnci/djs438 schema:sameAs https://app.dimensions.ai/details/publication/pub.1016226448
    200 rdf:type schema:CreativeWork
    201 https://doi.org/10.1093/jnci/djt306 schema:sameAs https://app.dimensions.ai/details/publication/pub.1007448888
    202 rdf:type schema:CreativeWork
    203 https://doi.org/10.1109/34.745739 schema:sameAs https://app.dimensions.ai/details/publication/pub.1061156908
    204 rdf:type schema:CreativeWork
    205 https://doi.org/10.1111/his.12795 schema:sameAs https://app.dimensions.ai/details/publication/pub.1031281639
    206 rdf:type schema:CreativeWork
    207 https://doi.org/10.1111/his.13452 schema:sameAs https://app.dimensions.ai/details/publication/pub.1099627353
    208 rdf:type schema:CreativeWork
    209 https://doi.org/10.1158/1078-0432.ccr-14-1283 schema:sameAs https://app.dimensions.ai/details/publication/pub.1045571310
    210 rdf:type schema:CreativeWork
    211 https://doi.org/10.1200/jco.2015.65.2289 schema:sameAs https://app.dimensions.ai/details/publication/pub.1045222004
    212 rdf:type schema:CreativeWork
    213 https://doi.org/10.1371/journal.pone.0094137 schema:sameAs https://app.dimensions.ai/details/publication/pub.1023385375
    214 rdf:type schema:CreativeWork
    215 https://doi.org/10.1371/journal.pone.0150505 schema:sameAs https://app.dimensions.ai/details/publication/pub.1026981914
    216 rdf:type schema:CreativeWork
    217 https://doi.org/10.2144/000113382 schema:sameAs https://app.dimensions.ai/details/publication/pub.1038561153
    218 rdf:type schema:CreativeWork
    219 https://doi.org/10.2307/2529310 schema:sameAs https://app.dimensions.ai/details/publication/pub.1069974986
    220 rdf:type schema:CreativeWork
    221 https://www.grid.ac/institutes/grid.17091.3e schema:alternateName University of British Columbia
    222 schema:name Department of Pathology and Laboratory Medicine, University of British Columbia, Vancouver, BC, Canada
    223 rdf:type schema:Organization
    224 https://www.grid.ac/institutes/grid.417555.7 schema:alternateName Sanofi (United States)
    225 schema:name Department of Pathology, Yale School of Medicine, New Haven, CT, USA
    226 Precision Oncology, Sanofi US Services Inc, Cambridge, MA, USA
    227 rdf:type schema:Organization
    228 https://www.grid.ac/institutes/grid.47100.32 schema:alternateName Yale University
    229 schema:name Department of Pathology, Yale School of Medicine, New Haven, CT, USA
    230 rdf:type schema:Organization
     




    Preview window. Press ESC to close (or click here)


    ...