Ontology type: schema:ScholarlyArticle
2017-11-06
AUTHORSAmin Madani, Jordan Gornitsky, Yusuke Watanabe, Cassandre Benay, Maria S. Altieri, Philip H. Pucher, Roger Tabah, Elliot J. Mitmaker
ABSTRACTBackgroundErrors in judgment during thyroidectomy can lead to recurrent laryngeal nerve injury and other complications. Despite the strong link between patient outcomes and intraoperative decision-making, methods to evaluate these complex skills are lacking. The purpose of this study was to develop objective metrics to evaluate advanced cognitive skills during thyroidectomy and to obtain validity evidence for them.MethodsAn interactive online learning platform was developed (www.thinklikeasurgeon.com). Trainees and surgeons from four institutions completed a 33-item assessment, developed based on a cognitive task analysis and expert Delphi consensus. Sixteen items required subjects to make annotations on still frames of thyroidectomy videos, and accuracy scores were calculated based on an algorithm derived from experts’ responses (“visual concordance test,” VCT). Seven items were short answer (SA), requiring users to type their answers, and scores were automatically calculated based on their similarity to a pre-populated repertoire of correct responses. Test–retest reliability, internal consistency, and correlation of scores with self-reported experience and training level (novice, intermediate, expert) were calculated.ResultsTwenty-eight subjects (10 endocrine surgeons and otolaryngologists, 18 trainees) participated. There was high test–retest reliability (intraclass correlation coefficient = 0.96; n = 10) and internal consistency (Cronbach’s α = 0.93). The assessment demonstrated significant differences between novices, intermediates, and experts in total score (p < 0.01), VCT score (p < 0.01) and SA score (p < 0.01). There was high correlation between total case number and total score (ρ = 0.95, p < 0.01), between total case number and VCT score (ρ = 0.93, p < 0.01), and between total case number and SA score (ρ = 0.83, p < 0.01).ConclusionThis study describes the development of novel metrics and provides validity evidence for an interactive Web-based platform to objectively assess decision-making during thyroidectomy. More... »
PAGES376-383
http://scigraph.springernature.com/pub.10.1007/s00268-017-4322-y
DOIhttp://dx.doi.org/10.1007/s00268-017-4322-y
DIMENSIONShttps://app.dimensions.ai/details/publication/pub.1092556303
PUBMEDhttps://www.ncbi.nlm.nih.gov/pubmed/29110159
JSON-LD is the canonical representation for SciGraph data.
TIP: You can open this SciGraph record using an external JSON-LD service: JSON-LD Playground Google SDTT
[
{
"@context": "https://springernature.github.io/scigraph/jsonld/sgcontext.json",
"about": [
{
"id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/11",
"inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/",
"name": "Medical and Health Sciences",
"type": "DefinedTerm"
},
{
"id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/1103",
"inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/",
"name": "Clinical Sciences",
"type": "DefinedTerm"
},
{
"inDefinedTermSet": "https://www.nlm.nih.gov/mesh/",
"name": "Adult",
"type": "DefinedTerm"
},
{
"inDefinedTermSet": "https://www.nlm.nih.gov/mesh/",
"name": "Clinical Competence",
"type": "DefinedTerm"
},
{
"inDefinedTermSet": "https://www.nlm.nih.gov/mesh/",
"name": "Decision Making",
"type": "DefinedTerm"
},
{
"inDefinedTermSet": "https://www.nlm.nih.gov/mesh/",
"name": "Decision Making, Computer-Assisted",
"type": "DefinedTerm"
},
{
"inDefinedTermSet": "https://www.nlm.nih.gov/mesh/",
"name": "Decision Support Techniques",
"type": "DefinedTerm"
},
{
"inDefinedTermSet": "https://www.nlm.nih.gov/mesh/",
"name": "Female",
"type": "DefinedTerm"
},
{
"inDefinedTermSet": "https://www.nlm.nih.gov/mesh/",
"name": "Humans",
"type": "DefinedTerm"
},
{
"inDefinedTermSet": "https://www.nlm.nih.gov/mesh/",
"name": "Internet",
"type": "DefinedTerm"
},
{
"inDefinedTermSet": "https://www.nlm.nih.gov/mesh/",
"name": "Male",
"type": "DefinedTerm"
},
{
"inDefinedTermSet": "https://www.nlm.nih.gov/mesh/",
"name": "Medical Errors",
"type": "DefinedTerm"
},
{
"inDefinedTermSet": "https://www.nlm.nih.gov/mesh/",
"name": "Middle Aged",
"type": "DefinedTerm"
},
{
"inDefinedTermSet": "https://www.nlm.nih.gov/mesh/",
"name": "Reproducibility of Results",
"type": "DefinedTerm"
},
{
"inDefinedTermSet": "https://www.nlm.nih.gov/mesh/",
"name": "Statistics, Nonparametric",
"type": "DefinedTerm"
},
{
"inDefinedTermSet": "https://www.nlm.nih.gov/mesh/",
"name": "Surgeons",
"type": "DefinedTerm"
},
{
"inDefinedTermSet": "https://www.nlm.nih.gov/mesh/",
"name": "Thyroidectomy",
"type": "DefinedTerm"
}
],
"author": [
{
"affiliation": {
"alternateName": "Department of Surgery, McGill University Health Centre, 1650 Cedar Avenue, Rm D6-257, H3G 1A4, Montreal, QC, Canada",
"id": "http://www.grid.ac/institutes/grid.63984.30",
"name": [
"Department of Surgery, McGill University Health Centre, 1650 Cedar Avenue, Rm D6-257, H3G 1A4, Montreal, QC, Canada"
],
"type": "Organization"
},
"familyName": "Madani",
"givenName": "Amin",
"id": "sg:person.01305612377.03",
"sameAs": [
"https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.01305612377.03"
],
"type": "Person"
},
{
"affiliation": {
"alternateName": "Department of Surgery, McGill University Health Centre, 1650 Cedar Avenue, Rm D6-257, H3G 1A4, Montreal, QC, Canada",
"id": "http://www.grid.ac/institutes/grid.63984.30",
"name": [
"Department of Surgery, McGill University Health Centre, 1650 Cedar Avenue, Rm D6-257, H3G 1A4, Montreal, QC, Canada"
],
"type": "Organization"
},
"familyName": "Gornitsky",
"givenName": "Jordan",
"id": "sg:person.015074024071.97",
"sameAs": [
"https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.015074024071.97"
],
"type": "Person"
},
{
"affiliation": {
"alternateName": "Department of Gastroenterological Surgery II, Hokkaido University, Sapporo, Japan",
"id": "http://www.grid.ac/institutes/grid.39158.36",
"name": [
"Department of Gastroenterological Surgery II, Hokkaido University, Sapporo, Japan"
],
"type": "Organization"
},
"familyName": "Watanabe",
"givenName": "Yusuke",
"id": "sg:person.0643337710.18",
"sameAs": [
"https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.0643337710.18"
],
"type": "Person"
},
{
"affiliation": {
"alternateName": "Department of Surgery, McGill University Health Centre, 1650 Cedar Avenue, Rm D6-257, H3G 1A4, Montreal, QC, Canada",
"id": "http://www.grid.ac/institutes/grid.63984.30",
"name": [
"Department of Surgery, McGill University Health Centre, 1650 Cedar Avenue, Rm D6-257, H3G 1A4, Montreal, QC, Canada"
],
"type": "Organization"
},
"familyName": "Benay",
"givenName": "Cassandre",
"id": "sg:person.01230225245.99",
"sameAs": [
"https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.01230225245.99"
],
"type": "Person"
},
{
"affiliation": {
"alternateName": "Department of Surgery, Stony Brook University Medical Center, Stony Brook, NY, USA",
"id": "http://www.grid.ac/institutes/grid.412695.d",
"name": [
"Department of Surgery, Stony Brook University Medical Center, Stony Brook, NY, USA"
],
"type": "Organization"
},
"familyName": "Altieri",
"givenName": "Maria S.",
"id": "sg:person.01210572152.29",
"sameAs": [
"https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.01210572152.29"
],
"type": "Person"
},
{
"affiliation": {
"alternateName": "Department of Surgery and Cancer, Imperial College London, London, UK",
"id": "http://www.grid.ac/institutes/grid.7445.2",
"name": [
"Department of Surgery and Cancer, Imperial College London, London, UK"
],
"type": "Organization"
},
"familyName": "Pucher",
"givenName": "Philip H.",
"id": "sg:person.01106731015.13",
"sameAs": [
"https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.01106731015.13"
],
"type": "Person"
},
{
"affiliation": {
"alternateName": "Department of Surgery, McGill University Health Centre, 1650 Cedar Avenue, Rm D6-257, H3G 1A4, Montreal, QC, Canada",
"id": "http://www.grid.ac/institutes/grid.63984.30",
"name": [
"Department of Surgery, McGill University Health Centre, 1650 Cedar Avenue, Rm D6-257, H3G 1A4, Montreal, QC, Canada"
],
"type": "Organization"
},
"familyName": "Tabah",
"givenName": "Roger",
"id": "sg:person.0655270466.87",
"sameAs": [
"https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.0655270466.87"
],
"type": "Person"
},
{
"affiliation": {
"alternateName": "Department of Surgery, McGill University Health Centre, 1650 Cedar Avenue, Rm D6-257, H3G 1A4, Montreal, QC, Canada",
"id": "http://www.grid.ac/institutes/grid.63984.30",
"name": [
"Department of Surgery, McGill University Health Centre, 1650 Cedar Avenue, Rm D6-257, H3G 1A4, Montreal, QC, Canada"
],
"type": "Organization"
},
"familyName": "Mitmaker",
"givenName": "Elliot J.",
"id": "sg:person.01022504663.32",
"sameAs": [
"https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.01022504663.32"
],
"type": "Person"
}
],
"citation": [
{
"id": "sg:pub.10.1007/s00464-016-5091-7",
"sameAs": [
"https://app.dimensions.ai/details/publication/pub.1008440826",
"https://doi.org/10.1007/s00464-016-5091-7"
],
"type": "CreativeWork"
},
{
"id": "sg:pub.10.1007/s00268-005-0355-8",
"sameAs": [
"https://app.dimensions.ai/details/publication/pub.1034667309",
"https://doi.org/10.1007/s00268-005-0355-8"
],
"type": "CreativeWork"
}
],
"datePublished": "2017-11-06",
"datePublishedReg": "2017-11-06",
"description": "BackgroundErrors in judgment during thyroidectomy can lead to recurrent laryngeal nerve injury and other complications. Despite the strong link between patient outcomes and intraoperative decision-making, methods to evaluate these complex skills are lacking. The purpose of this study was to develop objective metrics to evaluate advanced cognitive skills during thyroidectomy and to obtain validity evidence for them.MethodsAn interactive online learning platform was developed (www.thinklikeasurgeon.com). Trainees and surgeons from four institutions completed a 33-item assessment, developed based on a cognitive task analysis and expert Delphi consensus. Sixteen items required subjects to make annotations on still frames of thyroidectomy videos, and accuracy scores were calculated based on an algorithm derived from experts\u2019 responses (\u201cvisual concordance test,\u201d VCT). Seven items were short answer (SA), requiring users to type their answers, and scores were automatically calculated based on their similarity to a pre-populated repertoire of correct responses. Test\u2013retest reliability, internal consistency, and correlation of scores with self-reported experience and training level (novice, intermediate, expert) were calculated.ResultsTwenty-eight subjects (10 endocrine surgeons and otolaryngologists, 18 trainees) participated. There was high test\u2013retest reliability (intraclass correlation coefficient\u00a0=\u00a00.96; n\u00a0=\u00a010) and internal consistency (Cronbach\u2019s \u03b1\u00a0=\u00a00.93). The assessment demonstrated significant differences between novices, intermediates, and experts in total score (p\u00a0<\u00a00.01), VCT score (p\u00a0<\u00a00.01) and SA score (p\u00a0<\u00a00.01). There was high correlation between total case number and total score (\u03c1\u00a0=\u00a00.95, p\u00a0<\u00a00.01), between total case number and VCT score (\u03c1\u00a0=\u00a00.93, p\u00a0<\u00a00.01), and between total case number and SA score (\u03c1\u00a0=\u00a00.83, p\u00a0<\u00a00.01).ConclusionThis study describes the development of novel metrics and provides validity evidence for an interactive Web-based platform to objectively assess decision-making during thyroidectomy.",
"genre": "article",
"id": "sg:pub.10.1007/s00268-017-4322-y",
"isAccessibleForFree": false,
"isPartOf": [
{
"id": "sg:journal.1086446",
"issn": [
"0364-2313",
"1432-2323"
],
"name": "World Journal of Surgery",
"publisher": "Springer Nature",
"type": "Periodical"
},
{
"issueNumber": "2",
"type": "PublicationIssue"
},
{
"type": "PublicationVolume",
"volumeNumber": "42"
}
],
"keywords": [
"validity evidence",
"test-retest reliability",
"SA scores",
"cognitive task analysis",
"advanced cognitive skills",
"internal consistency",
"high test-retest reliability",
"self-reported experiences",
"correlation of scores",
"cognitive skills",
"total score",
"complex skills",
"correct responses",
"task analysis",
"accuracy scores",
"expert Delphi consensus",
"ResultsTwenty-eight subjects",
"short answer",
"skills",
"objective metrics",
"training level",
"strong link",
"online learning platforms",
"items",
"scores",
"assessment tool",
"interactive web-based platform",
"judgments",
"learning platform",
"consistency",
"novices",
"evidence",
"total case numbers",
"trainees",
"subjects",
"answers",
"experience",
"web-based platform",
"experts",
"assessment",
"high correlation",
"video",
"web-based assessment tool",
"reliability",
"link",
"novel metric",
"significant differences",
"study",
"outcomes",
"response",
"differences",
"repertoire",
"similarity",
"correlation",
"purpose",
"users",
"ConclusionThis study",
"metrics",
"development",
"consensus",
"levels",
"annotation",
"frame",
"number",
"tool",
"analysis",
"injury",
"patient outcomes",
"institutions",
"platform",
"method",
"case numbers",
"recurrent laryngeal nerve injury",
"laryngeal nerve injury",
"algorithm",
"nerve injury",
"Delphi consensus",
"thyroidectomy",
"complications",
"surgeons",
"intermediates"
],
"name": "Measuring Decision-Making During Thyroidectomy: Validity Evidence for a Web-Based Assessment Tool",
"pagination": "376-383",
"productId": [
{
"name": "dimensions_id",
"type": "PropertyValue",
"value": [
"pub.1092556303"
]
},
{
"name": "doi",
"type": "PropertyValue",
"value": [
"10.1007/s00268-017-4322-y"
]
},
{
"name": "pubmed_id",
"type": "PropertyValue",
"value": [
"29110159"
]
}
],
"sameAs": [
"https://doi.org/10.1007/s00268-017-4322-y",
"https://app.dimensions.ai/details/publication/pub.1092556303"
],
"sdDataset": "articles",
"sdDatePublished": "2022-08-04T17:06",
"sdLicense": "https://scigraph.springernature.com/explorer/license/",
"sdPublisher": {
"name": "Springer Nature - SN SciGraph project",
"type": "Organization"
},
"sdSource": "s3://com-springernature-scigraph/baseset/20220804/entities/gbq_results/article/article_736.jsonl",
"type": "ScholarlyArticle",
"url": "https://doi.org/10.1007/s00268-017-4322-y"
}
]Download the RDF metadata as: json-ld nt turtle xml License info
JSON-LD is a popular format for linked data which is fully compatible with JSON.
curl -H 'Accept: application/ld+json' 'https://scigraph.springernature.com/pub.10.1007/s00268-017-4322-y'
N-Triples is a line-based linked data format ideal for batch operations.
curl -H 'Accept: application/n-triples' 'https://scigraph.springernature.com/pub.10.1007/s00268-017-4322-y'
Turtle is a human-readable linked data format.
curl -H 'Accept: text/turtle' 'https://scigraph.springernature.com/pub.10.1007/s00268-017-4322-y'
RDF/XML is a standard XML format for linked data.
curl -H 'Accept: application/rdf+xml' 'https://scigraph.springernature.com/pub.10.1007/s00268-017-4322-y'
This table displays all metadata directly associated to this object as RDF triples.
268 TRIPLES
21 PREDICATES
123 URIs
113 LITERALS
22 BLANK NODES