From opening the ‘black box’ to looking behind the curtain: cognition and context in assessor-based judgements View Full Text


Ontology type: schema:ScholarlyArticle     


Article Info

DATE

2019-03

AUTHORS

Victor Lee, Keira Brain, Jenepher Martin

ABSTRACT

The increasing use of direct observation tools to assess routine performance has resulted in the growing reliance on assessor-based judgements in the workplace. However, we have a limited understanding of how assessors make judgements and formulate ratings in real world contexts. The current research on assessor cognition has largely focused on the cognitive domain but the contextual factors are equally important, and both are closely interconnected. This study aimed to explore the perceived cognitive and contextual factors influencing Mini-CEX assessor judgements in the Emergency Department setting. We used a conceptual framework of assessor-based judgement to develop a sequential mixed methods study. We analysed and integrated survey and focus group results to illustrate self-reported cognitive and contextual factors influencing assessor judgements. We used situated cognition theory as a sensitizing lens to explore the interactions between people and their environment. The major factors highlighted through our mixed methods study were: clarity of the assessment, reliance on and variable approach to overall impression (gestalt), role tension especially when giving constructive feedback, prior knowledge of the trainee and case complexity. We identified prevailing tensions between participants (assessors and trainees), interactions (assessment and feedback) and setting. The two practical implications of our research are the need to broaden assessor training to incorporate both cognitive and contextual domains, and the need to develop a more holistic understanding of assessor-based judgements in real world contexts to better inform future research and development in workplace-based assessments. More... »

PAGES

1-18

References to SciGraph publications

  • 2007-05. Broadening Perspectives on Clinical Performance Assessment: Rethinking the Nature of In-training Assessment in ADVANCES IN HEALTH SCIENCES EDUCATION
  • 2013-05. Exploring the impact of mental workload on rater-based assessments in ADVANCES IN HEALTH SCIENCES EDUCATION
  • 2013-10. Expertise in performance assessment: assessors’ perspectives in ADVANCES IN HEALTH SCIENCES EDUCATION
  • 2013-08. Mental workload as a tool for understanding dual processes in rater-based assessments in ADVANCES IN HEALTH SCIENCES EDUCATION
  • 2017-10. Self-entrustment: how trainees’ self-regulated learning supports participation in the workplace in ADVANCES IN HEALTH SCIENCES EDUCATION
  • 2015-12. The influence of students’ prior clinical skills and context characteristics on mini-CEX scores in clerkships – a multilevel analysis in BMC MEDICAL EDUCATION
  • 2013-08. Workplace-based assessment: raters’ performance theories and constructs in ADVANCES IN HEALTH SCIENCES EDUCATION
  • 2011-05. Workplace-based assessment: effects of rater expertise in ADVANCES IN HEALTH SCIENCES EDUCATION
  • 2014-08. Exploring the role of first impressions in rater-based assessments in ADVANCES IN HEALTH SCIENCES EDUCATION
  • 2012-03. The impact of selected contextual factors on experts’ clinical reasoning performance (does context impact clinical reasoning performance in experts?) in ADVANCES IN HEALTH SCIENCES EDUCATION
  • 2009-01. Effect of Rater Training on Reliability and Accuracy of Mini-CEX Scores: A Randomized, Controlled Trial in JOURNAL OF GENERAL INTERNAL MEDICINE
  • 2013-08. Seeing the same thing differently in ADVANCES IN HEALTH SCIENCES EDUCATION
  • Identifiers

    URI

    http://scigraph.springernature.com/pub.10.1007/s10459-018-9851-0

    DOI

    http://dx.doi.org/10.1007/s10459-018-9851-0

    DIMENSIONS

    https://app.dimensions.ai/details/publication/pub.1107493406

    PUBMED

    https://www.ncbi.nlm.nih.gov/pubmed/30302670


    Indexing Status Check whether this publication has been indexed by Scopus and Web Of Science using the SN Indexing Status Tool
    Incoming Citations Browse incoming citations for this publication using opencitations.net

    JSON-LD is the canonical representation for SciGraph data.

    TIP: You can open this SciGraph record using an external JSON-LD service: JSON-LD Playground Google SDTT

    [
      {
        "@context": "https://springernature.github.io/scigraph/jsonld/sgcontext.json", 
        "about": [
          {
            "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/1701", 
            "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
            "name": "Psychology", 
            "type": "DefinedTerm"
          }, 
          {
            "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/17", 
            "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
            "name": "Psychology and Cognitive Sciences", 
            "type": "DefinedTerm"
          }
        ], 
        "author": [
          {
            "affiliation": {
              "alternateName": "Austin Health", 
              "id": "https://www.grid.ac/institutes/grid.410678.c", 
              "name": [
                "Department of Emergency Medicine, Austin Health, P.O. Box 5555, 3084, Heidelberg, VIC, Australia"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Lee", 
            "givenName": "Victor", 
            "id": "sg:person.014704015645.38", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.014704015645.38"
            ], 
            "type": "Person"
          }, 
          {
            "affiliation": {
              "alternateName": "Western Hospital", 
              "id": "https://www.grid.ac/institutes/grid.417075.0", 
              "name": [
                "Western Hospital, Footscray, VIC, Australia"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Brain", 
            "givenName": "Keira", 
            "id": "sg:person.015501376245.96", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.015501376245.96"
            ], 
            "type": "Person"
          }, 
          {
            "affiliation": {
              "alternateName": "Deakin University", 
              "id": "https://www.grid.ac/institutes/grid.1021.2", 
              "name": [
                "Eastern Health Clinical School, Monash University and Deakin University, Box Hill, VIC, Australia"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Martin", 
            "givenName": "Jenepher", 
            "id": "sg:person.016276756645.68", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.016276756645.68"
            ], 
            "type": "Person"
          }
        ], 
        "citation": [
          {
            "id": "https://doi.org/10.3109/0142159x.2013.798403", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1001252663"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/s11606-008-0842-3", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1001398701", 
              "https://doi.org/10.1007/s11606-008-0842-3"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.3109/0142159x.2014.917165", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1001404029"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1186/s12909-015-0490-3", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1004586929", 
              "https://doi.org/10.1186/s12909-015-0490-3"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.3109/0142159x.2011.550965", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1005184642"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1097/acm.0b013e3181d7427c", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1005387966"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1097/acm.0b013e3181d7427c", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1005387966"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1097/acm.0b013e3181d7427c", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1005387966"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/s10459-010-9250-7", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1007103035", 
              "https://doi.org/10.1007/s10459-010-9250-7"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1111/medu.12254", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1007650158"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1111/medu.12733", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1008076219"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.3102/0013189x018001032", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1010595714"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.3102/0013189x018001032", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1010595714"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1111/j.1365-2923.2011.04025.x", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1012470358"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1097/acm.0b013e3181d73fb6", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1012814232"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1097/acm.0b013e3181d73fb6", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1012814232"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1097/acm.0b013e3181d73fb6", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1012814232"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1111/j.1365-2923.2008.03275.x", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1013009727"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1111/j.1365-2923.2008.03275.x", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1013009727"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/s10459-012-9376-x", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1015882010", 
              "https://doi.org/10.1007/s10459-012-9376-x"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/s10459-012-9370-3", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1016125492", 
              "https://doi.org/10.1007/s10459-012-9370-3"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/s10459-012-9370-3", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1016125492", 
              "https://doi.org/10.1007/s10459-012-9370-3"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1111/j.1365-2923.2009.03386.x", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1017891516"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1111/j.1365-2923.2009.03386.x", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1017891516"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/s10459-011-9294-3", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1018353271", 
              "https://doi.org/10.1007/s10459-011-9294-3"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1097/acm.0b013e31822a6cf8", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1018396617"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1097/acm.0b013e31822a6cf8", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1018396617"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/s10459-006-9043-1", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1018553586", 
              "https://doi.org/10.1007/s10459-006-9043-1"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/s10459-006-9043-1", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1018553586", 
              "https://doi.org/10.1007/s10459-006-9043-1"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.3109/0142159x.2011.565828", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1022567449"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1111/j.1365-2923.2012.04266.x", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1024485126"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1046/j.1365-2923.2002.01140.x", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1026567540"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1111/j.1365-2923.2011.04053.x", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1027403235"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1207/s15328015tlm1504_11", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1028087504"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.3109/0142159x.2011.611022", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1029584272"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1097/acm.0000000000000486", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1029965137"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1097/acm.0000000000000486", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1029965137"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.3109/0142159x.2013.759645", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1030228531"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1046/j.1365-2923.2004.01799.x", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1031246819"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1111/medu.12777", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1034236197"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1111/medu.12546", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1034269735"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1111/j.1365-2923.2011.04137.x", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1034836465"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1111/medu.12973", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1035786347"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1080/00461520.2016.1207538", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1035960466"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1207/s15326985ep2901_3", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1036646530"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1207/s15326985ep2901_3", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1036646530"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1207/s15326985ep2901_3", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1036646530"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.3109/0142159x.2013.788789", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1039353763"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/s10459-013-9453-9", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1040879042", 
              "https://doi.org/10.1007/s10459-013-9453-9"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/s10459-012-9396-6", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1041105371", 
              "https://doi.org/10.1007/s10459-012-9396-6"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1097/acm.0000000000000221", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1044226992"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1097/acm.0000000000000221", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1044226992"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1212/wnl.0b013e3181b35212", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1044539217"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1212/wnl.0b013e3181b35212", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1044539217"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.3109/0142159x.2011.542523", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1045979734"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/s10459-016-9723-4", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1048478082", 
              "https://doi.org/10.1007/s10459-016-9723-4"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/s10459-016-9723-4", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1048478082", 
              "https://doi.org/10.1007/s10459-016-9723-4"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1097/acm.0000000000001537", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1049413372"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1097/acm.0000000000001537", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1049413372"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1017/s1481803500010009", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1050549323"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/s10459-012-9392-x", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1050767823", 
              "https://doi.org/10.1007/s10459-012-9392-x"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1016/0749-5978(87)90010-0", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1050909131"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/s10459-012-9372-1", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1053005267", 
              "https://doi.org/10.1007/s10459-012-9372-1"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/s10459-012-9372-1", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1053005267", 
              "https://doi.org/10.1007/s10459-012-9372-1"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1126/science.185.4157.1124", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1062510354"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.7326/0003-4819-123-10-199511150-00008", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1073699678"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.7326/0003-4819-138-6-200303180-00012", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1073706165"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.7326/0003-4819-140-11-200406010-00008", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1073707026"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1111/medu.13390", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1091622022"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1080/0142159x.2017.1390216", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1092480651"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1037/amp0000238", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1100102815"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1080/0142159x.2018.1432850", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1100866788"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1016/j.jarmac.2018.03.008", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1104548706"
            ], 
            "type": "CreativeWork"
          }
        ], 
        "datePublished": "2019-03", 
        "datePublishedReg": "2019-03-01", 
        "description": "The increasing use of direct observation tools to assess routine performance has resulted in the growing reliance on assessor-based judgements in the workplace. However, we have a limited understanding of how assessors make judgements and formulate ratings in real world contexts. The current research on assessor cognition has largely focused on the cognitive domain but the contextual factors are equally important, and both are closely interconnected. This study aimed to explore the perceived cognitive and contextual factors influencing Mini-CEX assessor judgements in the Emergency Department setting. We used a conceptual framework of assessor-based judgement to develop a sequential mixed methods study. We analysed and integrated survey and focus group results to illustrate self-reported cognitive and contextual factors influencing assessor judgements. We used situated cognition theory as a sensitizing lens to explore the interactions between people and their environment. The major factors highlighted through our mixed methods study were: clarity of the assessment, reliance on and variable approach to overall impression (gestalt), role tension especially when giving constructive feedback, prior knowledge of the trainee and case complexity. We identified prevailing tensions between participants (assessors and trainees), interactions (assessment and feedback) and setting. The two practical implications of our research are the need to broaden assessor training to incorporate both cognitive and contextual domains, and the need to develop a more holistic understanding of assessor-based judgements in real world contexts to better inform future research and development in workplace-based assessments.", 
        "genre": "research_article", 
        "id": "sg:pub.10.1007/s10459-018-9851-0", 
        "inLanguage": [
          "en"
        ], 
        "isAccessibleForFree": false, 
        "isPartOf": [
          {
            "id": "sg:journal.1115841", 
            "issn": [
              "1382-4996", 
              "1573-1677"
            ], 
            "name": "Advances in Health Sciences Education", 
            "type": "Periodical"
          }
        ], 
        "name": "From opening the \u2018black box\u2019 to looking behind the curtain: cognition and context in assessor-based judgements", 
        "pagination": "1-18", 
        "productId": [
          {
            "name": "readcube_id", 
            "type": "PropertyValue", 
            "value": [
              "282f925c168f67eeb196cdfa9bb698dbd43b43be0f95868bb477e0bc3c0788f0"
            ]
          }, 
          {
            "name": "pubmed_id", 
            "type": "PropertyValue", 
            "value": [
              "30302670"
            ]
          }, 
          {
            "name": "nlm_unique_id", 
            "type": "PropertyValue", 
            "value": [
              "9612021"
            ]
          }, 
          {
            "name": "doi", 
            "type": "PropertyValue", 
            "value": [
              "10.1007/s10459-018-9851-0"
            ]
          }, 
          {
            "name": "dimensions_id", 
            "type": "PropertyValue", 
            "value": [
              "pub.1107493406"
            ]
          }
        ], 
        "sameAs": [
          "https://doi.org/10.1007/s10459-018-9851-0", 
          "https://app.dimensions.ai/details/publication/pub.1107493406"
        ], 
        "sdDataset": "articles", 
        "sdDatePublished": "2019-04-10T13:26", 
        "sdLicense": "https://scigraph.springernature.com/explorer/license/", 
        "sdPublisher": {
          "name": "Springer Nature - SN SciGraph project", 
          "type": "Organization"
        }, 
        "sdSource": "s3://com-uberresearch-data-dimensions-target-20181106-alternative/cleanup/v134/2549eaecd7973599484d7c17b260dba0a4ecb94b/merge/v9/a6c9fde33151104705d4d7ff012ea9563521a3ce/jats-lookup/v90/0000000001_0000000264/records_8659_00000559.jsonl", 
        "type": "ScholarlyArticle", 
        "url": "https://link.springer.com/10.1007%2Fs10459-018-9851-0"
      }
    ]
     

    Download the RDF metadata as:  json-ld nt turtle xml License info

    HOW TO GET THIS DATA PROGRAMMATICALLY:

    JSON-LD is a popular format for linked data which is fully compatible with JSON.

    curl -H 'Accept: application/ld+json' 'https://scigraph.springernature.com/pub.10.1007/s10459-018-9851-0'

    N-Triples is a line-based linked data format ideal for batch operations.

    curl -H 'Accept: application/n-triples' 'https://scigraph.springernature.com/pub.10.1007/s10459-018-9851-0'

    Turtle is a human-readable linked data format.

    curl -H 'Accept: text/turtle' 'https://scigraph.springernature.com/pub.10.1007/s10459-018-9851-0'

    RDF/XML is a standard XML format for linked data.

    curl -H 'Accept: application/rdf+xml' 'https://scigraph.springernature.com/pub.10.1007/s10459-018-9851-0'


     

    This table displays all metadata directly associated to this object as RDF triples.

    260 TRIPLES      21 PREDICATES      82 URIs      19 LITERALS      7 BLANK NODES

    Subject Predicate Object
    1 sg:pub.10.1007/s10459-018-9851-0 schema:about anzsrc-for:17
    2 anzsrc-for:1701
    3 schema:author N5867332167bb4407982ce03f65ac1390
    4 schema:citation sg:pub.10.1007/s10459-006-9043-1
    5 sg:pub.10.1007/s10459-010-9250-7
    6 sg:pub.10.1007/s10459-011-9294-3
    7 sg:pub.10.1007/s10459-012-9370-3
    8 sg:pub.10.1007/s10459-012-9372-1
    9 sg:pub.10.1007/s10459-012-9376-x
    10 sg:pub.10.1007/s10459-012-9392-x
    11 sg:pub.10.1007/s10459-012-9396-6
    12 sg:pub.10.1007/s10459-013-9453-9
    13 sg:pub.10.1007/s10459-016-9723-4
    14 sg:pub.10.1007/s11606-008-0842-3
    15 sg:pub.10.1186/s12909-015-0490-3
    16 https://doi.org/10.1016/0749-5978(87)90010-0
    17 https://doi.org/10.1016/j.jarmac.2018.03.008
    18 https://doi.org/10.1017/s1481803500010009
    19 https://doi.org/10.1037/amp0000238
    20 https://doi.org/10.1046/j.1365-2923.2002.01140.x
    21 https://doi.org/10.1046/j.1365-2923.2004.01799.x
    22 https://doi.org/10.1080/00461520.2016.1207538
    23 https://doi.org/10.1080/0142159x.2017.1390216
    24 https://doi.org/10.1080/0142159x.2018.1432850
    25 https://doi.org/10.1097/acm.0000000000000221
    26 https://doi.org/10.1097/acm.0000000000000486
    27 https://doi.org/10.1097/acm.0000000000001537
    28 https://doi.org/10.1097/acm.0b013e3181d73fb6
    29 https://doi.org/10.1097/acm.0b013e3181d7427c
    30 https://doi.org/10.1097/acm.0b013e31822a6cf8
    31 https://doi.org/10.1111/j.1365-2923.2008.03275.x
    32 https://doi.org/10.1111/j.1365-2923.2009.03386.x
    33 https://doi.org/10.1111/j.1365-2923.2011.04025.x
    34 https://doi.org/10.1111/j.1365-2923.2011.04053.x
    35 https://doi.org/10.1111/j.1365-2923.2011.04137.x
    36 https://doi.org/10.1111/j.1365-2923.2012.04266.x
    37 https://doi.org/10.1111/medu.12254
    38 https://doi.org/10.1111/medu.12546
    39 https://doi.org/10.1111/medu.12733
    40 https://doi.org/10.1111/medu.12777
    41 https://doi.org/10.1111/medu.12973
    42 https://doi.org/10.1111/medu.13390
    43 https://doi.org/10.1126/science.185.4157.1124
    44 https://doi.org/10.1207/s15326985ep2901_3
    45 https://doi.org/10.1207/s15328015tlm1504_11
    46 https://doi.org/10.1212/wnl.0b013e3181b35212
    47 https://doi.org/10.3102/0013189x018001032
    48 https://doi.org/10.3109/0142159x.2011.542523
    49 https://doi.org/10.3109/0142159x.2011.550965
    50 https://doi.org/10.3109/0142159x.2011.565828
    51 https://doi.org/10.3109/0142159x.2011.611022
    52 https://doi.org/10.3109/0142159x.2013.759645
    53 https://doi.org/10.3109/0142159x.2013.788789
    54 https://doi.org/10.3109/0142159x.2013.798403
    55 https://doi.org/10.3109/0142159x.2014.917165
    56 https://doi.org/10.7326/0003-4819-123-10-199511150-00008
    57 https://doi.org/10.7326/0003-4819-138-6-200303180-00012
    58 https://doi.org/10.7326/0003-4819-140-11-200406010-00008
    59 schema:datePublished 2019-03
    60 schema:datePublishedReg 2019-03-01
    61 schema:description The increasing use of direct observation tools to assess routine performance has resulted in the growing reliance on assessor-based judgements in the workplace. However, we have a limited understanding of how assessors make judgements and formulate ratings in real world contexts. The current research on assessor cognition has largely focused on the cognitive domain but the contextual factors are equally important, and both are closely interconnected. This study aimed to explore the perceived cognitive and contextual factors influencing Mini-CEX assessor judgements in the Emergency Department setting. We used a conceptual framework of assessor-based judgement to develop a sequential mixed methods study. We analysed and integrated survey and focus group results to illustrate self-reported cognitive and contextual factors influencing assessor judgements. We used situated cognition theory as a sensitizing lens to explore the interactions between people and their environment. The major factors highlighted through our mixed methods study were: clarity of the assessment, reliance on and variable approach to overall impression (gestalt), role tension especially when giving constructive feedback, prior knowledge of the trainee and case complexity. We identified prevailing tensions between participants (assessors and trainees), interactions (assessment and feedback) and setting. The two practical implications of our research are the need to broaden assessor training to incorporate both cognitive and contextual domains, and the need to develop a more holistic understanding of assessor-based judgements in real world contexts to better inform future research and development in workplace-based assessments.
    62 schema:genre research_article
    63 schema:inLanguage en
    64 schema:isAccessibleForFree false
    65 schema:isPartOf sg:journal.1115841
    66 schema:name From opening the ‘black box’ to looking behind the curtain: cognition and context in assessor-based judgements
    67 schema:pagination 1-18
    68 schema:productId N46bbf3214ea44cda96b30df7f35fff2d
    69 N7f50f7382ec244b285b2932d8bc45957
    70 Nc99ce943325047b4b1994963697fac98
    71 Ncfa0a582136743bcb31fc4475cc3e476
    72 Nf1da5e7300d1471fba5efe54c7a4ca70
    73 schema:sameAs https://app.dimensions.ai/details/publication/pub.1107493406
    74 https://doi.org/10.1007/s10459-018-9851-0
    75 schema:sdDatePublished 2019-04-10T13:26
    76 schema:sdLicense https://scigraph.springernature.com/explorer/license/
    77 schema:sdPublisher N0fb9bcf158d84028bfeebb61d3316a9e
    78 schema:url https://link.springer.com/10.1007%2Fs10459-018-9851-0
    79 sgo:license sg:explorer/license/
    80 sgo:sdDataset articles
    81 rdf:type schema:ScholarlyArticle
    82 N0fb9bcf158d84028bfeebb61d3316a9e schema:name Springer Nature - SN SciGraph project
    83 rdf:type schema:Organization
    84 N290e00afcdbf49ffb307ca40f644c96e rdf:first sg:person.015501376245.96
    85 rdf:rest N8bb75aae30e2438cae536ed5b9d9209d
    86 N46bbf3214ea44cda96b30df7f35fff2d schema:name doi
    87 schema:value 10.1007/s10459-018-9851-0
    88 rdf:type schema:PropertyValue
    89 N5867332167bb4407982ce03f65ac1390 rdf:first sg:person.014704015645.38
    90 rdf:rest N290e00afcdbf49ffb307ca40f644c96e
    91 N7f50f7382ec244b285b2932d8bc45957 schema:name readcube_id
    92 schema:value 282f925c168f67eeb196cdfa9bb698dbd43b43be0f95868bb477e0bc3c0788f0
    93 rdf:type schema:PropertyValue
    94 N8bb75aae30e2438cae536ed5b9d9209d rdf:first sg:person.016276756645.68
    95 rdf:rest rdf:nil
    96 Nc99ce943325047b4b1994963697fac98 schema:name pubmed_id
    97 schema:value 30302670
    98 rdf:type schema:PropertyValue
    99 Ncfa0a582136743bcb31fc4475cc3e476 schema:name dimensions_id
    100 schema:value pub.1107493406
    101 rdf:type schema:PropertyValue
    102 Nf1da5e7300d1471fba5efe54c7a4ca70 schema:name nlm_unique_id
    103 schema:value 9612021
    104 rdf:type schema:PropertyValue
    105 anzsrc-for:17 schema:inDefinedTermSet anzsrc-for:
    106 schema:name Psychology and Cognitive Sciences
    107 rdf:type schema:DefinedTerm
    108 anzsrc-for:1701 schema:inDefinedTermSet anzsrc-for:
    109 schema:name Psychology
    110 rdf:type schema:DefinedTerm
    111 sg:journal.1115841 schema:issn 1382-4996
    112 1573-1677
    113 schema:name Advances in Health Sciences Education
    114 rdf:type schema:Periodical
    115 sg:person.014704015645.38 schema:affiliation https://www.grid.ac/institutes/grid.410678.c
    116 schema:familyName Lee
    117 schema:givenName Victor
    118 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.014704015645.38
    119 rdf:type schema:Person
    120 sg:person.015501376245.96 schema:affiliation https://www.grid.ac/institutes/grid.417075.0
    121 schema:familyName Brain
    122 schema:givenName Keira
    123 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.015501376245.96
    124 rdf:type schema:Person
    125 sg:person.016276756645.68 schema:affiliation https://www.grid.ac/institutes/grid.1021.2
    126 schema:familyName Martin
    127 schema:givenName Jenepher
    128 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.016276756645.68
    129 rdf:type schema:Person
    130 sg:pub.10.1007/s10459-006-9043-1 schema:sameAs https://app.dimensions.ai/details/publication/pub.1018553586
    131 https://doi.org/10.1007/s10459-006-9043-1
    132 rdf:type schema:CreativeWork
    133 sg:pub.10.1007/s10459-010-9250-7 schema:sameAs https://app.dimensions.ai/details/publication/pub.1007103035
    134 https://doi.org/10.1007/s10459-010-9250-7
    135 rdf:type schema:CreativeWork
    136 sg:pub.10.1007/s10459-011-9294-3 schema:sameAs https://app.dimensions.ai/details/publication/pub.1018353271
    137 https://doi.org/10.1007/s10459-011-9294-3
    138 rdf:type schema:CreativeWork
    139 sg:pub.10.1007/s10459-012-9370-3 schema:sameAs https://app.dimensions.ai/details/publication/pub.1016125492
    140 https://doi.org/10.1007/s10459-012-9370-3
    141 rdf:type schema:CreativeWork
    142 sg:pub.10.1007/s10459-012-9372-1 schema:sameAs https://app.dimensions.ai/details/publication/pub.1053005267
    143 https://doi.org/10.1007/s10459-012-9372-1
    144 rdf:type schema:CreativeWork
    145 sg:pub.10.1007/s10459-012-9376-x schema:sameAs https://app.dimensions.ai/details/publication/pub.1015882010
    146 https://doi.org/10.1007/s10459-012-9376-x
    147 rdf:type schema:CreativeWork
    148 sg:pub.10.1007/s10459-012-9392-x schema:sameAs https://app.dimensions.ai/details/publication/pub.1050767823
    149 https://doi.org/10.1007/s10459-012-9392-x
    150 rdf:type schema:CreativeWork
    151 sg:pub.10.1007/s10459-012-9396-6 schema:sameAs https://app.dimensions.ai/details/publication/pub.1041105371
    152 https://doi.org/10.1007/s10459-012-9396-6
    153 rdf:type schema:CreativeWork
    154 sg:pub.10.1007/s10459-013-9453-9 schema:sameAs https://app.dimensions.ai/details/publication/pub.1040879042
    155 https://doi.org/10.1007/s10459-013-9453-9
    156 rdf:type schema:CreativeWork
    157 sg:pub.10.1007/s10459-016-9723-4 schema:sameAs https://app.dimensions.ai/details/publication/pub.1048478082
    158 https://doi.org/10.1007/s10459-016-9723-4
    159 rdf:type schema:CreativeWork
    160 sg:pub.10.1007/s11606-008-0842-3 schema:sameAs https://app.dimensions.ai/details/publication/pub.1001398701
    161 https://doi.org/10.1007/s11606-008-0842-3
    162 rdf:type schema:CreativeWork
    163 sg:pub.10.1186/s12909-015-0490-3 schema:sameAs https://app.dimensions.ai/details/publication/pub.1004586929
    164 https://doi.org/10.1186/s12909-015-0490-3
    165 rdf:type schema:CreativeWork
    166 https://doi.org/10.1016/0749-5978(87)90010-0 schema:sameAs https://app.dimensions.ai/details/publication/pub.1050909131
    167 rdf:type schema:CreativeWork
    168 https://doi.org/10.1016/j.jarmac.2018.03.008 schema:sameAs https://app.dimensions.ai/details/publication/pub.1104548706
    169 rdf:type schema:CreativeWork
    170 https://doi.org/10.1017/s1481803500010009 schema:sameAs https://app.dimensions.ai/details/publication/pub.1050549323
    171 rdf:type schema:CreativeWork
    172 https://doi.org/10.1037/amp0000238 schema:sameAs https://app.dimensions.ai/details/publication/pub.1100102815
    173 rdf:type schema:CreativeWork
    174 https://doi.org/10.1046/j.1365-2923.2002.01140.x schema:sameAs https://app.dimensions.ai/details/publication/pub.1026567540
    175 rdf:type schema:CreativeWork
    176 https://doi.org/10.1046/j.1365-2923.2004.01799.x schema:sameAs https://app.dimensions.ai/details/publication/pub.1031246819
    177 rdf:type schema:CreativeWork
    178 https://doi.org/10.1080/00461520.2016.1207538 schema:sameAs https://app.dimensions.ai/details/publication/pub.1035960466
    179 rdf:type schema:CreativeWork
    180 https://doi.org/10.1080/0142159x.2017.1390216 schema:sameAs https://app.dimensions.ai/details/publication/pub.1092480651
    181 rdf:type schema:CreativeWork
    182 https://doi.org/10.1080/0142159x.2018.1432850 schema:sameAs https://app.dimensions.ai/details/publication/pub.1100866788
    183 rdf:type schema:CreativeWork
    184 https://doi.org/10.1097/acm.0000000000000221 schema:sameAs https://app.dimensions.ai/details/publication/pub.1044226992
    185 rdf:type schema:CreativeWork
    186 https://doi.org/10.1097/acm.0000000000000486 schema:sameAs https://app.dimensions.ai/details/publication/pub.1029965137
    187 rdf:type schema:CreativeWork
    188 https://doi.org/10.1097/acm.0000000000001537 schema:sameAs https://app.dimensions.ai/details/publication/pub.1049413372
    189 rdf:type schema:CreativeWork
    190 https://doi.org/10.1097/acm.0b013e3181d73fb6 schema:sameAs https://app.dimensions.ai/details/publication/pub.1012814232
    191 rdf:type schema:CreativeWork
    192 https://doi.org/10.1097/acm.0b013e3181d7427c schema:sameAs https://app.dimensions.ai/details/publication/pub.1005387966
    193 rdf:type schema:CreativeWork
    194 https://doi.org/10.1097/acm.0b013e31822a6cf8 schema:sameAs https://app.dimensions.ai/details/publication/pub.1018396617
    195 rdf:type schema:CreativeWork
    196 https://doi.org/10.1111/j.1365-2923.2008.03275.x schema:sameAs https://app.dimensions.ai/details/publication/pub.1013009727
    197 rdf:type schema:CreativeWork
    198 https://doi.org/10.1111/j.1365-2923.2009.03386.x schema:sameAs https://app.dimensions.ai/details/publication/pub.1017891516
    199 rdf:type schema:CreativeWork
    200 https://doi.org/10.1111/j.1365-2923.2011.04025.x schema:sameAs https://app.dimensions.ai/details/publication/pub.1012470358
    201 rdf:type schema:CreativeWork
    202 https://doi.org/10.1111/j.1365-2923.2011.04053.x schema:sameAs https://app.dimensions.ai/details/publication/pub.1027403235
    203 rdf:type schema:CreativeWork
    204 https://doi.org/10.1111/j.1365-2923.2011.04137.x schema:sameAs https://app.dimensions.ai/details/publication/pub.1034836465
    205 rdf:type schema:CreativeWork
    206 https://doi.org/10.1111/j.1365-2923.2012.04266.x schema:sameAs https://app.dimensions.ai/details/publication/pub.1024485126
    207 rdf:type schema:CreativeWork
    208 https://doi.org/10.1111/medu.12254 schema:sameAs https://app.dimensions.ai/details/publication/pub.1007650158
    209 rdf:type schema:CreativeWork
    210 https://doi.org/10.1111/medu.12546 schema:sameAs https://app.dimensions.ai/details/publication/pub.1034269735
    211 rdf:type schema:CreativeWork
    212 https://doi.org/10.1111/medu.12733 schema:sameAs https://app.dimensions.ai/details/publication/pub.1008076219
    213 rdf:type schema:CreativeWork
    214 https://doi.org/10.1111/medu.12777 schema:sameAs https://app.dimensions.ai/details/publication/pub.1034236197
    215 rdf:type schema:CreativeWork
    216 https://doi.org/10.1111/medu.12973 schema:sameAs https://app.dimensions.ai/details/publication/pub.1035786347
    217 rdf:type schema:CreativeWork
    218 https://doi.org/10.1111/medu.13390 schema:sameAs https://app.dimensions.ai/details/publication/pub.1091622022
    219 rdf:type schema:CreativeWork
    220 https://doi.org/10.1126/science.185.4157.1124 schema:sameAs https://app.dimensions.ai/details/publication/pub.1062510354
    221 rdf:type schema:CreativeWork
    222 https://doi.org/10.1207/s15326985ep2901_3 schema:sameAs https://app.dimensions.ai/details/publication/pub.1036646530
    223 rdf:type schema:CreativeWork
    224 https://doi.org/10.1207/s15328015tlm1504_11 schema:sameAs https://app.dimensions.ai/details/publication/pub.1028087504
    225 rdf:type schema:CreativeWork
    226 https://doi.org/10.1212/wnl.0b013e3181b35212 schema:sameAs https://app.dimensions.ai/details/publication/pub.1044539217
    227 rdf:type schema:CreativeWork
    228 https://doi.org/10.3102/0013189x018001032 schema:sameAs https://app.dimensions.ai/details/publication/pub.1010595714
    229 rdf:type schema:CreativeWork
    230 https://doi.org/10.3109/0142159x.2011.542523 schema:sameAs https://app.dimensions.ai/details/publication/pub.1045979734
    231 rdf:type schema:CreativeWork
    232 https://doi.org/10.3109/0142159x.2011.550965 schema:sameAs https://app.dimensions.ai/details/publication/pub.1005184642
    233 rdf:type schema:CreativeWork
    234 https://doi.org/10.3109/0142159x.2011.565828 schema:sameAs https://app.dimensions.ai/details/publication/pub.1022567449
    235 rdf:type schema:CreativeWork
    236 https://doi.org/10.3109/0142159x.2011.611022 schema:sameAs https://app.dimensions.ai/details/publication/pub.1029584272
    237 rdf:type schema:CreativeWork
    238 https://doi.org/10.3109/0142159x.2013.759645 schema:sameAs https://app.dimensions.ai/details/publication/pub.1030228531
    239 rdf:type schema:CreativeWork
    240 https://doi.org/10.3109/0142159x.2013.788789 schema:sameAs https://app.dimensions.ai/details/publication/pub.1039353763
    241 rdf:type schema:CreativeWork
    242 https://doi.org/10.3109/0142159x.2013.798403 schema:sameAs https://app.dimensions.ai/details/publication/pub.1001252663
    243 rdf:type schema:CreativeWork
    244 https://doi.org/10.3109/0142159x.2014.917165 schema:sameAs https://app.dimensions.ai/details/publication/pub.1001404029
    245 rdf:type schema:CreativeWork
    246 https://doi.org/10.7326/0003-4819-123-10-199511150-00008 schema:sameAs https://app.dimensions.ai/details/publication/pub.1073699678
    247 rdf:type schema:CreativeWork
    248 https://doi.org/10.7326/0003-4819-138-6-200303180-00012 schema:sameAs https://app.dimensions.ai/details/publication/pub.1073706165
    249 rdf:type schema:CreativeWork
    250 https://doi.org/10.7326/0003-4819-140-11-200406010-00008 schema:sameAs https://app.dimensions.ai/details/publication/pub.1073707026
    251 rdf:type schema:CreativeWork
    252 https://www.grid.ac/institutes/grid.1021.2 schema:alternateName Deakin University
    253 schema:name Eastern Health Clinical School, Monash University and Deakin University, Box Hill, VIC, Australia
    254 rdf:type schema:Organization
    255 https://www.grid.ac/institutes/grid.410678.c schema:alternateName Austin Health
    256 schema:name Department of Emergency Medicine, Austin Health, P.O. Box 5555, 3084, Heidelberg, VIC, Australia
    257 rdf:type schema:Organization
    258 https://www.grid.ac/institutes/grid.417075.0 schema:alternateName Western Hospital
    259 schema:name Western Hospital, Footscray, VIC, Australia
    260 rdf:type schema:Organization
     




    Preview window. Press ESC to close (or click here)


    ...