Assessing Agreement in Human-Robot Dialogue Strategies: A Tale of Two Wizards View Full Text


Ontology type: schema:Chapter     


Chapter Info

DATE

2016

AUTHORS

Matthew Marge , Claire Bonial , Kimberly A. Pollard , Ron Artstein , Brendan Byrne , Susan G. Hill , Clare Voss , David Traum

ABSTRACT

The Wizard-of-Oz (WOz) method is a common experimental technique in virtual agent and human-robot dialogue research for eliciting natural communicative behavior from human partners when full autonomy is not yet possible. For the first phase of our research reported here, wizards play the role of dialogue manager, acting as a robot’s dialogue processing. We describe a novel step within WOz methodology that incorporates two wizards and control sessions: the wizards function much like corpus annotators, being asked to make independent judgments on how the robot should respond when receiving the same verbal commands in separate trials. We show that inter-wizard discussion after the control sessions and the resolution with a reconciled protocol for the follow-on pilot sessions successfully impacts wizard behaviors and significantly aligns their strategies. We conclude that, without control sessions, we would have been unlikely to achieve both the natural diversity of expression that comes with multiple wizards and a better protocol for modeling an automated system. More... »

PAGES

484-488

Book

TITLE

Intelligent Virtual Agents

ISBN

978-3-319-47664-3
978-3-319-47665-0

Identifiers

URI

http://scigraph.springernature.com/pub.10.1007/978-3-319-47665-0_60

DOI

http://dx.doi.org/10.1007/978-3-319-47665-0_60

DIMENSIONS

https://app.dimensions.ai/details/publication/pub.1008924668


Indexing Status Check whether this publication has been indexed by Scopus and Web Of Science using the SN Indexing Status Tool
Incoming Citations Browse incoming citations for this publication using opencitations.net

JSON-LD is the canonical representation for SciGraph data.

TIP: You can open this SciGraph record using an external JSON-LD service: JSON-LD Playground Google SDTT

[
  {
    "@context": "https://springernature.github.io/scigraph/jsonld/sgcontext.json", 
    "about": [
      {
        "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/0801", 
        "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
        "name": "Artificial Intelligence and Image Processing", 
        "type": "DefinedTerm"
      }, 
      {
        "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/08", 
        "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
        "name": "Information and Computing Sciences", 
        "type": "DefinedTerm"
      }
    ], 
    "author": [
      {
        "affiliation": {
          "alternateName": "United States Army Research Laboratory", 
          "id": "https://www.grid.ac/institutes/grid.420282.e", 
          "name": [
            "U.S. Army Research Laboratory"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Marge", 
        "givenName": "Matthew", 
        "id": "sg:person.015650276704.82", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.015650276704.82"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "United States Army Research Laboratory", 
          "id": "https://www.grid.ac/institutes/grid.420282.e", 
          "name": [
            "U.S. Army Research Laboratory"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Bonial", 
        "givenName": "Claire", 
        "id": "sg:person.011516550376.00", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.011516550376.00"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "United States Army Research Laboratory", 
          "id": "https://www.grid.ac/institutes/grid.420282.e", 
          "name": [
            "U.S. Army Research Laboratory"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Pollard", 
        "givenName": "Kimberly A.", 
        "id": "sg:person.01141731741.96", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.01141731741.96"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "name": [
            "USC Institute for Creative Technologies"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Artstein", 
        "givenName": "Ron", 
        "id": "sg:person.011476470243.70", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.011476470243.70"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "United States Army Research Laboratory", 
          "id": "https://www.grid.ac/institutes/grid.420282.e", 
          "name": [
            "U.S. Army Research Laboratory"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Byrne", 
        "givenName": "Brendan", 
        "id": "sg:person.013231516731.37", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.013231516731.37"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "United States Army Research Laboratory", 
          "id": "https://www.grid.ac/institutes/grid.420282.e", 
          "name": [
            "U.S. Army Research Laboratory"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Hill", 
        "givenName": "Susan G.", 
        "id": "sg:person.07742672337.65", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.07742672337.65"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "United States Army Research Laboratory", 
          "id": "https://www.grid.ac/institutes/grid.420282.e", 
          "name": [
            "U.S. Army Research Laboratory"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Voss", 
        "givenName": "Clare", 
        "id": "sg:person.013422563125.49", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.013422563125.49"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "name": [
            "USC Institute for Creative Technologies"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Traum", 
        "givenName": "David", 
        "id": "sg:person.013767173315.17", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.013767173315.17"
        ], 
        "type": "Person"
      }
    ], 
    "datePublished": "2016", 
    "datePublishedReg": "2016-01-01", 
    "description": "The Wizard-of-Oz (WOz) method is a common experimental technique in virtual agent and human-robot dialogue research for eliciting natural communicative behavior from human partners when full autonomy is not yet possible. For the first phase of our research reported here, wizards play the role of dialogue manager, acting as a robot\u2019s dialogue processing. We describe a novel step within WOz methodology that incorporates two wizards and control sessions: the wizards function much like corpus annotators, being asked to make independent judgments on how the robot should respond when receiving the same verbal commands in separate trials. We show that inter-wizard discussion after the control sessions and the resolution with a reconciled protocol for the follow-on pilot sessions successfully impacts wizard behaviors and significantly aligns their strategies. We conclude that, without control sessions, we would have been unlikely to achieve both the natural diversity of expression that comes with multiple wizards and a better protocol for modeling an automated system.", 
    "editor": [
      {
        "familyName": "Traum", 
        "givenName": "David", 
        "type": "Person"
      }, 
      {
        "familyName": "Swartout", 
        "givenName": "William", 
        "type": "Person"
      }, 
      {
        "familyName": "Khooshabeh", 
        "givenName": "Peter", 
        "type": "Person"
      }, 
      {
        "familyName": "Kopp", 
        "givenName": "Stefan", 
        "type": "Person"
      }, 
      {
        "familyName": "Scherer", 
        "givenName": "Stefan", 
        "type": "Person"
      }, 
      {
        "familyName": "Leuski", 
        "givenName": "Anton", 
        "type": "Person"
      }
    ], 
    "genre": "chapter", 
    "id": "sg:pub.10.1007/978-3-319-47665-0_60", 
    "inLanguage": [
      "en"
    ], 
    "isAccessibleForFree": false, 
    "isPartOf": {
      "isbn": [
        "978-3-319-47664-3", 
        "978-3-319-47665-0"
      ], 
      "name": "Intelligent Virtual Agents", 
      "type": "Book"
    }, 
    "name": "Assessing Agreement in Human-Robot Dialogue Strategies: A Tale of Two Wizards", 
    "pagination": "484-488", 
    "productId": [
      {
        "name": "doi", 
        "type": "PropertyValue", 
        "value": [
          "10.1007/978-3-319-47665-0_60"
        ]
      }, 
      {
        "name": "readcube_id", 
        "type": "PropertyValue", 
        "value": [
          "2a84932226753ac7539b1d1ac4479340507114fc912686df7ea3a4f54dbdef77"
        ]
      }, 
      {
        "name": "dimensions_id", 
        "type": "PropertyValue", 
        "value": [
          "pub.1008924668"
        ]
      }
    ], 
    "publisher": {
      "location": "Cham", 
      "name": "Springer International Publishing", 
      "type": "Organisation"
    }, 
    "sameAs": [
      "https://doi.org/10.1007/978-3-319-47665-0_60", 
      "https://app.dimensions.ai/details/publication/pub.1008924668"
    ], 
    "sdDataset": "chapters", 
    "sdDatePublished": "2019-04-15T19:51", 
    "sdLicense": "https://scigraph.springernature.com/explorer/license/", 
    "sdPublisher": {
      "name": "Springer Nature - SN SciGraph project", 
      "type": "Organization"
    }, 
    "sdSource": "s3://com-uberresearch-data-dimensions-target-20181106-alternative/cleanup/v134/2549eaecd7973599484d7c17b260dba0a4ecb94b/merge/v9/a6c9fde33151104705d4d7ff012ea9563521a3ce/jats-lookup/v90/0000000001_0000000264/records_8687_00000015.jsonl", 
    "type": "Chapter", 
    "url": "http://link.springer.com/10.1007/978-3-319-47665-0_60"
  }
]
 

Download the RDF metadata as:  json-ld nt turtle xml License info

HOW TO GET THIS DATA PROGRAMMATICALLY:

JSON-LD is a popular format for linked data which is fully compatible with JSON.

curl -H 'Accept: application/ld+json' 'https://scigraph.springernature.com/pub.10.1007/978-3-319-47665-0_60'

N-Triples is a line-based linked data format ideal for batch operations.

curl -H 'Accept: application/n-triples' 'https://scigraph.springernature.com/pub.10.1007/978-3-319-47665-0_60'

Turtle is a human-readable linked data format.

curl -H 'Accept: text/turtle' 'https://scigraph.springernature.com/pub.10.1007/978-3-319-47665-0_60'

RDF/XML is a standard XML format for linked data.

curl -H 'Accept: application/rdf+xml' 'https://scigraph.springernature.com/pub.10.1007/978-3-319-47665-0_60'


 

This table displays all metadata directly associated to this object as RDF triples.

143 TRIPLES      22 PREDICATES      27 URIs      20 LITERALS      8 BLANK NODES

Subject Predicate Object
1 sg:pub.10.1007/978-3-319-47665-0_60 schema:about anzsrc-for:08
2 anzsrc-for:0801
3 schema:author N9af31ada00714bbd9e87fd792460c44f
4 schema:datePublished 2016
5 schema:datePublishedReg 2016-01-01
6 schema:description The Wizard-of-Oz (WOz) method is a common experimental technique in virtual agent and human-robot dialogue research for eliciting natural communicative behavior from human partners when full autonomy is not yet possible. For the first phase of our research reported here, wizards play the role of dialogue manager, acting as a robot’s dialogue processing. We describe a novel step within WOz methodology that incorporates two wizards and control sessions: the wizards function much like corpus annotators, being asked to make independent judgments on how the robot should respond when receiving the same verbal commands in separate trials. We show that inter-wizard discussion after the control sessions and the resolution with a reconciled protocol for the follow-on pilot sessions successfully impacts wizard behaviors and significantly aligns their strategies. We conclude that, without control sessions, we would have been unlikely to achieve both the natural diversity of expression that comes with multiple wizards and a better protocol for modeling an automated system.
7 schema:editor N9d1a121336a844819fc5183903cc6a9d
8 schema:genre chapter
9 schema:inLanguage en
10 schema:isAccessibleForFree false
11 schema:isPartOf N4103b1d7ed894191b1dcc63a31d5528b
12 schema:name Assessing Agreement in Human-Robot Dialogue Strategies: A Tale of Two Wizards
13 schema:pagination 484-488
14 schema:productId N409764439f6f4eab9fb46cb66e4a2bd3
15 N74b0f31799924c879e73959ee0be2b5f
16 N76e04d1f4d934eafb8b122f5066bec7c
17 schema:publisher N77614ad3c8e4491aa197e4b9c0d7d612
18 schema:sameAs https://app.dimensions.ai/details/publication/pub.1008924668
19 https://doi.org/10.1007/978-3-319-47665-0_60
20 schema:sdDatePublished 2019-04-15T19:51
21 schema:sdLicense https://scigraph.springernature.com/explorer/license/
22 schema:sdPublisher N3320b33e8c1745b89a8fe959e5adf8bb
23 schema:url http://link.springer.com/10.1007/978-3-319-47665-0_60
24 sgo:license sg:explorer/license/
25 sgo:sdDataset chapters
26 rdf:type schema:Chapter
27 N07b312a5dece42e5bd5e3acb5ab1a9e3 rdf:first sg:person.011516550376.00
28 rdf:rest N247a8ecff62741989cc71229ad649bfd
29 N08890d02a02b460f99e2b32c2cb3f572 schema:familyName Traum
30 schema:givenName David
31 rdf:type schema:Person
32 N15ecb02a35cc423989308e9951e71e5e schema:familyName Kopp
33 schema:givenName Stefan
34 rdf:type schema:Person
35 N1f4c6e0de1a64eaa8a1ac2e85dfb4bd3 rdf:first sg:person.013422563125.49
36 rdf:rest N75cb054d736c4ef181a810f86e8aafa9
37 N247a8ecff62741989cc71229ad649bfd rdf:first sg:person.01141731741.96
38 rdf:rest N89a18b76a7794445a5a834b58539c3e1
39 N3320b33e8c1745b89a8fe959e5adf8bb schema:name Springer Nature - SN SciGraph project
40 rdf:type schema:Organization
41 N3a3899937ea34ab6bc342b12d01c2187 schema:familyName Khooshabeh
42 schema:givenName Peter
43 rdf:type schema:Person
44 N3bbb470959fe43c7a8465896792c4242 rdf:first N15ecb02a35cc423989308e9951e71e5e
45 rdf:rest Neff56aab3f01476aaebd41e293c59166
46 N409764439f6f4eab9fb46cb66e4a2bd3 schema:name readcube_id
47 schema:value 2a84932226753ac7539b1d1ac4479340507114fc912686df7ea3a4f54dbdef77
48 rdf:type schema:PropertyValue
49 N4103b1d7ed894191b1dcc63a31d5528b schema:isbn 978-3-319-47664-3
50 978-3-319-47665-0
51 schema:name Intelligent Virtual Agents
52 rdf:type schema:Book
53 N5ddc6a406fba49ea8d985a1af74cb1ca rdf:first Na84c255c42a541f0a3e46ae607f9066d
54 rdf:rest rdf:nil
55 N62724bd0d76243d588d9c99f9b5fd210 rdf:first sg:person.013231516731.37
56 rdf:rest N8ae2e9492a4548c781f6c7c5198cf475
57 N74b0f31799924c879e73959ee0be2b5f schema:name dimensions_id
58 schema:value pub.1008924668
59 rdf:type schema:PropertyValue
60 N75cb054d736c4ef181a810f86e8aafa9 rdf:first sg:person.013767173315.17
61 rdf:rest rdf:nil
62 N76e04d1f4d934eafb8b122f5066bec7c schema:name doi
63 schema:value 10.1007/978-3-319-47665-0_60
64 rdf:type schema:PropertyValue
65 N77614ad3c8e4491aa197e4b9c0d7d612 schema:location Cham
66 schema:name Springer International Publishing
67 rdf:type schema:Organisation
68 N88f3d2092606448b999ff3065b065af5 schema:name USC Institute for Creative Technologies
69 rdf:type schema:Organization
70 N89a18b76a7794445a5a834b58539c3e1 rdf:first sg:person.011476470243.70
71 rdf:rest N62724bd0d76243d588d9c99f9b5fd210
72 N8ae2e9492a4548c781f6c7c5198cf475 rdf:first sg:person.07742672337.65
73 rdf:rest N1f4c6e0de1a64eaa8a1ac2e85dfb4bd3
74 N9418a69dbd12432bb02878f9b8c68c89 schema:name USC Institute for Creative Technologies
75 rdf:type schema:Organization
76 N9af31ada00714bbd9e87fd792460c44f rdf:first sg:person.015650276704.82
77 rdf:rest N07b312a5dece42e5bd5e3acb5ab1a9e3
78 N9d0fa26139fe46c88f7a2c447e5384fc rdf:first Nfe1a034d777540d0862cf32fb4d9f7ba
79 rdf:rest Nd81a6349008a47ea8ca4102b3fb1e18c
80 N9d1a121336a844819fc5183903cc6a9d rdf:first N08890d02a02b460f99e2b32c2cb3f572
81 rdf:rest N9d0fa26139fe46c88f7a2c447e5384fc
82 Na84c255c42a541f0a3e46ae607f9066d schema:familyName Leuski
83 schema:givenName Anton
84 rdf:type schema:Person
85 Nd81a6349008a47ea8ca4102b3fb1e18c rdf:first N3a3899937ea34ab6bc342b12d01c2187
86 rdf:rest N3bbb470959fe43c7a8465896792c4242
87 Neff56aab3f01476aaebd41e293c59166 rdf:first Nf90a363f4e274e05a4a61f78f2ee5f43
88 rdf:rest N5ddc6a406fba49ea8d985a1af74cb1ca
89 Nf90a363f4e274e05a4a61f78f2ee5f43 schema:familyName Scherer
90 schema:givenName Stefan
91 rdf:type schema:Person
92 Nfe1a034d777540d0862cf32fb4d9f7ba schema:familyName Swartout
93 schema:givenName William
94 rdf:type schema:Person
95 anzsrc-for:08 schema:inDefinedTermSet anzsrc-for:
96 schema:name Information and Computing Sciences
97 rdf:type schema:DefinedTerm
98 anzsrc-for:0801 schema:inDefinedTermSet anzsrc-for:
99 schema:name Artificial Intelligence and Image Processing
100 rdf:type schema:DefinedTerm
101 sg:person.01141731741.96 schema:affiliation https://www.grid.ac/institutes/grid.420282.e
102 schema:familyName Pollard
103 schema:givenName Kimberly A.
104 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.01141731741.96
105 rdf:type schema:Person
106 sg:person.011476470243.70 schema:affiliation N9418a69dbd12432bb02878f9b8c68c89
107 schema:familyName Artstein
108 schema:givenName Ron
109 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.011476470243.70
110 rdf:type schema:Person
111 sg:person.011516550376.00 schema:affiliation https://www.grid.ac/institutes/grid.420282.e
112 schema:familyName Bonial
113 schema:givenName Claire
114 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.011516550376.00
115 rdf:type schema:Person
116 sg:person.013231516731.37 schema:affiliation https://www.grid.ac/institutes/grid.420282.e
117 schema:familyName Byrne
118 schema:givenName Brendan
119 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.013231516731.37
120 rdf:type schema:Person
121 sg:person.013422563125.49 schema:affiliation https://www.grid.ac/institutes/grid.420282.e
122 schema:familyName Voss
123 schema:givenName Clare
124 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.013422563125.49
125 rdf:type schema:Person
126 sg:person.013767173315.17 schema:affiliation N88f3d2092606448b999ff3065b065af5
127 schema:familyName Traum
128 schema:givenName David
129 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.013767173315.17
130 rdf:type schema:Person
131 sg:person.015650276704.82 schema:affiliation https://www.grid.ac/institutes/grid.420282.e
132 schema:familyName Marge
133 schema:givenName Matthew
134 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.015650276704.82
135 rdf:type schema:Person
136 sg:person.07742672337.65 schema:affiliation https://www.grid.ac/institutes/grid.420282.e
137 schema:familyName Hill
138 schema:givenName Susan G.
139 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.07742672337.65
140 rdf:type schema:Person
141 https://www.grid.ac/institutes/grid.420282.e schema:alternateName United States Army Research Laboratory
142 schema:name U.S. Army Research Laboratory
143 rdf:type schema:Organization
 




Preview window. Press ESC to close (or click here)


...