Measuring Heterogeneous User Behaviors During the Interaction with Dialog Systems View Full Text


Ontology type: schema:Chapter     


Chapter Info

DATE

2016

AUTHORS

David Griol , José Manuel Molina

ABSTRACT

In this paper, we describe a technique to develop simulated user agents that are able to interact with dialog systems. By means of these agents, it is possible not only to automatically evaluate the overall operation of the dialog system, but also to assess the impact of the user responses on the decisions that are selected by the system. The selection of the user responses by the simulated user agent are based on a statistical model that is automatically learned from a dialog corpus. The complete history of the interaction is considered to carry out this selection. The paper describes the application of this technique to evaluate a practical dialog system providing tourist information and services. More... »

PAGES

289-300

References to SciGraph publications

Book

TITLE

Highlights of Practical Applications of Scalable Multi-Agent Systems. The PAAMS Collection

ISBN

978-3-319-39386-5
978-3-319-39387-2

Author Affiliations

Identifiers

URI

http://scigraph.springernature.com/pub.10.1007/978-3-319-39387-2_24

DOI

http://dx.doi.org/10.1007/978-3-319-39387-2_24

DIMENSIONS

https://app.dimensions.ai/details/publication/pub.1015887691


Indexing Status Check whether this publication has been indexed by Scopus and Web Of Science using the SN Indexing Status Tool
Incoming Citations Browse incoming citations for this publication using opencitations.net

JSON-LD is the canonical representation for SciGraph data.

TIP: You can open this SciGraph record using an external JSON-LD service: JSON-LD Playground Google SDTT

[
  {
    "@context": "https://springernature.github.io/scigraph/jsonld/sgcontext.json", 
    "about": [
      {
        "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/0806", 
        "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
        "name": "Information Systems", 
        "type": "DefinedTerm"
      }, 
      {
        "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/08", 
        "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
        "name": "Information and Computing Sciences", 
        "type": "DefinedTerm"
      }
    ], 
    "author": [
      {
        "affiliation": {
          "alternateName": "Carlos III University of Madrid", 
          "id": "https://www.grid.ac/institutes/grid.7840.b", 
          "name": [
            "Computer Science Department, Carlos III University of Madrid"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Griol", 
        "givenName": "David", 
        "id": "sg:person.013422741257.57", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.013422741257.57"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "Carlos III University of Madrid", 
          "id": "https://www.grid.ac/institutes/grid.7840.b", 
          "name": [
            "Computer Science Department, Carlos III University of Madrid"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Molina", 
        "givenName": "Jos\u00e9 Manuel", 
        "id": "sg:person.010563353054.10", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010563353054.10"
        ], 
        "type": "Person"
      }
    ], 
    "citation": [
      {
        "id": "https://doi.org/10.1016/j.csl.2013.09.002", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1002867806"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1017/s0269888906000944", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1011556404"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1016/j.csl.2012.07.004", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1013790106"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1016/j.csl.2006.06.008", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1015870155"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-3-319-19644-2_30", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1017459956", 
          "https://doi.org/10.1007/978-3-319-19644-2_30"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1016/j.csl.2009.05.002", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1020900983"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-3-642-31591-6", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1030055872", 
          "https://doi.org/10.1007/978-3-642-31591-6"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-3-642-31591-6", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1030055872", 
          "https://doi.org/10.1007/978-3-642-31591-6"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-3-540-39398-6_24", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1036042620", 
          "https://doi.org/10.1007/978-3-540-39398-6_24"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1016/s0167-6393(02)00126-7", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1037984060"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1016/s0167-6393(02)00126-7", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1037984060"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1016/j.csl.2010.04.005", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1043036376"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1109/89.928918", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1061242688"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1109/asru.2007.4430167", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1093229671"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.3115/1218955.1218964", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1099221189"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.3115/1218955.1218964", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1099221189"
        ], 
        "type": "CreativeWork"
      }
    ], 
    "datePublished": "2016", 
    "datePublishedReg": "2016-01-01", 
    "description": "In this paper, we describe a technique to develop simulated user agents that are able to interact with dialog systems. By means of these agents, it is possible not only to automatically evaluate the overall operation of the dialog system, but also to assess the impact of the user responses on the decisions that are selected by the system. The selection of the user responses by the simulated user agent are based on a statistical model that is automatically learned from a dialog corpus. The complete history of the interaction is considered to carry out this selection. The paper describes the application of this technique to evaluate a practical dialog system providing tourist information and services.", 
    "editor": [
      {
        "familyName": "Bajo", 
        "givenName": "Javier", 
        "type": "Person"
      }, 
      {
        "familyName": "Escalona", 
        "givenName": "Mar\u00eda Jos\u00e9", 
        "type": "Person"
      }, 
      {
        "familyName": "Giroux", 
        "givenName": "Sylvain", 
        "type": "Person"
      }, 
      {
        "familyName": "Hoffa-D\u0105browska", 
        "givenName": "Patrycja", 
        "type": "Person"
      }, 
      {
        "familyName": "Juli\u00e1n", 
        "givenName": "Vicente", 
        "type": "Person"
      }, 
      {
        "familyName": "Novais", 
        "givenName": "Paulo", 
        "type": "Person"
      }, 
      {
        "familyName": "S\u00e1nchez-Pi", 
        "givenName": "Nayat", 
        "type": "Person"
      }, 
      {
        "familyName": "Unland", 
        "givenName": "Rainer", 
        "type": "Person"
      }, 
      {
        "familyName": "Azambuja-Silveira", 
        "givenName": "Ricardo", 
        "type": "Person"
      }
    ], 
    "genre": "chapter", 
    "id": "sg:pub.10.1007/978-3-319-39387-2_24", 
    "inLanguage": [
      "en"
    ], 
    "isAccessibleForFree": false, 
    "isPartOf": {
      "isbn": [
        "978-3-319-39386-5", 
        "978-3-319-39387-2"
      ], 
      "name": "Highlights of Practical Applications of Scalable Multi-Agent Systems. The PAAMS Collection", 
      "type": "Book"
    }, 
    "name": "Measuring Heterogeneous User Behaviors During the Interaction with Dialog Systems", 
    "pagination": "289-300", 
    "productId": [
      {
        "name": "doi", 
        "type": "PropertyValue", 
        "value": [
          "10.1007/978-3-319-39387-2_24"
        ]
      }, 
      {
        "name": "readcube_id", 
        "type": "PropertyValue", 
        "value": [
          "4bb3b27dc1139ddbd6f6e43a17fe2e84c3ec7c0027137cf6d8576ffff8429a76"
        ]
      }, 
      {
        "name": "dimensions_id", 
        "type": "PropertyValue", 
        "value": [
          "pub.1015887691"
        ]
      }
    ], 
    "publisher": {
      "location": "Cham", 
      "name": "Springer International Publishing", 
      "type": "Organisation"
    }, 
    "sameAs": [
      "https://doi.org/10.1007/978-3-319-39387-2_24", 
      "https://app.dimensions.ai/details/publication/pub.1015887691"
    ], 
    "sdDataset": "chapters", 
    "sdDatePublished": "2019-04-15T12:30", 
    "sdLicense": "https://scigraph.springernature.com/explorer/license/", 
    "sdPublisher": {
      "name": "Springer Nature - SN SciGraph project", 
      "type": "Organization"
    }, 
    "sdSource": "s3://com-uberresearch-data-dimensions-target-20181106-alternative/cleanup/v134/2549eaecd7973599484d7c17b260dba0a4ecb94b/merge/v9/a6c9fde33151104705d4d7ff012ea9563521a3ce/jats-lookup/v90/0000000001_0000000264/records_8663_00000253.jsonl", 
    "type": "Chapter", 
    "url": "http://link.springer.com/10.1007/978-3-319-39387-2_24"
  }
]
 

Download the RDF metadata as:  json-ld nt turtle xml License info

HOW TO GET THIS DATA PROGRAMMATICALLY:

JSON-LD is a popular format for linked data which is fully compatible with JSON.

curl -H 'Accept: application/ld+json' 'https://scigraph.springernature.com/pub.10.1007/978-3-319-39387-2_24'

N-Triples is a line-based linked data format ideal for batch operations.

curl -H 'Accept: application/n-triples' 'https://scigraph.springernature.com/pub.10.1007/978-3-319-39387-2_24'

Turtle is a human-readable linked data format.

curl -H 'Accept: text/turtle' 'https://scigraph.springernature.com/pub.10.1007/978-3-319-39387-2_24'

RDF/XML is a standard XML format for linked data.

curl -H 'Accept: application/rdf+xml' 'https://scigraph.springernature.com/pub.10.1007/978-3-319-39387-2_24'


 

This table displays all metadata directly associated to this object as RDF triples.

154 TRIPLES      23 PREDICATES      40 URIs      20 LITERALS      8 BLANK NODES

Subject Predicate Object
1 sg:pub.10.1007/978-3-319-39387-2_24 schema:about anzsrc-for:08
2 anzsrc-for:0806
3 schema:author Ndad17ed3488b4bbc80fb471c642701b3
4 schema:citation sg:pub.10.1007/978-3-319-19644-2_30
5 sg:pub.10.1007/978-3-540-39398-6_24
6 sg:pub.10.1007/978-3-642-31591-6
7 https://doi.org/10.1016/j.csl.2006.06.008
8 https://doi.org/10.1016/j.csl.2009.05.002
9 https://doi.org/10.1016/j.csl.2010.04.005
10 https://doi.org/10.1016/j.csl.2012.07.004
11 https://doi.org/10.1016/j.csl.2013.09.002
12 https://doi.org/10.1016/s0167-6393(02)00126-7
13 https://doi.org/10.1017/s0269888906000944
14 https://doi.org/10.1109/89.928918
15 https://doi.org/10.1109/asru.2007.4430167
16 https://doi.org/10.3115/1218955.1218964
17 schema:datePublished 2016
18 schema:datePublishedReg 2016-01-01
19 schema:description In this paper, we describe a technique to develop simulated user agents that are able to interact with dialog systems. By means of these agents, it is possible not only to automatically evaluate the overall operation of the dialog system, but also to assess the impact of the user responses on the decisions that are selected by the system. The selection of the user responses by the simulated user agent are based on a statistical model that is automatically learned from a dialog corpus. The complete history of the interaction is considered to carry out this selection. The paper describes the application of this technique to evaluate a practical dialog system providing tourist information and services.
20 schema:editor N35fce50b53c04be4bc22be3b49b439a9
21 schema:genre chapter
22 schema:inLanguage en
23 schema:isAccessibleForFree false
24 schema:isPartOf N31c2ac9b3d964702a44bd23109e3ee3e
25 schema:name Measuring Heterogeneous User Behaviors During the Interaction with Dialog Systems
26 schema:pagination 289-300
27 schema:productId N1840efc636e245b68cd25e88cd114a5d
28 N20f3d3bbaacc4f54a04cbed2c3d9793d
29 Nd314c3e2cd154c14a4a554867c57da29
30 schema:publisher N5237531b633b433e8c9d4f9182430579
31 schema:sameAs https://app.dimensions.ai/details/publication/pub.1015887691
32 https://doi.org/10.1007/978-3-319-39387-2_24
33 schema:sdDatePublished 2019-04-15T12:30
34 schema:sdLicense https://scigraph.springernature.com/explorer/license/
35 schema:sdPublisher N3165c16406494e3f8e9cd3ed82a8a765
36 schema:url http://link.springer.com/10.1007/978-3-319-39387-2_24
37 sgo:license sg:explorer/license/
38 sgo:sdDataset chapters
39 rdf:type schema:Chapter
40 N08634c0c9efa47f4bde69945e2ace508 schema:familyName Escalona
41 schema:givenName María José
42 rdf:type schema:Person
43 N159443a5185843e3a2052de463cf68e2 schema:familyName Novais
44 schema:givenName Paulo
45 rdf:type schema:Person
46 N1840efc636e245b68cd25e88cd114a5d schema:name doi
47 schema:value 10.1007/978-3-319-39387-2_24
48 rdf:type schema:PropertyValue
49 N20f3d3bbaacc4f54a04cbed2c3d9793d schema:name readcube_id
50 schema:value 4bb3b27dc1139ddbd6f6e43a17fe2e84c3ec7c0027137cf6d8576ffff8429a76
51 rdf:type schema:PropertyValue
52 N2e9d8efcf7e648eb8febe865f6873f49 rdf:first N159443a5185843e3a2052de463cf68e2
53 rdf:rest Ne2bf8bea679d426ba56ee22001ac50c8
54 N309e19cdf40542ea843308638febc6d9 schema:familyName Giroux
55 schema:givenName Sylvain
56 rdf:type schema:Person
57 N3165c16406494e3f8e9cd3ed82a8a765 schema:name Springer Nature - SN SciGraph project
58 rdf:type schema:Organization
59 N31c2ac9b3d964702a44bd23109e3ee3e schema:isbn 978-3-319-39386-5
60 978-3-319-39387-2
61 schema:name Highlights of Practical Applications of Scalable Multi-Agent Systems. The PAAMS Collection
62 rdf:type schema:Book
63 N35fce50b53c04be4bc22be3b49b439a9 rdf:first Ne9a081c5b72141c78c9874ea9dfd4f54
64 rdf:rest N89566ebf83f34615bef0acf18d33d4c6
65 N3a0ac7c57fc14d83a0b697d149b7777d schema:familyName Azambuja-Silveira
66 schema:givenName Ricardo
67 rdf:type schema:Person
68 N4c1bc01cead94bfa8438fbc66a532ebe schema:familyName Hoffa-Dąbrowska
69 schema:givenName Patrycja
70 rdf:type schema:Person
71 N5237531b633b433e8c9d4f9182430579 schema:location Cham
72 schema:name Springer International Publishing
73 rdf:type schema:Organisation
74 N6973f62620d5459c8c9a78cbc767a220 schema:familyName Unland
75 schema:givenName Rainer
76 rdf:type schema:Person
77 N7ad05223ca2c4efdb578689e93479b5d schema:familyName Julián
78 schema:givenName Vicente
79 rdf:type schema:Person
80 N7c33a8bc62334a94879ec56adbaa28ab rdf:first N3a0ac7c57fc14d83a0b697d149b7777d
81 rdf:rest rdf:nil
82 N89566ebf83f34615bef0acf18d33d4c6 rdf:first N08634c0c9efa47f4bde69945e2ace508
83 rdf:rest Nf7cf25c9f8294545b4deb8df3404b530
84 Na45dc2e9b083461aabc63adbbef659ea rdf:first N7ad05223ca2c4efdb578689e93479b5d
85 rdf:rest N2e9d8efcf7e648eb8febe865f6873f49
86 Nbc97271bbbc54f8a9dee6701e50f99bf rdf:first N4c1bc01cead94bfa8438fbc66a532ebe
87 rdf:rest Na45dc2e9b083461aabc63adbbef659ea
88 Nd314c3e2cd154c14a4a554867c57da29 schema:name dimensions_id
89 schema:value pub.1015887691
90 rdf:type schema:PropertyValue
91 Ndad17ed3488b4bbc80fb471c642701b3 rdf:first sg:person.013422741257.57
92 rdf:rest Ndd5cb409f2f746d6b56a6d55c16fe19c
93 Ndb96cba11f8e444884238ff521c248d0 rdf:first N6973f62620d5459c8c9a78cbc767a220
94 rdf:rest N7c33a8bc62334a94879ec56adbaa28ab
95 Ndd5cb409f2f746d6b56a6d55c16fe19c rdf:first sg:person.010563353054.10
96 rdf:rest rdf:nil
97 Ne2bf8bea679d426ba56ee22001ac50c8 rdf:first Necae3e5a240a475c8795f5079e042d79
98 rdf:rest Ndb96cba11f8e444884238ff521c248d0
99 Ne9a081c5b72141c78c9874ea9dfd4f54 schema:familyName Bajo
100 schema:givenName Javier
101 rdf:type schema:Person
102 Necae3e5a240a475c8795f5079e042d79 schema:familyName Sánchez-Pi
103 schema:givenName Nayat
104 rdf:type schema:Person
105 Nf7cf25c9f8294545b4deb8df3404b530 rdf:first N309e19cdf40542ea843308638febc6d9
106 rdf:rest Nbc97271bbbc54f8a9dee6701e50f99bf
107 anzsrc-for:08 schema:inDefinedTermSet anzsrc-for:
108 schema:name Information and Computing Sciences
109 rdf:type schema:DefinedTerm
110 anzsrc-for:0806 schema:inDefinedTermSet anzsrc-for:
111 schema:name Information Systems
112 rdf:type schema:DefinedTerm
113 sg:person.010563353054.10 schema:affiliation https://www.grid.ac/institutes/grid.7840.b
114 schema:familyName Molina
115 schema:givenName José Manuel
116 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010563353054.10
117 rdf:type schema:Person
118 sg:person.013422741257.57 schema:affiliation https://www.grid.ac/institutes/grid.7840.b
119 schema:familyName Griol
120 schema:givenName David
121 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.013422741257.57
122 rdf:type schema:Person
123 sg:pub.10.1007/978-3-319-19644-2_30 schema:sameAs https://app.dimensions.ai/details/publication/pub.1017459956
124 https://doi.org/10.1007/978-3-319-19644-2_30
125 rdf:type schema:CreativeWork
126 sg:pub.10.1007/978-3-540-39398-6_24 schema:sameAs https://app.dimensions.ai/details/publication/pub.1036042620
127 https://doi.org/10.1007/978-3-540-39398-6_24
128 rdf:type schema:CreativeWork
129 sg:pub.10.1007/978-3-642-31591-6 schema:sameAs https://app.dimensions.ai/details/publication/pub.1030055872
130 https://doi.org/10.1007/978-3-642-31591-6
131 rdf:type schema:CreativeWork
132 https://doi.org/10.1016/j.csl.2006.06.008 schema:sameAs https://app.dimensions.ai/details/publication/pub.1015870155
133 rdf:type schema:CreativeWork
134 https://doi.org/10.1016/j.csl.2009.05.002 schema:sameAs https://app.dimensions.ai/details/publication/pub.1020900983
135 rdf:type schema:CreativeWork
136 https://doi.org/10.1016/j.csl.2010.04.005 schema:sameAs https://app.dimensions.ai/details/publication/pub.1043036376
137 rdf:type schema:CreativeWork
138 https://doi.org/10.1016/j.csl.2012.07.004 schema:sameAs https://app.dimensions.ai/details/publication/pub.1013790106
139 rdf:type schema:CreativeWork
140 https://doi.org/10.1016/j.csl.2013.09.002 schema:sameAs https://app.dimensions.ai/details/publication/pub.1002867806
141 rdf:type schema:CreativeWork
142 https://doi.org/10.1016/s0167-6393(02)00126-7 schema:sameAs https://app.dimensions.ai/details/publication/pub.1037984060
143 rdf:type schema:CreativeWork
144 https://doi.org/10.1017/s0269888906000944 schema:sameAs https://app.dimensions.ai/details/publication/pub.1011556404
145 rdf:type schema:CreativeWork
146 https://doi.org/10.1109/89.928918 schema:sameAs https://app.dimensions.ai/details/publication/pub.1061242688
147 rdf:type schema:CreativeWork
148 https://doi.org/10.1109/asru.2007.4430167 schema:sameAs https://app.dimensions.ai/details/publication/pub.1093229671
149 rdf:type schema:CreativeWork
150 https://doi.org/10.3115/1218955.1218964 schema:sameAs https://app.dimensions.ai/details/publication/pub.1099221189
151 rdf:type schema:CreativeWork
152 https://www.grid.ac/institutes/grid.7840.b schema:alternateName Carlos III University of Madrid
153 schema:name Computer Science Department, Carlos III University of Madrid
154 rdf:type schema:Organization
 




Preview window. Press ESC to close (or click here)


...