Towards Fine-Grain User-Simulation for Spoken Dialogue Systems View Full Text


Ontology type: schema:Chapter     


Chapter Info

DATE

2010-11-01

AUTHORS

Ramón López-Cózar , David Griol , Gonzalo Espejo , Zoraida Callejas , Nieves Ábalos

ABSTRACT

Continuous advances in the field of spoken dialogue systems make the processe of design, implementation and evaluation of these systems more and more com-s plex. To solve problems emerging from this complexity, a technique which has attracted increasing interest during the last decades is based on the automatic generation of dialogues between the system and a user simulator, which is another system that represents human interactions with the dialogue system. This chapter describes the main methodologies and techniques developed to create user simulators, and presents a discussion of their main characteristics and the benefits that they provide for the development, improvement and assessment of this kind of systems. Additionally, we propose a user simulation technique to test the performance of spoken dialogue systems. The technique is based on a novel approach to simulating different levels of user cooperativeness, which allows carrying out a more detailed system assessment. In the experiments we have evaluated a spoken dialogue system designed for the fast food domain. Theevaluation has focused on the performance of the speech recogniser, semantic analyser and dialogue manager of this system. The results show that the technique provides relevant information to obtain a solid evaluation of the system, enabling us to find problems in these modules which cannot be observed taking into account just one cooperativeness level. More... »

PAGES

53-81

Identifiers

URI

http://scigraph.springernature.com/pub.10.1007/978-1-4419-7934-6_3

DOI

http://dx.doi.org/10.1007/978-1-4419-7934-6_3

DIMENSIONS

https://app.dimensions.ai/details/publication/pub.1010703980


Indexing Status Check whether this publication has been indexed by Scopus and Web Of Science using the SN Indexing Status Tool
Incoming Citations Browse incoming citations for this publication using opencitations.net

JSON-LD is the canonical representation for SciGraph data.

TIP: You can open this SciGraph record using an external JSON-LD service: JSON-LD Playground Google SDTT

[
  {
    "@context": "https://springernature.github.io/scigraph/jsonld/sgcontext.json", 
    "about": [
      {
        "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/08", 
        "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
        "name": "Information and Computing Sciences", 
        "type": "DefinedTerm"
      }, 
      {
        "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/0801", 
        "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
        "name": "Artificial Intelligence and Image Processing", 
        "type": "DefinedTerm"
      }
    ], 
    "author": [
      {
        "affiliation": {
          "alternateName": "Dept. of Languages and Computer Systems, University of Granada, Granada, Spain", 
          "id": "http://www.grid.ac/institutes/grid.4489.1", 
          "name": [
            "Dept. of Languages and Computer Systems, University of Granada, Granada, Spain"
          ], 
          "type": "Organization"
        }, 
        "familyName": "L\u00f3pez-C\u00f3zar", 
        "givenName": "Ram\u00f3n", 
        "id": "sg:person.013113720067.02", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.013113720067.02"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "Dept. of Computer Science, University Carlos III de Madrid, Madrid, Spain", 
          "id": "http://www.grid.ac/institutes/grid.7840.b", 
          "name": [
            "Dept. of Computer Science, University Carlos III de Madrid, Madrid, Spain"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Griol", 
        "givenName": "David", 
        "id": "sg:person.013422741257.57", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.013422741257.57"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "Dept. of Languages and Computer Systems, University of Granada, Granada, Spain", 
          "id": "http://www.grid.ac/institutes/grid.4489.1", 
          "name": [
            "Dept. of Languages and Computer Systems, University of Granada, Granada, Spain"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Espejo", 
        "givenName": "Gonzalo", 
        "id": "sg:person.016027151560.36", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.016027151560.36"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "Dept. of Languages and Computer Systems, University of Granada, Granada, Spain", 
          "id": "http://www.grid.ac/institutes/grid.4489.1", 
          "name": [
            "Dept. of Languages and Computer Systems, University of Granada, Granada, Spain"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Callejas", 
        "givenName": "Zoraida", 
        "id": "sg:person.016307634167.10", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.016307634167.10"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "Dept. of Languages and Computer Systems, University of Granada, Granada, Spain", 
          "id": "http://www.grid.ac/institutes/grid.4489.1", 
          "name": [
            "Dept. of Languages and Computer Systems, University of Granada, Granada, Spain"
          ], 
          "type": "Organization"
        }, 
        "familyName": "\u00c1balos", 
        "givenName": "Nieves", 
        "id": "sg:person.012560514745.80", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.012560514745.80"
        ], 
        "type": "Person"
      }
    ], 
    "datePublished": "2010-11-01", 
    "datePublishedReg": "2010-11-01", 
    "description": "Continuous advances in the field of spoken dialogue systems make the processe of design, implementation and evaluation of these systems more and more com-s plex. To solve problems emerging from this complexity, a technique which has attracted increasing interest during the last decades is based on the automatic generation of dialogues between the system and a user simulator, which is another system that represents human interactions with the dialogue system. This chapter describes the main methodologies and techniques developed to create user simulators, and presents a discussion of their main characteristics and the benefits that they provide for the development, improvement and assessment of this kind of systems. Additionally, we propose a user simulation technique to test the performance of spoken dialogue systems. The technique is based on a novel approach to simulating different levels of user cooperativeness, which allows carrying out a more detailed system assessment. In the experiments we have evaluated a spoken dialogue system designed for the fast food domain. Theevaluation has focused on the performance of the speech recogniser, semantic analyser and dialogue manager of this system. The results show that the technique provides relevant information to obtain a solid evaluation of the system, enabling us to find problems in these modules which cannot be observed taking into account just one cooperativeness level.", 
    "editor": [
      {
        "familyName": "Minker", 
        "givenName": "Wolfgang", 
        "type": "Person"
      }, 
      {
        "familyName": "Lee", 
        "givenName": "Gary Geunbae", 
        "type": "Person"
      }, 
      {
        "familyName": "Nakamura", 
        "givenName": "Satoshi", 
        "type": "Person"
      }, 
      {
        "familyName": "Mariani", 
        "givenName": "Joseph", 
        "type": "Person"
      }
    ], 
    "genre": "chapter", 
    "id": "sg:pub.10.1007/978-1-4419-7934-6_3", 
    "inLanguage": "en", 
    "isAccessibleForFree": false, 
    "isPartOf": {
      "isbn": [
        "978-1-4419-7933-9", 
        "978-1-4419-7934-6"
      ], 
      "name": "Spoken Dialogue Systems Technology and Design", 
      "type": "Book"
    }, 
    "keywords": [
      "dialogue systems", 
      "spoken dialogue system", 
      "user simulator", 
      "user simulation technique", 
      "kind of system", 
      "automatic generation", 
      "dialogue manager", 
      "semantic analyzer", 
      "speech recogniser", 
      "human interaction", 
      "continuous advances", 
      "relevant information", 
      "novel approach", 
      "simulator", 
      "simulation techniques", 
      "main methodologies", 
      "system assessment", 
      "recogniser", 
      "system", 
      "users", 
      "solid evaluation", 
      "main characteristics", 
      "more com", 
      "technique", 
      "performance", 
      "complexity", 
      "implementation", 
      "module", 
      "food domain", 
      "different levels", 
      "information", 
      "last decade", 
      "plexes", 
      "methodology", 
      "simulations", 
      "domain", 
      "design", 
      "evaluation", 
      "kind", 
      "managers", 
      "COM", 
      "experiments", 
      "advances", 
      "generation", 
      "improvement", 
      "interest", 
      "benefits", 
      "dialogue", 
      "theevaluation", 
      "field", 
      "cooperativeness", 
      "processe", 
      "results", 
      "development", 
      "chapter", 
      "account", 
      "analyzer", 
      "discussion", 
      "characteristics", 
      "decades", 
      "interaction", 
      "assessment", 
      "levels", 
      "problem", 
      "approach", 
      "processe of design", 
      "user cooperativeness", 
      "detailed system assessment", 
      "fast food domain", 
      "cooperativeness level", 
      "Fine-Grain User"
    ], 
    "name": "Towards Fine-Grain User-Simulation for Spoken Dialogue Systems", 
    "pagination": "53-81", 
    "productId": [
      {
        "name": "dimensions_id", 
        "type": "PropertyValue", 
        "value": [
          "pub.1010703980"
        ]
      }, 
      {
        "name": "doi", 
        "type": "PropertyValue", 
        "value": [
          "10.1007/978-1-4419-7934-6_3"
        ]
      }
    ], 
    "publisher": {
      "name": "Springer Nature", 
      "type": "Organisation"
    }, 
    "sameAs": [
      "https://doi.org/10.1007/978-1-4419-7934-6_3", 
      "https://app.dimensions.ai/details/publication/pub.1010703980"
    ], 
    "sdDataset": "chapters", 
    "sdDatePublished": "2021-11-01T18:48", 
    "sdLicense": "https://scigraph.springernature.com/explorer/license/", 
    "sdPublisher": {
      "name": "Springer Nature - SN SciGraph project", 
      "type": "Organization"
    }, 
    "sdSource": "s3://com-springernature-scigraph/baseset/20211101/entities/gbq_results/chapter/chapter_175.jsonl", 
    "type": "Chapter", 
    "url": "https://doi.org/10.1007/978-1-4419-7934-6_3"
  }
]
 

Download the RDF metadata as:  json-ld nt turtle xml License info

HOW TO GET THIS DATA PROGRAMMATICALLY:

JSON-LD is a popular format for linked data which is fully compatible with JSON.

curl -H 'Accept: application/ld+json' 'https://scigraph.springernature.com/pub.10.1007/978-1-4419-7934-6_3'

N-Triples is a line-based linked data format ideal for batch operations.

curl -H 'Accept: application/n-triples' 'https://scigraph.springernature.com/pub.10.1007/978-1-4419-7934-6_3'

Turtle is a human-readable linked data format.

curl -H 'Accept: text/turtle' 'https://scigraph.springernature.com/pub.10.1007/978-1-4419-7934-6_3'

RDF/XML is a standard XML format for linked data.

curl -H 'Accept: application/rdf+xml' 'https://scigraph.springernature.com/pub.10.1007/978-1-4419-7934-6_3'


 

This table displays all metadata directly associated to this object as RDF triples.

177 TRIPLES      23 PREDICATES      95 URIs      88 LITERALS      7 BLANK NODES

Subject Predicate Object
1 sg:pub.10.1007/978-1-4419-7934-6_3 schema:about anzsrc-for:08
2 anzsrc-for:0801
3 schema:author N15048067d76a4749be8b4af963fee35b
4 schema:datePublished 2010-11-01
5 schema:datePublishedReg 2010-11-01
6 schema:description Continuous advances in the field of spoken dialogue systems make the processe of design, implementation and evaluation of these systems more and more com-s plex. To solve problems emerging from this complexity, a technique which has attracted increasing interest during the last decades is based on the automatic generation of dialogues between the system and a user simulator, which is another system that represents human interactions with the dialogue system. This chapter describes the main methodologies and techniques developed to create user simulators, and presents a discussion of their main characteristics and the benefits that they provide for the development, improvement and assessment of this kind of systems. Additionally, we propose a user simulation technique to test the performance of spoken dialogue systems. The technique is based on a novel approach to simulating different levels of user cooperativeness, which allows carrying out a more detailed system assessment. In the experiments we have evaluated a spoken dialogue system designed for the fast food domain. Theevaluation has focused on the performance of the speech recogniser, semantic analyser and dialogue manager of this system. The results show that the technique provides relevant information to obtain a solid evaluation of the system, enabling us to find problems in these modules which cannot be observed taking into account just one cooperativeness level.
7 schema:editor N29031112a3824447960d5970f77ef194
8 schema:genre chapter
9 schema:inLanguage en
10 schema:isAccessibleForFree false
11 schema:isPartOf Nae815323b6024d1683326ebb09bacd4a
12 schema:keywords COM
13 Fine-Grain User
14 account
15 advances
16 analyzer
17 approach
18 assessment
19 automatic generation
20 benefits
21 chapter
22 characteristics
23 complexity
24 continuous advances
25 cooperativeness
26 cooperativeness level
27 decades
28 design
29 detailed system assessment
30 development
31 dialogue
32 dialogue manager
33 dialogue systems
34 different levels
35 discussion
36 domain
37 evaluation
38 experiments
39 fast food domain
40 field
41 food domain
42 generation
43 human interaction
44 implementation
45 improvement
46 information
47 interaction
48 interest
49 kind
50 kind of system
51 last decade
52 levels
53 main characteristics
54 main methodologies
55 managers
56 methodology
57 module
58 more com
59 novel approach
60 performance
61 plexes
62 problem
63 processe
64 processe of design
65 recogniser
66 relevant information
67 results
68 semantic analyzer
69 simulation techniques
70 simulations
71 simulator
72 solid evaluation
73 speech recogniser
74 spoken dialogue system
75 system
76 system assessment
77 technique
78 theevaluation
79 user cooperativeness
80 user simulation technique
81 user simulator
82 users
83 schema:name Towards Fine-Grain User-Simulation for Spoken Dialogue Systems
84 schema:pagination 53-81
85 schema:productId N615c2dda148c405591945bc26491ac80
86 N7ed639ad2ab34b65b61f884a9c026b4b
87 schema:publisher N09f5e09522e04f79a875a43cc94cfd96
88 schema:sameAs https://app.dimensions.ai/details/publication/pub.1010703980
89 https://doi.org/10.1007/978-1-4419-7934-6_3
90 schema:sdDatePublished 2021-11-01T18:48
91 schema:sdLicense https://scigraph.springernature.com/explorer/license/
92 schema:sdPublisher Ne70d1e0775604c49957cf5e023818eba
93 schema:url https://doi.org/10.1007/978-1-4419-7934-6_3
94 sgo:license sg:explorer/license/
95 sgo:sdDataset chapters
96 rdf:type schema:Chapter
97 N09f5e09522e04f79a875a43cc94cfd96 schema:name Springer Nature
98 rdf:type schema:Organisation
99 N0fae1eaf8a2d4db4ab0bc9cf523fd03e rdf:first sg:person.013422741257.57
100 rdf:rest Nc47167b281e94b22affe88bfa7870ba4
101 N15048067d76a4749be8b4af963fee35b rdf:first sg:person.013113720067.02
102 rdf:rest N0fae1eaf8a2d4db4ab0bc9cf523fd03e
103 N19020cb237c249a580e0fb3a523baacd rdf:first N616e2477befa4f5d973ba78c682815ef
104 rdf:rest rdf:nil
105 N21b6979dc8604047b0a9aa69de56db5f schema:familyName Minker
106 schema:givenName Wolfgang
107 rdf:type schema:Person
108 N29031112a3824447960d5970f77ef194 rdf:first N21b6979dc8604047b0a9aa69de56db5f
109 rdf:rest Nee6bf9876f124308af7f74dc9c9d606b
110 N33998152a99749719f8c4e6a2a3eba6e rdf:first sg:person.012560514745.80
111 rdf:rest rdf:nil
112 N615c2dda148c405591945bc26491ac80 schema:name dimensions_id
113 schema:value pub.1010703980
114 rdf:type schema:PropertyValue
115 N616e2477befa4f5d973ba78c682815ef schema:familyName Mariani
116 schema:givenName Joseph
117 rdf:type schema:Person
118 N6b61d026d65340c999c101ce6f1efb6b rdf:first Ne7cbbd0055ef4cf2bdfa7916b87a7a90
119 rdf:rest N19020cb237c249a580e0fb3a523baacd
120 N7ed639ad2ab34b65b61f884a9c026b4b schema:name doi
121 schema:value 10.1007/978-1-4419-7934-6_3
122 rdf:type schema:PropertyValue
123 Nae815323b6024d1683326ebb09bacd4a schema:isbn 978-1-4419-7933-9
124 978-1-4419-7934-6
125 schema:name Spoken Dialogue Systems Technology and Design
126 rdf:type schema:Book
127 Naee8e406fcd348bc8a846c5ae3dc6333 rdf:first sg:person.016307634167.10
128 rdf:rest N33998152a99749719f8c4e6a2a3eba6e
129 Nc47167b281e94b22affe88bfa7870ba4 rdf:first sg:person.016027151560.36
130 rdf:rest Naee8e406fcd348bc8a846c5ae3dc6333
131 Ne70d1e0775604c49957cf5e023818eba schema:name Springer Nature - SN SciGraph project
132 rdf:type schema:Organization
133 Ne7cbbd0055ef4cf2bdfa7916b87a7a90 schema:familyName Nakamura
134 schema:givenName Satoshi
135 rdf:type schema:Person
136 Nee6bf9876f124308af7f74dc9c9d606b rdf:first Nf6eebbdeb5ee4d76b8b574a084b313f4
137 rdf:rest N6b61d026d65340c999c101ce6f1efb6b
138 Nf6eebbdeb5ee4d76b8b574a084b313f4 schema:familyName Lee
139 schema:givenName Gary Geunbae
140 rdf:type schema:Person
141 anzsrc-for:08 schema:inDefinedTermSet anzsrc-for:
142 schema:name Information and Computing Sciences
143 rdf:type schema:DefinedTerm
144 anzsrc-for:0801 schema:inDefinedTermSet anzsrc-for:
145 schema:name Artificial Intelligence and Image Processing
146 rdf:type schema:DefinedTerm
147 sg:person.012560514745.80 schema:affiliation grid-institutes:grid.4489.1
148 schema:familyName Ábalos
149 schema:givenName Nieves
150 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.012560514745.80
151 rdf:type schema:Person
152 sg:person.013113720067.02 schema:affiliation grid-institutes:grid.4489.1
153 schema:familyName López-Cózar
154 schema:givenName Ramón
155 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.013113720067.02
156 rdf:type schema:Person
157 sg:person.013422741257.57 schema:affiliation grid-institutes:grid.7840.b
158 schema:familyName Griol
159 schema:givenName David
160 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.013422741257.57
161 rdf:type schema:Person
162 sg:person.016027151560.36 schema:affiliation grid-institutes:grid.4489.1
163 schema:familyName Espejo
164 schema:givenName Gonzalo
165 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.016027151560.36
166 rdf:type schema:Person
167 sg:person.016307634167.10 schema:affiliation grid-institutes:grid.4489.1
168 schema:familyName Callejas
169 schema:givenName Zoraida
170 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.016307634167.10
171 rdf:type schema:Person
172 grid-institutes:grid.4489.1 schema:alternateName Dept. of Languages and Computer Systems, University of Granada, Granada, Spain
173 schema:name Dept. of Languages and Computer Systems, University of Granada, Granada, Spain
174 rdf:type schema:Organization
175 grid-institutes:grid.7840.b schema:alternateName Dept. of Computer Science, University Carlos III de Madrid, Madrid, Spain
176 schema:name Dept. of Computer Science, University Carlos III de Madrid, Madrid, Spain
177 rdf:type schema:Organization
 




Preview window. Press ESC to close (or click here)


...