Towards Fine-Grain User-Simulation for Spoken Dialogue Systems View Full Text


Ontology type: schema:Chapter     


Chapter Info

DATE

2010-11-01

AUTHORS

Ramón López-Cózar , David Griol , Gonzalo Espejo , Zoraida Callejas , Nieves Ábalos

ABSTRACT

Continuous advances in the field of spoken dialogue systems make the processe of design, implementation and evaluation of these systems more and more com-s plex. To solve problems emerging from this complexity, a technique which has attracted increasing interest during the last decades is based on the automatic generation of dialogues between the system and a user simulator, which is another system that represents human interactions with the dialogue system. This chapter describes the main methodologies and techniques developed to create user simulators, and presents a discussion of their main characteristics and the benefits that they provide for the development, improvement and assessment of this kind of systems. Additionally, we propose a user simulation technique to test the performance of spoken dialogue systems. The technique is based on a novel approach to simulating different levels of user cooperativeness, which allows carrying out a more detailed system assessment. In the experiments we have evaluated a spoken dialogue system designed for the fast food domain. Theevaluation has focused on the performance of the speech recogniser, semantic analyser and dialogue manager of this system. The results show that the technique provides relevant information to obtain a solid evaluation of the system, enabling us to find problems in these modules which cannot be observed taking into account just one cooperativeness level. More... »

PAGES

53-81

Identifiers

URI

http://scigraph.springernature.com/pub.10.1007/978-1-4419-7934-6_3

DOI

http://dx.doi.org/10.1007/978-1-4419-7934-6_3

DIMENSIONS

https://app.dimensions.ai/details/publication/pub.1010703980


Indexing Status Check whether this publication has been indexed by Scopus and Web Of Science using the SN Indexing Status Tool
Incoming Citations Browse incoming citations for this publication using opencitations.net

JSON-LD is the canonical representation for SciGraph data.

TIP: You can open this SciGraph record using an external JSON-LD service: JSON-LD Playground Google SDTT

[
  {
    "@context": "https://springernature.github.io/scigraph/jsonld/sgcontext.json", 
    "about": [
      {
        "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/08", 
        "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
        "name": "Information and Computing Sciences", 
        "type": "DefinedTerm"
      }, 
      {
        "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/0801", 
        "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
        "name": "Artificial Intelligence and Image Processing", 
        "type": "DefinedTerm"
      }
    ], 
    "author": [
      {
        "affiliation": {
          "alternateName": "Dept. of Languages and Computer Systems, University of Granada, Granada, Spain", 
          "id": "http://www.grid.ac/institutes/grid.4489.1", 
          "name": [
            "Dept. of Languages and Computer Systems, University of Granada, Granada, Spain"
          ], 
          "type": "Organization"
        }, 
        "familyName": "L\u00f3pez-C\u00f3zar", 
        "givenName": "Ram\u00f3n", 
        "id": "sg:person.013113720067.02", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.013113720067.02"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "Dept. of Computer Science, University Carlos III de Madrid, Madrid, Spain", 
          "id": "http://www.grid.ac/institutes/grid.7840.b", 
          "name": [
            "Dept. of Computer Science, University Carlos III de Madrid, Madrid, Spain"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Griol", 
        "givenName": "David", 
        "id": "sg:person.013422741257.57", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.013422741257.57"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "Dept. of Languages and Computer Systems, University of Granada, Granada, Spain", 
          "id": "http://www.grid.ac/institutes/grid.4489.1", 
          "name": [
            "Dept. of Languages and Computer Systems, University of Granada, Granada, Spain"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Espejo", 
        "givenName": "Gonzalo", 
        "id": "sg:person.016027151560.36", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.016027151560.36"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "Dept. of Languages and Computer Systems, University of Granada, Granada, Spain", 
          "id": "http://www.grid.ac/institutes/grid.4489.1", 
          "name": [
            "Dept. of Languages and Computer Systems, University of Granada, Granada, Spain"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Callejas", 
        "givenName": "Zoraida", 
        "id": "sg:person.016307634167.10", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.016307634167.10"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "Dept. of Languages and Computer Systems, University of Granada, Granada, Spain", 
          "id": "http://www.grid.ac/institutes/grid.4489.1", 
          "name": [
            "Dept. of Languages and Computer Systems, University of Granada, Granada, Spain"
          ], 
          "type": "Organization"
        }, 
        "familyName": "\u00c1balos", 
        "givenName": "Nieves", 
        "id": "sg:person.012560514745.80", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.012560514745.80"
        ], 
        "type": "Person"
      }
    ], 
    "datePublished": "2010-11-01", 
    "datePublishedReg": "2010-11-01", 
    "description": "Continuous advances in the field of spoken dialogue systems make the processe of design, implementation and evaluation of these systems more and more com-s plex. To solve problems emerging from this complexity, a technique which has attracted increasing interest during the last decades is based on the automatic generation of dialogues between the system and a user simulator, which is another system that represents human interactions with the dialogue system. This chapter describes the main methodologies and techniques developed to create user simulators, and presents a discussion of their main characteristics and the benefits that they provide for the development, improvement and assessment of this kind of systems. Additionally, we propose a user simulation technique to test the performance of spoken dialogue systems. The technique is based on a novel approach to simulating different levels of user cooperativeness, which allows carrying out a more detailed system assessment. In the experiments we have evaluated a spoken dialogue system designed for the fast food domain. Theevaluation has focused on the performance of the speech recogniser, semantic analyser and dialogue manager of this system. The results show that the technique provides relevant information to obtain a solid evaluation of the system, enabling us to find problems in these modules which cannot be observed taking into account just one cooperativeness level.", 
    "editor": [
      {
        "familyName": "Minker", 
        "givenName": "Wolfgang", 
        "type": "Person"
      }, 
      {
        "familyName": "Lee", 
        "givenName": "Gary Geunbae", 
        "type": "Person"
      }, 
      {
        "familyName": "Nakamura", 
        "givenName": "Satoshi", 
        "type": "Person"
      }, 
      {
        "familyName": "Mariani", 
        "givenName": "Joseph", 
        "type": "Person"
      }
    ], 
    "genre": "chapter", 
    "id": "sg:pub.10.1007/978-1-4419-7934-6_3", 
    "inLanguage": "en", 
    "isAccessibleForFree": false, 
    "isPartOf": {
      "isbn": [
        "978-1-4419-7933-9", 
        "978-1-4419-7934-6"
      ], 
      "name": "Spoken Dialogue Systems Technology and Design", 
      "type": "Book"
    }, 
    "keywords": [
      "dialogue systems", 
      "spoken dialogue system", 
      "user simulator", 
      "user simulation technique", 
      "kind of system", 
      "automatic generation", 
      "dialogue manager", 
      "semantic analyzer", 
      "speech recogniser", 
      "human interaction", 
      "continuous advances", 
      "relevant information", 
      "novel approach", 
      "simulator", 
      "simulation techniques", 
      "main methodologies", 
      "system assessment", 
      "recogniser", 
      "system", 
      "users", 
      "solid evaluation", 
      "main characteristics", 
      "more com", 
      "technique", 
      "performance", 
      "complexity", 
      "implementation", 
      "module", 
      "food domain", 
      "different levels", 
      "information", 
      "last decade", 
      "plexes", 
      "methodology", 
      "simulations", 
      "domain", 
      "design", 
      "evaluation", 
      "kind", 
      "managers", 
      "COM", 
      "experiments", 
      "advances", 
      "generation", 
      "improvement", 
      "interest", 
      "benefits", 
      "dialogue", 
      "theevaluation", 
      "field", 
      "cooperativeness", 
      "processe", 
      "results", 
      "development", 
      "chapter", 
      "account", 
      "analyzer", 
      "discussion", 
      "characteristics", 
      "decades", 
      "interaction", 
      "assessment", 
      "levels", 
      "problem", 
      "approach", 
      "processe of design", 
      "user cooperativeness", 
      "detailed system assessment", 
      "fast food domain", 
      "cooperativeness level", 
      "Fine-Grain User"
    ], 
    "name": "Towards Fine-Grain User-Simulation for Spoken Dialogue Systems", 
    "pagination": "53-81", 
    "productId": [
      {
        "name": "dimensions_id", 
        "type": "PropertyValue", 
        "value": [
          "pub.1010703980"
        ]
      }, 
      {
        "name": "doi", 
        "type": "PropertyValue", 
        "value": [
          "10.1007/978-1-4419-7934-6_3"
        ]
      }
    ], 
    "publisher": {
      "name": "Springer Nature", 
      "type": "Organisation"
    }, 
    "sameAs": [
      "https://doi.org/10.1007/978-1-4419-7934-6_3", 
      "https://app.dimensions.ai/details/publication/pub.1010703980"
    ], 
    "sdDataset": "chapters", 
    "sdDatePublished": "2022-01-01T19:12", 
    "sdLicense": "https://scigraph.springernature.com/explorer/license/", 
    "sdPublisher": {
      "name": "Springer Nature - SN SciGraph project", 
      "type": "Organization"
    }, 
    "sdSource": "s3://com-springernature-scigraph/baseset/20220101/entities/gbq_results/chapter/chapter_212.jsonl", 
    "type": "Chapter", 
    "url": "https://doi.org/10.1007/978-1-4419-7934-6_3"
  }
]
 

Download the RDF metadata as:  json-ld nt turtle xml License info

HOW TO GET THIS DATA PROGRAMMATICALLY:

JSON-LD is a popular format for linked data which is fully compatible with JSON.

curl -H 'Accept: application/ld+json' 'https://scigraph.springernature.com/pub.10.1007/978-1-4419-7934-6_3'

N-Triples is a line-based linked data format ideal for batch operations.

curl -H 'Accept: application/n-triples' 'https://scigraph.springernature.com/pub.10.1007/978-1-4419-7934-6_3'

Turtle is a human-readable linked data format.

curl -H 'Accept: text/turtle' 'https://scigraph.springernature.com/pub.10.1007/978-1-4419-7934-6_3'

RDF/XML is a standard XML format for linked data.

curl -H 'Accept: application/rdf+xml' 'https://scigraph.springernature.com/pub.10.1007/978-1-4419-7934-6_3'


 

This table displays all metadata directly associated to this object as RDF triples.

177 TRIPLES      23 PREDICATES      95 URIs      88 LITERALS      7 BLANK NODES

Subject Predicate Object
1 sg:pub.10.1007/978-1-4419-7934-6_3 schema:about anzsrc-for:08
2 anzsrc-for:0801
3 schema:author N82fbb2504a764839ae7ebe84aa4d86ee
4 schema:datePublished 2010-11-01
5 schema:datePublishedReg 2010-11-01
6 schema:description Continuous advances in the field of spoken dialogue systems make the processe of design, implementation and evaluation of these systems more and more com-s plex. To solve problems emerging from this complexity, a technique which has attracted increasing interest during the last decades is based on the automatic generation of dialogues between the system and a user simulator, which is another system that represents human interactions with the dialogue system. This chapter describes the main methodologies and techniques developed to create user simulators, and presents a discussion of their main characteristics and the benefits that they provide for the development, improvement and assessment of this kind of systems. Additionally, we propose a user simulation technique to test the performance of spoken dialogue systems. The technique is based on a novel approach to simulating different levels of user cooperativeness, which allows carrying out a more detailed system assessment. In the experiments we have evaluated a spoken dialogue system designed for the fast food domain. Theevaluation has focused on the performance of the speech recogniser, semantic analyser and dialogue manager of this system. The results show that the technique provides relevant information to obtain a solid evaluation of the system, enabling us to find problems in these modules which cannot be observed taking into account just one cooperativeness level.
7 schema:editor N5477e115dd78420080cdc7b256ffece7
8 schema:genre chapter
9 schema:inLanguage en
10 schema:isAccessibleForFree false
11 schema:isPartOf Nc7827555f7be4912aaa5a80d82d498db
12 schema:keywords COM
13 Fine-Grain User
14 account
15 advances
16 analyzer
17 approach
18 assessment
19 automatic generation
20 benefits
21 chapter
22 characteristics
23 complexity
24 continuous advances
25 cooperativeness
26 cooperativeness level
27 decades
28 design
29 detailed system assessment
30 development
31 dialogue
32 dialogue manager
33 dialogue systems
34 different levels
35 discussion
36 domain
37 evaluation
38 experiments
39 fast food domain
40 field
41 food domain
42 generation
43 human interaction
44 implementation
45 improvement
46 information
47 interaction
48 interest
49 kind
50 kind of system
51 last decade
52 levels
53 main characteristics
54 main methodologies
55 managers
56 methodology
57 module
58 more com
59 novel approach
60 performance
61 plexes
62 problem
63 processe
64 processe of design
65 recogniser
66 relevant information
67 results
68 semantic analyzer
69 simulation techniques
70 simulations
71 simulator
72 solid evaluation
73 speech recogniser
74 spoken dialogue system
75 system
76 system assessment
77 technique
78 theevaluation
79 user cooperativeness
80 user simulation technique
81 user simulator
82 users
83 schema:name Towards Fine-Grain User-Simulation for Spoken Dialogue Systems
84 schema:pagination 53-81
85 schema:productId N58221fb1b5ba4b549360a9b3d39d6e6f
86 Naf54059677674709b387b7d8f48dc3d6
87 schema:publisher N48d4e39d679444ab88926a6ac80ead4f
88 schema:sameAs https://app.dimensions.ai/details/publication/pub.1010703980
89 https://doi.org/10.1007/978-1-4419-7934-6_3
90 schema:sdDatePublished 2022-01-01T19:12
91 schema:sdLicense https://scigraph.springernature.com/explorer/license/
92 schema:sdPublisher Ne533858118c041d798acee4341ef09f0
93 schema:url https://doi.org/10.1007/978-1-4419-7934-6_3
94 sgo:license sg:explorer/license/
95 sgo:sdDataset chapters
96 rdf:type schema:Chapter
97 N13053e7f6bef4e07b91e40e5ff562641 rdf:first N1444365a03a341e59cb961ba4fb36171
98 rdf:rest Na1d4b6f8d24c4bf7b177bbc43e20c700
99 N1444365a03a341e59cb961ba4fb36171 schema:familyName Nakamura
100 schema:givenName Satoshi
101 rdf:type schema:Person
102 N3d612472c37645f3bdea05551046db78 schema:familyName Mariani
103 schema:givenName Joseph
104 rdf:type schema:Person
105 N48d4e39d679444ab88926a6ac80ead4f schema:name Springer Nature
106 rdf:type schema:Organisation
107 N5477e115dd78420080cdc7b256ffece7 rdf:first N68b002a683644165ad8e63dff3b824ec
108 rdf:rest N54a844f0aa064d248e419ee181c15d01
109 N54a844f0aa064d248e419ee181c15d01 rdf:first N8c3f3ec9f2f04bdaa3ddf31019ccf48c
110 rdf:rest N13053e7f6bef4e07b91e40e5ff562641
111 N58221fb1b5ba4b549360a9b3d39d6e6f schema:name doi
112 schema:value 10.1007/978-1-4419-7934-6_3
113 rdf:type schema:PropertyValue
114 N68b002a683644165ad8e63dff3b824ec schema:familyName Minker
115 schema:givenName Wolfgang
116 rdf:type schema:Person
117 N76923bc0ab824101b6cb62ac4b440ac2 rdf:first sg:person.016027151560.36
118 rdf:rest Nf4085518ea0f4ef0adb383d81421ef86
119 N82fbb2504a764839ae7ebe84aa4d86ee rdf:first sg:person.013113720067.02
120 rdf:rest Nff083e4e846a478fa223ccad925be612
121 N8c3f3ec9f2f04bdaa3ddf31019ccf48c schema:familyName Lee
122 schema:givenName Gary Geunbae
123 rdf:type schema:Person
124 Na1d4b6f8d24c4bf7b177bbc43e20c700 rdf:first N3d612472c37645f3bdea05551046db78
125 rdf:rest rdf:nil
126 Naf54059677674709b387b7d8f48dc3d6 schema:name dimensions_id
127 schema:value pub.1010703980
128 rdf:type schema:PropertyValue
129 Nc7827555f7be4912aaa5a80d82d498db schema:isbn 978-1-4419-7933-9
130 978-1-4419-7934-6
131 schema:name Spoken Dialogue Systems Technology and Design
132 rdf:type schema:Book
133 Ncd6834d777ef4b3fa46e4a13e9719e66 rdf:first sg:person.012560514745.80
134 rdf:rest rdf:nil
135 Ne533858118c041d798acee4341ef09f0 schema:name Springer Nature - SN SciGraph project
136 rdf:type schema:Organization
137 Nf4085518ea0f4ef0adb383d81421ef86 rdf:first sg:person.016307634167.10
138 rdf:rest Ncd6834d777ef4b3fa46e4a13e9719e66
139 Nff083e4e846a478fa223ccad925be612 rdf:first sg:person.013422741257.57
140 rdf:rest N76923bc0ab824101b6cb62ac4b440ac2
141 anzsrc-for:08 schema:inDefinedTermSet anzsrc-for:
142 schema:name Information and Computing Sciences
143 rdf:type schema:DefinedTerm
144 anzsrc-for:0801 schema:inDefinedTermSet anzsrc-for:
145 schema:name Artificial Intelligence and Image Processing
146 rdf:type schema:DefinedTerm
147 sg:person.012560514745.80 schema:affiliation grid-institutes:grid.4489.1
148 schema:familyName Ábalos
149 schema:givenName Nieves
150 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.012560514745.80
151 rdf:type schema:Person
152 sg:person.013113720067.02 schema:affiliation grid-institutes:grid.4489.1
153 schema:familyName López-Cózar
154 schema:givenName Ramón
155 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.013113720067.02
156 rdf:type schema:Person
157 sg:person.013422741257.57 schema:affiliation grid-institutes:grid.7840.b
158 schema:familyName Griol
159 schema:givenName David
160 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.013422741257.57
161 rdf:type schema:Person
162 sg:person.016027151560.36 schema:affiliation grid-institutes:grid.4489.1
163 schema:familyName Espejo
164 schema:givenName Gonzalo
165 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.016027151560.36
166 rdf:type schema:Person
167 sg:person.016307634167.10 schema:affiliation grid-institutes:grid.4489.1
168 schema:familyName Callejas
169 schema:givenName Zoraida
170 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.016307634167.10
171 rdf:type schema:Person
172 grid-institutes:grid.4489.1 schema:alternateName Dept. of Languages and Computer Systems, University of Granada, Granada, Spain
173 schema:name Dept. of Languages and Computer Systems, University of Granada, Granada, Spain
174 rdf:type schema:Organization
175 grid-institutes:grid.7840.b schema:alternateName Dept. of Computer Science, University Carlos III de Madrid, Madrid, Spain
176 schema:name Dept. of Computer Science, University Carlos III de Madrid, Madrid, Spain
177 rdf:type schema:Organization
 




Preview window. Press ESC to close (or click here)


...