Design and Implementation of a Toolkit for Evaluation of Spoken Dialogue Systems Designed for AmI Environments View Full Text


Ontology type: schema:Chapter     


Chapter Info

DATE

2011-08-12

AUTHORS

Nieves Ábalos , Gonzalo Espejo , Ramón López-Cózar , Zoraida Callejas , David Griol

ABSTRACT

This paper presents a new toolkit for the evaluation of spoken dialogue systems in Ambient Intelligence domains. It describes the design and implementation of the toolkit, which consists in several tools that can be employed to process corpora of recorded spoken interaction and automatically obtain statistical measures in order to assess and improve these systems. The toolkit has been applied to evaluate the Mayordomo multimodal dialogue system developed in our laboratory, which enables automatic control of home appliances. This evaluation was useful to detect problems in the dialogue system suggesting which modules must be improved. More... »

PAGES

343-355

References to SciGraph publications

Book

TITLE

Proceedings of the Paralinguistic Information and its Integration in Spoken Dialogue Systems Workshop

ISBN

978-1-4614-1334-9
978-1-4614-1335-6

Identifiers

URI

http://scigraph.springernature.com/pub.10.1007/978-1-4614-1335-6_33

DOI

http://dx.doi.org/10.1007/978-1-4614-1335-6_33

DIMENSIONS

https://app.dimensions.ai/details/publication/pub.1016811883


Indexing Status Check whether this publication has been indexed by Scopus and Web Of Science using the SN Indexing Status Tool
Incoming Citations Browse incoming citations for this publication using opencitations.net

JSON-LD is the canonical representation for SciGraph data.

TIP: You can open this SciGraph record using an external JSON-LD service: JSON-LD Playground Google SDTT

[
  {
    "@context": "https://springernature.github.io/scigraph/jsonld/sgcontext.json", 
    "about": [
      {
        "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/0801", 
        "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
        "name": "Artificial Intelligence and Image Processing", 
        "type": "DefinedTerm"
      }, 
      {
        "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/08", 
        "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
        "name": "Information and Computing Sciences", 
        "type": "DefinedTerm"
      }
    ], 
    "author": [
      {
        "affiliation": {
          "alternateName": "University of Granada", 
          "id": "https://www.grid.ac/institutes/grid.4489.1", 
          "name": [
            "Dept. of LSI, CITIC-UGR, University of Granada, Granada, Spain"
          ], 
          "type": "Organization"
        }, 
        "familyName": "\u00c1balos", 
        "givenName": "Nieves", 
        "id": "sg:person.012560514745.80", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.012560514745.80"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "University of Granada", 
          "id": "https://www.grid.ac/institutes/grid.4489.1", 
          "name": [
            "Dept. of LSI, CITIC-UGR, University of Granada, Granada, Spain"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Espejo", 
        "givenName": "Gonzalo", 
        "id": "sg:person.016027151560.36", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.016027151560.36"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "University of Granada", 
          "id": "https://www.grid.ac/institutes/grid.4489.1", 
          "name": [
            "Dept. of LSI, CITIC-UGR, University of Granada, Granada, Spain"
          ], 
          "type": "Organization"
        }, 
        "familyName": "L\u00f3pez-C\u00f3zar", 
        "givenName": "Ram\u00f3n", 
        "id": "sg:person.013113720067.02", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.013113720067.02"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "University of Granada", 
          "id": "https://www.grid.ac/institutes/grid.4489.1", 
          "name": [
            "Dept. of LSI, CITIC-UGR, University of Granada, Granada, Spain"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Callejas", 
        "givenName": "Zoraida", 
        "id": "sg:person.016307634167.10", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.016307634167.10"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "Carlos III University of Madrid", 
          "id": "https://www.grid.ac/institutes/grid.7840.b", 
          "name": [
            "Dept. of Computer Science, Carlos III University of Madrid, Madrid, Spain"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Griol", 
        "givenName": "David", 
        "id": "sg:person.013422741257.57", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.013422741257.57"
        ], 
        "type": "Person"
      }
    ], 
    "citation": [
      {
        "id": "sg:pub.10.1007/978-1-4419-7934-6_3", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1010703980", 
          "https://doi.org/10.1007/978-1-4419-7934-6_3"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/3-540-63175-5_46", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1015758853", 
          "https://doi.org/10.1007/3-540-63175-5_46"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-3-642-15760-8_62", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1034546674", 
          "https://doi.org/10.1007/978-3-642-15760-8_62"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1016/s0167-6393(02)00126-7", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1037984060"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1016/s0167-6393(02)00126-7", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1037984060"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-0-85729-414-2", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1049197639", 
          "https://doi.org/10.1007/978-0-85729-414-2"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-0-85729-414-2", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1049197639", 
          "https://doi.org/10.1007/978-0-85729-414-2"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1109/icslp.1996.607774", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1093436792"
        ], 
        "type": "CreativeWork"
      }
    ], 
    "datePublished": "2011-08-12", 
    "datePublishedReg": "2011-08-12", 
    "description": "This paper presents a new toolkit for the evaluation of spoken dialogue systems in Ambient Intelligence domains. It describes the design and implementation of the toolkit, which consists in several tools that can be employed to process corpora of recorded spoken interaction and automatically obtain statistical measures in order to assess and improve these systems. The toolkit has been applied to evaluate the Mayordomo multimodal dialogue system developed in our laboratory, which enables automatic control of home appliances. This evaluation was useful to detect problems in the dialogue system suggesting which modules must be improved.", 
    "editor": [
      {
        "familyName": "Delgado", 
        "givenName": "Ram\u00f3n L\u00f3pez-C\u00f3zar", 
        "type": "Person"
      }, 
      {
        "familyName": "Kobayashi", 
        "givenName": "Tetsunori", 
        "type": "Person"
      }
    ], 
    "genre": "chapter", 
    "id": "sg:pub.10.1007/978-1-4614-1335-6_33", 
    "inLanguage": [
      "en"
    ], 
    "isAccessibleForFree": false, 
    "isPartOf": {
      "isbn": [
        "978-1-4614-1334-9", 
        "978-1-4614-1335-6"
      ], 
      "name": "Proceedings of the Paralinguistic Information and its Integration in Spoken Dialogue Systems Workshop", 
      "type": "Book"
    }, 
    "name": "Design and Implementation of a Toolkit for Evaluation of Spoken Dialogue Systems Designed for AmI Environments", 
    "pagination": "343-355", 
    "productId": [
      {
        "name": "dimensions_id", 
        "type": "PropertyValue", 
        "value": [
          "pub.1016811883"
        ]
      }, 
      {
        "name": "doi", 
        "type": "PropertyValue", 
        "value": [
          "10.1007/978-1-4614-1335-6_33"
        ]
      }, 
      {
        "name": "readcube_id", 
        "type": "PropertyValue", 
        "value": [
          "501a1c6cb221cb09fdeded610a9e55fe2885ac7036bac03c78da957ebe9436a5"
        ]
      }
    ], 
    "publisher": {
      "location": "New York, NY", 
      "name": "Springer New York", 
      "type": "Organisation"
    }, 
    "sameAs": [
      "https://doi.org/10.1007/978-1-4614-1335-6_33", 
      "https://app.dimensions.ai/details/publication/pub.1016811883"
    ], 
    "sdDataset": "chapters", 
    "sdDatePublished": "2019-04-16T09:15", 
    "sdLicense": "https://scigraph.springernature.com/explorer/license/", 
    "sdPublisher": {
      "name": "Springer Nature - SN SciGraph project", 
      "type": "Organization"
    }, 
    "sdSource": "s3://com-uberresearch-data-dimensions-target-20181106-alternative/cleanup/v134/2549eaecd7973599484d7c17b260dba0a4ecb94b/merge/v9/a6c9fde33151104705d4d7ff012ea9563521a3ce/jats-lookup/v90/0000000371_0000000371/records_130811_00000001.jsonl", 
    "type": "Chapter", 
    "url": "https://link.springer.com/10.1007%2F978-1-4614-1335-6_33"
  }
]
 

Download the RDF metadata as:  json-ld nt turtle xml License info

HOW TO GET THIS DATA PROGRAMMATICALLY:

JSON-LD is a popular format for linked data which is fully compatible with JSON.

curl -H 'Accept: application/ld+json' 'https://scigraph.springernature.com/pub.10.1007/978-1-4614-1335-6_33'

N-Triples is a line-based linked data format ideal for batch operations.

curl -H 'Accept: application/n-triples' 'https://scigraph.springernature.com/pub.10.1007/978-1-4614-1335-6_33'

Turtle is a human-readable linked data format.

curl -H 'Accept: text/turtle' 'https://scigraph.springernature.com/pub.10.1007/978-1-4614-1335-6_33'

RDF/XML is a standard XML format for linked data.

curl -H 'Accept: application/rdf+xml' 'https://scigraph.springernature.com/pub.10.1007/978-1-4614-1335-6_33'


 

This table displays all metadata directly associated to this object as RDF triples.

123 TRIPLES      23 PREDICATES      32 URIs      19 LITERALS      8 BLANK NODES

Subject Predicate Object
1 sg:pub.10.1007/978-1-4614-1335-6_33 schema:about anzsrc-for:08
2 anzsrc-for:0801
3 schema:author Ndbcade1cb99c469988cae82003d348e4
4 schema:citation sg:pub.10.1007/3-540-63175-5_46
5 sg:pub.10.1007/978-0-85729-414-2
6 sg:pub.10.1007/978-1-4419-7934-6_3
7 sg:pub.10.1007/978-3-642-15760-8_62
8 https://doi.org/10.1016/s0167-6393(02)00126-7
9 https://doi.org/10.1109/icslp.1996.607774
10 schema:datePublished 2011-08-12
11 schema:datePublishedReg 2011-08-12
12 schema:description This paper presents a new toolkit for the evaluation of spoken dialogue systems in Ambient Intelligence domains. It describes the design and implementation of the toolkit, which consists in several tools that can be employed to process corpora of recorded spoken interaction and automatically obtain statistical measures in order to assess and improve these systems. The toolkit has been applied to evaluate the Mayordomo multimodal dialogue system developed in our laboratory, which enables automatic control of home appliances. This evaluation was useful to detect problems in the dialogue system suggesting which modules must be improved.
13 schema:editor Ne12c9d995cee459fb4eb84048c1ab6d6
14 schema:genre chapter
15 schema:inLanguage en
16 schema:isAccessibleForFree false
17 schema:isPartOf N442de06b5a384f3193e8a105900a13eb
18 schema:name Design and Implementation of a Toolkit for Evaluation of Spoken Dialogue Systems Designed for AmI Environments
19 schema:pagination 343-355
20 schema:productId N6cea330d469a4c6bac6ff39442ecfc2f
21 N9b9cbeb72d614993803daad0ce6ceab9
22 Ne5528aec78ac4daeb3273fd234ecd7ab
23 schema:publisher Nf410aa06d91e4ed39ea08c94731e974a
24 schema:sameAs https://app.dimensions.ai/details/publication/pub.1016811883
25 https://doi.org/10.1007/978-1-4614-1335-6_33
26 schema:sdDatePublished 2019-04-16T09:15
27 schema:sdLicense https://scigraph.springernature.com/explorer/license/
28 schema:sdPublisher N65095d5aa460404586e95a5424b8b179
29 schema:url https://link.springer.com/10.1007%2F978-1-4614-1335-6_33
30 sgo:license sg:explorer/license/
31 sgo:sdDataset chapters
32 rdf:type schema:Chapter
33 N26c03d63b7df4148b7f58df64edc30a3 rdf:first sg:person.013113720067.02
34 rdf:rest N354403bd62db4881a8eca3bd6cc16d8f
35 N354403bd62db4881a8eca3bd6cc16d8f rdf:first sg:person.016307634167.10
36 rdf:rest N3fa83fed21b74c688b2cddc204661b3e
37 N3fa83fed21b74c688b2cddc204661b3e rdf:first sg:person.013422741257.57
38 rdf:rest rdf:nil
39 N4253b666225d46c180c6fe3cedb3a329 rdf:first sg:person.016027151560.36
40 rdf:rest N26c03d63b7df4148b7f58df64edc30a3
41 N442de06b5a384f3193e8a105900a13eb schema:isbn 978-1-4614-1334-9
42 978-1-4614-1335-6
43 schema:name Proceedings of the Paralinguistic Information and its Integration in Spoken Dialogue Systems Workshop
44 rdf:type schema:Book
45 N65095d5aa460404586e95a5424b8b179 schema:name Springer Nature - SN SciGraph project
46 rdf:type schema:Organization
47 N6cea330d469a4c6bac6ff39442ecfc2f schema:name readcube_id
48 schema:value 501a1c6cb221cb09fdeded610a9e55fe2885ac7036bac03c78da957ebe9436a5
49 rdf:type schema:PropertyValue
50 N7da4322017654e68bfbd28fd912f3909 rdf:first N9b9f6953f3484e5aa17ea02131394698
51 rdf:rest rdf:nil
52 N9b9cbeb72d614993803daad0ce6ceab9 schema:name dimensions_id
53 schema:value pub.1016811883
54 rdf:type schema:PropertyValue
55 N9b9f6953f3484e5aa17ea02131394698 schema:familyName Kobayashi
56 schema:givenName Tetsunori
57 rdf:type schema:Person
58 Nda7c33a7d90444f8a72b3f317831b221 schema:familyName Delgado
59 schema:givenName Ramón López-Cózar
60 rdf:type schema:Person
61 Ndbcade1cb99c469988cae82003d348e4 rdf:first sg:person.012560514745.80
62 rdf:rest N4253b666225d46c180c6fe3cedb3a329
63 Ne12c9d995cee459fb4eb84048c1ab6d6 rdf:first Nda7c33a7d90444f8a72b3f317831b221
64 rdf:rest N7da4322017654e68bfbd28fd912f3909
65 Ne5528aec78ac4daeb3273fd234ecd7ab schema:name doi
66 schema:value 10.1007/978-1-4614-1335-6_33
67 rdf:type schema:PropertyValue
68 Nf410aa06d91e4ed39ea08c94731e974a schema:location New York, NY
69 schema:name Springer New York
70 rdf:type schema:Organisation
71 anzsrc-for:08 schema:inDefinedTermSet anzsrc-for:
72 schema:name Information and Computing Sciences
73 rdf:type schema:DefinedTerm
74 anzsrc-for:0801 schema:inDefinedTermSet anzsrc-for:
75 schema:name Artificial Intelligence and Image Processing
76 rdf:type schema:DefinedTerm
77 sg:person.012560514745.80 schema:affiliation https://www.grid.ac/institutes/grid.4489.1
78 schema:familyName Ábalos
79 schema:givenName Nieves
80 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.012560514745.80
81 rdf:type schema:Person
82 sg:person.013113720067.02 schema:affiliation https://www.grid.ac/institutes/grid.4489.1
83 schema:familyName López-Cózar
84 schema:givenName Ramón
85 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.013113720067.02
86 rdf:type schema:Person
87 sg:person.013422741257.57 schema:affiliation https://www.grid.ac/institutes/grid.7840.b
88 schema:familyName Griol
89 schema:givenName David
90 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.013422741257.57
91 rdf:type schema:Person
92 sg:person.016027151560.36 schema:affiliation https://www.grid.ac/institutes/grid.4489.1
93 schema:familyName Espejo
94 schema:givenName Gonzalo
95 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.016027151560.36
96 rdf:type schema:Person
97 sg:person.016307634167.10 schema:affiliation https://www.grid.ac/institutes/grid.4489.1
98 schema:familyName Callejas
99 schema:givenName Zoraida
100 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.016307634167.10
101 rdf:type schema:Person
102 sg:pub.10.1007/3-540-63175-5_46 schema:sameAs https://app.dimensions.ai/details/publication/pub.1015758853
103 https://doi.org/10.1007/3-540-63175-5_46
104 rdf:type schema:CreativeWork
105 sg:pub.10.1007/978-0-85729-414-2 schema:sameAs https://app.dimensions.ai/details/publication/pub.1049197639
106 https://doi.org/10.1007/978-0-85729-414-2
107 rdf:type schema:CreativeWork
108 sg:pub.10.1007/978-1-4419-7934-6_3 schema:sameAs https://app.dimensions.ai/details/publication/pub.1010703980
109 https://doi.org/10.1007/978-1-4419-7934-6_3
110 rdf:type schema:CreativeWork
111 sg:pub.10.1007/978-3-642-15760-8_62 schema:sameAs https://app.dimensions.ai/details/publication/pub.1034546674
112 https://doi.org/10.1007/978-3-642-15760-8_62
113 rdf:type schema:CreativeWork
114 https://doi.org/10.1016/s0167-6393(02)00126-7 schema:sameAs https://app.dimensions.ai/details/publication/pub.1037984060
115 rdf:type schema:CreativeWork
116 https://doi.org/10.1109/icslp.1996.607774 schema:sameAs https://app.dimensions.ai/details/publication/pub.1093436792
117 rdf:type schema:CreativeWork
118 https://www.grid.ac/institutes/grid.4489.1 schema:alternateName University of Granada
119 schema:name Dept. of LSI, CITIC-UGR, University of Granada, Granada, Spain
120 rdf:type schema:Organization
121 https://www.grid.ac/institutes/grid.7840.b schema:alternateName Carlos III University of Madrid
122 schema:name Dept. of Computer Science, Carlos III University of Madrid, Madrid, Spain
123 rdf:type schema:Organization
 




Preview window. Press ESC to close (or click here)


...