Overview of the CLEF 2009 Large-Scale Visual Concept Detection and Annotation Task View Full Text


Ontology type: schema:Chapter     


Chapter Info

DATE

2010

AUTHORS

Stefanie Nowak , Peter Dunker

ABSTRACT

The Large-Scale Visual Concept Detection and Annotation Task (LS-VCDT) in ImageCLEF 2009 aims at the detection of 53 concepts in consumer photos. These concepts are structured in an ontology which can be utilized during training and classification of the photos. The dataset consists of 18,000 Flickr photos which were manually annotated with 53 concepts. 5,000 photos were used for training and 13,000 for testing. Two evaluation paradigms have been applied, the evaluation per concept and the evaluation per photo. The evaluation per concept was performed by calculating the Equal Error Rate (EER) and the Area Under Curve (AUC). For the evaluation per photo a recently proposed ontology-based measure was utilized that takes the hierarchy and the relations of the ontology into account and calculates a score per photo. Altogether 19 research groups participated and submitted 73 runs. For the concepts, an average AUC of 84% could be achieved, including concepts with an AUC of 95%. The classification performance for each photo ranged between 68.7% and 100% with an average score of 89.6%. More... »

PAGES

94-109

Book

TITLE

Multilingual Information Access Evaluation II. Multimedia Experiments

ISBN

978-3-642-15750-9
978-3-642-15751-6

Identifiers

URI

http://scigraph.springernature.com/pub.10.1007/978-3-642-15751-6_10

DOI

http://dx.doi.org/10.1007/978-3-642-15751-6_10

DIMENSIONS

https://app.dimensions.ai/details/publication/pub.1052874237


Indexing Status Check whether this publication has been indexed by Scopus and Web Of Science using the SN Indexing Status Tool
Incoming Citations Browse incoming citations for this publication using opencitations.net

JSON-LD is the canonical representation for SciGraph data.

TIP: You can open this SciGraph record using an external JSON-LD service: JSON-LD Playground Google SDTT

[
  {
    "@context": "https://springernature.github.io/scigraph/jsonld/sgcontext.json", 
    "about": [
      {
        "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/1701", 
        "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
        "name": "Psychology", 
        "type": "DefinedTerm"
      }, 
      {
        "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/17", 
        "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
        "name": "Psychology and Cognitive Sciences", 
        "type": "DefinedTerm"
      }
    ], 
    "author": [
      {
        "affiliation": {
          "alternateName": "Fraunhofer Institute for Digital Media Technology", 
          "id": "https://www.grid.ac/institutes/grid.469861.4", 
          "name": [
            "Audio-Visual Systems, Fraunhofer IDMT, Ilmenau, Germany"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Nowak", 
        "givenName": "Stefanie", 
        "id": "sg:person.010632377665.20", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010632377665.20"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "name": [
            "Media Technology Lab, Gracenote Inc, Emeryville, CA, USA"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Dunker", 
        "givenName": "Peter", 
        "id": "sg:person.010761747005.41", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010761747005.41"
        ], 
        "type": "Person"
      }
    ], 
    "citation": [
      {
        "id": "sg:pub.10.1007/978-3-642-15751-6_40", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1000579645", 
          "https://doi.org/10.1007/978-3-642-15751-6_40"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-3-642-15751-6_40", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1000579645", 
          "https://doi.org/10.1007/978-3-642-15751-6_40"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-3-642-15751-6_33", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1004665961", 
          "https://doi.org/10.1007/978-3-642-15751-6_33"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-3-642-15751-6_33", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1004665961", 
          "https://doi.org/10.1007/978-3-642-15751-6_33"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-3-642-15751-6_32", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1005081003", 
          "https://doi.org/10.1007/978-3-642-15751-6_32"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-3-642-15751-6_32", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1005081003", 
          "https://doi.org/10.1007/978-3-642-15751-6_32"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1145/1460096.1460104", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1005779407"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-3-642-15751-6_44", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1007875289", 
          "https://doi.org/10.1007/978-3-642-15751-6_44"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-3-642-15751-6_44", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1007875289", 
          "https://doi.org/10.1007/978-3-642-15751-6_44"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-3-642-15751-6_35", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1022925612", 
          "https://doi.org/10.1007/978-3-642-15751-6_35"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-3-642-15751-6_35", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1022925612", 
          "https://doi.org/10.1007/978-3-642-15751-6_35"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-3-642-15751-6_37", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1030509913", 
          "https://doi.org/10.1007/978-3-642-15751-6_37"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-3-642-15751-6_37", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1030509913", 
          "https://doi.org/10.1007/978-3-642-15751-6_37"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-3-642-15751-6_36", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1034080535", 
          "https://doi.org/10.1007/978-3-642-15751-6_36"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-3-642-15751-6_36", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1034080535", 
          "https://doi.org/10.1007/978-3-642-15751-6_36"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-3-642-15751-6_42", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1037318832", 
          "https://doi.org/10.1007/978-3-642-15751-6_42"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-3-642-15751-6_42", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1037318832", 
          "https://doi.org/10.1007/978-3-642-15751-6_42"
        ], 
        "type": "CreativeWork"
      }
    ], 
    "datePublished": "2010", 
    "datePublishedReg": "2010-01-01", 
    "description": "The Large-Scale Visual Concept Detection and Annotation Task (LS-VCDT) in ImageCLEF 2009 aims at the detection of 53 concepts in consumer photos. These concepts are structured in an ontology which can be utilized during training and classification of the photos. The dataset consists of 18,000 Flickr photos which were manually annotated with 53 concepts. 5,000 photos were used for training and 13,000 for testing. Two evaluation paradigms have been applied, the evaluation per concept and the evaluation per photo. The evaluation per concept was performed by calculating the Equal Error Rate (EER) and the Area Under Curve (AUC). For the evaluation per photo a recently proposed ontology-based measure was utilized that takes the hierarchy and the relations of the ontology into account and calculates a score per photo. Altogether 19 research groups participated and submitted 73 runs. For the concepts, an average AUC of 84% could be achieved, including concepts with an AUC of 95%. The classification performance for each photo ranged between 68.7% and 100% with an average score of 89.6%.", 
    "editor": [
      {
        "familyName": "Peters", 
        "givenName": "Carol", 
        "type": "Person"
      }, 
      {
        "familyName": "Caputo", 
        "givenName": "Barbara", 
        "type": "Person"
      }, 
      {
        "familyName": "Gonzalo", 
        "givenName": "Julio", 
        "type": "Person"
      }, 
      {
        "familyName": "Jones", 
        "givenName": "Gareth J. F.", 
        "type": "Person"
      }, 
      {
        "familyName": "Kalpathy-Cramer", 
        "givenName": "Jayashree", 
        "type": "Person"
      }, 
      {
        "familyName": "M\u00fcller", 
        "givenName": "Henning", 
        "type": "Person"
      }, 
      {
        "familyName": "Tsikrika", 
        "givenName": "Theodora", 
        "type": "Person"
      }
    ], 
    "genre": "chapter", 
    "id": "sg:pub.10.1007/978-3-642-15751-6_10", 
    "inLanguage": [
      "en"
    ], 
    "isAccessibleForFree": false, 
    "isPartOf": {
      "isbn": [
        "978-3-642-15750-9", 
        "978-3-642-15751-6"
      ], 
      "name": "Multilingual Information Access Evaluation II. Multimedia Experiments", 
      "type": "Book"
    }, 
    "name": "Overview of the CLEF 2009 Large-Scale Visual Concept Detection and Annotation Task", 
    "pagination": "94-109", 
    "productId": [
      {
        "name": "dimensions_id", 
        "type": "PropertyValue", 
        "value": [
          "pub.1052874237"
        ]
      }, 
      {
        "name": "doi", 
        "type": "PropertyValue", 
        "value": [
          "10.1007/978-3-642-15751-6_10"
        ]
      }, 
      {
        "name": "readcube_id", 
        "type": "PropertyValue", 
        "value": [
          "fbdb14033d8cc747b34f2e7751532c82797c9f8508b05923c313e2a898352050"
        ]
      }
    ], 
    "publisher": {
      "location": "Berlin, Heidelberg", 
      "name": "Springer Berlin Heidelberg", 
      "type": "Organisation"
    }, 
    "sameAs": [
      "https://doi.org/10.1007/978-3-642-15751-6_10", 
      "https://app.dimensions.ai/details/publication/pub.1052874237"
    ], 
    "sdDataset": "chapters", 
    "sdDatePublished": "2019-04-16T08:27", 
    "sdLicense": "https://scigraph.springernature.com/explorer/license/", 
    "sdPublisher": {
      "name": "Springer Nature - SN SciGraph project", 
      "type": "Organization"
    }, 
    "sdSource": "s3://com-uberresearch-data-dimensions-target-20181106-alternative/cleanup/v134/2549eaecd7973599484d7c17b260dba0a4ecb94b/merge/v9/a6c9fde33151104705d4d7ff012ea9563521a3ce/jats-lookup/v90/0000000363_0000000363/records_70061_00000002.jsonl", 
    "type": "Chapter", 
    "url": "https://link.springer.com/10.1007%2F978-3-642-15751-6_10"
  }
]
 

Download the RDF metadata as:  json-ld nt turtle xml License info

HOW TO GET THIS DATA PROGRAMMATICALLY:

JSON-LD is a popular format for linked data which is fully compatible with JSON.

curl -H 'Accept: application/ld+json' 'https://scigraph.springernature.com/pub.10.1007/978-3-642-15751-6_10'

N-Triples is a line-based linked data format ideal for batch operations.

curl -H 'Accept: application/n-triples' 'https://scigraph.springernature.com/pub.10.1007/978-3-642-15751-6_10'

Turtle is a human-readable linked data format.

curl -H 'Accept: text/turtle' 'https://scigraph.springernature.com/pub.10.1007/978-3-642-15751-6_10'

RDF/XML is a standard XML format for linked data.

curl -H 'Accept: application/rdf+xml' 'https://scigraph.springernature.com/pub.10.1007/978-3-642-15751-6_10'


 

This table displays all metadata directly associated to this object as RDF triples.

139 TRIPLES      23 PREDICATES      36 URIs      20 LITERALS      8 BLANK NODES

Subject Predicate Object
1 sg:pub.10.1007/978-3-642-15751-6_10 schema:about anzsrc-for:17
2 anzsrc-for:1701
3 schema:author N100786e6171e4044950348afc2c3e6d4
4 schema:citation sg:pub.10.1007/978-3-642-15751-6_32
5 sg:pub.10.1007/978-3-642-15751-6_33
6 sg:pub.10.1007/978-3-642-15751-6_35
7 sg:pub.10.1007/978-3-642-15751-6_36
8 sg:pub.10.1007/978-3-642-15751-6_37
9 sg:pub.10.1007/978-3-642-15751-6_40
10 sg:pub.10.1007/978-3-642-15751-6_42
11 sg:pub.10.1007/978-3-642-15751-6_44
12 https://doi.org/10.1145/1460096.1460104
13 schema:datePublished 2010
14 schema:datePublishedReg 2010-01-01
15 schema:description The Large-Scale Visual Concept Detection and Annotation Task (LS-VCDT) in ImageCLEF 2009 aims at the detection of 53 concepts in consumer photos. These concepts are structured in an ontology which can be utilized during training and classification of the photos. The dataset consists of 18,000 Flickr photos which were manually annotated with 53 concepts. 5,000 photos were used for training and 13,000 for testing. Two evaluation paradigms have been applied, the evaluation per concept and the evaluation per photo. The evaluation per concept was performed by calculating the Equal Error Rate (EER) and the Area Under Curve (AUC). For the evaluation per photo a recently proposed ontology-based measure was utilized that takes the hierarchy and the relations of the ontology into account and calculates a score per photo. Altogether 19 research groups participated and submitted 73 runs. For the concepts, an average AUC of 84% could be achieved, including concepts with an AUC of 95%. The classification performance for each photo ranged between 68.7% and 100% with an average score of 89.6%.
16 schema:editor N5d86fd03717b4e65ad04b9068c815763
17 schema:genre chapter
18 schema:inLanguage en
19 schema:isAccessibleForFree false
20 schema:isPartOf Ne95e421fe4c44ca194a4368dd5038247
21 schema:name Overview of the CLEF 2009 Large-Scale Visual Concept Detection and Annotation Task
22 schema:pagination 94-109
23 schema:productId N0c3260487b6342e9ad4e996bdf31e27d
24 N1e0f819dcc1e4302bbaf6ccf23c89774
25 N48c3afadb5374f9eb1f78cf1e39181c3
26 schema:publisher Nd9bfaca5097641d2a34026ef44a35f0e
27 schema:sameAs https://app.dimensions.ai/details/publication/pub.1052874237
28 https://doi.org/10.1007/978-3-642-15751-6_10
29 schema:sdDatePublished 2019-04-16T08:27
30 schema:sdLicense https://scigraph.springernature.com/explorer/license/
31 schema:sdPublisher N424696d0a300407cadd819dfad6d5a17
32 schema:url https://link.springer.com/10.1007%2F978-3-642-15751-6_10
33 sgo:license sg:explorer/license/
34 sgo:sdDataset chapters
35 rdf:type schema:Chapter
36 N06a8b94ff83a49139d4fe1c91ed5bb52 rdf:first N8d58b558605743b09d0ba2cfb823af42
37 rdf:rest rdf:nil
38 N0c3260487b6342e9ad4e996bdf31e27d schema:name dimensions_id
39 schema:value pub.1052874237
40 rdf:type schema:PropertyValue
41 N100786e6171e4044950348afc2c3e6d4 rdf:first sg:person.010632377665.20
42 rdf:rest N185659a7cb724614867cf995cd654bff
43 N1331828a65cd4ba0b8403802e480745a schema:familyName Jones
44 schema:givenName Gareth J. F.
45 rdf:type schema:Person
46 N185659a7cb724614867cf995cd654bff rdf:first sg:person.010761747005.41
47 rdf:rest rdf:nil
48 N1e0f819dcc1e4302bbaf6ccf23c89774 schema:name doi
49 schema:value 10.1007/978-3-642-15751-6_10
50 rdf:type schema:PropertyValue
51 N2d926e93dcb54feaab2526c9700d86d5 rdf:first N1331828a65cd4ba0b8403802e480745a
52 rdf:rest N950805f889c343ef8c9c98e5957cc449
53 N2eeb474845564156aa904bbbbd3222ff schema:familyName Caputo
54 schema:givenName Barbara
55 rdf:type schema:Person
56 N33612d1110dd4fb49729ec0cfd7466ac schema:familyName Peters
57 schema:givenName Carol
58 rdf:type schema:Person
59 N424696d0a300407cadd819dfad6d5a17 schema:name Springer Nature - SN SciGraph project
60 rdf:type schema:Organization
61 N48c3afadb5374f9eb1f78cf1e39181c3 schema:name readcube_id
62 schema:value fbdb14033d8cc747b34f2e7751532c82797c9f8508b05923c313e2a898352050
63 rdf:type schema:PropertyValue
64 N4e0bf2489e8d41b3abca71265ac323b4 schema:familyName Kalpathy-Cramer
65 schema:givenName Jayashree
66 rdf:type schema:Person
67 N5d86fd03717b4e65ad04b9068c815763 rdf:first N33612d1110dd4fb49729ec0cfd7466ac
68 rdf:rest Ncdf1eeccfa084ae18675b8c1de38311c
69 N7e22193ecac04be2856541cc8897c316 schema:familyName Müller
70 schema:givenName Henning
71 rdf:type schema:Person
72 N8d58b558605743b09d0ba2cfb823af42 schema:familyName Tsikrika
73 schema:givenName Theodora
74 rdf:type schema:Person
75 N912b0c72d1084b54a1a774d2037b35d9 schema:name Media Technology Lab, Gracenote Inc, Emeryville, CA, USA
76 rdf:type schema:Organization
77 N950805f889c343ef8c9c98e5957cc449 rdf:first N4e0bf2489e8d41b3abca71265ac323b4
78 rdf:rest Ncf7e55c9d9b6470190a5e6b7a0bbbac6
79 Nac312978789140e5a7c33d2bf0e04901 rdf:first Nb54653c756b9405e950b931011dd95f5
80 rdf:rest N2d926e93dcb54feaab2526c9700d86d5
81 Nb54653c756b9405e950b931011dd95f5 schema:familyName Gonzalo
82 schema:givenName Julio
83 rdf:type schema:Person
84 Ncdf1eeccfa084ae18675b8c1de38311c rdf:first N2eeb474845564156aa904bbbbd3222ff
85 rdf:rest Nac312978789140e5a7c33d2bf0e04901
86 Ncf7e55c9d9b6470190a5e6b7a0bbbac6 rdf:first N7e22193ecac04be2856541cc8897c316
87 rdf:rest N06a8b94ff83a49139d4fe1c91ed5bb52
88 Nd9bfaca5097641d2a34026ef44a35f0e schema:location Berlin, Heidelberg
89 schema:name Springer Berlin Heidelberg
90 rdf:type schema:Organisation
91 Ne95e421fe4c44ca194a4368dd5038247 schema:isbn 978-3-642-15750-9
92 978-3-642-15751-6
93 schema:name Multilingual Information Access Evaluation II. Multimedia Experiments
94 rdf:type schema:Book
95 anzsrc-for:17 schema:inDefinedTermSet anzsrc-for:
96 schema:name Psychology and Cognitive Sciences
97 rdf:type schema:DefinedTerm
98 anzsrc-for:1701 schema:inDefinedTermSet anzsrc-for:
99 schema:name Psychology
100 rdf:type schema:DefinedTerm
101 sg:person.010632377665.20 schema:affiliation https://www.grid.ac/institutes/grid.469861.4
102 schema:familyName Nowak
103 schema:givenName Stefanie
104 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010632377665.20
105 rdf:type schema:Person
106 sg:person.010761747005.41 schema:affiliation N912b0c72d1084b54a1a774d2037b35d9
107 schema:familyName Dunker
108 schema:givenName Peter
109 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010761747005.41
110 rdf:type schema:Person
111 sg:pub.10.1007/978-3-642-15751-6_32 schema:sameAs https://app.dimensions.ai/details/publication/pub.1005081003
112 https://doi.org/10.1007/978-3-642-15751-6_32
113 rdf:type schema:CreativeWork
114 sg:pub.10.1007/978-3-642-15751-6_33 schema:sameAs https://app.dimensions.ai/details/publication/pub.1004665961
115 https://doi.org/10.1007/978-3-642-15751-6_33
116 rdf:type schema:CreativeWork
117 sg:pub.10.1007/978-3-642-15751-6_35 schema:sameAs https://app.dimensions.ai/details/publication/pub.1022925612
118 https://doi.org/10.1007/978-3-642-15751-6_35
119 rdf:type schema:CreativeWork
120 sg:pub.10.1007/978-3-642-15751-6_36 schema:sameAs https://app.dimensions.ai/details/publication/pub.1034080535
121 https://doi.org/10.1007/978-3-642-15751-6_36
122 rdf:type schema:CreativeWork
123 sg:pub.10.1007/978-3-642-15751-6_37 schema:sameAs https://app.dimensions.ai/details/publication/pub.1030509913
124 https://doi.org/10.1007/978-3-642-15751-6_37
125 rdf:type schema:CreativeWork
126 sg:pub.10.1007/978-3-642-15751-6_40 schema:sameAs https://app.dimensions.ai/details/publication/pub.1000579645
127 https://doi.org/10.1007/978-3-642-15751-6_40
128 rdf:type schema:CreativeWork
129 sg:pub.10.1007/978-3-642-15751-6_42 schema:sameAs https://app.dimensions.ai/details/publication/pub.1037318832
130 https://doi.org/10.1007/978-3-642-15751-6_42
131 rdf:type schema:CreativeWork
132 sg:pub.10.1007/978-3-642-15751-6_44 schema:sameAs https://app.dimensions.ai/details/publication/pub.1007875289
133 https://doi.org/10.1007/978-3-642-15751-6_44
134 rdf:type schema:CreativeWork
135 https://doi.org/10.1145/1460096.1460104 schema:sameAs https://app.dimensions.ai/details/publication/pub.1005779407
136 rdf:type schema:CreativeWork
137 https://www.grid.ac/institutes/grid.469861.4 schema:alternateName Fraunhofer Institute for Digital Media Technology
138 schema:name Audio-Visual Systems, Fraunhofer IDMT, Ilmenau, Germany
139 rdf:type schema:Organization
 




Preview window. Press ESC to close (or click here)


...