Overview of the CLEF 2009 Large-Scale Visual Concept Detection and Annotation Task View Full Text


Ontology type: schema:Chapter     


Chapter Info

DATE

2010

AUTHORS

Stefanie Nowak , Peter Dunker

ABSTRACT

The Large-Scale Visual Concept Detection and Annotation Task (LS-VCDT) in ImageCLEF 2009 aims at the detection of 53 concepts in consumer photos. These concepts are structured in an ontology which can be utilized during training and classification of the photos. The dataset consists of 18,000 Flickr photos which were manually annotated with 53 concepts. 5,000 photos were used for training and 13,000 for testing. Two evaluation paradigms have been applied, the evaluation per concept and the evaluation per photo. The evaluation per concept was performed by calculating the Equal Error Rate (EER) and the Area Under Curve (AUC). For the evaluation per photo a recently proposed ontology-based measure was utilized that takes the hierarchy and the relations of the ontology into account and calculates a score per photo. Altogether 19 research groups participated and submitted 73 runs. For the concepts, an average AUC of 84% could be achieved, including concepts with an AUC of 95%. The classification performance for each photo ranged between 68.7% and 100% with an average score of 89.6%. More... »

PAGES

94-109

References to SciGraph publications

Book

TITLE

Multilingual Information Access Evaluation II. Multimedia Experiments

ISBN

978-3-642-15750-9
978-3-642-15751-6

Identifiers

URI

http://scigraph.springernature.com/pub.10.1007/978-3-642-15751-6_10

DOI

http://dx.doi.org/10.1007/978-3-642-15751-6_10

DIMENSIONS

https://app.dimensions.ai/details/publication/pub.1052874237


Indexing Status Check whether this publication has been indexed by Scopus and Web Of Science using the SN Indexing Status Tool
Incoming Citations Browse incoming citations for this publication using opencitations.net

JSON-LD is the canonical representation for SciGraph data.

TIP: You can open this SciGraph record using an external JSON-LD service: JSON-LD Playground Google SDTT

[
  {
    "@context": "https://springernature.github.io/scigraph/jsonld/sgcontext.json", 
    "about": [
      {
        "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/1701", 
        "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
        "name": "Psychology", 
        "type": "DefinedTerm"
      }, 
      {
        "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/17", 
        "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
        "name": "Psychology and Cognitive Sciences", 
        "type": "DefinedTerm"
      }
    ], 
    "author": [
      {
        "affiliation": {
          "alternateName": "Fraunhofer Institute for Digital Media Technology", 
          "id": "https://www.grid.ac/institutes/grid.469861.4", 
          "name": [
            "Audio-Visual Systems, Fraunhofer IDMT, Ilmenau, Germany"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Nowak", 
        "givenName": "Stefanie", 
        "id": "sg:person.010632377665.20", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010632377665.20"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "name": [
            "Media Technology Lab, Gracenote Inc, Emeryville, CA, USA"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Dunker", 
        "givenName": "Peter", 
        "id": "sg:person.010761747005.41", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010761747005.41"
        ], 
        "type": "Person"
      }
    ], 
    "citation": [
      {
        "id": "sg:pub.10.1007/978-3-642-15751-6_40", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1000579645", 
          "https://doi.org/10.1007/978-3-642-15751-6_40"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-3-642-15751-6_40", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1000579645", 
          "https://doi.org/10.1007/978-3-642-15751-6_40"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-3-642-15751-6_33", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1004665961", 
          "https://doi.org/10.1007/978-3-642-15751-6_33"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-3-642-15751-6_33", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1004665961", 
          "https://doi.org/10.1007/978-3-642-15751-6_33"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-3-642-15751-6_32", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1005081003", 
          "https://doi.org/10.1007/978-3-642-15751-6_32"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-3-642-15751-6_32", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1005081003", 
          "https://doi.org/10.1007/978-3-642-15751-6_32"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1145/1460096.1460104", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1005779407"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-3-642-15751-6_44", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1007875289", 
          "https://doi.org/10.1007/978-3-642-15751-6_44"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-3-642-15751-6_44", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1007875289", 
          "https://doi.org/10.1007/978-3-642-15751-6_44"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-3-642-15751-6_35", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1022925612", 
          "https://doi.org/10.1007/978-3-642-15751-6_35"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-3-642-15751-6_35", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1022925612", 
          "https://doi.org/10.1007/978-3-642-15751-6_35"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-3-642-15751-6_37", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1030509913", 
          "https://doi.org/10.1007/978-3-642-15751-6_37"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-3-642-15751-6_37", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1030509913", 
          "https://doi.org/10.1007/978-3-642-15751-6_37"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-3-642-15751-6_36", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1034080535", 
          "https://doi.org/10.1007/978-3-642-15751-6_36"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-3-642-15751-6_36", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1034080535", 
          "https://doi.org/10.1007/978-3-642-15751-6_36"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-3-642-15751-6_42", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1037318832", 
          "https://doi.org/10.1007/978-3-642-15751-6_42"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-3-642-15751-6_42", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1037318832", 
          "https://doi.org/10.1007/978-3-642-15751-6_42"
        ], 
        "type": "CreativeWork"
      }
    ], 
    "datePublished": "2010", 
    "datePublishedReg": "2010-01-01", 
    "description": "The Large-Scale Visual Concept Detection and Annotation Task (LS-VCDT) in ImageCLEF 2009 aims at the detection of 53 concepts in consumer photos. These concepts are structured in an ontology which can be utilized during training and classification of the photos. The dataset consists of 18,000 Flickr photos which were manually annotated with 53 concepts. 5,000 photos were used for training and 13,000 for testing. Two evaluation paradigms have been applied, the evaluation per concept and the evaluation per photo. The evaluation per concept was performed by calculating the Equal Error Rate (EER) and the Area Under Curve (AUC). For the evaluation per photo a recently proposed ontology-based measure was utilized that takes the hierarchy and the relations of the ontology into account and calculates a score per photo. Altogether 19 research groups participated and submitted 73 runs. For the concepts, an average AUC of 84% could be achieved, including concepts with an AUC of 95%. The classification performance for each photo ranged between 68.7% and 100% with an average score of 89.6%.", 
    "editor": [
      {
        "familyName": "Peters", 
        "givenName": "Carol", 
        "type": "Person"
      }, 
      {
        "familyName": "Caputo", 
        "givenName": "Barbara", 
        "type": "Person"
      }, 
      {
        "familyName": "Gonzalo", 
        "givenName": "Julio", 
        "type": "Person"
      }, 
      {
        "familyName": "Jones", 
        "givenName": "Gareth J. F.", 
        "type": "Person"
      }, 
      {
        "familyName": "Kalpathy-Cramer", 
        "givenName": "Jayashree", 
        "type": "Person"
      }, 
      {
        "familyName": "M\u00fcller", 
        "givenName": "Henning", 
        "type": "Person"
      }, 
      {
        "familyName": "Tsikrika", 
        "givenName": "Theodora", 
        "type": "Person"
      }
    ], 
    "genre": "chapter", 
    "id": "sg:pub.10.1007/978-3-642-15751-6_10", 
    "inLanguage": [
      "en"
    ], 
    "isAccessibleForFree": false, 
    "isPartOf": {
      "isbn": [
        "978-3-642-15750-9", 
        "978-3-642-15751-6"
      ], 
      "name": "Multilingual Information Access Evaluation II. Multimedia Experiments", 
      "type": "Book"
    }, 
    "name": "Overview of the CLEF 2009 Large-Scale Visual Concept Detection and Annotation Task", 
    "pagination": "94-109", 
    "productId": [
      {
        "name": "dimensions_id", 
        "type": "PropertyValue", 
        "value": [
          "pub.1052874237"
        ]
      }, 
      {
        "name": "doi", 
        "type": "PropertyValue", 
        "value": [
          "10.1007/978-3-642-15751-6_10"
        ]
      }, 
      {
        "name": "readcube_id", 
        "type": "PropertyValue", 
        "value": [
          "fbdb14033d8cc747b34f2e7751532c82797c9f8508b05923c313e2a898352050"
        ]
      }
    ], 
    "publisher": {
      "location": "Berlin, Heidelberg", 
      "name": "Springer Berlin Heidelberg", 
      "type": "Organisation"
    }, 
    "sameAs": [
      "https://doi.org/10.1007/978-3-642-15751-6_10", 
      "https://app.dimensions.ai/details/publication/pub.1052874237"
    ], 
    "sdDataset": "chapters", 
    "sdDatePublished": "2019-04-16T08:27", 
    "sdLicense": "https://scigraph.springernature.com/explorer/license/", 
    "sdPublisher": {
      "name": "Springer Nature - SN SciGraph project", 
      "type": "Organization"
    }, 
    "sdSource": "s3://com-uberresearch-data-dimensions-target-20181106-alternative/cleanup/v134/2549eaecd7973599484d7c17b260dba0a4ecb94b/merge/v9/a6c9fde33151104705d4d7ff012ea9563521a3ce/jats-lookup/v90/0000000363_0000000363/records_70061_00000002.jsonl", 
    "type": "Chapter", 
    "url": "https://link.springer.com/10.1007%2F978-3-642-15751-6_10"
  }
]
 

Download the RDF metadata as:  json-ld nt turtle xml License info

HOW TO GET THIS DATA PROGRAMMATICALLY:

JSON-LD is a popular format for linked data which is fully compatible with JSON.

curl -H 'Accept: application/ld+json' 'https://scigraph.springernature.com/pub.10.1007/978-3-642-15751-6_10'

N-Triples is a line-based linked data format ideal for batch operations.

curl -H 'Accept: application/n-triples' 'https://scigraph.springernature.com/pub.10.1007/978-3-642-15751-6_10'

Turtle is a human-readable linked data format.

curl -H 'Accept: text/turtle' 'https://scigraph.springernature.com/pub.10.1007/978-3-642-15751-6_10'

RDF/XML is a standard XML format for linked data.

curl -H 'Accept: application/rdf+xml' 'https://scigraph.springernature.com/pub.10.1007/978-3-642-15751-6_10'


 

This table displays all metadata directly associated to this object as RDF triples.

139 TRIPLES      23 PREDICATES      36 URIs      20 LITERALS      8 BLANK NODES

Subject Predicate Object
1 sg:pub.10.1007/978-3-642-15751-6_10 schema:about anzsrc-for:17
2 anzsrc-for:1701
3 schema:author Na6aa26da9a6a42069b5319d96cc08d59
4 schema:citation sg:pub.10.1007/978-3-642-15751-6_32
5 sg:pub.10.1007/978-3-642-15751-6_33
6 sg:pub.10.1007/978-3-642-15751-6_35
7 sg:pub.10.1007/978-3-642-15751-6_36
8 sg:pub.10.1007/978-3-642-15751-6_37
9 sg:pub.10.1007/978-3-642-15751-6_40
10 sg:pub.10.1007/978-3-642-15751-6_42
11 sg:pub.10.1007/978-3-642-15751-6_44
12 https://doi.org/10.1145/1460096.1460104
13 schema:datePublished 2010
14 schema:datePublishedReg 2010-01-01
15 schema:description The Large-Scale Visual Concept Detection and Annotation Task (LS-VCDT) in ImageCLEF 2009 aims at the detection of 53 concepts in consumer photos. These concepts are structured in an ontology which can be utilized during training and classification of the photos. The dataset consists of 18,000 Flickr photos which were manually annotated with 53 concepts. 5,000 photos were used for training and 13,000 for testing. Two evaluation paradigms have been applied, the evaluation per concept and the evaluation per photo. The evaluation per concept was performed by calculating the Equal Error Rate (EER) and the Area Under Curve (AUC). For the evaluation per photo a recently proposed ontology-based measure was utilized that takes the hierarchy and the relations of the ontology into account and calculates a score per photo. Altogether 19 research groups participated and submitted 73 runs. For the concepts, an average AUC of 84% could be achieved, including concepts with an AUC of 95%. The classification performance for each photo ranged between 68.7% and 100% with an average score of 89.6%.
16 schema:editor Nbe99511ac1e445bba70014179213d1be
17 schema:genre chapter
18 schema:inLanguage en
19 schema:isAccessibleForFree false
20 schema:isPartOf N41f44b4cdfb34c139fcd1549d40431d9
21 schema:name Overview of the CLEF 2009 Large-Scale Visual Concept Detection and Annotation Task
22 schema:pagination 94-109
23 schema:productId N2eb3c4f4e8de4d1f9cb80b1d29914342
24 N5e3ffaef73484258ae5bcac04764372e
25 Nd80c7b283053475c80beefb607dcb1fb
26 schema:publisher N3de6ee3a397d4800a38f7f89fce602fa
27 schema:sameAs https://app.dimensions.ai/details/publication/pub.1052874237
28 https://doi.org/10.1007/978-3-642-15751-6_10
29 schema:sdDatePublished 2019-04-16T08:27
30 schema:sdLicense https://scigraph.springernature.com/explorer/license/
31 schema:sdPublisher Nf6eb65597b5349669f9f21074718dcc2
32 schema:url https://link.springer.com/10.1007%2F978-3-642-15751-6_10
33 sgo:license sg:explorer/license/
34 sgo:sdDataset chapters
35 rdf:type schema:Chapter
36 N00ece135f20f4ea9ba60401253ea0275 rdf:first N32e51ef901f54953831e22af4e76e9a9
37 rdf:rest Nc866ffbca25445ef8dbbbc8a7e89a476
38 N099c601c021f4bde9f138a8aab52aaab schema:familyName Jones
39 schema:givenName Gareth J. F.
40 rdf:type schema:Person
41 N1cf64a3ecb5c4ab79d3c37346713ef97 schema:familyName Tsikrika
42 schema:givenName Theodora
43 rdf:type schema:Person
44 N2532d27f892f4f55bae6a1a8434120f0 rdf:first N41678e496ea74378be545859ba590b40
45 rdf:rest N661e51608ec94b9e9a25b66b2da669f9
46 N2eb3c4f4e8de4d1f9cb80b1d29914342 schema:name doi
47 schema:value 10.1007/978-3-642-15751-6_10
48 rdf:type schema:PropertyValue
49 N32e51ef901f54953831e22af4e76e9a9 schema:familyName Caputo
50 schema:givenName Barbara
51 rdf:type schema:Person
52 N38f7d8e431ca4696a7d98c70dc8bb2c3 rdf:first sg:person.010761747005.41
53 rdf:rest rdf:nil
54 N3d4abb983363453789d8940be22d92f8 schema:name Media Technology Lab, Gracenote Inc, Emeryville, CA, USA
55 rdf:type schema:Organization
56 N3de6ee3a397d4800a38f7f89fce602fa schema:location Berlin, Heidelberg
57 schema:name Springer Berlin Heidelberg
58 rdf:type schema:Organisation
59 N41678e496ea74378be545859ba590b40 schema:familyName Kalpathy-Cramer
60 schema:givenName Jayashree
61 rdf:type schema:Person
62 N41f44b4cdfb34c139fcd1549d40431d9 schema:isbn 978-3-642-15750-9
63 978-3-642-15751-6
64 schema:name Multilingual Information Access Evaluation II. Multimedia Experiments
65 rdf:type schema:Book
66 N5e3ffaef73484258ae5bcac04764372e schema:name dimensions_id
67 schema:value pub.1052874237
68 rdf:type schema:PropertyValue
69 N661e51608ec94b9e9a25b66b2da669f9 rdf:first Nbc147ec285284c67b7e48f0f64d74678
70 rdf:rest Nf32cd18b89fc4516a8777c9371eaea17
71 N67f9fe4c659b49659aa78e02d762c3c3 rdf:first N099c601c021f4bde9f138a8aab52aaab
72 rdf:rest N2532d27f892f4f55bae6a1a8434120f0
73 N893562c53af645119a7b30c18a1a830b schema:familyName Gonzalo
74 schema:givenName Julio
75 rdf:type schema:Person
76 Na6aa26da9a6a42069b5319d96cc08d59 rdf:first sg:person.010632377665.20
77 rdf:rest N38f7d8e431ca4696a7d98c70dc8bb2c3
78 Nb2d972134bda4e2ba7c196faaff2d46f schema:familyName Peters
79 schema:givenName Carol
80 rdf:type schema:Person
81 Nbc147ec285284c67b7e48f0f64d74678 schema:familyName Müller
82 schema:givenName Henning
83 rdf:type schema:Person
84 Nbe99511ac1e445bba70014179213d1be rdf:first Nb2d972134bda4e2ba7c196faaff2d46f
85 rdf:rest N00ece135f20f4ea9ba60401253ea0275
86 Nc866ffbca25445ef8dbbbc8a7e89a476 rdf:first N893562c53af645119a7b30c18a1a830b
87 rdf:rest N67f9fe4c659b49659aa78e02d762c3c3
88 Nd80c7b283053475c80beefb607dcb1fb schema:name readcube_id
89 schema:value fbdb14033d8cc747b34f2e7751532c82797c9f8508b05923c313e2a898352050
90 rdf:type schema:PropertyValue
91 Nf32cd18b89fc4516a8777c9371eaea17 rdf:first N1cf64a3ecb5c4ab79d3c37346713ef97
92 rdf:rest rdf:nil
93 Nf6eb65597b5349669f9f21074718dcc2 schema:name Springer Nature - SN SciGraph project
94 rdf:type schema:Organization
95 anzsrc-for:17 schema:inDefinedTermSet anzsrc-for:
96 schema:name Psychology and Cognitive Sciences
97 rdf:type schema:DefinedTerm
98 anzsrc-for:1701 schema:inDefinedTermSet anzsrc-for:
99 schema:name Psychology
100 rdf:type schema:DefinedTerm
101 sg:person.010632377665.20 schema:affiliation https://www.grid.ac/institutes/grid.469861.4
102 schema:familyName Nowak
103 schema:givenName Stefanie
104 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010632377665.20
105 rdf:type schema:Person
106 sg:person.010761747005.41 schema:affiliation N3d4abb983363453789d8940be22d92f8
107 schema:familyName Dunker
108 schema:givenName Peter
109 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010761747005.41
110 rdf:type schema:Person
111 sg:pub.10.1007/978-3-642-15751-6_32 schema:sameAs https://app.dimensions.ai/details/publication/pub.1005081003
112 https://doi.org/10.1007/978-3-642-15751-6_32
113 rdf:type schema:CreativeWork
114 sg:pub.10.1007/978-3-642-15751-6_33 schema:sameAs https://app.dimensions.ai/details/publication/pub.1004665961
115 https://doi.org/10.1007/978-3-642-15751-6_33
116 rdf:type schema:CreativeWork
117 sg:pub.10.1007/978-3-642-15751-6_35 schema:sameAs https://app.dimensions.ai/details/publication/pub.1022925612
118 https://doi.org/10.1007/978-3-642-15751-6_35
119 rdf:type schema:CreativeWork
120 sg:pub.10.1007/978-3-642-15751-6_36 schema:sameAs https://app.dimensions.ai/details/publication/pub.1034080535
121 https://doi.org/10.1007/978-3-642-15751-6_36
122 rdf:type schema:CreativeWork
123 sg:pub.10.1007/978-3-642-15751-6_37 schema:sameAs https://app.dimensions.ai/details/publication/pub.1030509913
124 https://doi.org/10.1007/978-3-642-15751-6_37
125 rdf:type schema:CreativeWork
126 sg:pub.10.1007/978-3-642-15751-6_40 schema:sameAs https://app.dimensions.ai/details/publication/pub.1000579645
127 https://doi.org/10.1007/978-3-642-15751-6_40
128 rdf:type schema:CreativeWork
129 sg:pub.10.1007/978-3-642-15751-6_42 schema:sameAs https://app.dimensions.ai/details/publication/pub.1037318832
130 https://doi.org/10.1007/978-3-642-15751-6_42
131 rdf:type schema:CreativeWork
132 sg:pub.10.1007/978-3-642-15751-6_44 schema:sameAs https://app.dimensions.ai/details/publication/pub.1007875289
133 https://doi.org/10.1007/978-3-642-15751-6_44
134 rdf:type schema:CreativeWork
135 https://doi.org/10.1145/1460096.1460104 schema:sameAs https://app.dimensions.ai/details/publication/pub.1005779407
136 rdf:type schema:CreativeWork
137 https://www.grid.ac/institutes/grid.469861.4 schema:alternateName Fraunhofer Institute for Digital Media Technology
138 schema:name Audio-Visual Systems, Fraunhofer IDMT, Ilmenau, Germany
139 rdf:type schema:Organization
 




Preview window. Press ESC to close (or click here)


...