Overview of the CLEF 2009 Large-Scale Visual Concept Detection and Annotation Task View Full Text


Ontology type: schema:Chapter     


Chapter Info

DATE

2010

AUTHORS

Stefanie Nowak , Peter Dunker

ABSTRACT

The Large-Scale Visual Concept Detection and Annotation Task (LS-VCDT) in ImageCLEF 2009 aims at the detection of 53 concepts in consumer photos. These concepts are structured in an ontology which can be utilized during training and classification of the photos. The dataset consists of 18,000 Flickr photos which were manually annotated with 53 concepts. 5,000 photos were used for training and 13,000 for testing. Two evaluation paradigms have been applied, the evaluation per concept and the evaluation per photo. The evaluation per concept was performed by calculating the Equal Error Rate (EER) and the Area Under Curve (AUC). For the evaluation per photo a recently proposed ontology-based measure was utilized that takes the hierarchy and the relations of the ontology into account and calculates a score per photo. Altogether 19 research groups participated and submitted 73 runs. For the concepts, an average AUC of 84% could be achieved, including concepts with an AUC of 95%. The classification performance for each photo ranged between 68.7% and 100% with an average score of 89.6%. More... »

PAGES

94-109

Book

TITLE

Multilingual Information Access Evaluation II. Multimedia Experiments

ISBN

978-3-642-15750-9
978-3-642-15751-6

Identifiers

URI

http://scigraph.springernature.com/pub.10.1007/978-3-642-15751-6_10

DOI

http://dx.doi.org/10.1007/978-3-642-15751-6_10

DIMENSIONS

https://app.dimensions.ai/details/publication/pub.1052874237


Indexing Status Check whether this publication has been indexed by Scopus and Web Of Science using the SN Indexing Status Tool
Incoming Citations Browse incoming citations for this publication using opencitations.net

JSON-LD is the canonical representation for SciGraph data.

TIP: You can open this SciGraph record using an external JSON-LD service: JSON-LD Playground Google SDTT

[
  {
    "@context": "https://springernature.github.io/scigraph/jsonld/sgcontext.json", 
    "about": [
      {
        "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/1701", 
        "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
        "name": "Psychology", 
        "type": "DefinedTerm"
      }, 
      {
        "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/17", 
        "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
        "name": "Psychology and Cognitive Sciences", 
        "type": "DefinedTerm"
      }
    ], 
    "author": [
      {
        "affiliation": {
          "alternateName": "Fraunhofer Institute for Digital Media Technology", 
          "id": "https://www.grid.ac/institutes/grid.469861.4", 
          "name": [
            "Audio-Visual Systems, Fraunhofer IDMT, Ilmenau, Germany"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Nowak", 
        "givenName": "Stefanie", 
        "id": "sg:person.010632377665.20", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010632377665.20"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "name": [
            "Media Technology Lab, Gracenote Inc, Emeryville, CA, USA"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Dunker", 
        "givenName": "Peter", 
        "id": "sg:person.010761747005.41", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010761747005.41"
        ], 
        "type": "Person"
      }
    ], 
    "citation": [
      {
        "id": "sg:pub.10.1007/978-3-642-15751-6_40", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1000579645", 
          "https://doi.org/10.1007/978-3-642-15751-6_40"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-3-642-15751-6_40", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1000579645", 
          "https://doi.org/10.1007/978-3-642-15751-6_40"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-3-642-15751-6_33", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1004665961", 
          "https://doi.org/10.1007/978-3-642-15751-6_33"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-3-642-15751-6_33", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1004665961", 
          "https://doi.org/10.1007/978-3-642-15751-6_33"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-3-642-15751-6_32", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1005081003", 
          "https://doi.org/10.1007/978-3-642-15751-6_32"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-3-642-15751-6_32", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1005081003", 
          "https://doi.org/10.1007/978-3-642-15751-6_32"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1145/1460096.1460104", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1005779407"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-3-642-15751-6_44", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1007875289", 
          "https://doi.org/10.1007/978-3-642-15751-6_44"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-3-642-15751-6_44", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1007875289", 
          "https://doi.org/10.1007/978-3-642-15751-6_44"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-3-642-15751-6_35", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1022925612", 
          "https://doi.org/10.1007/978-3-642-15751-6_35"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-3-642-15751-6_35", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1022925612", 
          "https://doi.org/10.1007/978-3-642-15751-6_35"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-3-642-15751-6_37", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1030509913", 
          "https://doi.org/10.1007/978-3-642-15751-6_37"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-3-642-15751-6_37", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1030509913", 
          "https://doi.org/10.1007/978-3-642-15751-6_37"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-3-642-15751-6_36", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1034080535", 
          "https://doi.org/10.1007/978-3-642-15751-6_36"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-3-642-15751-6_36", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1034080535", 
          "https://doi.org/10.1007/978-3-642-15751-6_36"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-3-642-15751-6_42", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1037318832", 
          "https://doi.org/10.1007/978-3-642-15751-6_42"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-3-642-15751-6_42", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1037318832", 
          "https://doi.org/10.1007/978-3-642-15751-6_42"
        ], 
        "type": "CreativeWork"
      }
    ], 
    "datePublished": "2010", 
    "datePublishedReg": "2010-01-01", 
    "description": "The Large-Scale Visual Concept Detection and Annotation Task (LS-VCDT) in ImageCLEF 2009 aims at the detection of 53 concepts in consumer photos. These concepts are structured in an ontology which can be utilized during training and classification of the photos. The dataset consists of 18,000 Flickr photos which were manually annotated with 53 concepts. 5,000 photos were used for training and 13,000 for testing. Two evaluation paradigms have been applied, the evaluation per concept and the evaluation per photo. The evaluation per concept was performed by calculating the Equal Error Rate (EER) and the Area Under Curve (AUC). For the evaluation per photo a recently proposed ontology-based measure was utilized that takes the hierarchy and the relations of the ontology into account and calculates a score per photo. Altogether 19 research groups participated and submitted 73 runs. For the concepts, an average AUC of 84% could be achieved, including concepts with an AUC of 95%. The classification performance for each photo ranged between 68.7% and 100% with an average score of 89.6%.", 
    "editor": [
      {
        "familyName": "Peters", 
        "givenName": "Carol", 
        "type": "Person"
      }, 
      {
        "familyName": "Caputo", 
        "givenName": "Barbara", 
        "type": "Person"
      }, 
      {
        "familyName": "Gonzalo", 
        "givenName": "Julio", 
        "type": "Person"
      }, 
      {
        "familyName": "Jones", 
        "givenName": "Gareth J. F.", 
        "type": "Person"
      }, 
      {
        "familyName": "Kalpathy-Cramer", 
        "givenName": "Jayashree", 
        "type": "Person"
      }, 
      {
        "familyName": "M\u00fcller", 
        "givenName": "Henning", 
        "type": "Person"
      }, 
      {
        "familyName": "Tsikrika", 
        "givenName": "Theodora", 
        "type": "Person"
      }
    ], 
    "genre": "chapter", 
    "id": "sg:pub.10.1007/978-3-642-15751-6_10", 
    "inLanguage": [
      "en"
    ], 
    "isAccessibleForFree": false, 
    "isPartOf": {
      "isbn": [
        "978-3-642-15750-9", 
        "978-3-642-15751-6"
      ], 
      "name": "Multilingual Information Access Evaluation II. Multimedia Experiments", 
      "type": "Book"
    }, 
    "name": "Overview of the CLEF 2009 Large-Scale Visual Concept Detection and Annotation Task", 
    "pagination": "94-109", 
    "productId": [
      {
        "name": "dimensions_id", 
        "type": "PropertyValue", 
        "value": [
          "pub.1052874237"
        ]
      }, 
      {
        "name": "doi", 
        "type": "PropertyValue", 
        "value": [
          "10.1007/978-3-642-15751-6_10"
        ]
      }, 
      {
        "name": "readcube_id", 
        "type": "PropertyValue", 
        "value": [
          "fbdb14033d8cc747b34f2e7751532c82797c9f8508b05923c313e2a898352050"
        ]
      }
    ], 
    "publisher": {
      "location": "Berlin, Heidelberg", 
      "name": "Springer Berlin Heidelberg", 
      "type": "Organisation"
    }, 
    "sameAs": [
      "https://doi.org/10.1007/978-3-642-15751-6_10", 
      "https://app.dimensions.ai/details/publication/pub.1052874237"
    ], 
    "sdDataset": "chapters", 
    "sdDatePublished": "2019-04-16T08:27", 
    "sdLicense": "https://scigraph.springernature.com/explorer/license/", 
    "sdPublisher": {
      "name": "Springer Nature - SN SciGraph project", 
      "type": "Organization"
    }, 
    "sdSource": "s3://com-uberresearch-data-dimensions-target-20181106-alternative/cleanup/v134/2549eaecd7973599484d7c17b260dba0a4ecb94b/merge/v9/a6c9fde33151104705d4d7ff012ea9563521a3ce/jats-lookup/v90/0000000363_0000000363/records_70061_00000002.jsonl", 
    "type": "Chapter", 
    "url": "https://link.springer.com/10.1007%2F978-3-642-15751-6_10"
  }
]
 

Download the RDF metadata as:  json-ld nt turtle xml License info

HOW TO GET THIS DATA PROGRAMMATICALLY:

JSON-LD is a popular format for linked data which is fully compatible with JSON.

curl -H 'Accept: application/ld+json' 'https://scigraph.springernature.com/pub.10.1007/978-3-642-15751-6_10'

N-Triples is a line-based linked data format ideal for batch operations.

curl -H 'Accept: application/n-triples' 'https://scigraph.springernature.com/pub.10.1007/978-3-642-15751-6_10'

Turtle is a human-readable linked data format.

curl -H 'Accept: text/turtle' 'https://scigraph.springernature.com/pub.10.1007/978-3-642-15751-6_10'

RDF/XML is a standard XML format for linked data.

curl -H 'Accept: application/rdf+xml' 'https://scigraph.springernature.com/pub.10.1007/978-3-642-15751-6_10'


 

This table displays all metadata directly associated to this object as RDF triples.

139 TRIPLES      23 PREDICATES      36 URIs      20 LITERALS      8 BLANK NODES

Subject Predicate Object
1 sg:pub.10.1007/978-3-642-15751-6_10 schema:about anzsrc-for:17
2 anzsrc-for:1701
3 schema:author Nc64f29ab7d5340dea8d26b6e2a9b3298
4 schema:citation sg:pub.10.1007/978-3-642-15751-6_32
5 sg:pub.10.1007/978-3-642-15751-6_33
6 sg:pub.10.1007/978-3-642-15751-6_35
7 sg:pub.10.1007/978-3-642-15751-6_36
8 sg:pub.10.1007/978-3-642-15751-6_37
9 sg:pub.10.1007/978-3-642-15751-6_40
10 sg:pub.10.1007/978-3-642-15751-6_42
11 sg:pub.10.1007/978-3-642-15751-6_44
12 https://doi.org/10.1145/1460096.1460104
13 schema:datePublished 2010
14 schema:datePublishedReg 2010-01-01
15 schema:description The Large-Scale Visual Concept Detection and Annotation Task (LS-VCDT) in ImageCLEF 2009 aims at the detection of 53 concepts in consumer photos. These concepts are structured in an ontology which can be utilized during training and classification of the photos. The dataset consists of 18,000 Flickr photos which were manually annotated with 53 concepts. 5,000 photos were used for training and 13,000 for testing. Two evaluation paradigms have been applied, the evaluation per concept and the evaluation per photo. The evaluation per concept was performed by calculating the Equal Error Rate (EER) and the Area Under Curve (AUC). For the evaluation per photo a recently proposed ontology-based measure was utilized that takes the hierarchy and the relations of the ontology into account and calculates a score per photo. Altogether 19 research groups participated and submitted 73 runs. For the concepts, an average AUC of 84% could be achieved, including concepts with an AUC of 95%. The classification performance for each photo ranged between 68.7% and 100% with an average score of 89.6%.
16 schema:editor N144663fcd3a74af7b229ff7138de747b
17 schema:genre chapter
18 schema:inLanguage en
19 schema:isAccessibleForFree false
20 schema:isPartOf Nf8fa62dded054003a1bdefd010ff2541
21 schema:name Overview of the CLEF 2009 Large-Scale Visual Concept Detection and Annotation Task
22 schema:pagination 94-109
23 schema:productId N469455b08ab04daeaffc3f11a921450d
24 N51416776b7bf4818b63da025f1d26dac
25 Ne996c5366fb4476fa85c0070d4091cc6
26 schema:publisher Nce91ddffeacb4a66959158f3322c3b26
27 schema:sameAs https://app.dimensions.ai/details/publication/pub.1052874237
28 https://doi.org/10.1007/978-3-642-15751-6_10
29 schema:sdDatePublished 2019-04-16T08:27
30 schema:sdLicense https://scigraph.springernature.com/explorer/license/
31 schema:sdPublisher Nb5839f567dd04d9faea3da7b04c31681
32 schema:url https://link.springer.com/10.1007%2F978-3-642-15751-6_10
33 sgo:license sg:explorer/license/
34 sgo:sdDataset chapters
35 rdf:type schema:Chapter
36 N10667bd56c2c4960b5347ef4e48985ac schema:familyName Tsikrika
37 schema:givenName Theodora
38 rdf:type schema:Person
39 N144663fcd3a74af7b229ff7138de747b rdf:first N50a04ac180a9402cb10b80b7f44febdf
40 rdf:rest N84d1a5ee29444304aeb26df1b588c512
41 N19003fa8039741a999290ffb7ddda5ae schema:familyName Caputo
42 schema:givenName Barbara
43 rdf:type schema:Person
44 N337014bb464d4d3d85e74f5f10f5aad7 rdf:first Na5aed7afc51b4d0b991a3916a54fbfda
45 rdf:rest N7f1d1be42cac49f9b945edff9aeabd81
46 N469455b08ab04daeaffc3f11a921450d schema:name readcube_id
47 schema:value fbdb14033d8cc747b34f2e7751532c82797c9f8508b05923c313e2a898352050
48 rdf:type schema:PropertyValue
49 N50a04ac180a9402cb10b80b7f44febdf schema:familyName Peters
50 schema:givenName Carol
51 rdf:type schema:Person
52 N50c29a550193463b9beecc4c49e800de rdf:first sg:person.010761747005.41
53 rdf:rest rdf:nil
54 N5121a369d9b141f4aac99c8adfb06cbd schema:familyName Kalpathy-Cramer
55 schema:givenName Jayashree
56 rdf:type schema:Person
57 N51416776b7bf4818b63da025f1d26dac schema:name dimensions_id
58 schema:value pub.1052874237
59 rdf:type schema:PropertyValue
60 N732af458bbbf415586df18d5c87f97f0 schema:familyName Müller
61 schema:givenName Henning
62 rdf:type schema:Person
63 N7f1d1be42cac49f9b945edff9aeabd81 rdf:first Nb4d640b3c31f4d27a1f926ce0c4351cb
64 rdf:rest N992ff229719147598b47530c97fab50f
65 N8256fd008d2c406d99e0337aa7821dfc rdf:first N10667bd56c2c4960b5347ef4e48985ac
66 rdf:rest rdf:nil
67 N84d1a5ee29444304aeb26df1b588c512 rdf:first N19003fa8039741a999290ffb7ddda5ae
68 rdf:rest N337014bb464d4d3d85e74f5f10f5aad7
69 N992ff229719147598b47530c97fab50f rdf:first N5121a369d9b141f4aac99c8adfb06cbd
70 rdf:rest Na78fc8a23b1c4f9fbcc9ffc1a9e03345
71 Na5aed7afc51b4d0b991a3916a54fbfda schema:familyName Gonzalo
72 schema:givenName Julio
73 rdf:type schema:Person
74 Na78fc8a23b1c4f9fbcc9ffc1a9e03345 rdf:first N732af458bbbf415586df18d5c87f97f0
75 rdf:rest N8256fd008d2c406d99e0337aa7821dfc
76 Nb4d640b3c31f4d27a1f926ce0c4351cb schema:familyName Jones
77 schema:givenName Gareth J. F.
78 rdf:type schema:Person
79 Nb5839f567dd04d9faea3da7b04c31681 schema:name Springer Nature - SN SciGraph project
80 rdf:type schema:Organization
81 Nbd091f0241664f2faaf9c94a7d3a72e8 schema:name Media Technology Lab, Gracenote Inc, Emeryville, CA, USA
82 rdf:type schema:Organization
83 Nc64f29ab7d5340dea8d26b6e2a9b3298 rdf:first sg:person.010632377665.20
84 rdf:rest N50c29a550193463b9beecc4c49e800de
85 Nce91ddffeacb4a66959158f3322c3b26 schema:location Berlin, Heidelberg
86 schema:name Springer Berlin Heidelberg
87 rdf:type schema:Organisation
88 Ne996c5366fb4476fa85c0070d4091cc6 schema:name doi
89 schema:value 10.1007/978-3-642-15751-6_10
90 rdf:type schema:PropertyValue
91 Nf8fa62dded054003a1bdefd010ff2541 schema:isbn 978-3-642-15750-9
92 978-3-642-15751-6
93 schema:name Multilingual Information Access Evaluation II. Multimedia Experiments
94 rdf:type schema:Book
95 anzsrc-for:17 schema:inDefinedTermSet anzsrc-for:
96 schema:name Psychology and Cognitive Sciences
97 rdf:type schema:DefinedTerm
98 anzsrc-for:1701 schema:inDefinedTermSet anzsrc-for:
99 schema:name Psychology
100 rdf:type schema:DefinedTerm
101 sg:person.010632377665.20 schema:affiliation https://www.grid.ac/institutes/grid.469861.4
102 schema:familyName Nowak
103 schema:givenName Stefanie
104 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010632377665.20
105 rdf:type schema:Person
106 sg:person.010761747005.41 schema:affiliation Nbd091f0241664f2faaf9c94a7d3a72e8
107 schema:familyName Dunker
108 schema:givenName Peter
109 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010761747005.41
110 rdf:type schema:Person
111 sg:pub.10.1007/978-3-642-15751-6_32 schema:sameAs https://app.dimensions.ai/details/publication/pub.1005081003
112 https://doi.org/10.1007/978-3-642-15751-6_32
113 rdf:type schema:CreativeWork
114 sg:pub.10.1007/978-3-642-15751-6_33 schema:sameAs https://app.dimensions.ai/details/publication/pub.1004665961
115 https://doi.org/10.1007/978-3-642-15751-6_33
116 rdf:type schema:CreativeWork
117 sg:pub.10.1007/978-3-642-15751-6_35 schema:sameAs https://app.dimensions.ai/details/publication/pub.1022925612
118 https://doi.org/10.1007/978-3-642-15751-6_35
119 rdf:type schema:CreativeWork
120 sg:pub.10.1007/978-3-642-15751-6_36 schema:sameAs https://app.dimensions.ai/details/publication/pub.1034080535
121 https://doi.org/10.1007/978-3-642-15751-6_36
122 rdf:type schema:CreativeWork
123 sg:pub.10.1007/978-3-642-15751-6_37 schema:sameAs https://app.dimensions.ai/details/publication/pub.1030509913
124 https://doi.org/10.1007/978-3-642-15751-6_37
125 rdf:type schema:CreativeWork
126 sg:pub.10.1007/978-3-642-15751-6_40 schema:sameAs https://app.dimensions.ai/details/publication/pub.1000579645
127 https://doi.org/10.1007/978-3-642-15751-6_40
128 rdf:type schema:CreativeWork
129 sg:pub.10.1007/978-3-642-15751-6_42 schema:sameAs https://app.dimensions.ai/details/publication/pub.1037318832
130 https://doi.org/10.1007/978-3-642-15751-6_42
131 rdf:type schema:CreativeWork
132 sg:pub.10.1007/978-3-642-15751-6_44 schema:sameAs https://app.dimensions.ai/details/publication/pub.1007875289
133 https://doi.org/10.1007/978-3-642-15751-6_44
134 rdf:type schema:CreativeWork
135 https://doi.org/10.1145/1460096.1460104 schema:sameAs https://app.dimensions.ai/details/publication/pub.1005779407
136 rdf:type schema:CreativeWork
137 https://www.grid.ac/institutes/grid.469861.4 schema:alternateName Fraunhofer Institute for Digital Media Technology
138 schema:name Audio-Visual Systems, Fraunhofer IDMT, Ilmenau, Germany
139 rdf:type schema:Organization
 




Preview window. Press ESC to close (or click here)


...