Towards Space-Time Semantics in Two Frames View Full Text


Ontology type: schema:Chapter      Open Access: True


Chapter Info

DATE

2012

AUTHORS

Karla Brkić , Axel Pinz , Zoran Kalafatić , Siniša Šegvić

ABSTRACT

We present a novel, low-level scheme to analyze spatial and temporal change within a local support region. Assuming available region correspondences between two adjacent frames, we divide each region into a regular grid of patches. Depending on the change of an image function inside the patch over time, each patch is assigned weights for the following four labels: “C” for a constant patch, “O” when new information originates from outside the support region, “I” for “inner” changes, and “N” for information from neighboring patches. Our method goes beyond optical flow, as it provides an additional semantic level of understanding the changes in space-time. We demonstrate how our novel “COIN” scheme can be used to categorize local space-time events in image pairs, including locally planar support regions, 3D discontinuities, and virtual vs. real crossings of 3D structures. More... »

PAGES

121-130

References to SciGraph publications

  • 2011. Histogram-Based Description of Local Space-Time Appearance in IMAGE ANALYSIS
  • 2005-09. On Space-Time Interest Points in INTERNATIONAL JOURNAL OF COMPUTER VISION
  • 2012-03. Interesting Interest Points in INTERNATIONAL JOURNAL OF COMPUTER VISION
  • 2010. Detecting Spatiotemporal Structure Boundaries: Beyond Motion Discontinuities in COMPUTER VISION – ACCV 2009
  • 2003-02. Dynamic Textures in INTERNATIONAL JOURNAL OF COMPUTER VISION
  • Book

    TITLE

    Computer Vision – ECCV 2012. Workshops and Demonstrations

    ISBN

    978-3-642-33884-7
    978-3-642-33885-4

    Identifiers

    URI

    http://scigraph.springernature.com/pub.10.1007/978-3-642-33885-4_13

    DOI

    http://dx.doi.org/10.1007/978-3-642-33885-4_13

    DIMENSIONS

    https://app.dimensions.ai/details/publication/pub.1016579014


    Indexing Status Check whether this publication has been indexed by Scopus and Web Of Science using the SN Indexing Status Tool
    Incoming Citations Browse incoming citations for this publication using opencitations.net

    JSON-LD is the canonical representation for SciGraph data.

    TIP: You can open this SciGraph record using an external JSON-LD service: JSON-LD Playground Google SDTT

    [
      {
        "@context": "https://springernature.github.io/scigraph/jsonld/sgcontext.json", 
        "about": [
          {
            "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/0801", 
            "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
            "name": "Artificial Intelligence and Image Processing", 
            "type": "DefinedTerm"
          }, 
          {
            "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/08", 
            "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
            "name": "Information and Computing Sciences", 
            "type": "DefinedTerm"
          }
        ], 
        "author": [
          {
            "affiliation": {
              "alternateName": "University of Zagreb", 
              "id": "https://www.grid.ac/institutes/grid.4808.4", 
              "name": [
                "Faculty of Electrical Engineering and Computing, University of Zagreb, Croatia"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Brki\u0107", 
            "givenName": "Karla", 
            "id": "sg:person.013636557205.05", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.013636557205.05"
            ], 
            "type": "Person"
          }, 
          {
            "affiliation": {
              "alternateName": "Graz University of Technology", 
              "id": "https://www.grid.ac/institutes/grid.410413.3", 
              "name": [
                "Graz University of Technology, Austria"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Pinz", 
            "givenName": "Axel", 
            "id": "sg:person.012033065653.49", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.012033065653.49"
            ], 
            "type": "Person"
          }, 
          {
            "affiliation": {
              "alternateName": "University of Zagreb", 
              "id": "https://www.grid.ac/institutes/grid.4808.4", 
              "name": [
                "Faculty of Electrical Engineering and Computing, University of Zagreb, Croatia"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Kalafati\u0107", 
            "givenName": "Zoran", 
            "id": "sg:person.012150053074.71", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.012150053074.71"
            ], 
            "type": "Person"
          }, 
          {
            "affiliation": {
              "alternateName": "University of Zagreb", 
              "id": "https://www.grid.ac/institutes/grid.4808.4", 
              "name": [
                "Faculty of Electrical Engineering and Computing, University of Zagreb, Croatia"
              ], 
              "type": "Organization"
            }, 
            "familyName": "\u0160egvi\u0107", 
            "givenName": "Sini\u0161a", 
            "id": "sg:person.014100560705.96", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.014100560705.96"
            ], 
            "type": "Person"
          }
        ], 
        "citation": [
          {
            "id": "sg:pub.10.1023/a:1021669406132", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1008692516", 
              "https://doi.org/10.1023/a:1021669406132"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/s11263-011-0473-8", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1017080323", 
              "https://doi.org/10.1007/s11263-011-0473-8"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1109/vspets.2005.1570899", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1018076917"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1016/j.imavis.2008.04.017", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1019460000"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/s11263-005-1838-7", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1031382793", 
              "https://doi.org/10.1007/s11263-005-1838-7"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/s11263-005-1838-7", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1031382793", 
              "https://doi.org/10.1007/s11263-005-1838-7"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/s11263-005-1838-7", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1031382793", 
              "https://doi.org/10.1007/s11263-005-1838-7"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/978-3-642-12304-7_29", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1033384214", 
              "https://doi.org/10.1007/978-3-642-12304-7_29"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/978-3-642-12304-7_29", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1033384214", 
              "https://doi.org/10.1007/978-3-642-12304-7_29"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/978-3-642-21227-7_20", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1034408622", 
              "https://doi.org/10.1007/978-3-642-21227-7_20"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/978-3-642-21227-7_20", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1034408622", 
              "https://doi.org/10.1007/978-3-642-21227-7_20"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1109/tnn.2003.810605", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1061716563"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1109/tpami.2005.123", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1061742792"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1109/tpami.2011.221", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1061744103"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1109/iccv.2003.1238378", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1094433853"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.5244/c.23.124", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1099325624"
            ], 
            "type": "CreativeWork"
          }
        ], 
        "datePublished": "2012", 
        "datePublishedReg": "2012-01-01", 
        "description": "We present a novel, low-level scheme to analyze spatial and temporal change within a local support region. Assuming available region correspondences between two adjacent frames, we divide each region into a regular grid of patches. Depending on the change of an image function inside the patch over time, each patch is assigned weights for the following four labels: \u201cC\u201d for a constant patch, \u201cO\u201d when new information originates from outside the support region, \u201cI\u201d for \u201cinner\u201d changes, and \u201cN\u201d for information from neighboring patches. Our method goes beyond optical flow, as it provides an additional semantic level of understanding the changes in space-time. We demonstrate how our novel \u201cCOIN\u201d scheme can be used to categorize local space-time events in image pairs, including locally planar support regions, 3D discontinuities, and virtual vs.\u00a0real crossings of 3D structures.", 
        "editor": [
          {
            "familyName": "Fusiello", 
            "givenName": "Andrea", 
            "type": "Person"
          }, 
          {
            "familyName": "Murino", 
            "givenName": "Vittorio", 
            "type": "Person"
          }, 
          {
            "familyName": "Cucchiara", 
            "givenName": "Rita", 
            "type": "Person"
          }
        ], 
        "genre": "chapter", 
        "id": "sg:pub.10.1007/978-3-642-33885-4_13", 
        "inLanguage": [
          "en"
        ], 
        "isAccessibleForFree": true, 
        "isPartOf": {
          "isbn": [
            "978-3-642-33884-7", 
            "978-3-642-33885-4"
          ], 
          "name": "Computer Vision \u2013 ECCV 2012. Workshops and Demonstrations", 
          "type": "Book"
        }, 
        "name": "Towards Space-Time Semantics in Two Frames", 
        "pagination": "121-130", 
        "productId": [
          {
            "name": "doi", 
            "type": "PropertyValue", 
            "value": [
              "10.1007/978-3-642-33885-4_13"
            ]
          }, 
          {
            "name": "readcube_id", 
            "type": "PropertyValue", 
            "value": [
              "4efe52eed62a6d5e92c6949aae48831941a4e67bd66b2229726acbd7e6419810"
            ]
          }, 
          {
            "name": "dimensions_id", 
            "type": "PropertyValue", 
            "value": [
              "pub.1016579014"
            ]
          }
        ], 
        "publisher": {
          "location": "Berlin, Heidelberg", 
          "name": "Springer Berlin Heidelberg", 
          "type": "Organisation"
        }, 
        "sameAs": [
          "https://doi.org/10.1007/978-3-642-33885-4_13", 
          "https://app.dimensions.ai/details/publication/pub.1016579014"
        ], 
        "sdDataset": "chapters", 
        "sdDatePublished": "2019-04-15T15:20", 
        "sdLicense": "https://scigraph.springernature.com/explorer/license/", 
        "sdPublisher": {
          "name": "Springer Nature - SN SciGraph project", 
          "type": "Organization"
        }, 
        "sdSource": "s3://com-uberresearch-data-dimensions-target-20181106-alternative/cleanup/v134/2549eaecd7973599484d7c17b260dba0a4ecb94b/merge/v9/a6c9fde33151104705d4d7ff012ea9563521a3ce/jats-lookup/v90/0000000001_0000000264/records_8672_00000253.jsonl", 
        "type": "Chapter", 
        "url": "http://link.springer.com/10.1007/978-3-642-33885-4_13"
      }
    ]
     

    Download the RDF metadata as:  json-ld nt turtle xml License info

    HOW TO GET THIS DATA PROGRAMMATICALLY:

    JSON-LD is a popular format for linked data which is fully compatible with JSON.

    curl -H 'Accept: application/ld+json' 'https://scigraph.springernature.com/pub.10.1007/978-3-642-33885-4_13'

    N-Triples is a line-based linked data format ideal for batch operations.

    curl -H 'Accept: application/n-triples' 'https://scigraph.springernature.com/pub.10.1007/978-3-642-33885-4_13'

    Turtle is a human-readable linked data format.

    curl -H 'Accept: text/turtle' 'https://scigraph.springernature.com/pub.10.1007/978-3-642-33885-4_13'

    RDF/XML is a standard XML format for linked data.

    curl -H 'Accept: application/rdf+xml' 'https://scigraph.springernature.com/pub.10.1007/978-3-642-33885-4_13'


     

    This table displays all metadata directly associated to this object as RDF triples.

    140 TRIPLES      23 PREDICATES      39 URIs      20 LITERALS      8 BLANK NODES

    Subject Predicate Object
    1 sg:pub.10.1007/978-3-642-33885-4_13 schema:about anzsrc-for:08
    2 anzsrc-for:0801
    3 schema:author N7e0a61720ee34309905b13258c486597
    4 schema:citation sg:pub.10.1007/978-3-642-12304-7_29
    5 sg:pub.10.1007/978-3-642-21227-7_20
    6 sg:pub.10.1007/s11263-005-1838-7
    7 sg:pub.10.1007/s11263-011-0473-8
    8 sg:pub.10.1023/a:1021669406132
    9 https://doi.org/10.1016/j.imavis.2008.04.017
    10 https://doi.org/10.1109/iccv.2003.1238378
    11 https://doi.org/10.1109/tnn.2003.810605
    12 https://doi.org/10.1109/tpami.2005.123
    13 https://doi.org/10.1109/tpami.2011.221
    14 https://doi.org/10.1109/vspets.2005.1570899
    15 https://doi.org/10.5244/c.23.124
    16 schema:datePublished 2012
    17 schema:datePublishedReg 2012-01-01
    18 schema:description We present a novel, low-level scheme to analyze spatial and temporal change within a local support region. Assuming available region correspondences between two adjacent frames, we divide each region into a regular grid of patches. Depending on the change of an image function inside the patch over time, each patch is assigned weights for the following four labels: “C” for a constant patch, “O” when new information originates from outside the support region, “I” for “inner” changes, and “N” for information from neighboring patches. Our method goes beyond optical flow, as it provides an additional semantic level of understanding the changes in space-time. We demonstrate how our novel “COIN” scheme can be used to categorize local space-time events in image pairs, including locally planar support regions, 3D discontinuities, and virtual vs. real crossings of 3D structures.
    19 schema:editor Ned87c109c9e8487c8482de41f7d405d9
    20 schema:genre chapter
    21 schema:inLanguage en
    22 schema:isAccessibleForFree true
    23 schema:isPartOf N654aff12e1924914a7669133d614b3b3
    24 schema:name Towards Space-Time Semantics in Two Frames
    25 schema:pagination 121-130
    26 schema:productId N3af34b2b749f42deafa14f8437da6d1a
    27 N3b093ea78e85436990a9977b02d5a041
    28 Na9755f73595b4069badad16a95824886
    29 schema:publisher Nf54c61b9d4e44c4f8d7ecd2677196486
    30 schema:sameAs https://app.dimensions.ai/details/publication/pub.1016579014
    31 https://doi.org/10.1007/978-3-642-33885-4_13
    32 schema:sdDatePublished 2019-04-15T15:20
    33 schema:sdLicense https://scigraph.springernature.com/explorer/license/
    34 schema:sdPublisher Nfaf35b0de64c4e75b1635ee4ef39cbd1
    35 schema:url http://link.springer.com/10.1007/978-3-642-33885-4_13
    36 sgo:license sg:explorer/license/
    37 sgo:sdDataset chapters
    38 rdf:type schema:Chapter
    39 N2d6c858a923c488f896dcfcdaafb31db rdf:first sg:person.012033065653.49
    40 rdf:rest N5f9efca1b7e64aa3aabe28938fa034c6
    41 N33db77b87672465fb60f416a15c90e93 rdf:first Nb4bdbb1bf0ff44c0a3de037108277f8b
    42 rdf:rest rdf:nil
    43 N3af34b2b749f42deafa14f8437da6d1a schema:name doi
    44 schema:value 10.1007/978-3-642-33885-4_13
    45 rdf:type schema:PropertyValue
    46 N3b093ea78e85436990a9977b02d5a041 schema:name readcube_id
    47 schema:value 4efe52eed62a6d5e92c6949aae48831941a4e67bd66b2229726acbd7e6419810
    48 rdf:type schema:PropertyValue
    49 N53b0d7ec5b924a82b6bc124399f289e8 rdf:first sg:person.014100560705.96
    50 rdf:rest rdf:nil
    51 N5f9efca1b7e64aa3aabe28938fa034c6 rdf:first sg:person.012150053074.71
    52 rdf:rest N53b0d7ec5b924a82b6bc124399f289e8
    53 N654aff12e1924914a7669133d614b3b3 schema:isbn 978-3-642-33884-7
    54 978-3-642-33885-4
    55 schema:name Computer Vision – ECCV 2012. Workshops and Demonstrations
    56 rdf:type schema:Book
    57 N6db52cf7f70a4aa292258e3b9fc9815f schema:familyName Fusiello
    58 schema:givenName Andrea
    59 rdf:type schema:Person
    60 N7e0a61720ee34309905b13258c486597 rdf:first sg:person.013636557205.05
    61 rdf:rest N2d6c858a923c488f896dcfcdaafb31db
    62 Na9755f73595b4069badad16a95824886 schema:name dimensions_id
    63 schema:value pub.1016579014
    64 rdf:type schema:PropertyValue
    65 Nb1100d625b544941b9e5dcbcfe2881ce rdf:first Nce86ee733fec4bddb1bf4932e0d9c65c
    66 rdf:rest N33db77b87672465fb60f416a15c90e93
    67 Nb4bdbb1bf0ff44c0a3de037108277f8b schema:familyName Cucchiara
    68 schema:givenName Rita
    69 rdf:type schema:Person
    70 Nce86ee733fec4bddb1bf4932e0d9c65c schema:familyName Murino
    71 schema:givenName Vittorio
    72 rdf:type schema:Person
    73 Ned87c109c9e8487c8482de41f7d405d9 rdf:first N6db52cf7f70a4aa292258e3b9fc9815f
    74 rdf:rest Nb1100d625b544941b9e5dcbcfe2881ce
    75 Nf54c61b9d4e44c4f8d7ecd2677196486 schema:location Berlin, Heidelberg
    76 schema:name Springer Berlin Heidelberg
    77 rdf:type schema:Organisation
    78 Nfaf35b0de64c4e75b1635ee4ef39cbd1 schema:name Springer Nature - SN SciGraph project
    79 rdf:type schema:Organization
    80 anzsrc-for:08 schema:inDefinedTermSet anzsrc-for:
    81 schema:name Information and Computing Sciences
    82 rdf:type schema:DefinedTerm
    83 anzsrc-for:0801 schema:inDefinedTermSet anzsrc-for:
    84 schema:name Artificial Intelligence and Image Processing
    85 rdf:type schema:DefinedTerm
    86 sg:person.012033065653.49 schema:affiliation https://www.grid.ac/institutes/grid.410413.3
    87 schema:familyName Pinz
    88 schema:givenName Axel
    89 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.012033065653.49
    90 rdf:type schema:Person
    91 sg:person.012150053074.71 schema:affiliation https://www.grid.ac/institutes/grid.4808.4
    92 schema:familyName Kalafatić
    93 schema:givenName Zoran
    94 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.012150053074.71
    95 rdf:type schema:Person
    96 sg:person.013636557205.05 schema:affiliation https://www.grid.ac/institutes/grid.4808.4
    97 schema:familyName Brkić
    98 schema:givenName Karla
    99 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.013636557205.05
    100 rdf:type schema:Person
    101 sg:person.014100560705.96 schema:affiliation https://www.grid.ac/institutes/grid.4808.4
    102 schema:familyName Šegvić
    103 schema:givenName Siniša
    104 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.014100560705.96
    105 rdf:type schema:Person
    106 sg:pub.10.1007/978-3-642-12304-7_29 schema:sameAs https://app.dimensions.ai/details/publication/pub.1033384214
    107 https://doi.org/10.1007/978-3-642-12304-7_29
    108 rdf:type schema:CreativeWork
    109 sg:pub.10.1007/978-3-642-21227-7_20 schema:sameAs https://app.dimensions.ai/details/publication/pub.1034408622
    110 https://doi.org/10.1007/978-3-642-21227-7_20
    111 rdf:type schema:CreativeWork
    112 sg:pub.10.1007/s11263-005-1838-7 schema:sameAs https://app.dimensions.ai/details/publication/pub.1031382793
    113 https://doi.org/10.1007/s11263-005-1838-7
    114 rdf:type schema:CreativeWork
    115 sg:pub.10.1007/s11263-011-0473-8 schema:sameAs https://app.dimensions.ai/details/publication/pub.1017080323
    116 https://doi.org/10.1007/s11263-011-0473-8
    117 rdf:type schema:CreativeWork
    118 sg:pub.10.1023/a:1021669406132 schema:sameAs https://app.dimensions.ai/details/publication/pub.1008692516
    119 https://doi.org/10.1023/a:1021669406132
    120 rdf:type schema:CreativeWork
    121 https://doi.org/10.1016/j.imavis.2008.04.017 schema:sameAs https://app.dimensions.ai/details/publication/pub.1019460000
    122 rdf:type schema:CreativeWork
    123 https://doi.org/10.1109/iccv.2003.1238378 schema:sameAs https://app.dimensions.ai/details/publication/pub.1094433853
    124 rdf:type schema:CreativeWork
    125 https://doi.org/10.1109/tnn.2003.810605 schema:sameAs https://app.dimensions.ai/details/publication/pub.1061716563
    126 rdf:type schema:CreativeWork
    127 https://doi.org/10.1109/tpami.2005.123 schema:sameAs https://app.dimensions.ai/details/publication/pub.1061742792
    128 rdf:type schema:CreativeWork
    129 https://doi.org/10.1109/tpami.2011.221 schema:sameAs https://app.dimensions.ai/details/publication/pub.1061744103
    130 rdf:type schema:CreativeWork
    131 https://doi.org/10.1109/vspets.2005.1570899 schema:sameAs https://app.dimensions.ai/details/publication/pub.1018076917
    132 rdf:type schema:CreativeWork
    133 https://doi.org/10.5244/c.23.124 schema:sameAs https://app.dimensions.ai/details/publication/pub.1099325624
    134 rdf:type schema:CreativeWork
    135 https://www.grid.ac/institutes/grid.410413.3 schema:alternateName Graz University of Technology
    136 schema:name Graz University of Technology, Austria
    137 rdf:type schema:Organization
    138 https://www.grid.ac/institutes/grid.4808.4 schema:alternateName University of Zagreb
    139 schema:name Faculty of Electrical Engineering and Computing, University of Zagreb, Croatia
    140 rdf:type schema:Organization
     




    Preview window. Press ESC to close (or click here)


    ...