Human-Computer Interaction through Time-of-Flight and RGB Cameras View Full Text


Ontology type: schema:Chapter      Open Access: True


Chapter Info

DATE

2011

AUTHORS

Piercarlo Dondi , Luca Lombardi , Marco Porta

ABSTRACT

The number of systems exploiting Time-of-Flight (ToF) cameras for gesture recognition has greatly increased in the last years, confirming a very positive trend of this technology within the field of Human-Computer Interaction. In this work we present a new kind of application for the interaction with a virtual keyboard which is based on the use of an ordinary RGB webcam and a ToF camera. Our approach can be subdivided into two steps: firstly a segmentation of the entire body of the user is achieved exploiting only the ToF data; then the extraction of hands and head is obtained applying color information on the retrieved clusters. The final tracking step, based on the Kalman filter, is able to recognize the chosen hand also in presence of a second hand or the head. Tests, carried out with users of different ages, showed interesting results and a quick learning curve. More... »

PAGES

89-98

References to SciGraph publications

  • 2007. Hand Gesture Recognition with a Novel IR Time-of-Flight Range Camera–A Pilot Study in COMPUTER VISION/COMPUTER GRAPHICS COLLABORATION TECHNIQUES
  • 2010. Deictic Gestures with a Time-of-Flight Camera in GESTURE IN EMBODIED COMMUNICATION AND HUMAN-COMPUTER INTERACTION
  • Book

    TITLE

    Image Analysis and Processing – ICIAP 2011

    ISBN

    978-3-642-24087-4
    978-3-642-24088-1

    Author Affiliations

    Identifiers

    URI

    http://scigraph.springernature.com/pub.10.1007/978-3-642-24088-1_10

    DOI

    http://dx.doi.org/10.1007/978-3-642-24088-1_10

    DIMENSIONS

    https://app.dimensions.ai/details/publication/pub.1024921710


    Indexing Status Check whether this publication has been indexed by Scopus and Web Of Science using the SN Indexing Status Tool
    Incoming Citations Browse incoming citations for this publication using opencitations.net

    JSON-LD is the canonical representation for SciGraph data.

    TIP: You can open this SciGraph record using an external JSON-LD service: JSON-LD Playground Google SDTT

    [
      {
        "@context": "https://springernature.github.io/scigraph/jsonld/sgcontext.json", 
        "about": [
          {
            "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/0801", 
            "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
            "name": "Artificial Intelligence and Image Processing", 
            "type": "DefinedTerm"
          }, 
          {
            "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/08", 
            "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
            "name": "Information and Computing Sciences", 
            "type": "DefinedTerm"
          }
        ], 
        "author": [
          {
            "affiliation": {
              "alternateName": "University of Pavia", 
              "id": "https://www.grid.ac/institutes/grid.8982.b", 
              "name": [
                "Department of Computer Engineering and Systems Science, University of Pavia, Via Ferrata 1, 27100\u00a0Pavia, Italy"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Dondi", 
            "givenName": "Piercarlo", 
            "id": "sg:person.013147430753.29", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.013147430753.29"
            ], 
            "type": "Person"
          }, 
          {
            "affiliation": {
              "alternateName": "University of Pavia", 
              "id": "https://www.grid.ac/institutes/grid.8982.b", 
              "name": [
                "Department of Computer Engineering and Systems Science, University of Pavia, Via Ferrata 1, 27100\u00a0Pavia, Italy"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Lombardi", 
            "givenName": "Luca", 
            "id": "sg:person.011416663251.54", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.011416663251.54"
            ], 
            "type": "Person"
          }, 
          {
            "affiliation": {
              "alternateName": "University of Pavia", 
              "id": "https://www.grid.ac/institutes/grid.8982.b", 
              "name": [
                "Department of Computer Engineering and Systems Science, University of Pavia, Via Ferrata 1, 27100\u00a0Pavia, Italy"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Porta", 
            "givenName": "Marco", 
            "id": "sg:person.010622175511.26", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010622175511.26"
            ], 
            "type": "Person"
          }
        ], 
        "citation": [
          {
            "id": "https://doi.org/10.1111/j.1467-8659.2009.01583.x", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1000554313"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1111/j.1467-8659.2009.01583.x", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1000554313"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/978-3-642-12553-9_10", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1014500069", 
              "https://doi.org/10.1007/978-3-642-12553-9_10"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/978-3-642-12553-9_10", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1014500069", 
              "https://doi.org/10.1007/978-3-642-12553-9_10"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/978-3-540-71457-6_23", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1039435266", 
              "https://doi.org/10.1007/978-3-540-71457-6_23"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1504/ijista.2008.021296", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1067467072"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1109/isscs.2007.4292691", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1094015542"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1109/cvprw.2008.4563162", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1094238785"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1109/wacv.2011.5711485", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1095489942"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.5220/0003322505820587", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1099369983"
            ], 
            "type": "CreativeWork"
          }
        ], 
        "datePublished": "2011", 
        "datePublishedReg": "2011-01-01", 
        "description": "The number of systems exploiting Time-of-Flight (ToF) cameras for gesture recognition has greatly increased in the last years, confirming a very positive trend of this technology within the field of Human-Computer Interaction. In this work we present a new kind of application for the interaction with a virtual keyboard which is based on the use of an ordinary RGB webcam and a ToF camera. Our approach can be subdivided into two steps: firstly a segmentation of the entire body of the user is achieved exploiting only the ToF data; then the extraction of hands and head is obtained applying color information on the retrieved clusters. The final tracking step, based on the Kalman filter, is able to recognize the chosen hand also in presence of a second hand or the head. Tests, carried out with users of different ages, showed interesting results and a quick learning curve.", 
        "editor": [
          {
            "familyName": "Maino", 
            "givenName": "Giuseppe", 
            "type": "Person"
          }, 
          {
            "familyName": "Foresti", 
            "givenName": "Gian Luca", 
            "type": "Person"
          }
        ], 
        "genre": "chapter", 
        "id": "sg:pub.10.1007/978-3-642-24088-1_10", 
        "inLanguage": [
          "en"
        ], 
        "isAccessibleForFree": true, 
        "isPartOf": {
          "isbn": [
            "978-3-642-24087-4", 
            "978-3-642-24088-1"
          ], 
          "name": "Image Analysis and Processing \u2013 ICIAP 2011", 
          "type": "Book"
        }, 
        "name": "Human-Computer Interaction through Time-of-Flight and RGB Cameras", 
        "pagination": "89-98", 
        "productId": [
          {
            "name": "doi", 
            "type": "PropertyValue", 
            "value": [
              "10.1007/978-3-642-24088-1_10"
            ]
          }, 
          {
            "name": "readcube_id", 
            "type": "PropertyValue", 
            "value": [
              "76ba2fdb987743950a37459f9cef3062a9bc6cd96659a887fb1d1ca15809f74e"
            ]
          }, 
          {
            "name": "dimensions_id", 
            "type": "PropertyValue", 
            "value": [
              "pub.1024921710"
            ]
          }
        ], 
        "publisher": {
          "location": "Berlin, Heidelberg", 
          "name": "Springer Berlin Heidelberg", 
          "type": "Organisation"
        }, 
        "sameAs": [
          "https://doi.org/10.1007/978-3-642-24088-1_10", 
          "https://app.dimensions.ai/details/publication/pub.1024921710"
        ], 
        "sdDataset": "chapters", 
        "sdDatePublished": "2019-04-15T15:53", 
        "sdLicense": "https://scigraph.springernature.com/explorer/license/", 
        "sdPublisher": {
          "name": "Springer Nature - SN SciGraph project", 
          "type": "Organization"
        }, 
        "sdSource": "s3://com-uberresearch-data-dimensions-target-20181106-alternative/cleanup/v134/2549eaecd7973599484d7c17b260dba0a4ecb94b/merge/v9/a6c9fde33151104705d4d7ff012ea9563521a3ce/jats-lookup/v90/0000000001_0000000264/records_8672_00000556.jsonl", 
        "type": "Chapter", 
        "url": "http://link.springer.com/10.1007/978-3-642-24088-1_10"
      }
    ]
     

    Download the RDF metadata as:  json-ld nt turtle xml License info

    HOW TO GET THIS DATA PROGRAMMATICALLY:

    JSON-LD is a popular format for linked data which is fully compatible with JSON.

    curl -H 'Accept: application/ld+json' 'https://scigraph.springernature.com/pub.10.1007/978-3-642-24088-1_10'

    N-Triples is a line-based linked data format ideal for batch operations.

    curl -H 'Accept: application/n-triples' 'https://scigraph.springernature.com/pub.10.1007/978-3-642-24088-1_10'

    Turtle is a human-readable linked data format.

    curl -H 'Accept: text/turtle' 'https://scigraph.springernature.com/pub.10.1007/978-3-642-24088-1_10'

    RDF/XML is a standard XML format for linked data.

    curl -H 'Accept: application/rdf+xml' 'https://scigraph.springernature.com/pub.10.1007/978-3-642-24088-1_10'


     

    This table displays all metadata directly associated to this object as RDF triples.

    110 TRIPLES      23 PREDICATES      35 URIs      20 LITERALS      8 BLANK NODES

    Subject Predicate Object
    1 sg:pub.10.1007/978-3-642-24088-1_10 schema:about anzsrc-for:08
    2 anzsrc-for:0801
    3 schema:author Nb979e8f079c5471a9f685579d67f38c0
    4 schema:citation sg:pub.10.1007/978-3-540-71457-6_23
    5 sg:pub.10.1007/978-3-642-12553-9_10
    6 https://doi.org/10.1109/cvprw.2008.4563162
    7 https://doi.org/10.1109/isscs.2007.4292691
    8 https://doi.org/10.1109/wacv.2011.5711485
    9 https://doi.org/10.1111/j.1467-8659.2009.01583.x
    10 https://doi.org/10.1504/ijista.2008.021296
    11 https://doi.org/10.5220/0003322505820587
    12 schema:datePublished 2011
    13 schema:datePublishedReg 2011-01-01
    14 schema:description The number of systems exploiting Time-of-Flight (ToF) cameras for gesture recognition has greatly increased in the last years, confirming a very positive trend of this technology within the field of Human-Computer Interaction. In this work we present a new kind of application for the interaction with a virtual keyboard which is based on the use of an ordinary RGB webcam and a ToF camera. Our approach can be subdivided into two steps: firstly a segmentation of the entire body of the user is achieved exploiting only the ToF data; then the extraction of hands and head is obtained applying color information on the retrieved clusters. The final tracking step, based on the Kalman filter, is able to recognize the chosen hand also in presence of a second hand or the head. Tests, carried out with users of different ages, showed interesting results and a quick learning curve.
    15 schema:editor N4826c26752ec40e2afbfc625bbcac0d7
    16 schema:genre chapter
    17 schema:inLanguage en
    18 schema:isAccessibleForFree true
    19 schema:isPartOf N27c13024749b44a09cb6c09360aaeaa7
    20 schema:name Human-Computer Interaction through Time-of-Flight and RGB Cameras
    21 schema:pagination 89-98
    22 schema:productId N51a2ea715caa425d8e5a4ae86a023fe9
    23 N6024a3ed4b334ff9a9c3012d65d65fd5
    24 Nd7ee00aea09b4d5c9adb77ba9401075e
    25 schema:publisher Na64ef12c2c4141f594d7a45feb5c23db
    26 schema:sameAs https://app.dimensions.ai/details/publication/pub.1024921710
    27 https://doi.org/10.1007/978-3-642-24088-1_10
    28 schema:sdDatePublished 2019-04-15T15:53
    29 schema:sdLicense https://scigraph.springernature.com/explorer/license/
    30 schema:sdPublisher N9b540a0683da4a7080c61d6b773a4f12
    31 schema:url http://link.springer.com/10.1007/978-3-642-24088-1_10
    32 sgo:license sg:explorer/license/
    33 sgo:sdDataset chapters
    34 rdf:type schema:Chapter
    35 N130bbe26e71946b0ba8812b21e4f425a schema:familyName Foresti
    36 schema:givenName Gian Luca
    37 rdf:type schema:Person
    38 N27c13024749b44a09cb6c09360aaeaa7 schema:isbn 978-3-642-24087-4
    39 978-3-642-24088-1
    40 schema:name Image Analysis and Processing – ICIAP 2011
    41 rdf:type schema:Book
    42 N2d22e27e10df444e8cf19be156e44d1e rdf:first N130bbe26e71946b0ba8812b21e4f425a
    43 rdf:rest rdf:nil
    44 N4826c26752ec40e2afbfc625bbcac0d7 rdf:first N7bf6e5fb1b0c4190a94bd46ac8d302b5
    45 rdf:rest N2d22e27e10df444e8cf19be156e44d1e
    46 N51a2ea715caa425d8e5a4ae86a023fe9 schema:name readcube_id
    47 schema:value 76ba2fdb987743950a37459f9cef3062a9bc6cd96659a887fb1d1ca15809f74e
    48 rdf:type schema:PropertyValue
    49 N6024a3ed4b334ff9a9c3012d65d65fd5 schema:name dimensions_id
    50 schema:value pub.1024921710
    51 rdf:type schema:PropertyValue
    52 N7bf6e5fb1b0c4190a94bd46ac8d302b5 schema:familyName Maino
    53 schema:givenName Giuseppe
    54 rdf:type schema:Person
    55 N9b540a0683da4a7080c61d6b773a4f12 schema:name Springer Nature - SN SciGraph project
    56 rdf:type schema:Organization
    57 Na64ef12c2c4141f594d7a45feb5c23db schema:location Berlin, Heidelberg
    58 schema:name Springer Berlin Heidelberg
    59 rdf:type schema:Organisation
    60 Nb979e8f079c5471a9f685579d67f38c0 rdf:first sg:person.013147430753.29
    61 rdf:rest Nf624e3176ad64f7ab1c993c4e9d84c79
    62 Nc2148537269d4b2fb2a6edac43b4200b rdf:first sg:person.010622175511.26
    63 rdf:rest rdf:nil
    64 Nd7ee00aea09b4d5c9adb77ba9401075e schema:name doi
    65 schema:value 10.1007/978-3-642-24088-1_10
    66 rdf:type schema:PropertyValue
    67 Nf624e3176ad64f7ab1c993c4e9d84c79 rdf:first sg:person.011416663251.54
    68 rdf:rest Nc2148537269d4b2fb2a6edac43b4200b
    69 anzsrc-for:08 schema:inDefinedTermSet anzsrc-for:
    70 schema:name Information and Computing Sciences
    71 rdf:type schema:DefinedTerm
    72 anzsrc-for:0801 schema:inDefinedTermSet anzsrc-for:
    73 schema:name Artificial Intelligence and Image Processing
    74 rdf:type schema:DefinedTerm
    75 sg:person.010622175511.26 schema:affiliation https://www.grid.ac/institutes/grid.8982.b
    76 schema:familyName Porta
    77 schema:givenName Marco
    78 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010622175511.26
    79 rdf:type schema:Person
    80 sg:person.011416663251.54 schema:affiliation https://www.grid.ac/institutes/grid.8982.b
    81 schema:familyName Lombardi
    82 schema:givenName Luca
    83 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.011416663251.54
    84 rdf:type schema:Person
    85 sg:person.013147430753.29 schema:affiliation https://www.grid.ac/institutes/grid.8982.b
    86 schema:familyName Dondi
    87 schema:givenName Piercarlo
    88 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.013147430753.29
    89 rdf:type schema:Person
    90 sg:pub.10.1007/978-3-540-71457-6_23 schema:sameAs https://app.dimensions.ai/details/publication/pub.1039435266
    91 https://doi.org/10.1007/978-3-540-71457-6_23
    92 rdf:type schema:CreativeWork
    93 sg:pub.10.1007/978-3-642-12553-9_10 schema:sameAs https://app.dimensions.ai/details/publication/pub.1014500069
    94 https://doi.org/10.1007/978-3-642-12553-9_10
    95 rdf:type schema:CreativeWork
    96 https://doi.org/10.1109/cvprw.2008.4563162 schema:sameAs https://app.dimensions.ai/details/publication/pub.1094238785
    97 rdf:type schema:CreativeWork
    98 https://doi.org/10.1109/isscs.2007.4292691 schema:sameAs https://app.dimensions.ai/details/publication/pub.1094015542
    99 rdf:type schema:CreativeWork
    100 https://doi.org/10.1109/wacv.2011.5711485 schema:sameAs https://app.dimensions.ai/details/publication/pub.1095489942
    101 rdf:type schema:CreativeWork
    102 https://doi.org/10.1111/j.1467-8659.2009.01583.x schema:sameAs https://app.dimensions.ai/details/publication/pub.1000554313
    103 rdf:type schema:CreativeWork
    104 https://doi.org/10.1504/ijista.2008.021296 schema:sameAs https://app.dimensions.ai/details/publication/pub.1067467072
    105 rdf:type schema:CreativeWork
    106 https://doi.org/10.5220/0003322505820587 schema:sameAs https://app.dimensions.ai/details/publication/pub.1099369983
    107 rdf:type schema:CreativeWork
    108 https://www.grid.ac/institutes/grid.8982.b schema:alternateName University of Pavia
    109 schema:name Department of Computer Engineering and Systems Science, University of Pavia, Via Ferrata 1, 27100 Pavia, Italy
    110 rdf:type schema:Organization
     




    Preview window. Press ESC to close (or click here)


    ...