A Novel Approach to Gesture Recognition in Sign Language Applications Using AVL Tree and SVM View Full Text


Ontology type: schema:Chapter     


Chapter Info

DATE

2018

AUTHORS

Sriparna Saha , Saurav Bhattacharya , Amit Konar

ABSTRACT

Body gesture is the most important way of non-verbal communication for deaf and dumb people. Thus, a novel sign language recognition procedure is presented here where the movements of hands play a pivotal role for such kind of communications. Microsoft’s Kinect sensor is used to act as a medium to interpret such communication by tracking the movement of human body using 20 joints. A procedural approach has been developed to deal with unknown gesture recognition by generating in-order expression for AVL tree as a feature. Here, 12 gestures are taken into consideration, and for the classification purpose, kernel function-based support vector machine is employed with results to gesture recognition into an accuracy of 88.3%. The foremost goal is to develop an algorithm that act as a medium to human–computer interaction for deaf and dumb people. Here, the novelty lies in the fact that for gesture recognition in sign language interpretation, the whole body of the subject is represented using a hierarchical balanced tree (here AVL). More... »

PAGES

271-277

References to SciGraph publications

  • 1995-09. Support-vector networks in MACHINE LEARNING
  • 1999-06. Least Squares Support Vector Machine Classifiers in NEURAL PROCESSING LETTERS
  • Book

    TITLE

    Progress in Intelligent Computing Techniques: Theory, Practice, and Applications

    ISBN

    978-981-10-3372-8
    978-981-10-3373-5

    Author Affiliations

    Identifiers

    URI

    http://scigraph.springernature.com/pub.10.1007/978-981-10-3373-5_27

    DOI

    http://dx.doi.org/10.1007/978-981-10-3373-5_27

    DIMENSIONS

    https://app.dimensions.ai/details/publication/pub.1090652698


    Indexing Status Check whether this publication has been indexed by Scopus and Web Of Science using the SN Indexing Status Tool
    Incoming Citations Browse incoming citations for this publication using opencitations.net

    JSON-LD is the canonical representation for SciGraph data.

    TIP: You can open this SciGraph record using an external JSON-LD service: JSON-LD Playground Google SDTT

    [
      {
        "@context": "https://springernature.github.io/scigraph/jsonld/sgcontext.json", 
        "about": [
          {
            "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/2004", 
            "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
            "name": "Linguistics", 
            "type": "DefinedTerm"
          }, 
          {
            "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/20", 
            "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
            "name": "Language, Communication and Culture", 
            "type": "DefinedTerm"
          }
        ], 
        "author": [
          {
            "affiliation": {
              "alternateName": "Jadavpur University", 
              "id": "https://www.grid.ac/institutes/grid.216499.1", 
              "name": [
                "Jadavpur University"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Saha", 
            "givenName": "Sriparna", 
            "id": "sg:person.011526334455.36", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.011526334455.36"
            ], 
            "type": "Person"
          }, 
          {
            "affiliation": {
              "alternateName": "Jadavpur University", 
              "id": "https://www.grid.ac/institutes/grid.216499.1", 
              "name": [
                "Jadavpur University"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Bhattacharya", 
            "givenName": "Saurav", 
            "id": "sg:person.012450372603.35", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.012450372603.35"
            ], 
            "type": "Person"
          }, 
          {
            "affiliation": {
              "alternateName": "Jadavpur University", 
              "id": "https://www.grid.ac/institutes/grid.216499.1", 
              "name": [
                "Jadavpur University"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Konar", 
            "givenName": "Amit", 
            "id": "sg:person.01337053064.29", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.01337053064.29"
            ], 
            "type": "Person"
          }
        ], 
        "citation": [
          {
            "id": "sg:pub.10.1007/bf00994018", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1025150743", 
              "https://doi.org/10.1007/bf00994018"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1023/a:1018628609742", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1025353016", 
              "https://doi.org/10.1023/a:1018628609742"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.3390/s120201437", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1036195029"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1145/319382.319388", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1039288226"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1016/s1570-8667(03)00034-0", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1052140616"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1109/tmm.2013.2246148", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1061698117"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1109/jcsse.2012.6261920", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1093520538"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1109/commantel.2013.6482417", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1094555433"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1109/icara.2011.6144864", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1095212302"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1109/avss.2013.6636643", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1095269045"
            ], 
            "type": "CreativeWork"
          }
        ], 
        "datePublished": "2018", 
        "datePublishedReg": "2018-01-01", 
        "description": "Body gesture is the most important way of non-verbal communication for deaf and dumb people. Thus, a novel sign language recognition procedure is presented here where the movements of hands play a pivotal role for such kind of communications. Microsoft\u2019s Kinect sensor is used to act as a medium to interpret such communication by tracking the movement of human body using 20 joints. A procedural approach has been developed to deal with unknown gesture recognition by generating in-order expression for AVL tree as a feature. Here, 12 gestures are taken into consideration, and for the classification purpose, kernel function-based support vector machine is employed with results to gesture recognition into an accuracy of 88.3%. The foremost goal is to develop an algorithm that act as a medium to human\u2013computer interaction for deaf and dumb people. Here, the novelty lies in the fact that for gesture recognition in sign language interpretation, the whole body of the subject is represented using a hierarchical balanced tree (here AVL).", 
        "editor": [
          {
            "familyName": "Sa", 
            "givenName": "Pankaj Kumar", 
            "type": "Person"
          }, 
          {
            "familyName": "Sahoo", 
            "givenName": "Manmath Narayan", 
            "type": "Person"
          }, 
          {
            "familyName": "Murugappan", 
            "givenName": "M.", 
            "type": "Person"
          }, 
          {
            "familyName": "Wu", 
            "givenName": "Yulei", 
            "type": "Person"
          }, 
          {
            "familyName": "Majhi", 
            "givenName": "Banshidhar", 
            "type": "Person"
          }
        ], 
        "genre": "chapter", 
        "id": "sg:pub.10.1007/978-981-10-3373-5_27", 
        "inLanguage": [
          "en"
        ], 
        "isAccessibleForFree": false, 
        "isPartOf": {
          "isbn": [
            "978-981-10-3372-8", 
            "978-981-10-3373-5"
          ], 
          "name": "Progress in Intelligent Computing Techniques: Theory, Practice, and Applications", 
          "type": "Book"
        }, 
        "name": "A Novel Approach to Gesture Recognition in Sign Language Applications Using AVL Tree and SVM", 
        "pagination": "271-277", 
        "productId": [
          {
            "name": "doi", 
            "type": "PropertyValue", 
            "value": [
              "10.1007/978-981-10-3373-5_27"
            ]
          }, 
          {
            "name": "readcube_id", 
            "type": "PropertyValue", 
            "value": [
              "3db124d5e34bfb669551846844c356baa7425f884edfc1333befd722334f8a50"
            ]
          }, 
          {
            "name": "dimensions_id", 
            "type": "PropertyValue", 
            "value": [
              "pub.1090652698"
            ]
          }
        ], 
        "publisher": {
          "location": "Singapore", 
          "name": "Springer Singapore", 
          "type": "Organisation"
        }, 
        "sameAs": [
          "https://doi.org/10.1007/978-981-10-3373-5_27", 
          "https://app.dimensions.ai/details/publication/pub.1090652698"
        ], 
        "sdDataset": "chapters", 
        "sdDatePublished": "2019-04-15T13:23", 
        "sdLicense": "https://scigraph.springernature.com/explorer/license/", 
        "sdPublisher": {
          "name": "Springer Nature - SN SciGraph project", 
          "type": "Organization"
        }, 
        "sdSource": "s3://com-uberresearch-data-dimensions-target-20181106-alternative/cleanup/v134/2549eaecd7973599484d7c17b260dba0a4ecb94b/merge/v9/a6c9fde33151104705d4d7ff012ea9563521a3ce/jats-lookup/v90/0000000001_0000000264/records_8664_00000221.jsonl", 
        "type": "Chapter", 
        "url": "http://link.springer.com/10.1007/978-981-10-3373-5_27"
      }
    ]
     

    Download the RDF metadata as:  json-ld nt turtle xml License info

    HOW TO GET THIS DATA PROGRAMMATICALLY:

    JSON-LD is a popular format for linked data which is fully compatible with JSON.

    curl -H 'Accept: application/ld+json' 'https://scigraph.springernature.com/pub.10.1007/978-981-10-3373-5_27'

    N-Triples is a line-based linked data format ideal for batch operations.

    curl -H 'Accept: application/n-triples' 'https://scigraph.springernature.com/pub.10.1007/978-981-10-3373-5_27'

    Turtle is a human-readable linked data format.

    curl -H 'Accept: text/turtle' 'https://scigraph.springernature.com/pub.10.1007/978-981-10-3373-5_27'

    RDF/XML is a standard XML format for linked data.

    curl -H 'Accept: application/rdf+xml' 'https://scigraph.springernature.com/pub.10.1007/978-981-10-3373-5_27'


     

    This table displays all metadata directly associated to this object as RDF triples.

    131 TRIPLES      23 PREDICATES      37 URIs      20 LITERALS      8 BLANK NODES

    Subject Predicate Object
    1 sg:pub.10.1007/978-981-10-3373-5_27 schema:about anzsrc-for:20
    2 anzsrc-for:2004
    3 schema:author Nf227b82b647b4c79833912627d5ee3a9
    4 schema:citation sg:pub.10.1007/bf00994018
    5 sg:pub.10.1023/a:1018628609742
    6 https://doi.org/10.1016/s1570-8667(03)00034-0
    7 https://doi.org/10.1109/avss.2013.6636643
    8 https://doi.org/10.1109/commantel.2013.6482417
    9 https://doi.org/10.1109/icara.2011.6144864
    10 https://doi.org/10.1109/jcsse.2012.6261920
    11 https://doi.org/10.1109/tmm.2013.2246148
    12 https://doi.org/10.1145/319382.319388
    13 https://doi.org/10.3390/s120201437
    14 schema:datePublished 2018
    15 schema:datePublishedReg 2018-01-01
    16 schema:description Body gesture is the most important way of non-verbal communication for deaf and dumb people. Thus, a novel sign language recognition procedure is presented here where the movements of hands play a pivotal role for such kind of communications. Microsoft’s Kinect sensor is used to act as a medium to interpret such communication by tracking the movement of human body using 20 joints. A procedural approach has been developed to deal with unknown gesture recognition by generating in-order expression for AVL tree as a feature. Here, 12 gestures are taken into consideration, and for the classification purpose, kernel function-based support vector machine is employed with results to gesture recognition into an accuracy of 88.3%. The foremost goal is to develop an algorithm that act as a medium to human–computer interaction for deaf and dumb people. Here, the novelty lies in the fact that for gesture recognition in sign language interpretation, the whole body of the subject is represented using a hierarchical balanced tree (here AVL).
    17 schema:editor Ndab2ad2bf7554b59b70be908c4243601
    18 schema:genre chapter
    19 schema:inLanguage en
    20 schema:isAccessibleForFree false
    21 schema:isPartOf Nbe2db663bc1546f8a6a513ca753bc77b
    22 schema:name A Novel Approach to Gesture Recognition in Sign Language Applications Using AVL Tree and SVM
    23 schema:pagination 271-277
    24 schema:productId N82e2ac80aa694581b593e38a2f4ea4f9
    25 Nc708913165fa4f248ab86dbafbe0ca33
    26 Neaeec99a4ed445388aa779dd263e8397
    27 schema:publisher N1fe5a4ac835549c2933641e375c8ecd1
    28 schema:sameAs https://app.dimensions.ai/details/publication/pub.1090652698
    29 https://doi.org/10.1007/978-981-10-3373-5_27
    30 schema:sdDatePublished 2019-04-15T13:23
    31 schema:sdLicense https://scigraph.springernature.com/explorer/license/
    32 schema:sdPublisher N841285faacf2474cb7845683e3d4c2e4
    33 schema:url http://link.springer.com/10.1007/978-981-10-3373-5_27
    34 sgo:license sg:explorer/license/
    35 sgo:sdDataset chapters
    36 rdf:type schema:Chapter
    37 N01bc481ef6fb430d8b2706c97d3632ae rdf:first sg:person.012450372603.35
    38 rdf:rest N2641340e79364616b8de9d6dcd72df31
    39 N1fe5a4ac835549c2933641e375c8ecd1 schema:location Singapore
    40 schema:name Springer Singapore
    41 rdf:type schema:Organisation
    42 N2641340e79364616b8de9d6dcd72df31 rdf:first sg:person.01337053064.29
    43 rdf:rest rdf:nil
    44 N5fcc50948ac14695a77b5ee34fd41273 rdf:first N754ccf70dc16448eb642b64b6897a691
    45 rdf:rest rdf:nil
    46 N64b7aa2a1fd948fb9d631337d595c770 rdf:first N6a3e4eb4c7c74bbda551e855d5df8461
    47 rdf:rest N6b1949ada914419ca80513b452f50814
    48 N64d7ea88a1304a7d872c2eca17f35a8b rdf:first N8ee86bd2901a46adad2e7c21926cc757
    49 rdf:rest N64b7aa2a1fd948fb9d631337d595c770
    50 N6a3e4eb4c7c74bbda551e855d5df8461 schema:familyName Murugappan
    51 schema:givenName M.
    52 rdf:type schema:Person
    53 N6b1949ada914419ca80513b452f50814 rdf:first Nc6e62aeae7b44aea85c57537d60097f7
    54 rdf:rest N5fcc50948ac14695a77b5ee34fd41273
    55 N754ccf70dc16448eb642b64b6897a691 schema:familyName Majhi
    56 schema:givenName Banshidhar
    57 rdf:type schema:Person
    58 N82e2ac80aa694581b593e38a2f4ea4f9 schema:name readcube_id
    59 schema:value 3db124d5e34bfb669551846844c356baa7425f884edfc1333befd722334f8a50
    60 rdf:type schema:PropertyValue
    61 N841285faacf2474cb7845683e3d4c2e4 schema:name Springer Nature - SN SciGraph project
    62 rdf:type schema:Organization
    63 N8ee86bd2901a46adad2e7c21926cc757 schema:familyName Sahoo
    64 schema:givenName Manmath Narayan
    65 rdf:type schema:Person
    66 Nb03b6890775b43f7a818213ed1efd29a schema:familyName Sa
    67 schema:givenName Pankaj Kumar
    68 rdf:type schema:Person
    69 Nbe2db663bc1546f8a6a513ca753bc77b schema:isbn 978-981-10-3372-8
    70 978-981-10-3373-5
    71 schema:name Progress in Intelligent Computing Techniques: Theory, Practice, and Applications
    72 rdf:type schema:Book
    73 Nc6e62aeae7b44aea85c57537d60097f7 schema:familyName Wu
    74 schema:givenName Yulei
    75 rdf:type schema:Person
    76 Nc708913165fa4f248ab86dbafbe0ca33 schema:name dimensions_id
    77 schema:value pub.1090652698
    78 rdf:type schema:PropertyValue
    79 Ndab2ad2bf7554b59b70be908c4243601 rdf:first Nb03b6890775b43f7a818213ed1efd29a
    80 rdf:rest N64d7ea88a1304a7d872c2eca17f35a8b
    81 Neaeec99a4ed445388aa779dd263e8397 schema:name doi
    82 schema:value 10.1007/978-981-10-3373-5_27
    83 rdf:type schema:PropertyValue
    84 Nf227b82b647b4c79833912627d5ee3a9 rdf:first sg:person.011526334455.36
    85 rdf:rest N01bc481ef6fb430d8b2706c97d3632ae
    86 anzsrc-for:20 schema:inDefinedTermSet anzsrc-for:
    87 schema:name Language, Communication and Culture
    88 rdf:type schema:DefinedTerm
    89 anzsrc-for:2004 schema:inDefinedTermSet anzsrc-for:
    90 schema:name Linguistics
    91 rdf:type schema:DefinedTerm
    92 sg:person.011526334455.36 schema:affiliation https://www.grid.ac/institutes/grid.216499.1
    93 schema:familyName Saha
    94 schema:givenName Sriparna
    95 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.011526334455.36
    96 rdf:type schema:Person
    97 sg:person.012450372603.35 schema:affiliation https://www.grid.ac/institutes/grid.216499.1
    98 schema:familyName Bhattacharya
    99 schema:givenName Saurav
    100 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.012450372603.35
    101 rdf:type schema:Person
    102 sg:person.01337053064.29 schema:affiliation https://www.grid.ac/institutes/grid.216499.1
    103 schema:familyName Konar
    104 schema:givenName Amit
    105 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.01337053064.29
    106 rdf:type schema:Person
    107 sg:pub.10.1007/bf00994018 schema:sameAs https://app.dimensions.ai/details/publication/pub.1025150743
    108 https://doi.org/10.1007/bf00994018
    109 rdf:type schema:CreativeWork
    110 sg:pub.10.1023/a:1018628609742 schema:sameAs https://app.dimensions.ai/details/publication/pub.1025353016
    111 https://doi.org/10.1023/a:1018628609742
    112 rdf:type schema:CreativeWork
    113 https://doi.org/10.1016/s1570-8667(03)00034-0 schema:sameAs https://app.dimensions.ai/details/publication/pub.1052140616
    114 rdf:type schema:CreativeWork
    115 https://doi.org/10.1109/avss.2013.6636643 schema:sameAs https://app.dimensions.ai/details/publication/pub.1095269045
    116 rdf:type schema:CreativeWork
    117 https://doi.org/10.1109/commantel.2013.6482417 schema:sameAs https://app.dimensions.ai/details/publication/pub.1094555433
    118 rdf:type schema:CreativeWork
    119 https://doi.org/10.1109/icara.2011.6144864 schema:sameAs https://app.dimensions.ai/details/publication/pub.1095212302
    120 rdf:type schema:CreativeWork
    121 https://doi.org/10.1109/jcsse.2012.6261920 schema:sameAs https://app.dimensions.ai/details/publication/pub.1093520538
    122 rdf:type schema:CreativeWork
    123 https://doi.org/10.1109/tmm.2013.2246148 schema:sameAs https://app.dimensions.ai/details/publication/pub.1061698117
    124 rdf:type schema:CreativeWork
    125 https://doi.org/10.1145/319382.319388 schema:sameAs https://app.dimensions.ai/details/publication/pub.1039288226
    126 rdf:type schema:CreativeWork
    127 https://doi.org/10.3390/s120201437 schema:sameAs https://app.dimensions.ai/details/publication/pub.1036195029
    128 rdf:type schema:CreativeWork
    129 https://www.grid.ac/institutes/grid.216499.1 schema:alternateName Jadavpur University
    130 schema:name Jadavpur University
    131 rdf:type schema:Organization
     




    Preview window. Press ESC to close (or click here)


    ...