A fuzzy logic approach to reliable real-time recognition of facial emotions View Full Text


Ontology type: schema:ScholarlyArticle     


Article Info

DATE

2019-02-06

AUTHORS

Kiavash Bahreini, Wim van der Vegt, Wim Westera

ABSTRACT

This paper represents our newly developed software for emotion recognition from facial expressions. Besides allowing emotion recognition from image files and recorded video files, it uses webcam data to provide real-time, continuous, and unobtrusive facial emotional expressions. It uses FURIA algorithm for unordered fuzzy rule induction to offer timely and appropriate feedback based on learners’ facial expressions. The main objective of this study was first to validate the use of webcam data for a real-time and accurate analysis of facial expressions in e-learning environments. Second, transform these facial expressions to detected emotional states using the FURIA algorithm. We measured the performance of the software with ten participants, provided them with the same computer-based tasks, requested them a hundred times to mimic specific facial expressions, and recorded all sessions on video. We used the recorded video files to feed our newly developed software. We then used two experts’ opinions to annotate and rate participants’ recorded behaviours and to validate the software’s results. The software provides accurate and reliable results with the overall accuracy of 83.2%, which is comparable to the recognition by humans. This study will help to increase the quality of e-learning. More... »

PAGES

1-24

References to SciGraph publications

  • 2009-12. FURIA: an algorithm for unordered fuzzy rule induction in DATA MINING AND KNOWLEDGE DISCOVERY
  • 2012-03. Wavelets-based facial expression recognition using a bank of support vector machines in SOFT COMPUTING
  • 2011. Affect Detection from Multichannel Physiology during Learning Sessions with AutoTutor in ARTIFICIAL INTELLIGENCE IN EDUCATION
  • 2014-11. A Dynamic Gesture and Posture Recognition System in JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS
  • 2005. A Chat System Based on Emotion Estimation from Text and Embodied Conversational Messengers in ENTERTAINMENT COMPUTING - ICEC 2005
  • 2011. Handbook of Face Recognition in NONE
  • 2016. RAGE Reusable Game Software Components and Their Integration into Serious Game Engines in SOFTWARE REUSE: BRIDGING WITH SOCIAL-AWARENESS
  • 2010-01. A novel application of self-organizing network for facial expression recognition from radial encoded contours in SOFT COMPUTING
  • 2011-07-20. Audiovisual Expression of Emotions in Communication in SENSING EMOTIONS
  • 2006. Recovering Informal Learning, Wisdom, Judgement and Community in NONE
  • 2012-12. A review of wearable sensors and systems with application in rehabilitation in JOURNAL OF NEUROENGINEERING AND REHABILITATION
  • 2016-09. Towards real-time speech emotion recognition for affective e-learning in EDUCATION AND INFORMATION TECHNOLOGIES
  • 2016-07. Facial expression recognition using ASM-based post-processing technique in PATTERN RECOGNITION AND IMAGE ANALYSIS
  • 1996-03. GPOWER: A general power analysis program in BEHAVIOR RESEARCH METHODS
  • 2009. Emotion Recognition from Facial Expression Using Neural Networks in HUMAN-COMPUTER SYSTEMS INTERACTION
  • Identifiers

    URI

    http://scigraph.springernature.com/pub.10.1007/s11042-019-7250-z

    DOI

    http://dx.doi.org/10.1007/s11042-019-7250-z

    DIMENSIONS

    https://app.dimensions.ai/details/publication/pub.1111949453


    Indexing Status Check whether this publication has been indexed by Scopus and Web Of Science using the SN Indexing Status Tool
    Incoming Citations Browse incoming citations for this publication using opencitations.net

    JSON-LD is the canonical representation for SciGraph data.

    TIP: You can open this SciGraph record using an external JSON-LD service: JSON-LD Playground Google SDTT

    [
      {
        "@context": "https://springernature.github.io/scigraph/jsonld/sgcontext.json", 
        "about": [
          {
            "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/0801", 
            "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
            "name": "Artificial Intelligence and Image Processing", 
            "type": "DefinedTerm"
          }, 
          {
            "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/08", 
            "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
            "name": "Information and Computing Sciences", 
            "type": "DefinedTerm"
          }
        ], 
        "author": [
          {
            "affiliation": {
              "alternateName": "Open University in the Netherlands", 
              "id": "https://www.grid.ac/institutes/grid.36120.36", 
              "name": [
                "Welten Institute, Research Centre for Learning, Teaching and Technology, Faculty of Psychology and Educational Sciences, Open University of the Netherlands, Heerlen, Netherlands"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Bahreini", 
            "givenName": "Kiavash", 
            "type": "Person"
          }, 
          {
            "affiliation": {
              "alternateName": "Open University in the Netherlands", 
              "id": "https://www.grid.ac/institutes/grid.36120.36", 
              "name": [
                "Welten Institute, Research Centre for Learning, Teaching and Technology, Faculty of Psychology and Educational Sciences, Open University of the Netherlands, Heerlen, Netherlands"
              ], 
              "type": "Organization"
            }, 
            "familyName": "van der Vegt", 
            "givenName": "Wim", 
            "type": "Person"
          }, 
          {
            "affiliation": {
              "alternateName": "Open University in the Netherlands", 
              "id": "https://www.grid.ac/institutes/grid.36120.36", 
              "name": [
                "Welten Institute, Research Centre for Learning, Teaching and Technology, Faculty of Psychology and Educational Sciences, Open University of the Netherlands, Heerlen, Netherlands"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Westera", 
            "givenName": "Wim", 
            "type": "Person"
          }
        ], 
        "citation": [
          {
            "id": "https://doi.org/10.1111/j.1365-2729.2008.00279.x", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1001233326"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1111/j.1464-0597.1992.tb00712.x", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1004412602"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/s00500-009-0441-1", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1005468570", 
              "https://doi.org/10.1007/s00500-009-0441-1"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/s00500-009-0441-1", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1005468570", 
              "https://doi.org/10.1007/s00500-009-0441-1"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/s00500-009-0441-1", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1005468570", 
              "https://doi.org/10.1007/s00500-009-0441-1"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/s10846-013-9983-7", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1007415229", 
              "https://doi.org/10.1007/s10846-013-9983-7"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1016/j.eswa.2009.09.031", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1008805621"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/978-3-319-35122-3_12", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1009824315", 
              "https://doi.org/10.1007/978-3-319-35122-3_12"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1002/(sici)1099-0992(1998110)28:6<879::aid-ejsp901>3.0.co;2-w", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1010516410"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1016/j.ijleo.2012.08.040", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1011399660"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/1-4020-5346-0", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1012364248", 
              "https://doi.org/10.1007/1-4020-5346-0"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/1-4020-5346-0", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1012364248", 
              "https://doi.org/10.1007/1-4020-5346-0"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/1-4020-5346-0", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1012364248", 
              "https://doi.org/10.1007/1-4020-5346-0"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/978-0-85729-932-1", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1012818484", 
              "https://doi.org/10.1007/978-0-85729-932-1"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/978-0-85729-932-1", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1012818484", 
              "https://doi.org/10.1007/978-0-85729-932-1"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/s10639-015-9388-2", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1013241059", 
              "https://doi.org/10.1007/s10639-015-9388-2"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/s10639-015-9388-2", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1013241059", 
              "https://doi.org/10.1007/s10639-015-9388-2"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1134/s105466181603010x", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1013254914", 
              "https://doi.org/10.1134/s105466181603010x"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1134/s105466181603010x", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1013254914", 
              "https://doi.org/10.1134/s105466181603010x"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/978-3-642-03202-8_17", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1017009151", 
              "https://doi.org/10.1007/978-3-642-03202-8_17"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/978-3-642-03202-8_17", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1017009151", 
              "https://doi.org/10.1007/978-3-642-03202-8_17"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/11558651_56", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1018231160", 
              "https://doi.org/10.1007/11558651_56"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/11558651_56", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1018231160", 
              "https://doi.org/10.1007/11558651_56"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1080/10494820.2014.908927", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1018900858"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/978-90-481-3258-4_6", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1021115032", 
              "https://doi.org/10.1007/978-90-481-3258-4_6"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/978-90-481-3258-4_6", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1021115032", 
              "https://doi.org/10.1007/978-90-481-3258-4_6"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1016/j.jesp.2013.09.011", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1021152272"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1037/h0077714", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1026751541"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1145/2254556.2254580", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1030256463"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1016/j.chb.2007.07.008", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1031133913"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1016/s0167-6393(03)00099-2", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1031300442"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1016/s0167-6393(03)00099-2", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1031300442"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.3758/bf03203630", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1031867147", 
              "https://doi.org/10.3758/bf03203630"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1145/2395123.2395128", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1032905054"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1186/1743-0003-9-21", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1033340636", 
              "https://doi.org/10.1186/1743-0003-9-21"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1186/1743-0003-9-21", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1033340636", 
              "https://doi.org/10.1186/1743-0003-9-21"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1186/1743-0003-9-21", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1033340636", 
              "https://doi.org/10.1186/1743-0003-9-21"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1186/1743-0003-9-21", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1033340636", 
              "https://doi.org/10.1186/1743-0003-9-21"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1186/1743-0003-9-21", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1033340636", 
              "https://doi.org/10.1186/1743-0003-9-21"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1016/j.cedpsych.2013.08.001", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1033453723"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1145/1165255.1165259", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1035151052"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/s00500-011-0721-4", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1035399853", 
              "https://doi.org/10.1007/s00500-011-0721-4"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1117/12.600746", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1036853350"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1037/h0073583", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1038617747"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1016/j.eswa.2014.08.049", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1039358555"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1080/10494820.2016.1247286", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1039920083"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/s10618-009-0131-8", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1040472498", 
              "https://doi.org/10.1007/s10618-009-0131-8"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/s10618-009-0131-8", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1040472498", 
              "https://doi.org/10.1007/s10618-009-0131-8"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.4018/jse.2010101605", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1041326499"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1080/10447318.2016.1159799", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1042308352"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1155/2016/5680526", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1044909780"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1016/j.engappai.2011.07.004", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1046645367"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/978-3-642-21869-9_19", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1052335695", 
              "https://doi.org/10.1007/978-3-642-21869-9_19"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/978-3-642-21869-9_19", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1052335695", 
              "https://doi.org/10.1007/978-3-642-21869-9_19"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1016/j.eswa.2013.11.041", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1052374372"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1145/1101149.1101299", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1053427070"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1088/0967-3334/32/10/002", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1059123657"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1109/maes.2005.1576071", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1061381038"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1109/mmul.2012.24", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1061410292"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1142/s0218001499000495", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1062951271"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.17083/ijsg.v1i1.11", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1068268182"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.2307/2529310", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1069974986"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.5121/ijcsa.2014.4104", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1072615595"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.7763/ijcte.2009.v1.103", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1074032451"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.9781/ijimai.2016.4112", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1074158146"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1016/j.compedu.2017.09.010", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1091972432"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1109/cvpr.2011.5995316", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1093733060"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1109/ccnc.2012.6181098", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1094246889"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1109/icdmw.2014.80", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1094544771"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1109/incos.2011.82", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1094762124"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1109/fg.2011.5771364", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1095213232"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1109/acii.2009.5349544", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1095275973"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1109/icosp.2010.5656884", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1095670593"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1109/nlpke.2009.5313815", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1095777045"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1109/fuzzy.2007.4295451", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1095829862"
            ], 
            "type": "CreativeWork"
          }
        ], 
        "datePublished": "2019-02-06", 
        "datePublishedReg": "2019-02-06", 
        "description": "This paper represents our newly developed software for emotion recognition from facial expressions. Besides allowing emotion recognition from image files and recorded video files, it uses webcam data to provide real-time, continuous, and unobtrusive facial emotional expressions. It uses FURIA algorithm for unordered fuzzy rule induction to offer timely and appropriate feedback based on learners\u2019 facial expressions. The main objective of this study was first to validate the use of webcam data for a real-time and accurate analysis of facial expressions in e-learning environments. Second, transform these facial expressions to detected emotional states using the FURIA algorithm. We measured the performance of the software with ten participants, provided them with the same computer-based tasks, requested them a hundred times to mimic specific facial expressions, and recorded all sessions on video. We used the recorded video files to feed our newly developed software. We then used two experts\u2019 opinions to annotate and rate participants\u2019 recorded behaviours and to validate the software\u2019s results. The software provides accurate and reliable results with the overall accuracy of 83.2%, which is comparable to the recognition by humans. This study will help to increase the quality of e-learning.", 
        "genre": "research_article", 
        "id": "sg:pub.10.1007/s11042-019-7250-z", 
        "inLanguage": [
          "en"
        ], 
        "isAccessibleForFree": false, 
        "isPartOf": [
          {
            "id": "sg:journal.1044869", 
            "issn": [
              "1380-7501", 
              "1573-7721"
            ], 
            "name": "Multimedia Tools and Applications", 
            "type": "Periodical"
          }
        ], 
        "name": "A fuzzy logic approach to reliable real-time recognition of facial emotions", 
        "pagination": "1-24", 
        "productId": [
          {
            "name": "readcube_id", 
            "type": "PropertyValue", 
            "value": [
              "f6ce2a6378e8494bce90a530e0fa7b799fb0dd6529f19da19115ba6612a4c879"
            ]
          }, 
          {
            "name": "doi", 
            "type": "PropertyValue", 
            "value": [
              "10.1007/s11042-019-7250-z"
            ]
          }, 
          {
            "name": "dimensions_id", 
            "type": "PropertyValue", 
            "value": [
              "pub.1111949453"
            ]
          }
        ], 
        "sameAs": [
          "https://doi.org/10.1007/s11042-019-7250-z", 
          "https://app.dimensions.ai/details/publication/pub.1111949453"
        ], 
        "sdDataset": "articles", 
        "sdDatePublished": "2019-04-11T09:02", 
        "sdLicense": "https://scigraph.springernature.com/explorer/license/", 
        "sdPublisher": {
          "name": "Springer Nature - SN SciGraph project", 
          "type": "Organization"
        }, 
        "sdSource": "s3://com-uberresearch-data-dimensions-target-20181106-alternative/cleanup/v134/2549eaecd7973599484d7c17b260dba0a4ecb94b/merge/v9/a6c9fde33151104705d4d7ff012ea9563521a3ce/jats-lookup/v90/0000000331_0000000331/records_105406_00000000.jsonl", 
        "type": "ScholarlyArticle", 
        "url": "https://link.springer.com/10.1007%2Fs11042-019-7250-z"
      }
    ]
     

    Download the RDF metadata as:  json-ld nt turtle xml License info

    HOW TO GET THIS DATA PROGRAMMATICALLY:

    JSON-LD is a popular format for linked data which is fully compatible with JSON.

    curl -H 'Accept: application/ld+json' 'https://scigraph.springernature.com/pub.10.1007/s11042-019-7250-z'

    N-Triples is a line-based linked data format ideal for batch operations.

    curl -H 'Accept: application/n-triples' 'https://scigraph.springernature.com/pub.10.1007/s11042-019-7250-z'

    Turtle is a human-readable linked data format.

    curl -H 'Accept: text/turtle' 'https://scigraph.springernature.com/pub.10.1007/s11042-019-7250-z'

    RDF/XML is a standard XML format for linked data.

    curl -H 'Accept: application/rdf+xml' 'https://scigraph.springernature.com/pub.10.1007/s11042-019-7250-z'


     

    This table displays all metadata directly associated to this object as RDF triples.

    255 TRIPLES      21 PREDICATES      82 URIs      16 LITERALS      5 BLANK NODES

    Subject Predicate Object
    1 sg:pub.10.1007/s11042-019-7250-z schema:about anzsrc-for:08
    2 anzsrc-for:0801
    3 schema:author N0ee989cbb74e4fefa1101f27d4d1ba09
    4 schema:citation sg:pub.10.1007/1-4020-5346-0
    5 sg:pub.10.1007/11558651_56
    6 sg:pub.10.1007/978-0-85729-932-1
    7 sg:pub.10.1007/978-3-319-35122-3_12
    8 sg:pub.10.1007/978-3-642-03202-8_17
    9 sg:pub.10.1007/978-3-642-21869-9_19
    10 sg:pub.10.1007/978-90-481-3258-4_6
    11 sg:pub.10.1007/s00500-009-0441-1
    12 sg:pub.10.1007/s00500-011-0721-4
    13 sg:pub.10.1007/s10618-009-0131-8
    14 sg:pub.10.1007/s10639-015-9388-2
    15 sg:pub.10.1007/s10846-013-9983-7
    16 sg:pub.10.1134/s105466181603010x
    17 sg:pub.10.1186/1743-0003-9-21
    18 sg:pub.10.3758/bf03203630
    19 https://doi.org/10.1002/(sici)1099-0992(1998110)28:6<879::aid-ejsp901>3.0.co;2-w
    20 https://doi.org/10.1016/j.cedpsych.2013.08.001
    21 https://doi.org/10.1016/j.chb.2007.07.008
    22 https://doi.org/10.1016/j.compedu.2017.09.010
    23 https://doi.org/10.1016/j.engappai.2011.07.004
    24 https://doi.org/10.1016/j.eswa.2009.09.031
    25 https://doi.org/10.1016/j.eswa.2013.11.041
    26 https://doi.org/10.1016/j.eswa.2014.08.049
    27 https://doi.org/10.1016/j.ijleo.2012.08.040
    28 https://doi.org/10.1016/j.jesp.2013.09.011
    29 https://doi.org/10.1016/s0167-6393(03)00099-2
    30 https://doi.org/10.1037/h0073583
    31 https://doi.org/10.1037/h0077714
    32 https://doi.org/10.1080/10447318.2016.1159799
    33 https://doi.org/10.1080/10494820.2014.908927
    34 https://doi.org/10.1080/10494820.2016.1247286
    35 https://doi.org/10.1088/0967-3334/32/10/002
    36 https://doi.org/10.1109/acii.2009.5349544
    37 https://doi.org/10.1109/ccnc.2012.6181098
    38 https://doi.org/10.1109/cvpr.2011.5995316
    39 https://doi.org/10.1109/fg.2011.5771364
    40 https://doi.org/10.1109/fuzzy.2007.4295451
    41 https://doi.org/10.1109/icdmw.2014.80
    42 https://doi.org/10.1109/icosp.2010.5656884
    43 https://doi.org/10.1109/incos.2011.82
    44 https://doi.org/10.1109/maes.2005.1576071
    45 https://doi.org/10.1109/mmul.2012.24
    46 https://doi.org/10.1109/nlpke.2009.5313815
    47 https://doi.org/10.1111/j.1365-2729.2008.00279.x
    48 https://doi.org/10.1111/j.1464-0597.1992.tb00712.x
    49 https://doi.org/10.1117/12.600746
    50 https://doi.org/10.1142/s0218001499000495
    51 https://doi.org/10.1145/1101149.1101299
    52 https://doi.org/10.1145/1165255.1165259
    53 https://doi.org/10.1145/2254556.2254580
    54 https://doi.org/10.1145/2395123.2395128
    55 https://doi.org/10.1155/2016/5680526
    56 https://doi.org/10.17083/ijsg.v1i1.11
    57 https://doi.org/10.2307/2529310
    58 https://doi.org/10.4018/jse.2010101605
    59 https://doi.org/10.5121/ijcsa.2014.4104
    60 https://doi.org/10.7763/ijcte.2009.v1.103
    61 https://doi.org/10.9781/ijimai.2016.4112
    62 schema:datePublished 2019-02-06
    63 schema:datePublishedReg 2019-02-06
    64 schema:description This paper represents our newly developed software for emotion recognition from facial expressions. Besides allowing emotion recognition from image files and recorded video files, it uses webcam data to provide real-time, continuous, and unobtrusive facial emotional expressions. It uses FURIA algorithm for unordered fuzzy rule induction to offer timely and appropriate feedback based on learners’ facial expressions. The main objective of this study was first to validate the use of webcam data for a real-time and accurate analysis of facial expressions in e-learning environments. Second, transform these facial expressions to detected emotional states using the FURIA algorithm. We measured the performance of the software with ten participants, provided them with the same computer-based tasks, requested them a hundred times to mimic specific facial expressions, and recorded all sessions on video. We used the recorded video files to feed our newly developed software. We then used two experts’ opinions to annotate and rate participants’ recorded behaviours and to validate the software’s results. The software provides accurate and reliable results with the overall accuracy of 83.2%, which is comparable to the recognition by humans. This study will help to increase the quality of e-learning.
    65 schema:genre research_article
    66 schema:inLanguage en
    67 schema:isAccessibleForFree false
    68 schema:isPartOf sg:journal.1044869
    69 schema:name A fuzzy logic approach to reliable real-time recognition of facial emotions
    70 schema:pagination 1-24
    71 schema:productId N8d3e955d49db4e6e9d5a88a5f000a5b5
    72 N92a85737dd20409c9598c209afe032d3
    73 Nc9b1bcc53e144c8996e60859ba42017b
    74 schema:sameAs https://app.dimensions.ai/details/publication/pub.1111949453
    75 https://doi.org/10.1007/s11042-019-7250-z
    76 schema:sdDatePublished 2019-04-11T09:02
    77 schema:sdLicense https://scigraph.springernature.com/explorer/license/
    78 schema:sdPublisher Nfabea04948c8404db23e9b4b9fcbb046
    79 schema:url https://link.springer.com/10.1007%2Fs11042-019-7250-z
    80 sgo:license sg:explorer/license/
    81 sgo:sdDataset articles
    82 rdf:type schema:ScholarlyArticle
    83 N0ee989cbb74e4fefa1101f27d4d1ba09 rdf:first Nad1d607e0a3948c6a9fa2a6075cafe1d
    84 rdf:rest Nd46c705c53d74b3b8a47cf4500c2846b
    85 N5765984d37b141a8aaa0712661bcb4c1 rdf:first Ne5ef6a82da18413499a8d07e74a39663
    86 rdf:rest rdf:nil
    87 N5d29a095915244e2a666efc0ef0c599e schema:affiliation https://www.grid.ac/institutes/grid.36120.36
    88 schema:familyName van der Vegt
    89 schema:givenName Wim
    90 rdf:type schema:Person
    91 N8d3e955d49db4e6e9d5a88a5f000a5b5 schema:name doi
    92 schema:value 10.1007/s11042-019-7250-z
    93 rdf:type schema:PropertyValue
    94 N92a85737dd20409c9598c209afe032d3 schema:name readcube_id
    95 schema:value f6ce2a6378e8494bce90a530e0fa7b799fb0dd6529f19da19115ba6612a4c879
    96 rdf:type schema:PropertyValue
    97 Nad1d607e0a3948c6a9fa2a6075cafe1d schema:affiliation https://www.grid.ac/institutes/grid.36120.36
    98 schema:familyName Bahreini
    99 schema:givenName Kiavash
    100 rdf:type schema:Person
    101 Nc9b1bcc53e144c8996e60859ba42017b schema:name dimensions_id
    102 schema:value pub.1111949453
    103 rdf:type schema:PropertyValue
    104 Nd46c705c53d74b3b8a47cf4500c2846b rdf:first N5d29a095915244e2a666efc0ef0c599e
    105 rdf:rest N5765984d37b141a8aaa0712661bcb4c1
    106 Ne5ef6a82da18413499a8d07e74a39663 schema:affiliation https://www.grid.ac/institutes/grid.36120.36
    107 schema:familyName Westera
    108 schema:givenName Wim
    109 rdf:type schema:Person
    110 Nfabea04948c8404db23e9b4b9fcbb046 schema:name Springer Nature - SN SciGraph project
    111 rdf:type schema:Organization
    112 anzsrc-for:08 schema:inDefinedTermSet anzsrc-for:
    113 schema:name Information and Computing Sciences
    114 rdf:type schema:DefinedTerm
    115 anzsrc-for:0801 schema:inDefinedTermSet anzsrc-for:
    116 schema:name Artificial Intelligence and Image Processing
    117 rdf:type schema:DefinedTerm
    118 sg:journal.1044869 schema:issn 1380-7501
    119 1573-7721
    120 schema:name Multimedia Tools and Applications
    121 rdf:type schema:Periodical
    122 sg:pub.10.1007/1-4020-5346-0 schema:sameAs https://app.dimensions.ai/details/publication/pub.1012364248
    123 https://doi.org/10.1007/1-4020-5346-0
    124 rdf:type schema:CreativeWork
    125 sg:pub.10.1007/11558651_56 schema:sameAs https://app.dimensions.ai/details/publication/pub.1018231160
    126 https://doi.org/10.1007/11558651_56
    127 rdf:type schema:CreativeWork
    128 sg:pub.10.1007/978-0-85729-932-1 schema:sameAs https://app.dimensions.ai/details/publication/pub.1012818484
    129 https://doi.org/10.1007/978-0-85729-932-1
    130 rdf:type schema:CreativeWork
    131 sg:pub.10.1007/978-3-319-35122-3_12 schema:sameAs https://app.dimensions.ai/details/publication/pub.1009824315
    132 https://doi.org/10.1007/978-3-319-35122-3_12
    133 rdf:type schema:CreativeWork
    134 sg:pub.10.1007/978-3-642-03202-8_17 schema:sameAs https://app.dimensions.ai/details/publication/pub.1017009151
    135 https://doi.org/10.1007/978-3-642-03202-8_17
    136 rdf:type schema:CreativeWork
    137 sg:pub.10.1007/978-3-642-21869-9_19 schema:sameAs https://app.dimensions.ai/details/publication/pub.1052335695
    138 https://doi.org/10.1007/978-3-642-21869-9_19
    139 rdf:type schema:CreativeWork
    140 sg:pub.10.1007/978-90-481-3258-4_6 schema:sameAs https://app.dimensions.ai/details/publication/pub.1021115032
    141 https://doi.org/10.1007/978-90-481-3258-4_6
    142 rdf:type schema:CreativeWork
    143 sg:pub.10.1007/s00500-009-0441-1 schema:sameAs https://app.dimensions.ai/details/publication/pub.1005468570
    144 https://doi.org/10.1007/s00500-009-0441-1
    145 rdf:type schema:CreativeWork
    146 sg:pub.10.1007/s00500-011-0721-4 schema:sameAs https://app.dimensions.ai/details/publication/pub.1035399853
    147 https://doi.org/10.1007/s00500-011-0721-4
    148 rdf:type schema:CreativeWork
    149 sg:pub.10.1007/s10618-009-0131-8 schema:sameAs https://app.dimensions.ai/details/publication/pub.1040472498
    150 https://doi.org/10.1007/s10618-009-0131-8
    151 rdf:type schema:CreativeWork
    152 sg:pub.10.1007/s10639-015-9388-2 schema:sameAs https://app.dimensions.ai/details/publication/pub.1013241059
    153 https://doi.org/10.1007/s10639-015-9388-2
    154 rdf:type schema:CreativeWork
    155 sg:pub.10.1007/s10846-013-9983-7 schema:sameAs https://app.dimensions.ai/details/publication/pub.1007415229
    156 https://doi.org/10.1007/s10846-013-9983-7
    157 rdf:type schema:CreativeWork
    158 sg:pub.10.1134/s105466181603010x schema:sameAs https://app.dimensions.ai/details/publication/pub.1013254914
    159 https://doi.org/10.1134/s105466181603010x
    160 rdf:type schema:CreativeWork
    161 sg:pub.10.1186/1743-0003-9-21 schema:sameAs https://app.dimensions.ai/details/publication/pub.1033340636
    162 https://doi.org/10.1186/1743-0003-9-21
    163 rdf:type schema:CreativeWork
    164 sg:pub.10.3758/bf03203630 schema:sameAs https://app.dimensions.ai/details/publication/pub.1031867147
    165 https://doi.org/10.3758/bf03203630
    166 rdf:type schema:CreativeWork
    167 https://doi.org/10.1002/(sici)1099-0992(1998110)28:6<879::aid-ejsp901>3.0.co;2-w schema:sameAs https://app.dimensions.ai/details/publication/pub.1010516410
    168 rdf:type schema:CreativeWork
    169 https://doi.org/10.1016/j.cedpsych.2013.08.001 schema:sameAs https://app.dimensions.ai/details/publication/pub.1033453723
    170 rdf:type schema:CreativeWork
    171 https://doi.org/10.1016/j.chb.2007.07.008 schema:sameAs https://app.dimensions.ai/details/publication/pub.1031133913
    172 rdf:type schema:CreativeWork
    173 https://doi.org/10.1016/j.compedu.2017.09.010 schema:sameAs https://app.dimensions.ai/details/publication/pub.1091972432
    174 rdf:type schema:CreativeWork
    175 https://doi.org/10.1016/j.engappai.2011.07.004 schema:sameAs https://app.dimensions.ai/details/publication/pub.1046645367
    176 rdf:type schema:CreativeWork
    177 https://doi.org/10.1016/j.eswa.2009.09.031 schema:sameAs https://app.dimensions.ai/details/publication/pub.1008805621
    178 rdf:type schema:CreativeWork
    179 https://doi.org/10.1016/j.eswa.2013.11.041 schema:sameAs https://app.dimensions.ai/details/publication/pub.1052374372
    180 rdf:type schema:CreativeWork
    181 https://doi.org/10.1016/j.eswa.2014.08.049 schema:sameAs https://app.dimensions.ai/details/publication/pub.1039358555
    182 rdf:type schema:CreativeWork
    183 https://doi.org/10.1016/j.ijleo.2012.08.040 schema:sameAs https://app.dimensions.ai/details/publication/pub.1011399660
    184 rdf:type schema:CreativeWork
    185 https://doi.org/10.1016/j.jesp.2013.09.011 schema:sameAs https://app.dimensions.ai/details/publication/pub.1021152272
    186 rdf:type schema:CreativeWork
    187 https://doi.org/10.1016/s0167-6393(03)00099-2 schema:sameAs https://app.dimensions.ai/details/publication/pub.1031300442
    188 rdf:type schema:CreativeWork
    189 https://doi.org/10.1037/h0073583 schema:sameAs https://app.dimensions.ai/details/publication/pub.1038617747
    190 rdf:type schema:CreativeWork
    191 https://doi.org/10.1037/h0077714 schema:sameAs https://app.dimensions.ai/details/publication/pub.1026751541
    192 rdf:type schema:CreativeWork
    193 https://doi.org/10.1080/10447318.2016.1159799 schema:sameAs https://app.dimensions.ai/details/publication/pub.1042308352
    194 rdf:type schema:CreativeWork
    195 https://doi.org/10.1080/10494820.2014.908927 schema:sameAs https://app.dimensions.ai/details/publication/pub.1018900858
    196 rdf:type schema:CreativeWork
    197 https://doi.org/10.1080/10494820.2016.1247286 schema:sameAs https://app.dimensions.ai/details/publication/pub.1039920083
    198 rdf:type schema:CreativeWork
    199 https://doi.org/10.1088/0967-3334/32/10/002 schema:sameAs https://app.dimensions.ai/details/publication/pub.1059123657
    200 rdf:type schema:CreativeWork
    201 https://doi.org/10.1109/acii.2009.5349544 schema:sameAs https://app.dimensions.ai/details/publication/pub.1095275973
    202 rdf:type schema:CreativeWork
    203 https://doi.org/10.1109/ccnc.2012.6181098 schema:sameAs https://app.dimensions.ai/details/publication/pub.1094246889
    204 rdf:type schema:CreativeWork
    205 https://doi.org/10.1109/cvpr.2011.5995316 schema:sameAs https://app.dimensions.ai/details/publication/pub.1093733060
    206 rdf:type schema:CreativeWork
    207 https://doi.org/10.1109/fg.2011.5771364 schema:sameAs https://app.dimensions.ai/details/publication/pub.1095213232
    208 rdf:type schema:CreativeWork
    209 https://doi.org/10.1109/fuzzy.2007.4295451 schema:sameAs https://app.dimensions.ai/details/publication/pub.1095829862
    210 rdf:type schema:CreativeWork
    211 https://doi.org/10.1109/icdmw.2014.80 schema:sameAs https://app.dimensions.ai/details/publication/pub.1094544771
    212 rdf:type schema:CreativeWork
    213 https://doi.org/10.1109/icosp.2010.5656884 schema:sameAs https://app.dimensions.ai/details/publication/pub.1095670593
    214 rdf:type schema:CreativeWork
    215 https://doi.org/10.1109/incos.2011.82 schema:sameAs https://app.dimensions.ai/details/publication/pub.1094762124
    216 rdf:type schema:CreativeWork
    217 https://doi.org/10.1109/maes.2005.1576071 schema:sameAs https://app.dimensions.ai/details/publication/pub.1061381038
    218 rdf:type schema:CreativeWork
    219 https://doi.org/10.1109/mmul.2012.24 schema:sameAs https://app.dimensions.ai/details/publication/pub.1061410292
    220 rdf:type schema:CreativeWork
    221 https://doi.org/10.1109/nlpke.2009.5313815 schema:sameAs https://app.dimensions.ai/details/publication/pub.1095777045
    222 rdf:type schema:CreativeWork
    223 https://doi.org/10.1111/j.1365-2729.2008.00279.x schema:sameAs https://app.dimensions.ai/details/publication/pub.1001233326
    224 rdf:type schema:CreativeWork
    225 https://doi.org/10.1111/j.1464-0597.1992.tb00712.x schema:sameAs https://app.dimensions.ai/details/publication/pub.1004412602
    226 rdf:type schema:CreativeWork
    227 https://doi.org/10.1117/12.600746 schema:sameAs https://app.dimensions.ai/details/publication/pub.1036853350
    228 rdf:type schema:CreativeWork
    229 https://doi.org/10.1142/s0218001499000495 schema:sameAs https://app.dimensions.ai/details/publication/pub.1062951271
    230 rdf:type schema:CreativeWork
    231 https://doi.org/10.1145/1101149.1101299 schema:sameAs https://app.dimensions.ai/details/publication/pub.1053427070
    232 rdf:type schema:CreativeWork
    233 https://doi.org/10.1145/1165255.1165259 schema:sameAs https://app.dimensions.ai/details/publication/pub.1035151052
    234 rdf:type schema:CreativeWork
    235 https://doi.org/10.1145/2254556.2254580 schema:sameAs https://app.dimensions.ai/details/publication/pub.1030256463
    236 rdf:type schema:CreativeWork
    237 https://doi.org/10.1145/2395123.2395128 schema:sameAs https://app.dimensions.ai/details/publication/pub.1032905054
    238 rdf:type schema:CreativeWork
    239 https://doi.org/10.1155/2016/5680526 schema:sameAs https://app.dimensions.ai/details/publication/pub.1044909780
    240 rdf:type schema:CreativeWork
    241 https://doi.org/10.17083/ijsg.v1i1.11 schema:sameAs https://app.dimensions.ai/details/publication/pub.1068268182
    242 rdf:type schema:CreativeWork
    243 https://doi.org/10.2307/2529310 schema:sameAs https://app.dimensions.ai/details/publication/pub.1069974986
    244 rdf:type schema:CreativeWork
    245 https://doi.org/10.4018/jse.2010101605 schema:sameAs https://app.dimensions.ai/details/publication/pub.1041326499
    246 rdf:type schema:CreativeWork
    247 https://doi.org/10.5121/ijcsa.2014.4104 schema:sameAs https://app.dimensions.ai/details/publication/pub.1072615595
    248 rdf:type schema:CreativeWork
    249 https://doi.org/10.7763/ijcte.2009.v1.103 schema:sameAs https://app.dimensions.ai/details/publication/pub.1074032451
    250 rdf:type schema:CreativeWork
    251 https://doi.org/10.9781/ijimai.2016.4112 schema:sameAs https://app.dimensions.ai/details/publication/pub.1074158146
    252 rdf:type schema:CreativeWork
    253 https://www.grid.ac/institutes/grid.36120.36 schema:alternateName Open University in the Netherlands
    254 schema:name Welten Institute, Research Centre for Learning, Teaching and Technology, Faculty of Psychology and Educational Sciences, Open University of the Netherlands, Heerlen, Netherlands
    255 rdf:type schema:Organization
     




    Preview window. Press ESC to close (or click here)


    ...