Playful Screening of Executive Functions Using Augmented Reality and Gaze Based Assessment View Full Text


Ontology type: schema:Chapter     


Chapter Info

DATE

2021-07-04

AUTHORS

Martin Pszeida , Amir Dini , Sandra Schüssler , Claudia Voithofer , Jean-Philippe Andreu , Philipp Hafner , Lucas Paletta

ABSTRACT

Augmented Reality (AR) technologies have recently been explored for application in dementia care, including cognitive training and screening, navigational assistance to find their way around, assistance to identify friends and family members, and assistance with activities of daily living. The presented work proposes the use of mobile and playful assessment of executive functions in the home environment by AR technology. We implemented a gamified version of the neuropsychological test ‘Tower of London’ (Shallice, 1982 [1]). It is played with poles of various size and colored balls, starting each exercise with a certain start and desired goal configuration of balls on poles. The novel AR-based technology enables hand-based interaction with artificial objects in the field of view and monitoring of the user’s gaze behavior via eye tracking towards the artificial objects of interest. A pilot study was performed with 12 healthy people that played the game with various degrees of difficulty concerning its planning depth. The results of the study demonstrate statistically significant correlation between the eye tracking features and the planning ability as well as cognitive flexibility measured by standardized psychological tests. This study provides first indication that executive functions can be estimated from playful AR-based interaction. Future work will focus on adjusting the game for persons with dementia, such as, by decreasing the difficulty level appropriately. More... »

PAGES

419-427

Book

TITLE

Advances in Neuroergonomics and Cognitive Engineering

ISBN

978-3-030-80284-4
978-3-030-80285-1

Identifiers

URI

http://scigraph.springernature.com/pub.10.1007/978-3-030-80285-1_49

DOI

http://dx.doi.org/10.1007/978-3-030-80285-1_49

DIMENSIONS

https://app.dimensions.ai/details/publication/pub.1139356330


Indexing Status Check whether this publication has been indexed by Scopus and Web Of Science using the SN Indexing Status Tool
Incoming Citations Browse incoming citations for this publication using opencitations.net

JSON-LD is the canonical representation for SciGraph data.

TIP: You can open this SciGraph record using an external JSON-LD service: JSON-LD Playground Google SDTT

[
  {
    "@context": "https://springernature.github.io/scigraph/jsonld/sgcontext.json", 
    "about": [
      {
        "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/17", 
        "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
        "name": "Psychology and Cognitive Sciences", 
        "type": "DefinedTerm"
      }, 
      {
        "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/1701", 
        "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
        "name": "Psychology", 
        "type": "DefinedTerm"
      }
    ], 
    "author": [
      {
        "affiliation": {
          "alternateName": "Joanneum Research Forschungsgesellschaft mbH, 8010, Graz, Austria", 
          "id": "http://www.grid.ac/institutes/grid.8684.2", 
          "name": [
            "Joanneum Research Forschungsgesellschaft mbH, 8010, Graz, Austria"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Pszeida", 
        "givenName": "Martin", 
        "id": "sg:person.015600167217.84", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.015600167217.84"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "Joanneum Research Forschungsgesellschaft mbH, 8010, Graz, Austria", 
          "id": "http://www.grid.ac/institutes/grid.8684.2", 
          "name": [
            "Joanneum Research Forschungsgesellschaft mbH, 8010, Graz, Austria"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Dini", 
        "givenName": "Amir", 
        "id": "sg:person.013362736035.12", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.013362736035.12"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "Institute of Nursing Science, Medical University of Graz, 8010, Graz, Austria", 
          "id": "http://www.grid.ac/institutes/grid.11598.34", 
          "name": [
            "Institute of Nursing Science, Medical University of Graz, 8010, Graz, Austria"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Sch\u00fcssler", 
        "givenName": "Sandra", 
        "id": "sg:person.0761116675.49", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.0761116675.49"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "Institute of Nursing Science, Medical University of Graz, 8010, Graz, Austria", 
          "id": "http://www.grid.ac/institutes/grid.11598.34", 
          "name": [
            "Institute of Nursing Science, Medical University of Graz, 8010, Graz, Austria"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Voithofer", 
        "givenName": "Claudia", 
        "id": "sg:person.010763455001.03", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010763455001.03"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "Joanneum Research Forschungsgesellschaft mbH, 8010, Graz, Austria", 
          "id": "http://www.grid.ac/institutes/grid.8684.2", 
          "name": [
            "Joanneum Research Forschungsgesellschaft mbH, 8010, Graz, Austria"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Andreu", 
        "givenName": "Jean-Philippe", 
        "id": "sg:person.013114365575.24", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.013114365575.24"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "Joanneum Research Forschungsgesellschaft mbH, 8010, Graz, Austria", 
          "id": "http://www.grid.ac/institutes/grid.8684.2", 
          "name": [
            "Joanneum Research Forschungsgesellschaft mbH, 8010, Graz, Austria"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Hafner", 
        "givenName": "Philipp", 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "Joanneum Research Forschungsgesellschaft mbH, 8010, Graz, Austria", 
          "id": "http://www.grid.ac/institutes/grid.8684.2", 
          "name": [
            "Joanneum Research Forschungsgesellschaft mbH, 8010, Graz, Austria"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Paletta", 
        "givenName": "Lucas", 
        "id": "sg:person.010060055125.29", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010060055125.29"
        ], 
        "type": "Person"
      }
    ], 
    "datePublished": "2021-07-04", 
    "datePublishedReg": "2021-07-04", 
    "description": "Augmented Reality (AR) technologies have recently been explored for application in dementia care, including cognitive training and screening, navigational assistance to find their way around, assistance to identify friends and family members, and assistance with activities of daily living. The presented work proposes the use of mobile and playful assessment of executive functions in the home environment by AR technology. We implemented a gamified version of the neuropsychological test \u2018Tower of London\u2019 (Shallice, 1982 [1]). It is played with poles of various size and colored balls, starting each exercise with a certain start and desired goal configuration of balls on poles. The novel AR-based technology enables hand-based interaction with artificial objects in the field of view and monitoring of the user\u2019s gaze behavior via eye tracking towards the artificial objects of interest. A pilot study was performed with 12 healthy people that played the game with various degrees of difficulty concerning its planning depth. The results of the study demonstrate statistically significant correlation between the eye tracking features and the planning ability as well as cognitive flexibility measured by standardized psychological tests. This study provides first indication that executive functions can be estimated from playful AR-based interaction. Future work will focus on adjusting the game for persons with dementia, such as, by decreasing the difficulty level appropriately.", 
    "editor": [
      {
        "familyName": "Ayaz", 
        "givenName": "Hasan", 
        "type": "Person"
      }, 
      {
        "familyName": "Asgher", 
        "givenName": "Umer", 
        "type": "Person"
      }, 
      {
        "familyName": "Paletta", 
        "givenName": "Lucas", 
        "type": "Person"
      }
    ], 
    "genre": "chapter", 
    "id": "sg:pub.10.1007/978-3-030-80285-1_49", 
    "inLanguage": "en", 
    "isAccessibleForFree": false, 
    "isPartOf": {
      "isbn": [
        "978-3-030-80284-4", 
        "978-3-030-80285-1"
      ], 
      "name": "Advances in Neuroergonomics and Cognitive Engineering", 
      "type": "Book"
    }, 
    "keywords": [
      "executive function", 
      "hand-based interaction", 
      "Augmented Reality (AR) technology", 
      "eye-tracking features", 
      "user's gaze behavior", 
      "artificial objects", 
      "daily living", 
      "healthy people", 
      "gaze behavior", 
      "Augmented Reality", 
      "reality technology", 
      "dementia care", 
      "AR technology", 
      "novel AR", 
      "pilot study", 
      "navigational assistance", 
      "standardized psychological tests", 
      "neuropsychological tests", 
      "goal configuration", 
      "significant correlation", 
      "tracking features", 
      "family members", 
      "eye tracking", 
      "field of view", 
      "cognitive training", 
      "home environment", 
      "psychological tests", 
      "screening", 
      "difficulty level", 
      "presented work", 
      "future work", 
      "technology", 
      "degree of difficulty", 
      "certain start", 
      "objects", 
      "dementia", 
      "first indication", 
      "game", 
      "study", 
      "care", 
      "assessment", 
      "planning ability", 
      "Tower of London", 
      "exercise", 
      "indications", 
      "cognitive flexibility", 
      "test", 
      "tracking", 
      "function", 
      "Based Assessment", 
      "assistance", 
      "living", 
      "persons", 
      "levels", 
      "flexibility", 
      "activity", 
      "work", 
      "start", 
      "environment", 
      "applications", 
      "training", 
      "reality", 
      "correlation", 
      "people", 
      "features", 
      "version", 
      "monitoring", 
      "use", 
      "ability", 
      "way", 
      "difficulties", 
      "members", 
      "friends", 
      "degree", 
      "view", 
      "interaction", 
      "Ar", 
      "results", 
      "configuration", 
      "interest", 
      "London", 
      "field", 
      "poles", 
      "size", 
      "ball", 
      "behavior", 
      "tower", 
      "depth", 
      "planning depth", 
      "playful assessment", 
      "playful AR", 
      "Playful Screening", 
      "Gaze Based Assessment"
    ], 
    "name": "Playful Screening of Executive Functions Using Augmented Reality and Gaze Based Assessment", 
    "pagination": "419-427", 
    "productId": [
      {
        "name": "dimensions_id", 
        "type": "PropertyValue", 
        "value": [
          "pub.1139356330"
        ]
      }, 
      {
        "name": "doi", 
        "type": "PropertyValue", 
        "value": [
          "10.1007/978-3-030-80285-1_49"
        ]
      }
    ], 
    "publisher": {
      "name": "Springer Nature", 
      "type": "Organisation"
    }, 
    "sameAs": [
      "https://doi.org/10.1007/978-3-030-80285-1_49", 
      "https://app.dimensions.ai/details/publication/pub.1139356330"
    ], 
    "sdDataset": "chapters", 
    "sdDatePublished": "2022-01-01T19:06", 
    "sdLicense": "https://scigraph.springernature.com/explorer/license/", 
    "sdPublisher": {
      "name": "Springer Nature - SN SciGraph project", 
      "type": "Organization"
    }, 
    "sdSource": "s3://com-springernature-scigraph/baseset/20220101/entities/gbq_results/chapter/chapter_100.jsonl", 
    "type": "Chapter", 
    "url": "https://doi.org/10.1007/978-3-030-80285-1_49"
  }
]
 

Download the RDF metadata as:  json-ld nt turtle xml License info

HOW TO GET THIS DATA PROGRAMMATICALLY:

JSON-LD is a popular format for linked data which is fully compatible with JSON.

curl -H 'Accept: application/ld+json' 'https://scigraph.springernature.com/pub.10.1007/978-3-030-80285-1_49'

N-Triples is a line-based linked data format ideal for batch operations.

curl -H 'Accept: application/n-triples' 'https://scigraph.springernature.com/pub.10.1007/978-3-030-80285-1_49'

Turtle is a human-readable linked data format.

curl -H 'Accept: text/turtle' 'https://scigraph.springernature.com/pub.10.1007/978-3-030-80285-1_49'

RDF/XML is a standard XML format for linked data.

curl -H 'Accept: application/rdf+xml' 'https://scigraph.springernature.com/pub.10.1007/978-3-030-80285-1_49'


 

This table displays all metadata directly associated to this object as RDF triples.

207 TRIPLES      23 PREDICATES      118 URIs      111 LITERALS      7 BLANK NODES

Subject Predicate Object
1 sg:pub.10.1007/978-3-030-80285-1_49 schema:about anzsrc-for:17
2 anzsrc-for:1701
3 schema:author N7cd55023f17d4656b1c67e089f114dd0
4 schema:datePublished 2021-07-04
5 schema:datePublishedReg 2021-07-04
6 schema:description Augmented Reality (AR) technologies have recently been explored for application in dementia care, including cognitive training and screening, navigational assistance to find their way around, assistance to identify friends and family members, and assistance with activities of daily living. The presented work proposes the use of mobile and playful assessment of executive functions in the home environment by AR technology. We implemented a gamified version of the neuropsychological test ‘Tower of London’ (Shallice, 1982 [1]). It is played with poles of various size and colored balls, starting each exercise with a certain start and desired goal configuration of balls on poles. The novel AR-based technology enables hand-based interaction with artificial objects in the field of view and monitoring of the user’s gaze behavior via eye tracking towards the artificial objects of interest. A pilot study was performed with 12 healthy people that played the game with various degrees of difficulty concerning its planning depth. The results of the study demonstrate statistically significant correlation between the eye tracking features and the planning ability as well as cognitive flexibility measured by standardized psychological tests. This study provides first indication that executive functions can be estimated from playful AR-based interaction. Future work will focus on adjusting the game for persons with dementia, such as, by decreasing the difficulty level appropriately.
7 schema:editor N45f7860f4e8c403481ea083dce9b8569
8 schema:genre chapter
9 schema:inLanguage en
10 schema:isAccessibleForFree false
11 schema:isPartOf Nbd9b658fba354816bffc46278906b577
12 schema:keywords AR technology
13 Ar
14 Augmented Reality
15 Augmented Reality (AR) technology
16 Based Assessment
17 Gaze Based Assessment
18 London
19 Playful Screening
20 Tower of London
21 ability
22 activity
23 applications
24 artificial objects
25 assessment
26 assistance
27 ball
28 behavior
29 care
30 certain start
31 cognitive flexibility
32 cognitive training
33 configuration
34 correlation
35 daily living
36 degree
37 degree of difficulty
38 dementia
39 dementia care
40 depth
41 difficulties
42 difficulty level
43 environment
44 executive function
45 exercise
46 eye tracking
47 eye-tracking features
48 family members
49 features
50 field
51 field of view
52 first indication
53 flexibility
54 friends
55 function
56 future work
57 game
58 gaze behavior
59 goal configuration
60 hand-based interaction
61 healthy people
62 home environment
63 indications
64 interaction
65 interest
66 levels
67 living
68 members
69 monitoring
70 navigational assistance
71 neuropsychological tests
72 novel AR
73 objects
74 people
75 persons
76 pilot study
77 planning ability
78 planning depth
79 playful AR
80 playful assessment
81 poles
82 presented work
83 psychological tests
84 reality
85 reality technology
86 results
87 screening
88 significant correlation
89 size
90 standardized psychological tests
91 start
92 study
93 technology
94 test
95 tower
96 tracking
97 tracking features
98 training
99 use
100 user's gaze behavior
101 version
102 view
103 way
104 work
105 schema:name Playful Screening of Executive Functions Using Augmented Reality and Gaze Based Assessment
106 schema:pagination 419-427
107 schema:productId N06e77a66077642169c2cffe8ed84b68b
108 N438814a989114292969188efc9085570
109 schema:publisher N61c50ef32bf3417ea6e237fa181d7c78
110 schema:sameAs https://app.dimensions.ai/details/publication/pub.1139356330
111 https://doi.org/10.1007/978-3-030-80285-1_49
112 schema:sdDatePublished 2022-01-01T19:06
113 schema:sdLicense https://scigraph.springernature.com/explorer/license/
114 schema:sdPublisher N8f4e7b6ce01747848bb3d979bd967032
115 schema:url https://doi.org/10.1007/978-3-030-80285-1_49
116 sgo:license sg:explorer/license/
117 sgo:sdDataset chapters
118 rdf:type schema:Chapter
119 N06e77a66077642169c2cffe8ed84b68b schema:name doi
120 schema:value 10.1007/978-3-030-80285-1_49
121 rdf:type schema:PropertyValue
122 N17e4b4ec445f4f3bb0f960403d65ba42 rdf:first sg:person.010060055125.29
123 rdf:rest rdf:nil
124 N1def449184f64fa8bf844775ce150ddb rdf:first sg:person.0761116675.49
125 rdf:rest N9da00b5d0b8448ea9f1083be90b34277
126 N3e7ada70ad4a449480f8d2090e82cb54 schema:familyName Paletta
127 schema:givenName Lucas
128 rdf:type schema:Person
129 N438814a989114292969188efc9085570 schema:name dimensions_id
130 schema:value pub.1139356330
131 rdf:type schema:PropertyValue
132 N45f7860f4e8c403481ea083dce9b8569 rdf:first N84d0afb9dbbf417093aba6587e759718
133 rdf:rest N5f7e6527bb374b8795da5ac2b76c6f1a
134 N5f7e6527bb374b8795da5ac2b76c6f1a rdf:first Nfe41dc85e82f4f0fb7100b58376fffc4
135 rdf:rest Nbf95e5dcc82346488a7af559393582bc
136 N61c50ef32bf3417ea6e237fa181d7c78 schema:name Springer Nature
137 rdf:type schema:Organisation
138 N7cd55023f17d4656b1c67e089f114dd0 rdf:first sg:person.015600167217.84
139 rdf:rest Nff89d06628254bd681c8acbcd4108f0a
140 N84d0afb9dbbf417093aba6587e759718 schema:familyName Ayaz
141 schema:givenName Hasan
142 rdf:type schema:Person
143 N8f4e7b6ce01747848bb3d979bd967032 schema:name Springer Nature - SN SciGraph project
144 rdf:type schema:Organization
145 N9da00b5d0b8448ea9f1083be90b34277 rdf:first sg:person.010763455001.03
146 rdf:rest Na75963ba7c684169b27f3545e8836c4e
147 Na75963ba7c684169b27f3545e8836c4e rdf:first sg:person.013114365575.24
148 rdf:rest Nee5b53f7bb5447eebdd1833575ebe602
149 Nb305cefce235402ea2eddc390fc9364f schema:affiliation grid-institutes:grid.8684.2
150 schema:familyName Hafner
151 schema:givenName Philipp
152 rdf:type schema:Person
153 Nbd9b658fba354816bffc46278906b577 schema:isbn 978-3-030-80284-4
154 978-3-030-80285-1
155 schema:name Advances in Neuroergonomics and Cognitive Engineering
156 rdf:type schema:Book
157 Nbf95e5dcc82346488a7af559393582bc rdf:first N3e7ada70ad4a449480f8d2090e82cb54
158 rdf:rest rdf:nil
159 Nee5b53f7bb5447eebdd1833575ebe602 rdf:first Nb305cefce235402ea2eddc390fc9364f
160 rdf:rest N17e4b4ec445f4f3bb0f960403d65ba42
161 Nfe41dc85e82f4f0fb7100b58376fffc4 schema:familyName Asgher
162 schema:givenName Umer
163 rdf:type schema:Person
164 Nff89d06628254bd681c8acbcd4108f0a rdf:first sg:person.013362736035.12
165 rdf:rest N1def449184f64fa8bf844775ce150ddb
166 anzsrc-for:17 schema:inDefinedTermSet anzsrc-for:
167 schema:name Psychology and Cognitive Sciences
168 rdf:type schema:DefinedTerm
169 anzsrc-for:1701 schema:inDefinedTermSet anzsrc-for:
170 schema:name Psychology
171 rdf:type schema:DefinedTerm
172 sg:person.010060055125.29 schema:affiliation grid-institutes:grid.8684.2
173 schema:familyName Paletta
174 schema:givenName Lucas
175 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010060055125.29
176 rdf:type schema:Person
177 sg:person.010763455001.03 schema:affiliation grid-institutes:grid.11598.34
178 schema:familyName Voithofer
179 schema:givenName Claudia
180 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010763455001.03
181 rdf:type schema:Person
182 sg:person.013114365575.24 schema:affiliation grid-institutes:grid.8684.2
183 schema:familyName Andreu
184 schema:givenName Jean-Philippe
185 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.013114365575.24
186 rdf:type schema:Person
187 sg:person.013362736035.12 schema:affiliation grid-institutes:grid.8684.2
188 schema:familyName Dini
189 schema:givenName Amir
190 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.013362736035.12
191 rdf:type schema:Person
192 sg:person.015600167217.84 schema:affiliation grid-institutes:grid.8684.2
193 schema:familyName Pszeida
194 schema:givenName Martin
195 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.015600167217.84
196 rdf:type schema:Person
197 sg:person.0761116675.49 schema:affiliation grid-institutes:grid.11598.34
198 schema:familyName Schüssler
199 schema:givenName Sandra
200 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.0761116675.49
201 rdf:type schema:Person
202 grid-institutes:grid.11598.34 schema:alternateName Institute of Nursing Science, Medical University of Graz, 8010, Graz, Austria
203 schema:name Institute of Nursing Science, Medical University of Graz, 8010, Graz, Austria
204 rdf:type schema:Organization
205 grid-institutes:grid.8684.2 schema:alternateName Joanneum Research Forschungsgesellschaft mbH, 8010, Graz, Austria
206 schema:name Joanneum Research Forschungsgesellschaft mbH, 8010, Graz, Austria
207 rdf:type schema:Organization
 




Preview window. Press ESC to close (or click here)


...