Playful Screening of Executive Functions Using Augmented Reality and Gaze Based Assessment View Full Text


Ontology type: schema:Chapter     


Chapter Info

DATE

2021-07-04

AUTHORS

Martin Pszeida , Amir Dini , Sandra Schüssler , Claudia Voithofer , Jean-Philippe Andreu , Philipp Hafner , Lucas Paletta

ABSTRACT

Augmented Reality (AR) technologies have recently been explored for application in dementia care, including cognitive training and screening, navigational assistance to find their way around, assistance to identify friends and family members, and assistance with activities of daily living. The presented work proposes the use of mobile and playful assessment of executive functions in the home environment by AR technology. We implemented a gamified version of the neuropsychological test ‘Tower of London’ (Shallice, 1982 [1]). It is played with poles of various size and colored balls, starting each exercise with a certain start and desired goal configuration of balls on poles. The novel AR-based technology enables hand-based interaction with artificial objects in the field of view and monitoring of the user’s gaze behavior via eye tracking towards the artificial objects of interest. A pilot study was performed with 12 healthy people that played the game with various degrees of difficulty concerning its planning depth. The results of the study demonstrate statistically significant correlation between the eye tracking features and the planning ability as well as cognitive flexibility measured by standardized psychological tests. This study provides first indication that executive functions can be estimated from playful AR-based interaction. Future work will focus on adjusting the game for persons with dementia, such as, by decreasing the difficulty level appropriately. More... »

PAGES

419-427

Book

TITLE

Advances in Neuroergonomics and Cognitive Engineering

ISBN

978-3-030-80284-4
978-3-030-80285-1

Identifiers

URI

http://scigraph.springernature.com/pub.10.1007/978-3-030-80285-1_49

DOI

http://dx.doi.org/10.1007/978-3-030-80285-1_49

DIMENSIONS

https://app.dimensions.ai/details/publication/pub.1139356330


Indexing Status Check whether this publication has been indexed by Scopus and Web Of Science using the SN Indexing Status Tool
Incoming Citations Browse incoming citations for this publication using opencitations.net

JSON-LD is the canonical representation for SciGraph data.

TIP: You can open this SciGraph record using an external JSON-LD service: JSON-LD Playground Google SDTT

[
  {
    "@context": "https://springernature.github.io/scigraph/jsonld/sgcontext.json", 
    "about": [
      {
        "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/17", 
        "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
        "name": "Psychology and Cognitive Sciences", 
        "type": "DefinedTerm"
      }, 
      {
        "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/1701", 
        "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
        "name": "Psychology", 
        "type": "DefinedTerm"
      }
    ], 
    "author": [
      {
        "affiliation": {
          "alternateName": "Joanneum Research Forschungsgesellschaft mbH, 8010, Graz, Austria", 
          "id": "http://www.grid.ac/institutes/grid.8684.2", 
          "name": [
            "Joanneum Research Forschungsgesellschaft mbH, 8010, Graz, Austria"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Pszeida", 
        "givenName": "Martin", 
        "id": "sg:person.015600167217.84", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.015600167217.84"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "Joanneum Research Forschungsgesellschaft mbH, 8010, Graz, Austria", 
          "id": "http://www.grid.ac/institutes/grid.8684.2", 
          "name": [
            "Joanneum Research Forschungsgesellschaft mbH, 8010, Graz, Austria"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Dini", 
        "givenName": "Amir", 
        "id": "sg:person.013362736035.12", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.013362736035.12"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "Institute of Nursing Science, Medical University of Graz, 8010, Graz, Austria", 
          "id": "http://www.grid.ac/institutes/grid.11598.34", 
          "name": [
            "Institute of Nursing Science, Medical University of Graz, 8010, Graz, Austria"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Sch\u00fcssler", 
        "givenName": "Sandra", 
        "id": "sg:person.0761116675.49", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.0761116675.49"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "Institute of Nursing Science, Medical University of Graz, 8010, Graz, Austria", 
          "id": "http://www.grid.ac/institutes/grid.11598.34", 
          "name": [
            "Institute of Nursing Science, Medical University of Graz, 8010, Graz, Austria"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Voithofer", 
        "givenName": "Claudia", 
        "id": "sg:person.010763455001.03", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010763455001.03"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "Joanneum Research Forschungsgesellschaft mbH, 8010, Graz, Austria", 
          "id": "http://www.grid.ac/institutes/grid.8684.2", 
          "name": [
            "Joanneum Research Forschungsgesellschaft mbH, 8010, Graz, Austria"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Andreu", 
        "givenName": "Jean-Philippe", 
        "id": "sg:person.013114365575.24", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.013114365575.24"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "Joanneum Research Forschungsgesellschaft mbH, 8010, Graz, Austria", 
          "id": "http://www.grid.ac/institutes/grid.8684.2", 
          "name": [
            "Joanneum Research Forschungsgesellschaft mbH, 8010, Graz, Austria"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Hafner", 
        "givenName": "Philipp", 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "Joanneum Research Forschungsgesellschaft mbH, 8010, Graz, Austria", 
          "id": "http://www.grid.ac/institutes/grid.8684.2", 
          "name": [
            "Joanneum Research Forschungsgesellschaft mbH, 8010, Graz, Austria"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Paletta", 
        "givenName": "Lucas", 
        "id": "sg:person.010060055125.29", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010060055125.29"
        ], 
        "type": "Person"
      }
    ], 
    "datePublished": "2021-07-04", 
    "datePublishedReg": "2021-07-04", 
    "description": "Augmented Reality (AR) technologies have recently been explored for application in dementia care, including cognitive training and screening, navigational assistance to find their way around, assistance to identify friends and family members, and assistance with activities of daily living. The presented work proposes the use of mobile and playful assessment of executive functions in the home environment by AR technology. We implemented a gamified version of the neuropsychological test \u2018Tower of London\u2019 (Shallice, 1982 [1]). It is played with poles of various size and colored balls, starting each exercise with a certain start and desired goal configuration of balls on poles. The novel AR-based technology enables hand-based interaction with artificial objects in the field of view and monitoring of the user\u2019s gaze behavior via eye tracking towards the artificial objects of interest. A pilot study was performed with 12 healthy people that played the game with various degrees of difficulty concerning its planning depth. The results of the study demonstrate statistically significant correlation between the eye tracking features and the planning ability as well as cognitive flexibility measured by standardized psychological tests. This study provides first indication that executive functions can be estimated from playful AR-based interaction. Future work will focus on adjusting the game for persons with dementia, such as, by decreasing the difficulty level appropriately.", 
    "editor": [
      {
        "familyName": "Ayaz", 
        "givenName": "Hasan", 
        "type": "Person"
      }, 
      {
        "familyName": "Asgher", 
        "givenName": "Umer", 
        "type": "Person"
      }, 
      {
        "familyName": "Paletta", 
        "givenName": "Lucas", 
        "type": "Person"
      }
    ], 
    "genre": "chapter", 
    "id": "sg:pub.10.1007/978-3-030-80285-1_49", 
    "inLanguage": "en", 
    "isAccessibleForFree": false, 
    "isPartOf": {
      "isbn": [
        "978-3-030-80284-4", 
        "978-3-030-80285-1"
      ], 
      "name": "Advances in Neuroergonomics and Cognitive Engineering", 
      "type": "Book"
    }, 
    "keywords": [
      "executive function", 
      "hand-based interaction", 
      "Augmented Reality (AR) technology", 
      "eye tracking features", 
      "user's gaze behavior", 
      "artificial objects", 
      "daily living", 
      "healthy people", 
      "gaze behavior", 
      "dementia care", 
      "Augmented Reality", 
      "reality technology", 
      "AR technology", 
      "pilot study", 
      "novel AR", 
      "neuropsychological tests", 
      "navigational assistance", 
      "standardized psychological tests", 
      "goal configuration", 
      "significant correlation", 
      "tracking features", 
      "family members", 
      "eye tracking", 
      "field of view", 
      "cognitive training", 
      "home environment", 
      "screening", 
      "certain start", 
      "psychological tests", 
      "difficulty level", 
      "presented work", 
      "future work", 
      "technology", 
      "degree of difficulty", 
      "dementia", 
      "objects", 
      "first indication", 
      "care", 
      "game", 
      "study", 
      "assessment", 
      "planning ability", 
      "Tower of London", 
      "playful assessment", 
      "exercise", 
      "indications", 
      "cognitive flexibility", 
      "test", 
      "tracking", 
      "function", 
      "assistance", 
      "Based Assessment", 
      "living", 
      "persons", 
      "levels", 
      "activity", 
      "flexibility", 
      "work", 
      "start", 
      "environment", 
      "reality", 
      "training", 
      "correlation", 
      "applications", 
      "people", 
      "features", 
      "planning depth", 
      "version", 
      "monitoring", 
      "use", 
      "ability", 
      "way", 
      "difficulties", 
      "members", 
      "friends", 
      "degree", 
      "view", 
      "interaction", 
      "results", 
      "Ar", 
      "configuration", 
      "interest", 
      "London", 
      "field", 
      "poles", 
      "size", 
      "ball", 
      "behavior", 
      "tower", 
      "depth"
    ], 
    "name": "Playful Screening of Executive Functions Using Augmented Reality and Gaze Based Assessment", 
    "pagination": "419-427", 
    "productId": [
      {
        "name": "dimensions_id", 
        "type": "PropertyValue", 
        "value": [
          "pub.1139356330"
        ]
      }, 
      {
        "name": "doi", 
        "type": "PropertyValue", 
        "value": [
          "10.1007/978-3-030-80285-1_49"
        ]
      }
    ], 
    "publisher": {
      "name": "Springer Nature", 
      "type": "Organisation"
    }, 
    "sameAs": [
      "https://doi.org/10.1007/978-3-030-80285-1_49", 
      "https://app.dimensions.ai/details/publication/pub.1139356330"
    ], 
    "sdDataset": "chapters", 
    "sdDatePublished": "2022-05-20T07:48", 
    "sdLicense": "https://scigraph.springernature.com/explorer/license/", 
    "sdPublisher": {
      "name": "Springer Nature - SN SciGraph project", 
      "type": "Organization"
    }, 
    "sdSource": "s3://com-springernature-scigraph/baseset/20220519/entities/gbq_results/chapter/chapter_446.jsonl", 
    "type": "Chapter", 
    "url": "https://doi.org/10.1007/978-3-030-80285-1_49"
  }
]
 

Download the RDF metadata as:  json-ld nt turtle xml License info

HOW TO GET THIS DATA PROGRAMMATICALLY:

JSON-LD is a popular format for linked data which is fully compatible with JSON.

curl -H 'Accept: application/ld+json' 'https://scigraph.springernature.com/pub.10.1007/978-3-030-80285-1_49'

N-Triples is a line-based linked data format ideal for batch operations.

curl -H 'Accept: application/n-triples' 'https://scigraph.springernature.com/pub.10.1007/978-3-030-80285-1_49'

Turtle is a human-readable linked data format.

curl -H 'Accept: text/turtle' 'https://scigraph.springernature.com/pub.10.1007/978-3-030-80285-1_49'

RDF/XML is a standard XML format for linked data.

curl -H 'Accept: application/rdf+xml' 'https://scigraph.springernature.com/pub.10.1007/978-3-030-80285-1_49'


 

This table displays all metadata directly associated to this object as RDF triples.

204 TRIPLES      23 PREDICATES      115 URIs      108 LITERALS      7 BLANK NODES

Subject Predicate Object
1 sg:pub.10.1007/978-3-030-80285-1_49 schema:about anzsrc-for:17
2 anzsrc-for:1701
3 schema:author N37c7c372667e4c04a77b465d9227af9f
4 schema:datePublished 2021-07-04
5 schema:datePublishedReg 2021-07-04
6 schema:description Augmented Reality (AR) technologies have recently been explored for application in dementia care, including cognitive training and screening, navigational assistance to find their way around, assistance to identify friends and family members, and assistance with activities of daily living. The presented work proposes the use of mobile and playful assessment of executive functions in the home environment by AR technology. We implemented a gamified version of the neuropsychological test ‘Tower of London’ (Shallice, 1982 [1]). It is played with poles of various size and colored balls, starting each exercise with a certain start and desired goal configuration of balls on poles. The novel AR-based technology enables hand-based interaction with artificial objects in the field of view and monitoring of the user’s gaze behavior via eye tracking towards the artificial objects of interest. A pilot study was performed with 12 healthy people that played the game with various degrees of difficulty concerning its planning depth. The results of the study demonstrate statistically significant correlation between the eye tracking features and the planning ability as well as cognitive flexibility measured by standardized psychological tests. This study provides first indication that executive functions can be estimated from playful AR-based interaction. Future work will focus on adjusting the game for persons with dementia, such as, by decreasing the difficulty level appropriately.
7 schema:editor Nfa5fbc4fb89a40e980276a62261fda20
8 schema:genre chapter
9 schema:inLanguage en
10 schema:isAccessibleForFree false
11 schema:isPartOf N7abf44a39b04415699ea321fdeaba195
12 schema:keywords AR technology
13 Ar
14 Augmented Reality
15 Augmented Reality (AR) technology
16 Based Assessment
17 London
18 Tower of London
19 ability
20 activity
21 applications
22 artificial objects
23 assessment
24 assistance
25 ball
26 behavior
27 care
28 certain start
29 cognitive flexibility
30 cognitive training
31 configuration
32 correlation
33 daily living
34 degree
35 degree of difficulty
36 dementia
37 dementia care
38 depth
39 difficulties
40 difficulty level
41 environment
42 executive function
43 exercise
44 eye tracking
45 eye tracking features
46 family members
47 features
48 field
49 field of view
50 first indication
51 flexibility
52 friends
53 function
54 future work
55 game
56 gaze behavior
57 goal configuration
58 hand-based interaction
59 healthy people
60 home environment
61 indications
62 interaction
63 interest
64 levels
65 living
66 members
67 monitoring
68 navigational assistance
69 neuropsychological tests
70 novel AR
71 objects
72 people
73 persons
74 pilot study
75 planning ability
76 planning depth
77 playful assessment
78 poles
79 presented work
80 psychological tests
81 reality
82 reality technology
83 results
84 screening
85 significant correlation
86 size
87 standardized psychological tests
88 start
89 study
90 technology
91 test
92 tower
93 tracking
94 tracking features
95 training
96 use
97 user's gaze behavior
98 version
99 view
100 way
101 work
102 schema:name Playful Screening of Executive Functions Using Augmented Reality and Gaze Based Assessment
103 schema:pagination 419-427
104 schema:productId N374a8d1adae140b7a2bb78c843088e60
105 Nc3c05389ab334a67914727bfcf43d3c0
106 schema:publisher N9fc82f4f07dd4c259acd957cf34efff7
107 schema:sameAs https://app.dimensions.ai/details/publication/pub.1139356330
108 https://doi.org/10.1007/978-3-030-80285-1_49
109 schema:sdDatePublished 2022-05-20T07:48
110 schema:sdLicense https://scigraph.springernature.com/explorer/license/
111 schema:sdPublisher Na8fd477bb77a40798b8cd66974dada7f
112 schema:url https://doi.org/10.1007/978-3-030-80285-1_49
113 sgo:license sg:explorer/license/
114 sgo:sdDataset chapters
115 rdf:type schema:Chapter
116 N12e6ee343c5b4c3aa9d76912381091d5 rdf:first sg:person.010060055125.29
117 rdf:rest rdf:nil
118 N374a8d1adae140b7a2bb78c843088e60 schema:name doi
119 schema:value 10.1007/978-3-030-80285-1_49
120 rdf:type schema:PropertyValue
121 N37c7c372667e4c04a77b465d9227af9f rdf:first sg:person.015600167217.84
122 rdf:rest N914b25d77f5f485a9b313234e8fe8b01
123 N575599559e2742e99ad1e04ba8d40422 rdf:first N621e6f4bc36a49c498449c998e3e24a8
124 rdf:rest N12e6ee343c5b4c3aa9d76912381091d5
125 N5c73c4fd52d3436baa3883102309a2ff rdf:first sg:person.013114365575.24
126 rdf:rest N575599559e2742e99ad1e04ba8d40422
127 N621e6f4bc36a49c498449c998e3e24a8 schema:affiliation grid-institutes:grid.8684.2
128 schema:familyName Hafner
129 schema:givenName Philipp
130 rdf:type schema:Person
131 N651f19b98513499dbe761e29b5a18a08 schema:familyName Paletta
132 schema:givenName Lucas
133 rdf:type schema:Person
134 N7abf44a39b04415699ea321fdeaba195 schema:isbn 978-3-030-80284-4
135 978-3-030-80285-1
136 schema:name Advances in Neuroergonomics and Cognitive Engineering
137 rdf:type schema:Book
138 N7c5ebe54f2384d6e98f334f2d20ad969 rdf:first sg:person.0761116675.49
139 rdf:rest Nfa9204a5bfa445448154c8d5721da9c5
140 N914b25d77f5f485a9b313234e8fe8b01 rdf:first sg:person.013362736035.12
141 rdf:rest N7c5ebe54f2384d6e98f334f2d20ad969
142 N9fc82f4f07dd4c259acd957cf34efff7 schema:name Springer Nature
143 rdf:type schema:Organisation
144 Na54f3d14b7b04e05b4ba4d661dd7e1ba rdf:first Nec4f5ccbca0242c8a0bf09b75b6a91f2
145 rdf:rest Nccec6fc9fb0541afa099bc47724b4eb9
146 Na8fd477bb77a40798b8cd66974dada7f schema:name Springer Nature - SN SciGraph project
147 rdf:type schema:Organization
148 Nc3c05389ab334a67914727bfcf43d3c0 schema:name dimensions_id
149 schema:value pub.1139356330
150 rdf:type schema:PropertyValue
151 Nccec6fc9fb0541afa099bc47724b4eb9 rdf:first N651f19b98513499dbe761e29b5a18a08
152 rdf:rest rdf:nil
153 Nec4f5ccbca0242c8a0bf09b75b6a91f2 schema:familyName Asgher
154 schema:givenName Umer
155 rdf:type schema:Person
156 Nfa5fbc4fb89a40e980276a62261fda20 rdf:first Nfe9b96c74c7f44adb1b72cc0b4c585c6
157 rdf:rest Na54f3d14b7b04e05b4ba4d661dd7e1ba
158 Nfa9204a5bfa445448154c8d5721da9c5 rdf:first sg:person.010763455001.03
159 rdf:rest N5c73c4fd52d3436baa3883102309a2ff
160 Nfe9b96c74c7f44adb1b72cc0b4c585c6 schema:familyName Ayaz
161 schema:givenName Hasan
162 rdf:type schema:Person
163 anzsrc-for:17 schema:inDefinedTermSet anzsrc-for:
164 schema:name Psychology and Cognitive Sciences
165 rdf:type schema:DefinedTerm
166 anzsrc-for:1701 schema:inDefinedTermSet anzsrc-for:
167 schema:name Psychology
168 rdf:type schema:DefinedTerm
169 sg:person.010060055125.29 schema:affiliation grid-institutes:grid.8684.2
170 schema:familyName Paletta
171 schema:givenName Lucas
172 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010060055125.29
173 rdf:type schema:Person
174 sg:person.010763455001.03 schema:affiliation grid-institutes:grid.11598.34
175 schema:familyName Voithofer
176 schema:givenName Claudia
177 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010763455001.03
178 rdf:type schema:Person
179 sg:person.013114365575.24 schema:affiliation grid-institutes:grid.8684.2
180 schema:familyName Andreu
181 schema:givenName Jean-Philippe
182 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.013114365575.24
183 rdf:type schema:Person
184 sg:person.013362736035.12 schema:affiliation grid-institutes:grid.8684.2
185 schema:familyName Dini
186 schema:givenName Amir
187 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.013362736035.12
188 rdf:type schema:Person
189 sg:person.015600167217.84 schema:affiliation grid-institutes:grid.8684.2
190 schema:familyName Pszeida
191 schema:givenName Martin
192 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.015600167217.84
193 rdf:type schema:Person
194 sg:person.0761116675.49 schema:affiliation grid-institutes:grid.11598.34
195 schema:familyName Schüssler
196 schema:givenName Sandra
197 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.0761116675.49
198 rdf:type schema:Person
199 grid-institutes:grid.11598.34 schema:alternateName Institute of Nursing Science, Medical University of Graz, 8010, Graz, Austria
200 schema:name Institute of Nursing Science, Medical University of Graz, 8010, Graz, Austria
201 rdf:type schema:Organization
202 grid-institutes:grid.8684.2 schema:alternateName Joanneum Research Forschungsgesellschaft mbH, 8010, Graz, Austria
203 schema:name Joanneum Research Forschungsgesellschaft mbH, 8010, Graz, Austria
204 rdf:type schema:Organization
 




Preview window. Press ESC to close (or click here)


...