FACTS - A Computer Vision System for 3D Recovery and Semantic Mapping of Human Factors View Full Text


Ontology type: schema:Chapter     


Chapter Info

DATE

2013

AUTHORS

Lucas Paletta , Katrin Santner , Gerald Fritz , Albert Hofmann , Gerald Lodron , Georg Thallinger , Heinz Mayer

ABSTRACT

The study of human attention in the frame of interaction studies has been relevant for usability engineering and ergonomics for decades. Today, with the advent of wearable eye-tracking and Google glasses, monitoring of human attention will soon become ubiquitous. This work describes a multi-component vision system that enables pervasive mapping of human attention. The key contribution is that our methodology enables full 3D recovery of the gaze pointer, human view frustum and associated human centered measurements directly into an automatically computed 3D model. We apply RGB-D SLAM and descriptor matching methodologies for the 3D modeling, localization and fully automated annotation of ROIs (regions of interest) within the acquired 3D model. This methodology brings new potential into automated processing of human factors, opening new avenues for attention studies. More... »

PAGES

62-72

Identifiers

URI

http://scigraph.springernature.com/pub.10.1007/978-3-642-39402-7_7

DOI

http://dx.doi.org/10.1007/978-3-642-39402-7_7

DIMENSIONS

https://app.dimensions.ai/details/publication/pub.1012740595


Indexing Status Check whether this publication has been indexed by Scopus and Web Of Science using the SN Indexing Status Tool
Incoming Citations Browse incoming citations for this publication using opencitations.net

JSON-LD is the canonical representation for SciGraph data.

TIP: You can open this SciGraph record using an external JSON-LD service: JSON-LD Playground Google SDTT

[
  {
    "@context": "https://springernature.github.io/scigraph/jsonld/sgcontext.json", 
    "about": [
      {
        "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/08", 
        "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
        "name": "Information and Computing Sciences", 
        "type": "DefinedTerm"
      }, 
      {
        "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/17", 
        "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
        "name": "Psychology and Cognitive Sciences", 
        "type": "DefinedTerm"
      }, 
      {
        "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/0801", 
        "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
        "name": "Artificial Intelligence and Image Processing", 
        "type": "DefinedTerm"
      }, 
      {
        "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/1701", 
        "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
        "name": "Psychology", 
        "type": "DefinedTerm"
      }
    ], 
    "author": [
      {
        "affiliation": {
          "alternateName": "JOANNEUM RESEARCH Forschungsgesellschaft mbH, DIGITAL - Institute for Information and Communication Technologies, Steyrergasse 17, 8010, Graz, Austria", 
          "id": "http://www.grid.ac/institutes/grid.8684.2", 
          "name": [
            "JOANNEUM RESEARCH Forschungsgesellschaft mbH, DIGITAL - Institute for Information and Communication Technologies, Steyrergasse 17, 8010, Graz, Austria"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Paletta", 
        "givenName": "Lucas", 
        "id": "sg:person.010060055125.29", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010060055125.29"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "JOANNEUM RESEARCH Forschungsgesellschaft mbH, DIGITAL - Institute for Information and Communication Technologies, Steyrergasse 17, 8010, Graz, Austria", 
          "id": "http://www.grid.ac/institutes/grid.8684.2", 
          "name": [
            "JOANNEUM RESEARCH Forschungsgesellschaft mbH, DIGITAL - Institute for Information and Communication Technologies, Steyrergasse 17, 8010, Graz, Austria"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Santner", 
        "givenName": "Katrin", 
        "id": "sg:person.015513127441.33", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.015513127441.33"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "JOANNEUM RESEARCH Forschungsgesellschaft mbH, DIGITAL - Institute for Information and Communication Technologies, Steyrergasse 17, 8010, Graz, Austria", 
          "id": "http://www.grid.ac/institutes/grid.8684.2", 
          "name": [
            "JOANNEUM RESEARCH Forschungsgesellschaft mbH, DIGITAL - Institute for Information and Communication Technologies, Steyrergasse 17, 8010, Graz, Austria"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Fritz", 
        "givenName": "Gerald", 
        "id": "sg:person.011015636117.31", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.011015636117.31"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "JOANNEUM RESEARCH Forschungsgesellschaft mbH, DIGITAL - Institute for Information and Communication Technologies, Steyrergasse 17, 8010, Graz, Austria", 
          "id": "http://www.grid.ac/institutes/grid.8684.2", 
          "name": [
            "JOANNEUM RESEARCH Forschungsgesellschaft mbH, DIGITAL - Institute for Information and Communication Technologies, Steyrergasse 17, 8010, Graz, Austria"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Hofmann", 
        "givenName": "Albert", 
        "id": "sg:person.014457171455.12", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.014457171455.12"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "JOANNEUM RESEARCH Forschungsgesellschaft mbH, DIGITAL - Institute for Information and Communication Technologies, Steyrergasse 17, 8010, Graz, Austria", 
          "id": "http://www.grid.ac/institutes/grid.8684.2", 
          "name": [
            "JOANNEUM RESEARCH Forschungsgesellschaft mbH, DIGITAL - Institute for Information and Communication Technologies, Steyrergasse 17, 8010, Graz, Austria"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Lodron", 
        "givenName": "Gerald", 
        "id": "sg:person.016350640035.16", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.016350640035.16"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "JOANNEUM RESEARCH Forschungsgesellschaft mbH, DIGITAL - Institute for Information and Communication Technologies, Steyrergasse 17, 8010, Graz, Austria", 
          "id": "http://www.grid.ac/institutes/grid.8684.2", 
          "name": [
            "JOANNEUM RESEARCH Forschungsgesellschaft mbH, DIGITAL - Institute for Information and Communication Technologies, Steyrergasse 17, 8010, Graz, Austria"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Thallinger", 
        "givenName": "Georg", 
        "id": "sg:person.014226756747.64", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.014226756747.64"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "JOANNEUM RESEARCH Forschungsgesellschaft mbH, DIGITAL - Institute for Information and Communication Technologies, Steyrergasse 17, 8010, Graz, Austria", 
          "id": "http://www.grid.ac/institutes/grid.8684.2", 
          "name": [
            "JOANNEUM RESEARCH Forschungsgesellschaft mbH, DIGITAL - Institute for Information and Communication Technologies, Steyrergasse 17, 8010, Graz, Austria"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Mayer", 
        "givenName": "Heinz", 
        "id": "sg:person.012101323701.00", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.012101323701.00"
        ], 
        "type": "Person"
      }
    ], 
    "datePublished": "2013", 
    "datePublishedReg": "2013-01-01", 
    "description": "The study of human attention in the frame of interaction studies has been relevant for usability engineering and ergonomics for decades. Today, with the advent of wearable eye-tracking and Google glasses, monitoring of human attention will soon become ubiquitous. This work describes a multi-component vision system that enables pervasive mapping of human attention. The key contribution is that our methodology enables full 3D recovery of the gaze pointer, human view frustum and associated human centered measurements directly into an automatically computed 3D model. We apply RGB-D SLAM and descriptor matching methodologies for the 3D modeling, localization and fully automated annotation of ROIs (regions of interest) within the acquired 3D model. This methodology brings new potential into automated processing of human factors, opening new avenues for attention studies.", 
    "editor": [
      {
        "familyName": "Chen", 
        "givenName": "Mei", 
        "type": "Person"
      }, 
      {
        "familyName": "Leibe", 
        "givenName": "Bastian", 
        "type": "Person"
      }, 
      {
        "familyName": "Neumann", 
        "givenName": "Bernd", 
        "type": "Person"
      }
    ], 
    "genre": "chapter", 
    "id": "sg:pub.10.1007/978-3-642-39402-7_7", 
    "inLanguage": "en", 
    "isAccessibleForFree": false, 
    "isPartOf": {
      "isbn": [
        "978-3-642-39401-0", 
        "978-3-642-39402-7"
      ], 
      "name": "Computer Vision Systems", 
      "type": "Book"
    }, 
    "keywords": [
      "vision system", 
      "human attention", 
      "computer vision system", 
      "acquired 3D model", 
      "usability engineering", 
      "semantic mapping", 
      "view frustum", 
      "gaze pointer", 
      "human factors", 
      "Google Glass", 
      "matching methodology", 
      "key contribution", 
      "pervasive mapping", 
      "RGB", 
      "SLAM", 
      "methodology", 
      "annotation", 
      "attention studies", 
      "pointers", 
      "system", 
      "mapping", 
      "new potential", 
      "ROI", 
      "processing", 
      "frame", 
      "engineering", 
      "model", 
      "ergonomics", 
      "modeling", 
      "advent", 
      "frustum", 
      "today", 
      "attention", 
      "monitoring", 
      "work", 
      "localization", 
      "fact", 
      "contribution", 
      "humans", 
      "decades", 
      "new avenues", 
      "interaction studies", 
      "avenues", 
      "recovery", 
      "potential", 
      "study", 
      "measurements", 
      "factors", 
      "glass", 
      "multi-component vision system", 
      "full 3D recovery", 
      "human view frustum", 
      "descriptor matching methodologies", 
      "annotation of ROIs"
    ], 
    "name": "FACTS - A Computer Vision System for 3D Recovery and Semantic Mapping of Human Factors", 
    "pagination": "62-72", 
    "productId": [
      {
        "name": "dimensions_id", 
        "type": "PropertyValue", 
        "value": [
          "pub.1012740595"
        ]
      }, 
      {
        "name": "doi", 
        "type": "PropertyValue", 
        "value": [
          "10.1007/978-3-642-39402-7_7"
        ]
      }
    ], 
    "publisher": {
      "name": "Springer Nature", 
      "type": "Organisation"
    }, 
    "sameAs": [
      "https://doi.org/10.1007/978-3-642-39402-7_7", 
      "https://app.dimensions.ai/details/publication/pub.1012740595"
    ], 
    "sdDataset": "chapters", 
    "sdDatePublished": "2022-01-01T19:27", 
    "sdLicense": "https://scigraph.springernature.com/explorer/license/", 
    "sdPublisher": {
      "name": "Springer Nature - SN SciGraph project", 
      "type": "Organization"
    }, 
    "sdSource": "s3://com-springernature-scigraph/baseset/20220101/entities/gbq_results/chapter/chapter_82.jsonl", 
    "type": "Chapter", 
    "url": "https://doi.org/10.1007/978-3-642-39402-7_7"
  }
]
 

Download the RDF metadata as:  json-ld nt turtle xml License info

HOW TO GET THIS DATA PROGRAMMATICALLY:

JSON-LD is a popular format for linked data which is fully compatible with JSON.

curl -H 'Accept: application/ld+json' 'https://scigraph.springernature.com/pub.10.1007/978-3-642-39402-7_7'

N-Triples is a line-based linked data format ideal for batch operations.

curl -H 'Accept: application/n-triples' 'https://scigraph.springernature.com/pub.10.1007/978-3-642-39402-7_7'

Turtle is a human-readable linked data format.

curl -H 'Accept: text/turtle' 'https://scigraph.springernature.com/pub.10.1007/978-3-642-39402-7_7'

RDF/XML is a standard XML format for linked data.

curl -H 'Accept: application/rdf+xml' 'https://scigraph.springernature.com/pub.10.1007/978-3-642-39402-7_7'


 

This table displays all metadata directly associated to this object as RDF triples.

174 TRIPLES      23 PREDICATES      82 URIs      73 LITERALS      7 BLANK NODES

Subject Predicate Object
1 sg:pub.10.1007/978-3-642-39402-7_7 schema:about anzsrc-for:08
2 anzsrc-for:0801
3 anzsrc-for:17
4 anzsrc-for:1701
5 schema:author Ne685ced6edc44d07880700b3f778c30a
6 schema:datePublished 2013
7 schema:datePublishedReg 2013-01-01
8 schema:description The study of human attention in the frame of interaction studies has been relevant for usability engineering and ergonomics for decades. Today, with the advent of wearable eye-tracking and Google glasses, monitoring of human attention will soon become ubiquitous. This work describes a multi-component vision system that enables pervasive mapping of human attention. The key contribution is that our methodology enables full 3D recovery of the gaze pointer, human view frustum and associated human centered measurements directly into an automatically computed 3D model. We apply RGB-D SLAM and descriptor matching methodologies for the 3D modeling, localization and fully automated annotation of ROIs (regions of interest) within the acquired 3D model. This methodology brings new potential into automated processing of human factors, opening new avenues for attention studies.
9 schema:editor N8c531504e9c048fe997c39b6f953f2c9
10 schema:genre chapter
11 schema:inLanguage en
12 schema:isAccessibleForFree false
13 schema:isPartOf N9ced3c62dfde4d70b7d17bf207062ee8
14 schema:keywords Google Glass
15 RGB
16 ROI
17 SLAM
18 acquired 3D model
19 advent
20 annotation
21 annotation of ROIs
22 attention
23 attention studies
24 avenues
25 computer vision system
26 contribution
27 decades
28 descriptor matching methodologies
29 engineering
30 ergonomics
31 fact
32 factors
33 frame
34 frustum
35 full 3D recovery
36 gaze pointer
37 glass
38 human attention
39 human factors
40 human view frustum
41 humans
42 interaction studies
43 key contribution
44 localization
45 mapping
46 matching methodology
47 measurements
48 methodology
49 model
50 modeling
51 monitoring
52 multi-component vision system
53 new avenues
54 new potential
55 pervasive mapping
56 pointers
57 potential
58 processing
59 recovery
60 semantic mapping
61 study
62 system
63 today
64 usability engineering
65 view frustum
66 vision system
67 work
68 schema:name FACTS - A Computer Vision System for 3D Recovery and Semantic Mapping of Human Factors
69 schema:pagination 62-72
70 schema:productId N3b3c546f288747dbaae19230a1d9b8a9
71 N45f658398b6541cca7270bf88f317183
72 schema:publisher N8997bb2a40074ab99b92b4b7b3f53fcc
73 schema:sameAs https://app.dimensions.ai/details/publication/pub.1012740595
74 https://doi.org/10.1007/978-3-642-39402-7_7
75 schema:sdDatePublished 2022-01-01T19:27
76 schema:sdLicense https://scigraph.springernature.com/explorer/license/
77 schema:sdPublisher N92716e627e6f413ab76d2968ebfe97ed
78 schema:url https://doi.org/10.1007/978-3-642-39402-7_7
79 sgo:license sg:explorer/license/
80 sgo:sdDataset chapters
81 rdf:type schema:Chapter
82 N0cdd46a328054dcd863daedb146b22a0 rdf:first sg:person.011015636117.31
83 rdf:rest N2fc3045bded4448c82322a7795ce0d1d
84 N0f92cc03ab4c4923bfc7fbd1b7cfab9f schema:familyName Neumann
85 schema:givenName Bernd
86 rdf:type schema:Person
87 N1496990c3b494f43bf035e010a70f83c rdf:first sg:person.014226756747.64
88 rdf:rest N6f6603844cf243348aaaf2acc0197baf
89 N2fc3045bded4448c82322a7795ce0d1d rdf:first sg:person.014457171455.12
90 rdf:rest N380d2c8cc5024ec9be3491907be5dfc7
91 N380d2c8cc5024ec9be3491907be5dfc7 rdf:first sg:person.016350640035.16
92 rdf:rest N1496990c3b494f43bf035e010a70f83c
93 N3b3c546f288747dbaae19230a1d9b8a9 schema:name dimensions_id
94 schema:value pub.1012740595
95 rdf:type schema:PropertyValue
96 N3c8871089c4744c18e014c7ce84b2ce1 schema:familyName Leibe
97 schema:givenName Bastian
98 rdf:type schema:Person
99 N45f658398b6541cca7270bf88f317183 schema:name doi
100 schema:value 10.1007/978-3-642-39402-7_7
101 rdf:type schema:PropertyValue
102 N48d2de29d70349b69e4fa22c7ad02272 rdf:first sg:person.015513127441.33
103 rdf:rest N0cdd46a328054dcd863daedb146b22a0
104 N6e8cd1a5253d4007b190faf2f28f4471 rdf:first N3c8871089c4744c18e014c7ce84b2ce1
105 rdf:rest Nda6235bbf3cb4eb2ba11a68fcb966016
106 N6f6603844cf243348aaaf2acc0197baf rdf:first sg:person.012101323701.00
107 rdf:rest rdf:nil
108 N8997bb2a40074ab99b92b4b7b3f53fcc schema:name Springer Nature
109 rdf:type schema:Organisation
110 N8c531504e9c048fe997c39b6f953f2c9 rdf:first Nf7691cc1c5014f2b9b15c1f077dd2f06
111 rdf:rest N6e8cd1a5253d4007b190faf2f28f4471
112 N92716e627e6f413ab76d2968ebfe97ed schema:name Springer Nature - SN SciGraph project
113 rdf:type schema:Organization
114 N9ced3c62dfde4d70b7d17bf207062ee8 schema:isbn 978-3-642-39401-0
115 978-3-642-39402-7
116 schema:name Computer Vision Systems
117 rdf:type schema:Book
118 Nda6235bbf3cb4eb2ba11a68fcb966016 rdf:first N0f92cc03ab4c4923bfc7fbd1b7cfab9f
119 rdf:rest rdf:nil
120 Ne685ced6edc44d07880700b3f778c30a rdf:first sg:person.010060055125.29
121 rdf:rest N48d2de29d70349b69e4fa22c7ad02272
122 Nf7691cc1c5014f2b9b15c1f077dd2f06 schema:familyName Chen
123 schema:givenName Mei
124 rdf:type schema:Person
125 anzsrc-for:08 schema:inDefinedTermSet anzsrc-for:
126 schema:name Information and Computing Sciences
127 rdf:type schema:DefinedTerm
128 anzsrc-for:0801 schema:inDefinedTermSet anzsrc-for:
129 schema:name Artificial Intelligence and Image Processing
130 rdf:type schema:DefinedTerm
131 anzsrc-for:17 schema:inDefinedTermSet anzsrc-for:
132 schema:name Psychology and Cognitive Sciences
133 rdf:type schema:DefinedTerm
134 anzsrc-for:1701 schema:inDefinedTermSet anzsrc-for:
135 schema:name Psychology
136 rdf:type schema:DefinedTerm
137 sg:person.010060055125.29 schema:affiliation grid-institutes:grid.8684.2
138 schema:familyName Paletta
139 schema:givenName Lucas
140 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010060055125.29
141 rdf:type schema:Person
142 sg:person.011015636117.31 schema:affiliation grid-institutes:grid.8684.2
143 schema:familyName Fritz
144 schema:givenName Gerald
145 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.011015636117.31
146 rdf:type schema:Person
147 sg:person.012101323701.00 schema:affiliation grid-institutes:grid.8684.2
148 schema:familyName Mayer
149 schema:givenName Heinz
150 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.012101323701.00
151 rdf:type schema:Person
152 sg:person.014226756747.64 schema:affiliation grid-institutes:grid.8684.2
153 schema:familyName Thallinger
154 schema:givenName Georg
155 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.014226756747.64
156 rdf:type schema:Person
157 sg:person.014457171455.12 schema:affiliation grid-institutes:grid.8684.2
158 schema:familyName Hofmann
159 schema:givenName Albert
160 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.014457171455.12
161 rdf:type schema:Person
162 sg:person.015513127441.33 schema:affiliation grid-institutes:grid.8684.2
163 schema:familyName Santner
164 schema:givenName Katrin
165 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.015513127441.33
166 rdf:type schema:Person
167 sg:person.016350640035.16 schema:affiliation grid-institutes:grid.8684.2
168 schema:familyName Lodron
169 schema:givenName Gerald
170 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.016350640035.16
171 rdf:type schema:Person
172 grid-institutes:grid.8684.2 schema:alternateName JOANNEUM RESEARCH Forschungsgesellschaft mbH, DIGITAL - Institute for Information and Communication Technologies, Steyrergasse 17, 8010, Graz, Austria
173 schema:name JOANNEUM RESEARCH Forschungsgesellschaft mbH, DIGITAL - Institute for Information and Communication Technologies, Steyrergasse 17, 8010, Graz, Austria
174 rdf:type schema:Organization
 




Preview window. Press ESC to close (or click here)


...