On measuring the accuracy of SLAM algorithms View Full Text


Ontology type: schema:ScholarlyArticle      Open Access: True


Article Info

DATE

2009-09-30

AUTHORS

Rainer Kümmerle, Bastian Steder, Christian Dornhege, Michael Ruhnke, Giorgio Grisetti, Cyrill Stachniss, Alexander Kleiner

ABSTRACT

In this paper, we address the problem of creating an objective benchmark for evaluating SLAM approaches. We propose a framework for analyzing the results of a SLAM approach based on a metric for measuring the error of the corrected trajectory. This metric uses only relative relations between poses and does not rely on a global reference frame. This overcomes serious shortcomings of approaches using a global reference frame to compute the error. Our method furthermore allows us to compare SLAM approaches that use different estimation techniques or different sensor modalities since all computations are made based on the corrected trajectory of the robot.We provide sets of relative relations needed to compute our metric for an extensive set of datasets frequently used in the robotics community. The relations have been obtained by manually matching laser-range observations to avoid the errors caused by matching algorithms. Our benchmark framework allows the user to easily analyze and objectively compare different SLAM approaches. More... »

PAGES

387

References to SciGraph publications

Identifiers

URI

http://scigraph.springernature.com/pub.10.1007/s10514-009-9155-6

DOI

http://dx.doi.org/10.1007/s10514-009-9155-6

DIMENSIONS

https://app.dimensions.ai/details/publication/pub.1030710465


Indexing Status Check whether this publication has been indexed by Scopus and Web Of Science using the SN Indexing Status Tool
Incoming Citations Browse incoming citations for this publication using opencitations.net

JSON-LD is the canonical representation for SciGraph data.

TIP: You can open this SciGraph record using an external JSON-LD service: JSON-LD Playground Google SDTT

[
  {
    "@context": "https://springernature.github.io/scigraph/jsonld/sgcontext.json", 
    "about": [
      {
        "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/08", 
        "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
        "name": "Information and Computing Sciences", 
        "type": "DefinedTerm"
      }, 
      {
        "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/0801", 
        "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
        "name": "Artificial Intelligence and Image Processing", 
        "type": "DefinedTerm"
      }
    ], 
    "author": [
      {
        "affiliation": {
          "alternateName": "Dept. of Computer Science, University of Freiburg, Georges K\u00f6hler Allee 79, 79110, Freiburg, Germany", 
          "id": "http://www.grid.ac/institutes/grid.5963.9", 
          "name": [
            "Dept. of Computer Science, University of Freiburg, Georges K\u00f6hler Allee 79, 79110, Freiburg, Germany"
          ], 
          "type": "Organization"
        }, 
        "familyName": "K\u00fcmmerle", 
        "givenName": "Rainer", 
        "id": "sg:person.07760376421.22", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.07760376421.22"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "Dept. of Computer Science, University of Freiburg, Georges K\u00f6hler Allee 79, 79110, Freiburg, Germany", 
          "id": "http://www.grid.ac/institutes/grid.5963.9", 
          "name": [
            "Dept. of Computer Science, University of Freiburg, Georges K\u00f6hler Allee 79, 79110, Freiburg, Germany"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Steder", 
        "givenName": "Bastian", 
        "id": "sg:person.011353337421.52", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.011353337421.52"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "Dept. of Computer Science, University of Freiburg, Georges K\u00f6hler Allee 52, 79110, Freiburg, Germany", 
          "id": "http://www.grid.ac/institutes/grid.5963.9", 
          "name": [
            "Dept. of Computer Science, University of Freiburg, Georges K\u00f6hler Allee 52, 79110, Freiburg, Germany"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Dornhege", 
        "givenName": "Christian", 
        "id": "sg:person.012746300421.38", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.012746300421.38"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "Dept. of Computer Science, University of Freiburg, Georges K\u00f6hler Allee 79, 79110, Freiburg, Germany", 
          "id": "http://www.grid.ac/institutes/grid.5963.9", 
          "name": [
            "Dept. of Computer Science, University of Freiburg, Georges K\u00f6hler Allee 79, 79110, Freiburg, Germany"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Ruhnke", 
        "givenName": "Michael", 
        "id": "sg:person.014341241421.07", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.014341241421.07"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "Dept. of Computer Science, University of Freiburg, Georges K\u00f6hler Allee 79, 79110, Freiburg, Germany", 
          "id": "http://www.grid.ac/institutes/grid.5963.9", 
          "name": [
            "Dept. of Computer Science, University of Freiburg, Georges K\u00f6hler Allee 79, 79110, Freiburg, Germany"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Grisetti", 
        "givenName": "Giorgio", 
        "id": "sg:person.012500024215.02", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.012500024215.02"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "Dept. of Computer Science, University of Freiburg, Georges K\u00f6hler Allee 79, 79110, Freiburg, Germany", 
          "id": "http://www.grid.ac/institutes/grid.5963.9", 
          "name": [
            "Dept. of Computer Science, University of Freiburg, Georges K\u00f6hler Allee 79, 79110, Freiburg, Germany"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Stachniss", 
        "givenName": "Cyrill", 
        "id": "sg:person.015152144445.37", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.015152144445.37"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "Dept. of Computer Science, University of Freiburg, Georges K\u00f6hler Allee 52, 79110, Freiburg, Germany", 
          "id": "http://www.grid.ac/institutes/grid.5963.9", 
          "name": [
            "Dept. of Computer Science, University of Freiburg, Georges K\u00f6hler Allee 52, 79110, Freiburg, Germany"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Kleiner", 
        "givenName": "Alexander", 
        "id": "sg:person.010071616231.75", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010071616231.75"
        ], 
        "type": "Person"
      }
    ], 
    "citation": [
      {
        "id": "sg:pub.10.1023/a:1008854305733", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1025138015", 
          "https://doi.org/10.1023/a:1008854305733"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/s10514-006-9043-2", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1025700617", 
          "https://doi.org/10.1007/s10514-006-9043-2"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1023/b:visi.0000027787.82851.b6", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1028136757", 
          "https://doi.org/10.1023/b:visi.0000027787.82851.b6"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-1-4613-8997-2_14", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1038743430", 
          "https://doi.org/10.1007/978-1-4613-8997-2_14"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1023/a:1015269615729", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1017420141", 
          "https://doi.org/10.1023/a:1015269615729"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/11681120_15", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1035206758", 
          "https://doi.org/10.1007/11681120_15"
        ], 
        "type": "CreativeWork"
      }
    ], 
    "datePublished": "2009-09-30", 
    "datePublishedReg": "2009-09-30", 
    "description": "In this paper, we address the problem of creating an objective benchmark for evaluating SLAM approaches. We propose a framework for analyzing the results of a SLAM approach based on a metric for measuring the error of the corrected trajectory. This metric uses only relative relations between poses and does not rely on a global reference frame. This overcomes serious shortcomings of approaches using a global reference frame to compute the error. Our method furthermore allows us to compare SLAM approaches that use different estimation techniques or different sensor modalities since all computations are made based on the corrected trajectory of the robot.We provide sets of relative relations needed to compute our metric for an extensive set of datasets frequently used in the robotics community. The relations have been obtained by manually matching laser-range observations to avoid the errors caused by matching algorithms. Our benchmark framework allows the user to easily analyze and objectively compare different SLAM approaches.", 
    "genre": "article", 
    "id": "sg:pub.10.1007/s10514-009-9155-6", 
    "isAccessibleForFree": true, 
    "isPartOf": [
      {
        "id": "sg:journal.1031086", 
        "issn": [
          "0929-5593", 
          "1573-7527"
        ], 
        "name": "Autonomous Robots", 
        "publisher": "Springer Nature", 
        "type": "Periodical"
      }, 
      {
        "issueNumber": "4", 
        "type": "PublicationIssue"
      }, 
      {
        "type": "PublicationVolume", 
        "volumeNumber": "27"
      }
    ], 
    "keywords": [
      "SLAM approach", 
      "different SLAM approaches", 
      "different sensor modalities", 
      "global reference frame", 
      "robotics community", 
      "SLAM algorithm", 
      "sensor modalities", 
      "benchmark framework", 
      "relative relations", 
      "extensive set", 
      "algorithm", 
      "reference frame", 
      "metrics", 
      "estimation techniques", 
      "objective benchmark", 
      "framework", 
      "robot", 
      "users", 
      "pose", 
      "set", 
      "dataset", 
      "error", 
      "frame", 
      "computation", 
      "benchmarks", 
      "accuracy", 
      "different estimation techniques", 
      "shortcomings", 
      "serious shortcomings", 
      "technique", 
      "trajectories", 
      "method", 
      "laser range observations", 
      "community", 
      "results", 
      "modalities", 
      "relation", 
      "observations", 
      "approach", 
      "problem", 
      "paper"
    ], 
    "name": "On measuring the accuracy of SLAM algorithms", 
    "pagination": "387", 
    "productId": [
      {
        "name": "dimensions_id", 
        "type": "PropertyValue", 
        "value": [
          "pub.1030710465"
        ]
      }, 
      {
        "name": "doi", 
        "type": "PropertyValue", 
        "value": [
          "10.1007/s10514-009-9155-6"
        ]
      }
    ], 
    "sameAs": [
      "https://doi.org/10.1007/s10514-009-9155-6", 
      "https://app.dimensions.ai/details/publication/pub.1030710465"
    ], 
    "sdDataset": "articles", 
    "sdDatePublished": "2022-11-24T20:54", 
    "sdLicense": "https://scigraph.springernature.com/explorer/license/", 
    "sdPublisher": {
      "name": "Springer Nature - SN SciGraph project", 
      "type": "Organization"
    }, 
    "sdSource": "s3://com-springernature-scigraph/baseset/20221124/entities/gbq_results/article/article_494.jsonl", 
    "type": "ScholarlyArticle", 
    "url": "https://doi.org/10.1007/s10514-009-9155-6"
  }
]
 

Download the RDF metadata as:  json-ld nt turtle xml License info

HOW TO GET THIS DATA PROGRAMMATICALLY:

JSON-LD is a popular format for linked data which is fully compatible with JSON.

curl -H 'Accept: application/ld+json' 'https://scigraph.springernature.com/pub.10.1007/s10514-009-9155-6'

N-Triples is a line-based linked data format ideal for batch operations.

curl -H 'Accept: application/n-triples' 'https://scigraph.springernature.com/pub.10.1007/s10514-009-9155-6'

Turtle is a human-readable linked data format.

curl -H 'Accept: text/turtle' 'https://scigraph.springernature.com/pub.10.1007/s10514-009-9155-6'

RDF/XML is a standard XML format for linked data.

curl -H 'Accept: application/rdf+xml' 'https://scigraph.springernature.com/pub.10.1007/s10514-009-9155-6'


 

This table displays all metadata directly associated to this object as RDF triples.

166 TRIPLES      21 PREDICATES      71 URIs      57 LITERALS      6 BLANK NODES

Subject Predicate Object
1 sg:pub.10.1007/s10514-009-9155-6 schema:about anzsrc-for:08
2 anzsrc-for:0801
3 schema:author N918b5ecc6d454e27bd16a37f99f2b8a6
4 schema:citation sg:pub.10.1007/11681120_15
5 sg:pub.10.1007/978-1-4613-8997-2_14
6 sg:pub.10.1007/s10514-006-9043-2
7 sg:pub.10.1023/a:1008854305733
8 sg:pub.10.1023/a:1015269615729
9 sg:pub.10.1023/b:visi.0000027787.82851.b6
10 schema:datePublished 2009-09-30
11 schema:datePublishedReg 2009-09-30
12 schema:description In this paper, we address the problem of creating an objective benchmark for evaluating SLAM approaches. We propose a framework for analyzing the results of a SLAM approach based on a metric for measuring the error of the corrected trajectory. This metric uses only relative relations between poses and does not rely on a global reference frame. This overcomes serious shortcomings of approaches using a global reference frame to compute the error. Our method furthermore allows us to compare SLAM approaches that use different estimation techniques or different sensor modalities since all computations are made based on the corrected trajectory of the robot.We provide sets of relative relations needed to compute our metric for an extensive set of datasets frequently used in the robotics community. The relations have been obtained by manually matching laser-range observations to avoid the errors caused by matching algorithms. Our benchmark framework allows the user to easily analyze and objectively compare different SLAM approaches.
13 schema:genre article
14 schema:isAccessibleForFree true
15 schema:isPartOf N09a02380f4e941829d1850e6c62d0314
16 Nada367ee5b7045b89c97c93c5e7e9d9e
17 sg:journal.1031086
18 schema:keywords SLAM algorithm
19 SLAM approach
20 accuracy
21 algorithm
22 approach
23 benchmark framework
24 benchmarks
25 community
26 computation
27 dataset
28 different SLAM approaches
29 different estimation techniques
30 different sensor modalities
31 error
32 estimation techniques
33 extensive set
34 frame
35 framework
36 global reference frame
37 laser range observations
38 method
39 metrics
40 modalities
41 objective benchmark
42 observations
43 paper
44 pose
45 problem
46 reference frame
47 relation
48 relative relations
49 results
50 robot
51 robotics community
52 sensor modalities
53 serious shortcomings
54 set
55 shortcomings
56 technique
57 trajectories
58 users
59 schema:name On measuring the accuracy of SLAM algorithms
60 schema:pagination 387
61 schema:productId N1938f3a765b740ba9580a1a495dfd4d1
62 N68da09d8138441e2a7819d6acc488362
63 schema:sameAs https://app.dimensions.ai/details/publication/pub.1030710465
64 https://doi.org/10.1007/s10514-009-9155-6
65 schema:sdDatePublished 2022-11-24T20:54
66 schema:sdLicense https://scigraph.springernature.com/explorer/license/
67 schema:sdPublisher N1ba51aee064e41c5926fbf6b4846e6be
68 schema:url https://doi.org/10.1007/s10514-009-9155-6
69 sgo:license sg:explorer/license/
70 sgo:sdDataset articles
71 rdf:type schema:ScholarlyArticle
72 N07b0cac43d2f45d58195160a3f3f2c25 rdf:first sg:person.014341241421.07
73 rdf:rest Nb8a51119fe764bbeb78bd9cd9369df0f
74 N09a02380f4e941829d1850e6c62d0314 schema:volumeNumber 27
75 rdf:type schema:PublicationVolume
76 N18bb52c918b74654ae07c7e2225993d4 rdf:first sg:person.011353337421.52
77 rdf:rest N5fa354e1844a41ae9189ffc4de2c18a4
78 N1938f3a765b740ba9580a1a495dfd4d1 schema:name doi
79 schema:value 10.1007/s10514-009-9155-6
80 rdf:type schema:PropertyValue
81 N1ba51aee064e41c5926fbf6b4846e6be schema:name Springer Nature - SN SciGraph project
82 rdf:type schema:Organization
83 N1e30148565fd48a7b3ad10b425b81ad0 rdf:first sg:person.015152144445.37
84 rdf:rest N6da14abc723a444fbbd381d7dbca2283
85 N5fa354e1844a41ae9189ffc4de2c18a4 rdf:first sg:person.012746300421.38
86 rdf:rest N07b0cac43d2f45d58195160a3f3f2c25
87 N68da09d8138441e2a7819d6acc488362 schema:name dimensions_id
88 schema:value pub.1030710465
89 rdf:type schema:PropertyValue
90 N6da14abc723a444fbbd381d7dbca2283 rdf:first sg:person.010071616231.75
91 rdf:rest rdf:nil
92 N918b5ecc6d454e27bd16a37f99f2b8a6 rdf:first sg:person.07760376421.22
93 rdf:rest N18bb52c918b74654ae07c7e2225993d4
94 Nada367ee5b7045b89c97c93c5e7e9d9e schema:issueNumber 4
95 rdf:type schema:PublicationIssue
96 Nb8a51119fe764bbeb78bd9cd9369df0f rdf:first sg:person.012500024215.02
97 rdf:rest N1e30148565fd48a7b3ad10b425b81ad0
98 anzsrc-for:08 schema:inDefinedTermSet anzsrc-for:
99 schema:name Information and Computing Sciences
100 rdf:type schema:DefinedTerm
101 anzsrc-for:0801 schema:inDefinedTermSet anzsrc-for:
102 schema:name Artificial Intelligence and Image Processing
103 rdf:type schema:DefinedTerm
104 sg:journal.1031086 schema:issn 0929-5593
105 1573-7527
106 schema:name Autonomous Robots
107 schema:publisher Springer Nature
108 rdf:type schema:Periodical
109 sg:person.010071616231.75 schema:affiliation grid-institutes:grid.5963.9
110 schema:familyName Kleiner
111 schema:givenName Alexander
112 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010071616231.75
113 rdf:type schema:Person
114 sg:person.011353337421.52 schema:affiliation grid-institutes:grid.5963.9
115 schema:familyName Steder
116 schema:givenName Bastian
117 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.011353337421.52
118 rdf:type schema:Person
119 sg:person.012500024215.02 schema:affiliation grid-institutes:grid.5963.9
120 schema:familyName Grisetti
121 schema:givenName Giorgio
122 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.012500024215.02
123 rdf:type schema:Person
124 sg:person.012746300421.38 schema:affiliation grid-institutes:grid.5963.9
125 schema:familyName Dornhege
126 schema:givenName Christian
127 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.012746300421.38
128 rdf:type schema:Person
129 sg:person.014341241421.07 schema:affiliation grid-institutes:grid.5963.9
130 schema:familyName Ruhnke
131 schema:givenName Michael
132 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.014341241421.07
133 rdf:type schema:Person
134 sg:person.015152144445.37 schema:affiliation grid-institutes:grid.5963.9
135 schema:familyName Stachniss
136 schema:givenName Cyrill
137 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.015152144445.37
138 rdf:type schema:Person
139 sg:person.07760376421.22 schema:affiliation grid-institutes:grid.5963.9
140 schema:familyName Kümmerle
141 schema:givenName Rainer
142 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.07760376421.22
143 rdf:type schema:Person
144 sg:pub.10.1007/11681120_15 schema:sameAs https://app.dimensions.ai/details/publication/pub.1035206758
145 https://doi.org/10.1007/11681120_15
146 rdf:type schema:CreativeWork
147 sg:pub.10.1007/978-1-4613-8997-2_14 schema:sameAs https://app.dimensions.ai/details/publication/pub.1038743430
148 https://doi.org/10.1007/978-1-4613-8997-2_14
149 rdf:type schema:CreativeWork
150 sg:pub.10.1007/s10514-006-9043-2 schema:sameAs https://app.dimensions.ai/details/publication/pub.1025700617
151 https://doi.org/10.1007/s10514-006-9043-2
152 rdf:type schema:CreativeWork
153 sg:pub.10.1023/a:1008854305733 schema:sameAs https://app.dimensions.ai/details/publication/pub.1025138015
154 https://doi.org/10.1023/a:1008854305733
155 rdf:type schema:CreativeWork
156 sg:pub.10.1023/a:1015269615729 schema:sameAs https://app.dimensions.ai/details/publication/pub.1017420141
157 https://doi.org/10.1023/a:1015269615729
158 rdf:type schema:CreativeWork
159 sg:pub.10.1023/b:visi.0000027787.82851.b6 schema:sameAs https://app.dimensions.ai/details/publication/pub.1028136757
160 https://doi.org/10.1023/b:visi.0000027787.82851.b6
161 rdf:type schema:CreativeWork
162 grid-institutes:grid.5963.9 schema:alternateName Dept. of Computer Science, University of Freiburg, Georges Köhler Allee 52, 79110, Freiburg, Germany
163 Dept. of Computer Science, University of Freiburg, Georges Köhler Allee 79, 79110, Freiburg, Germany
164 schema:name Dept. of Computer Science, University of Freiburg, Georges Köhler Allee 52, 79110, Freiburg, Germany
165 Dept. of Computer Science, University of Freiburg, Georges Köhler Allee 79, 79110, Freiburg, Germany
166 rdf:type schema:Organization
 




Preview window. Press ESC to close (or click here)


...