Intelligent perception and control for space robotics View Full Text


Ontology type: schema:ScholarlyArticle     


Article Info

DATE

2007-06-26

AUTHORS

Faisal Qureshi, Demetri Terzopoulos

ABSTRACT

We present a space robotic system capable of capturing a free-flying satellite for the purposes of on-orbit satellite servicing. Currently such operations are carried out either manually or through discrete-event scripted controllers. The manual approach is costly and exposes astronauts to danger, while the scripted approach is tedious and brittle. Consequently, there is substantial interest in performing these operations autonomously, and the work presented here is a step in this direction. To our knowledge, ours is the only satellite-capturing system that relies on vision and cognition to deal with an uncooperative satellite. Our innovative system combines visual perception (object identification, recognition, and tracking) with high-level reasoning in a hybrid deliberative/reactive computational framework. The reasoning module, which encodes a model of the environment, performs deliberation to control the perception pipeline—it guides the vision system, validates its performance, and suggests corrections when vision is performing poorly. Furthermore, it advises the behavioral controller to carry out its tasks. Reasoning and related elements, among them intention, context, and memory, are responsible for the robustness and reliability of the overall system. We demonstrate our prototype system controlling a robotic arm that autonomously captures a free-flying satellite in a realistic laboratory setting that faithfully mimics on-orbit conditions. More... »

PAGES

141-161

References to SciGraph publications

  • 2003. Behavioral Knowledge Representation for the Understanding and Creation of Video Sequences in KI 2003: ADVANCES IN ARTIFICIAL INTELLIGENCE
  • 1998-03. Cost-benefit analysis of on-orbit satellite servicing in JOURNAL OF REDUCING SPACE MISSION COST
  • 1988-01. A ‘complexity level’ analysis of immediate vision in INTERNATIONAL JOURNAL OF COMPUTER VISION
  • Identifiers

    URI

    http://scigraph.springernature.com/pub.10.1007/s00138-007-0085-z

    DOI

    http://dx.doi.org/10.1007/s00138-007-0085-z

    DIMENSIONS

    https://app.dimensions.ai/details/publication/pub.1052391877


    Indexing Status Check whether this publication has been indexed by Scopus and Web Of Science using the SN Indexing Status Tool
    Incoming Citations Browse incoming citations for this publication using opencitations.net

    JSON-LD is the canonical representation for SciGraph data.

    TIP: You can open this SciGraph record using an external JSON-LD service: JSON-LD Playground Google SDTT

    [
      {
        "@context": "https://springernature.github.io/scigraph/jsonld/sgcontext.json", 
        "about": [
          {
            "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/08", 
            "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
            "name": "Information and Computing Sciences", 
            "type": "DefinedTerm"
          }, 
          {
            "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/17", 
            "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
            "name": "Psychology and Cognitive Sciences", 
            "type": "DefinedTerm"
          }, 
          {
            "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/0801", 
            "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
            "name": "Artificial Intelligence and Image Processing", 
            "type": "DefinedTerm"
          }, 
          {
            "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/1701", 
            "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
            "name": "Psychology", 
            "type": "DefinedTerm"
          }
        ], 
        "author": [
          {
            "affiliation": {
              "alternateName": "Department of Computer Science, University of Toronto, 10 Kings College Road, Room 3304, M5S-3G4, Toronto, ON, Canada", 
              "id": "http://www.grid.ac/institutes/grid.17063.33", 
              "name": [
                "Department of Computer Science, University of Toronto, 10 Kings College Road, Room 3304, M5S-3G4, Toronto, ON, Canada"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Qureshi", 
            "givenName": "Faisal", 
            "id": "sg:person.0705765137.05", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.0705765137.05"
            ], 
            "type": "Person"
          }, 
          {
            "affiliation": {
              "alternateName": "Computer Science Department, University of California, Los Angeles, 4732 Boelter Hall, 90095-1596, Los Angeles, CA, USA", 
              "id": "http://www.grid.ac/institutes/grid.19006.3e", 
              "name": [
                "Computer Science Department, University of California, Los Angeles, 4732 Boelter Hall, 90095-1596, Los Angeles, CA, USA"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Terzopoulos", 
            "givenName": "Demetri", 
            "id": "sg:person.016347323445.35", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.016347323445.35"
            ], 
            "type": "Person"
          }
        ], 
        "citation": [
          {
            "id": "sg:pub.10.1023/a:1009955909481", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1039749156", 
              "https://doi.org/10.1023/a:1009955909481"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/bf00133569", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1038500604", 
              "https://doi.org/10.1007/bf00133569"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/978-3-540-39451-8_12", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1034214233", 
              "https://doi.org/10.1007/978-3-540-39451-8_12"
            ], 
            "type": "CreativeWork"
          }
        ], 
        "datePublished": "2007-06-26", 
        "datePublishedReg": "2007-06-26", 
        "description": "We present a space robotic system capable of capturing a free-flying satellite for the purposes of on-orbit satellite servicing. Currently such operations are carried out either manually or through discrete-event scripted controllers. The manual approach is costly and exposes astronauts to danger, while the scripted approach is tedious and brittle. Consequently, there is substantial interest in performing these operations autonomously, and the work presented here is a step in this direction. To our knowledge, ours is the only satellite-capturing system that relies on vision and cognition to deal with an uncooperative satellite. Our innovative system combines visual perception (object identification, recognition, and tracking) with high-level reasoning in a hybrid deliberative/reactive computational framework. The reasoning module, which encodes a model of the environment, performs deliberation to control the perception pipeline\u2014it guides the vision system, validates its performance, and suggests corrections when vision is performing poorly. Furthermore, it advises the behavioral controller to carry out its tasks. Reasoning and related elements, among them intention, context, and memory, are responsible for the robustness and reliability of the overall system. We demonstrate our prototype system controlling a robotic arm that autonomously captures a free-flying satellite in a realistic laboratory setting that faithfully mimics on-orbit conditions.", 
        "genre": "article", 
        "id": "sg:pub.10.1007/s00138-007-0085-z", 
        "inLanguage": "en", 
        "isAccessibleForFree": false, 
        "isPartOf": [
          {
            "id": "sg:journal.1045266", 
            "issn": [
              "0932-8092", 
              "1432-1769"
            ], 
            "name": "Machine Vision and Applications", 
            "publisher": "Springer Nature", 
            "type": "Periodical"
          }, 
          {
            "issueNumber": "3", 
            "type": "PublicationIssue"
          }, 
          {
            "type": "PublicationVolume", 
            "volumeNumber": "19"
          }
        ], 
        "keywords": [
          "high-level reasoning", 
          "space robotic system", 
          "orbit satellite servicing", 
          "perception pipeline", 
          "intelligent perception", 
          "visual perception", 
          "vision system", 
          "behavioral controllers", 
          "space robotics", 
          "robotic system", 
          "prototype system", 
          "robotic arm", 
          "satellite servicing", 
          "manual approach", 
          "computational framework", 
          "overall system", 
          "laboratory setting", 
          "perception", 
          "such operations", 
          "orbit conditions", 
          "innovative system", 
          "controller", 
          "vision", 
          "cognition", 
          "robotics", 
          "satellite", 
          "memory", 
          "system", 
          "task", 
          "reasoning", 
          "intention", 
          "operation", 
          "robustness", 
          "module", 
          "framework", 
          "pipeline", 
          "servicing", 
          "environment", 
          "related elements", 
          "context", 
          "performance", 
          "substantial interest", 
          "reliability", 
          "deliberation", 
          "danger", 
          "astronauts", 
          "knowledge", 
          "work", 
          "step", 
          "setting", 
          "model", 
          "direction", 
          "approach", 
          "conditions", 
          "interest", 
          "purpose", 
          "elements", 
          "control", 
          "arm", 
          "correction", 
          "mimics", 
          "only satellite-capturing system", 
          "satellite-capturing system", 
          "uncooperative satellite", 
          "reactive computational framework", 
          "realistic laboratory setting"
        ], 
        "name": "Intelligent perception and control for space robotics", 
        "pagination": "141-161", 
        "productId": [
          {
            "name": "dimensions_id", 
            "type": "PropertyValue", 
            "value": [
              "pub.1052391877"
            ]
          }, 
          {
            "name": "doi", 
            "type": "PropertyValue", 
            "value": [
              "10.1007/s00138-007-0085-z"
            ]
          }
        ], 
        "sameAs": [
          "https://doi.org/10.1007/s00138-007-0085-z", 
          "https://app.dimensions.ai/details/publication/pub.1052391877"
        ], 
        "sdDataset": "articles", 
        "sdDatePublished": "2022-01-01T18:16", 
        "sdLicense": "https://scigraph.springernature.com/explorer/license/", 
        "sdPublisher": {
          "name": "Springer Nature - SN SciGraph project", 
          "type": "Organization"
        }, 
        "sdSource": "s3://com-springernature-scigraph/baseset/20220101/entities/gbq_results/article/article_433.jsonl", 
        "type": "ScholarlyArticle", 
        "url": "https://doi.org/10.1007/s00138-007-0085-z"
      }
    ]
     

    Download the RDF metadata as:  json-ld nt turtle xml License info

    HOW TO GET THIS DATA PROGRAMMATICALLY:

    JSON-LD is a popular format for linked data which is fully compatible with JSON.

    curl -H 'Accept: application/ld+json' 'https://scigraph.springernature.com/pub.10.1007/s00138-007-0085-z'

    N-Triples is a line-based linked data format ideal for batch operations.

    curl -H 'Accept: application/n-triples' 'https://scigraph.springernature.com/pub.10.1007/s00138-007-0085-z'

    Turtle is a human-readable linked data format.

    curl -H 'Accept: text/turtle' 'https://scigraph.springernature.com/pub.10.1007/s00138-007-0085-z'

    RDF/XML is a standard XML format for linked data.

    curl -H 'Accept: application/rdf+xml' 'https://scigraph.springernature.com/pub.10.1007/s00138-007-0085-z'


     

    This table displays all metadata directly associated to this object as RDF triples.

    154 TRIPLES      22 PREDICATES      96 URIs      83 LITERALS      6 BLANK NODES

    Subject Predicate Object
    1 sg:pub.10.1007/s00138-007-0085-z schema:about anzsrc-for:08
    2 anzsrc-for:0801
    3 anzsrc-for:17
    4 anzsrc-for:1701
    5 schema:author N232670f0283f47dc9ea7599d33bfac72
    6 schema:citation sg:pub.10.1007/978-3-540-39451-8_12
    7 sg:pub.10.1007/bf00133569
    8 sg:pub.10.1023/a:1009955909481
    9 schema:datePublished 2007-06-26
    10 schema:datePublishedReg 2007-06-26
    11 schema:description We present a space robotic system capable of capturing a free-flying satellite for the purposes of on-orbit satellite servicing. Currently such operations are carried out either manually or through discrete-event scripted controllers. The manual approach is costly and exposes astronauts to danger, while the scripted approach is tedious and brittle. Consequently, there is substantial interest in performing these operations autonomously, and the work presented here is a step in this direction. To our knowledge, ours is the only satellite-capturing system that relies on vision and cognition to deal with an uncooperative satellite. Our innovative system combines visual perception (object identification, recognition, and tracking) with high-level reasoning in a hybrid deliberative/reactive computational framework. The reasoning module, which encodes a model of the environment, performs deliberation to control the perception pipeline—it guides the vision system, validates its performance, and suggests corrections when vision is performing poorly. Furthermore, it advises the behavioral controller to carry out its tasks. Reasoning and related elements, among them intention, context, and memory, are responsible for the robustness and reliability of the overall system. We demonstrate our prototype system controlling a robotic arm that autonomously captures a free-flying satellite in a realistic laboratory setting that faithfully mimics on-orbit conditions.
    12 schema:genre article
    13 schema:inLanguage en
    14 schema:isAccessibleForFree false
    15 schema:isPartOf N16201dab700647ee8f38af6d1b078dad
    16 Na5d1d183786940cba776903fcd17fc76
    17 sg:journal.1045266
    18 schema:keywords approach
    19 arm
    20 astronauts
    21 behavioral controllers
    22 cognition
    23 computational framework
    24 conditions
    25 context
    26 control
    27 controller
    28 correction
    29 danger
    30 deliberation
    31 direction
    32 elements
    33 environment
    34 framework
    35 high-level reasoning
    36 innovative system
    37 intelligent perception
    38 intention
    39 interest
    40 knowledge
    41 laboratory setting
    42 manual approach
    43 memory
    44 mimics
    45 model
    46 module
    47 only satellite-capturing system
    48 operation
    49 orbit conditions
    50 orbit satellite servicing
    51 overall system
    52 perception
    53 perception pipeline
    54 performance
    55 pipeline
    56 prototype system
    57 purpose
    58 reactive computational framework
    59 realistic laboratory setting
    60 reasoning
    61 related elements
    62 reliability
    63 robotic arm
    64 robotic system
    65 robotics
    66 robustness
    67 satellite
    68 satellite servicing
    69 satellite-capturing system
    70 servicing
    71 setting
    72 space robotic system
    73 space robotics
    74 step
    75 substantial interest
    76 such operations
    77 system
    78 task
    79 uncooperative satellite
    80 vision
    81 vision system
    82 visual perception
    83 work
    84 schema:name Intelligent perception and control for space robotics
    85 schema:pagination 141-161
    86 schema:productId N44db6153434c4b2e9252c942676cc1e9
    87 Naac01c4ccfce410194191649fb554b83
    88 schema:sameAs https://app.dimensions.ai/details/publication/pub.1052391877
    89 https://doi.org/10.1007/s00138-007-0085-z
    90 schema:sdDatePublished 2022-01-01T18:16
    91 schema:sdLicense https://scigraph.springernature.com/explorer/license/
    92 schema:sdPublisher Na8f6d7ee9ed6441abcf8aacda88b9f20
    93 schema:url https://doi.org/10.1007/s00138-007-0085-z
    94 sgo:license sg:explorer/license/
    95 sgo:sdDataset articles
    96 rdf:type schema:ScholarlyArticle
    97 N16201dab700647ee8f38af6d1b078dad schema:volumeNumber 19
    98 rdf:type schema:PublicationVolume
    99 N232670f0283f47dc9ea7599d33bfac72 rdf:first sg:person.0705765137.05
    100 rdf:rest N2339cd9710a6402ba6107aa8a6f05863
    101 N2339cd9710a6402ba6107aa8a6f05863 rdf:first sg:person.016347323445.35
    102 rdf:rest rdf:nil
    103 N44db6153434c4b2e9252c942676cc1e9 schema:name doi
    104 schema:value 10.1007/s00138-007-0085-z
    105 rdf:type schema:PropertyValue
    106 Na5d1d183786940cba776903fcd17fc76 schema:issueNumber 3
    107 rdf:type schema:PublicationIssue
    108 Na8f6d7ee9ed6441abcf8aacda88b9f20 schema:name Springer Nature - SN SciGraph project
    109 rdf:type schema:Organization
    110 Naac01c4ccfce410194191649fb554b83 schema:name dimensions_id
    111 schema:value pub.1052391877
    112 rdf:type schema:PropertyValue
    113 anzsrc-for:08 schema:inDefinedTermSet anzsrc-for:
    114 schema:name Information and Computing Sciences
    115 rdf:type schema:DefinedTerm
    116 anzsrc-for:0801 schema:inDefinedTermSet anzsrc-for:
    117 schema:name Artificial Intelligence and Image Processing
    118 rdf:type schema:DefinedTerm
    119 anzsrc-for:17 schema:inDefinedTermSet anzsrc-for:
    120 schema:name Psychology and Cognitive Sciences
    121 rdf:type schema:DefinedTerm
    122 anzsrc-for:1701 schema:inDefinedTermSet anzsrc-for:
    123 schema:name Psychology
    124 rdf:type schema:DefinedTerm
    125 sg:journal.1045266 schema:issn 0932-8092
    126 1432-1769
    127 schema:name Machine Vision and Applications
    128 schema:publisher Springer Nature
    129 rdf:type schema:Periodical
    130 sg:person.016347323445.35 schema:affiliation grid-institutes:grid.19006.3e
    131 schema:familyName Terzopoulos
    132 schema:givenName Demetri
    133 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.016347323445.35
    134 rdf:type schema:Person
    135 sg:person.0705765137.05 schema:affiliation grid-institutes:grid.17063.33
    136 schema:familyName Qureshi
    137 schema:givenName Faisal
    138 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.0705765137.05
    139 rdf:type schema:Person
    140 sg:pub.10.1007/978-3-540-39451-8_12 schema:sameAs https://app.dimensions.ai/details/publication/pub.1034214233
    141 https://doi.org/10.1007/978-3-540-39451-8_12
    142 rdf:type schema:CreativeWork
    143 sg:pub.10.1007/bf00133569 schema:sameAs https://app.dimensions.ai/details/publication/pub.1038500604
    144 https://doi.org/10.1007/bf00133569
    145 rdf:type schema:CreativeWork
    146 sg:pub.10.1023/a:1009955909481 schema:sameAs https://app.dimensions.ai/details/publication/pub.1039749156
    147 https://doi.org/10.1023/a:1009955909481
    148 rdf:type schema:CreativeWork
    149 grid-institutes:grid.17063.33 schema:alternateName Department of Computer Science, University of Toronto, 10 Kings College Road, Room 3304, M5S-3G4, Toronto, ON, Canada
    150 schema:name Department of Computer Science, University of Toronto, 10 Kings College Road, Room 3304, M5S-3G4, Toronto, ON, Canada
    151 rdf:type schema:Organization
    152 grid-institutes:grid.19006.3e schema:alternateName Computer Science Department, University of California, Los Angeles, 4732 Boelter Hall, 90095-1596, Los Angeles, CA, USA
    153 schema:name Computer Science Department, University of California, Los Angeles, 4732 Boelter Hall, 90095-1596, Los Angeles, CA, USA
    154 rdf:type schema:Organization
     




    Preview window. Press ESC to close (or click here)


    ...