Reinforcement Learning of Intelligent Characters in Fighting Action Games View Full Text


Ontology type: schema:Chapter     


Chapter Info

DATE

2006

AUTHORS

Byeong Heon Cho , Sung Hoon Jung , Kwang-Hyun Shim , Yeong Rak Seong , Ha Ryoung Oh

ABSTRACT

In this paper, we investigate reinforcement learning (RL) of intelligent characters, based on neural network technology, for fighting action games. RL can be either on-policy or off-policy. We apply both schemes to tabula rasa learning and adaptation. The experimental results show that (1) in tabula rasa leaning, off-policy RL outperforms on-policy RL, but (2) in adaptation, on-policy RL outperforms off-policy RL. More... »

PAGES

310-313

References to SciGraph publications

  • 2005. Adaptation of Intelligent Characters to Changes of Game Environments in COMPUTATIONAL INTELLIGENCE AND SECURITY
  • Book

    TITLE

    Entertainment Computing - ICEC 2006

    ISBN

    978-3-540-45259-1
    978-3-540-45261-4

    Identifiers

    URI

    http://scigraph.springernature.com/pub.10.1007/11872320_39

    DOI

    http://dx.doi.org/10.1007/11872320_39

    DIMENSIONS

    https://app.dimensions.ai/details/publication/pub.1039311893


    Indexing Status Check whether this publication has been indexed by Scopus and Web Of Science using the SN Indexing Status Tool
    Incoming Citations Browse incoming citations for this publication using opencitations.net

    JSON-LD is the canonical representation for SciGraph data.

    TIP: You can open this SciGraph record using an external JSON-LD service: JSON-LD Playground Google SDTT

    [
      {
        "@context": "https://springernature.github.io/scigraph/jsonld/sgcontext.json", 
        "about": [
          {
            "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/1605", 
            "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
            "name": "Policy and Administration", 
            "type": "DefinedTerm"
          }, 
          {
            "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/16", 
            "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
            "name": "Studies in Human Society", 
            "type": "DefinedTerm"
          }
        ], 
        "author": [
          {
            "affiliation": {
              "alternateName": "Electronics and Telecommunications Research Institute", 
              "id": "https://www.grid.ac/institutes/grid.36303.35", 
              "name": [
                "Digital Content Research Division, ETRI, Daejeon, 305-700, Korea"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Cho", 
            "givenName": "Byeong Heon", 
            "id": "sg:person.015226474461.83", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.015226474461.83"
            ], 
            "type": "Person"
          }, 
          {
            "affiliation": {
              "alternateName": "Hansung University", 
              "id": "https://www.grid.ac/institutes/grid.444079.a", 
              "name": [
                "Dept. of Information and Comm. Eng., Hansung Univ., Seoul, 136-792, Korea"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Jung", 
            "givenName": "Sung Hoon", 
            "id": "sg:person.014511727413.21", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.014511727413.21"
            ], 
            "type": "Person"
          }, 
          {
            "affiliation": {
              "alternateName": "Electronics and Telecommunications Research Institute", 
              "id": "https://www.grid.ac/institutes/grid.36303.35", 
              "name": [
                "Digital Content Research Division, ETRI, Daejeon, 305-700, Korea"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Shim", 
            "givenName": "Kwang-Hyun", 
            "id": "sg:person.013476161137.06", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.013476161137.06"
            ], 
            "type": "Person"
          }, 
          {
            "affiliation": {
              "alternateName": "Kookmin University", 
              "id": "https://www.grid.ac/institutes/grid.91443.3b", 
              "name": [
                "School of Electrical Engineering, Kookmin Univ., Seoul, 136-702, Korea"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Seong", 
            "givenName": "Yeong Rak", 
            "id": "sg:person.014111450133.04", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.014111450133.04"
            ], 
            "type": "Person"
          }, 
          {
            "affiliation": {
              "alternateName": "Kookmin University", 
              "id": "https://www.grid.ac/institutes/grid.91443.3b", 
              "name": [
                "School of Electrical Engineering, Kookmin Univ., Seoul, 136-702, Korea"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Oh", 
            "givenName": "Ha Ryoung", 
            "id": "sg:person.011143172143.38", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.011143172143.38"
            ], 
            "type": "Person"
          }
        ], 
        "citation": [
          {
            "id": "sg:pub.10.1007/11596448_159", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1032424388", 
              "https://doi.org/10.1007/11596448_159"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/11596448_159", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1032424388", 
              "https://doi.org/10.1007/11596448_159"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1093/ietisy/e89-d.3.1249", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1059671877"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1109/massp.1987.1165576", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1061385413"
            ], 
            "type": "CreativeWork"
          }
        ], 
        "datePublished": "2006", 
        "datePublishedReg": "2006-01-01", 
        "description": "In this paper, we investigate reinforcement learning (RL) of intelligent characters, based on neural network technology, for fighting action games. RL can be either on-policy or off-policy. We apply both schemes to tabula rasa learning and adaptation. The experimental results show that (1) in tabula rasa leaning, off-policy RL outperforms on-policy RL, but (2) in adaptation, on-policy RL outperforms off-policy RL.", 
        "editor": [
          {
            "familyName": "Harper", 
            "givenName": "Richard", 
            "type": "Person"
          }, 
          {
            "familyName": "Rauterberg", 
            "givenName": "Matthias", 
            "type": "Person"
          }, 
          {
            "familyName": "Combetto", 
            "givenName": "Marco", 
            "type": "Person"
          }
        ], 
        "genre": "chapter", 
        "id": "sg:pub.10.1007/11872320_39", 
        "inLanguage": [
          "en"
        ], 
        "isAccessibleForFree": false, 
        "isPartOf": {
          "isbn": [
            "978-3-540-45259-1", 
            "978-3-540-45261-4"
          ], 
          "name": "Entertainment Computing - ICEC 2006", 
          "type": "Book"
        }, 
        "name": "Reinforcement Learning of Intelligent Characters in Fighting Action Games", 
        "pagination": "310-313", 
        "productId": [
          {
            "name": "doi", 
            "type": "PropertyValue", 
            "value": [
              "10.1007/11872320_39"
            ]
          }, 
          {
            "name": "readcube_id", 
            "type": "PropertyValue", 
            "value": [
              "bb42c9e82a94a38f98dcdd4c2510bdba455f65997122730f24c7b59a080f7f52"
            ]
          }, 
          {
            "name": "dimensions_id", 
            "type": "PropertyValue", 
            "value": [
              "pub.1039311893"
            ]
          }
        ], 
        "publisher": {
          "location": "Berlin, Heidelberg", 
          "name": "Springer Berlin Heidelberg", 
          "type": "Organisation"
        }, 
        "sameAs": [
          "https://doi.org/10.1007/11872320_39", 
          "https://app.dimensions.ai/details/publication/pub.1039311893"
        ], 
        "sdDataset": "chapters", 
        "sdDatePublished": "2019-04-15T13:29", 
        "sdLicense": "https://scigraph.springernature.com/explorer/license/", 
        "sdPublisher": {
          "name": "Springer Nature - SN SciGraph project", 
          "type": "Organization"
        }, 
        "sdSource": "s3://com-uberresearch-data-dimensions-target-20181106-alternative/cleanup/v134/2549eaecd7973599484d7c17b260dba0a4ecb94b/merge/v9/a6c9fde33151104705d4d7ff012ea9563521a3ce/jats-lookup/v90/0000000001_0000000264/records_8664_00000267.jsonl", 
        "type": "Chapter", 
        "url": "http://link.springer.com/10.1007/11872320_39"
      }
    ]
     

    Download the RDF metadata as:  json-ld nt turtle xml License info

    HOW TO GET THIS DATA PROGRAMMATICALLY:

    JSON-LD is a popular format for linked data which is fully compatible with JSON.

    curl -H 'Accept: application/ld+json' 'https://scigraph.springernature.com/pub.10.1007/11872320_39'

    N-Triples is a line-based linked data format ideal for batch operations.

    curl -H 'Accept: application/n-triples' 'https://scigraph.springernature.com/pub.10.1007/11872320_39'

    Turtle is a human-readable linked data format.

    curl -H 'Accept: text/turtle' 'https://scigraph.springernature.com/pub.10.1007/11872320_39'

    RDF/XML is a standard XML format for linked data.

    curl -H 'Accept: application/rdf+xml' 'https://scigraph.springernature.com/pub.10.1007/11872320_39'


     

    This table displays all metadata directly associated to this object as RDF triples.

    119 TRIPLES      23 PREDICATES      30 URIs      20 LITERALS      8 BLANK NODES

    Subject Predicate Object
    1 sg:pub.10.1007/11872320_39 schema:about anzsrc-for:16
    2 anzsrc-for:1605
    3 schema:author N364c40cff18243369bcfee7d6828d40c
    4 schema:citation sg:pub.10.1007/11596448_159
    5 https://doi.org/10.1093/ietisy/e89-d.3.1249
    6 https://doi.org/10.1109/massp.1987.1165576
    7 schema:datePublished 2006
    8 schema:datePublishedReg 2006-01-01
    9 schema:description In this paper, we investigate reinforcement learning (RL) of intelligent characters, based on neural network technology, for fighting action games. RL can be either on-policy or off-policy. We apply both schemes to tabula rasa learning and adaptation. The experimental results show that (1) in tabula rasa leaning, off-policy RL outperforms on-policy RL, but (2) in adaptation, on-policy RL outperforms off-policy RL.
    10 schema:editor Nd64f47e2df3d404e8c1d6725a41bb6f2
    11 schema:genre chapter
    12 schema:inLanguage en
    13 schema:isAccessibleForFree false
    14 schema:isPartOf N8ab21bbe53a848f3948a9d66563bc0a7
    15 schema:name Reinforcement Learning of Intelligent Characters in Fighting Action Games
    16 schema:pagination 310-313
    17 schema:productId N0af117f2967e4bcb9dfcec9533e73a0f
    18 N1f6ab937be3c4d40a2b65f8a06949cee
    19 N6c1f092f951e4fd387dbc3bcd35193d6
    20 schema:publisher Nf31d510252504a148e3bd83e20771510
    21 schema:sameAs https://app.dimensions.ai/details/publication/pub.1039311893
    22 https://doi.org/10.1007/11872320_39
    23 schema:sdDatePublished 2019-04-15T13:29
    24 schema:sdLicense https://scigraph.springernature.com/explorer/license/
    25 schema:sdPublisher Nfbd0f3a2688b4fa695956c53039a257e
    26 schema:url http://link.springer.com/10.1007/11872320_39
    27 sgo:license sg:explorer/license/
    28 sgo:sdDataset chapters
    29 rdf:type schema:Chapter
    30 N0af117f2967e4bcb9dfcec9533e73a0f schema:name doi
    31 schema:value 10.1007/11872320_39
    32 rdf:type schema:PropertyValue
    33 N0f0780e2bd724883a2ab39bd8adcfce8 schema:familyName Combetto
    34 schema:givenName Marco
    35 rdf:type schema:Person
    36 N1bf3ca269f534046b00807732f09cf55 rdf:first sg:person.013476161137.06
    37 rdf:rest Nc56824bf79664845967376fa477fa366
    38 N1f6ab937be3c4d40a2b65f8a06949cee schema:name readcube_id
    39 schema:value bb42c9e82a94a38f98dcdd4c2510bdba455f65997122730f24c7b59a080f7f52
    40 rdf:type schema:PropertyValue
    41 N364c40cff18243369bcfee7d6828d40c rdf:first sg:person.015226474461.83
    42 rdf:rest Necda7c8e030c4e61bf9cb230118a2384
    43 N3e91cb22fcb64f95a74e422bd6720709 schema:familyName Harper
    44 schema:givenName Richard
    45 rdf:type schema:Person
    46 N44c9bf350fa04a1e91e143f86c698d09 schema:familyName Rauterberg
    47 schema:givenName Matthias
    48 rdf:type schema:Person
    49 N5baf3dd097a74beab644f720005999f8 rdf:first N44c9bf350fa04a1e91e143f86c698d09
    50 rdf:rest N928e3cb134d34ec79112b1fc7759941a
    51 N6c1f092f951e4fd387dbc3bcd35193d6 schema:name dimensions_id
    52 schema:value pub.1039311893
    53 rdf:type schema:PropertyValue
    54 N8ab21bbe53a848f3948a9d66563bc0a7 schema:isbn 978-3-540-45259-1
    55 978-3-540-45261-4
    56 schema:name Entertainment Computing - ICEC 2006
    57 rdf:type schema:Book
    58 N928e3cb134d34ec79112b1fc7759941a rdf:first N0f0780e2bd724883a2ab39bd8adcfce8
    59 rdf:rest rdf:nil
    60 Nc56824bf79664845967376fa477fa366 rdf:first sg:person.014111450133.04
    61 rdf:rest Nf240d4e8387f4bf3be86e76353572337
    62 Nd64f47e2df3d404e8c1d6725a41bb6f2 rdf:first N3e91cb22fcb64f95a74e422bd6720709
    63 rdf:rest N5baf3dd097a74beab644f720005999f8
    64 Necda7c8e030c4e61bf9cb230118a2384 rdf:first sg:person.014511727413.21
    65 rdf:rest N1bf3ca269f534046b00807732f09cf55
    66 Nf240d4e8387f4bf3be86e76353572337 rdf:first sg:person.011143172143.38
    67 rdf:rest rdf:nil
    68 Nf31d510252504a148e3bd83e20771510 schema:location Berlin, Heidelberg
    69 schema:name Springer Berlin Heidelberg
    70 rdf:type schema:Organisation
    71 Nfbd0f3a2688b4fa695956c53039a257e schema:name Springer Nature - SN SciGraph project
    72 rdf:type schema:Organization
    73 anzsrc-for:16 schema:inDefinedTermSet anzsrc-for:
    74 schema:name Studies in Human Society
    75 rdf:type schema:DefinedTerm
    76 anzsrc-for:1605 schema:inDefinedTermSet anzsrc-for:
    77 schema:name Policy and Administration
    78 rdf:type schema:DefinedTerm
    79 sg:person.011143172143.38 schema:affiliation https://www.grid.ac/institutes/grid.91443.3b
    80 schema:familyName Oh
    81 schema:givenName Ha Ryoung
    82 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.011143172143.38
    83 rdf:type schema:Person
    84 sg:person.013476161137.06 schema:affiliation https://www.grid.ac/institutes/grid.36303.35
    85 schema:familyName Shim
    86 schema:givenName Kwang-Hyun
    87 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.013476161137.06
    88 rdf:type schema:Person
    89 sg:person.014111450133.04 schema:affiliation https://www.grid.ac/institutes/grid.91443.3b
    90 schema:familyName Seong
    91 schema:givenName Yeong Rak
    92 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.014111450133.04
    93 rdf:type schema:Person
    94 sg:person.014511727413.21 schema:affiliation https://www.grid.ac/institutes/grid.444079.a
    95 schema:familyName Jung
    96 schema:givenName Sung Hoon
    97 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.014511727413.21
    98 rdf:type schema:Person
    99 sg:person.015226474461.83 schema:affiliation https://www.grid.ac/institutes/grid.36303.35
    100 schema:familyName Cho
    101 schema:givenName Byeong Heon
    102 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.015226474461.83
    103 rdf:type schema:Person
    104 sg:pub.10.1007/11596448_159 schema:sameAs https://app.dimensions.ai/details/publication/pub.1032424388
    105 https://doi.org/10.1007/11596448_159
    106 rdf:type schema:CreativeWork
    107 https://doi.org/10.1093/ietisy/e89-d.3.1249 schema:sameAs https://app.dimensions.ai/details/publication/pub.1059671877
    108 rdf:type schema:CreativeWork
    109 https://doi.org/10.1109/massp.1987.1165576 schema:sameAs https://app.dimensions.ai/details/publication/pub.1061385413
    110 rdf:type schema:CreativeWork
    111 https://www.grid.ac/institutes/grid.36303.35 schema:alternateName Electronics and Telecommunications Research Institute
    112 schema:name Digital Content Research Division, ETRI, Daejeon, 305-700, Korea
    113 rdf:type schema:Organization
    114 https://www.grid.ac/institutes/grid.444079.a schema:alternateName Hansung University
    115 schema:name Dept. of Information and Comm. Eng., Hansung Univ., Seoul, 136-792, Korea
    116 rdf:type schema:Organization
    117 https://www.grid.ac/institutes/grid.91443.3b schema:alternateName Kookmin University
    118 schema:name School of Electrical Engineering, Kookmin Univ., Seoul, 136-702, Korea
    119 rdf:type schema:Organization
     




    Preview window. Press ESC to close (or click here)


    ...