Decision Making in Agent-Based Models View Full Text


Ontology type: schema:Chapter      Open Access: True


Chapter Info

DATE

2015

AUTHORS

Guillem Francès , Xavier Rubio-Campillo , Carla Lancelotti , Marco Madella

ABSTRACT

Agent-Based Models (ABM) are being increasingly applied to the study of a wide range of social phenomena, often putting the focus on the macroscopic patterns that emerge from the interaction of a number of agents programmed to behave in a plausible manner. This agent behavior, however, is all too often encoded as a small set of rules that produces a somewhat simplistic behavior. In this short paper, we propose to explore the impact of decision-making processes on the outcome of simulations, and introduce a type of agent that uses a more systematic and principled decision-making approach, based on casting the simulation environment as a Markov Decision Process. We compare the performance of this type of agent to that of more simplistic agents on a simple ABM simulation, and examine the interplay between the decision-making mechanism and other relevant simulation parameters such as the distribution and scarcity of resources. Our preliminary findings show that our novel agent outperforms the rest of agents, and, more generally, that the process of decision-making needs to be acknowledged as a first-class parameter of ABM simulations with a significant impact on the simulation outcome. More... »

PAGES

370-378

References to SciGraph publications

  • 2006. Bandit Based Monte-Carlo Planning in MACHINE LEARNING: ECML 2006
  • 2014-06. Trends in Archaeological Simulation in JOURNAL OF ARCHAEOLOGICAL METHOD AND THEORY
  • Identifiers

    URI

    http://scigraph.springernature.com/pub.10.1007/978-3-319-17130-2_25

    DOI

    http://dx.doi.org/10.1007/978-3-319-17130-2_25

    DIMENSIONS

    https://app.dimensions.ai/details/publication/pub.1010245153


    Indexing Status Check whether this publication has been indexed by Scopus and Web Of Science using the SN Indexing Status Tool
    Incoming Citations Browse incoming citations for this publication using opencitations.net

    JSON-LD is the canonical representation for SciGraph data.

    TIP: You can open this SciGraph record using an external JSON-LD service: JSON-LD Playground Google SDTT

    [
      {
        "@context": "https://springernature.github.io/scigraph/jsonld/sgcontext.json", 
        "about": [
          {
            "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/0801", 
            "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
            "name": "Artificial Intelligence and Image Processing", 
            "type": "DefinedTerm"
          }, 
          {
            "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/08", 
            "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
            "name": "Information and Computing Sciences", 
            "type": "DefinedTerm"
          }
        ], 
        "author": [
          {
            "affiliation": {
              "alternateName": "Pompeu Fabra University", 
              "id": "https://www.grid.ac/institutes/grid.5612.0", 
              "name": [
                "Artificial Intelligence Group, Universitat Pompeu Fabra, Barcelona, Spain"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Franc\u00e8s", 
            "givenName": "Guillem", 
            "id": "sg:person.015002373571.38", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.015002373571.38"
            ], 
            "type": "Person"
          }, 
          {
            "affiliation": {
              "name": [
                "Barcelona Supercomputing Centre, Barcelona, Spain"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Rubio-Campillo", 
            "givenName": "Xavier", 
            "id": "sg:person.010627006344.08", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010627006344.08"
            ], 
            "type": "Person"
          }, 
          {
            "affiliation": {
              "alternateName": "Pompeu Fabra University", 
              "id": "https://www.grid.ac/institutes/grid.5612.0", 
              "name": [
                "CaSEs Research Group, Department of Humanities, Universitat Pompeu Fabra, Barcelona, Spain"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Lancelotti", 
            "givenName": "Carla", 
            "id": "sg:person.010226443327.06", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010226443327.06"
            ], 
            "type": "Person"
          }, 
          {
            "affiliation": {
              "alternateName": "Instituci\u00f3 Catalana de Recerca i Estudis Avan\u00e7ats", 
              "id": "https://www.grid.ac/institutes/grid.425902.8", 
              "name": [
                "CaSEs Research Group, Department of Humanities, ICREA, Universitat Pompeu Fabra and IMF-CSIC, Barcelona, Spain"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Madella", 
            "givenName": "Marco", 
            "id": "sg:person.015357765632.01", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.015357765632.01"
            ], 
            "type": "Person"
          }
        ], 
        "citation": [
          {
            "id": "https://doi.org/10.1111/j.0020-2754.2004.00321.x", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1008338113"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1016/j.cageo.2004.03.012", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1016997706"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1080/0022250x.1971.9989794", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1027934917"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/11871842_29", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1037233025", 
              "https://doi.org/10.1007/11871842_29"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/11871842_29", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1037233025", 
              "https://doi.org/10.1007/11871842_29"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/s10816-013-9188-1", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1038686138", 
              "https://doi.org/10.1007/s10816-013-9188-1"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/s10816-013-9188-1", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1038686138", 
              "https://doi.org/10.1007/s10816-013-9188-1"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1109/tciaig.2012.2186810", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1061548895"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.2200/s00513ed1v01y201306aim022", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1069288395"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.2307/1939924", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1069663732"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.2307/1960858", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1069668299"
            ], 
            "type": "CreativeWork"
          }
        ], 
        "datePublished": "2015", 
        "datePublishedReg": "2015-01-01", 
        "description": "Agent-Based Models (ABM) are being increasingly applied to the study of a wide range of social phenomena, often putting the focus on the macroscopic patterns that emerge from the interaction of a number of agents programmed to behave in a plausible manner. This agent behavior, however, is all too often encoded as a small set of rules that produces a somewhat simplistic behavior. In this short paper, we propose to explore the impact of decision-making processes on the outcome of simulations, and introduce a type of agent that uses a more systematic and principled decision-making approach, based on casting the simulation environment as a Markov Decision Process. We compare the performance of this type of agent to that of more simplistic agents on a simple ABM simulation, and examine the interplay between the decision-making mechanism and other relevant simulation parameters such as the distribution and scarcity of resources. Our preliminary findings show that our novel agent outperforms the rest of agents, and, more generally, that the process of decision-making needs to be acknowledged as a first-class parameter of ABM simulations with a significant impact on the simulation outcome.", 
        "editor": [
          {
            "familyName": "Bulling", 
            "givenName": "Nils", 
            "type": "Person"
          }
        ], 
        "genre": "chapter", 
        "id": "sg:pub.10.1007/978-3-319-17130-2_25", 
        "inLanguage": [
          "en"
        ], 
        "isAccessibleForFree": true, 
        "isPartOf": {
          "isbn": [
            "978-3-319-17129-6", 
            "978-3-319-17130-2"
          ], 
          "name": "Multi-Agent Systems", 
          "type": "Book"
        }, 
        "name": "Decision Making in Agent-Based Models", 
        "pagination": "370-378", 
        "productId": [
          {
            "name": "doi", 
            "type": "PropertyValue", 
            "value": [
              "10.1007/978-3-319-17130-2_25"
            ]
          }, 
          {
            "name": "readcube_id", 
            "type": "PropertyValue", 
            "value": [
              "30cf33a5eda66c053df0a8ce77ae7ba1f9b506a5f7e348f57b1e7d5d20916cd6"
            ]
          }, 
          {
            "name": "dimensions_id", 
            "type": "PropertyValue", 
            "value": [
              "pub.1010245153"
            ]
          }
        ], 
        "publisher": {
          "location": "Cham", 
          "name": "Springer International Publishing", 
          "type": "Organisation"
        }, 
        "sameAs": [
          "https://doi.org/10.1007/978-3-319-17130-2_25", 
          "https://app.dimensions.ai/details/publication/pub.1010245153"
        ], 
        "sdDataset": "chapters", 
        "sdDatePublished": "2019-04-15T10:31", 
        "sdLicense": "https://scigraph.springernature.com/explorer/license/", 
        "sdPublisher": {
          "name": "Springer Nature - SN SciGraph project", 
          "type": "Organization"
        }, 
        "sdSource": "s3://com-uberresearch-data-dimensions-target-20181106-alternative/cleanup/v134/2549eaecd7973599484d7c17b260dba0a4ecb94b/merge/v9/a6c9fde33151104705d4d7ff012ea9563521a3ce/jats-lookup/v90/0000000001_0000000264/records_8659_00000249.jsonl", 
        "type": "Chapter", 
        "url": "http://link.springer.com/10.1007/978-3-319-17130-2_25"
      }
    ]
     

    Download the RDF metadata as:  json-ld nt turtle xml License info

    HOW TO GET THIS DATA PROGRAMMATICALLY:

    JSON-LD is a popular format for linked data which is fully compatible with JSON.

    curl -H 'Accept: application/ld+json' 'https://scigraph.springernature.com/pub.10.1007/978-3-319-17130-2_25'

    N-Triples is a line-based linked data format ideal for batch operations.

    curl -H 'Accept: application/n-triples' 'https://scigraph.springernature.com/pub.10.1007/978-3-319-17130-2_25'

    Turtle is a human-readable linked data format.

    curl -H 'Accept: text/turtle' 'https://scigraph.springernature.com/pub.10.1007/978-3-319-17130-2_25'

    RDF/XML is a standard XML format for linked data.

    curl -H 'Accept: application/rdf+xml' 'https://scigraph.springernature.com/pub.10.1007/978-3-319-17130-2_25'


     

    This table displays all metadata directly associated to this object as RDF triples.

    121 TRIPLES      23 PREDICATES      36 URIs      20 LITERALS      8 BLANK NODES

    Subject Predicate Object
    1 sg:pub.10.1007/978-3-319-17130-2_25 schema:about anzsrc-for:08
    2 anzsrc-for:0801
    3 schema:author N9b3123dfc58743beb82e0f3d3f528fa0
    4 schema:citation sg:pub.10.1007/11871842_29
    5 sg:pub.10.1007/s10816-013-9188-1
    6 https://doi.org/10.1016/j.cageo.2004.03.012
    7 https://doi.org/10.1080/0022250x.1971.9989794
    8 https://doi.org/10.1109/tciaig.2012.2186810
    9 https://doi.org/10.1111/j.0020-2754.2004.00321.x
    10 https://doi.org/10.2200/s00513ed1v01y201306aim022
    11 https://doi.org/10.2307/1939924
    12 https://doi.org/10.2307/1960858
    13 schema:datePublished 2015
    14 schema:datePublishedReg 2015-01-01
    15 schema:description Agent-Based Models (ABM) are being increasingly applied to the study of a wide range of social phenomena, often putting the focus on the macroscopic patterns that emerge from the interaction of a number of agents programmed to behave in a plausible manner. This agent behavior, however, is all too often encoded as a small set of rules that produces a somewhat simplistic behavior. In this short paper, we propose to explore the impact of decision-making processes on the outcome of simulations, and introduce a type of agent that uses a more systematic and principled decision-making approach, based on casting the simulation environment as a Markov Decision Process. We compare the performance of this type of agent to that of more simplistic agents on a simple ABM simulation, and examine the interplay between the decision-making mechanism and other relevant simulation parameters such as the distribution and scarcity of resources. Our preliminary findings show that our novel agent outperforms the rest of agents, and, more generally, that the process of decision-making needs to be acknowledged as a first-class parameter of ABM simulations with a significant impact on the simulation outcome.
    16 schema:editor N71debacc787547dd98319cf2f4d8473b
    17 schema:genre chapter
    18 schema:inLanguage en
    19 schema:isAccessibleForFree true
    20 schema:isPartOf Nb7a9ed876a384053ac8f22186345d34d
    21 schema:name Decision Making in Agent-Based Models
    22 schema:pagination 370-378
    23 schema:productId Nc1aad5e500f341a98eee0a203c1f4437
    24 Nc1c127e223d44dbcbdbfcf39115f9330
    25 Nfb51b2597ade4d689b73d799b15c6d83
    26 schema:publisher N2a66ff091cad4aecba3ae9b2713ffee5
    27 schema:sameAs https://app.dimensions.ai/details/publication/pub.1010245153
    28 https://doi.org/10.1007/978-3-319-17130-2_25
    29 schema:sdDatePublished 2019-04-15T10:31
    30 schema:sdLicense https://scigraph.springernature.com/explorer/license/
    31 schema:sdPublisher N9c9565eeb4d74cf59291333a0dfb09e2
    32 schema:url http://link.springer.com/10.1007/978-3-319-17130-2_25
    33 sgo:license sg:explorer/license/
    34 sgo:sdDataset chapters
    35 rdf:type schema:Chapter
    36 N121c6d5ec47b43099561139294b8a338 rdf:first sg:person.015357765632.01
    37 rdf:rest rdf:nil
    38 N221cdd51674b4cf590a1f2a778568498 schema:familyName Bulling
    39 schema:givenName Nils
    40 rdf:type schema:Person
    41 N2a66ff091cad4aecba3ae9b2713ffee5 schema:location Cham
    42 schema:name Springer International Publishing
    43 rdf:type schema:Organisation
    44 N4f544c6b40cf4e3cadbe7fbdc85c4ec8 schema:name Barcelona Supercomputing Centre, Barcelona, Spain
    45 rdf:type schema:Organization
    46 N71debacc787547dd98319cf2f4d8473b rdf:first N221cdd51674b4cf590a1f2a778568498
    47 rdf:rest rdf:nil
    48 N99688de5c4a14993afc69512e5a67baa rdf:first sg:person.010627006344.08
    49 rdf:rest Nc62f71ed4a1d4651b2377739cd3bb7ac
    50 N9b3123dfc58743beb82e0f3d3f528fa0 rdf:first sg:person.015002373571.38
    51 rdf:rest N99688de5c4a14993afc69512e5a67baa
    52 N9c9565eeb4d74cf59291333a0dfb09e2 schema:name Springer Nature - SN SciGraph project
    53 rdf:type schema:Organization
    54 Nb7a9ed876a384053ac8f22186345d34d schema:isbn 978-3-319-17129-6
    55 978-3-319-17130-2
    56 schema:name Multi-Agent Systems
    57 rdf:type schema:Book
    58 Nc1aad5e500f341a98eee0a203c1f4437 schema:name readcube_id
    59 schema:value 30cf33a5eda66c053df0a8ce77ae7ba1f9b506a5f7e348f57b1e7d5d20916cd6
    60 rdf:type schema:PropertyValue
    61 Nc1c127e223d44dbcbdbfcf39115f9330 schema:name dimensions_id
    62 schema:value pub.1010245153
    63 rdf:type schema:PropertyValue
    64 Nc62f71ed4a1d4651b2377739cd3bb7ac rdf:first sg:person.010226443327.06
    65 rdf:rest N121c6d5ec47b43099561139294b8a338
    66 Nfb51b2597ade4d689b73d799b15c6d83 schema:name doi
    67 schema:value 10.1007/978-3-319-17130-2_25
    68 rdf:type schema:PropertyValue
    69 anzsrc-for:08 schema:inDefinedTermSet anzsrc-for:
    70 schema:name Information and Computing Sciences
    71 rdf:type schema:DefinedTerm
    72 anzsrc-for:0801 schema:inDefinedTermSet anzsrc-for:
    73 schema:name Artificial Intelligence and Image Processing
    74 rdf:type schema:DefinedTerm
    75 sg:person.010226443327.06 schema:affiliation https://www.grid.ac/institutes/grid.5612.0
    76 schema:familyName Lancelotti
    77 schema:givenName Carla
    78 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010226443327.06
    79 rdf:type schema:Person
    80 sg:person.010627006344.08 schema:affiliation N4f544c6b40cf4e3cadbe7fbdc85c4ec8
    81 schema:familyName Rubio-Campillo
    82 schema:givenName Xavier
    83 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010627006344.08
    84 rdf:type schema:Person
    85 sg:person.015002373571.38 schema:affiliation https://www.grid.ac/institutes/grid.5612.0
    86 schema:familyName Francès
    87 schema:givenName Guillem
    88 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.015002373571.38
    89 rdf:type schema:Person
    90 sg:person.015357765632.01 schema:affiliation https://www.grid.ac/institutes/grid.425902.8
    91 schema:familyName Madella
    92 schema:givenName Marco
    93 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.015357765632.01
    94 rdf:type schema:Person
    95 sg:pub.10.1007/11871842_29 schema:sameAs https://app.dimensions.ai/details/publication/pub.1037233025
    96 https://doi.org/10.1007/11871842_29
    97 rdf:type schema:CreativeWork
    98 sg:pub.10.1007/s10816-013-9188-1 schema:sameAs https://app.dimensions.ai/details/publication/pub.1038686138
    99 https://doi.org/10.1007/s10816-013-9188-1
    100 rdf:type schema:CreativeWork
    101 https://doi.org/10.1016/j.cageo.2004.03.012 schema:sameAs https://app.dimensions.ai/details/publication/pub.1016997706
    102 rdf:type schema:CreativeWork
    103 https://doi.org/10.1080/0022250x.1971.9989794 schema:sameAs https://app.dimensions.ai/details/publication/pub.1027934917
    104 rdf:type schema:CreativeWork
    105 https://doi.org/10.1109/tciaig.2012.2186810 schema:sameAs https://app.dimensions.ai/details/publication/pub.1061548895
    106 rdf:type schema:CreativeWork
    107 https://doi.org/10.1111/j.0020-2754.2004.00321.x schema:sameAs https://app.dimensions.ai/details/publication/pub.1008338113
    108 rdf:type schema:CreativeWork
    109 https://doi.org/10.2200/s00513ed1v01y201306aim022 schema:sameAs https://app.dimensions.ai/details/publication/pub.1069288395
    110 rdf:type schema:CreativeWork
    111 https://doi.org/10.2307/1939924 schema:sameAs https://app.dimensions.ai/details/publication/pub.1069663732
    112 rdf:type schema:CreativeWork
    113 https://doi.org/10.2307/1960858 schema:sameAs https://app.dimensions.ai/details/publication/pub.1069668299
    114 rdf:type schema:CreativeWork
    115 https://www.grid.ac/institutes/grid.425902.8 schema:alternateName Institució Catalana de Recerca i Estudis Avançats
    116 schema:name CaSEs Research Group, Department of Humanities, ICREA, Universitat Pompeu Fabra and IMF-CSIC, Barcelona, Spain
    117 rdf:type schema:Organization
    118 https://www.grid.ac/institutes/grid.5612.0 schema:alternateName Pompeu Fabra University
    119 schema:name Artificial Intelligence Group, Universitat Pompeu Fabra, Barcelona, Spain
    120 CaSEs Research Group, Department of Humanities, Universitat Pompeu Fabra, Barcelona, Spain
    121 rdf:type schema:Organization
     




    Preview window. Press ESC to close (or click here)


    ...