Decision Making in Agent-Based Models View Full Text


Ontology type: schema:Chapter      Open Access: True


Chapter Info

DATE

2015

AUTHORS

Guillem Francès , Xavier Rubio-Campillo , Carla Lancelotti , Marco Madella

ABSTRACT

Agent-Based Models (ABM) are being increasingly applied to the study of a wide range of social phenomena, often putting the focus on the macroscopic patterns that emerge from the interaction of a number of agents programmed to behave in a plausible manner. This agent behavior, however, is all too often encoded as a small set of rules that produces a somewhat simplistic behavior. In this short paper, we propose to explore the impact of decision-making processes on the outcome of simulations, and introduce a type of agent that uses a more systematic and principled decision-making approach, based on casting the simulation environment as a Markov Decision Process. We compare the performance of this type of agent to that of more simplistic agents on a simple ABM simulation, and examine the interplay between the decision-making mechanism and other relevant simulation parameters such as the distribution and scarcity of resources. Our preliminary findings show that our novel agent outperforms the rest of agents, and, more generally, that the process of decision-making needs to be acknowledged as a first-class parameter of ABM simulations with a significant impact on the simulation outcome. More... »

PAGES

370-378

References to SciGraph publications

  • 2006. Bandit Based Monte-Carlo Planning in MACHINE LEARNING: ECML 2006
  • 2014-06. Trends in Archaeological Simulation in JOURNAL OF ARCHAEOLOGICAL METHOD AND THEORY
  • Identifiers

    URI

    http://scigraph.springernature.com/pub.10.1007/978-3-319-17130-2_25

    DOI

    http://dx.doi.org/10.1007/978-3-319-17130-2_25

    DIMENSIONS

    https://app.dimensions.ai/details/publication/pub.1010245153


    Indexing Status Check whether this publication has been indexed by Scopus and Web Of Science using the SN Indexing Status Tool
    Incoming Citations Browse incoming citations for this publication using opencitations.net

    JSON-LD is the canonical representation for SciGraph data.

    TIP: You can open this SciGraph record using an external JSON-LD service: JSON-LD Playground Google SDTT

    [
      {
        "@context": "https://springernature.github.io/scigraph/jsonld/sgcontext.json", 
        "about": [
          {
            "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/0801", 
            "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
            "name": "Artificial Intelligence and Image Processing", 
            "type": "DefinedTerm"
          }, 
          {
            "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/08", 
            "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
            "name": "Information and Computing Sciences", 
            "type": "DefinedTerm"
          }
        ], 
        "author": [
          {
            "affiliation": {
              "alternateName": "Pompeu Fabra University", 
              "id": "https://www.grid.ac/institutes/grid.5612.0", 
              "name": [
                "Artificial Intelligence Group, Universitat Pompeu Fabra, Barcelona, Spain"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Franc\u00e8s", 
            "givenName": "Guillem", 
            "id": "sg:person.015002373571.38", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.015002373571.38"
            ], 
            "type": "Person"
          }, 
          {
            "affiliation": {
              "name": [
                "Barcelona Supercomputing Centre, Barcelona, Spain"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Rubio-Campillo", 
            "givenName": "Xavier", 
            "id": "sg:person.010627006344.08", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010627006344.08"
            ], 
            "type": "Person"
          }, 
          {
            "affiliation": {
              "alternateName": "Pompeu Fabra University", 
              "id": "https://www.grid.ac/institutes/grid.5612.0", 
              "name": [
                "CaSEs Research Group, Department of Humanities, Universitat Pompeu Fabra, Barcelona, Spain"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Lancelotti", 
            "givenName": "Carla", 
            "id": "sg:person.010226443327.06", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010226443327.06"
            ], 
            "type": "Person"
          }, 
          {
            "affiliation": {
              "alternateName": "Instituci\u00f3 Catalana de Recerca i Estudis Avan\u00e7ats", 
              "id": "https://www.grid.ac/institutes/grid.425902.8", 
              "name": [
                "CaSEs Research Group, Department of Humanities, ICREA, Universitat Pompeu Fabra and IMF-CSIC, Barcelona, Spain"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Madella", 
            "givenName": "Marco", 
            "id": "sg:person.015357765632.01", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.015357765632.01"
            ], 
            "type": "Person"
          }
        ], 
        "citation": [
          {
            "id": "https://doi.org/10.1111/j.0020-2754.2004.00321.x", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1008338113"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1016/j.cageo.2004.03.012", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1016997706"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1080/0022250x.1971.9989794", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1027934917"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/11871842_29", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1037233025", 
              "https://doi.org/10.1007/11871842_29"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/11871842_29", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1037233025", 
              "https://doi.org/10.1007/11871842_29"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/s10816-013-9188-1", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1038686138", 
              "https://doi.org/10.1007/s10816-013-9188-1"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/s10816-013-9188-1", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1038686138", 
              "https://doi.org/10.1007/s10816-013-9188-1"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1109/tciaig.2012.2186810", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1061548895"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.2200/s00513ed1v01y201306aim022", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1069288395"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.2307/1939924", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1069663732"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.2307/1960858", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1069668299"
            ], 
            "type": "CreativeWork"
          }
        ], 
        "datePublished": "2015", 
        "datePublishedReg": "2015-01-01", 
        "description": "Agent-Based Models (ABM) are being increasingly applied to the study of a wide range of social phenomena, often putting the focus on the macroscopic patterns that emerge from the interaction of a number of agents programmed to behave in a plausible manner. This agent behavior, however, is all too often encoded as a small set of rules that produces a somewhat simplistic behavior. In this short paper, we propose to explore the impact of decision-making processes on the outcome of simulations, and introduce a type of agent that uses a more systematic and principled decision-making approach, based on casting the simulation environment as a Markov Decision Process. We compare the performance of this type of agent to that of more simplistic agents on a simple ABM simulation, and examine the interplay between the decision-making mechanism and other relevant simulation parameters such as the distribution and scarcity of resources. Our preliminary findings show that our novel agent outperforms the rest of agents, and, more generally, that the process of decision-making needs to be acknowledged as a first-class parameter of ABM simulations with a significant impact on the simulation outcome.", 
        "editor": [
          {
            "familyName": "Bulling", 
            "givenName": "Nils", 
            "type": "Person"
          }
        ], 
        "genre": "chapter", 
        "id": "sg:pub.10.1007/978-3-319-17130-2_25", 
        "inLanguage": [
          "en"
        ], 
        "isAccessibleForFree": true, 
        "isPartOf": {
          "isbn": [
            "978-3-319-17129-6", 
            "978-3-319-17130-2"
          ], 
          "name": "Multi-Agent Systems", 
          "type": "Book"
        }, 
        "name": "Decision Making in Agent-Based Models", 
        "pagination": "370-378", 
        "productId": [
          {
            "name": "doi", 
            "type": "PropertyValue", 
            "value": [
              "10.1007/978-3-319-17130-2_25"
            ]
          }, 
          {
            "name": "readcube_id", 
            "type": "PropertyValue", 
            "value": [
              "30cf33a5eda66c053df0a8ce77ae7ba1f9b506a5f7e348f57b1e7d5d20916cd6"
            ]
          }, 
          {
            "name": "dimensions_id", 
            "type": "PropertyValue", 
            "value": [
              "pub.1010245153"
            ]
          }
        ], 
        "publisher": {
          "location": "Cham", 
          "name": "Springer International Publishing", 
          "type": "Organisation"
        }, 
        "sameAs": [
          "https://doi.org/10.1007/978-3-319-17130-2_25", 
          "https://app.dimensions.ai/details/publication/pub.1010245153"
        ], 
        "sdDataset": "chapters", 
        "sdDatePublished": "2019-04-15T10:31", 
        "sdLicense": "https://scigraph.springernature.com/explorer/license/", 
        "sdPublisher": {
          "name": "Springer Nature - SN SciGraph project", 
          "type": "Organization"
        }, 
        "sdSource": "s3://com-uberresearch-data-dimensions-target-20181106-alternative/cleanup/v134/2549eaecd7973599484d7c17b260dba0a4ecb94b/merge/v9/a6c9fde33151104705d4d7ff012ea9563521a3ce/jats-lookup/v90/0000000001_0000000264/records_8659_00000249.jsonl", 
        "type": "Chapter", 
        "url": "http://link.springer.com/10.1007/978-3-319-17130-2_25"
      }
    ]
     

    Download the RDF metadata as:  json-ld nt turtle xml License info

    HOW TO GET THIS DATA PROGRAMMATICALLY:

    JSON-LD is a popular format for linked data which is fully compatible with JSON.

    curl -H 'Accept: application/ld+json' 'https://scigraph.springernature.com/pub.10.1007/978-3-319-17130-2_25'

    N-Triples is a line-based linked data format ideal for batch operations.

    curl -H 'Accept: application/n-triples' 'https://scigraph.springernature.com/pub.10.1007/978-3-319-17130-2_25'

    Turtle is a human-readable linked data format.

    curl -H 'Accept: text/turtle' 'https://scigraph.springernature.com/pub.10.1007/978-3-319-17130-2_25'

    RDF/XML is a standard XML format for linked data.

    curl -H 'Accept: application/rdf+xml' 'https://scigraph.springernature.com/pub.10.1007/978-3-319-17130-2_25'


     

    This table displays all metadata directly associated to this object as RDF triples.

    121 TRIPLES      23 PREDICATES      36 URIs      20 LITERALS      8 BLANK NODES

    Subject Predicate Object
    1 sg:pub.10.1007/978-3-319-17130-2_25 schema:about anzsrc-for:08
    2 anzsrc-for:0801
    3 schema:author N7443af77b04a4b8abfba59d16bc3a9da
    4 schema:citation sg:pub.10.1007/11871842_29
    5 sg:pub.10.1007/s10816-013-9188-1
    6 https://doi.org/10.1016/j.cageo.2004.03.012
    7 https://doi.org/10.1080/0022250x.1971.9989794
    8 https://doi.org/10.1109/tciaig.2012.2186810
    9 https://doi.org/10.1111/j.0020-2754.2004.00321.x
    10 https://doi.org/10.2200/s00513ed1v01y201306aim022
    11 https://doi.org/10.2307/1939924
    12 https://doi.org/10.2307/1960858
    13 schema:datePublished 2015
    14 schema:datePublishedReg 2015-01-01
    15 schema:description Agent-Based Models (ABM) are being increasingly applied to the study of a wide range of social phenomena, often putting the focus on the macroscopic patterns that emerge from the interaction of a number of agents programmed to behave in a plausible manner. This agent behavior, however, is all too often encoded as a small set of rules that produces a somewhat simplistic behavior. In this short paper, we propose to explore the impact of decision-making processes on the outcome of simulations, and introduce a type of agent that uses a more systematic and principled decision-making approach, based on casting the simulation environment as a Markov Decision Process. We compare the performance of this type of agent to that of more simplistic agents on a simple ABM simulation, and examine the interplay between the decision-making mechanism and other relevant simulation parameters such as the distribution and scarcity of resources. Our preliminary findings show that our novel agent outperforms the rest of agents, and, more generally, that the process of decision-making needs to be acknowledged as a first-class parameter of ABM simulations with a significant impact on the simulation outcome.
    16 schema:editor N342b0e2fbab94bfd950b13b9ef5b458a
    17 schema:genre chapter
    18 schema:inLanguage en
    19 schema:isAccessibleForFree true
    20 schema:isPartOf N509a888860df47a6a41de1ccc3e12e7a
    21 schema:name Decision Making in Agent-Based Models
    22 schema:pagination 370-378
    23 schema:productId N376a76f8e1b240fdb725b37f38e232c8
    24 N41829adc1e32401ab22075de09ac1a52
    25 N4d341e66c2904568b3dedb65c17613f5
    26 schema:publisher Nc93cf276f2ec47f788d4033fbc1848fb
    27 schema:sameAs https://app.dimensions.ai/details/publication/pub.1010245153
    28 https://doi.org/10.1007/978-3-319-17130-2_25
    29 schema:sdDatePublished 2019-04-15T10:31
    30 schema:sdLicense https://scigraph.springernature.com/explorer/license/
    31 schema:sdPublisher N4168477dc8ce4dcd8a9b7118c86586d8
    32 schema:url http://link.springer.com/10.1007/978-3-319-17130-2_25
    33 sgo:license sg:explorer/license/
    34 sgo:sdDataset chapters
    35 rdf:type schema:Chapter
    36 N317af70d068c40a1a6492ba4aeae5616 rdf:first sg:person.010627006344.08
    37 rdf:rest N8246e3e139064204bdae53253b81c1a0
    38 N342b0e2fbab94bfd950b13b9ef5b458a rdf:first Nd860cc9f653e4a019bffa31dd15230fc
    39 rdf:rest rdf:nil
    40 N376a76f8e1b240fdb725b37f38e232c8 schema:name doi
    41 schema:value 10.1007/978-3-319-17130-2_25
    42 rdf:type schema:PropertyValue
    43 N4168477dc8ce4dcd8a9b7118c86586d8 schema:name Springer Nature - SN SciGraph project
    44 rdf:type schema:Organization
    45 N41829adc1e32401ab22075de09ac1a52 schema:name readcube_id
    46 schema:value 30cf33a5eda66c053df0a8ce77ae7ba1f9b506a5f7e348f57b1e7d5d20916cd6
    47 rdf:type schema:PropertyValue
    48 N4d341e66c2904568b3dedb65c17613f5 schema:name dimensions_id
    49 schema:value pub.1010245153
    50 rdf:type schema:PropertyValue
    51 N509a888860df47a6a41de1ccc3e12e7a schema:isbn 978-3-319-17129-6
    52 978-3-319-17130-2
    53 schema:name Multi-Agent Systems
    54 rdf:type schema:Book
    55 N7443af77b04a4b8abfba59d16bc3a9da rdf:first sg:person.015002373571.38
    56 rdf:rest N317af70d068c40a1a6492ba4aeae5616
    57 N790edece50ed4c32b59c808e1fb55c3f rdf:first sg:person.015357765632.01
    58 rdf:rest rdf:nil
    59 N8246e3e139064204bdae53253b81c1a0 rdf:first sg:person.010226443327.06
    60 rdf:rest N790edece50ed4c32b59c808e1fb55c3f
    61 Nc93cf276f2ec47f788d4033fbc1848fb schema:location Cham
    62 schema:name Springer International Publishing
    63 rdf:type schema:Organisation
    64 Nd306aaf093e24ce7b658573b76cf383d schema:name Barcelona Supercomputing Centre, Barcelona, Spain
    65 rdf:type schema:Organization
    66 Nd860cc9f653e4a019bffa31dd15230fc schema:familyName Bulling
    67 schema:givenName Nils
    68 rdf:type schema:Person
    69 anzsrc-for:08 schema:inDefinedTermSet anzsrc-for:
    70 schema:name Information and Computing Sciences
    71 rdf:type schema:DefinedTerm
    72 anzsrc-for:0801 schema:inDefinedTermSet anzsrc-for:
    73 schema:name Artificial Intelligence and Image Processing
    74 rdf:type schema:DefinedTerm
    75 sg:person.010226443327.06 schema:affiliation https://www.grid.ac/institutes/grid.5612.0
    76 schema:familyName Lancelotti
    77 schema:givenName Carla
    78 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010226443327.06
    79 rdf:type schema:Person
    80 sg:person.010627006344.08 schema:affiliation Nd306aaf093e24ce7b658573b76cf383d
    81 schema:familyName Rubio-Campillo
    82 schema:givenName Xavier
    83 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010627006344.08
    84 rdf:type schema:Person
    85 sg:person.015002373571.38 schema:affiliation https://www.grid.ac/institutes/grid.5612.0
    86 schema:familyName Francès
    87 schema:givenName Guillem
    88 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.015002373571.38
    89 rdf:type schema:Person
    90 sg:person.015357765632.01 schema:affiliation https://www.grid.ac/institutes/grid.425902.8
    91 schema:familyName Madella
    92 schema:givenName Marco
    93 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.015357765632.01
    94 rdf:type schema:Person
    95 sg:pub.10.1007/11871842_29 schema:sameAs https://app.dimensions.ai/details/publication/pub.1037233025
    96 https://doi.org/10.1007/11871842_29
    97 rdf:type schema:CreativeWork
    98 sg:pub.10.1007/s10816-013-9188-1 schema:sameAs https://app.dimensions.ai/details/publication/pub.1038686138
    99 https://doi.org/10.1007/s10816-013-9188-1
    100 rdf:type schema:CreativeWork
    101 https://doi.org/10.1016/j.cageo.2004.03.012 schema:sameAs https://app.dimensions.ai/details/publication/pub.1016997706
    102 rdf:type schema:CreativeWork
    103 https://doi.org/10.1080/0022250x.1971.9989794 schema:sameAs https://app.dimensions.ai/details/publication/pub.1027934917
    104 rdf:type schema:CreativeWork
    105 https://doi.org/10.1109/tciaig.2012.2186810 schema:sameAs https://app.dimensions.ai/details/publication/pub.1061548895
    106 rdf:type schema:CreativeWork
    107 https://doi.org/10.1111/j.0020-2754.2004.00321.x schema:sameAs https://app.dimensions.ai/details/publication/pub.1008338113
    108 rdf:type schema:CreativeWork
    109 https://doi.org/10.2200/s00513ed1v01y201306aim022 schema:sameAs https://app.dimensions.ai/details/publication/pub.1069288395
    110 rdf:type schema:CreativeWork
    111 https://doi.org/10.2307/1939924 schema:sameAs https://app.dimensions.ai/details/publication/pub.1069663732
    112 rdf:type schema:CreativeWork
    113 https://doi.org/10.2307/1960858 schema:sameAs https://app.dimensions.ai/details/publication/pub.1069668299
    114 rdf:type schema:CreativeWork
    115 https://www.grid.ac/institutes/grid.425902.8 schema:alternateName Institució Catalana de Recerca i Estudis Avançats
    116 schema:name CaSEs Research Group, Department of Humanities, ICREA, Universitat Pompeu Fabra and IMF-CSIC, Barcelona, Spain
    117 rdf:type schema:Organization
    118 https://www.grid.ac/institutes/grid.5612.0 schema:alternateName Pompeu Fabra University
    119 schema:name Artificial Intelligence Group, Universitat Pompeu Fabra, Barcelona, Spain
    120 CaSEs Research Group, Department of Humanities, Universitat Pompeu Fabra, Barcelona, Spain
    121 rdf:type schema:Organization
     




    Preview window. Press ESC to close (or click here)


    ...