The Sharer’s Dilemma in Collective Adaptive Systems of Self-interested Agents View Full Text


Ontology type: schema:Chapter      Open Access: True


Chapter Info

DATE

2018-10-31

AUTHORS

Lenz Belzner , Kyrill Schmid , Thomy Phan , Thomas Gabor , Martin Wirsing

ABSTRACT

In collective adaptive systems (CAS), adaptation can be implemented by optimization wrt. utility. Agents in a CAS may be self-interested, while their utilities may depend on other agents’ choices. Independent optimization of agent utilities may yield poor individual and global reward due to locally interfering individual preferences. Joint optimization may scale poorly, and is impossible if agents cannot expose their preferences due to privacy or security issues. In this paper, we study utility sharing for mitigating this issue. Sharing utility with others may incentivize individuals to consider choices that are locally suboptimal but increase global reward. We illustrate our approach with a utility sharing variant of distributed cross entropy optimization. Empirical results show that utility sharing increases expected individual and global payoff in comparison to optimization without utility sharing. We also investigate the effect of greedy defectors in a CAS of sharing, self-interested agents. We observe that defection increases the mean expected individual payoff at the expense of sharing individuals’ payoff. We empirically show that the choice between defection and sharing yields a fundamental dilemma for self-interested agents in a CAS. More... »

PAGES

241-256

References to SciGraph publications

  • 2016-01. Mastering the game of Go with deep neural networks and tree search in NATURE
  • 2017-10. Mastering the game of Go without human knowledge in NATURE
  • 2016. Collective Autonomic Systems: Towards Engineering Principles and Their Foundations in TRANSACTIONS ON FOUNDATIONS FOR MASTERING CHANGE I
  • 2013. Cross-Entropy Method in ENCYCLOPEDIA OF OPERATIONS RESEARCH AND MANAGEMENT SCIENCE
  • Book

    TITLE

    Leveraging Applications of Formal Methods, Verification and Validation. Distributed Systems

    ISBN

    978-3-030-03423-8
    978-3-030-03424-5

    Identifiers

    URI

    http://scigraph.springernature.com/pub.10.1007/978-3-030-03424-5_16

    DOI

    http://dx.doi.org/10.1007/978-3-030-03424-5_16

    DIMENSIONS

    https://app.dimensions.ai/details/publication/pub.1107922857


    Indexing Status Check whether this publication has been indexed by Scopus and Web Of Science using the SN Indexing Status Tool
    Incoming Citations Browse incoming citations for this publication using opencitations.net

    JSON-LD is the canonical representation for SciGraph data.

    TIP: You can open this SciGraph record using an external JSON-LD service: JSON-LD Playground Google SDTT

    [
      {
        "@context": "https://springernature.github.io/scigraph/jsonld/sgcontext.json", 
        "about": [
          {
            "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/0103", 
            "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
            "name": "Numerical and Computational Mathematics", 
            "type": "DefinedTerm"
          }, 
          {
            "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/01", 
            "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
            "name": "Mathematical Sciences", 
            "type": "DefinedTerm"
          }
        ], 
        "author": [
          {
            "affiliation": {
              "name": [
                "MaibornWolff, Munich, Germany"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Belzner", 
            "givenName": "Lenz", 
            "id": "sg:person.015152211751.65", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.015152211751.65"
            ], 
            "type": "Person"
          }, 
          {
            "affiliation": {
              "alternateName": "Ludwig Maximilian University of Munich", 
              "id": "https://www.grid.ac/institutes/grid.5252.0", 
              "name": [
                "LMU Munich, Munich, Germany"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Schmid", 
            "givenName": "Kyrill", 
            "id": "sg:person.016342030724.89", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.016342030724.89"
            ], 
            "type": "Person"
          }, 
          {
            "affiliation": {
              "alternateName": "Ludwig Maximilian University of Munich", 
              "id": "https://www.grid.ac/institutes/grid.5252.0", 
              "name": [
                "LMU Munich, Munich, Germany"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Phan", 
            "givenName": "Thomy", 
            "id": "sg:person.015015203124.66", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.015015203124.66"
            ], 
            "type": "Person"
          }, 
          {
            "affiliation": {
              "alternateName": "Ludwig Maximilian University of Munich", 
              "id": "https://www.grid.ac/institutes/grid.5252.0", 
              "name": [
                "LMU Munich, Munich, Germany"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Gabor", 
            "givenName": "Thomas", 
            "id": "sg:person.016361124677.30", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.016361124677.30"
            ], 
            "type": "Person"
          }, 
          {
            "affiliation": {
              "alternateName": "Ludwig Maximilian University of Munich", 
              "id": "https://www.grid.ac/institutes/grid.5252.0", 
              "name": [
                "LMU Munich, Munich, Germany"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Wirsing", 
            "givenName": "Martin", 
            "id": "sg:person.010602274463.18", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010602274463.18"
            ], 
            "type": "Person"
          }
        ], 
        "citation": [
          {
            "id": "https://doi.org/10.1016/b978-1-55860-307-3.50049-6", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1005298406"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/978-1-4419-1153-7_131", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1028122692", 
              "https://doi.org/10.1007/978-1-4419-1153-7_131"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/978-1-4419-1153-7_131", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1028122692", 
              "https://doi.org/10.1007/978-1-4419-1153-7_131"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1016/0303-2647(95)01551-5", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1033414893"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1038/nature16961", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1039427823", 
              "https://doi.org/10.1038/nature16961"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1177/002200277301700302", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1045155753"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1177/002200277301700302", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1045155753"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1016/s1574-6526(07)03024-6", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1053048724"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1073/pnas.39.10.1953", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1058212297"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1371/journal.pone.0172395", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1084622519"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/978-3-319-46508-1_10", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1084848846", 
              "https://doi.org/10.1007/978-3-319-46508-1_10"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1038/nature24270", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1092261951", 
              "https://doi.org/10.1038/nature24270"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1038/nature24270", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1092261951", 
              "https://doi.org/10.1038/nature24270"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1613/jair.5565", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1105690159"
            ], 
            "type": "CreativeWork"
          }
        ], 
        "datePublished": "2018-10-31", 
        "datePublishedReg": "2018-10-31", 
        "description": "In collective adaptive systems (CAS), adaptation can be implemented by optimization wrt. utility. Agents in a CAS may be self-interested, while their utilities may depend on other agents\u2019 choices. Independent optimization of agent utilities may yield poor individual and global reward due to locally interfering individual preferences. Joint optimization may scale poorly, and is impossible if agents cannot expose their preferences due to privacy or security issues. In this paper, we study utility sharing for mitigating this issue. Sharing utility with others may incentivize individuals to consider choices that are locally suboptimal but increase global reward. We illustrate our approach with a utility sharing variant of distributed cross entropy optimization. Empirical results show that utility sharing increases expected individual and global payoff in comparison to optimization without utility sharing. We also investigate the effect of greedy defectors in a CAS of sharing, self-interested agents. We observe that defection increases the mean expected individual payoff at the expense of sharing individuals\u2019 payoff. We empirically show that the choice between defection and sharing yields a fundamental dilemma for self-interested agents in a CAS.", 
        "editor": [
          {
            "familyName": "Margaria", 
            "givenName": "Tiziana", 
            "type": "Person"
          }, 
          {
            "familyName": "Steffen", 
            "givenName": "Bernhard", 
            "type": "Person"
          }
        ], 
        "genre": "chapter", 
        "id": "sg:pub.10.1007/978-3-030-03424-5_16", 
        "inLanguage": [
          "en"
        ], 
        "isAccessibleForFree": true, 
        "isPartOf": {
          "isbn": [
            "978-3-030-03423-8", 
            "978-3-030-03424-5"
          ], 
          "name": "Leveraging Applications of Formal Methods, Verification and Validation. Distributed Systems", 
          "type": "Book"
        }, 
        "name": "The Sharer\u2019s Dilemma in Collective Adaptive Systems of Self-interested Agents", 
        "pagination": "241-256", 
        "productId": [
          {
            "name": "doi", 
            "type": "PropertyValue", 
            "value": [
              "10.1007/978-3-030-03424-5_16"
            ]
          }, 
          {
            "name": "readcube_id", 
            "type": "PropertyValue", 
            "value": [
              "5d35fec8fb72d2ffe8f04f7732a4e19da120cb021dd032e583b86514b05760ef"
            ]
          }, 
          {
            "name": "dimensions_id", 
            "type": "PropertyValue", 
            "value": [
              "pub.1107922857"
            ]
          }
        ], 
        "publisher": {
          "location": "Cham", 
          "name": "Springer International Publishing", 
          "type": "Organisation"
        }, 
        "sameAs": [
          "https://doi.org/10.1007/978-3-030-03424-5_16", 
          "https://app.dimensions.ai/details/publication/pub.1107922857"
        ], 
        "sdDataset": "chapters", 
        "sdDatePublished": "2019-04-16T04:41", 
        "sdLicense": "https://scigraph.springernature.com/explorer/license/", 
        "sdPublisher": {
          "name": "Springer Nature - SN SciGraph project", 
          "type": "Organization"
        }, 
        "sdSource": "s3://com-uberresearch-data-dimensions-target-20181106-alternative/cleanup/v134/2549eaecd7973599484d7c17b260dba0a4ecb94b/merge/v9/a6c9fde33151104705d4d7ff012ea9563521a3ce/jats-lookup/v90/0000000322_0000000322/records_65008_00000000.jsonl", 
        "type": "Chapter", 
        "url": "https://link.springer.com/10.1007%2F978-3-030-03424-5_16"
      }
    ]
     

    Download the RDF metadata as:  json-ld nt turtle xml License info

    HOW TO GET THIS DATA PROGRAMMATICALLY:

    JSON-LD is a popular format for linked data which is fully compatible with JSON.

    curl -H 'Accept: application/ld+json' 'https://scigraph.springernature.com/pub.10.1007/978-3-030-03424-5_16'

    N-Triples is a line-based linked data format ideal for batch operations.

    curl -H 'Accept: application/n-triples' 'https://scigraph.springernature.com/pub.10.1007/978-3-030-03424-5_16'

    Turtle is a human-readable linked data format.

    curl -H 'Accept: text/turtle' 'https://scigraph.springernature.com/pub.10.1007/978-3-030-03424-5_16'

    RDF/XML is a standard XML format for linked data.

    curl -H 'Accept: application/rdf+xml' 'https://scigraph.springernature.com/pub.10.1007/978-3-030-03424-5_16'


     

    This table displays all metadata directly associated to this object as RDF triples.

    137 TRIPLES      23 PREDICATES      37 URIs      19 LITERALS      8 BLANK NODES

    Subject Predicate Object
    1 sg:pub.10.1007/978-3-030-03424-5_16 schema:about anzsrc-for:01
    2 anzsrc-for:0103
    3 schema:author N005a465e24d34f32ab5b051a66d9bce2
    4 schema:citation sg:pub.10.1007/978-1-4419-1153-7_131
    5 sg:pub.10.1007/978-3-319-46508-1_10
    6 sg:pub.10.1038/nature16961
    7 sg:pub.10.1038/nature24270
    8 https://doi.org/10.1016/0303-2647(95)01551-5
    9 https://doi.org/10.1016/b978-1-55860-307-3.50049-6
    10 https://doi.org/10.1016/s1574-6526(07)03024-6
    11 https://doi.org/10.1073/pnas.39.10.1953
    12 https://doi.org/10.1177/002200277301700302
    13 https://doi.org/10.1371/journal.pone.0172395
    14 https://doi.org/10.1613/jair.5565
    15 schema:datePublished 2018-10-31
    16 schema:datePublishedReg 2018-10-31
    17 schema:description In collective adaptive systems (CAS), adaptation can be implemented by optimization wrt. utility. Agents in a CAS may be self-interested, while their utilities may depend on other agents’ choices. Independent optimization of agent utilities may yield poor individual and global reward due to locally interfering individual preferences. Joint optimization may scale poorly, and is impossible if agents cannot expose their preferences due to privacy or security issues. In this paper, we study utility sharing for mitigating this issue. Sharing utility with others may incentivize individuals to consider choices that are locally suboptimal but increase global reward. We illustrate our approach with a utility sharing variant of distributed cross entropy optimization. Empirical results show that utility sharing increases expected individual and global payoff in comparison to optimization without utility sharing. We also investigate the effect of greedy defectors in a CAS of sharing, self-interested agents. We observe that defection increases the mean expected individual payoff at the expense of sharing individuals’ payoff. We empirically show that the choice between defection and sharing yields a fundamental dilemma for self-interested agents in a CAS.
    18 schema:editor Ne5ec3ceb2c724cdb9956f4faefc5a099
    19 schema:genre chapter
    20 schema:inLanguage en
    21 schema:isAccessibleForFree true
    22 schema:isPartOf Ncec267959b544538a8c8418c91cd482f
    23 schema:name The Sharer’s Dilemma in Collective Adaptive Systems of Self-interested Agents
    24 schema:pagination 241-256
    25 schema:productId N339c8c0e2aaf4024b8bbb0da59345ff0
    26 N3549d11b9e9d45208633ba781067b303
    27 N51701cfc92cc4faaac9a5050d18152e7
    28 schema:publisher N5c4ac888adbf458c958cb85268e4a465
    29 schema:sameAs https://app.dimensions.ai/details/publication/pub.1107922857
    30 https://doi.org/10.1007/978-3-030-03424-5_16
    31 schema:sdDatePublished 2019-04-16T04:41
    32 schema:sdLicense https://scigraph.springernature.com/explorer/license/
    33 schema:sdPublisher N4a2d4d48b19446db93a54c36d21384e2
    34 schema:url https://link.springer.com/10.1007%2F978-3-030-03424-5_16
    35 sgo:license sg:explorer/license/
    36 sgo:sdDataset chapters
    37 rdf:type schema:Chapter
    38 N005a465e24d34f32ab5b051a66d9bce2 rdf:first sg:person.015152211751.65
    39 rdf:rest N7b8c6738b4c04d45862b2cb88627f7b0
    40 N19609bd04ec0449086fdef2011c39fe9 schema:familyName Steffen
    41 schema:givenName Bernhard
    42 rdf:type schema:Person
    43 N339c8c0e2aaf4024b8bbb0da59345ff0 schema:name doi
    44 schema:value 10.1007/978-3-030-03424-5_16
    45 rdf:type schema:PropertyValue
    46 N3549d11b9e9d45208633ba781067b303 schema:name readcube_id
    47 schema:value 5d35fec8fb72d2ffe8f04f7732a4e19da120cb021dd032e583b86514b05760ef
    48 rdf:type schema:PropertyValue
    49 N4a2d4d48b19446db93a54c36d21384e2 schema:name Springer Nature - SN SciGraph project
    50 rdf:type schema:Organization
    51 N4d90503ce4b041f7bffccdc4b6270cee rdf:first sg:person.010602274463.18
    52 rdf:rest rdf:nil
    53 N51701cfc92cc4faaac9a5050d18152e7 schema:name dimensions_id
    54 schema:value pub.1107922857
    55 rdf:type schema:PropertyValue
    56 N5c4ac888adbf458c958cb85268e4a465 schema:location Cham
    57 schema:name Springer International Publishing
    58 rdf:type schema:Organisation
    59 N791593df56a2416a81c7a33a6099f062 rdf:first sg:person.016361124677.30
    60 rdf:rest N4d90503ce4b041f7bffccdc4b6270cee
    61 N7b8c6738b4c04d45862b2cb88627f7b0 rdf:first sg:person.016342030724.89
    62 rdf:rest N9f1395181eb4469494fd59f8fc7dcc04
    63 N9f1395181eb4469494fd59f8fc7dcc04 rdf:first sg:person.015015203124.66
    64 rdf:rest N791593df56a2416a81c7a33a6099f062
    65 Nc8e25b62e7fd4c3d9d69a29bbba78932 schema:familyName Margaria
    66 schema:givenName Tiziana
    67 rdf:type schema:Person
    68 Ncec267959b544538a8c8418c91cd482f schema:isbn 978-3-030-03423-8
    69 978-3-030-03424-5
    70 schema:name Leveraging Applications of Formal Methods, Verification and Validation. Distributed Systems
    71 rdf:type schema:Book
    72 Ncf8e36f4c0fd4d2eac73b7859b62dc38 schema:name MaibornWolff, Munich, Germany
    73 rdf:type schema:Organization
    74 Nd8f8a37831204088a6fd1a546c6005af rdf:first N19609bd04ec0449086fdef2011c39fe9
    75 rdf:rest rdf:nil
    76 Ne5ec3ceb2c724cdb9956f4faefc5a099 rdf:first Nc8e25b62e7fd4c3d9d69a29bbba78932
    77 rdf:rest Nd8f8a37831204088a6fd1a546c6005af
    78 anzsrc-for:01 schema:inDefinedTermSet anzsrc-for:
    79 schema:name Mathematical Sciences
    80 rdf:type schema:DefinedTerm
    81 anzsrc-for:0103 schema:inDefinedTermSet anzsrc-for:
    82 schema:name Numerical and Computational Mathematics
    83 rdf:type schema:DefinedTerm
    84 sg:person.010602274463.18 schema:affiliation https://www.grid.ac/institutes/grid.5252.0
    85 schema:familyName Wirsing
    86 schema:givenName Martin
    87 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010602274463.18
    88 rdf:type schema:Person
    89 sg:person.015015203124.66 schema:affiliation https://www.grid.ac/institutes/grid.5252.0
    90 schema:familyName Phan
    91 schema:givenName Thomy
    92 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.015015203124.66
    93 rdf:type schema:Person
    94 sg:person.015152211751.65 schema:affiliation Ncf8e36f4c0fd4d2eac73b7859b62dc38
    95 schema:familyName Belzner
    96 schema:givenName Lenz
    97 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.015152211751.65
    98 rdf:type schema:Person
    99 sg:person.016342030724.89 schema:affiliation https://www.grid.ac/institutes/grid.5252.0
    100 schema:familyName Schmid
    101 schema:givenName Kyrill
    102 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.016342030724.89
    103 rdf:type schema:Person
    104 sg:person.016361124677.30 schema:affiliation https://www.grid.ac/institutes/grid.5252.0
    105 schema:familyName Gabor
    106 schema:givenName Thomas
    107 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.016361124677.30
    108 rdf:type schema:Person
    109 sg:pub.10.1007/978-1-4419-1153-7_131 schema:sameAs https://app.dimensions.ai/details/publication/pub.1028122692
    110 https://doi.org/10.1007/978-1-4419-1153-7_131
    111 rdf:type schema:CreativeWork
    112 sg:pub.10.1007/978-3-319-46508-1_10 schema:sameAs https://app.dimensions.ai/details/publication/pub.1084848846
    113 https://doi.org/10.1007/978-3-319-46508-1_10
    114 rdf:type schema:CreativeWork
    115 sg:pub.10.1038/nature16961 schema:sameAs https://app.dimensions.ai/details/publication/pub.1039427823
    116 https://doi.org/10.1038/nature16961
    117 rdf:type schema:CreativeWork
    118 sg:pub.10.1038/nature24270 schema:sameAs https://app.dimensions.ai/details/publication/pub.1092261951
    119 https://doi.org/10.1038/nature24270
    120 rdf:type schema:CreativeWork
    121 https://doi.org/10.1016/0303-2647(95)01551-5 schema:sameAs https://app.dimensions.ai/details/publication/pub.1033414893
    122 rdf:type schema:CreativeWork
    123 https://doi.org/10.1016/b978-1-55860-307-3.50049-6 schema:sameAs https://app.dimensions.ai/details/publication/pub.1005298406
    124 rdf:type schema:CreativeWork
    125 https://doi.org/10.1016/s1574-6526(07)03024-6 schema:sameAs https://app.dimensions.ai/details/publication/pub.1053048724
    126 rdf:type schema:CreativeWork
    127 https://doi.org/10.1073/pnas.39.10.1953 schema:sameAs https://app.dimensions.ai/details/publication/pub.1058212297
    128 rdf:type schema:CreativeWork
    129 https://doi.org/10.1177/002200277301700302 schema:sameAs https://app.dimensions.ai/details/publication/pub.1045155753
    130 rdf:type schema:CreativeWork
    131 https://doi.org/10.1371/journal.pone.0172395 schema:sameAs https://app.dimensions.ai/details/publication/pub.1084622519
    132 rdf:type schema:CreativeWork
    133 https://doi.org/10.1613/jair.5565 schema:sameAs https://app.dimensions.ai/details/publication/pub.1105690159
    134 rdf:type schema:CreativeWork
    135 https://www.grid.ac/institutes/grid.5252.0 schema:alternateName Ludwig Maximilian University of Munich
    136 schema:name LMU Munich, Munich, Germany
    137 rdf:type schema:Organization
     




    Preview window. Press ESC to close (or click here)


    ...