Assigning Papers to Referees View Full Text


Ontology type: schema:ScholarlyArticle      Open Access: True


Article Info

DATE

2010-01-12

AUTHORS

Naveen Garg, Telikepalli Kavitha, Amit Kumar, Kurt Mehlhorn, Julián Mestre

ABSTRACT

Refereed conferences require every submission to be reviewed by members of a program committee (PC) in charge of selecting the conference program. There are many software packages available to manage the review process. Typically, in a bidding phase PC members express their personal preferences by ranking the submissions. This information is used by the system to compute an assignment of the papers to referees (PC members).We study the problem of assigning papers to referees. We propose to optimize a number of criteria that aim at achieving fairness among referees/papers. Some of these variants can be solved optimally in polynomial time, while others are NP-hard, in which case we design approximation algorithms. Experimental results strongly suggest that the assignments computed by our algorithms are considerably better than those computed by popular conference management software. More... »

PAGES

119-136

References to SciGraph publications

  • 1999-09. Strategy-proof allocation of indivisible goods in SOCIAL CHOICE AND WELFARE
  • 1993-02. An approximation algorithm for the generalized assignment problem in MATHEMATICAL PROGRAMMING
  • 1990-01. Approximation algorithms for scheduling unrelated parallel machines in MATHEMATICAL PROGRAMMING
  • 2004. Conference Paper Assignment Using a Combined Greedy/Evolutionary Algorithm in PARALLEL PROBLEM SOLVING FROM NATURE - PPSN VIII
  • 2008-01-01. A Survey on Reviewer Assignment Problem in NEW FRONTIERS IN APPLIED ARTIFICIAL INTELLIGENCE
  • 1972. Reducibility among Combinatorial Problems in COMPLEXITY OF COMPUTER COMPUTATIONS
  • Identifiers

    URI

    http://scigraph.springernature.com/pub.10.1007/s00453-009-9386-0

    DOI

    http://dx.doi.org/10.1007/s00453-009-9386-0

    DIMENSIONS

    https://app.dimensions.ai/details/publication/pub.1014566788


    Indexing Status Check whether this publication has been indexed by Scopus and Web Of Science using the SN Indexing Status Tool
    Incoming Citations Browse incoming citations for this publication using opencitations.net

    JSON-LD is the canonical representation for SciGraph data.

    TIP: You can open this SciGraph record using an external JSON-LD service: JSON-LD Playground Google SDTT

    [
      {
        "@context": "https://springernature.github.io/scigraph/jsonld/sgcontext.json", 
        "about": [
          {
            "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/08", 
            "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
            "name": "Information and Computing Sciences", 
            "type": "DefinedTerm"
          }, 
          {
            "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/0802", 
            "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
            "name": "Computation Theory and Mathematics", 
            "type": "DefinedTerm"
          }
        ], 
        "author": [
          {
            "affiliation": {
              "alternateName": "Computer Science and Engineering, Indian Institute of Technology, New Delhi, India", 
              "id": "http://www.grid.ac/institutes/grid.417967.a", 
              "name": [
                "Computer Science and Engineering, Indian Institute of Technology, New Delhi, India"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Garg", 
            "givenName": "Naveen", 
            "id": "sg:person.015560532267.82", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.015560532267.82"
            ], 
            "type": "Person"
          }, 
          {
            "affiliation": {
              "alternateName": "Department of Computer Science and Automation, Indian Institute of Science, Bangalore, India", 
              "id": "http://www.grid.ac/institutes/grid.34980.36", 
              "name": [
                "Department of Computer Science and Automation, Indian Institute of Science, Bangalore, India"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Kavitha", 
            "givenName": "Telikepalli", 
            "id": "sg:person.015551052213.83", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.015551052213.83"
            ], 
            "type": "Person"
          }, 
          {
            "affiliation": {
              "alternateName": "Computer Science and Engineering, Indian Institute of Technology, New Delhi, India", 
              "id": "http://www.grid.ac/institutes/grid.417967.a", 
              "name": [
                "Computer Science and Engineering, Indian Institute of Technology, New Delhi, India"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Kumar", 
            "givenName": "Amit", 
            "id": "sg:person.011101072313.70", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.011101072313.70"
            ], 
            "type": "Person"
          }, 
          {
            "affiliation": {
              "alternateName": "Max-Planck-Institut f\u00fcr Informatik, 66123, Saarbr\u00fccken, Germany", 
              "id": "http://www.grid.ac/institutes/grid.419528.3", 
              "name": [
                "Max-Planck-Institut f\u00fcr Informatik, 66123, Saarbr\u00fccken, Germany"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Mehlhorn", 
            "givenName": "Kurt", 
            "id": "sg:person.011757371347.43", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.011757371347.43"
            ], 
            "type": "Person"
          }, 
          {
            "affiliation": {
              "alternateName": "Max-Planck-Institut f\u00fcr Informatik, 66123, Saarbr\u00fccken, Germany", 
              "id": "http://www.grid.ac/institutes/grid.419528.3", 
              "name": [
                "Max-Planck-Institut f\u00fcr Informatik, 66123, Saarbr\u00fccken, Germany"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Mestre", 
            "givenName": "Juli\u00e1n", 
            "id": "sg:person.011213001575.22", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.011213001575.22"
            ], 
            "type": "Person"
          }
        ], 
        "citation": [
          {
            "id": "sg:pub.10.1007/s003550050160", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1012917704", 
              "https://doi.org/10.1007/s003550050160"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/bf01585178", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1032899049", 
              "https://doi.org/10.1007/bf01585178"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/bf01585745", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1006292857", 
              "https://doi.org/10.1007/bf01585745"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/978-3-540-30217-9_61", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1044469140", 
              "https://doi.org/10.1007/978-3-540-30217-9_61"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/978-3-540-69052-8_75", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1017486144", 
              "https://doi.org/10.1007/978-3-540-69052-8_75"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/978-1-4684-2001-2_9", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1007977430", 
              "https://doi.org/10.1007/978-1-4684-2001-2_9"
            ], 
            "type": "CreativeWork"
          }
        ], 
        "datePublished": "2010-01-12", 
        "datePublishedReg": "2010-01-12", 
        "description": "Refereed conferences require every submission to be reviewed by members of a program committee (PC) in charge of selecting the conference program. There are many software packages available to manage the review process. Typically, in a bidding phase PC members express their personal preferences by ranking the submissions. This information is used by the system to compute an assignment of the papers to referees (PC members).We study the problem of assigning papers to referees. We propose to optimize a number of criteria that aim at achieving fairness among referees/papers. Some of these variants can be solved optimally in polynomial time, while others are NP-hard, in which case we design approximation algorithms. Experimental results strongly suggest that the assignments computed by our algorithms are considerably better than those computed by popular conference management software.", 
        "genre": "article", 
        "id": "sg:pub.10.1007/s00453-009-9386-0", 
        "isAccessibleForFree": true, 
        "isPartOf": [
          {
            "id": "sg:journal.1047644", 
            "issn": [
              "0178-4617", 
              "1432-0541"
            ], 
            "name": "Algorithmica", 
            "publisher": "Springer Nature", 
            "type": "Periodical"
          }, 
          {
            "issueNumber": "1", 
            "type": "PublicationIssue"
          }, 
          {
            "type": "PublicationVolume", 
            "volumeNumber": "58"
          }
        ], 
        "keywords": [
          "refereed conferences", 
          "management software", 
          "polynomial time", 
          "approximation algorithm", 
          "software package", 
          "experimental results", 
          "algorithm", 
          "personal preferences", 
          "Program Committee", 
          "PC members", 
          "number of criteria", 
          "software", 
          "submission", 
          "fairness", 
          "NPs", 
          "assignment", 
          "information", 
          "conference program", 
          "package", 
          "review process", 
          "system", 
          "referees", 
          "number", 
          "process", 
          "preferences", 
          "time", 
          "program", 
          "results", 
          "variants", 
          "conference", 
          "criteria", 
          "cases", 
          "members", 
          "Committee", 
          "charge", 
          "paper", 
          "problem"
        ], 
        "name": "Assigning Papers to Referees", 
        "pagination": "119-136", 
        "productId": [
          {
            "name": "dimensions_id", 
            "type": "PropertyValue", 
            "value": [
              "pub.1014566788"
            ]
          }, 
          {
            "name": "doi", 
            "type": "PropertyValue", 
            "value": [
              "10.1007/s00453-009-9386-0"
            ]
          }
        ], 
        "sameAs": [
          "https://doi.org/10.1007/s00453-009-9386-0", 
          "https://app.dimensions.ai/details/publication/pub.1014566788"
        ], 
        "sdDataset": "articles", 
        "sdDatePublished": "2022-09-02T15:55", 
        "sdLicense": "https://scigraph.springernature.com/explorer/license/", 
        "sdPublisher": {
          "name": "Springer Nature - SN SciGraph project", 
          "type": "Organization"
        }, 
        "sdSource": "s3://com-springernature-scigraph/baseset/20220902/entities/gbq_results/article/article_515.jsonl", 
        "type": "ScholarlyArticle", 
        "url": "https://doi.org/10.1007/s00453-009-9386-0"
      }
    ]
     

    Download the RDF metadata as:  json-ld nt turtle xml License info

    HOW TO GET THIS DATA PROGRAMMATICALLY:

    JSON-LD is a popular format for linked data which is fully compatible with JSON.

    curl -H 'Accept: application/ld+json' 'https://scigraph.springernature.com/pub.10.1007/s00453-009-9386-0'

    N-Triples is a line-based linked data format ideal for batch operations.

    curl -H 'Accept: application/n-triples' 'https://scigraph.springernature.com/pub.10.1007/s00453-009-9386-0'

    Turtle is a human-readable linked data format.

    curl -H 'Accept: text/turtle' 'https://scigraph.springernature.com/pub.10.1007/s00453-009-9386-0'

    RDF/XML is a standard XML format for linked data.

    curl -H 'Accept: application/rdf+xml' 'https://scigraph.springernature.com/pub.10.1007/s00453-009-9386-0'


     

    This table displays all metadata directly associated to this object as RDF triples.

    152 TRIPLES      21 PREDICATES      67 URIs      53 LITERALS      6 BLANK NODES

    Subject Predicate Object
    1 sg:pub.10.1007/s00453-009-9386-0 schema:about anzsrc-for:08
    2 anzsrc-for:0802
    3 schema:author Nd488aea6fb5e4a84b140260905bcf0f3
    4 schema:citation sg:pub.10.1007/978-1-4684-2001-2_9
    5 sg:pub.10.1007/978-3-540-30217-9_61
    6 sg:pub.10.1007/978-3-540-69052-8_75
    7 sg:pub.10.1007/bf01585178
    8 sg:pub.10.1007/bf01585745
    9 sg:pub.10.1007/s003550050160
    10 schema:datePublished 2010-01-12
    11 schema:datePublishedReg 2010-01-12
    12 schema:description Refereed conferences require every submission to be reviewed by members of a program committee (PC) in charge of selecting the conference program. There are many software packages available to manage the review process. Typically, in a bidding phase PC members express their personal preferences by ranking the submissions. This information is used by the system to compute an assignment of the papers to referees (PC members).We study the problem of assigning papers to referees. We propose to optimize a number of criteria that aim at achieving fairness among referees/papers. Some of these variants can be solved optimally in polynomial time, while others are NP-hard, in which case we design approximation algorithms. Experimental results strongly suggest that the assignments computed by our algorithms are considerably better than those computed by popular conference management software.
    13 schema:genre article
    14 schema:isAccessibleForFree true
    15 schema:isPartOf N6551e394a7f14179b789b002fd84dd41
    16 N8244f3fd18894b86a160415492a6a9b7
    17 sg:journal.1047644
    18 schema:keywords Committee
    19 NPs
    20 PC members
    21 Program Committee
    22 algorithm
    23 approximation algorithm
    24 assignment
    25 cases
    26 charge
    27 conference
    28 conference program
    29 criteria
    30 experimental results
    31 fairness
    32 information
    33 management software
    34 members
    35 number
    36 number of criteria
    37 package
    38 paper
    39 personal preferences
    40 polynomial time
    41 preferences
    42 problem
    43 process
    44 program
    45 refereed conferences
    46 referees
    47 results
    48 review process
    49 software
    50 software package
    51 submission
    52 system
    53 time
    54 variants
    55 schema:name Assigning Papers to Referees
    56 schema:pagination 119-136
    57 schema:productId N66ca5be44d6f4157822066815ad32354
    58 N7661d277fd8543fab9f5bde38a2d7f0c
    59 schema:sameAs https://app.dimensions.ai/details/publication/pub.1014566788
    60 https://doi.org/10.1007/s00453-009-9386-0
    61 schema:sdDatePublished 2022-09-02T15:55
    62 schema:sdLicense https://scigraph.springernature.com/explorer/license/
    63 schema:sdPublisher N5a57c717332a458abe063bd14d7b839d
    64 schema:url https://doi.org/10.1007/s00453-009-9386-0
    65 sgo:license sg:explorer/license/
    66 sgo:sdDataset articles
    67 rdf:type schema:ScholarlyArticle
    68 N0094a270d24b4bf686c37df002966caf rdf:first sg:person.011101072313.70
    69 rdf:rest N636a5f502c164499b77e35f55a595d26
    70 N37112ba923ee4e9f9b2716ddd84de33a rdf:first sg:person.015551052213.83
    71 rdf:rest N0094a270d24b4bf686c37df002966caf
    72 N5a57c717332a458abe063bd14d7b839d schema:name Springer Nature - SN SciGraph project
    73 rdf:type schema:Organization
    74 N619bfb6fdf8448fbb9806ae0a327b091 rdf:first sg:person.011213001575.22
    75 rdf:rest rdf:nil
    76 N636a5f502c164499b77e35f55a595d26 rdf:first sg:person.011757371347.43
    77 rdf:rest N619bfb6fdf8448fbb9806ae0a327b091
    78 N6551e394a7f14179b789b002fd84dd41 schema:issueNumber 1
    79 rdf:type schema:PublicationIssue
    80 N66ca5be44d6f4157822066815ad32354 schema:name doi
    81 schema:value 10.1007/s00453-009-9386-0
    82 rdf:type schema:PropertyValue
    83 N7661d277fd8543fab9f5bde38a2d7f0c schema:name dimensions_id
    84 schema:value pub.1014566788
    85 rdf:type schema:PropertyValue
    86 N8244f3fd18894b86a160415492a6a9b7 schema:volumeNumber 58
    87 rdf:type schema:PublicationVolume
    88 Nd488aea6fb5e4a84b140260905bcf0f3 rdf:first sg:person.015560532267.82
    89 rdf:rest N37112ba923ee4e9f9b2716ddd84de33a
    90 anzsrc-for:08 schema:inDefinedTermSet anzsrc-for:
    91 schema:name Information and Computing Sciences
    92 rdf:type schema:DefinedTerm
    93 anzsrc-for:0802 schema:inDefinedTermSet anzsrc-for:
    94 schema:name Computation Theory and Mathematics
    95 rdf:type schema:DefinedTerm
    96 sg:journal.1047644 schema:issn 0178-4617
    97 1432-0541
    98 schema:name Algorithmica
    99 schema:publisher Springer Nature
    100 rdf:type schema:Periodical
    101 sg:person.011101072313.70 schema:affiliation grid-institutes:grid.417967.a
    102 schema:familyName Kumar
    103 schema:givenName Amit
    104 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.011101072313.70
    105 rdf:type schema:Person
    106 sg:person.011213001575.22 schema:affiliation grid-institutes:grid.419528.3
    107 schema:familyName Mestre
    108 schema:givenName Julián
    109 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.011213001575.22
    110 rdf:type schema:Person
    111 sg:person.011757371347.43 schema:affiliation grid-institutes:grid.419528.3
    112 schema:familyName Mehlhorn
    113 schema:givenName Kurt
    114 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.011757371347.43
    115 rdf:type schema:Person
    116 sg:person.015551052213.83 schema:affiliation grid-institutes:grid.34980.36
    117 schema:familyName Kavitha
    118 schema:givenName Telikepalli
    119 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.015551052213.83
    120 rdf:type schema:Person
    121 sg:person.015560532267.82 schema:affiliation grid-institutes:grid.417967.a
    122 schema:familyName Garg
    123 schema:givenName Naveen
    124 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.015560532267.82
    125 rdf:type schema:Person
    126 sg:pub.10.1007/978-1-4684-2001-2_9 schema:sameAs https://app.dimensions.ai/details/publication/pub.1007977430
    127 https://doi.org/10.1007/978-1-4684-2001-2_9
    128 rdf:type schema:CreativeWork
    129 sg:pub.10.1007/978-3-540-30217-9_61 schema:sameAs https://app.dimensions.ai/details/publication/pub.1044469140
    130 https://doi.org/10.1007/978-3-540-30217-9_61
    131 rdf:type schema:CreativeWork
    132 sg:pub.10.1007/978-3-540-69052-8_75 schema:sameAs https://app.dimensions.ai/details/publication/pub.1017486144
    133 https://doi.org/10.1007/978-3-540-69052-8_75
    134 rdf:type schema:CreativeWork
    135 sg:pub.10.1007/bf01585178 schema:sameAs https://app.dimensions.ai/details/publication/pub.1032899049
    136 https://doi.org/10.1007/bf01585178
    137 rdf:type schema:CreativeWork
    138 sg:pub.10.1007/bf01585745 schema:sameAs https://app.dimensions.ai/details/publication/pub.1006292857
    139 https://doi.org/10.1007/bf01585745
    140 rdf:type schema:CreativeWork
    141 sg:pub.10.1007/s003550050160 schema:sameAs https://app.dimensions.ai/details/publication/pub.1012917704
    142 https://doi.org/10.1007/s003550050160
    143 rdf:type schema:CreativeWork
    144 grid-institutes:grid.34980.36 schema:alternateName Department of Computer Science and Automation, Indian Institute of Science, Bangalore, India
    145 schema:name Department of Computer Science and Automation, Indian Institute of Science, Bangalore, India
    146 rdf:type schema:Organization
    147 grid-institutes:grid.417967.a schema:alternateName Computer Science and Engineering, Indian Institute of Technology, New Delhi, India
    148 schema:name Computer Science and Engineering, Indian Institute of Technology, New Delhi, India
    149 rdf:type schema:Organization
    150 grid-institutes:grid.419528.3 schema:alternateName Max-Planck-Institut für Informatik, 66123, Saarbrücken, Germany
    151 schema:name Max-Planck-Institut für Informatik, 66123, Saarbrücken, Germany
    152 rdf:type schema:Organization
     




    Preview window. Press ESC to close (or click here)


    ...