CLEF 2001 — Overview of Results View Full Text


Ontology type: schema:Chapter     


Chapter Info

DATE

2002

AUTHORS

Martin Braschler

ABSTRACT

CLEF, the Cross-Language Evaluation Forum, continued to grow substantially in the second year of its existence. Building on the success of the first CLEF campaign in 2000 and of its predecessors, the TREC cross-language tracks, CLEF 2001 attracted 34 participating groups which submitted nearly 200 different result sets. A description of the various tracks, and a summary of the main results and research directions are given in this overview. In addition, the CLEF multilingual test collection is examined with respect to the completeness of its relevance assessments. The analysis indicates that the test collection is stable and well suited for use in future evaluations. More... »

PAGES

9-26

References to SciGraph publications

  • 2002. ITC-irst at CLEF 2001: Monolingual and Bilingual Tracks in EVALUATION OF CROSS-LANGUAGE INFORMATION RETRIEVAL SYSTEMS
  • 2002. Multilingual Information Retrieval Using English and Chinese Queries in EVALUATION OF CROSS-LANGUAGE INFORMATION RETRIEVAL SYSTEMS
  • 2002. Using Co-occurrence, Augmented Restrictions, and C-E WordNet for Chinese-English Cross-Language Information Retrieval at CLEF 2001 in EVALUATION OF CROSS-LANGUAGE INFORMATION RETRIEVAL SYSTEMS
  • 2002. Shallow Morphological Analysis in Monolingual Information Retrieval for Dutch, German, and Italian in EVALUATION OF CROSS-LANGUAGE INFORMATION RETRIEVAL SYSTEMS
  • 2002. The CLEF 2001 Interactive Track in EVALUATION OF CROSS-LANGUAGE INFORMATION RETRIEVAL SYSTEMS
  • 2002. Working with Russian Queries for the GIRT, Bilingual, and Multilingual CLEF Tasks in EVALUATION OF CROSS-LANGUAGE INFORMATION RETRIEVAL SYSTEMS
  • 2001. CLIR Evaluation at TREC in CROSS-LANGUAGE INFORMATION RETRIEVAL AND EVALUATION
  • 2002. Vector-Based Semantic Analysis Using Random Indexing for Cross-Lingual Query Expansion in EVALUATION OF CROSS-LANGUAGE INFORMATION RETRIEVAL SYSTEMS
  • 2001. CLEF 2000 — Overview of Results in CROSS-LANGUAGE INFORMATION RETRIEVAL AND EVALUATION
  • 2002. JHU/APL Experiments at CLEF: Translation Resources and Score Normalization in EVALUATION OF CROSS-LANGUAGE INFORMATION RETRIEVAL SYSTEMS
  • Book

    TITLE

    Evaluation of Cross-Language Information Retrieval Systems

    ISBN

    978-3-540-44042-0
    978-3-540-45691-9

    Identifiers

    URI

    http://scigraph.springernature.com/pub.10.1007/3-540-45691-0_2

    DOI

    http://dx.doi.org/10.1007/3-540-45691-0_2

    DIMENSIONS

    https://app.dimensions.ai/details/publication/pub.1012089737


    Indexing Status Check whether this publication has been indexed by Scopus and Web Of Science using the SN Indexing Status Tool
    Incoming Citations Browse incoming citations for this publication using opencitations.net

    JSON-LD is the canonical representation for SciGraph data.

    TIP: You can open this SciGraph record using an external JSON-LD service: JSON-LD Playground Google SDTT

    [
      {
        "@context": "https://springernature.github.io/scigraph/jsonld/sgcontext.json", 
        "about": [
          {
            "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/2004", 
            "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
            "name": "Linguistics", 
            "type": "DefinedTerm"
          }, 
          {
            "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/20", 
            "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
            "name": "Language, Communication and Culture", 
            "type": "DefinedTerm"
          }
        ], 
        "author": [
          {
            "affiliation": {
              "alternateName": "Eurospider Information Technology (Switzerland)", 
              "id": "https://www.grid.ac/institutes/grid.433769.c", 
              "name": [
                "Eurospider Information Technology AG, Schaffhauserstr. 18, 8006\u00a0Z\u00fcrich, Switzerland"
              ], 
              "type": "Organization"
            }, 
            "familyName": "Braschler", 
            "givenName": "Martin", 
            "id": "sg:person.015363630667.99", 
            "sameAs": [
              "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.015363630667.99"
            ], 
            "type": "Person"
          }
        ], 
        "citation": [
          {
            "id": "sg:pub.10.1007/3-540-45691-0_30", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1000755817", 
              "https://doi.org/10.1007/3-540-45691-0_30"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/3-540-45691-0_14", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1000950104", 
              "https://doi.org/10.1007/3-540-45691-0_14"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/3-540-45691-0_21", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1001318205", 
              "https://doi.org/10.1007/3-540-45691-0_21"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/3-540-45691-0_9", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1012139415", 
              "https://doi.org/10.1007/3-540-45691-0_9"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1002/asi.1164", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1012319733"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/3-540-44645-1_2", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1016014159", 
              "https://doi.org/10.1007/3-540-44645-1_2"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/3-540-45691-0_24", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1020330513", 
              "https://doi.org/10.1007/3-540-45691-0_24"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/3-540-45691-0_7", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1021484944", 
              "https://doi.org/10.1007/3-540-45691-0_7"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1145/160688.160758", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1021980312"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/3-540-45691-0_4", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1027161755", 
              "https://doi.org/10.1007/3-540-45691-0_4"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1016/0306-4573(92)90005-k", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1027935191"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1016/0306-4573(92)90005-k", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1027935191"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/3-540-45691-0_17", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1029748702", 
              "https://doi.org/10.1007/3-540-45691-0_17"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "sg:pub.10.1007/3-540-44645-1_9", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1037719018", 
              "https://doi.org/10.1007/3-540-44645-1_9"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1016/s0306-4573(99)00043-6", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1039173467"
            ], 
            "type": "CreativeWork"
          }, 
          {
            "id": "https://doi.org/10.1145/290941.291014", 
            "sameAs": [
              "https://app.dimensions.ai/details/publication/pub.1052200729"
            ], 
            "type": "CreativeWork"
          }
        ], 
        "datePublished": "2002", 
        "datePublishedReg": "2002-01-01", 
        "description": "CLEF, the Cross-Language Evaluation Forum, continued to grow substantially in the second year of its existence. Building on the success of the first CLEF campaign in 2000 and of its predecessors, the TREC cross-language tracks, CLEF 2001 attracted 34 participating groups which submitted nearly 200 different result sets. A description of the various tracks, and a summary of the main results and research directions are given in this overview. In addition, the CLEF multilingual test collection is examined with respect to the completeness of its relevance assessments. The analysis indicates that the test collection is stable and well suited for use in future evaluations.", 
        "editor": [
          {
            "familyName": "Peters", 
            "givenName": "Carol", 
            "type": "Person"
          }, 
          {
            "familyName": "Braschler", 
            "givenName": "Martin", 
            "type": "Person"
          }, 
          {
            "familyName": "Gonzalo", 
            "givenName": "Julio", 
            "type": "Person"
          }, 
          {
            "familyName": "Kluck", 
            "givenName": "Michael", 
            "type": "Person"
          }
        ], 
        "genre": "chapter", 
        "id": "sg:pub.10.1007/3-540-45691-0_2", 
        "inLanguage": [
          "en"
        ], 
        "isAccessibleForFree": false, 
        "isPartOf": {
          "isbn": [
            "978-3-540-44042-0", 
            "978-3-540-45691-9"
          ], 
          "name": "Evaluation of Cross-Language Information Retrieval Systems", 
          "type": "Book"
        }, 
        "name": "CLEF 2001 \u2014 Overview of Results", 
        "pagination": "9-26", 
        "productId": [
          {
            "name": "doi", 
            "type": "PropertyValue", 
            "value": [
              "10.1007/3-540-45691-0_2"
            ]
          }, 
          {
            "name": "readcube_id", 
            "type": "PropertyValue", 
            "value": [
              "3999f675062dd9c8dfccf45d72be5acfd95c6a3e74fde4bf0eaaeb11201c8db7"
            ]
          }, 
          {
            "name": "dimensions_id", 
            "type": "PropertyValue", 
            "value": [
              "pub.1012089737"
            ]
          }
        ], 
        "publisher": {
          "location": "Berlin, Heidelberg", 
          "name": "Springer Berlin Heidelberg", 
          "type": "Organisation"
        }, 
        "sameAs": [
          "https://doi.org/10.1007/3-540-45691-0_2", 
          "https://app.dimensions.ai/details/publication/pub.1012089737"
        ], 
        "sdDataset": "chapters", 
        "sdDatePublished": "2019-04-15T13:13", 
        "sdLicense": "https://scigraph.springernature.com/explorer/license/", 
        "sdPublisher": {
          "name": "Springer Nature - SN SciGraph project", 
          "type": "Organization"
        }, 
        "sdSource": "s3://com-uberresearch-data-dimensions-target-20181106-alternative/cleanup/v134/2549eaecd7973599484d7c17b260dba0a4ecb94b/merge/v9/a6c9fde33151104705d4d7ff012ea9563521a3ce/jats-lookup/v90/0000000001_0000000264/records_8664_00000020.jsonl", 
        "type": "Chapter", 
        "url": "http://link.springer.com/10.1007/3-540-45691-0_2"
      }
    ]
     

    Download the RDF metadata as:  json-ld nt turtle xml License info

    HOW TO GET THIS DATA PROGRAMMATICALLY:

    JSON-LD is a popular format for linked data which is fully compatible with JSON.

    curl -H 'Accept: application/ld+json' 'https://scigraph.springernature.com/pub.10.1007/3-540-45691-0_2'

    N-Triples is a line-based linked data format ideal for batch operations.

    curl -H 'Accept: application/n-triples' 'https://scigraph.springernature.com/pub.10.1007/3-540-45691-0_2'

    Turtle is a human-readable linked data format.

    curl -H 'Accept: text/turtle' 'https://scigraph.springernature.com/pub.10.1007/3-540-45691-0_2'

    RDF/XML is a standard XML format for linked data.

    curl -H 'Accept: application/rdf+xml' 'https://scigraph.springernature.com/pub.10.1007/3-540-45691-0_2'


     

    This table displays all metadata directly associated to this object as RDF triples.

    135 TRIPLES      23 PREDICATES      42 URIs      20 LITERALS      8 BLANK NODES

    Subject Predicate Object
    1 sg:pub.10.1007/3-540-45691-0_2 schema:about anzsrc-for:20
    2 anzsrc-for:2004
    3 schema:author N36e904ed6b6f4227a2b499e0639de7ef
    4 schema:citation sg:pub.10.1007/3-540-44645-1_2
    5 sg:pub.10.1007/3-540-44645-1_9
    6 sg:pub.10.1007/3-540-45691-0_14
    7 sg:pub.10.1007/3-540-45691-0_17
    8 sg:pub.10.1007/3-540-45691-0_21
    9 sg:pub.10.1007/3-540-45691-0_24
    10 sg:pub.10.1007/3-540-45691-0_30
    11 sg:pub.10.1007/3-540-45691-0_4
    12 sg:pub.10.1007/3-540-45691-0_7
    13 sg:pub.10.1007/3-540-45691-0_9
    14 https://doi.org/10.1002/asi.1164
    15 https://doi.org/10.1016/0306-4573(92)90005-k
    16 https://doi.org/10.1016/s0306-4573(99)00043-6
    17 https://doi.org/10.1145/160688.160758
    18 https://doi.org/10.1145/290941.291014
    19 schema:datePublished 2002
    20 schema:datePublishedReg 2002-01-01
    21 schema:description CLEF, the Cross-Language Evaluation Forum, continued to grow substantially in the second year of its existence. Building on the success of the first CLEF campaign in 2000 and of its predecessors, the TREC cross-language tracks, CLEF 2001 attracted 34 participating groups which submitted nearly 200 different result sets. A description of the various tracks, and a summary of the main results and research directions are given in this overview. In addition, the CLEF multilingual test collection is examined with respect to the completeness of its relevance assessments. The analysis indicates that the test collection is stable and well suited for use in future evaluations.
    22 schema:editor Nb7e520f8e1f7418b89eea56e792290dc
    23 schema:genre chapter
    24 schema:inLanguage en
    25 schema:isAccessibleForFree false
    26 schema:isPartOf N41d38fbe479e44a3948c2718cfd16f48
    27 schema:name CLEF 2001 — Overview of Results
    28 schema:pagination 9-26
    29 schema:productId N296dae1205ce442b8110cb77ff8dd9b2
    30 N4521125cce74470389b87885da3ac870
    31 Nd72da1cf642e4df8841da95d186de1c3
    32 schema:publisher N45b8bfa5e84e48ccba009e3342b8abd2
    33 schema:sameAs https://app.dimensions.ai/details/publication/pub.1012089737
    34 https://doi.org/10.1007/3-540-45691-0_2
    35 schema:sdDatePublished 2019-04-15T13:13
    36 schema:sdLicense https://scigraph.springernature.com/explorer/license/
    37 schema:sdPublisher N0819a4d0bb504641ac4d43ac465120c2
    38 schema:url http://link.springer.com/10.1007/3-540-45691-0_2
    39 sgo:license sg:explorer/license/
    40 sgo:sdDataset chapters
    41 rdf:type schema:Chapter
    42 N0819a4d0bb504641ac4d43ac465120c2 schema:name Springer Nature - SN SciGraph project
    43 rdf:type schema:Organization
    44 N258f37ccca14402da9bcf715bbb985c1 rdf:first N547264b7a9ed45d188b58d1ae822e3aa
    45 rdf:rest N950a83f690b04448ad7198e70f5fcbfb
    46 N25d8401d60d444a9aa64936b50290c3f rdf:first N71df5b708ce24ca9ae2259aa8b3f8a31
    47 rdf:rest N258f37ccca14402da9bcf715bbb985c1
    48 N296dae1205ce442b8110cb77ff8dd9b2 schema:name dimensions_id
    49 schema:value pub.1012089737
    50 rdf:type schema:PropertyValue
    51 N36e904ed6b6f4227a2b499e0639de7ef rdf:first sg:person.015363630667.99
    52 rdf:rest rdf:nil
    53 N41d38fbe479e44a3948c2718cfd16f48 schema:isbn 978-3-540-44042-0
    54 978-3-540-45691-9
    55 schema:name Evaluation of Cross-Language Information Retrieval Systems
    56 rdf:type schema:Book
    57 N4521125cce74470389b87885da3ac870 schema:name readcube_id
    58 schema:value 3999f675062dd9c8dfccf45d72be5acfd95c6a3e74fde4bf0eaaeb11201c8db7
    59 rdf:type schema:PropertyValue
    60 N45b8bfa5e84e48ccba009e3342b8abd2 schema:location Berlin, Heidelberg
    61 schema:name Springer Berlin Heidelberg
    62 rdf:type schema:Organisation
    63 N4b0acc98d53743f2913cbdbcfe1801a1 schema:familyName Kluck
    64 schema:givenName Michael
    65 rdf:type schema:Person
    66 N547264b7a9ed45d188b58d1ae822e3aa schema:familyName Gonzalo
    67 schema:givenName Julio
    68 rdf:type schema:Person
    69 N6c18c024bb444f168e73617442b7054a schema:familyName Peters
    70 schema:givenName Carol
    71 rdf:type schema:Person
    72 N71df5b708ce24ca9ae2259aa8b3f8a31 schema:familyName Braschler
    73 schema:givenName Martin
    74 rdf:type schema:Person
    75 N950a83f690b04448ad7198e70f5fcbfb rdf:first N4b0acc98d53743f2913cbdbcfe1801a1
    76 rdf:rest rdf:nil
    77 Nb7e520f8e1f7418b89eea56e792290dc rdf:first N6c18c024bb444f168e73617442b7054a
    78 rdf:rest N25d8401d60d444a9aa64936b50290c3f
    79 Nd72da1cf642e4df8841da95d186de1c3 schema:name doi
    80 schema:value 10.1007/3-540-45691-0_2
    81 rdf:type schema:PropertyValue
    82 anzsrc-for:20 schema:inDefinedTermSet anzsrc-for:
    83 schema:name Language, Communication and Culture
    84 rdf:type schema:DefinedTerm
    85 anzsrc-for:2004 schema:inDefinedTermSet anzsrc-for:
    86 schema:name Linguistics
    87 rdf:type schema:DefinedTerm
    88 sg:person.015363630667.99 schema:affiliation https://www.grid.ac/institutes/grid.433769.c
    89 schema:familyName Braschler
    90 schema:givenName Martin
    91 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.015363630667.99
    92 rdf:type schema:Person
    93 sg:pub.10.1007/3-540-44645-1_2 schema:sameAs https://app.dimensions.ai/details/publication/pub.1016014159
    94 https://doi.org/10.1007/3-540-44645-1_2
    95 rdf:type schema:CreativeWork
    96 sg:pub.10.1007/3-540-44645-1_9 schema:sameAs https://app.dimensions.ai/details/publication/pub.1037719018
    97 https://doi.org/10.1007/3-540-44645-1_9
    98 rdf:type schema:CreativeWork
    99 sg:pub.10.1007/3-540-45691-0_14 schema:sameAs https://app.dimensions.ai/details/publication/pub.1000950104
    100 https://doi.org/10.1007/3-540-45691-0_14
    101 rdf:type schema:CreativeWork
    102 sg:pub.10.1007/3-540-45691-0_17 schema:sameAs https://app.dimensions.ai/details/publication/pub.1029748702
    103 https://doi.org/10.1007/3-540-45691-0_17
    104 rdf:type schema:CreativeWork
    105 sg:pub.10.1007/3-540-45691-0_21 schema:sameAs https://app.dimensions.ai/details/publication/pub.1001318205
    106 https://doi.org/10.1007/3-540-45691-0_21
    107 rdf:type schema:CreativeWork
    108 sg:pub.10.1007/3-540-45691-0_24 schema:sameAs https://app.dimensions.ai/details/publication/pub.1020330513
    109 https://doi.org/10.1007/3-540-45691-0_24
    110 rdf:type schema:CreativeWork
    111 sg:pub.10.1007/3-540-45691-0_30 schema:sameAs https://app.dimensions.ai/details/publication/pub.1000755817
    112 https://doi.org/10.1007/3-540-45691-0_30
    113 rdf:type schema:CreativeWork
    114 sg:pub.10.1007/3-540-45691-0_4 schema:sameAs https://app.dimensions.ai/details/publication/pub.1027161755
    115 https://doi.org/10.1007/3-540-45691-0_4
    116 rdf:type schema:CreativeWork
    117 sg:pub.10.1007/3-540-45691-0_7 schema:sameAs https://app.dimensions.ai/details/publication/pub.1021484944
    118 https://doi.org/10.1007/3-540-45691-0_7
    119 rdf:type schema:CreativeWork
    120 sg:pub.10.1007/3-540-45691-0_9 schema:sameAs https://app.dimensions.ai/details/publication/pub.1012139415
    121 https://doi.org/10.1007/3-540-45691-0_9
    122 rdf:type schema:CreativeWork
    123 https://doi.org/10.1002/asi.1164 schema:sameAs https://app.dimensions.ai/details/publication/pub.1012319733
    124 rdf:type schema:CreativeWork
    125 https://doi.org/10.1016/0306-4573(92)90005-k schema:sameAs https://app.dimensions.ai/details/publication/pub.1027935191
    126 rdf:type schema:CreativeWork
    127 https://doi.org/10.1016/s0306-4573(99)00043-6 schema:sameAs https://app.dimensions.ai/details/publication/pub.1039173467
    128 rdf:type schema:CreativeWork
    129 https://doi.org/10.1145/160688.160758 schema:sameAs https://app.dimensions.ai/details/publication/pub.1021980312
    130 rdf:type schema:CreativeWork
    131 https://doi.org/10.1145/290941.291014 schema:sameAs https://app.dimensions.ai/details/publication/pub.1052200729
    132 rdf:type schema:CreativeWork
    133 https://www.grid.ac/institutes/grid.433769.c schema:alternateName Eurospider Information Technology (Switzerland)
    134 schema:name Eurospider Information Technology AG, Schaffhauserstr. 18, 8006 Zürich, Switzerland
    135 rdf:type schema:Organization
     




    Preview window. Press ESC to close (or click here)


    ...