RI: Medium: Deep Annotation: Measuring Human Vision to Improve Machine Vision View Homepage


Ontology type: schema:MonetaryGrant     


Grant Info

YEARS

2014-2019

FUNDING AMOUNT

674099 USD

ABSTRACT

Machine learning is the science of designing computational systems that can learn from data, much as humans do. However, while many machine learning approaches rely on humans to provide labels for training examples that are used for learning, human-provided labels represent just a tiny fraction of the information that can be gleaned from humans. This project brings together a multidisciplinary team with expertise spanning computer science, neuroscience and psychology to pioneer a new paradigm in machine learning that seeks to better mimic human performance by incorporating new kinds of information about human behavior. Specifically, this project brings the disciplines of psychophysics and psychometrics, which seek to quantitatively describe human performance -- patterns of errors, reaction times, and variations across populations of humans -- together with machine learning to develop systems that learn both from human successes and failures, to generate artificial systems that perform better and generalize better to data outside of their training sets. The project team has already shown initial proof of concept in applying these ideas to the problem of face detection in difficult, cluttered real-world images. During the project period, the team will greatly expand these ideas, developing new applications (including face and object recognition tasks), a broader range of machine learning settings (including regression and feature selection), and methods for incorporating new kinds of data (such as fMRI brain scans) for guiding machine learning algorithms. This research represents a new direction in machine learning research, which increasingly has important and broad impact in our modern, data-driven world. In addition, it is anticipated that the theoretical gains in machine learning derived from this work will feed back into psychology, enabling rapid screening of candidate hypotheses about how the brain works by artificial systems which can then be tested on humans using an advanced crowdsourcing platform for quantifying human behavior. More... »

URL

http://www.nsf.gov/awardsearch/showAward?AWD_ID=1409097&HistoricalAwards=false

Related SciGraph Publications

  • 2018-12. Using human brain activity to guide machine learning in SCIENTIFIC REPORTS
  • 2018. Conditional Infilling GANs for Data Augmentation in Mammogram Classification in IMAGE ANALYSIS FOR MOVING ORGAN, BREAST, AND THORACIC IMAGES
  • JSON-LD is the canonical representation for SciGraph data.

    TIP: You can open this SciGraph record using an external JSON-LD service: JSON-LD Playground Google SDTT

    [
      {
        "@context": "https://springernature.github.io/scigraph/jsonld/sgcontext.json", 
        "about": [
          {
            "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/2217", 
            "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
            "type": "DefinedTerm"
          }, 
          {
            "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/2217", 
            "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
            "type": "DefinedTerm"
          }, 
          {
            "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/2208", 
            "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
            "type": "DefinedTerm"
          }
        ], 
        "amount": {
          "currency": "USD", 
          "type": "MonetaryAmount", 
          "value": "674099"
        }, 
        "description": "Machine learning is the science of designing computational systems that can learn from data, much as humans do. However, while many machine learning approaches rely on humans to provide labels for training examples that are used for learning, human-provided labels represent just a tiny fraction of the information that can be gleaned from humans. This project brings together a multidisciplinary team with expertise spanning computer science, neuroscience and psychology to pioneer a new paradigm in machine learning that seeks to better mimic human performance by incorporating new kinds of information about human behavior. Specifically, this project brings the disciplines of psychophysics and psychometrics, which seek to quantitatively describe human performance -- patterns of errors, reaction times, and variations across populations of humans -- together with machine learning to develop systems that learn both from human successes and failures, to generate artificial systems that perform better and generalize better to data outside of their training sets. The project team has already shown initial proof of concept in applying these ideas to the problem of face detection in difficult, cluttered real-world images. During the project period, the team will greatly expand these ideas, developing new applications (including face and object recognition tasks), a broader range of machine learning settings (including regression and feature selection), and methods for incorporating new kinds of data (such as fMRI brain scans) for guiding machine learning algorithms. This research represents a new direction in machine learning research, which increasingly has important and broad impact in our modern, data-driven world. In addition, it is anticipated that the theoretical gains in machine learning derived from this work will feed back into psychology, enabling rapid screening of candidate hypotheses about how the brain works by artificial systems which can then be tested on humans using an advanced crowdsourcing platform for quantifying human behavior.", 
        "endDate": "2019-08-31T00:00:00Z", 
        "funder": {
          "id": "https://www.grid.ac/institutes/grid.457785.c", 
          "type": "Organization"
        }, 
        "id": "sg:grant.3849302", 
        "identifier": [
          {
            "name": "dimensions_id", 
            "type": "PropertyValue", 
            "value": [
              "3849302"
            ]
          }, 
          {
            "name": "nsf_id", 
            "type": "PropertyValue", 
            "value": [
              "1409097"
            ]
          }
        ], 
        "inLanguage": [
          "en"
        ], 
        "keywords": [
          "feature selection", 
          "training set", 
          "RI", 
          "label", 
          "human success", 
          "tiny fraction", 
          "theoretical gain", 
          "broad range", 
          "human behavior", 
          "candidate hypotheses", 
          "failure", 
          "pattern", 
          "project team", 
          "psychophysics", 
          "algorithms", 
          "idea", 
          "METHODS", 
          "world images", 
          "brain", 
          "object recognition task", 
          "new kind", 
          "system", 
          "errors", 
          "concept", 
          "work", 
          "team", 
          "new applications", 
          "computer science", 
          "deep annotation", 
          "many machine", 
          "face", 
          "machine learning", 
          "multidisciplinary team", 
          "SETTING", 
          "project", 
          "regression", 
          "psychology", 
          "data", 
          "neuroscience", 
          "approach", 
          "addition", 
          "world", 
          "machine vision", 
          "population", 
          "artificial systems", 
          "computational systems", 
          "human-provided labels", 
          "advanced crowdsourcing platform", 
          "broad impact", 
          "fMRI brain", 
          "research", 
          "psychometric", 
          "training examples", 
          "humans", 
          "face detection", 
          "disciplines", 
          "medium", 
          "rapid screening", 
          "expertise", 
          "human vision", 
          "project period", 
          "information", 
          "human performance", 
          "machine", 
          "science", 
          "variation", 
          "new paradigm", 
          "problem", 
          "new directions", 
          "initial proof", 
          "reaction time"
        ], 
        "name": "RI: Medium: Deep Annotation: Measuring Human Vision to Improve Machine Vision", 
        "recipient": [
          {
            "id": "https://www.grid.ac/institutes/grid.38142.3c", 
            "type": "Organization"
          }, 
          {
            "affiliation": {
              "id": "https://www.grid.ac/institutes/grid.38142.3c", 
              "name": "Harvard University", 
              "type": "Organization"
            }, 
            "familyName": "Cox", 
            "givenName": "David", 
            "id": "sg:person.01061655002.77", 
            "type": "Person"
          }, 
          {
            "member": "sg:person.01061655002.77", 
            "roleName": "PI", 
            "type": "Role"
          }, 
          {
            "affiliation": {
              "id": "https://www.grid.ac/institutes/grid.38142.3c", 
              "name": "Harvard University", 
              "type": "Organization"
            }, 
            "familyName": "Nakayama", 
            "givenName": "Ken", 
            "id": "sg:person.0776305751.74", 
            "type": "Person"
          }, 
          {
            "member": "sg:person.0776305751.74", 
            "roleName": "Co-PI", 
            "type": "Role"
          }
        ], 
        "sameAs": [
          "https://app.dimensions.ai/details/grant/grant.3849302"
        ], 
        "sdDataset": "grants", 
        "sdDatePublished": "2019-03-07T12:36", 
        "sdLicense": "https://scigraph.springernature.com/explorer/license/", 
        "sdPublisher": {
          "name": "Springer Nature - SN SciGraph project", 
          "type": "Organization"
        }, 
        "sdSource": "s3://com.uberresearch.data.processor/core_data/20181219_192338/projects/base/nsf_projects_7.xml.gz", 
        "startDate": "2014-09-01T00:00:00Z", 
        "type": "MonetaryGrant", 
        "url": "http://www.nsf.gov/awardsearch/showAward?AWD_ID=1409097&HistoricalAwards=false"
      }
    ]
     

    Download the RDF metadata as:  json-ld nt turtle xml License info

    HOW TO GET THIS DATA PROGRAMMATICALLY:

    JSON-LD is a popular format for linked data which is fully compatible with JSON.

    curl -H 'Accept: application/ld+json' 'https://scigraph.springernature.com/grant.3849302'

    N-Triples is a line-based linked data format ideal for batch operations.

    curl -H 'Accept: application/n-triples' 'https://scigraph.springernature.com/grant.3849302'

    Turtle is a human-readable linked data format.

    curl -H 'Accept: text/turtle' 'https://scigraph.springernature.com/grant.3849302'

    RDF/XML is a standard XML format for linked data.

    curl -H 'Accept: application/rdf+xml' 'https://scigraph.springernature.com/grant.3849302'


     

    This table displays all metadata directly associated to this object as RDF triples.

    127 TRIPLES      19 PREDICATES      96 URIs      86 LITERALS      6 BLANK NODES

    Subject Predicate Object
    1 sg:grant.3849302 schema:about anzsrc-for:2208
    2 anzsrc-for:2217
    3 schema:amount Ne84e19e158ed4f79bb5bc007a777b9ee
    4 schema:description Machine learning is the science of designing computational systems that can learn from data, much as humans do. However, while many machine learning approaches rely on humans to provide labels for training examples that are used for learning, human-provided labels represent just a tiny fraction of the information that can be gleaned from humans. This project brings together a multidisciplinary team with expertise spanning computer science, neuroscience and psychology to pioneer a new paradigm in machine learning that seeks to better mimic human performance by incorporating new kinds of information about human behavior. Specifically, this project brings the disciplines of psychophysics and psychometrics, which seek to quantitatively describe human performance -- patterns of errors, reaction times, and variations across populations of humans -- together with machine learning to develop systems that learn both from human successes and failures, to generate artificial systems that perform better and generalize better to data outside of their training sets. The project team has already shown initial proof of concept in applying these ideas to the problem of face detection in difficult, cluttered real-world images. During the project period, the team will greatly expand these ideas, developing new applications (including face and object recognition tasks), a broader range of machine learning settings (including regression and feature selection), and methods for incorporating new kinds of data (such as fMRI brain scans) for guiding machine learning algorithms. This research represents a new direction in machine learning research, which increasingly has important and broad impact in our modern, data-driven world. In addition, it is anticipated that the theoretical gains in machine learning derived from this work will feed back into psychology, enabling rapid screening of candidate hypotheses about how the brain works by artificial systems which can then be tested on humans using an advanced crowdsourcing platform for quantifying human behavior.
    5 schema:endDate 2019-08-31T00:00:00Z
    6 schema:funder https://www.grid.ac/institutes/grid.457785.c
    7 schema:identifier N533946ce0d1040b8a5993b4e47c96c14
    8 N851e430f8c084bb2bb8a8f0511431f54
    9 schema:inLanguage en
    10 schema:keywords METHODS
    11 RI
    12 SETTING
    13 addition
    14 advanced crowdsourcing platform
    15 algorithms
    16 approach
    17 artificial systems
    18 brain
    19 broad impact
    20 broad range
    21 candidate hypotheses
    22 computational systems
    23 computer science
    24 concept
    25 data
    26 deep annotation
    27 disciplines
    28 errors
    29 expertise
    30 fMRI brain
    31 face
    32 face detection
    33 failure
    34 feature selection
    35 human behavior
    36 human performance
    37 human success
    38 human vision
    39 human-provided labels
    40 humans
    41 idea
    42 information
    43 initial proof
    44 label
    45 machine
    46 machine learning
    47 machine vision
    48 many machine
    49 medium
    50 multidisciplinary team
    51 neuroscience
    52 new applications
    53 new directions
    54 new kind
    55 new paradigm
    56 object recognition task
    57 pattern
    58 population
    59 problem
    60 project
    61 project period
    62 project team
    63 psychology
    64 psychometric
    65 psychophysics
    66 rapid screening
    67 reaction time
    68 regression
    69 research
    70 science
    71 system
    72 team
    73 theoretical gain
    74 tiny fraction
    75 training examples
    76 training set
    77 variation
    78 work
    79 world
    80 world images
    81 schema:name RI: Medium: Deep Annotation: Measuring Human Vision to Improve Machine Vision
    82 schema:recipient N33217febec834f17a72b0f58eee2ed81
    83 Nb0b56ff419b54360950b30e14a4f11ba
    84 sg:person.01061655002.77
    85 sg:person.0776305751.74
    86 https://www.grid.ac/institutes/grid.38142.3c
    87 schema:sameAs https://app.dimensions.ai/details/grant/grant.3849302
    88 schema:sdDatePublished 2019-03-07T12:36
    89 schema:sdLicense https://scigraph.springernature.com/explorer/license/
    90 schema:sdPublisher Ncb51395486e44ce7ba822f98062e9c1e
    91 schema:startDate 2014-09-01T00:00:00Z
    92 schema:url http://www.nsf.gov/awardsearch/showAward?AWD_ID=1409097&HistoricalAwards=false
    93 sgo:license sg:explorer/license/
    94 sgo:sdDataset grants
    95 rdf:type schema:MonetaryGrant
    96 N33217febec834f17a72b0f58eee2ed81 schema:member sg:person.0776305751.74
    97 schema:roleName Co-PI
    98 rdf:type schema:Role
    99 N533946ce0d1040b8a5993b4e47c96c14 schema:name nsf_id
    100 schema:value 1409097
    101 rdf:type schema:PropertyValue
    102 N851e430f8c084bb2bb8a8f0511431f54 schema:name dimensions_id
    103 schema:value 3849302
    104 rdf:type schema:PropertyValue
    105 Nb0b56ff419b54360950b30e14a4f11ba schema:member sg:person.01061655002.77
    106 schema:roleName PI
    107 rdf:type schema:Role
    108 Ncb51395486e44ce7ba822f98062e9c1e schema:name Springer Nature - SN SciGraph project
    109 rdf:type schema:Organization
    110 Ne84e19e158ed4f79bb5bc007a777b9ee schema:currency USD
    111 schema:value 674099
    112 rdf:type schema:MonetaryAmount
    113 anzsrc-for:2208 schema:inDefinedTermSet anzsrc-for:
    114 rdf:type schema:DefinedTerm
    115 anzsrc-for:2217 schema:inDefinedTermSet anzsrc-for:
    116 rdf:type schema:DefinedTerm
    117 sg:person.01061655002.77 schema:affiliation https://www.grid.ac/institutes/grid.38142.3c
    118 schema:familyName Cox
    119 schema:givenName David
    120 rdf:type schema:Person
    121 sg:person.0776305751.74 schema:affiliation https://www.grid.ac/institutes/grid.38142.3c
    122 schema:familyName Nakayama
    123 schema:givenName Ken
    124 rdf:type schema:Person
    125 https://www.grid.ac/institutes/grid.38142.3c schema:name Harvard University
    126 rdf:type schema:Organization
    127 https://www.grid.ac/institutes/grid.457785.c schema:Organization
     




    Preview window. Press ESC to close (or click here)


    ...