Ontology type: schema:ScholarlyArticle
2018-07
AUTHORSMatteo Fischetti, Jason Jo
ABSTRACTDeep Neural Networks (DNNs) are very popular these days, and are the subject of a very intense investigation. A DNN is made up of layers of internal units (or neurons), each of which computes an affine combination of the output of the units in the previous layer, applies a nonlinear operator, and outputs the corresponding value (also known as activation). A commonly-used nonlinear operator is the so-called rectified linear unit (ReLU), whose output is just the maximum between its input value and zero. In this (and other similar cases like max pooling, where the max operation involves more than one input value), for fixed parameters one can model the DNN as a 0-1 Mixed Integer Linear Program (0-1 MILP) where the continuous variables correspond to the output values of each unit, and a binary variable is associated with each ReLU to model its yes/no nature. In this paper we discuss the peculiarity of this kind of 0-1 MILP models, and describe an effective bound-tightening technique intended to ease its solution. We also present possible applications of the 0-1 MILP model arising in feature visualization and in the construction of adversarial examples. Computational results are reported, aimed at investigating (on small DNNs) the computational performance of a state-of-the-art MILP solver when applied to a known test case, namely, hand-written digit recognition. More... »
PAGES296-309
http://scigraph.springernature.com/pub.10.1007/s10601-018-9285-6
DOIhttp://dx.doi.org/10.1007/s10601-018-9285-6
DIMENSIONShttps://app.dimensions.ai/details/publication/pub.1103660105
JSON-LD is the canonical representation for SciGraph data.
TIP: You can open this SciGraph record using an external JSON-LD service: JSON-LD Playground Google SDTT
[
{
"@context": "https://springernature.github.io/scigraph/jsonld/sgcontext.json",
"about": [
{
"id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/0801",
"inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/",
"name": "Artificial Intelligence and Image Processing",
"type": "DefinedTerm"
},
{
"id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/08",
"inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/",
"name": "Information and Computing Sciences",
"type": "DefinedTerm"
}
],
"author": [
{
"affiliation": {
"alternateName": "University of Padua",
"id": "https://www.grid.ac/institutes/grid.5608.b",
"name": [
"Department of Information Engineering (DEI), University of Padova, Padua, Italy"
],
"type": "Organization"
},
"familyName": "Fischetti",
"givenName": "Matteo",
"id": "sg:person.015541213603.44",
"sameAs": [
"https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.015541213603.44"
],
"type": "Person"
},
{
"affiliation": {
"name": [
"Montreal Institute for Learning Algorithms (MILA), Montreal, Qu\u00e9bec, Canada",
"Institute for Data Valorization (IVADO), Montreal, Qu\u00e9bec, Canada"
],
"type": "Organization"
},
"familyName": "Jo",
"givenName": "Jason",
"type": "Person"
}
],
"citation": [
{
"id": "sg:pub.10.1007/s10589-016-9847-8",
"sameAs": [
"https://app.dimensions.ai/details/publication/pub.1010953651",
"https://doi.org/10.1007/s10589-016-9847-8"
],
"type": "CreativeWork"
},
{
"id": "sg:pub.10.1007/s10107-003-0395-5",
"sameAs": [
"https://app.dimensions.ai/details/publication/pub.1023883503",
"https://doi.org/10.1007/s10107-003-0395-5"
],
"type": "CreativeWork"
},
{
"id": "sg:pub.10.1007/s10732-014-9266-x",
"sameAs": [
"https://app.dimensions.ai/details/publication/pub.1027615537",
"https://doi.org/10.1007/s10732-014-9266-x"
],
"type": "CreativeWork"
},
{
"id": "https://doi.org/10.1016/j.disopt.2015.03.002",
"sameAs": [
"https://app.dimensions.ai/details/publication/pub.1031284123"
],
"type": "CreativeWork"
},
{
"id": "https://doi.org/10.1109/5.726791",
"sameAs": [
"https://app.dimensions.ai/details/publication/pub.1061179979"
],
"type": "CreativeWork"
},
{
"id": "https://doi.org/10.1287/ijoc.1060.0189",
"sameAs": [
"https://app.dimensions.ai/details/publication/pub.1064706604"
],
"type": "CreativeWork"
},
{
"id": "https://doi.org/10.1145/3065386",
"sameAs": [
"https://app.dimensions.ai/details/publication/pub.1085642448"
],
"type": "CreativeWork"
},
{
"id": "https://doi.org/10.1145/3065386",
"sameAs": [
"https://app.dimensions.ai/details/publication/pub.1085642448"
],
"type": "CreativeWork"
},
{
"id": "sg:pub.10.1007/978-3-319-68167-2_18",
"sameAs": [
"https://app.dimensions.ai/details/publication/pub.1091962617",
"https://doi.org/10.1007/978-3-319-68167-2_18"
],
"type": "CreativeWork"
},
{
"id": "sg:pub.10.1007/978-3-319-68167-2_18",
"sameAs": [
"https://app.dimensions.ai/details/publication/pub.1091962617",
"https://doi.org/10.1007/978-3-319-68167-2_18"
],
"type": "CreativeWork"
}
],
"datePublished": "2018-07",
"datePublishedReg": "2018-07-01",
"description": "Deep Neural Networks (DNNs) are very popular these days, and are the subject of a very intense investigation. A DNN is made up of layers of internal units (or neurons), each of which computes an affine combination of the output of the units in the previous layer, applies a nonlinear operator, and outputs the corresponding value (also known as activation). A commonly-used nonlinear operator is the so-called rectified linear unit (ReLU), whose output is just the maximum between its input value and zero. In this (and other similar cases like max pooling, where the max operation involves more than one input value), for fixed parameters one can model the DNN as a 0-1 Mixed Integer Linear Program (0-1 MILP) where the continuous variables correspond to the output values of each unit, and a binary variable is associated with each ReLU to model its yes/no nature. In this paper we discuss the peculiarity of this kind of 0-1 MILP models, and describe an effective bound-tightening technique intended to ease its solution. We also present possible applications of the 0-1 MILP model arising in feature visualization and in the construction of adversarial examples. Computational results are reported, aimed at investigating (on small DNNs) the computational performance of a state-of-the-art MILP solver when applied to a known test case, namely, hand-written digit recognition.",
"genre": "research_article",
"id": "sg:pub.10.1007/s10601-018-9285-6",
"inLanguage": [
"en"
],
"isAccessibleForFree": false,
"isPartOf": [
{
"id": "sg:journal.1043977",
"issn": [
"1383-7133",
"1572-9354"
],
"name": "Constraints",
"type": "Periodical"
},
{
"issueNumber": "3",
"type": "PublicationIssue"
},
{
"type": "PublicationVolume",
"volumeNumber": "23"
}
],
"name": "Deep neural networks and mixed integer linear optimization",
"pagination": "296-309",
"productId": [
{
"name": "readcube_id",
"type": "PropertyValue",
"value": [
"4d095ab9e290ad103227a05b8ab88ab3e78a14e3a8470bc98ba4a3bbcb0c1a9f"
]
},
{
"name": "doi",
"type": "PropertyValue",
"value": [
"10.1007/s10601-018-9285-6"
]
},
{
"name": "dimensions_id",
"type": "PropertyValue",
"value": [
"pub.1103660105"
]
}
],
"sameAs": [
"https://doi.org/10.1007/s10601-018-9285-6",
"https://app.dimensions.ai/details/publication/pub.1103660105"
],
"sdDataset": "articles",
"sdDatePublished": "2019-04-11T09:57",
"sdLicense": "https://scigraph.springernature.com/explorer/license/",
"sdPublisher": {
"name": "Springer Nature - SN SciGraph project",
"type": "Organization"
},
"sdSource": "s3://com-uberresearch-data-dimensions-target-20181106-alternative/cleanup/v134/2549eaecd7973599484d7c17b260dba0a4ecb94b/merge/v9/a6c9fde33151104705d4d7ff012ea9563521a3ce/jats-lookup/v90/0000000347_0000000347/records_89807_00000003.jsonl",
"type": "ScholarlyArticle",
"url": "https://link.springer.com/10.1007%2Fs10601-018-9285-6"
}
]Download the RDF metadata as: json-ld nt turtle xml License info
JSON-LD is a popular format for linked data which is fully compatible with JSON.
curl -H 'Accept: application/ld+json' 'https://scigraph.springernature.com/pub.10.1007/s10601-018-9285-6'
N-Triples is a line-based linked data format ideal for batch operations.
curl -H 'Accept: application/n-triples' 'https://scigraph.springernature.com/pub.10.1007/s10601-018-9285-6'
Turtle is a human-readable linked data format.
curl -H 'Accept: text/turtle' 'https://scigraph.springernature.com/pub.10.1007/s10601-018-9285-6'
RDF/XML is a standard XML format for linked data.
curl -H 'Accept: application/rdf+xml' 'https://scigraph.springernature.com/pub.10.1007/s10601-018-9285-6'
This table displays all metadata directly associated to this object as RDF triples.
98 TRIPLES
21 PREDICATES
35 URIs
19 LITERALS
7 BLANK NODES