Detection of GUI Elements on Sketch Images Using Object Detector Based on Deep Neural Networks View Full Text


Ontology type: schema:Chapter     


Chapter Info

DATE

2019

AUTHORS

Young-Sun Yun , Jinman Jung , Seongbae Eun , Sun-Sup So , Junyoung Heo

ABSTRACT

Graphical user interface (GUI) is very important to interact with software users. In many studies, therefore, they are trying to convert GUI elements (or widgets) to code or to describe formally its structure by help of domain knowledge or machine learning based algorithms. In this paper, we adopted object detection based on deep neural networks that finds GUI elements by integration of localization and classification. After the successfully detection of GUI components, we will describe the objects as the hierarchical structure and transform those to appropriate codes by synthetic or machine learning algorithms. More... »

PAGES

86-90

Book

TITLE

Proceedings of the Sixth International Conference on Green and Human Information Technology

ISBN

978-981-13-0310-4
978-981-13-0311-1

Identifiers

URI

http://scigraph.springernature.com/pub.10.1007/978-981-13-0311-1_16

DOI

http://dx.doi.org/10.1007/978-981-13-0311-1_16

DIMENSIONS

https://app.dimensions.ai/details/publication/pub.1105213333


Indexing Status Check whether this publication has been indexed by Scopus and Web Of Science using the SN Indexing Status Tool
Incoming Citations Browse incoming citations for this publication using opencitations.net

JSON-LD is the canonical representation for SciGraph data.

TIP: You can open this SciGraph record using an external JSON-LD service: JSON-LD Playground Google SDTT

[
  {
    "@context": "https://springernature.github.io/scigraph/jsonld/sgcontext.json", 
    "about": [
      {
        "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/0801", 
        "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
        "name": "Artificial Intelligence and Image Processing", 
        "type": "DefinedTerm"
      }, 
      {
        "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/08", 
        "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
        "name": "Information and Computing Sciences", 
        "type": "DefinedTerm"
      }
    ], 
    "author": [
      {
        "affiliation": {
          "alternateName": "Hannam University", 
          "id": "https://www.grid.ac/institutes/grid.411970.a", 
          "name": [
            "Hannam University"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Yun", 
        "givenName": "Young-Sun", 
        "id": "sg:person.012422257207.75", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.012422257207.75"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "Hannam University", 
          "id": "https://www.grid.ac/institutes/grid.411970.a", 
          "name": [
            "Hannam University"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Jung", 
        "givenName": "Jinman", 
        "id": "sg:person.011734132707.22", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.011734132707.22"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "Hannam University", 
          "id": "https://www.grid.ac/institutes/grid.411970.a", 
          "name": [
            "Hannam University"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Eun", 
        "givenName": "Seongbae", 
        "id": "sg:person.010403215213.18", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010403215213.18"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "Kongju National University", 
          "id": "https://www.grid.ac/institutes/grid.411118.c", 
          "name": [
            "Kongju National University"
          ], 
          "type": "Organization"
        }, 
        "familyName": "So", 
        "givenName": "Sun-Sup", 
        "id": "sg:person.010534675221.37", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010534675221.37"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "Hansung University", 
          "id": "https://www.grid.ac/institutes/grid.444079.a", 
          "name": [
            "Hansung University"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Heo", 
        "givenName": "Junyoung", 
        "id": "sg:person.01362071421.93", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.01362071421.93"
        ], 
        "type": "Person"
      }
    ], 
    "citation": [
      {
        "id": "https://doi.org/10.1109/cvpr.2014.81", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1094727707"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1109/cvprw.2012.6239171", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1095296618"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1109/cvpr.2017.690", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1095851797"
        ], 
        "type": "CreativeWork"
      }
    ], 
    "datePublished": "2019", 
    "datePublishedReg": "2019-01-01", 
    "description": "Graphical user interface (GUI) is very important to interact with software users. In many studies, therefore, they are trying to convert GUI elements (or widgets) to code or to describe formally its structure by help of domain knowledge or machine learning based algorithms. In this paper, we adopted object detection based on deep neural networks that finds GUI elements by integration of localization and classification. After the successfully detection of GUI components, we will describe the objects as the hierarchical structure and transform those to appropriate codes by synthetic or machine learning algorithms.", 
    "editor": [
      {
        "familyName": "Hwang", 
        "givenName": "Seong Oun", 
        "type": "Person"
      }, 
      {
        "familyName": "Tan", 
        "givenName": "Syh Yuan", 
        "type": "Person"
      }, 
      {
        "familyName": "Bien", 
        "givenName": "Franklin", 
        "type": "Person"
      }
    ], 
    "genre": "chapter", 
    "id": "sg:pub.10.1007/978-981-13-0311-1_16", 
    "inLanguage": [
      "en"
    ], 
    "isAccessibleForFree": false, 
    "isPartOf": {
      "isbn": [
        "978-981-13-0310-4", 
        "978-981-13-0311-1"
      ], 
      "name": "Proceedings of the Sixth International Conference on Green and Human Information Technology", 
      "type": "Book"
    }, 
    "name": "Detection of GUI Elements on Sketch Images Using Object Detector Based on Deep Neural Networks", 
    "pagination": "86-90", 
    "productId": [
      {
        "name": "doi", 
        "type": "PropertyValue", 
        "value": [
          "10.1007/978-981-13-0311-1_16"
        ]
      }, 
      {
        "name": "readcube_id", 
        "type": "PropertyValue", 
        "value": [
          "5bbea639ac1f0c9e62fdff0241e1c17a159af3da2ddff6341ffd44a592869631"
        ]
      }, 
      {
        "name": "dimensions_id", 
        "type": "PropertyValue", 
        "value": [
          "pub.1105213333"
        ]
      }
    ], 
    "publisher": {
      "location": "Singapore", 
      "name": "Springer Singapore", 
      "type": "Organisation"
    }, 
    "sameAs": [
      "https://doi.org/10.1007/978-981-13-0311-1_16", 
      "https://app.dimensions.ai/details/publication/pub.1105213333"
    ], 
    "sdDataset": "chapters", 
    "sdDatePublished": "2019-04-15T15:40", 
    "sdLicense": "https://scigraph.springernature.com/explorer/license/", 
    "sdPublisher": {
      "name": "Springer Nature - SN SciGraph project", 
      "type": "Organization"
    }, 
    "sdSource": "s3://com-uberresearch-data-dimensions-target-20181106-alternative/cleanup/v134/2549eaecd7973599484d7c17b260dba0a4ecb94b/merge/v9/a6c9fde33151104705d4d7ff012ea9563521a3ce/jats-lookup/v90/0000000001_0000000264/records_8672_00000432.jsonl", 
    "type": "Chapter", 
    "url": "http://link.springer.com/10.1007/978-981-13-0311-1_16"
  }
]
 

Download the RDF metadata as:  json-ld nt turtle xml License info

HOW TO GET THIS DATA PROGRAMMATICALLY:

JSON-LD is a popular format for linked data which is fully compatible with JSON.

curl -H 'Accept: application/ld+json' 'https://scigraph.springernature.com/pub.10.1007/978-981-13-0311-1_16'

N-Triples is a line-based linked data format ideal for batch operations.

curl -H 'Accept: application/n-triples' 'https://scigraph.springernature.com/pub.10.1007/978-981-13-0311-1_16'

Turtle is a human-readable linked data format.

curl -H 'Accept: text/turtle' 'https://scigraph.springernature.com/pub.10.1007/978-981-13-0311-1_16'

RDF/XML is a standard XML format for linked data.

curl -H 'Accept: application/rdf+xml' 'https://scigraph.springernature.com/pub.10.1007/978-981-13-0311-1_16'


 

This table displays all metadata directly associated to this object as RDF triples.

118 TRIPLES      23 PREDICATES      30 URIs      20 LITERALS      8 BLANK NODES

Subject Predicate Object
1 sg:pub.10.1007/978-981-13-0311-1_16 schema:about anzsrc-for:08
2 anzsrc-for:0801
3 schema:author Nbf05427cface4afa9766661f539cc82c
4 schema:citation https://doi.org/10.1109/cvpr.2014.81
5 https://doi.org/10.1109/cvpr.2017.690
6 https://doi.org/10.1109/cvprw.2012.6239171
7 schema:datePublished 2019
8 schema:datePublishedReg 2019-01-01
9 schema:description Graphical user interface (GUI) is very important to interact with software users. In many studies, therefore, they are trying to convert GUI elements (or widgets) to code or to describe formally its structure by help of domain knowledge or machine learning based algorithms. In this paper, we adopted object detection based on deep neural networks that finds GUI elements by integration of localization and classification. After the successfully detection of GUI components, we will describe the objects as the hierarchical structure and transform those to appropriate codes by synthetic or machine learning algorithms.
10 schema:editor N26680302671e4197a00a83c04e0933e6
11 schema:genre chapter
12 schema:inLanguage en
13 schema:isAccessibleForFree false
14 schema:isPartOf N73d5844f8c77465295dffd975d74dba9
15 schema:name Detection of GUI Elements on Sketch Images Using Object Detector Based on Deep Neural Networks
16 schema:pagination 86-90
17 schema:productId N103ccf853e504f1a83fc7adebcf73b7b
18 Nb5fc00cd50134c809b1f98f80f76b75f
19 Nc500e5723f0947e1a0934f0f88bcc9a3
20 schema:publisher N2feb5470cabd4b1ea24394c211adc2de
21 schema:sameAs https://app.dimensions.ai/details/publication/pub.1105213333
22 https://doi.org/10.1007/978-981-13-0311-1_16
23 schema:sdDatePublished 2019-04-15T15:40
24 schema:sdLicense https://scigraph.springernature.com/explorer/license/
25 schema:sdPublisher Na9dfc88a4321403e8935e33595a8572d
26 schema:url http://link.springer.com/10.1007/978-981-13-0311-1_16
27 sgo:license sg:explorer/license/
28 sgo:sdDataset chapters
29 rdf:type schema:Chapter
30 N103ccf853e504f1a83fc7adebcf73b7b schema:name readcube_id
31 schema:value 5bbea639ac1f0c9e62fdff0241e1c17a159af3da2ddff6341ffd44a592869631
32 rdf:type schema:PropertyValue
33 N1767804afc6243949a287164ed43979b rdf:first N7befe85e691949cfa517078a23e3c070
34 rdf:rest Ncd86d1d8e9554e2299d21b4070ea897e
35 N26680302671e4197a00a83c04e0933e6 rdf:first N2f327878dea5460d8859cffd78862ece
36 rdf:rest N1767804afc6243949a287164ed43979b
37 N2f327878dea5460d8859cffd78862ece schema:familyName Hwang
38 schema:givenName Seong Oun
39 rdf:type schema:Person
40 N2feb5470cabd4b1ea24394c211adc2de schema:location Singapore
41 schema:name Springer Singapore
42 rdf:type schema:Organisation
43 N3e3bd18111f642b2aea8a6eb5c2b0092 schema:familyName Bien
44 schema:givenName Franklin
45 rdf:type schema:Person
46 N73d5844f8c77465295dffd975d74dba9 schema:isbn 978-981-13-0310-4
47 978-981-13-0311-1
48 schema:name Proceedings of the Sixth International Conference on Green and Human Information Technology
49 rdf:type schema:Book
50 N7befe85e691949cfa517078a23e3c070 schema:familyName Tan
51 schema:givenName Syh Yuan
52 rdf:type schema:Person
53 Na789c336aacb4b79ba65f2bb94b371c7 rdf:first sg:person.011734132707.22
54 rdf:rest Nd85e2cf3980743eba4ccae261c4d7705
55 Na9dfc88a4321403e8935e33595a8572d schema:name Springer Nature - SN SciGraph project
56 rdf:type schema:Organization
57 Nb5fc00cd50134c809b1f98f80f76b75f schema:name doi
58 schema:value 10.1007/978-981-13-0311-1_16
59 rdf:type schema:PropertyValue
60 Nbf05427cface4afa9766661f539cc82c rdf:first sg:person.012422257207.75
61 rdf:rest Na789c336aacb4b79ba65f2bb94b371c7
62 Nc500e5723f0947e1a0934f0f88bcc9a3 schema:name dimensions_id
63 schema:value pub.1105213333
64 rdf:type schema:PropertyValue
65 Ncd86d1d8e9554e2299d21b4070ea897e rdf:first N3e3bd18111f642b2aea8a6eb5c2b0092
66 rdf:rest rdf:nil
67 Nd76d51f2309042bdb0597c5365dc6fce rdf:first sg:person.010534675221.37
68 rdf:rest Ndcda63bb35444d2f86af22ef84e1caed
69 Nd85e2cf3980743eba4ccae261c4d7705 rdf:first sg:person.010403215213.18
70 rdf:rest Nd76d51f2309042bdb0597c5365dc6fce
71 Ndcda63bb35444d2f86af22ef84e1caed rdf:first sg:person.01362071421.93
72 rdf:rest rdf:nil
73 anzsrc-for:08 schema:inDefinedTermSet anzsrc-for:
74 schema:name Information and Computing Sciences
75 rdf:type schema:DefinedTerm
76 anzsrc-for:0801 schema:inDefinedTermSet anzsrc-for:
77 schema:name Artificial Intelligence and Image Processing
78 rdf:type schema:DefinedTerm
79 sg:person.010403215213.18 schema:affiliation https://www.grid.ac/institutes/grid.411970.a
80 schema:familyName Eun
81 schema:givenName Seongbae
82 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010403215213.18
83 rdf:type schema:Person
84 sg:person.010534675221.37 schema:affiliation https://www.grid.ac/institutes/grid.411118.c
85 schema:familyName So
86 schema:givenName Sun-Sup
87 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010534675221.37
88 rdf:type schema:Person
89 sg:person.011734132707.22 schema:affiliation https://www.grid.ac/institutes/grid.411970.a
90 schema:familyName Jung
91 schema:givenName Jinman
92 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.011734132707.22
93 rdf:type schema:Person
94 sg:person.012422257207.75 schema:affiliation https://www.grid.ac/institutes/grid.411970.a
95 schema:familyName Yun
96 schema:givenName Young-Sun
97 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.012422257207.75
98 rdf:type schema:Person
99 sg:person.01362071421.93 schema:affiliation https://www.grid.ac/institutes/grid.444079.a
100 schema:familyName Heo
101 schema:givenName Junyoung
102 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.01362071421.93
103 rdf:type schema:Person
104 https://doi.org/10.1109/cvpr.2014.81 schema:sameAs https://app.dimensions.ai/details/publication/pub.1094727707
105 rdf:type schema:CreativeWork
106 https://doi.org/10.1109/cvpr.2017.690 schema:sameAs https://app.dimensions.ai/details/publication/pub.1095851797
107 rdf:type schema:CreativeWork
108 https://doi.org/10.1109/cvprw.2012.6239171 schema:sameAs https://app.dimensions.ai/details/publication/pub.1095296618
109 rdf:type schema:CreativeWork
110 https://www.grid.ac/institutes/grid.411118.c schema:alternateName Kongju National University
111 schema:name Kongju National University
112 rdf:type schema:Organization
113 https://www.grid.ac/institutes/grid.411970.a schema:alternateName Hannam University
114 schema:name Hannam University
115 rdf:type schema:Organization
116 https://www.grid.ac/institutes/grid.444079.a schema:alternateName Hansung University
117 schema:name Hansung University
118 rdf:type schema:Organization
 




Preview window. Press ESC to close (or click here)


...