Detection of GUI Elements on Sketch Images Using Object Detector Based on Deep Neural Networks View Full Text


Ontology type: schema:Chapter     


Chapter Info

DATE

2019

AUTHORS

Young-Sun Yun , Jinman Jung , Seongbae Eun , Sun-Sup So , Junyoung Heo

ABSTRACT

Graphical user interface (GUI) is very important to interact with software users. In many studies, therefore, they are trying to convert GUI elements (or widgets) to code or to describe formally its structure by help of domain knowledge or machine learning based algorithms. In this paper, we adopted object detection based on deep neural networks that finds GUI elements by integration of localization and classification. After the successfully detection of GUI components, we will describe the objects as the hierarchical structure and transform those to appropriate codes by synthetic or machine learning algorithms. More... »

PAGES

86-90

Book

TITLE

Proceedings of the Sixth International Conference on Green and Human Information Technology

ISBN

978-981-13-0310-4
978-981-13-0311-1

Identifiers

URI

http://scigraph.springernature.com/pub.10.1007/978-981-13-0311-1_16

DOI

http://dx.doi.org/10.1007/978-981-13-0311-1_16

DIMENSIONS

https://app.dimensions.ai/details/publication/pub.1105213333


Indexing Status Check whether this publication has been indexed by Scopus and Web Of Science using the SN Indexing Status Tool
Incoming Citations Browse incoming citations for this publication using opencitations.net

JSON-LD is the canonical representation for SciGraph data.

TIP: You can open this SciGraph record using an external JSON-LD service: JSON-LD Playground Google SDTT

[
  {
    "@context": "https://springernature.github.io/scigraph/jsonld/sgcontext.json", 
    "about": [
      {
        "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/0801", 
        "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
        "name": "Artificial Intelligence and Image Processing", 
        "type": "DefinedTerm"
      }, 
      {
        "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/08", 
        "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
        "name": "Information and Computing Sciences", 
        "type": "DefinedTerm"
      }
    ], 
    "author": [
      {
        "affiliation": {
          "alternateName": "Hannam University", 
          "id": "https://www.grid.ac/institutes/grid.411970.a", 
          "name": [
            "Hannam University"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Yun", 
        "givenName": "Young-Sun", 
        "id": "sg:person.012422257207.75", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.012422257207.75"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "Hannam University", 
          "id": "https://www.grid.ac/institutes/grid.411970.a", 
          "name": [
            "Hannam University"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Jung", 
        "givenName": "Jinman", 
        "id": "sg:person.011734132707.22", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.011734132707.22"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "Hannam University", 
          "id": "https://www.grid.ac/institutes/grid.411970.a", 
          "name": [
            "Hannam University"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Eun", 
        "givenName": "Seongbae", 
        "id": "sg:person.010403215213.18", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010403215213.18"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "Kongju National University", 
          "id": "https://www.grid.ac/institutes/grid.411118.c", 
          "name": [
            "Kongju National University"
          ], 
          "type": "Organization"
        }, 
        "familyName": "So", 
        "givenName": "Sun-Sup", 
        "id": "sg:person.010534675221.37", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010534675221.37"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "Hansung University", 
          "id": "https://www.grid.ac/institutes/grid.444079.a", 
          "name": [
            "Hansung University"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Heo", 
        "givenName": "Junyoung", 
        "id": "sg:person.01362071421.93", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.01362071421.93"
        ], 
        "type": "Person"
      }
    ], 
    "citation": [
      {
        "id": "https://doi.org/10.1109/cvpr.2014.81", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1094727707"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1109/cvprw.2012.6239171", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1095296618"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1109/cvpr.2017.690", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1095851797"
        ], 
        "type": "CreativeWork"
      }
    ], 
    "datePublished": "2019", 
    "datePublishedReg": "2019-01-01", 
    "description": "Graphical user interface (GUI) is very important to interact with software users. In many studies, therefore, they are trying to convert GUI elements (or widgets) to code or to describe formally its structure by help of domain knowledge or machine learning based algorithms. In this paper, we adopted object detection based on deep neural networks that finds GUI elements by integration of localization and classification. After the successfully detection of GUI components, we will describe the objects as the hierarchical structure and transform those to appropriate codes by synthetic or machine learning algorithms.", 
    "editor": [
      {
        "familyName": "Hwang", 
        "givenName": "Seong Oun", 
        "type": "Person"
      }, 
      {
        "familyName": "Tan", 
        "givenName": "Syh Yuan", 
        "type": "Person"
      }, 
      {
        "familyName": "Bien", 
        "givenName": "Franklin", 
        "type": "Person"
      }
    ], 
    "genre": "chapter", 
    "id": "sg:pub.10.1007/978-981-13-0311-1_16", 
    "inLanguage": [
      "en"
    ], 
    "isAccessibleForFree": false, 
    "isPartOf": {
      "isbn": [
        "978-981-13-0310-4", 
        "978-981-13-0311-1"
      ], 
      "name": "Proceedings of the Sixth International Conference on Green and Human Information Technology", 
      "type": "Book"
    }, 
    "name": "Detection of GUI Elements on Sketch Images Using Object Detector Based on Deep Neural Networks", 
    "pagination": "86-90", 
    "productId": [
      {
        "name": "doi", 
        "type": "PropertyValue", 
        "value": [
          "10.1007/978-981-13-0311-1_16"
        ]
      }, 
      {
        "name": "readcube_id", 
        "type": "PropertyValue", 
        "value": [
          "5bbea639ac1f0c9e62fdff0241e1c17a159af3da2ddff6341ffd44a592869631"
        ]
      }, 
      {
        "name": "dimensions_id", 
        "type": "PropertyValue", 
        "value": [
          "pub.1105213333"
        ]
      }
    ], 
    "publisher": {
      "location": "Singapore", 
      "name": "Springer Singapore", 
      "type": "Organisation"
    }, 
    "sameAs": [
      "https://doi.org/10.1007/978-981-13-0311-1_16", 
      "https://app.dimensions.ai/details/publication/pub.1105213333"
    ], 
    "sdDataset": "chapters", 
    "sdDatePublished": "2019-04-15T15:40", 
    "sdLicense": "https://scigraph.springernature.com/explorer/license/", 
    "sdPublisher": {
      "name": "Springer Nature - SN SciGraph project", 
      "type": "Organization"
    }, 
    "sdSource": "s3://com-uberresearch-data-dimensions-target-20181106-alternative/cleanup/v134/2549eaecd7973599484d7c17b260dba0a4ecb94b/merge/v9/a6c9fde33151104705d4d7ff012ea9563521a3ce/jats-lookup/v90/0000000001_0000000264/records_8672_00000432.jsonl", 
    "type": "Chapter", 
    "url": "http://link.springer.com/10.1007/978-981-13-0311-1_16"
  }
]
 

Download the RDF metadata as:  json-ld nt turtle xml License info

HOW TO GET THIS DATA PROGRAMMATICALLY:

JSON-LD is a popular format for linked data which is fully compatible with JSON.

curl -H 'Accept: application/ld+json' 'https://scigraph.springernature.com/pub.10.1007/978-981-13-0311-1_16'

N-Triples is a line-based linked data format ideal for batch operations.

curl -H 'Accept: application/n-triples' 'https://scigraph.springernature.com/pub.10.1007/978-981-13-0311-1_16'

Turtle is a human-readable linked data format.

curl -H 'Accept: text/turtle' 'https://scigraph.springernature.com/pub.10.1007/978-981-13-0311-1_16'

RDF/XML is a standard XML format for linked data.

curl -H 'Accept: application/rdf+xml' 'https://scigraph.springernature.com/pub.10.1007/978-981-13-0311-1_16'


 

This table displays all metadata directly associated to this object as RDF triples.

118 TRIPLES      23 PREDICATES      30 URIs      20 LITERALS      8 BLANK NODES

Subject Predicate Object
1 sg:pub.10.1007/978-981-13-0311-1_16 schema:about anzsrc-for:08
2 anzsrc-for:0801
3 schema:author Nb26c4f9d40d941a195e4827c1b3a0ae3
4 schema:citation https://doi.org/10.1109/cvpr.2014.81
5 https://doi.org/10.1109/cvpr.2017.690
6 https://doi.org/10.1109/cvprw.2012.6239171
7 schema:datePublished 2019
8 schema:datePublishedReg 2019-01-01
9 schema:description Graphical user interface (GUI) is very important to interact with software users. In many studies, therefore, they are trying to convert GUI elements (or widgets) to code or to describe formally its structure by help of domain knowledge or machine learning based algorithms. In this paper, we adopted object detection based on deep neural networks that finds GUI elements by integration of localization and classification. After the successfully detection of GUI components, we will describe the objects as the hierarchical structure and transform those to appropriate codes by synthetic or machine learning algorithms.
10 schema:editor N907bcf03dbd54c0aba7c753199c32bdb
11 schema:genre chapter
12 schema:inLanguage en
13 schema:isAccessibleForFree false
14 schema:isPartOf Na432ba6f8a9d457484cd738d562a107d
15 schema:name Detection of GUI Elements on Sketch Images Using Object Detector Based on Deep Neural Networks
16 schema:pagination 86-90
17 schema:productId Nbbc4798a7d3140e9bf0cd53c8ca85f23
18 Nceb9172f2266414b9dc1cdf2d74736b3
19 Nf31425ed057542158894359cdde0f0b6
20 schema:publisher Nefde0e82640e45fab4a233b87812a01a
21 schema:sameAs https://app.dimensions.ai/details/publication/pub.1105213333
22 https://doi.org/10.1007/978-981-13-0311-1_16
23 schema:sdDatePublished 2019-04-15T15:40
24 schema:sdLicense https://scigraph.springernature.com/explorer/license/
25 schema:sdPublisher N2ef347b7894f4dd5a330d12e20eef06f
26 schema:url http://link.springer.com/10.1007/978-981-13-0311-1_16
27 sgo:license sg:explorer/license/
28 sgo:sdDataset chapters
29 rdf:type schema:Chapter
30 N1b4b193cf0b7413ba4f77f41a91678b7 schema:familyName Tan
31 schema:givenName Syh Yuan
32 rdf:type schema:Person
33 N23a924f512c541e5babde14120eed771 rdf:first sg:person.01362071421.93
34 rdf:rest rdf:nil
35 N2ea574d5915247ffbcbe91102b26e55f schema:familyName Hwang
36 schema:givenName Seong Oun
37 rdf:type schema:Person
38 N2ef347b7894f4dd5a330d12e20eef06f schema:name Springer Nature - SN SciGraph project
39 rdf:type schema:Organization
40 N3d5e23cc492c4f26af618503359e13a1 rdf:first N4eba37df6df94832aaa928faecf87151
41 rdf:rest rdf:nil
42 N4eba37df6df94832aaa928faecf87151 schema:familyName Bien
43 schema:givenName Franklin
44 rdf:type schema:Person
45 N595f40bf186b4f9e8cf912d039429dfd rdf:first N1b4b193cf0b7413ba4f77f41a91678b7
46 rdf:rest N3d5e23cc492c4f26af618503359e13a1
47 N62641b7ae33545678f4543ed221ff430 rdf:first sg:person.011734132707.22
48 rdf:rest N62bd915eb0bc45e5966bccec1f4a14b0
49 N62bd915eb0bc45e5966bccec1f4a14b0 rdf:first sg:person.010403215213.18
50 rdf:rest N78a8c4a668ac4ca5bf7c40dd275a6e1c
51 N78a8c4a668ac4ca5bf7c40dd275a6e1c rdf:first sg:person.010534675221.37
52 rdf:rest N23a924f512c541e5babde14120eed771
53 N907bcf03dbd54c0aba7c753199c32bdb rdf:first N2ea574d5915247ffbcbe91102b26e55f
54 rdf:rest N595f40bf186b4f9e8cf912d039429dfd
55 Na432ba6f8a9d457484cd738d562a107d schema:isbn 978-981-13-0310-4
56 978-981-13-0311-1
57 schema:name Proceedings of the Sixth International Conference on Green and Human Information Technology
58 rdf:type schema:Book
59 Nb26c4f9d40d941a195e4827c1b3a0ae3 rdf:first sg:person.012422257207.75
60 rdf:rest N62641b7ae33545678f4543ed221ff430
61 Nbbc4798a7d3140e9bf0cd53c8ca85f23 schema:name readcube_id
62 schema:value 5bbea639ac1f0c9e62fdff0241e1c17a159af3da2ddff6341ffd44a592869631
63 rdf:type schema:PropertyValue
64 Nceb9172f2266414b9dc1cdf2d74736b3 schema:name doi
65 schema:value 10.1007/978-981-13-0311-1_16
66 rdf:type schema:PropertyValue
67 Nefde0e82640e45fab4a233b87812a01a schema:location Singapore
68 schema:name Springer Singapore
69 rdf:type schema:Organisation
70 Nf31425ed057542158894359cdde0f0b6 schema:name dimensions_id
71 schema:value pub.1105213333
72 rdf:type schema:PropertyValue
73 anzsrc-for:08 schema:inDefinedTermSet anzsrc-for:
74 schema:name Information and Computing Sciences
75 rdf:type schema:DefinedTerm
76 anzsrc-for:0801 schema:inDefinedTermSet anzsrc-for:
77 schema:name Artificial Intelligence and Image Processing
78 rdf:type schema:DefinedTerm
79 sg:person.010403215213.18 schema:affiliation https://www.grid.ac/institutes/grid.411970.a
80 schema:familyName Eun
81 schema:givenName Seongbae
82 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010403215213.18
83 rdf:type schema:Person
84 sg:person.010534675221.37 schema:affiliation https://www.grid.ac/institutes/grid.411118.c
85 schema:familyName So
86 schema:givenName Sun-Sup
87 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010534675221.37
88 rdf:type schema:Person
89 sg:person.011734132707.22 schema:affiliation https://www.grid.ac/institutes/grid.411970.a
90 schema:familyName Jung
91 schema:givenName Jinman
92 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.011734132707.22
93 rdf:type schema:Person
94 sg:person.012422257207.75 schema:affiliation https://www.grid.ac/institutes/grid.411970.a
95 schema:familyName Yun
96 schema:givenName Young-Sun
97 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.012422257207.75
98 rdf:type schema:Person
99 sg:person.01362071421.93 schema:affiliation https://www.grid.ac/institutes/grid.444079.a
100 schema:familyName Heo
101 schema:givenName Junyoung
102 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.01362071421.93
103 rdf:type schema:Person
104 https://doi.org/10.1109/cvpr.2014.81 schema:sameAs https://app.dimensions.ai/details/publication/pub.1094727707
105 rdf:type schema:CreativeWork
106 https://doi.org/10.1109/cvpr.2017.690 schema:sameAs https://app.dimensions.ai/details/publication/pub.1095851797
107 rdf:type schema:CreativeWork
108 https://doi.org/10.1109/cvprw.2012.6239171 schema:sameAs https://app.dimensions.ai/details/publication/pub.1095296618
109 rdf:type schema:CreativeWork
110 https://www.grid.ac/institutes/grid.411118.c schema:alternateName Kongju National University
111 schema:name Kongju National University
112 rdf:type schema:Organization
113 https://www.grid.ac/institutes/grid.411970.a schema:alternateName Hannam University
114 schema:name Hannam University
115 rdf:type schema:Organization
116 https://www.grid.ac/institutes/grid.444079.a schema:alternateName Hansung University
117 schema:name Hansung University
118 rdf:type schema:Organization
 




Preview window. Press ESC to close (or click here)


...