Detection of GUI Elements on Sketch Images Using Object Detector Based on Deep Neural Networks View Full Text


Ontology type: schema:Chapter     


Chapter Info

DATE

2019

AUTHORS

Young-Sun Yun , Jinman Jung , Seongbae Eun , Sun-Sup So , Junyoung Heo

ABSTRACT

Graphical user interface (GUI) is very important to interact with software users. In many studies, therefore, they are trying to convert GUI elements (or widgets) to code or to describe formally its structure by help of domain knowledge or machine learning based algorithms. In this paper, we adopted object detection based on deep neural networks that finds GUI elements by integration of localization and classification. After the successfully detection of GUI components, we will describe the objects as the hierarchical structure and transform those to appropriate codes by synthetic or machine learning algorithms. More... »

PAGES

86-90

Book

TITLE

Proceedings of the Sixth International Conference on Green and Human Information Technology

ISBN

978-981-13-0310-4
978-981-13-0311-1

Identifiers

URI

http://scigraph.springernature.com/pub.10.1007/978-981-13-0311-1_16

DOI

http://dx.doi.org/10.1007/978-981-13-0311-1_16

DIMENSIONS

https://app.dimensions.ai/details/publication/pub.1105213333


Indexing Status Check whether this publication has been indexed by Scopus and Web Of Science using the SN Indexing Status Tool
Incoming Citations Browse incoming citations for this publication using opencitations.net

JSON-LD is the canonical representation for SciGraph data.

TIP: You can open this SciGraph record using an external JSON-LD service: JSON-LD Playground Google SDTT

[
  {
    "@context": "https://springernature.github.io/scigraph/jsonld/sgcontext.json", 
    "about": [
      {
        "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/0801", 
        "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
        "name": "Artificial Intelligence and Image Processing", 
        "type": "DefinedTerm"
      }, 
      {
        "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/08", 
        "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
        "name": "Information and Computing Sciences", 
        "type": "DefinedTerm"
      }
    ], 
    "author": [
      {
        "affiliation": {
          "alternateName": "Hannam University", 
          "id": "https://www.grid.ac/institutes/grid.411970.a", 
          "name": [
            "Hannam University"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Yun", 
        "givenName": "Young-Sun", 
        "id": "sg:person.012422257207.75", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.012422257207.75"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "Hannam University", 
          "id": "https://www.grid.ac/institutes/grid.411970.a", 
          "name": [
            "Hannam University"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Jung", 
        "givenName": "Jinman", 
        "id": "sg:person.011734132707.22", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.011734132707.22"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "Hannam University", 
          "id": "https://www.grid.ac/institutes/grid.411970.a", 
          "name": [
            "Hannam University"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Eun", 
        "givenName": "Seongbae", 
        "id": "sg:person.010403215213.18", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010403215213.18"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "Kongju National University", 
          "id": "https://www.grid.ac/institutes/grid.411118.c", 
          "name": [
            "Kongju National University"
          ], 
          "type": "Organization"
        }, 
        "familyName": "So", 
        "givenName": "Sun-Sup", 
        "id": "sg:person.010534675221.37", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010534675221.37"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "Hansung University", 
          "id": "https://www.grid.ac/institutes/grid.444079.a", 
          "name": [
            "Hansung University"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Heo", 
        "givenName": "Junyoung", 
        "id": "sg:person.01362071421.93", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.01362071421.93"
        ], 
        "type": "Person"
      }
    ], 
    "citation": [
      {
        "id": "https://doi.org/10.1109/cvpr.2014.81", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1094727707"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1109/cvprw.2012.6239171", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1095296618"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1109/cvpr.2017.690", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1095851797"
        ], 
        "type": "CreativeWork"
      }
    ], 
    "datePublished": "2019", 
    "datePublishedReg": "2019-01-01", 
    "description": "Graphical user interface (GUI) is very important to interact with software users. In many studies, therefore, they are trying to convert GUI elements (or widgets) to code or to describe formally its structure by help of domain knowledge or machine learning based algorithms. In this paper, we adopted object detection based on deep neural networks that finds GUI elements by integration of localization and classification. After the successfully detection of GUI components, we will describe the objects as the hierarchical structure and transform those to appropriate codes by synthetic or machine learning algorithms.", 
    "editor": [
      {
        "familyName": "Hwang", 
        "givenName": "Seong Oun", 
        "type": "Person"
      }, 
      {
        "familyName": "Tan", 
        "givenName": "Syh Yuan", 
        "type": "Person"
      }, 
      {
        "familyName": "Bien", 
        "givenName": "Franklin", 
        "type": "Person"
      }
    ], 
    "genre": "chapter", 
    "id": "sg:pub.10.1007/978-981-13-0311-1_16", 
    "inLanguage": [
      "en"
    ], 
    "isAccessibleForFree": false, 
    "isPartOf": {
      "isbn": [
        "978-981-13-0310-4", 
        "978-981-13-0311-1"
      ], 
      "name": "Proceedings of the Sixth International Conference on Green and Human Information Technology", 
      "type": "Book"
    }, 
    "name": "Detection of GUI Elements on Sketch Images Using Object Detector Based on Deep Neural Networks", 
    "pagination": "86-90", 
    "productId": [
      {
        "name": "doi", 
        "type": "PropertyValue", 
        "value": [
          "10.1007/978-981-13-0311-1_16"
        ]
      }, 
      {
        "name": "readcube_id", 
        "type": "PropertyValue", 
        "value": [
          "5bbea639ac1f0c9e62fdff0241e1c17a159af3da2ddff6341ffd44a592869631"
        ]
      }, 
      {
        "name": "dimensions_id", 
        "type": "PropertyValue", 
        "value": [
          "pub.1105213333"
        ]
      }
    ], 
    "publisher": {
      "location": "Singapore", 
      "name": "Springer Singapore", 
      "type": "Organisation"
    }, 
    "sameAs": [
      "https://doi.org/10.1007/978-981-13-0311-1_16", 
      "https://app.dimensions.ai/details/publication/pub.1105213333"
    ], 
    "sdDataset": "chapters", 
    "sdDatePublished": "2019-04-15T15:40", 
    "sdLicense": "https://scigraph.springernature.com/explorer/license/", 
    "sdPublisher": {
      "name": "Springer Nature - SN SciGraph project", 
      "type": "Organization"
    }, 
    "sdSource": "s3://com-uberresearch-data-dimensions-target-20181106-alternative/cleanup/v134/2549eaecd7973599484d7c17b260dba0a4ecb94b/merge/v9/a6c9fde33151104705d4d7ff012ea9563521a3ce/jats-lookup/v90/0000000001_0000000264/records_8672_00000432.jsonl", 
    "type": "Chapter", 
    "url": "http://link.springer.com/10.1007/978-981-13-0311-1_16"
  }
]
 

Download the RDF metadata as:  json-ld nt turtle xml License info

HOW TO GET THIS DATA PROGRAMMATICALLY:

JSON-LD is a popular format for linked data which is fully compatible with JSON.

curl -H 'Accept: application/ld+json' 'https://scigraph.springernature.com/pub.10.1007/978-981-13-0311-1_16'

N-Triples is a line-based linked data format ideal for batch operations.

curl -H 'Accept: application/n-triples' 'https://scigraph.springernature.com/pub.10.1007/978-981-13-0311-1_16'

Turtle is a human-readable linked data format.

curl -H 'Accept: text/turtle' 'https://scigraph.springernature.com/pub.10.1007/978-981-13-0311-1_16'

RDF/XML is a standard XML format for linked data.

curl -H 'Accept: application/rdf+xml' 'https://scigraph.springernature.com/pub.10.1007/978-981-13-0311-1_16'


 

This table displays all metadata directly associated to this object as RDF triples.

118 TRIPLES      23 PREDICATES      30 URIs      20 LITERALS      8 BLANK NODES

Subject Predicate Object
1 sg:pub.10.1007/978-981-13-0311-1_16 schema:about anzsrc-for:08
2 anzsrc-for:0801
3 schema:author N5d8f1a228a784d259b61900a56ea40cb
4 schema:citation https://doi.org/10.1109/cvpr.2014.81
5 https://doi.org/10.1109/cvpr.2017.690
6 https://doi.org/10.1109/cvprw.2012.6239171
7 schema:datePublished 2019
8 schema:datePublishedReg 2019-01-01
9 schema:description Graphical user interface (GUI) is very important to interact with software users. In many studies, therefore, they are trying to convert GUI elements (or widgets) to code or to describe formally its structure by help of domain knowledge or machine learning based algorithms. In this paper, we adopted object detection based on deep neural networks that finds GUI elements by integration of localization and classification. After the successfully detection of GUI components, we will describe the objects as the hierarchical structure and transform those to appropriate codes by synthetic or machine learning algorithms.
10 schema:editor N44909098df5147ff8b403b9dfd795b93
11 schema:genre chapter
12 schema:inLanguage en
13 schema:isAccessibleForFree false
14 schema:isPartOf N6408b761b89d4c92b722dc43e72a5d2d
15 schema:name Detection of GUI Elements on Sketch Images Using Object Detector Based on Deep Neural Networks
16 schema:pagination 86-90
17 schema:productId N2c5516bf911e438e93f293ab6ec1387b
18 N4547f0828d9947fd9a829f02fa3b28f1
19 N6db784ded4654de6a7a3da9d6ac03c19
20 schema:publisher N89e9454856fe46c4bd49a498f78a1885
21 schema:sameAs https://app.dimensions.ai/details/publication/pub.1105213333
22 https://doi.org/10.1007/978-981-13-0311-1_16
23 schema:sdDatePublished 2019-04-15T15:40
24 schema:sdLicense https://scigraph.springernature.com/explorer/license/
25 schema:sdPublisher N17cb3f2e884841879ba36a6eb758f75b
26 schema:url http://link.springer.com/10.1007/978-981-13-0311-1_16
27 sgo:license sg:explorer/license/
28 sgo:sdDataset chapters
29 rdf:type schema:Chapter
30 N17cb3f2e884841879ba36a6eb758f75b schema:name Springer Nature - SN SciGraph project
31 rdf:type schema:Organization
32 N2b59eb401072497982f29b244eb9c739 rdf:first Nef43bbb5cbb747b1a55fb29fa13d3e97
33 rdf:rest rdf:nil
34 N2c5516bf911e438e93f293ab6ec1387b schema:name readcube_id
35 schema:value 5bbea639ac1f0c9e62fdff0241e1c17a159af3da2ddff6341ffd44a592869631
36 rdf:type schema:PropertyValue
37 N44909098df5147ff8b403b9dfd795b93 rdf:first Nfe625375358141dba4db55185bdc8eec
38 rdf:rest Ndde80bc2c01045ee959061f6e4ae8394
39 N4547f0828d9947fd9a829f02fa3b28f1 schema:name dimensions_id
40 schema:value pub.1105213333
41 rdf:type schema:PropertyValue
42 N5d8f1a228a784d259b61900a56ea40cb rdf:first sg:person.012422257207.75
43 rdf:rest Nb7b07e8b13534861bb73c67d8bd08936
44 N6408b761b89d4c92b722dc43e72a5d2d schema:isbn 978-981-13-0310-4
45 978-981-13-0311-1
46 schema:name Proceedings of the Sixth International Conference on Green and Human Information Technology
47 rdf:type schema:Book
48 N6d7c31579dcd477eafe2032db6bb03b7 rdf:first sg:person.010403215213.18
49 rdf:rest N6f35b66f2fef4f1ba69b5b87d198fce3
50 N6db784ded4654de6a7a3da9d6ac03c19 schema:name doi
51 schema:value 10.1007/978-981-13-0311-1_16
52 rdf:type schema:PropertyValue
53 N6f35b66f2fef4f1ba69b5b87d198fce3 rdf:first sg:person.010534675221.37
54 rdf:rest Ne3825ce10b9649e9b7dba53b34d42f70
55 N89e9454856fe46c4bd49a498f78a1885 schema:location Singapore
56 schema:name Springer Singapore
57 rdf:type schema:Organisation
58 N9e31bb46527d4248962965991223e163 schema:familyName Tan
59 schema:givenName Syh Yuan
60 rdf:type schema:Person
61 Nb7b07e8b13534861bb73c67d8bd08936 rdf:first sg:person.011734132707.22
62 rdf:rest N6d7c31579dcd477eafe2032db6bb03b7
63 Ndde80bc2c01045ee959061f6e4ae8394 rdf:first N9e31bb46527d4248962965991223e163
64 rdf:rest N2b59eb401072497982f29b244eb9c739
65 Ne3825ce10b9649e9b7dba53b34d42f70 rdf:first sg:person.01362071421.93
66 rdf:rest rdf:nil
67 Nef43bbb5cbb747b1a55fb29fa13d3e97 schema:familyName Bien
68 schema:givenName Franklin
69 rdf:type schema:Person
70 Nfe625375358141dba4db55185bdc8eec schema:familyName Hwang
71 schema:givenName Seong Oun
72 rdf:type schema:Person
73 anzsrc-for:08 schema:inDefinedTermSet anzsrc-for:
74 schema:name Information and Computing Sciences
75 rdf:type schema:DefinedTerm
76 anzsrc-for:0801 schema:inDefinedTermSet anzsrc-for:
77 schema:name Artificial Intelligence and Image Processing
78 rdf:type schema:DefinedTerm
79 sg:person.010403215213.18 schema:affiliation https://www.grid.ac/institutes/grid.411970.a
80 schema:familyName Eun
81 schema:givenName Seongbae
82 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010403215213.18
83 rdf:type schema:Person
84 sg:person.010534675221.37 schema:affiliation https://www.grid.ac/institutes/grid.411118.c
85 schema:familyName So
86 schema:givenName Sun-Sup
87 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010534675221.37
88 rdf:type schema:Person
89 sg:person.011734132707.22 schema:affiliation https://www.grid.ac/institutes/grid.411970.a
90 schema:familyName Jung
91 schema:givenName Jinman
92 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.011734132707.22
93 rdf:type schema:Person
94 sg:person.012422257207.75 schema:affiliation https://www.grid.ac/institutes/grid.411970.a
95 schema:familyName Yun
96 schema:givenName Young-Sun
97 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.012422257207.75
98 rdf:type schema:Person
99 sg:person.01362071421.93 schema:affiliation https://www.grid.ac/institutes/grid.444079.a
100 schema:familyName Heo
101 schema:givenName Junyoung
102 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.01362071421.93
103 rdf:type schema:Person
104 https://doi.org/10.1109/cvpr.2014.81 schema:sameAs https://app.dimensions.ai/details/publication/pub.1094727707
105 rdf:type schema:CreativeWork
106 https://doi.org/10.1109/cvpr.2017.690 schema:sameAs https://app.dimensions.ai/details/publication/pub.1095851797
107 rdf:type schema:CreativeWork
108 https://doi.org/10.1109/cvprw.2012.6239171 schema:sameAs https://app.dimensions.ai/details/publication/pub.1095296618
109 rdf:type schema:CreativeWork
110 https://www.grid.ac/institutes/grid.411118.c schema:alternateName Kongju National University
111 schema:name Kongju National University
112 rdf:type schema:Organization
113 https://www.grid.ac/institutes/grid.411970.a schema:alternateName Hannam University
114 schema:name Hannam University
115 rdf:type schema:Organization
116 https://www.grid.ac/institutes/grid.444079.a schema:alternateName Hansung University
117 schema:name Hansung University
118 rdf:type schema:Organization
 




Preview window. Press ESC to close (or click here)


...