Automated Essay Scoring System Based on Rubric View Full Text


Ontology type: schema:Chapter     


Chapter Info

DATE

2017-07-15

AUTHORS

Megumi Yamamoto , Nobuo Umemura , Hiroyuki Kawano

ABSTRACT

In this paper, we propose an architecture of automated essay scoring system based on rubric, which combines automated scoring with human scoring. Rubrics are valid criteria for grading students’ essays. Our proposed rubric has five evaluation viewpoints “Contents, Structure, Evidence, Style, and Skill” and 25 evaluation items which are subdivided viewpoints. The system is cloud-based application and consists of several tools such as Moodle, R, MeCab, and RedPen. At first, the system automatically scores 11 items included in the Style and Skill such as sentence style, syntax, usage, readability, lexical richness, and so on. Then it predicts scores of Style and Skill from these items’ scores by multiple regression model. It also predicts Contents’ score by the cosine similarity between topics and descriptions. Moreover, our system classifies into five grades “A+, A, B, C, D” as useful information for teachers, by using machine learning techniques such as support vector machine. We try to improve automated scoring algorithms and a variety of input essays in order to improve accuracy of classification over 90%. More... »

PAGES

177-190

Identifiers

URI

http://scigraph.springernature.com/pub.10.1007/978-3-319-64051-8_11

DOI

http://dx.doi.org/10.1007/978-3-319-64051-8_11

DIMENSIONS

https://app.dimensions.ai/details/publication/pub.1090680764


Indexing Status Check whether this publication has been indexed by Scopus and Web Of Science using the SN Indexing Status Tool
Incoming Citations Browse incoming citations for this publication using opencitations.net

JSON-LD is the canonical representation for SciGraph data.

TIP: You can open this SciGraph record using an external JSON-LD service: JSON-LD Playground Google SDTT

[
  {
    "@context": "https://springernature.github.io/scigraph/jsonld/sgcontext.json", 
    "about": [
      {
        "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/08", 
        "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
        "name": "Information and Computing Sciences", 
        "type": "DefinedTerm"
      }, 
      {
        "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/0801", 
        "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
        "name": "Artificial Intelligence and Image Processing", 
        "type": "DefinedTerm"
      }
    ], 
    "author": [
      {
        "affiliation": {
          "alternateName": "School of Contemporary International Studies, Nagoya University of Foreign Studies, 470-0197, Nisshin, Japan", 
          "id": "http://www.grid.ac/institutes/grid.444511.1", 
          "name": [
            "School of Contemporary International Studies, Nagoya University of Foreign Studies, 470-0197, Nisshin, Japan"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Yamamoto", 
        "givenName": "Megumi", 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "School of Media and Design, Nagoya University of Arts and Sciences, 470-0196, Nagoya, Japan", 
          "id": "http://www.grid.ac/institutes/grid.444512.2", 
          "name": [
            "School of Media and Design, Nagoya University of Arts and Sciences, 470-0196, Nagoya, Japan"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Umemura", 
        "givenName": "Nobuo", 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "Faculty of Science and Engineering, Nanzan University, 466-8673, Nagoya, Japan", 
          "id": "http://www.grid.ac/institutes/grid.444385.a", 
          "name": [
            "Faculty of Science and Engineering, Nanzan University, 466-8673, Nagoya, Japan"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Kawano", 
        "givenName": "Hiroyuki", 
        "id": "sg:person.013163377255.11", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.013163377255.11"
        ], 
        "type": "Person"
      }
    ], 
    "datePublished": "2017-07-15", 
    "datePublishedReg": "2017-07-15", 
    "description": "In this paper, we propose an architecture of automated essay scoring system based on rubric, which combines automated scoring with human scoring. Rubrics are valid criteria for grading students\u2019 essays. Our proposed rubric has five evaluation viewpoints \u201cContents, Structure, Evidence, Style, and Skill\u201d and 25 evaluation items which are subdivided viewpoints. The system is cloud-based application and consists of several tools such as Moodle, R, MeCab, and RedPen. At first, the system automatically scores 11 items included in the Style and Skill such as sentence style, syntax, usage, readability, lexical richness, and so on. Then it predicts scores of Style and Skill from these items\u2019 scores by multiple regression model. It also predicts Contents\u2019 score by the cosine similarity between topics and descriptions. Moreover, our system classifies into five grades \u201cA+, A, B, C, D\u201d as useful information for teachers, by using machine learning techniques such as support vector machine. We try to improve automated scoring algorithms and a variety of input essays in order to improve accuracy of classification over 90%.", 
    "editor": [
      {
        "familyName": "Lee", 
        "givenName": "Roger", 
        "type": "Person"
      }
    ], 
    "genre": "chapter", 
    "id": "sg:pub.10.1007/978-3-319-64051-8_11", 
    "inLanguage": "en", 
    "isAccessibleForFree": false, 
    "isPartOf": {
      "isbn": [
        "978-3-319-64050-1", 
        "978-3-319-64051-8"
      ], 
      "name": "Applied Computing & Information Technology", 
      "type": "Book"
    }, 
    "keywords": [
      "support vector machine", 
      "accuracy of classification", 
      "cosine similarity", 
      "vector machine", 
      "essay scoring system", 
      "human scoring", 
      "sentence style", 
      "machine", 
      "useful information", 
      "system", 
      "Moodle", 
      "algorithm", 
      "architecture", 
      "MeCab", 
      "evaluation viewpoint", 
      "syntax", 
      "readability", 
      "viewpoint", 
      "usage", 
      "classification", 
      "information", 
      "accuracy", 
      "style", 
      "items", 
      "tool", 
      "applications", 
      "evaluation items", 
      "topic", 
      "technique", 
      "order", 
      "description", 
      "model", 
      "skills", 
      "similarity", 
      "scoring", 
      "variety", 
      "lexical richness", 
      "content", 
      "regression models", 
      "criteria", 
      "rubric", 
      "students", 
      "structure", 
      "multiple regression model", 
      "teachers", 
      "valid criteria", 
      "scores", 
      "scoring system", 
      "richness", 
      "grade", 
      "essay", 
      "evidence", 
      "paper", 
      "RedPen", 
      "scores of Style", 
      "input essays"
    ], 
    "name": "Automated Essay Scoring System Based on Rubric", 
    "pagination": "177-190", 
    "productId": [
      {
        "name": "dimensions_id", 
        "type": "PropertyValue", 
        "value": [
          "pub.1090680764"
        ]
      }, 
      {
        "name": "doi", 
        "type": "PropertyValue", 
        "value": [
          "10.1007/978-3-319-64051-8_11"
        ]
      }
    ], 
    "publisher": {
      "name": "Springer Nature", 
      "type": "Organisation"
    }, 
    "sameAs": [
      "https://doi.org/10.1007/978-3-319-64051-8_11", 
      "https://app.dimensions.ai/details/publication/pub.1090680764"
    ], 
    "sdDataset": "chapters", 
    "sdDatePublished": "2021-11-01T18:53", 
    "sdLicense": "https://scigraph.springernature.com/explorer/license/", 
    "sdPublisher": {
      "name": "Springer Nature - SN SciGraph project", 
      "type": "Organization"
    }, 
    "sdSource": "s3://com-springernature-scigraph/baseset/20211101/entities/gbq_results/chapter/chapter_278.jsonl", 
    "type": "Chapter", 
    "url": "https://doi.org/10.1007/978-3-319-64051-8_11"
  }
]
 

Download the RDF metadata as:  json-ld nt turtle xml License info

HOW TO GET THIS DATA PROGRAMMATICALLY:

JSON-LD is a popular format for linked data which is fully compatible with JSON.

curl -H 'Accept: application/ld+json' 'https://scigraph.springernature.com/pub.10.1007/978-3-319-64051-8_11'

N-Triples is a line-based linked data format ideal for batch operations.

curl -H 'Accept: application/n-triples' 'https://scigraph.springernature.com/pub.10.1007/978-3-319-64051-8_11'

Turtle is a human-readable linked data format.

curl -H 'Accept: text/turtle' 'https://scigraph.springernature.com/pub.10.1007/978-3-319-64051-8_11'

RDF/XML is a standard XML format for linked data.

curl -H 'Accept: application/rdf+xml' 'https://scigraph.springernature.com/pub.10.1007/978-3-319-64051-8_11'


 

This table displays all metadata directly associated to this object as RDF triples.

134 TRIPLES      23 PREDICATES      81 URIs      74 LITERALS      7 BLANK NODES

Subject Predicate Object
1 sg:pub.10.1007/978-3-319-64051-8_11 schema:about anzsrc-for:08
2 anzsrc-for:0801
3 schema:author N29cb10d589504eadb583450dfac0f1f1
4 schema:datePublished 2017-07-15
5 schema:datePublishedReg 2017-07-15
6 schema:description In this paper, we propose an architecture of automated essay scoring system based on rubric, which combines automated scoring with human scoring. Rubrics are valid criteria for grading students’ essays. Our proposed rubric has five evaluation viewpoints “Contents, Structure, Evidence, Style, and Skill” and 25 evaluation items which are subdivided viewpoints. The system is cloud-based application and consists of several tools such as Moodle, R, MeCab, and RedPen. At first, the system automatically scores 11 items included in the Style and Skill such as sentence style, syntax, usage, readability, lexical richness, and so on. Then it predicts scores of Style and Skill from these items’ scores by multiple regression model. It also predicts Contents’ score by the cosine similarity between topics and descriptions. Moreover, our system classifies into five grades “A+, A, B, C, D” as useful information for teachers, by using machine learning techniques such as support vector machine. We try to improve automated scoring algorithms and a variety of input essays in order to improve accuracy of classification over 90%.
7 schema:editor N16146f852db24e46a3d2fbcf3d157ba9
8 schema:genre chapter
9 schema:inLanguage en
10 schema:isAccessibleForFree false
11 schema:isPartOf N513e485ec71348cb92d21a3e58e3dce9
12 schema:keywords MeCab
13 Moodle
14 RedPen
15 accuracy
16 accuracy of classification
17 algorithm
18 applications
19 architecture
20 classification
21 content
22 cosine similarity
23 criteria
24 description
25 essay
26 essay scoring system
27 evaluation items
28 evaluation viewpoint
29 evidence
30 grade
31 human scoring
32 information
33 input essays
34 items
35 lexical richness
36 machine
37 model
38 multiple regression model
39 order
40 paper
41 readability
42 regression models
43 richness
44 rubric
45 scores
46 scores of Style
47 scoring
48 scoring system
49 sentence style
50 similarity
51 skills
52 structure
53 students
54 style
55 support vector machine
56 syntax
57 system
58 teachers
59 technique
60 tool
61 topic
62 usage
63 useful information
64 valid criteria
65 variety
66 vector machine
67 viewpoint
68 schema:name Automated Essay Scoring System Based on Rubric
69 schema:pagination 177-190
70 schema:productId N0b5b5c863efc4824bd9f7c42cdb3a319
71 Nf3b57f2eaf7545df9ac1cc2d8dd2df9f
72 schema:publisher Nfe8fcb22fae94597a9d9dda73849a767
73 schema:sameAs https://app.dimensions.ai/details/publication/pub.1090680764
74 https://doi.org/10.1007/978-3-319-64051-8_11
75 schema:sdDatePublished 2021-11-01T18:53
76 schema:sdLicense https://scigraph.springernature.com/explorer/license/
77 schema:sdPublisher N589b151c75f0435f9e21dd77a10c3596
78 schema:url https://doi.org/10.1007/978-3-319-64051-8_11
79 sgo:license sg:explorer/license/
80 sgo:sdDataset chapters
81 rdf:type schema:Chapter
82 N0b5b5c863efc4824bd9f7c42cdb3a319 schema:name dimensions_id
83 schema:value pub.1090680764
84 rdf:type schema:PropertyValue
85 N16146f852db24e46a3d2fbcf3d157ba9 rdf:first Nac0a94189557416d821db906489367d2
86 rdf:rest rdf:nil
87 N20b9fe037c794ec48d90147d31ce4346 schema:affiliation grid-institutes:grid.444511.1
88 schema:familyName Yamamoto
89 schema:givenName Megumi
90 rdf:type schema:Person
91 N29cb10d589504eadb583450dfac0f1f1 rdf:first N20b9fe037c794ec48d90147d31ce4346
92 rdf:rest N5bc9780b0e724179b2a48cc31e575da7
93 N513e485ec71348cb92d21a3e58e3dce9 schema:isbn 978-3-319-64050-1
94 978-3-319-64051-8
95 schema:name Applied Computing & Information Technology
96 rdf:type schema:Book
97 N589b151c75f0435f9e21dd77a10c3596 schema:name Springer Nature - SN SciGraph project
98 rdf:type schema:Organization
99 N5bc9780b0e724179b2a48cc31e575da7 rdf:first Nbe3fe81c541448fda56f2a5abdb30009
100 rdf:rest Ncd2a3b0a0887463ca4ce14fbeed273bc
101 Nac0a94189557416d821db906489367d2 schema:familyName Lee
102 schema:givenName Roger
103 rdf:type schema:Person
104 Nbe3fe81c541448fda56f2a5abdb30009 schema:affiliation grid-institutes:grid.444512.2
105 schema:familyName Umemura
106 schema:givenName Nobuo
107 rdf:type schema:Person
108 Ncd2a3b0a0887463ca4ce14fbeed273bc rdf:first sg:person.013163377255.11
109 rdf:rest rdf:nil
110 Nf3b57f2eaf7545df9ac1cc2d8dd2df9f schema:name doi
111 schema:value 10.1007/978-3-319-64051-8_11
112 rdf:type schema:PropertyValue
113 Nfe8fcb22fae94597a9d9dda73849a767 schema:name Springer Nature
114 rdf:type schema:Organisation
115 anzsrc-for:08 schema:inDefinedTermSet anzsrc-for:
116 schema:name Information and Computing Sciences
117 rdf:type schema:DefinedTerm
118 anzsrc-for:0801 schema:inDefinedTermSet anzsrc-for:
119 schema:name Artificial Intelligence and Image Processing
120 rdf:type schema:DefinedTerm
121 sg:person.013163377255.11 schema:affiliation grid-institutes:grid.444385.a
122 schema:familyName Kawano
123 schema:givenName Hiroyuki
124 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.013163377255.11
125 rdf:type schema:Person
126 grid-institutes:grid.444385.a schema:alternateName Faculty of Science and Engineering, Nanzan University, 466-8673, Nagoya, Japan
127 schema:name Faculty of Science and Engineering, Nanzan University, 466-8673, Nagoya, Japan
128 rdf:type schema:Organization
129 grid-institutes:grid.444511.1 schema:alternateName School of Contemporary International Studies, Nagoya University of Foreign Studies, 470-0197, Nisshin, Japan
130 schema:name School of Contemporary International Studies, Nagoya University of Foreign Studies, 470-0197, Nisshin, Japan
131 rdf:type schema:Organization
132 grid-institutes:grid.444512.2 schema:alternateName School of Media and Design, Nagoya University of Arts and Sciences, 470-0196, Nagoya, Japan
133 schema:name School of Media and Design, Nagoya University of Arts and Sciences, 470-0196, Nagoya, Japan
134 rdf:type schema:Organization
 




Preview window. Press ESC to close (or click here)


...