Cognitive System to Achieve Human-Level Accuracy in Automated Assignment of Helpdesk Email Tickets View Full Text


Ontology type: schema:Chapter      Open Access: True


Chapter Info

DATE

2018-11-07

AUTHORS

Atri Mandal , Nikhil Malhotra , Shivali Agarwal , Anupama Ray , Giriprasad Sridhara

ABSTRACT

Ticket assignment/dispatch is a crucial part of service delivery business with lot of scope for automation and optimization. In this paper, we present an end-to-end automated helpdesk email ticket assignment system, which is also offered as a service. The objective of the system is to determine the nature of the problem mentioned in an incoming email ticket and then automatically dispatch it to an appropriate resolver group (or team) for resolution. The proposed system uses an ensemble classifier augmented with a configurable rule engine. While design of classifier that is accurate is one of the main challenges, we also need to address the need of designing a system that is robust and adaptive to changing business needs. We discuss some of the main design challenges associated with email ticket assignment automation and how we solve them. The design decisions for our system are driven by high accuracy, coverage, business continuity, scalability and optimal usage of computational resources. Our system has been deployed in production of three major service providers and currently assigning over 40,000 emails per month, on an average, with an accuracy close to 90% and covering at least 90% of email tickets. This translates to achieving human-level accuracy and results in a net saving of about 23000 man-hours of effort per annum. More... »

PAGES

332-341

References to SciGraph publications

Book

TITLE

Service-Oriented Computing

ISBN

978-3-030-03595-2
978-3-030-03596-9

Author Affiliations

Identifiers

URI

http://scigraph.springernature.com/pub.10.1007/978-3-030-03596-9_23

DOI

http://dx.doi.org/10.1007/978-3-030-03596-9_23

DIMENSIONS

https://app.dimensions.ai/details/publication/pub.1108059996


Indexing Status Check whether this publication has been indexed by Scopus and Web Of Science using the SN Indexing Status Tool
Incoming Citations Browse incoming citations for this publication using opencitations.net

JSON-LD is the canonical representation for SciGraph data.

TIP: You can open this SciGraph record using an external JSON-LD service: JSON-LD Playground Google SDTT

[
  {
    "@context": "https://springernature.github.io/scigraph/jsonld/sgcontext.json", 
    "about": [
      {
        "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/0801", 
        "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
        "name": "Artificial Intelligence and Image Processing", 
        "type": "DefinedTerm"
      }, 
      {
        "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/08", 
        "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
        "name": "Information and Computing Sciences", 
        "type": "DefinedTerm"
      }
    ], 
    "author": [
      {
        "affiliation": {
          "alternateName": "IBM Research - India", 
          "id": "https://www.grid.ac/institutes/grid.481550.d", 
          "name": [
            "IBM Research AI, Bengaluru, India"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Mandal", 
        "givenName": "Atri", 
        "id": "sg:person.015135210313.62", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.015135210313.62"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "name": [
            "IBM Global Technology Services, Bengaluru, India"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Malhotra", 
        "givenName": "Nikhil", 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "IBM Research - India", 
          "id": "https://www.grid.ac/institutes/grid.481550.d", 
          "name": [
            "IBM Research AI, Bengaluru, India"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Agarwal", 
        "givenName": "Shivali", 
        "id": "sg:person.011246033443.91", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.011246033443.91"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "IBM Research - India", 
          "id": "https://www.grid.ac/institutes/grid.481550.d", 
          "name": [
            "IBM Research AI, Bengaluru, India"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Ray", 
        "givenName": "Anupama", 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "IBM Research - India", 
          "id": "https://www.grid.ac/institutes/grid.481550.d", 
          "name": [
            "IBM Research AI, Bengaluru, India"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Sridhara", 
        "givenName": "Giriprasad", 
        "id": "sg:person.016133555233.84", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.016133555233.84"
        ], 
        "type": "Person"
      }
    ], 
    "citation": [
      {
        "id": "https://doi.org/10.1145/1401890.1401964", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1014664342"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1145/2339530.2339744", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1025634846"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-3-662-45391-9_39", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1042719664", 
          "https://doi.org/10.1007/978-3-662-45391-9_39"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.14778/1454159.1454193", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1067367436"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1109/tnsm.2017.2668363", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1083810908"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1147/jrd.2016.2629318", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1084228380"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1109/wsc.2009.5429275", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1093903489"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1109/srii.2011.95", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1095020070"
        ], 
        "type": "CreativeWork"
      }
    ], 
    "datePublished": "2018-11-07", 
    "datePublishedReg": "2018-11-07", 
    "description": "Ticket assignment/dispatch is a crucial part of service delivery business with lot of scope for automation and optimization. In this paper, we present an end-to-end automated helpdesk email ticket assignment system, which is also offered as a service. The objective of the system is to determine the nature of the problem mentioned in an incoming email ticket and then automatically dispatch it to an appropriate resolver group (or team) for resolution. The proposed system uses an ensemble classifier augmented with a configurable rule engine. While design of classifier that is accurate is one of the main challenges, we also need to address the need of designing a system that is robust and adaptive to changing business needs. We discuss some of the main design challenges associated with email ticket assignment automation and how we solve them. The design decisions for our system are driven by high accuracy, coverage, business continuity, scalability and optimal usage of computational resources. Our system has been deployed in production of three major service providers and currently assigning over 40,000 emails per month, on an average, with an accuracy close to 90% and covering at least 90% of email tickets. This translates to achieving human-level accuracy and results in a net saving of about 23000 man-hours of effort per annum.", 
    "editor": [
      {
        "familyName": "Pahl", 
        "givenName": "Claus", 
        "type": "Person"
      }, 
      {
        "familyName": "Vukovic", 
        "givenName": "Maja", 
        "type": "Person"
      }, 
      {
        "familyName": "Yin", 
        "givenName": "Jianwei", 
        "type": "Person"
      }, 
      {
        "familyName": "Yu", 
        "givenName": "Qi", 
        "type": "Person"
      }
    ], 
    "genre": "chapter", 
    "id": "sg:pub.10.1007/978-3-030-03596-9_23", 
    "inLanguage": [
      "en"
    ], 
    "isAccessibleForFree": true, 
    "isPartOf": {
      "isbn": [
        "978-3-030-03595-2", 
        "978-3-030-03596-9"
      ], 
      "name": "Service-Oriented Computing", 
      "type": "Book"
    }, 
    "name": "Cognitive System to Achieve Human-Level Accuracy in Automated Assignment of Helpdesk Email Tickets", 
    "pagination": "332-341", 
    "productId": [
      {
        "name": "doi", 
        "type": "PropertyValue", 
        "value": [
          "10.1007/978-3-030-03596-9_23"
        ]
      }, 
      {
        "name": "readcube_id", 
        "type": "PropertyValue", 
        "value": [
          "b600ab155eff9ad3786db896890df15ba6ff32eb066e96f74c9aabb9f818ebb3"
        ]
      }, 
      {
        "name": "dimensions_id", 
        "type": "PropertyValue", 
        "value": [
          "pub.1108059996"
        ]
      }
    ], 
    "publisher": {
      "location": "Cham", 
      "name": "Springer International Publishing", 
      "type": "Organisation"
    }, 
    "sameAs": [
      "https://doi.org/10.1007/978-3-030-03596-9_23", 
      "https://app.dimensions.ai/details/publication/pub.1108059996"
    ], 
    "sdDataset": "chapters", 
    "sdDatePublished": "2019-04-16T04:41", 
    "sdLicense": "https://scigraph.springernature.com/explorer/license/", 
    "sdPublisher": {
      "name": "Springer Nature - SN SciGraph project", 
      "type": "Organization"
    }, 
    "sdSource": "s3://com-uberresearch-data-dimensions-target-20181106-alternative/cleanup/v134/2549eaecd7973599484d7c17b260dba0a4ecb94b/merge/v9/a6c9fde33151104705d4d7ff012ea9563521a3ce/jats-lookup/v90/0000000322_0000000322/records_65022_00000000.jsonl", 
    "type": "Chapter", 
    "url": "https://link.springer.com/10.1007%2F978-3-030-03596-9_23"
  }
]
 

Download the RDF metadata as:  json-ld nt turtle xml License info

HOW TO GET THIS DATA PROGRAMMATICALLY:

JSON-LD is a popular format for linked data which is fully compatible with JSON.

curl -H 'Accept: application/ld+json' 'https://scigraph.springernature.com/pub.10.1007/978-3-030-03596-9_23'

N-Triples is a line-based linked data format ideal for batch operations.

curl -H 'Accept: application/n-triples' 'https://scigraph.springernature.com/pub.10.1007/978-3-030-03596-9_23'

Turtle is a human-readable linked data format.

curl -H 'Accept: text/turtle' 'https://scigraph.springernature.com/pub.10.1007/978-3-030-03596-9_23'

RDF/XML is a standard XML format for linked data.

curl -H 'Accept: application/rdf+xml' 'https://scigraph.springernature.com/pub.10.1007/978-3-030-03596-9_23'


 

This table displays all metadata directly associated to this object as RDF triples.

133 TRIPLES      23 PREDICATES      34 URIs      19 LITERALS      8 BLANK NODES

Subject Predicate Object
1 sg:pub.10.1007/978-3-030-03596-9_23 schema:about anzsrc-for:08
2 anzsrc-for:0801
3 schema:author N2937c2ea55f54686beaea07d7779d9a3
4 schema:citation sg:pub.10.1007/978-3-662-45391-9_39
5 https://doi.org/10.1109/srii.2011.95
6 https://doi.org/10.1109/tnsm.2017.2668363
7 https://doi.org/10.1109/wsc.2009.5429275
8 https://doi.org/10.1145/1401890.1401964
9 https://doi.org/10.1145/2339530.2339744
10 https://doi.org/10.1147/jrd.2016.2629318
11 https://doi.org/10.14778/1454159.1454193
12 schema:datePublished 2018-11-07
13 schema:datePublishedReg 2018-11-07
14 schema:description Ticket assignment/dispatch is a crucial part of service delivery business with lot of scope for automation and optimization. In this paper, we present an end-to-end automated helpdesk email ticket assignment system, which is also offered as a service. The objective of the system is to determine the nature of the problem mentioned in an incoming email ticket and then automatically dispatch it to an appropriate resolver group (or team) for resolution. The proposed system uses an ensemble classifier augmented with a configurable rule engine. While design of classifier that is accurate is one of the main challenges, we also need to address the need of designing a system that is robust and adaptive to changing business needs. We discuss some of the main design challenges associated with email ticket assignment automation and how we solve them. The design decisions for our system are driven by high accuracy, coverage, business continuity, scalability and optimal usage of computational resources. Our system has been deployed in production of three major service providers and currently assigning over 40,000 emails per month, on an average, with an accuracy close to 90% and covering at least 90% of email tickets. This translates to achieving human-level accuracy and results in a net saving of about 23000 man-hours of effort per annum.
15 schema:editor N916a9f913f6b4c7cb6692c5fab622513
16 schema:genre chapter
17 schema:inLanguage en
18 schema:isAccessibleForFree true
19 schema:isPartOf N3ae284dba5fa4ef68f3d72a78ca0d661
20 schema:name Cognitive System to Achieve Human-Level Accuracy in Automated Assignment of Helpdesk Email Tickets
21 schema:pagination 332-341
22 schema:productId N482011e32c47407991b41dd8764e0f50
23 N8652d73a035c45f99ee2389fdc0adcd4
24 N9757b04e9ecb49109a06b1c0cbf4c3a5
25 schema:publisher Nfedcd03361c24f078c7acd2d766b544c
26 schema:sameAs https://app.dimensions.ai/details/publication/pub.1108059996
27 https://doi.org/10.1007/978-3-030-03596-9_23
28 schema:sdDatePublished 2019-04-16T04:41
29 schema:sdLicense https://scigraph.springernature.com/explorer/license/
30 schema:sdPublisher N4758c0b3df2343829adc0b68fa9377b4
31 schema:url https://link.springer.com/10.1007%2F978-3-030-03596-9_23
32 sgo:license sg:explorer/license/
33 sgo:sdDataset chapters
34 rdf:type schema:Chapter
35 N0d08678af4914ed5bbe33b03d385eaa0 schema:familyName Yin
36 schema:givenName Jianwei
37 rdf:type schema:Person
38 N1d8c08cdbff943c1b93d52a511b13acb rdf:first N5a45e46e2bd3482b993ec068ab9a6b79
39 rdf:rest Nc7eee12136d44562bb0c10d7cf1ced80
40 N2937c2ea55f54686beaea07d7779d9a3 rdf:first sg:person.015135210313.62
41 rdf:rest N1d8c08cdbff943c1b93d52a511b13acb
42 N3ae284dba5fa4ef68f3d72a78ca0d661 schema:isbn 978-3-030-03595-2
43 978-3-030-03596-9
44 schema:name Service-Oriented Computing
45 rdf:type schema:Book
46 N3cc3be1b602c4f0d87b1a6103f21d214 rdf:first N0d08678af4914ed5bbe33b03d385eaa0
47 rdf:rest N7260f8c142f942879530b74ca5993d6f
48 N4758c0b3df2343829adc0b68fa9377b4 schema:name Springer Nature - SN SciGraph project
49 rdf:type schema:Organization
50 N482011e32c47407991b41dd8764e0f50 schema:name doi
51 schema:value 10.1007/978-3-030-03596-9_23
52 rdf:type schema:PropertyValue
53 N53317eef2fca4687a77714022999a119 schema:name IBM Global Technology Services, Bengaluru, India
54 rdf:type schema:Organization
55 N5a45e46e2bd3482b993ec068ab9a6b79 schema:affiliation N53317eef2fca4687a77714022999a119
56 schema:familyName Malhotra
57 schema:givenName Nikhil
58 rdf:type schema:Person
59 N685d7de66a024cdba3ea415a7a0dc826 schema:familyName Pahl
60 schema:givenName Claus
61 rdf:type schema:Person
62 N7260f8c142f942879530b74ca5993d6f rdf:first N9dfb963d86df4772b80198c660413bcf
63 rdf:rest rdf:nil
64 N839cdcb8ec6b49d8b6ec0bfbb0f3d2b3 rdf:first N8817093cae234fe3828b06005037bf91
65 rdf:rest N98c88fc846114b2e999a1e478f2f5730
66 N84cb5d612b0140edb24541bac0672bec schema:familyName Vukovic
67 schema:givenName Maja
68 rdf:type schema:Person
69 N8652d73a035c45f99ee2389fdc0adcd4 schema:name dimensions_id
70 schema:value pub.1108059996
71 rdf:type schema:PropertyValue
72 N8817093cae234fe3828b06005037bf91 schema:affiliation https://www.grid.ac/institutes/grid.481550.d
73 schema:familyName Ray
74 schema:givenName Anupama
75 rdf:type schema:Person
76 N916a9f913f6b4c7cb6692c5fab622513 rdf:first N685d7de66a024cdba3ea415a7a0dc826
77 rdf:rest Neb6d650d8eef4c7fba5f717e948a2219
78 N9757b04e9ecb49109a06b1c0cbf4c3a5 schema:name readcube_id
79 schema:value b600ab155eff9ad3786db896890df15ba6ff32eb066e96f74c9aabb9f818ebb3
80 rdf:type schema:PropertyValue
81 N98c88fc846114b2e999a1e478f2f5730 rdf:first sg:person.016133555233.84
82 rdf:rest rdf:nil
83 N9dfb963d86df4772b80198c660413bcf schema:familyName Yu
84 schema:givenName Qi
85 rdf:type schema:Person
86 Nc7eee12136d44562bb0c10d7cf1ced80 rdf:first sg:person.011246033443.91
87 rdf:rest N839cdcb8ec6b49d8b6ec0bfbb0f3d2b3
88 Neb6d650d8eef4c7fba5f717e948a2219 rdf:first N84cb5d612b0140edb24541bac0672bec
89 rdf:rest N3cc3be1b602c4f0d87b1a6103f21d214
90 Nfedcd03361c24f078c7acd2d766b544c schema:location Cham
91 schema:name Springer International Publishing
92 rdf:type schema:Organisation
93 anzsrc-for:08 schema:inDefinedTermSet anzsrc-for:
94 schema:name Information and Computing Sciences
95 rdf:type schema:DefinedTerm
96 anzsrc-for:0801 schema:inDefinedTermSet anzsrc-for:
97 schema:name Artificial Intelligence and Image Processing
98 rdf:type schema:DefinedTerm
99 sg:person.011246033443.91 schema:affiliation https://www.grid.ac/institutes/grid.481550.d
100 schema:familyName Agarwal
101 schema:givenName Shivali
102 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.011246033443.91
103 rdf:type schema:Person
104 sg:person.015135210313.62 schema:affiliation https://www.grid.ac/institutes/grid.481550.d
105 schema:familyName Mandal
106 schema:givenName Atri
107 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.015135210313.62
108 rdf:type schema:Person
109 sg:person.016133555233.84 schema:affiliation https://www.grid.ac/institutes/grid.481550.d
110 schema:familyName Sridhara
111 schema:givenName Giriprasad
112 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.016133555233.84
113 rdf:type schema:Person
114 sg:pub.10.1007/978-3-662-45391-9_39 schema:sameAs https://app.dimensions.ai/details/publication/pub.1042719664
115 https://doi.org/10.1007/978-3-662-45391-9_39
116 rdf:type schema:CreativeWork
117 https://doi.org/10.1109/srii.2011.95 schema:sameAs https://app.dimensions.ai/details/publication/pub.1095020070
118 rdf:type schema:CreativeWork
119 https://doi.org/10.1109/tnsm.2017.2668363 schema:sameAs https://app.dimensions.ai/details/publication/pub.1083810908
120 rdf:type schema:CreativeWork
121 https://doi.org/10.1109/wsc.2009.5429275 schema:sameAs https://app.dimensions.ai/details/publication/pub.1093903489
122 rdf:type schema:CreativeWork
123 https://doi.org/10.1145/1401890.1401964 schema:sameAs https://app.dimensions.ai/details/publication/pub.1014664342
124 rdf:type schema:CreativeWork
125 https://doi.org/10.1145/2339530.2339744 schema:sameAs https://app.dimensions.ai/details/publication/pub.1025634846
126 rdf:type schema:CreativeWork
127 https://doi.org/10.1147/jrd.2016.2629318 schema:sameAs https://app.dimensions.ai/details/publication/pub.1084228380
128 rdf:type schema:CreativeWork
129 https://doi.org/10.14778/1454159.1454193 schema:sameAs https://app.dimensions.ai/details/publication/pub.1067367436
130 rdf:type schema:CreativeWork
131 https://www.grid.ac/institutes/grid.481550.d schema:alternateName IBM Research - India
132 schema:name IBM Research AI, Bengaluru, India
133 rdf:type schema:Organization
 




Preview window. Press ESC to close (or click here)


...