Cognitive System to Achieve Human-Level Accuracy in Automated Assignment of Helpdesk Email Tickets View Full Text


Ontology type: schema:Chapter      Open Access: True


Chapter Info

DATE

2018-11-07

AUTHORS

Atri Mandal , Nikhil Malhotra , Shivali Agarwal , Anupama Ray , Giriprasad Sridhara

ABSTRACT

Ticket assignment/dispatch is a crucial part of service delivery business with lot of scope for automation and optimization. In this paper, we present an end-to-end automated helpdesk email ticket assignment system, which is also offered as a service. The objective of the system is to determine the nature of the problem mentioned in an incoming email ticket and then automatically dispatch it to an appropriate resolver group (or team) for resolution. The proposed system uses an ensemble classifier augmented with a configurable rule engine. While design of classifier that is accurate is one of the main challenges, we also need to address the need of designing a system that is robust and adaptive to changing business needs. We discuss some of the main design challenges associated with email ticket assignment automation and how we solve them. The design decisions for our system are driven by high accuracy, coverage, business continuity, scalability and optimal usage of computational resources. Our system has been deployed in production of three major service providers and currently assigning over 40,000 emails per month, on an average, with an accuracy close to 90% and covering at least 90% of email tickets. This translates to achieving human-level accuracy and results in a net saving of about 23000 man-hours of effort per annum. More... »

PAGES

332-341

References to SciGraph publications

Book

TITLE

Service-Oriented Computing

ISBN

978-3-030-03595-2
978-3-030-03596-9

Author Affiliations

Identifiers

URI

http://scigraph.springernature.com/pub.10.1007/978-3-030-03596-9_23

DOI

http://dx.doi.org/10.1007/978-3-030-03596-9_23

DIMENSIONS

https://app.dimensions.ai/details/publication/pub.1108059996


Indexing Status Check whether this publication has been indexed by Scopus and Web Of Science using the SN Indexing Status Tool
Incoming Citations Browse incoming citations for this publication using opencitations.net

JSON-LD is the canonical representation for SciGraph data.

TIP: You can open this SciGraph record using an external JSON-LD service: JSON-LD Playground Google SDTT

[
  {
    "@context": "https://springernature.github.io/scigraph/jsonld/sgcontext.json", 
    "about": [
      {
        "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/0801", 
        "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
        "name": "Artificial Intelligence and Image Processing", 
        "type": "DefinedTerm"
      }, 
      {
        "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/08", 
        "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
        "name": "Information and Computing Sciences", 
        "type": "DefinedTerm"
      }
    ], 
    "author": [
      {
        "affiliation": {
          "alternateName": "IBM Research - India", 
          "id": "https://www.grid.ac/institutes/grid.481550.d", 
          "name": [
            "IBM Research AI, Bengaluru, India"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Mandal", 
        "givenName": "Atri", 
        "id": "sg:person.015135210313.62", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.015135210313.62"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "name": [
            "IBM Global Technology Services, Bengaluru, India"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Malhotra", 
        "givenName": "Nikhil", 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "IBM Research - India", 
          "id": "https://www.grid.ac/institutes/grid.481550.d", 
          "name": [
            "IBM Research AI, Bengaluru, India"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Agarwal", 
        "givenName": "Shivali", 
        "id": "sg:person.011246033443.91", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.011246033443.91"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "IBM Research - India", 
          "id": "https://www.grid.ac/institutes/grid.481550.d", 
          "name": [
            "IBM Research AI, Bengaluru, India"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Ray", 
        "givenName": "Anupama", 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "IBM Research - India", 
          "id": "https://www.grid.ac/institutes/grid.481550.d", 
          "name": [
            "IBM Research AI, Bengaluru, India"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Sridhara", 
        "givenName": "Giriprasad", 
        "id": "sg:person.016133555233.84", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.016133555233.84"
        ], 
        "type": "Person"
      }
    ], 
    "citation": [
      {
        "id": "https://doi.org/10.1145/1401890.1401964", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1014664342"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1145/2339530.2339744", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1025634846"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "sg:pub.10.1007/978-3-662-45391-9_39", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1042719664", 
          "https://doi.org/10.1007/978-3-662-45391-9_39"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.14778/1454159.1454193", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1067367436"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1109/tnsm.2017.2668363", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1083810908"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1147/jrd.2016.2629318", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1084228380"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1109/wsc.2009.5429275", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1093903489"
        ], 
        "type": "CreativeWork"
      }, 
      {
        "id": "https://doi.org/10.1109/srii.2011.95", 
        "sameAs": [
          "https://app.dimensions.ai/details/publication/pub.1095020070"
        ], 
        "type": "CreativeWork"
      }
    ], 
    "datePublished": "2018-11-07", 
    "datePublishedReg": "2018-11-07", 
    "description": "Ticket assignment/dispatch is a crucial part of service delivery business with lot of scope for automation and optimization. In this paper, we present an end-to-end automated helpdesk email ticket assignment system, which is also offered as a service. The objective of the system is to determine the nature of the problem mentioned in an incoming email ticket and then automatically dispatch it to an appropriate resolver group (or team) for resolution. The proposed system uses an ensemble classifier augmented with a configurable rule engine. While design of classifier that is accurate is one of the main challenges, we also need to address the need of designing a system that is robust and adaptive to changing business needs. We discuss some of the main design challenges associated with email ticket assignment automation and how we solve them. The design decisions for our system are driven by high accuracy, coverage, business continuity, scalability and optimal usage of computational resources. Our system has been deployed in production of three major service providers and currently assigning over 40,000 emails per month, on an average, with an accuracy close to 90% and covering at least 90% of email tickets. This translates to achieving human-level accuracy and results in a net saving of about 23000 man-hours of effort per annum.", 
    "editor": [
      {
        "familyName": "Pahl", 
        "givenName": "Claus", 
        "type": "Person"
      }, 
      {
        "familyName": "Vukovic", 
        "givenName": "Maja", 
        "type": "Person"
      }, 
      {
        "familyName": "Yin", 
        "givenName": "Jianwei", 
        "type": "Person"
      }, 
      {
        "familyName": "Yu", 
        "givenName": "Qi", 
        "type": "Person"
      }
    ], 
    "genre": "chapter", 
    "id": "sg:pub.10.1007/978-3-030-03596-9_23", 
    "inLanguage": [
      "en"
    ], 
    "isAccessibleForFree": true, 
    "isPartOf": {
      "isbn": [
        "978-3-030-03595-2", 
        "978-3-030-03596-9"
      ], 
      "name": "Service-Oriented Computing", 
      "type": "Book"
    }, 
    "name": "Cognitive System to Achieve Human-Level Accuracy in Automated Assignment of Helpdesk Email Tickets", 
    "pagination": "332-341", 
    "productId": [
      {
        "name": "doi", 
        "type": "PropertyValue", 
        "value": [
          "10.1007/978-3-030-03596-9_23"
        ]
      }, 
      {
        "name": "readcube_id", 
        "type": "PropertyValue", 
        "value": [
          "b600ab155eff9ad3786db896890df15ba6ff32eb066e96f74c9aabb9f818ebb3"
        ]
      }, 
      {
        "name": "dimensions_id", 
        "type": "PropertyValue", 
        "value": [
          "pub.1108059996"
        ]
      }
    ], 
    "publisher": {
      "location": "Cham", 
      "name": "Springer International Publishing", 
      "type": "Organisation"
    }, 
    "sameAs": [
      "https://doi.org/10.1007/978-3-030-03596-9_23", 
      "https://app.dimensions.ai/details/publication/pub.1108059996"
    ], 
    "sdDataset": "chapters", 
    "sdDatePublished": "2019-04-16T04:41", 
    "sdLicense": "https://scigraph.springernature.com/explorer/license/", 
    "sdPublisher": {
      "name": "Springer Nature - SN SciGraph project", 
      "type": "Organization"
    }, 
    "sdSource": "s3://com-uberresearch-data-dimensions-target-20181106-alternative/cleanup/v134/2549eaecd7973599484d7c17b260dba0a4ecb94b/merge/v9/a6c9fde33151104705d4d7ff012ea9563521a3ce/jats-lookup/v90/0000000322_0000000322/records_65022_00000000.jsonl", 
    "type": "Chapter", 
    "url": "https://link.springer.com/10.1007%2F978-3-030-03596-9_23"
  }
]
 

Download the RDF metadata as:  json-ld nt turtle xml License info

HOW TO GET THIS DATA PROGRAMMATICALLY:

JSON-LD is a popular format for linked data which is fully compatible with JSON.

curl -H 'Accept: application/ld+json' 'https://scigraph.springernature.com/pub.10.1007/978-3-030-03596-9_23'

N-Triples is a line-based linked data format ideal for batch operations.

curl -H 'Accept: application/n-triples' 'https://scigraph.springernature.com/pub.10.1007/978-3-030-03596-9_23'

Turtle is a human-readable linked data format.

curl -H 'Accept: text/turtle' 'https://scigraph.springernature.com/pub.10.1007/978-3-030-03596-9_23'

RDF/XML is a standard XML format for linked data.

curl -H 'Accept: application/rdf+xml' 'https://scigraph.springernature.com/pub.10.1007/978-3-030-03596-9_23'


 

This table displays all metadata directly associated to this object as RDF triples.

133 TRIPLES      23 PREDICATES      34 URIs      19 LITERALS      8 BLANK NODES

Subject Predicate Object
1 sg:pub.10.1007/978-3-030-03596-9_23 schema:about anzsrc-for:08
2 anzsrc-for:0801
3 schema:author N6a86f59170d5420ba01898b049b86d3f
4 schema:citation sg:pub.10.1007/978-3-662-45391-9_39
5 https://doi.org/10.1109/srii.2011.95
6 https://doi.org/10.1109/tnsm.2017.2668363
7 https://doi.org/10.1109/wsc.2009.5429275
8 https://doi.org/10.1145/1401890.1401964
9 https://doi.org/10.1145/2339530.2339744
10 https://doi.org/10.1147/jrd.2016.2629318
11 https://doi.org/10.14778/1454159.1454193
12 schema:datePublished 2018-11-07
13 schema:datePublishedReg 2018-11-07
14 schema:description Ticket assignment/dispatch is a crucial part of service delivery business with lot of scope for automation and optimization. In this paper, we present an end-to-end automated helpdesk email ticket assignment system, which is also offered as a service. The objective of the system is to determine the nature of the problem mentioned in an incoming email ticket and then automatically dispatch it to an appropriate resolver group (or team) for resolution. The proposed system uses an ensemble classifier augmented with a configurable rule engine. While design of classifier that is accurate is one of the main challenges, we also need to address the need of designing a system that is robust and adaptive to changing business needs. We discuss some of the main design challenges associated with email ticket assignment automation and how we solve them. The design decisions for our system are driven by high accuracy, coverage, business continuity, scalability and optimal usage of computational resources. Our system has been deployed in production of three major service providers and currently assigning over 40,000 emails per month, on an average, with an accuracy close to 90% and covering at least 90% of email tickets. This translates to achieving human-level accuracy and results in a net saving of about 23000 man-hours of effort per annum.
15 schema:editor N6d425d36e8094862ba68fe0a53783879
16 schema:genre chapter
17 schema:inLanguage en
18 schema:isAccessibleForFree true
19 schema:isPartOf N3a0a1fc5735e4acf9097284167064a75
20 schema:name Cognitive System to Achieve Human-Level Accuracy in Automated Assignment of Helpdesk Email Tickets
21 schema:pagination 332-341
22 schema:productId N0c775628e3db4c45829381dd2df45669
23 N276ec8b782464a5dbe2f9eaa271ed927
24 N54cf4170d4a0443abf7386484ab54945
25 schema:publisher N6db1273e488b455fbd157935a9290b3e
26 schema:sameAs https://app.dimensions.ai/details/publication/pub.1108059996
27 https://doi.org/10.1007/978-3-030-03596-9_23
28 schema:sdDatePublished 2019-04-16T04:41
29 schema:sdLicense https://scigraph.springernature.com/explorer/license/
30 schema:sdPublisher Neb447660b33e4cc3a5c38c60713bff2e
31 schema:url https://link.springer.com/10.1007%2F978-3-030-03596-9_23
32 sgo:license sg:explorer/license/
33 sgo:sdDataset chapters
34 rdf:type schema:Chapter
35 N0c775628e3db4c45829381dd2df45669 schema:name dimensions_id
36 schema:value pub.1108059996
37 rdf:type schema:PropertyValue
38 N276ec8b782464a5dbe2f9eaa271ed927 schema:name readcube_id
39 schema:value b600ab155eff9ad3786db896890df15ba6ff32eb066e96f74c9aabb9f818ebb3
40 rdf:type schema:PropertyValue
41 N2ad4ab46707941d68e91cc8ae1ad57de schema:familyName Pahl
42 schema:givenName Claus
43 rdf:type schema:Person
44 N30dbfdb35b384eae935ad2dea1083dc3 rdf:first N47588a592fe14c759c6af828c7b8e9aa
45 rdf:rest rdf:nil
46 N3a0a1fc5735e4acf9097284167064a75 schema:isbn 978-3-030-03595-2
47 978-3-030-03596-9
48 schema:name Service-Oriented Computing
49 rdf:type schema:Book
50 N44603796ccf4413f8b478f782df2a372 rdf:first Ncbd9bbcd43df4902a8f7b7900a863920
51 rdf:rest Nfd018881e7d24300ab92215fb41e402b
52 N47588a592fe14c759c6af828c7b8e9aa schema:familyName Yu
53 schema:givenName Qi
54 rdf:type schema:Person
55 N54cf4170d4a0443abf7386484ab54945 schema:name doi
56 schema:value 10.1007/978-3-030-03596-9_23
57 rdf:type schema:PropertyValue
58 N5a22e3f651604f6d968525216c0f13ae schema:familyName Vukovic
59 schema:givenName Maja
60 rdf:type schema:Person
61 N623d21b101014effa21a69553e9f78d3 rdf:first Nace99633e8084189913c96d25a8b1730
62 rdf:rest N84bf5f7a308842c8a7cd4c558b2a4f82
63 N6a86f59170d5420ba01898b049b86d3f rdf:first sg:person.015135210313.62
64 rdf:rest N623d21b101014effa21a69553e9f78d3
65 N6d425d36e8094862ba68fe0a53783879 rdf:first N2ad4ab46707941d68e91cc8ae1ad57de
66 rdf:rest Nb91eb12964264d89bed8ebad311e738c
67 N6db1273e488b455fbd157935a9290b3e schema:location Cham
68 schema:name Springer International Publishing
69 rdf:type schema:Organisation
70 N84bf5f7a308842c8a7cd4c558b2a4f82 rdf:first sg:person.011246033443.91
71 rdf:rest N44603796ccf4413f8b478f782df2a372
72 Na396e510056449ad8af3079a64f926ee rdf:first Nff15c6218cf44a17a536a4700282686c
73 rdf:rest N30dbfdb35b384eae935ad2dea1083dc3
74 Nace99633e8084189913c96d25a8b1730 schema:affiliation Nafd4525b716e4f058622c7dc6f3c73fa
75 schema:familyName Malhotra
76 schema:givenName Nikhil
77 rdf:type schema:Person
78 Nafd4525b716e4f058622c7dc6f3c73fa schema:name IBM Global Technology Services, Bengaluru, India
79 rdf:type schema:Organization
80 Nb91eb12964264d89bed8ebad311e738c rdf:first N5a22e3f651604f6d968525216c0f13ae
81 rdf:rest Na396e510056449ad8af3079a64f926ee
82 Ncbd9bbcd43df4902a8f7b7900a863920 schema:affiliation https://www.grid.ac/institutes/grid.481550.d
83 schema:familyName Ray
84 schema:givenName Anupama
85 rdf:type schema:Person
86 Neb447660b33e4cc3a5c38c60713bff2e schema:name Springer Nature - SN SciGraph project
87 rdf:type schema:Organization
88 Nfd018881e7d24300ab92215fb41e402b rdf:first sg:person.016133555233.84
89 rdf:rest rdf:nil
90 Nff15c6218cf44a17a536a4700282686c schema:familyName Yin
91 schema:givenName Jianwei
92 rdf:type schema:Person
93 anzsrc-for:08 schema:inDefinedTermSet anzsrc-for:
94 schema:name Information and Computing Sciences
95 rdf:type schema:DefinedTerm
96 anzsrc-for:0801 schema:inDefinedTermSet anzsrc-for:
97 schema:name Artificial Intelligence and Image Processing
98 rdf:type schema:DefinedTerm
99 sg:person.011246033443.91 schema:affiliation https://www.grid.ac/institutes/grid.481550.d
100 schema:familyName Agarwal
101 schema:givenName Shivali
102 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.011246033443.91
103 rdf:type schema:Person
104 sg:person.015135210313.62 schema:affiliation https://www.grid.ac/institutes/grid.481550.d
105 schema:familyName Mandal
106 schema:givenName Atri
107 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.015135210313.62
108 rdf:type schema:Person
109 sg:person.016133555233.84 schema:affiliation https://www.grid.ac/institutes/grid.481550.d
110 schema:familyName Sridhara
111 schema:givenName Giriprasad
112 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.016133555233.84
113 rdf:type schema:Person
114 sg:pub.10.1007/978-3-662-45391-9_39 schema:sameAs https://app.dimensions.ai/details/publication/pub.1042719664
115 https://doi.org/10.1007/978-3-662-45391-9_39
116 rdf:type schema:CreativeWork
117 https://doi.org/10.1109/srii.2011.95 schema:sameAs https://app.dimensions.ai/details/publication/pub.1095020070
118 rdf:type schema:CreativeWork
119 https://doi.org/10.1109/tnsm.2017.2668363 schema:sameAs https://app.dimensions.ai/details/publication/pub.1083810908
120 rdf:type schema:CreativeWork
121 https://doi.org/10.1109/wsc.2009.5429275 schema:sameAs https://app.dimensions.ai/details/publication/pub.1093903489
122 rdf:type schema:CreativeWork
123 https://doi.org/10.1145/1401890.1401964 schema:sameAs https://app.dimensions.ai/details/publication/pub.1014664342
124 rdf:type schema:CreativeWork
125 https://doi.org/10.1145/2339530.2339744 schema:sameAs https://app.dimensions.ai/details/publication/pub.1025634846
126 rdf:type schema:CreativeWork
127 https://doi.org/10.1147/jrd.2016.2629318 schema:sameAs https://app.dimensions.ai/details/publication/pub.1084228380
128 rdf:type schema:CreativeWork
129 https://doi.org/10.14778/1454159.1454193 schema:sameAs https://app.dimensions.ai/details/publication/pub.1067367436
130 rdf:type schema:CreativeWork
131 https://www.grid.ac/institutes/grid.481550.d schema:alternateName IBM Research - India
132 schema:name IBM Research AI, Bengaluru, India
133 rdf:type schema:Organization
 




Preview window. Press ESC to close (or click here)


...