LCAD: A Correlation Based Abnormal Pattern Detection Approach for Large Amount of Monitor Data View Full Text


Ontology type: schema:Chapter     


Chapter Info

DATE

2014

AUTHORS

Jianwei Ding , Yingbo Liu , Li Zhang , Jianmin Wang

ABSTRACT

The last decade has witnessed tremendous growths of Internet of Things(IoT). Numerous condition monitoring systems(CMS) are widely applied to monitor equipments simultaneously. With the help of CMS, a large variety of monitor data from a large number of equipments can be collected in a very short time. However, it is a non-trivial task to take full advantage of such large amounts of monitor data in the context of anomaly detection. In this paper, we propose an approach called Latent Correlation based Anomaly Detection(LCAD) that can quickly detect potential anomalies from a large amount of monitor data, which posits that abnormal ones are a small portion in a mass of similar individuals. Instead of focusing on each single monitor data series, we identify the abnormal pattern by modeling the latent correlation among multiple correlative monitor data series using the Latent Correlation Probabilistic Model(LCPM), a probabilistic distribution model which can help to detect anomalies depending on their relations with LCPM. In order to validate our approach, we conduct experiments on the real-world datasets and the experimental results show that when facing a large amount of correlative monitor data series LCAD has a better performance as compared to the previous anomaly detection approaches. More... »

PAGES

550-558

Identifiers

URI

http://scigraph.springernature.com/pub.10.1007/978-3-319-11116-2_51

DOI

http://dx.doi.org/10.1007/978-3-319-11116-2_51

DIMENSIONS

https://app.dimensions.ai/details/publication/pub.1009830449


Indexing Status Check whether this publication has been indexed by Scopus and Web Of Science using the SN Indexing Status Tool
Incoming Citations Browse incoming citations for this publication using opencitations.net

JSON-LD is the canonical representation for SciGraph data.

TIP: You can open this SciGraph record using an external JSON-LD service: JSON-LD Playground Google SDTT

[
  {
    "@context": "https://springernature.github.io/scigraph/jsonld/sgcontext.json", 
    "about": [
      {
        "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/08", 
        "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
        "name": "Information and Computing Sciences", 
        "type": "DefinedTerm"
      }, 
      {
        "id": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/0801", 
        "inDefinedTermSet": "http://purl.org/au-research/vocabulary/anzsrc-for/2008/", 
        "name": "Artificial Intelligence and Image Processing", 
        "type": "DefinedTerm"
      }
    ], 
    "author": [
      {
        "affiliation": {
          "alternateName": "Institute of Information System & Engineering, School of Software, Tsinghua University, China", 
          "id": "http://www.grid.ac/institutes/grid.12527.33", 
          "name": [
            "Department of Computer Science and Technology, Tsinghua University, China", 
            "Institute of Information System & Engineering, School of Software, Tsinghua University, China"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Ding", 
        "givenName": "Jianwei", 
        "id": "sg:person.016006656651.23", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.016006656651.23"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "Institute of Information System & Engineering, School of Software, Tsinghua University, China", 
          "id": "http://www.grid.ac/institutes/grid.12527.33", 
          "name": [
            "Institute of Information System & Engineering, School of Software, Tsinghua University, China"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Liu", 
        "givenName": "Yingbo", 
        "id": "sg:person.010101166051.66", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010101166051.66"
        ], 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "Institute of Information System & Engineering, School of Software, Tsinghua University, China", 
          "id": "http://www.grid.ac/institutes/grid.12527.33", 
          "name": [
            "Institute of Information System & Engineering, School of Software, Tsinghua University, China"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Zhang", 
        "givenName": "Li", 
        "type": "Person"
      }, 
      {
        "affiliation": {
          "alternateName": "Institute of Information System & Engineering, School of Software, Tsinghua University, China", 
          "id": "http://www.grid.ac/institutes/grid.12527.33", 
          "name": [
            "Institute of Information System & Engineering, School of Software, Tsinghua University, China"
          ], 
          "type": "Organization"
        }, 
        "familyName": "Wang", 
        "givenName": "Jianmin", 
        "id": "sg:person.012303351315.43", 
        "sameAs": [
          "https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.012303351315.43"
        ], 
        "type": "Person"
      }
    ], 
    "datePublished": "2014", 
    "datePublishedReg": "2014-01-01", 
    "description": "The last decade has witnessed tremendous growths of Internet of Things(IoT). Numerous condition monitoring systems(CMS) are widely applied to monitor equipments simultaneously. With the help of CMS, a large variety of monitor data from a large number of equipments can be collected in a very short time. However, it is a non-trivial task to take full advantage of such large amounts of monitor data in the context of anomaly detection. In this paper, we propose an approach called Latent Correlation based Anomaly Detection(LCAD) that can quickly detect potential anomalies from a large amount of monitor data, which posits that abnormal ones are a small portion in a mass of similar individuals. Instead of focusing on each single monitor data series, we identify the abnormal pattern by modeling the latent correlation among multiple correlative monitor data series using the Latent Correlation Probabilistic Model(LCPM), a probabilistic distribution model which can help to detect anomalies depending on their relations with LCPM. In order to validate our approach, we conduct experiments on the real-world datasets and the experimental results show that when facing a large amount of correlative monitor data series LCAD has a better performance as compared to the previous anomaly detection approaches.", 
    "editor": [
      {
        "familyName": "Chen", 
        "givenName": "Lei", 
        "type": "Person"
      }, 
      {
        "familyName": "Jia", 
        "givenName": "Yan", 
        "type": "Person"
      }, 
      {
        "familyName": "Sellis", 
        "givenName": "Timos", 
        "type": "Person"
      }, 
      {
        "familyName": "Liu", 
        "givenName": "Guanfeng", 
        "type": "Person"
      }
    ], 
    "genre": "chapter", 
    "id": "sg:pub.10.1007/978-3-319-11116-2_51", 
    "inLanguage": "en", 
    "isAccessibleForFree": false, 
    "isPartOf": {
      "isbn": [
        "978-3-319-11115-5", 
        "978-3-319-11116-2"
      ], 
      "name": "Web Technologies and Applications", 
      "type": "Book"
    }, 
    "keywords": [
      "anomaly detection", 
      "real-world datasets", 
      "latent correlations", 
      "non-trivial task", 
      "pattern detection approach", 
      "probabilistic distribution model", 
      "such large amounts", 
      "large amount", 
      "detection approach", 
      "full advantage", 
      "tremendous growth", 
      "potential anomalies", 
      "better performance", 
      "monitor data", 
      "experimental results", 
      "abnormal ones", 
      "Internet", 
      "large variety", 
      "large number", 
      "datasets", 
      "probabilistic", 
      "data series", 
      "LCPM", 
      "task", 
      "detection", 
      "similar individuals", 
      "distribution model", 
      "small portion", 
      "short time", 
      "equipment", 
      "data", 
      "last decade", 
      "performance", 
      "advantages", 
      "abnormal patterns", 
      "help", 
      "amount", 
      "context", 
      "order", 
      "model", 
      "experiments", 
      "one", 
      "number", 
      "LCAD", 
      "variety", 
      "time", 
      "CMS", 
      "results", 
      "anomalies", 
      "decades", 
      "patterns", 
      "series", 
      "correlation", 
      "portion", 
      "relation", 
      "conditions", 
      "numerous conditions", 
      "individuals", 
      "growth", 
      "mass", 
      "approach", 
      "paper", 
      "help of CMS", 
      "single monitor data series", 
      "monitor data series", 
      "multiple correlative monitor data series", 
      "correlative monitor data series", 
      "Latent Correlation Probabilistic", 
      "Correlation Probabilistic", 
      "correlative monitor data series LCAD", 
      "monitor data series LCAD", 
      "data series LCAD", 
      "series LCAD", 
      "previous anomaly detection", 
      "Abnormal Pattern Detection Approach"
    ], 
    "name": "LCAD: A Correlation Based Abnormal Pattern Detection Approach for Large Amount of Monitor Data", 
    "pagination": "550-558", 
    "productId": [
      {
        "name": "dimensions_id", 
        "type": "PropertyValue", 
        "value": [
          "pub.1009830449"
        ]
      }, 
      {
        "name": "doi", 
        "type": "PropertyValue", 
        "value": [
          "10.1007/978-3-319-11116-2_51"
        ]
      }
    ], 
    "publisher": {
      "name": "Springer Nature", 
      "type": "Organisation"
    }, 
    "sameAs": [
      "https://doi.org/10.1007/978-3-319-11116-2_51", 
      "https://app.dimensions.ai/details/publication/pub.1009830449"
    ], 
    "sdDataset": "chapters", 
    "sdDatePublished": "2022-01-01T19:13", 
    "sdLicense": "https://scigraph.springernature.com/explorer/license/", 
    "sdPublisher": {
      "name": "Springer Nature - SN SciGraph project", 
      "type": "Organization"
    }, 
    "sdSource": "s3://com-springernature-scigraph/baseset/20220101/entities/gbq_results/chapter/chapter_231.jsonl", 
    "type": "Chapter", 
    "url": "https://doi.org/10.1007/978-3-319-11116-2_51"
  }
]
 

Download the RDF metadata as:  json-ld nt turtle xml License info

HOW TO GET THIS DATA PROGRAMMATICALLY:

JSON-LD is a popular format for linked data which is fully compatible with JSON.

curl -H 'Accept: application/ld+json' 'https://scigraph.springernature.com/pub.10.1007/978-3-319-11116-2_51'

N-Triples is a line-based linked data format ideal for batch operations.

curl -H 'Accept: application/n-triples' 'https://scigraph.springernature.com/pub.10.1007/978-3-319-11116-2_51'

Turtle is a human-readable linked data format.

curl -H 'Accept: text/turtle' 'https://scigraph.springernature.com/pub.10.1007/978-3-319-11116-2_51'

RDF/XML is a standard XML format for linked data.

curl -H 'Accept: application/rdf+xml' 'https://scigraph.springernature.com/pub.10.1007/978-3-319-11116-2_51'


 

This table displays all metadata directly associated to this object as RDF triples.

171 TRIPLES      23 PREDICATES      101 URIs      94 LITERALS      7 BLANK NODES

Subject Predicate Object
1 sg:pub.10.1007/978-3-319-11116-2_51 schema:about anzsrc-for:08
2 anzsrc-for:0801
3 schema:author Nc771fec72ee04112b0003927285253b6
4 schema:datePublished 2014
5 schema:datePublishedReg 2014-01-01
6 schema:description The last decade has witnessed tremendous growths of Internet of Things(IoT). Numerous condition monitoring systems(CMS) are widely applied to monitor equipments simultaneously. With the help of CMS, a large variety of monitor data from a large number of equipments can be collected in a very short time. However, it is a non-trivial task to take full advantage of such large amounts of monitor data in the context of anomaly detection. In this paper, we propose an approach called Latent Correlation based Anomaly Detection(LCAD) that can quickly detect potential anomalies from a large amount of monitor data, which posits that abnormal ones are a small portion in a mass of similar individuals. Instead of focusing on each single monitor data series, we identify the abnormal pattern by modeling the latent correlation among multiple correlative monitor data series using the Latent Correlation Probabilistic Model(LCPM), a probabilistic distribution model which can help to detect anomalies depending on their relations with LCPM. In order to validate our approach, we conduct experiments on the real-world datasets and the experimental results show that when facing a large amount of correlative monitor data series LCAD has a better performance as compared to the previous anomaly detection approaches.
7 schema:editor Nc1e0d4ee99974501a63050ff0e773ce1
8 schema:genre chapter
9 schema:inLanguage en
10 schema:isAccessibleForFree false
11 schema:isPartOf N711108da114f4e86acddc669c744eb31
12 schema:keywords Abnormal Pattern Detection Approach
13 CMS
14 Correlation Probabilistic
15 Internet
16 LCAD
17 LCPM
18 Latent Correlation Probabilistic
19 abnormal ones
20 abnormal patterns
21 advantages
22 amount
23 anomalies
24 anomaly detection
25 approach
26 better performance
27 conditions
28 context
29 correlation
30 correlative monitor data series
31 correlative monitor data series LCAD
32 data
33 data series
34 data series LCAD
35 datasets
36 decades
37 detection
38 detection approach
39 distribution model
40 equipment
41 experimental results
42 experiments
43 full advantage
44 growth
45 help
46 help of CMS
47 individuals
48 large amount
49 large number
50 large variety
51 last decade
52 latent correlations
53 mass
54 model
55 monitor data
56 monitor data series
57 monitor data series LCAD
58 multiple correlative monitor data series
59 non-trivial task
60 number
61 numerous conditions
62 one
63 order
64 paper
65 pattern detection approach
66 patterns
67 performance
68 portion
69 potential anomalies
70 previous anomaly detection
71 probabilistic
72 probabilistic distribution model
73 real-world datasets
74 relation
75 results
76 series
77 series LCAD
78 short time
79 similar individuals
80 single monitor data series
81 small portion
82 such large amounts
83 task
84 time
85 tremendous growth
86 variety
87 schema:name LCAD: A Correlation Based Abnormal Pattern Detection Approach for Large Amount of Monitor Data
88 schema:pagination 550-558
89 schema:productId N02ac4bb2d37543458f510d27e74ae631
90 N46371f3cae3548249e7f57de27970e7e
91 schema:publisher N0fba7f1186a5470a88067a6882e9e1e1
92 schema:sameAs https://app.dimensions.ai/details/publication/pub.1009830449
93 https://doi.org/10.1007/978-3-319-11116-2_51
94 schema:sdDatePublished 2022-01-01T19:13
95 schema:sdLicense https://scigraph.springernature.com/explorer/license/
96 schema:sdPublisher N6b989401db184d9990f864acc50c2a27
97 schema:url https://doi.org/10.1007/978-3-319-11116-2_51
98 sgo:license sg:explorer/license/
99 sgo:sdDataset chapters
100 rdf:type schema:Chapter
101 N02ac4bb2d37543458f510d27e74ae631 schema:name dimensions_id
102 schema:value pub.1009830449
103 rdf:type schema:PropertyValue
104 N0fba7f1186a5470a88067a6882e9e1e1 schema:name Springer Nature
105 rdf:type schema:Organisation
106 N1379b9bda5974b1d8a814799eec1d7b4 rdf:first sg:person.010101166051.66
107 rdf:rest N2054018e3a2a495fb321c27c193f1ab2
108 N1f93273fd34049faaf2f6ef2c2ba9739 rdf:first Ne3effcd92a1b4e1ab43b6e9ae581d699
109 rdf:rest rdf:nil
110 N2054018e3a2a495fb321c27c193f1ab2 rdf:first Nfe43e4b7d77d485988a9cd1a13406108
111 rdf:rest Nbed8cebaed4641148f0ffa28e5360507
112 N231f5dd17c5a4943b3f370b4fcd4785e schema:familyName Sellis
113 schema:givenName Timos
114 rdf:type schema:Person
115 N3cef0897f0e84b43bbc56de5d01b63dd rdf:first N54e143d663b64511a2e70dc12b2821d2
116 rdf:rest N3e87c8f897284f5c924f0155b280b8a9
117 N3e87c8f897284f5c924f0155b280b8a9 rdf:first N231f5dd17c5a4943b3f370b4fcd4785e
118 rdf:rest N1f93273fd34049faaf2f6ef2c2ba9739
119 N46371f3cae3548249e7f57de27970e7e schema:name doi
120 schema:value 10.1007/978-3-319-11116-2_51
121 rdf:type schema:PropertyValue
122 N54e143d663b64511a2e70dc12b2821d2 schema:familyName Jia
123 schema:givenName Yan
124 rdf:type schema:Person
125 N6b989401db184d9990f864acc50c2a27 schema:name Springer Nature - SN SciGraph project
126 rdf:type schema:Organization
127 N711108da114f4e86acddc669c744eb31 schema:isbn 978-3-319-11115-5
128 978-3-319-11116-2
129 schema:name Web Technologies and Applications
130 rdf:type schema:Book
131 Nbed8cebaed4641148f0ffa28e5360507 rdf:first sg:person.012303351315.43
132 rdf:rest rdf:nil
133 Nc1e0d4ee99974501a63050ff0e773ce1 rdf:first Nc2cce2cfc5884c88b892e1679da1ac60
134 rdf:rest N3cef0897f0e84b43bbc56de5d01b63dd
135 Nc2cce2cfc5884c88b892e1679da1ac60 schema:familyName Chen
136 schema:givenName Lei
137 rdf:type schema:Person
138 Nc771fec72ee04112b0003927285253b6 rdf:first sg:person.016006656651.23
139 rdf:rest N1379b9bda5974b1d8a814799eec1d7b4
140 Ne3effcd92a1b4e1ab43b6e9ae581d699 schema:familyName Liu
141 schema:givenName Guanfeng
142 rdf:type schema:Person
143 Nfe43e4b7d77d485988a9cd1a13406108 schema:affiliation grid-institutes:grid.12527.33
144 schema:familyName Zhang
145 schema:givenName Li
146 rdf:type schema:Person
147 anzsrc-for:08 schema:inDefinedTermSet anzsrc-for:
148 schema:name Information and Computing Sciences
149 rdf:type schema:DefinedTerm
150 anzsrc-for:0801 schema:inDefinedTermSet anzsrc-for:
151 schema:name Artificial Intelligence and Image Processing
152 rdf:type schema:DefinedTerm
153 sg:person.010101166051.66 schema:affiliation grid-institutes:grid.12527.33
154 schema:familyName Liu
155 schema:givenName Yingbo
156 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.010101166051.66
157 rdf:type schema:Person
158 sg:person.012303351315.43 schema:affiliation grid-institutes:grid.12527.33
159 schema:familyName Wang
160 schema:givenName Jianmin
161 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.012303351315.43
162 rdf:type schema:Person
163 sg:person.016006656651.23 schema:affiliation grid-institutes:grid.12527.33
164 schema:familyName Ding
165 schema:givenName Jianwei
166 schema:sameAs https://app.dimensions.ai/discover/publication?and_facet_researcher=ur.016006656651.23
167 rdf:type schema:Person
168 grid-institutes:grid.12527.33 schema:alternateName Institute of Information System & Engineering, School of Software, Tsinghua University, China
169 schema:name Department of Computer Science and Technology, Tsinghua University, China
170 Institute of Information System & Engineering, School of Software, Tsinghua University, China
171 rdf:type schema:Organization
 




Preview window. Press ESC to close (or click here)


...