Validity and efficiency of conformal anomaly detection on big distributed data

Research output: Contribution to journalArticlepeer-review

246 Downloads (Pure)

Abstract

Conformal Prediction is a recently developed framework for reliable confident predictions. In this work we discuss its possible application to big data coming from different, possibly heterogeneous data sources. On example of anomaly detection problem, we study the question of saving validity of Conformal Prediction in this case. We show that the straight forward averaging approach is invalid, while its easy alternative of maximizing is not very efficient because of its conservativeness. We propose the third compromised approach that is valid, but much less conservative. It is supported by both theoretical justification and experimental results in the area of energy engineering.
Original languageEnglish
Pages (from-to)254-267
Number of pages14
JournalAdvances in Science, Technology and Engineering Systems Journal
Volume2
Issue number3
Early online date10 May 2017
DOIs
Publication statusPublished - 2017

Cite this