Prescience : Probabilistic Guidance on the Retraining Conundrum for Malware Detection. / Deo, Amit; Dash, Santanu; Suarez de Tangil Rotaeche, Guillermo; Vovk, Vladimir; Cavallaro, Lorenzo.

ACM Workshop on Artificial Intelligence and Security. Vienna, Austria : ACM, 2016. p. 71-82 .

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Published

Documents

Abstract

Malware evolves perpetually and relies on increasingly so- phisticated attacks to supersede defense strategies. Data-driven approaches to malware detection run the risk of becoming rapidly antiquated. Keeping pace with malware requires models that are periodically enriched with fresh knowledge, commonly known as retraining. In this work, we propose the use of Venn-Abers predictors for assessing the quality of binary classification tasks as a first step towards identifying antiquated models. One of the key benefits behind the use of Venn-Abers predictors is that they are automatically well calibrated and offer probabilistic guidance on the identification of nonstationary populations of malware. Our framework is agnostic to the underlying classification algorithm and can then be used for building better retraining strategies in the presence of concept drift. Results obtained over a timeline-based evaluation with about 90K samples show that our framework can identify when models tend to become obsolete.
Original languageEnglish
Title of host publicationACM Workshop on Artificial Intelligence and Security
Place of PublicationVienna, Austria
PublisherACM
Pages71-82
Number of pages12
ISBN (Print)978-1-4503-4573-6
DOIs
Publication statusPublished - 28 Oct 2016
This open access research output is licenced under a Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License.

ID: 27083973