Specialist Experts for Prediction with Side Information. / Kalnishkan, Yury; Adamskiy, Dmitry; Chernov, Alexey; Scarfe, Tim.

2015 IEEE International Conference on Data Mining Workshop (ICDMW). IEEE, 2016. p. 1470-1477.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

E-pub ahead of print

Documents

  • Accepted Manuscript

    Rights statement: Copyright IEEE

    Accepted author manuscript, 1 MB, PDF document

Links

Abstract

The paper proposes the vicinities merging algorithm for prediction with side information. The algorithm is based on specialist experts techniques. We use vicinities in the side information domain to identify relevant past examples, apply standard learning techniques to them, and then use prediction with expert advice tools to merge those predictions. Guarantees from the theory of prediction with expert advice ensure that helpful vicinities are selected dynamically. The algorithm automatically converges on the right vicinities from an initial broad selection. We apply the resulting algorithms to two problems, prediction of implied volatility of options and prediction of students' performance at tests. On the problem of predicting implied volatility, the algorithm consistently outperforms naive competitors and a highly-tuned proprietary method used in the industry. When applied to the students' performance, the algorithm never falls behind the baseline and outperforms it when the side information is beneficial.
Original languageEnglish
Title of host publication2015 IEEE International Conference on Data Mining Workshop (ICDMW)
PublisherIEEE
Pages1470-1477
Number of pages8
ISBN (Print)978-1-4673-8492-6
DOIs
Publication statusE-pub ahead of print - 4 Feb 2016
This open access research output is licenced under a Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License.

ID: 25395249