Competitive Online Generalised Linear Regression with Multidimensional Outputs. / Dzhamtyrova, Raisa; Kalnishkan, Yury.

Proceedings of IJCNN 2019. IEEE, 2019.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Forthcoming

Documents

Abstract

We apply online prediction with expert advice to construct a universal algorithm for multi-class classification problem. Our experts are generalised linear regression models with multidimensional outputs, i.e. neural networks with multiple output nodes but no hidden nodes. We allow the final layer transfer function to be a softmax function with linear activations to all output neurons. We build an online algorithm competitive with all the experts of relevant models of this type and derive an upper bound on the cumulative loss of the algorithm. We carry out experiments on three data sets and compare cumulative losses of our algorithm and a single neuron with multiple output nodes.
Original languageEnglish
Title of host publicationProceedings of IJCNN 2019
PublisherIEEE
Publication statusAccepted/In press - 7 Mar 2019
This open access research output is licenced under a Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License.

ID: 33978045