Optimistic and Pessimistic Neural Networks for Object Recognition

Rene Grzeszick, Sebastian Sudholt and Gernot A. Fink
Proc. IEEE Intl. Conf. on Image Processing, 2017.

BibTeX PDFarXiv

Abstract

In this paper the application of uncertainty modeling to convolutional neural networks is evaluated. A novel method for adjusting the network's predictions based on uncertainty information is introduced. This allows the network to be either optimistic or pessimistic in it's prediction scores. The proposed method builds on the idea of applying dropout at test time and sampling a predictive mean and variance from the network's output. Besides the methodological aspects, implementation details allowing for a fast evaluation are presented. In the evaluation on the ILSVRC2014 and VOC2011 datasets it will be shown that modeling uncertainty allows for improving the performance of a given model purely at test time without any further training steps.