A generalized multiple instance learning algorithm with multiple selection strategies for cross granular learning

Abstract

Statistical learning techniques provide a robust framework for learning representations of semantic concepts from multimedia features. The bottleneck is the number of training samples needed to construct robust models. This is particularly expensive when the annotation needs to happen at finer granularity. We present a novel approach where the annotations may be entered at coarser spatial granularity while the concept may still be learnt at finer granularity. This can speed up annotation significantly. Using the multiple instance learning paradigm, we show that it is possible to learn representations of concepts occurring at the regional level by using annotations for several images. We present a generalized multiple instance learning algorithm with three variations in the strategy to select the most likely positive instance from a positively annotated bag. Furthermore, we show how the three strategies can be combined to improve upon any single strategy and demonstrate 15 % performance improvement over any single strategy using a few regional semantic concepts from the TRECVID 2003 benchmark corpus. ©2006 IEEE.