Joint Clustering and Classification for Multiple Instance Learning

Karan Sikka, Ritwik Giri and Marian Bartlett

Abstract

The multiple Instance Learning (MIL) framework has been extensively used to solve weakly labeled visual classification problems, where each image or video is treated as a bag of instances. Instance Space based MIL algorithms construct a classifier by modifying standard classifiers by defining the probability that a bag is of the target class as the maximum over the probabilities that its instances are of the target class. Although they are the most commonly used MIL algorithms, they do not account for the possibility that the instances may have multiple intermediate concepts, and that these concepts may have unequal weighting in predicting the overall target class. On the other hand, Embedding-space (ES) based MIL approaches are able to tackle this issue by defining a set of concepts, and then embedding each bag into a concept space, followed by training a standard classifier in the embedding space. In previous ES based approaches, the concepts were discovered separately from the classifier, and thus were not optimized for the final classification task. Here we propose a novel algorithm to estimate concepts and classifier parameters by jointly optimizing a classification loss. This approach discovers a small set of discriminative concepts, which yield superior classification performance. The proposed algorithm is referred to as Joint Clustering Classification for MIL data (JC2MIL) because the discovered concepts induce clusters of data instances. In comparison to previous approaches JC2MIL obtains state-of-the-art results on several MIL datasets- Corel-2000, image annotation datasets (Elephant, Tiger and Fox), and UCSB Breast Cancer dataset.

Session

Poster 1

Files

PDF iconExtended Abstract (PDF, 320K)
PDF iconPaper (PDF, 476K)

DOI

10.5244/C.29.71
https://dx.doi.org/10.5244/C.29.71

Citation

Karan Sikka, Ritwik Giri and Marian Bartlett. Joint Clustering and Classification for Multiple Instance Learning. In Xianghua Xie, Mark W. Jones, and Gary K. L. Tam, editors, Proceedings of the British Machine Vision Conference (BMVC), pages 71.1-71.12. BMVA Press, September 2015.

Bibtex

@inproceedings{BMVC2015_71,
	title={Joint Clustering and Classification for Multiple Instance Learning},
	author={Karan Sikka and Ritwik Giri and Marian Bartlett},
	year={2015},
	month={September},
	pages={71.1-71.12},
	articleno={71},
	numpages={12},
	booktitle={Proceedings of the British Machine Vision Conference (BMVC)},
	publisher={BMVA Press},
	editor={Xianghua Xie, Mark W. Jones, and Gary K. L. Tam},
	doi={10.5244/C.29.71},
	isbn={1-901725-53-7},
	url={https://dx.doi.org/10.5244/C.29.71}
}