The Multimodal Focused Topic Model: A Nonparametric Bayesian Approach to Simultaneous Object Classification and Attribute Discovery

Abstract

A nonparametric Bayesian model for attribute-based object recognition and image-based class attribute inference is presented. This model draws on existing work in Bayesian nonparametrics such as the focused topic model. The model allows either the classification of objects or the inference of attributes over known classes (or both simultaneously). Attributes inferred from image datasets allow an improvement in classification accuracy when combined with attributes from other sources, including ?layperson? knowledge and existing inference methods.