Discriminative local binary pattern

Local binary pattern (LBP) is widely used to extract image features as well as motion features in various visual recognition tasks. LBP is formulated in quite a simple form and thus enables us to extract effective features with a low computational cost. There, however, are some limitations mainly regarding sensitivity to noise and loss of image contrast information. In this paper, we propose a novel LBP-based feature extraction method to remedy those drawbacks without degrading the simplicity of the original LBP formulation. LBP is built upon encoding local pixel intensities into binary patterns which can be regarded as separating them into two modes (clusters). We introduce Fisher discriminant criterion to optimize the LBP coding for exploiting binary patterns more stably and discriminatively with robustness to noise. Besides, image contrast information is incorporated in a unified way by leveraging the discriminant score as a weight on the binary pattern; therefore, the prominent patterns, such as around edges, are emphasized. The proposed method is applicable to extract not only image features but also motion features by both efficiently decomposing a XYT volume patch into 2-D patches and employing the effective thresholding strategy based on the volume patch. In the experiments on various visual recognition tasks, the proposed method exhibits superior performance compared to the ordinary LBP and the other methods.