Multi-patch embedding canonical correlation analysis for multi-view feature learning

Locality-based feature learning for multi-view data has received intensive attention recently. As a result of only considering single-category local neighbor relationships, most of such the learning methods are difficult to well reveal intrinsic geometric structure information of raw high-dimensional data. To solve the problem, we propose a novel supervised multi-view correlation feature learning algorithm based on multi-category local neighbor relationships, called multi-patch embedding canonical correlation analysis (MPECCA). Our algorithm not only employs multiple local patches of each raw data to better capture the intrinsic geometric structure information, but also makes intraclass correlation features as close as possible by minimizing intraclass scatter of each view. Extensive experimental results on several real-world image datasets have demonstrated the effectiveness of our algorithm.