🤖 AI Summary
Existing multi-view clustering methods overemphasize representation consistency across views while neglecting view complementarity. Method: This paper proposes a Dual Consistency Constraint framework built upon a disentangled variational autoencoder that explicitly separates shared (consistent) and private (complementary) representations. It jointly optimizes consistency and complementarity via cross-view contrastive learning, intra- and inter-reconstruction of shared/private information, and mutual information maximization. Contribution/Results: To our knowledge, this is the first work to model and jointly exploit both consistency and complementarity under a unified theoretical framework, breaking away from conventional single-consistency paradigms. Extensive experiments on multiple benchmark datasets demonstrate significant improvements over state-of-the-art methods, validating simultaneous enhancement in representation discriminability and generalizability. The framework also exhibits strong scalability.
📝 Abstract
Multi-view clustering can explore common semantics from multiple views and has received increasing attention in recent years. However, current methods focus on learning consistency in representation, neglecting the contribution of each view's complementarity aspect in representation learning. This limit poses a significant challenge in multi-view representation learning. This paper proposes a novel multi-view clustering framework that introduces a disentangled variational autoencoder that separates multi-view into shared and private information, i.e., consistency and complementarity information. We first learn informative and consistent representations by maximizing mutual information across different views through contrastive learning. This process will ignore complementary information. Then, we employ consistency inference constraints to explicitly utilize complementary information when attempting to seek the consistency of shared information across all views. Specifically, we perform a within-reconstruction using the private and shared information of each view and a cross-reconstruction using the shared information of all views. The dual consistency constraints are not only effective in improving the representation quality of data but also easy to extend to other scenarios, especially in complex multi-view scenes. This could be the first attempt to employ dual consistent constraint in a unified MVC theoretical framework. During the training procedure, the consistency and complementarity features are jointly optimized. Extensive experiments show that our method outperforms baseline methods.