July 07, 2026
Incomplete Multi-View Clustering addresses the problem of clustering multi-modal data when certain views are missing. Recent end-to-end generative approaches leverage diffusion models to recover missing views via stochastic noise-to-data trajectories. While expressive, such mechanisms are not explicitly designed for clustering, as they initialize from cluster-agnostic noise and rely on stochastic denoising dynamics. In this work, we revisit probability path design in end-to-end generative IMVC. We introduce a flow-matching framework with a linear interpolation path between paired view representations, that replaces diffusion with probability flows between observed and missing views. We provide a formal analysis showing that deterministic ODE flows are inherently better aligned with clustering objectives than diffusion-based stochastic trajectories, especially in terms of transport mechanisms that respect class-conditional data distributions and maintain cluster consistency in finite-step regimes. Building upon this insight, we develop an end-to-end IMVC architecture that integrates straight-path flow-matching view completion with cluster-level and entropy-based alignment to enforce cross-view clustering consistency. Extensive experiments on standard IMVC benchmarks demonstrate that the proposed framework establishes new state-of-the-art performance.
The task of Incomplete Multi-View Clustering (IMVC) [1] addresses the challenge of multi-view clustering (MVC) [2], with an additional layer of difficulty, not all views are consistently available for each sample. Compared to the traditional MVC task setup, IMVC more closely reflects real-world use cases involving multi-view data [3]–[5], as such data collection processes may encounter sensor malfunctions, occlusions, disk space limitations, or even storage media corruptions.
Traditional IMVC methods [6]–[11] focus on latent alignment and reconstruction under missing-view constraints. Recently, generative modeling [12]–[14] has emerged as a powerful alternative paradigm. Diffusion-based approaches [3], [5], in particular, formulate missing-view recovery as conditional generation: starting from Gaussian noise, a stochastic denoising process conditioned on the observed view progressively reconstructs the missing representation. Earlier works [3] adopt a two-stage pipeline in which clustering is performed after generative recovery. Recent research has shifted toward end-to-end IMVC frameworks [5] that optimize missing-view recovery and clustering jointly. In the joint framework, the generative module is trained under clustering-oriented supervision, so the intermediate and final recovered features directly determine the clustering embeddings and assignments during training. Consequently, the properties of the generative trajectory directly influence the structural organization of the learned representations, as cross-view discrepancies are progressively reduced and intra-cluster coherence is reinforced under clustering-oriented supervision.
However, diffusion-based generative modeling typically relies on stochastic dynamics, often formulated as stochastic differential equations (SDEs) [15], that transform cluster-agnostic Gaussian noise into data representations through progressive denoising. As illustrated in , the reverse process starts from noise that is independent of the observed sample and gradually reconstructs the target representation, causing trajectories to traverse regions of the latent space that are initially unrelated to the underlying cluster structure. Moreover, during the early and intermediate stages of denoising, the representations remain strongly influenced by noise, and cluster-discriminative structure becomes evident only in the low-noise regime (). Although such properties are natural for general-purpose generation, IMVC instead requires view-completion mechanisms that are deterministically conditioned on observed representations and preserve the clustering structure of the representations throughout the transport process.
To this end, we adopt flow matching [16] to learn a deterministic ODE transport operator for missing-view recovery. Unlike stochastic diffusion trajectories, flow matching enables direct modeling of continuous transports anchored at the observed representation and consistent with the clustering structure of the representation space. Concretely, we specify a linear interpolation (straight-path) between paired latent representations of observed and missing views, and train a neural vector field to match the corresponding path velocity. This yields trajectories that evolve consistently with the underlying cluster structure while requiring only a small number of integration steps. A formal analysis comparing diffusion trajectories and flow-based transport is provided to clarify their structural differences. Building on this formulation, we integrate straight-path completion with an end-to-end IMVC framework that combines within-view reconstruction and cross-view alignment, where the cluster-level contrastive loss enforces assignment consistency and the entropy-based alignment stabilizes probability predictions. The resulting design jointly optimizes view recovery and clustering consistency within a unified framework.
Our contributions are summarized as follows:
We propose a flow-matching framework for incomplete multi-view clustering (IMVC) that performs cross-view completion by learning a vector field to transport an observed latent representation to its missing-view counterpart along a straight-path formulation.
We present a formal analysis showing straight-path transport and finite-step cluster separability of flow matching under standard assumptions.
We develop an end-to-end model that integrates within-view reconstruction, cross-view alignment (cluster-level and entropic alignment), and straight-path completion, achieving SOTA performance on IMVC benchmarks.
Deep Incomplete Multi-View Clustering. Handling missing modalities is a central challenge in incomplete multi-view clustering (IMVC). Autoencoder-based approaches [17]–[19] learn latent representations by reconstructing observed views. Graph-based methods [20]–[22] propagate information across samples through graph structures. Contrastive learning approaches [23]–[25] improve cross-view representation consistency by maximizing agreement between views. To explicitly reconstruct missing modalities, recent studies introduce generative models [26]. Generative Adversarial Networks (GANs) [27]–[29] enable view synthesis but often suffer from training instability and mode collapse. Variational Autoencoders (VAEs) [30], [31] provide a probabilistic framework for view generation. More recently, diffusion models have achieved remarkable progress in generative modeling [12], [32], [33]. They have also been explored for missing-view generation in IMVC [3], [5]. However, diffusion models generate representations through stochastic noise-to-data trajectories that start from cluster-agnostic noise, so the transport process does not explicitly preserve the clustering structure of the representations.
Flow Matching in Generative Modeling. Flow Matching (FM) [16], [34], [35] is a generative framework that learns deterministic vector fields to transport samples between probability distributions through ODE flows. Instead of relying on stochastic noise injection and iterative denoising as in diffusion models, FM directly models probability transport along predefined interpolation paths between data distributions. Several extensions have further expanded its applicability, including latent-space flow matching [36], flow generator matching [37], and hybrid diffusion–flow formulations [38]. The deterministic transport formulation of flow matching provides a natural mechanism for modeling representation transport between paired observations. Motivated by this formulation, we adopt flow matching to model cross-view completion in the latent representation space for incomplete multi-view clustering.
In this section, we first concretely demonstrate that, under three assumptions, flow matching exhibits desirable theoretical properties over conditional diffusion models when applied to the task of IMVC (). Based on the theoretical analysis, we proceed to propose our method of adopting flow matching for the task in .
Without loss of generality, we consider a two-view IMVC setting. Let \(\mathcal{X} \subset \mathbb{R}^D\) denote the original data space and \(\mathcal{Z} \subset \mathbb{R}^d\) the corresponding latent representation space. For each sample, the raw observations from the two views are denoted by \(\boldsymbol{x}_1, \boldsymbol{x}_2 \in \mathcal{X}\), and their encoded latent representations are \(\boldsymbol{z}_1, \boldsymbol{z}_2 \in \mathcal{Z}\), respectively.
Under this formulation, the core objective of IMVC is as follows: given an observed view representation (\(\boldsymbol{z}_1\)), recover the missing-view representation (\(\boldsymbol{z}_2\)) such that both representations correspond to the same cluster. Equivalently, if \(c: \mathcal{Z} \to \{1,\dots,K\}\) denotes the clustering assignment function, the desired consistency condition is \(c(\boldsymbol{z}_1) = c(\boldsymbol{z}_2)\).
We establish all arguments under the following three assumptions. Note that they are shared by both the conditional diffusion models and flow matching.
Cluster Separability. The cluster sets \(\mathcal{S}_k\) \((k=1,\ldots,K)\) in the representation space are compact subsets of \(\mathbb{R}^d\). Any two clusters have a strictly positive minimum distance \(\delta>0\), \(\inf_{i\neq j} d(\mathcal{S}_i,\mathcal{S}_j) = \delta > 0\).
View Consistency. Different-view representations of the same sample belong to the same cluster, the clustering label mapping \(c(\cdot)\) satisfies: for any sample representations \(\boldsymbol{z}^{v}\) and \(\boldsymbol{z}^{v'}\), \(c(\boldsymbol{z}^{v}) = c(\boldsymbol{z}^{v'})\).
Sufficient Model Approximation. The neural network can sufficiently approximate the target function with bounded approximation error. the model can capture the true probability flow or the vector field.
In IMVC, to address the view-completion and the clustering objectives, flow matching directly constructs a deterministic ODE flow from the observed view representation \(\boldsymbol{z}_1\) to the completed view representation \(\boldsymbol{z}_2\). Here, time domain \(t \in [0,1]\), with \(t=0\) for the observed view, \(t=1\) for the completed view. We note that flow matching does not involve random terms in its formulation, or noise initializations.
Flow matching first performs a linear interpolation between the observed view \(\boldsymbol{z}_1\) (source distribution \(p_0 = p(\boldsymbol{z}_1)\)) and the completed view \(\boldsymbol{z}_2\) (target distribution \(p_1 = p(\boldsymbol{z}_2)\)) to construct the interpolated representation \(\boldsymbol{x}_t\) at time \(t\). The corresponding target vector field is the velocity of the interpolation path, \[\begin{align} \boldsymbol{x}_t = (1-t) \boldsymbol{z}_1 + t \boldsymbol{z}_2&, \quad t \in [0,1], \tag{1}\\ \boldsymbol{v}_{\text{target}}(\boldsymbol{x}_t, t) = &\boldsymbol{z}_2 - \boldsymbol{z}_1, \tag{2} \end{align}\] where represents the shortest path in Euclidean space, a straight line path, which is the optimal shortcut connecting the observed view and the completed view. Its path length is directly determined by \(\|\boldsymbol{z}_2 - \boldsymbol{z}_1\|\).
The learning objective of flow matching is to fit a vector field \(\boldsymbol{v}_\theta(\boldsymbol{x}_t, t)\) via a neural network, such that it approximates the target vector field \(\boldsymbol{v}_{\text{target}}(\boldsymbol{x}_t, t)\). The training loss uses mean squared error: \[\label{eqn:mean-square-error} \mathcal{L}_{\text{FM}} = \mathbb{E}_{t \sim \mathcal{U}(0,1), \boldsymbol{z}_1, \boldsymbol{z}_2} \left\| \boldsymbol{v}_\theta(\boldsymbol{x}_t, t) - \boldsymbol{v}_{\text{target}}(\boldsymbol{x}_t, t) \right\|_2^2,\tag{3}\] where \(\mathcal{U}(0,1)\) is the uniform distribution on \([0,1]\). The vector field \(\boldsymbol{v}_\theta(\cdot)\) takes the interpolated representation \(\boldsymbol{x}_t\), the time step \(t\), and the observed view \(\boldsymbol{z}_1\) as input and outputs a velocity vector of the same dimension as the representation.
The ODE framework of flow matching possesses a natural reversibility. If the forward vector field \(\boldsymbol{v}_\theta(\cdot)\) from \(\boldsymbol{z}_1\) to \(\boldsymbol{z}_2\) is learned, the reverse vector field \(\boldsymbol{v}_{\theta_R}(\cdot)\) from \(\boldsymbol{z}_2\) to \(\boldsymbol{z}_1\) is simply \(-\boldsymbol{v}_\theta(\cdot)\). The reverse ODE is: \[\label{eqn:reverse-ode} \frac{d\boldsymbol{x}_s}{ds} =\boldsymbol{v}_{\theta_R}(\boldsymbol{x}_{s},s)= -\boldsymbol{v}_\theta(\boldsymbol{x}_{1-t}, 1-t), \quad x_s = (1-s)\boldsymbol{z}_2+s\boldsymbol{z}_1.\tag{4}\]
This property grants that flow matching only needs to train the vector field in one direction to achieve bidirectional view completion, where we provide a detailed proof in . This is in contrast to methods using diffusion models, which require training two separate models.
With the preliminaries of flow matching introduced above, we argue that it is structurally more aligned to the task of IMVC, compared to existing diffusion-based methods. We concretely demonstrate our claim through the two corollaries below, while relating each one to the limitations of the diffusion models. A complete theoretical analysis regarding the properties and limitations of the diffusion model is provided in , detailed proofs of the corollaries are in .
Corollary 1 (Flow Matching’s Shortcut Path). Flow matching constructs an optimal shortcut path between views representation.
As illustrated in , during the training process of IMVC, view representations gradually align as \(\|\boldsymbol{z}_1 - \boldsymbol{z}_2\|\) decreases. The path length in flow matching shortens adaptively. When views are perfectly aligned, the path length becomes a small value. On the other hand, the diffusion model’s starting point is global Gaussian noise unrelated to the cluster class-conditional data distributions, which encode the clustering structure (, ). The reverse process must complete the full evolution of “noise space \(\Rightarrow\) representation space \(\Rightarrow\) cluster-specific distribution”. Even if the observed view representation and completion target view representation in latent space are highly aligned, diffusion cannot utilize the view consistency information. The path length is fixed as the distance from the noise to the cluster set.
Compared to the diffusion model’s Gaussian noise initialization (), flow matching offers the theoretical advantages of non-redundant paths and adaptively shortening path length, as shown in .
Corollary 2 (Flow Matching’s Finite-Step Separability). Flow matching achieves cluster separability within any finite number of steps.
In other words, sample trajectories from different cluster sets remain separated throughout the evolution, with no cross-cluster drift, as in (c). In contrast, the cluster separability of the diffusion model relies on a strong asymptotic condition (where \(\sigma_t < \delta/2\)), which only holds as \(t \to 0\), as shown in and is discussed in detail in , . This condition is difficult to satisfy in finite-step practical inference, leading to overlapping supports of noised distributions for different clusters and making samples prone to cross-cluster drift, significantly reducing cluster separability.
Flow matching offers the theoretical benefit of finite-step cluster separability with no cross-cluster drift compared to the diffusion model’s asymptotic separability condition (, ).
Motivated by the theoretical analysis in , we formulate incomplete multi-view clustering as a cross-view completion problem in the latent representation space. Under the assumptions of cluster separability, view consistency, and sufficient model approximation, our method is designed to preserve clustering structure while recovering missing-view representations. The overall framework consists of three components: within-view reconstruction, cross-view alignment (including cluster-level and entropic alignment), and straight-path completion.
Before performing cross-view transport, we first learn compact latent representations for each view via view-specific autoencoders. Given an input feature \(\boldsymbol{x}_v \in X\) from view \(v \in \{1,2\}\), an encoder \(\mathcal{E}_v(\cdot)\) maps it to a latent representation \(\boldsymbol{z}_v = \mathcal{E}_v(\boldsymbol{x}_v) \in Z\), and a decoder \(\mathcal{D}_v(\cdot)\) reconstructs it as \(\hat{\boldsymbol{x}}_v = \mathcal{D}_v(\boldsymbol{z}_v)\). This step extracts view-specific structural information and learns latent representations for each view. To preserve the intrinsic structure of each view in the latent space, we adopt a standard reconstruction objective in \(N\) samples: \[\mathcal{L}_{\text{rec}} = \frac{1}{N} \sum_{i=1}^N \left( \| \mathcal{D}_1(\mathcal{E}_1(\boldsymbol{x}_1^{(i)})) - \boldsymbol{x}_1^{(i)} \|^2 + \| \mathcal{D}_2(\mathcal{E}_2(\boldsymbol{x}_2^{(i)})) - \boldsymbol{x}_2^{(i)} \|^2 \right),\]
Under Assumptions [assump:separable95representation]–[assump:view95consistency], different views of the same sample are expected to belong to the same cluster and therefore share a consistent cluster assignment. However, in practice, the view-specific encoders and the learned clustering head can yield view-dependent predictions, leading to inconsistent assignments across views and degrading the clustering structure of the learned representations. We therefore employ a cluster-level contrastive objective to explicitly couple the two views in the clustering space.
Specifically, let \(\boldsymbol{y}_1,\boldsymbol{y}_2\in\mathbb{R}^{K}\) be the cluster probability vectors predicted from \(\boldsymbol{z}_1\) and \(\boldsymbol{z}_2\), respectively. We adopt an InfoNCE [39] objective to align cross-view cluster predictions in \(N\) samples: \[\mathcal{L}_{\text{cluster}} = -\frac{1}{N} \sum_{i=1}^{N} \log \frac{\exp\!\left(\cos(\boldsymbol{y}_1^{(i)}, \boldsymbol{y}_2^{(i)})/\tau\right)}{\sum_{j=1}^{N} \exp\!\left(\cos(\boldsymbol{y}_1^{(i)}, \boldsymbol{y}_2^{(j)})/\tau\right)},\] where \(\cos(\cdot,\cdot)\) denotes cosine similarity, and \(\tau\) is a temperature parameter. This objective increases the similarity between corresponding cross-view predictions while discouraging alignment with non-matching samples, thereby promoting view-consistent clustering and preserving inter-cluster separation.
Although the cluster-level contrastive objective promotes cross-view assignment consistency, it operates at the sample level and does not explicitly regularize the structure of the predicted probability distributions. In practice, direct fusion in Euclidean space may distort the relative probability structure and over-smooth cluster confidence. We therefore employ an entropy-weighted alignment objective to regularize probability consistency across views.
Let \(\boldsymbol{y}_1\), \(\boldsymbol{y}_2\), and \(\boldsymbol{y}_h\) denote the cluster probability distributions predicted from \(\boldsymbol{z}_1\), \(\boldsymbol{z}_2\), and the fused representation \(\boldsymbol{h}\), respectively. Since these distributions lie on the probability simplex, we adopt the centered log-ratio (clr) transformation () to perform fusion in a simplex-consistent space. An entropy-based weighting scheme assigns larger weights to more confident predictions, and the target distribution \(\boldsymbol{y}^*\) is obtained via a weighted combination in the clr space followed by inverse mapping back to the simplex. We then enforce consistency between the fused prediction and the entropy-weighted target via KL divergence: \[\mathcal{L}_{\text{entropy}} = \mathrm{KL}(\boldsymbol{y}_h \,\|\, \boldsymbol{y}^*),\] where \(\text{KL}\left(\cdot \middle\| \cdot\right)\) is the KL divergence. This objective stabilizes cross-view probability structure while preventing uncertain predictions from dominating the fusion, thereby preserving post-alignment cluster separability.
With cluster-level and entropic alignment regularizing cross-view consistency in the clustering space, we now realize cross-view representation completion via flow matching in the latent space. Given paired latent representations \((\boldsymbol{z}_1,\boldsymbol{z}_2)\) from complete samples, we construct the interpolated state \(\boldsymbol{x}_t\) along the straight-line path (). A neural vector field \(\mathcal{F}(\cdot)\) is trained to approximate the target transport direction, so that integrating the learned ODE maps an observed representation to its missing-view counterpart.
Given the straight-line interpolation \(\boldsymbol{x}_t\) defined in , the target transport direction at any intermediate state is uniquely determined as \(\boldsymbol{z}_2-\boldsymbol{z}_1\) (see ). We therefore learn a parametric vector field \(\mathcal{F}(\boldsymbol{x}_t,t)\) to approximate this target velocity by minimizing \[\mathcal{L}_{\text{flow-pred}} = \mathbb{E}_{t,\boldsymbol{z}_1,\boldsymbol{z}_2} \left\| \mathcal{F}(\boldsymbol{x}_t,t) - (\boldsymbol{z}_2-\boldsymbol{z}_1) \right\|_2^2 .\]
This objective enforces the learned vector field to follow the straight-line shortcut path between paired latent representations, as discussed in Corollary 1. By aligning the local velocity with \(\boldsymbol{z}_2-\boldsymbol{z}_1\), the transport process exploits view consistency and adaptively shortens the path length as cross-view representations become aligned. This avoids redundant detours and maintains the cluster structure established by the alignment modules.
Although the vector field is trained to approximate the shortcut transport direction, finite-step numerical integration may introduce approximation errors. Based on the reversibility property of flow matching (Eq. 4 ), forward integration (\(t:0\rightarrow1\)) maps \(\boldsymbol{z}_1\) to the recovered feature \(\hat{\boldsymbol{z}}_2\), while reverse integration (\(s:0\rightarrow1, s = 1-t\)) maps \(\boldsymbol{z}_2\) to \(\hat{\boldsymbol{z}}_1\): \[\begin{align} \hat{\boldsymbol{z}}_2 &= \boldsymbol{z}_1 + \int_{0}^{1} \mathcal{F}\!\left(\boldsymbol{x}_t, t\right)\, \mathrm{d}t, \\ \hat{\boldsymbol{z}}_1 &= \boldsymbol{z}_2 + \int_{0}^{1} -\mathcal{F}\!\left(\boldsymbol{x}_{1-t}, 1-t\right)\, \mathrm{d}s. \end{align}\] We then enforce bidirectional completion consistency by minimizing \[\mathcal{L}_{\text{flow-comp}} = \mathbb{E}_{\boldsymbol{z}_1,\boldsymbol{z}_2} \left[ \|\hat{\boldsymbol{z}}_2 - \boldsymbol{z}_2\|_2^2 + \|\hat{\boldsymbol{z}}_1 - \boldsymbol{z}_1\|_2^2 \right].\]
This loss constrains the transport trajectory at both endpoints, ensuring that finite-step evolution remains faithful to the true latent representations. Together with the shortcut-path property, it supports stable cross-view completion while maintaining the cluster structure discussed in Corollary 2.
The model is trained by minimizing a weighted combination of the losses introduced above, which jointly optimize representation reconstruction, cross-view cluster consistency, probability-level alignment, and shortcut-path completion: \[\mathcal{L} = \mathcal{L}_{\text{rec}} + \lambda_1 \mathcal{L}_{\text{flow-pred}} + \lambda_2 \mathcal{L}_{\text{flow-comp}} + \lambda_3 \mathcal{L}_{\text{cluster}} + \lambda_4 \mathcal{L}_{\text{entropy}},\] where \(\lambda_1,\lambda_2,\lambda_3,\) and \(\lambda_4\) balance the contributions of the transport, alignment, and reconstruction objectives.
This section presents the experimental evaluation of the proposed framework. We first describe the experimental settings (), and compare our method with recent incomplete multi-view clustering approaches on multiple benchmarks (). Then, we conduct ablation studies to analyze the contribution of each component (). Finally, we provide additional analyses, including hyperparameter sensitivity, representation visualization, and flow-step behavior, to further understand the properties of the proposed method ().
Dataset. We evaluate the proposed method on five multi-view benchmarks: (i) Synthetic3D [40], a synthetic Gaussian-mixture dataset with correlated features, where two views are selected following [5]; (ii) CUB [41], a fine-grained bird dataset containing 11,788 image–text pairs from 200 categories, where visual features are extracted using GoogLeNet and textual features via doc2vec, and the first 10 categories are used as in [5], [42]; (iii) HandWritten [43], a digit dataset with 2,000 samples and six feature views, from which two views are adopted following [5]; (iv) LandUse-21 [44], a remote-sensing dataset with 2,100 images from 21 categories, where PHOG and LBP descriptors are used as two views; and (v) Fashion [45], a product image dataset with 10,000 samples, from which two visual feature views are selected.
Metric. Following the standard incomplete multi-view clustering (IMVC) protocol [5], [23], we simulate missing views by randomly masking one view for a subset of samples. The missing rate is defined as the ratio of incomplete samples to the total dataset size. We follow [5], [23] to evaluate method performance using three standard metrics: Accuracy (ACC), Normalized Mutual Information (NMI), and Adjusted Rand Index (ARI).
Implementation details. Our framework consists of view-specific autoencoders, a straight-path flow matching module, and a clustering classifier. The model is trained for \(200\) epochs using the Adam optimizer with an initial learning rate of \(1 \times 10^{-3}\). The batch size is set according to the dataset configuration (typically \(128\) or \(256\)). We simulate incomplete multi-view scenarios by randomly masking one view for a subset of samples based on the target missing rate (\(\rho \in \{0.1, 0.3, 0.5\}\)). The weighting coefficients \(\lambda_1, \lambda_2, \lambda_3,\) and \(\lambda_4\) are configured individually for each dataset. For the flow matching process, we adopt an efficient setting with a single integration step (\(Step=1\)) during both training and inference. We refer readers to for detailed implementation details.
scale=0.8
Table ¿tbl:tab:performance? compares our method with recent incomplete multi-view clustering approaches under three missing rates on five benchmark datasets. Overall, the proposed framework consistently achieves the best or competitive performance across almost all evaluation metrics. On datasets with clear cluster structures, such as Synthetic3D and HandWritten, our method achieves notable improvements across all metrics. These results suggest that the straight-path completion learned by flow matching can recover missing representations while maintaining the underlying cluster geometry.
The advantage of our method becomes more pronounced under higher missing rates. As \(\tau\) increases from 0.1 to 0.5, many existing methods experience notable performance degradation due to reduced cross-view correspondence, whereas our approach remains relatively stable across datasets. This robustness arises from the combination of alignment and flow-based completion: the cluster-level and entropic alignment modules enforce view-consistent assignments, while the flow-matching transport recovers missing representations by following the straight-path transport between paired latent representations. This behavior is consistent with our theoretical analysis that flow matching maintains cluster separability under finite-step evolution, resulting in stronger robustness under severe incompleteness.
scale=0.85
We conduct ablation experiments on HandWritten with a missing rate \(\tau=0.3\) to analyze the contribution of each component in the proposed flow-matching formulation, as summarized in Table ¿tbl:tab:handwrite95exp?.
Removing the cluster-level contrastive loss causes the most severe performance drop (ACC decreases to 27.75%). This loss explicitly aligns cross-view cluster assignments and establishes view-consistent clustering structure in the latent space. Without this constraint, representations from different views may produce inconsistent cluster predictions, violating the cluster separability assumption required by the flow-matching formulation. Consequently, reliable cross-view completion cannot be achieved.
Effect of \(\mathcal{L}_{\text{entropy}}\). The entropy-based alignment complements the cluster-level contrastive objective by further stabilizing cross-view probability predictions. While \(\mathcal{L}_{\text{cluster}}\) enforces assignment consistency at the sample level, \(\mathcal{L}_{\text{entropy}}\) regularizes the probability distributions across views. Removing this term leads to performance degradation, indicating that probability-level alignment is also important for maintaining stable cluster assignments and cross-view completion.
Effect of \(\mathcal{L}_{\text{flow-pred}}\). The flow prediction loss supervises the learned vector field to follow the straight-path transport direction between paired latent representations. Removing this loss weakens the ability of the model to learn a consistent transport direction, resulting in degraded completion quality. This confirms that accurate velocity-field estimation is necessary for modeling cross-view transport.
Effect of \(\mathcal{L}_{\text{flow-comp}}\). The completion consistency loss enforces bidirectional completion consistency between paired latent representations. Without this constraint, the recovered features may deviate from the true latent representations during finite-step integration, leading to degraded performance. This loss therefore improves the stability of cross-view completion. When both flow losses are removed, the model reduces to an alignment-only variant and achieves moderate performance. Introducing the flow-matching formulation substantially improves all metrics, demonstrating that straight-path transport effectively exploits the clustering structure established by the alignment modules.
Figure 4: Hyperparameter analysis of the loss coefficients on five datasets with missing rate \(\tau=0.3\). (a) \(\lambda_1\) for the flow prediction loss \(\mathcal{L}_{\text{flow-pred}}\); (b) \(\lambda_2\) for the completion consistency loss \(\mathcal{L}_{\text{flow-comp}}\); (c) \(\lambda_3\) for the cluster-level contrastive loss \(\mathcal{L}_{\text{cluster}}\); (d) \(\lambda_4\) for the entropy-based alignment loss \(\mathcal{L}_{\text{entropy}}\).. a — ACC vs. \(\lambda_1\), b — ACC vs. \(\lambda_2\), c — ACC vs. \(\lambda_3\), d — ACC vs. \(\lambda_4\)
Hyperparameters Analysis. We analyze the sensitivity of the loss coefficients \(\lambda_1\), \(\lambda_2\), \(\lambda_3\), and \(\lambda_4\) under the missing rate \(\tau=0.3\), as shown in Fig. 4. The performance remains stable across a wide range of \(\lambda_1\) and \(\lambda_2\), corresponding to the flow prediction loss \(\mathcal{L}_{\text{flow-pred}}\) and the completion consistency loss \(\mathcal{L}_{\text{flow-comp}}\). In contrast, the method is more sensitive to \(\lambda_3\) and \(\lambda_4\), which control the cluster-level contrastive loss \(\mathcal{L}_{\text{cluster}}\) and the entropy-based alignment loss \(\mathcal{L}_{\text{entropy}}\). This observation is consistent with our formulation: alignment losses enforce cross-view assignment consistency and stabilize probability predictions, which are required by the assumptions underlying the flow-matching formulation.
Visualization Analysis. We visualize the learned representations on the HandWritten dataset using t-SNE under the missing rate \(\tau=0.3\), as shown in Fig. 5. Compared with the scattered and mixed raw features, the representations learned by our framework form clearly separated clusters. This improvement arises because the cluster-level contrastive loss and entropy-based alignment enforce cross-view assignment consistency and stabilize probability predictions, while the flow-matching formulation performs cross-view completion by following the straight-path transport between paired latent representations.
Flow-Step Analysis. We analyze the influence of the number of flow steps used for cross-view completion. As shown in Fig. 5, the clustering performance remains stable across different step numbers. This observation is consistent with our theoretical Corollary 2 that flow matching achieves cluster separability within any finite number of steps. Once the vector field is learned, the straight-path transport learned by the vector field produces stable completion under different finite-step integration settings.
Figure 5: Representation visualization and flow-step analysis. (a) t-SNE visualization on the HandWritten dataset with missing rate \(\tau=0.3\), showing the raw features (left) and the representations learned by our method (right). (b) Clustering accuracy under different flow step numbers on the HandWritten and Synthetic3D datasets.. a — t-SNE Visualization, b — Flow-Step Analysis
We presented a flow-matching framework for incomplete multi-view clustering that formulates missing-view recovery as a straight-path transport problem in the latent representation space. Through theoretical analysis, we showed that flow matching provides two desirable properties for IMVC: shortcut-path transport and finite-step cluster separability. Guided by this analysis, we developed an end-to-end model that integrates within-view reconstruction, cross-view alignment, and flow-based completion. Extensive experiments on multiple benchmarks demonstrate that the proposed approach consistently achieves strong clustering performance and remains robust under high missing rates.
Here, we establish a formal foundation for the comparative theoretical analysis between the diffusion model and flow matching. Specifically, we first augment the problem setup in in the context of conditional diffusion models (). Then, based on the assumptions we have enumerated in , we complete the full mathematical formulation of the continuous-time conditional diffusion model, including both the forward process and the reverse denoising process on the task of IMVC (). In , we summarize three properties of conditional diffusion models, which lead to two limitations of such models under the IMVC task setup ().
This section complements .
This setup augments the problem setup we introduced in in the context of the conditional diffusion model.
The diffusion process considered in subsequent analysis is defined over continuous time \(t \in [0,T]\), where \(t=0\) corresponds to the clean representation space and \(t=T\) corresponds to pure Gaussian noise. Let \(g(t) \in \mathbb{R}_+\) denote the diffusion coefficient, and define the accumulated noise variance as \(\sigma_t^2 = \int_0^t g^2(s)\,ds\), with \(g(0)=0\), \(g(T)>0\).
Previous work [5] has established that the conditional diffusion model can be adopted for the task of IMVC 1. However, we argue that its application to the task is suboptimal due to the intrinsic theoretical limitations.
Below, we present a complete mathematical formulation of the conditional diffusion models, where we establish three key properties, by analyzing the forward and reverse processes. The properties serve as the theoretical foundation for the analysis of its limitations in IMVC in .
The forward noising process of the diffusion model is the Ornstein–Uhlenbeck (OU) SDE: \[\label{eqn:property195eq1} d \boldsymbol{x}_t = -\frac{1}{2} g^2(t) \boldsymbol{x}_t \, dt + g(t)\, d \boldsymbol{w}_t, \quad \boldsymbol{x}_0 = \boldsymbol{z}_2;\tag{5}\] where \(\boldsymbol{x}_t \in Z\) denotes the noised representation at time \(t\), \(\boldsymbol{w}_t\) is a \(d\)-dimensional standard Wiener process (the stochastic noise source), and \(\boldsymbol{z}_2\) is the clean representation of view 2, as the missing view that shall be recovered.
By linearity of Gaussian processes, admits an explicit solution: \[\label{eqn:property195eq2} \boldsymbol{x}_t = \boldsymbol{z}_2 \cdot e^{-\frac{1}{2}\sigma_t^2} + \int_0^t g(s)\, e^{-\frac{1}{2}\int_s^t g^2(r)\,dr}\, d \boldsymbol{w}_s.\tag{6}\] Its marginal distribution is Gaussian: \[\label{eqn:property195pre1} p_t(\boldsymbol{x}_t\mid \boldsymbol{z}_2)=\mathcal{N}\!\left(\boldsymbol{x}_t;\alpha_t z_2,\sigma_t^2 I_d\right),\quad \alpha_t=e^{-\frac{1}{2}\sigma_t^2};\tag{7}\] where \(\alpha_t \in (0,1]\) is the signal attenuation coefficient, satisfying \(\alpha_0 = 1\) and \(\alpha_T \to 0\); \(I_d\) denotes the \(d\)-dimensional identity matrix.
Hence, in the high-noise limit \(t\to T\) (\(\alpha_T\to 0\)), the terminal distribution becomes a global Gaussian independent of the underlying cluster set: \[\label{eqn:property1} p_T(\boldsymbol{x}_T\mid \boldsymbol{z}_2)\to \mathcal{N}\!\left(\boldsymbol{x}_T;0,\sigma_T^2 I_d\right).\tag{8}\] As such, we arrive at
Property 1. Regardless of which cluster set \(\boldsymbol{z}_2\) belongs to, the diffusion endpoint at \(t\to T\) (\(\alpha_T\to 0\)) is cluster-agnostic noise and cluster identity is fully obscured.
In IMVC, diffusion model recovers the clean representation of \(\boldsymbol{z}_2\) at \(t=0\) conditioned on the observed-view representation \(\boldsymbol{z}_1\) by integrating a reverse-time conditional SDE: \[\label{eqn:property295pre1} d\boldsymbol{x}_t=\Big[g^2(t)s^*(\boldsymbol{x}_t,t,\boldsymbol{z}_1)-\frac{1}{2}g^2(t)\boldsymbol{x}_t\Big]dt+g(t)d\boldsymbol{\bar w}_t,\quad \boldsymbol{x}_T\sim \mathcal{N}(0,\sigma_T^2 I_d).\tag{9}\] Here \(\boldsymbol{\bar w}_t\) is a reverse-time Wiener process (independent of the forward one) and constitutes a non-removable source of randomness; \(s^*(\boldsymbol{x}_t,t,\boldsymbol{z}_1)=-\nabla_{\boldsymbol{x}_t}\log p_t(\boldsymbol{x}_t\mid \boldsymbol{z}_1)\) is the true conditional score. From and 9 , we derive
Property 2. The reverse process starts from a global Gaussian that is geometrically unrelated to the cluster set of \(\boldsymbol{z}_1\): \[\label{eqn:property2} p_T(\boldsymbol{x}_T\mid \boldsymbol{z}_1)=\mathcal{N}(0,\sigma_T^2 I_d).\tag{10}\] This stochasticity and cluster-agnostic start are intrinsic to the diffusion mechanism and cannot be eliminated by training or tuning.
A necessary condition for diffusion-based completion to preserve clustering is that the supports of noised distributions from different cluster sets do not overlap. For any \(\boldsymbol{z}_2^i\in M_i\) and \(\boldsymbol{z}_2^j\in M_j\) with \(i\neq j\), the separability requirement is \[\label{eqn:property395pre} \mathrm{supp}\!\left(p_t(\boldsymbol{x}_t\mid \boldsymbol{z}_2^i)\right)\cap \mathrm{supp}\!\left(p_t(\boldsymbol{x}_t\mid \boldsymbol{z}_2^j)\right)=\emptyset.\tag{11}\] Using the Gaussian form in , this condition holds iff \[\label{eqn:property395pre1} \sigma_t<\frac{\delta}{2},\tag{12}\] where \(\delta\) is the minimum inter-cluster distance from Assumption [assump:separable95representation]. Therefore, we naturally derive
Property 3. Diffusion-induced cluster separability is guaranteed only when the accumulated noise variance is sufficiently small — essentially in the asymptotic regime \(t\to 0\).
The mathematical formulation and three properties of conditional diffusion models lead to two limitations for these models when applied to the IMVC task. We note that these limitations cannot be resolved through engineering efforts, such as hyperparameter tuning or architectural designs. Below, we introduce these limitations while connecting them to the properties introduced in .
Limitation 1 (Cluster-Agnostic Gaussian Initialization). From and 10 in Property 1 and 2, the reverse process of the diffusion model starts from a fixed initialization \(\boldsymbol{x}_T \sim \mathcal{N}(0, \sigma_T^2 I_d)\). This starting point is a global Gaussian noise distribution that has no association with the observed view \(\boldsymbol{z}_1\) or the cluster set to which it belongs.
As such, we point out two direct consequences. The first is path redundancy, the reverse process must complete the full evolution from the global noise space to the representation space and finally to the cluster set. Even if the observed view and the completion target are highly aligned (\(\|\boldsymbol{z}_1 - \boldsymbol{z}_2\| \to 0\)), the process cannot exploit the structural information of view consistency to form a shortcut path. A substantial portion of computation is therefore consumed in noise attenuation rather than view completion and clustering refinement.
The second consequence is geometric irrelevance. Since the noise initialization contains no cluster geometric information, the early stage of the reverse process must extract cluster structure from noise without any geometric prior, resulting in low efficiency for IMVC.
Limitation 1 (Asymptotic Cluster Separability). From Property 3, , the cluster separability of the diffusion model holds only when \(\sigma_t < \delta/2\) (\(t \to 0\)). This strong asymptotic condition is difficult to satisfy under finite-step inference in IMVC, where we note two implications.
The first being the significant degradattion of separability under finite steps, when the minimum inter-cluster distance \(\delta\) is small (which is common in real-world data), it is possible that \(\sigma_t \not< \delta/2\) within finite steps, resulting in overlap between the supports of noised distributions from different clusters, and samples are prone to cross-cluster drift. This will reduce the clustering accuracy.
And second, clustering becomes a byproduct of noise attenuation — the cluster structure in diffusion models emerges only when the noise level becomes sufficiently small, and most reverse-time steps are devoted to noise reduction rather than the core objective of view completion and fine-grained clustering adjustment, leading to low efficiency.
The two limitations discussed above collectively demonstrate that diffusion model is structurally misaligned with the task requirements of IMVC.
To fill in the gap of existing work [5], which has only empirically adopted diffusion models for end-to-end IMVC without theoretical analysis, we provide proof that the reverse denoising process of conditional diffusion models is intrinsically a clustering process ().
Based on the complete mathematical formulation and the properties of the conditional diffusion model established above (), we prove that the reverse denoising process of the conditional diffusion model is intrinsically a clustering process. In essence, starting from pure Gaussian noise at \(t = T\), the reverse SDE evolves such that, as \(t \to 0\), the sample trajectory converges to the cluster set associated with the observed view with probability one.
This proof completes our theoretical analysis, while complementing previous work [5] that has empirically adopted diffusion models for end-to-end IMVC.
Theorem 1 (Clustering Convergence of Conditional Diffusion Models). Under the Assumptions [assump:separable95representation]-[assump:perfect95approx], consider the reverse denoising process of the conditional diffusion model defined by the reverse SDE (). Starting from pure Gaussian noise \(\boldsymbol{x}_T \sim \mathcal{N}\left(0, \sigma_T^2 I_d\right)\), as \(t \to 0\), the noisy representation \(\boldsymbol{x}_t\) converges almost surely to the cluster set associated with the observed view \(\boldsymbol{z}_1\), namely, \[\mathbb{P}\!\left( \boldsymbol{x}_t \in \mathcal{S}_{c(\boldsymbol{z}_1)} \mid \boldsymbol{z}_1 \right) \to 1, \qquad t \to 0. \label{eq:cluster95convergence95probability}\tag{13}\]
The proof proceeds in three steps, each directly grounded in the diffusion equations (–12 ) and the stated assumptions.
By the view-consistency assumption (Assumption [assump:view95consistency]), for a given observed view representation \(\boldsymbol{z}_1\), the target representation \(\boldsymbol{z}_2\) must lie on the same cluster. Therefore, the support of the conditional prior distribution satisfies \[\mathrm{supp}\big(p_0(\boldsymbol{z}_2 \mid \boldsymbol{z}_1)\big) \subseteq \mathcal{S}_{c(\boldsymbol{z}_1)}. \label{eq:conditional95prior95support}\tag{14}\]
This implies that the conditional prior assigns nonzero probability only within the unique cluster set corresponding to \(\boldsymbol{z}_1\), and thus no probability mass is distributed across different or disjoint clusters.
By Bayes’ rule, the conditional posterior distribution of the noisy representation at time \(t\) is \[p_t(\boldsymbol{x}_t \mid \boldsymbol{z}_1) = \int_{\mathcal{Z}} p_t(\boldsymbol{x}_t \mid \boldsymbol{z}_2)\, p_0(\boldsymbol{z}_2 \mid \boldsymbol{z}_1)\, d\boldsymbol{z}_2. \label{eq:posterior95decomposition}\tag{15}\]
From the Gaussian marginal distribution of the forward process (), we know that as \(t \to 0\), the accumulated noise variance satisfies \(\sigma_t \to 0\). Consequently, each conditional Gaussian distribution \(p_t\left(\boldsymbol{x}_t | \boldsymbol{z}_2 \right)\) contracts to a small neighborhood of the clean representation \(\boldsymbol{z}_2\).
By the cluster separability condition (), when \(\sigma_t < \delta/2\), the supports of the noisy conditional distributions \(p_t(\boldsymbol{x}_t \mid \boldsymbol{z}_2)\) corresponding to different cluster sets are disjoint. Combining this with 14 , the support of the posterior distribution \(p_t(\boldsymbol{x}_t \mid \boldsymbol{z}_1)\) is contained entirely within a neighborhood of \(\mathcal{S}_{c(\boldsymbol{z}_1)}\).
As \(t \to 0\), \(\delta \to 0\), the Gaussian distribution converges to a Dirac measure centered at \(\boldsymbol{z}_2\): \[p_t(\boldsymbol{x}_t \mid \boldsymbol{z}_2) \to \delta(\boldsymbol{x}_t - \boldsymbol{z}_2). \label{eq:dirac95limit}\tag{16}\]
Substituting this into 15 , we obtain \[\lim_{t \to 0} p_t(\boldsymbol{x}_t \mid \boldsymbol{z}_1) = p_0(\boldsymbol{x}_0 \mid \boldsymbol{z}_1), \label{eq:posterior95limit}\tag{17}\] whose support lies entirely within \(\mathcal{S}_{c(\boldsymbol{z}_1)}\).
Therefore, integrating the posterior distribution over the cluster set yields \[\mathbb{P}\!\left( \boldsymbol{x}_t \in \mathcal{S}_{c(\boldsymbol{z}_1)} \mid \boldsymbol{z}_1 \right) = \int_{\mathcal{S}_{c(\boldsymbol{z}_1)}} p_t(\boldsymbol{x}_t \mid \boldsymbol{z}_1)\, d\boldsymbol{x}_t \to 1, \qquad t \to 0. \label{eq:probability95limit}\tag{18}\]
This completes the proof.
We note that Thm. 1 establishes clustering convergence only in the asymptotic regime \(t \to 0\). However, the diffusion equations reveal three intrinsic structural properties that constitute theoretical limitations of diffusion models in the IMVC setting, as discussed in .
This section complements by supplying proofs of the corollaries on flowing matching.
The initial condition of flow matching is \(\boldsymbol{x}_0 = \boldsymbol{z}_1\), and since \(\boldsymbol{z}_1 \in \mathcal{S}_{c(\boldsymbol{z}_1)}\) (the cluster set of the observed view), the starting point itself contains complete cluster structure information. There is no need to mine the cluster structure from noise, eliminating path redundancy at its source.
The linear interpolation path in is the shortest path in Euclidean space connecting \(\boldsymbol{z}_1\) and \(\boldsymbol{z}_2\), with a path length of \(\|\boldsymbol{z}_2 - \boldsymbol{z}_1\|\) and no detours.
The target vector field for flow matching is \(\boldsymbol{v}_{\text{target}} = \boldsymbol{z}_2 - \boldsymbol{z}_1\) (). By the view consistency assumption (), \(\boldsymbol{z}_1, \boldsymbol{z}_2 \in \mathcal{S}_{c(\boldsymbol{z}_1)}\). Therefore, the target vector field always points inside the same cluster set, and the vector field \(\boldsymbol{v}_\theta(\cdot)\) fitted by the neural network naturally possesses a strong cluster-guiding property.
By the uniqueness theorem for ODE solutions, for any two initial conditions \(\boldsymbol{z}_1^i,\boldsymbol{z}_2^i\in \mathcal{S}_i\) and \(\boldsymbol{z}_1^j,\boldsymbol{z}_2^j \in \mathcal{S}_j \;(i \neq j)\) belonging to different cluster sets, their corresponding ODE solution trajectories \(\boldsymbol{x}_t^i, \boldsymbol{x}_t^j\) never intersect. That is: \[\begin{align} \boldsymbol{x}_t^i \in \mathcal{S}_i, \quad \boldsymbol{x}_t^j \in \mathcal{S}_j,\quad \forall t \in [0,1]\\ \boldsymbol{x}_t^i = (1-t)\boldsymbol{z}_1^i+t\boldsymbol{z}_2^i,\quad \boldsymbol{x}_t^j = (1-t)\boldsymbol{z}_1^j+t\boldsymbol{z}_2^j \end{align}\]
Due to the non-intersecting property of trajectories from different clusters, flow matching guarantees strict separation of sample representations from different clusters within any finite number of steps.
In this section, we provide a proof of the reversibility property of the flow matching ODE framework, which complements our discussion in .
First, recall the forward flow matching ODE that evolves a sample from \(\boldsymbol{z}_1\) to \(\boldsymbol{z}_2\) over time \(t \in [0,1]\): \[\frac{d\boldsymbol{x}_t}{dt} = \boldsymbol{v}_\theta(\boldsymbol{x}_t, t), \quad \boldsymbol{x}_0 = \boldsymbol{z}_1, \quad \boldsymbol{x}_1 = \boldsymbol{z}_2.\] The solution to this ODE is the integral: \[\boldsymbol{x}_1 - \boldsymbol{x}_0 = \int_0^1 \boldsymbol{v}_\theta(\boldsymbol{x}_t, t) dt.\]
To derive the reverse flow (from \(\boldsymbol{z}_2\) to \(\boldsymbol{z}_1\)), we introduce a reversed time variable \(s = 1 - t\). When \(t = 0\), \(s = 1\); when \(t = 1\), \(s = 0\). The differential of \(t\) with respect to \(s\) is: \[dt = -ds.\]
Define the reversed state variable \(\boldsymbol{x}_s = \boldsymbol{x}_{1-t}\), which satisfies: \[\boldsymbol{x}_s = (1-s)\boldsymbol{z}_2 + s\boldsymbol{z}_1,\] with initial condition \(\boldsymbol{x}_0 = \boldsymbol{z}_2\) and final condition \(\boldsymbol{x}_1 = \boldsymbol{z}_1\) (consistent with reverse flow).
Compute the time derivative of \(\boldsymbol{x}_s\) with respect to \(s\): \[\begin{align} \frac{d\boldsymbol{x}_s}{ds} &= \frac{d\boldsymbol{x}_{1-t}}{ds} = \frac{d\boldsymbol{x}_{1-t}}{d(1-t)} \cdot \frac{d(1-t)}{ds} \\ &= \boldsymbol{v}_\theta(\boldsymbol{x}_{1-t}, 1-t) \cdot (-1) \\ &= -\boldsymbol{v}_\theta(\boldsymbol{x}_{1-t}, 1-t). \end{align}\]
By defining the reverse vector field as \(\boldsymbol{v}_{\theta_R}(\boldsymbol{x}_s, s) = -\boldsymbol{v}_\theta(\boldsymbol{x}_{1-t}, 1-t)\), the corresponding reverse ODE simplifies to: \[\frac{d\boldsymbol{x}_s}{ds} = \boldsymbol{v}_{\theta_R}(\boldsymbol{x}_s, s), \quad \boldsymbol{x}_0 = \boldsymbol{z}_2, \quad \boldsymbol{x}_1 = \boldsymbol{z}_1.\]
Integrate the reverse ODE to verify it recovers the original state: \[\begin{align} \boldsymbol{x}_1 - \boldsymbol{x}_0 &= \int_0^1 \boldsymbol{v}_{\theta_R}(\boldsymbol{x}_s, s) ds \\ &= -\int_0^1 \boldsymbol{v}_\theta(\boldsymbol{x}_{1-t}, 1-t) ds \\ &= \int_1^0 \boldsymbol{v}_\theta(\boldsymbol{x}_t, t) dt = -\int_0^1 \boldsymbol{v}_\theta(\boldsymbol{x}_t, t) dt \\ &= \boldsymbol{z}_1 - \boldsymbol{z}_2. \end{align}\]
This confirms that the reverse vector field \(-\boldsymbol{v}_\theta(\cdot)\) exactly reverses the forward flow, proving that flow matching only requires training a single vector field to achieve bidirectional view completion—unlike diffusion models that need two separate models for forward and reverse processes.
In this section, we formally prove that the centered logratio (clr) transformation maps the \(D\)-dimensional probability simplex onto the \((D-1)\)-dimensional linear subspace of \(\mathbb{R}^D\) defined by the zero-sum constraint. This ensures that clr-transformed data preserves the relative information of the original compositional distributions while lying in a linear space, which allows standard fusion methods to be applied validly without violating simplex consistency. This complements the discussion in .
Let \(\mathcal{S}^D\) be the \(D\)-part simplex defined as: \[\mathcal{S}^D = \left\{ \mathbf{x} = [x_1, x_2, \dots, x_D] \in \mathbb{R}^D \;\middle|\; x_i > 0, \sum_{i=1}^D x_i = \kappa \right\},\] where \(\kappa\) is a constant (typically \(1\) or \(100\)).
The geometric mean of a composition \(\mathbf{x}\) is denoted by \(g(\mathbf{x})\): \[g(\mathbf{x}) = \left( \prod_{i=1}^D x_i \right)^{1/D}.\]
The Centered Log-Ratio (clr) transformation is defined as the mapping \(\text{clr}: \mathcal{S}^D \to \mathbb{R}^D\): \[\text{clr}(\mathbf{x}) = \mathbf{z} = \left[ \ln\frac{x_1}{g(\mathbf{x})}, \ln\frac{x_2}{g(\mathbf{x})}, \dots, \ln\frac{x_D}{g(\mathbf{x})} \right],\] where the \(i\)-th component is \(z_i = \ln x_i - \ln g(\mathbf{x})\).
The image of the simplex under the clr transformation, denoted as \(\mathcal{V}_0 = \{ \mathbf{z} \in \mathbb{R}^D \mid \exists \mathbf{x} \in \mathcal{S}^D, \mathbf{z} = \text{clr}(\mathbf{x}) \}\), is a linear subspace of \(\mathbb{R}^D\) of dimension \(D-1\). Specifically, it is the hyperplane defined by the sum-to-zero constraint: \[\mathcal{V}_0 = \left\{ \mathbf{z} \in \mathbb{R}^D \;\middle|\; \sum_{i=1}^D z_i = 0 \right\}.\]
This proof consists of two steps, as follows.
For any \(\mathbf{z} = \text{clr}(\mathbf{x})\), the sum of its components is: \[\begin{align} \sum_{i=1}^D z_i &= \sum_{i=1}^D \left( \ln x_i - \ln g(\mathbf{x}) \right) \nonumber \\ &= \sum_{i=1}^D \ln x_i - \sum_{i=1}^D \ln g(\mathbf{x}) \nonumber \\ &= \sum_{i=1}^D \ln x_i - D \cdot \ln g(\mathbf{x}). \end{align}\] Substituting the definition \(g(\mathbf{x}) = (\prod_{j=1}^D x_j)^{1/D}\): \[D \cdot \ln g(\mathbf{x}) = D \cdot \ln \left( \prod_{j=1}^D x_j \right)^{1/D} = D \cdot \frac{1}{D} \sum_{j=1}^D \ln x_j = \sum_{j=1}^D \ln x_j.\] Therefore: \[\sum_{i=1}^D z_i = \sum_{i=1}^D \ln x_i - \sum_{i=1}^D \ln x_i = 0.\] Thus, \(\mathcal{V}_0 \subseteq \{ \mathbf{z} \mid \sum z_i = 0 \}\).
Let \(W = \{ \mathbf{z} \in \mathbb{R}^D \mid \sum_{i=1}^D z_i = 0 \}\). To prove \(W\) is a linear subspace, we must show it contains the zero vector and is closed under addition and scalar multiplication.
Zero Vector: The vector \(\mathbf{0} = [0, \dots, 0]\) satisfies \(\sum 0 = 0\). Thus, \(\mathbf{0} \in W\).
Closure under Addition: Let \(\mathbf{u}, \mathbf{v} \in W\). Then \(\sum u_i = 0\) and \(\sum v_i = 0\). Consider \(\mathbf{w} = \mathbf{u} + \mathbf{v}\). The sum of components is: \[\sum_{i=1}^D w_i = \sum_{i=1}^D (u_i + v_i) = \sum_{i=1}^D u_i + \sum_{i=1}^D v_i = 0 + 0 = 0.\] Thus, \(\mathbf{u} + \mathbf{v} \in W\).
Closure under Scalar Multiplication: Let \(\mathbf{u} \in W\) and \(c \in \mathbb{R}\). Consider \(\mathbf{v} = c\mathbf{u}\). The sum of components is: \[\sum_{i=1}^D v_i = \sum_{i=1}^D (c \cdot u_i) = c \sum_{i=1}^D u_i = c \cdot 0 = 0.\] Thus, \(c\mathbf{u} \in W\).
Since \(W\) satisfies all axioms, it is a linear subspace of \(\mathbb{R}^D\). Since the constraint \(\sum z_i = 0\) is a single linearly independent equation in \(\mathbb{R}^D\), the dimension of this subspace is \(D-1\).
The experiments are conducted on one NVIDIA RTX4090 using PyTorch. We refer readers to Table 1 for detailed configurations of our experiments.
| Setting | Dataset | ||||
|---|---|---|---|---|---|
| 2-6 | Synthetic3d | CUB | HandWritten | LandUse-21 | Fashion |
| Shared configurations across all datasets | |||||
| Optimizer | Adam | ||||
| Learning Rate | \(1 \times 10^{-3}\) | ||||
| Epochs | 200 | ||||
| \(\tau\) | \(\{0.1, 0.3, 0.5\}\) | ||||
| Step | 1 (train and inference) | ||||
| Individual configurations per dataset | |||||
| Batch Size | 128 | 256 | 256 | 128 | 128 |
| \(\lambda_1\) | 100.0 | 1.0 | 1000.0 | 1000.0 | 10.0 |
| \(\lambda_2\) | 1.0 | 10.0 | 1.0 | 1.0 | 1.0 |
| \(\lambda_3\) | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 |
| \(\lambda_4\) | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 |
6pt
| Strategies | \(\tau = 0.1\) | \(\tau = 0.3\) | \(\tau = 0.5\) | ||||||
|---|---|---|---|---|---|---|---|---|---|
| 2-10 | ACC | NMI | ARI | ACC | NMI | ARI | ACC | NMI | ARI |
| GAN | 60.25 | 58.72 | 52.64 | 55.82 | 53.43 | 48.39 | 51.36 | 49.87 | 44.52 |
| Prediction | 75.89 | 71.26 | 59.83 | 71.13 | 66.76 | 54.61 | 67.54 | 63.29 | 50.17 |
| Paired | 77.41 | 71.53 | 59.27 | 72.83 | 66.80 | 53.98 | 68.92 | 63.55 | 49.86 |
| Diffusion | 82.23 | 77.70 | 69.21 | 77.17 | 71.35 | 59.85 | 75.50 | 72.21 | 59.12 |
| Flow(Ours) | 86.00 | 78.19 | 72.28 | 82.67 | 72.80 | 66.31 | 80.50 | 71.74 | 63.15 |
To further evaluate the effectiveness of our flow-based generation strategy, we replaced it with alternative generative models, including GAN [27], Prediction [23], Paired-data-only training, and Diffusion models [5], and conducted comprehensive experiments on the CUB dataset with missing rates of 0.1, 0.3 and 0.5, with corresponding results shown in Table 2.
The results consistently demonstrate that our Flow-based strategy achieves dominant performance over all comparative methods across all missing rate settings, verifying the robust and effective nature of our proposed method. Specifically, compared with the Diffusion baseline that ranks second, our method yields substantial and notable improvements in all clustering metrics under each missing rate, which fully reflects the superior generation capability of the flow-based strategy for missing view recovery. Additionally, the comparison with the “Paired” strategy confirms that our method can fully and efficiently leverage incomplete data instances instead of simply discarding them, which maximizes the utility of multi-view information and thus stably boosts the clustering performance even with the increase of missing rates, showing better adaptability to different missing rate scenarios.
We visualize the learned representations on the CUB, LandUse-21, Synthetic3d and Fashion datasets using t-SNE under the missing rate \(\tau=0.3\), as shown in Fig. 6. Compared with scattered and mixed raw features, the representations learned by our framework form well-separated clusters. This improvement stems from the cluster-level contrastive loss and entropy-based alignment, which enforce cross-view assignment consistency and stabilize probability predictions. Meanwhile, the flow-matching module achieves cross-view completion by performing straight-path transport between paired latent representations.
Figure 6: Representation visualization. (a), (b), (c), and (d) show the t-SNE visualizations of CUB, LandUse-21, Synthetic3d, and Fashion datasets, respectively, with a missing rate of 0.3.. a — CUB, b — LandUse-21, c — Synthetic3d, d — Fashion