July 02, 2026
We introduce a controlled subspace intervention framework to investigate how self-supervised Vision Transformers (ViTs) encode dense geometric information. While linear probing is widely used to assess geometric representations, it treats features as a black box, failing to disentangle the underlying topology. To address this issue, we decompose the weights of converged linear probes to isolate the low-rank subspaces containing explicit geometric signals using Singular Value Decomposition (SVD). Our perspective yields three key insights: (1) Pre-training objectives determine how features are encoded. DINOv2 aligns spatial features for efficient linear extraction, while Masked Autoencoders (MAE) tend to disperse these signals, requiring a broader spatial context. (2) Explicit geometric representations are highly compressible, suggesting dense predictive heads could potentially be constrained to low-rank subspaces with minimal performance loss. (3) The layer-wise task affinity suggests that geometric precision peaks at intermediate layers before yielding to semantic abstraction in the final layers. By connecting internal encoding mechanics with downstream performance, these findings provide a basis for effective feature selection and lightweight decoder design. The source code is available at https://github.com/Zhou-Weichen/Geosubprobe.
Modern dense prediction frameworks increasingly rely on self-supervised Vision Transformers (ViTs) as their foundational backbones [1]–[4]. Beyond the expected gains from task-specific training, these models exhibit an inherent understanding of spatial geometric information directly within their pre-trained representation space [5]–[7]. While their empirical effectiveness is established, the encoding format of this emergent geometric information remains unclear. It is uncertain whether the network disperses geometric information across its entire high-dimensional feature space or aligns it into specific, linearly accessible coordinates. Drawing from insights that latent space topology is heavily influenced by pre-training objectives [8]–[10], we hypothesize that optimization constraints determine how geometric primitives are routed and formatted within latent subspaces. Understanding how distinct paradigms, such as self-distillation [5], masked image modeling [11], and hybrid approaches [12], shape these internal geometric representations is therefore critical for adapting these models to downstream tasks.
To characterize this inherent geometric understanding, recent studies reveal that self-supervised ViTs encode accurate single-view geometry despite lacking explicit 3D supervision [13]–[16]. This geometric awareness is a functional necessity for resolving complex semantic ambiguities [17]. However, these models often struggle with multi-view consistency and complex spatial relationships [15], [16]. Such inconsistencies suggest that simply detecting the presence of geometric information is insufficient; it is crucial to understand how it is topologically encoded. Currently, representations are assessed primarily through the final prediction accuracy of black-box downstream probes [13], [16], [18], [19]. This paradigm conflates the absence of information with the inability to decode it [20], [21]. When a linear probe performs poorly, it remains ambiguous whether the geometric information is absent, entangled within non-linear manifolds, or scattered across disjoint spatial patches. Resolving this diagnostic ambiguity requires directly examining the underlying feature encoding mechanics.
To address these uncertainties, we introduce a controlled subspace intervention framework. Since a linear probe extracts information by projecting features onto a learned weight matrix, its predictive capacity is bottlenecked by the continuous subspace spanned by these weights. Motivated by this property, we apply SVD to the converged weights of linear probes to explicitly isolate task-aligned geometric directions. This allows us to evaluate the encoding format where geometric signals recoverable from a low-dimensional subspace indicate highly aligned spatial features. In contrast, signals requiring high-dimensional non-linear aggregation across spatial tokens should be entangled.
Through this analytical framework, our investigation reveals distinct feature encoding formats driven by pre-training objectives. Self-distillation (, DINOv2) strongly aligns explicit geometry into highly compressible, low-rank coordinate systems. In contrast, generative masked reconstruction model (, MAE) disperses geometric signals across broader dimensions to satisfy pixel-level reconstruction constraints. Despite these differences, we identify a high compressibility of explicit geometric representations across all evaluated paradigms. Furthermore, layer-wise evaluation uncovers a task affinity among surface normal estimation, depth estimation, and semantic segmentation in the deeper representation space.
Our main contributions are summarized as follows:
We introduce a controlled subspace intervention framework. By applying SVD to converged linear probe weights, we isolate task-aligned directions to quantify the linear compressibility of geometric representations, moving beyond black-box output metrics.
Through our framework, we characterize differences in the accessibility of geometric information across the evaluated self-supervised paradigms. DINOv2 exhibits more linearly accessible geometry than MAE, while much of the linearly decodable geometric information is concentrated in low-rank, task-aligned subspaces.
We reveal that geometric features peak in DINOv2’s middle layers, then weaken as semantic performance improves.
Traditional evaluation paradigms assess representations through the black-box probing of downstream outputs, offering limited insights into the underlying feature structure. We introduce a post-hoc analytical framework that transitions from only evaluating task accuracy to inspecting the internal manifold topology. As illustrated in 1, our approach consists of two primary stages: establishing a readability gap (Panel A) and performing subspace interventions (Panel B).
Our first objective is to determine whether geometric information is genuinely absent or locked within complex non-linear structures. Rather than using a single decoder, we design a three-tier probing hierarchy. By deliberately restricting the capacity of these probe heads, we decouple local non-linear folding from the necessity of global spatial context. The resulting performance discrepancies across these tiers define the readability gap, providing a baseline of topological entanglement before we delve into its subspace.
Given the patch-level representation \(\mathbf{Z}^{(l)} \in \mathbb{R}^{N \times D}\) from layer \(l\) of a frozen backbone, where \(N\) denotes the number of spatial tokens and \(D\) represents the feature dimension per token, we apply a linear head parameterized by \(\mathbf{W}^{(l)} \in \mathbb{R}^{C \times D}\), where \(C\) is the target prediction space dimensionality (, \(C=256\) depth bins [22]). The prediction is computed as \(\hat{\mathbf{Y}} = \mathbf{Z}^{(l)} \mathbf{W}^{(l)\top}\). This naturally extends to a concatenated multi-scale representation mapped by \(\mathbf{W}_{\mathrm{global}} \in \mathbb{R}^{C \times4D}\). We treat this linear probe as a strict measure of accessibility, testing whether geometric cues are explicitly rectified into a linearly readable format without requiring cross-patch communication.
When a linear probe fails, it remains unclear whether the geometry is entirely absent, non-linearly folded within individual patches, or scattered across the spatial manifold. To isolate this, we introduce a token-wise Multi-Layer Perceptron (MLP) and a DPT-style decoder [23]. The MLP operates point-wise on individual spatial tokens but incorporates non-linear activations, so the performance gap between the Linear and MLP probes quantifies the degree of local non-linear entanglement. The performance gap between the DPT and MLP probes isolates the degree of spatial dispersion, revealing whether the backbone distributes geometric primitives across multiple spatial tokens that necessitate a global receptive field for inference. Together, this probing hierarchy establishes a comprehensive readability description.
While the readability gap quantifies the degree of entanglement, it does not reveal the directional distribution of information. To peer inside the linear probe’s mechanism, we introduce a subspace intervention post-hoc analysis framework.
We posit that the converged linear weight matrix \(\mathbf{W}^{(l)}\) encodes the task-aligned geometric directions discovered by the probe. Because the mapping projects to a low-dimensional target space (\(C \ll D\)), the rank of the learned linear mapping is upper-bounded by \(C\). We perform SVD directly on the probe weights without requiring additional training: \[\mathbf{W}^{(l)} = \mathbf{U}^{(l)} \boldsymbol{\Sigma}^{(l)} \mathbf{V}^{(l)\top}\] where \(\mathbf{U}^{(l)} \in \mathbb{R}^{C \times C}\) contains the left singular vectors, \(\boldsymbol{\Sigma}^{(l)} \in \mathbb{R}^{C \times C}\) is a diagonal matrix containing the singular values, and \(\mathbf{V}^{(l)} \in \mathbb{R}^{D \times C}\) contains the right singular vectors. The columns of \(\mathbf{V}^{(l)}\) form an orthonormal basis of the task-relevant representation space. By extension, the same decomposition is applied to the global concatenated weight matrix \(\mathbf{W}_{\mathrm{global}}\), yielding a corresponding low-rank basis spanning the multi-scale feature dimensions.
We define aligned subspace of rank \(k\) (\(k \le C\)) as the span of the top-\(k\) principal directions: \[\mathcal{S}^{(l)}_k = \mathrm{span}\{\mathbf{v}_1, \dots, \mathbf{v}_k\}.\] To assess the geometric density of this subspace, we constrain the backbone representation via orthogonal projection: \[\tilde{\mathbf{Z}}^{(l)}_k = \mathbf{Z}^{(l)} \mathbf{V}^{(l)}_k \mathbf{V}^{(l)\top}_k,\] Crucially, the projected features are evaluated directly using the original, frozen linear head. Because both the backbone and the probe remain locked, any performance variation is exclusively attributable to the geometric capacity of the selected \(k\)-dimensional subspace. To ensure that the extracted basis reflects the intrinsic manifold rather than optimization artifacts, we evaluated the similarity of the extracted subspaces across multiple random probe initializations (see Section 4.5).
To ensure that the explicit geometric signal is directionally concentrated along the principal components, rather than an artifact of retaining \(k\) degrees of freedom, we introduce two control subspaces for strict ablation under the frozen probe:
First, the random subspace \(\mathcal{R}_k\) projects features onto a span of \(k\) randomly sampled orthonormal directions in \(\mathbb{R}^D\) or \(\mathbb{R}^{4D}\). This disrupts the task-aligned structure while preserving the exact dimensionality, thereby serving as a null baseline. Second, to isolate the orthogonal complement containing the rejected tail dimensions, we compute the residual representation \(\mathbf{Z}^{(l)}_{\mathrm{res}}\) by subtracting the task-aligned projection from the original features: \[\mathbf{Z}^{(l)}_{\mathrm{res}} = \mathbf{Z}^{(l)} - \mathbf{Z}^{(l)} \mathbf{V}^{(l)}_k \mathbf{V}^{(l)\top}_k.\] Passing these residual features through the frozen head allows us to validate the sufficiency of the low-rank subspace and assess the information loss in its orthogonal complement.
Evaluating these residual representations through the same frozen linear probe serves as a diagnostic for whether the task-aligned geometric signal is concentrated in the top-\(k\) subspace. A sharp decrease in performance on the residual space indicates that the explicitly decodable geometric features exploited by the probe are largely confined to the top-\(k\) components, rather than being broadly dispersed across the remaining dimensions. This experimental design determines whether the network compresses geometric signals into a compact manifold or relies on a more dispersed distribution.
We evaluate three representative self-supervised ViT paradigms: self-distillation (DINOv2 [5]), masked image modeling (MAE [11]), and a hybrid approach (iBOT [12]). For our primary analysis, we adopt the ViT-Large variant for all architectures and maintain frozen backbone weights.
Geometric representations are primarily assessed via monocular depth estimation on the standard NYU Depth V2 dataset [24]. Performance is measured by scale-aware (SA) threshold accuracy (\(\delta < 1.25\)), RMSE, and Absolute Relative error (AbsRel) [25]. To investigate layer-wise task affinities within a controlled domain, we perform parallel probing for 40-class semantic segmentation [26] and surface normal estimation, adopting the mean Intersection over Union (mIoU) and angular accuracy [27] as the respective evaluation metrics.
Since one of the main contributions of this work is the analytical framework itself, which utilizes converged probe weights to inversely explore the internal feature topology, we focus on depth estimation to construct a cohesive and deep narrative. However, to examine the consistency of findings across tasks, domains, and probe configurations, we provide extensive parallel evaluations in the Supplementary Material. These include full surface normal trajectories, extended cross-domain benchmarks (, depth on KITTI [28], [29], and depth/normal estimation on NAVI [30]), and validation on ViT-Base variants.
As formalized in 2, we implement a three-tiered probing hierarchy to systematically distinguish the presence of geometric information from its structural accessibility. The baseline Linear Probe employs a \(1 \times 1\) convolution to map frozen patch tokens directly to the target space, quantifying explicit, isolated geometric cues. To isolate local non-linear entanglement, the intermediate MLP Probe introduces point-wise non-linear activations (, a hidden layer with GELU) while strictly maintaining the exact same \(1 \times 1\) token-wise receptive field. Finally, the DPT Decoder [23] establishes the absolute latent geometric upper bound by incorporating multi-scale feature aggregation and global spatial receptive fields.
Our experimental analysis follows a deductive trajectory, including each stage and its corresponding objective.
(1) 4.1: We assess the readability gap by applying different decoders (Linear, MLP, and DPT) to concatenated multi-layer features to quantify feature alignment versus dispersion.
(2) 4.2: Building upon the decoder baselines in (1), we apply SVD to the global probe weights to evaluate the compressibility of geometric representations and quantify their cross-layer energy routing.
(3) 4.3: Motivated by energy imbalances, we investigate rank sensitivity at individual network depths through single-layer subspace interventions.
(4) 4.4: We contrast geometric and semantic probing to examine whether terminal performance shifts originate from capacity loss or a transition in task-specific affinities.
(5) 4.5: We verify the stability of the extracted subspaces across random probe initializations.
Full implementation details, including hyperparameters, optimizer, and exact architectural specifications, are provided in the Supplementary Material.
| 2-4 (lr)5-6 Backbone | Linear | 1\(\times\)1 MLP | DPT | ||||||||||||
| Entang. | |||||||||||||||
| Frag. | |||||||||||||||
| DINOv2-L | +0.0168 | +0.0158 | |||||||||||||
| iBOT-L | +0.0178 | +0.0148 | |||||||||||||
| MAE-L | +0.0357 | +0.0632 |
As shown in 1, evaluating the three pre-training paradigms via our tiered probing reveals distinct feature encoding formats, distinguishing geometric representation presence from structural accessibility for downstream decoders.
DINOv2 exhibits strong spatial feature alignment. A linear probe alone recovers the vast majority of geometric signals (SA-\(\delta_1\) of 0.9157). Point-wise MLP probing improves this slightly to 0.9325, while the global DPT decoder yields 0.9483. This indicates that self-distillation inherently organizes geometric information into a linearly accessible format, minimizing the need for complex downstream decoders. In contrast, MAE demonstrates significant spatial dispersion. Linear performance drops to 0.6033, and MLP probing only raises accuracy to 0.6390. However, the DPT decoder’s global receptive field substantially boosts performance to 0.7022. This jump (+0.0989 over Linear) indicates that masked reconstruction distributes geometric primitives across patches, necessitating global spatial aggregation for effective extraction. The hybrid iBOT model represents an intermediate state. Its minimal performance gains from the 0.8198 linear baseline to the 0.8524 DPT indicate low non-linear entanglement and fragmentation, suggesting that hybrid objectives balance linear accessibility with dense localized representations.
We apply subspace intervention on fused multi-layer representations to evaluate absolute saturation, relative structural efficiency, and energy allocation.
We truncate the task-aligned basis to isolate explicitly encoded geometric signals. [fig:subspace95sig95noise] demonstrates that performance on both random (\(\mathcal{R}_k\)) and residual (\(\mathcal{S}_k^\perp\)) control subspaces collapses under the frozen linear probe. This gap indicates significant representational redundancy, suggesting that explicitly decodable geometric information can be projected into a low-rank subspace with minimal loss. This performance collapse confirms that the predictive mechanism of the original probe is strictly bottlenecked within the top-\(k\) dimensions.
Qualitative visualizations (3) and recovery efficiency curves ([fig:subspace95efficiency]) reveal distinct saturation behaviors across paradigms. MAE exhibits the fastest relative saturation, recovering over \(98\%\) of its linear potential at \(k=32\) despite its lower absolute geometric capacity. In contrast, DINOv2 requires a higher intrinsic dimensionality (\(k \ge 64\)) to converge. These results corroborate our accessibility findings. Specifically, MAE provides only coarse geometry in a linearly accessible form and requires few singular vectors for reconstruction, given that fine-grained details remain non-linearly entangled. In contrast, DINOv2 linearly aligns richer spatial details, which necessitates a broader basis to resolve precise object boundaries.
While global subspace analysis quantifies the capacity required for geometry, it does not identify which layers contribute most to this signal. To determine the contribution of each layer, we analyze the energy distribution of the converged global linear probe via its singular spectrum.
The probe maps concatenated features using weights \(\mathbf{W}_{\mathrm{global}} \in \mathbb{R}^{C \times 4D}\). Each right singular vector \(\mathbf{v}_m \in \mathbb{R}^{4D}\) resulting from the subspace decomposition encodes a task-aligned direction. We partition these vectors into four layer-specific blocks \(\mathbf{v}_m = [\mathbf{v}_m^{(l_6)}, \mathbf{v}_m^{(l_{12})}, \mathbf{v}_m^{(l_{18})}, \mathbf{v}_m^{(l_{24})}]^\top\). To quantify the specific contribution of each depth, we define the spectral-weighted energy for layer \(i\): \[E_i = \frac{\sum_{m=1}^C \sigma_m^2 \|\mathbf{v}_m^{(l_i)}\|_2^2}{\sum_{j=1}^4 \sum_{m=1}^C \sigma_m^2 \|\mathbf{v}_m^{(l_j)}\|_2^2}\] where singular values \(\sigma_m\) weight each direction by its explanatory variance.
| Contribution (%) | ||||
|---|---|---|---|---|
| 2-5 Model | \(l_{6}\) | \(l_{12}\) | \(l_{18}\) | \(l_{24}\) |
| DINOv2 | 17.2 | 35.8 | 36.7 | 10.3 |
| iBOT | 26.9 | 28.4 | 22.4 | 22.3 |
| MAE | 19.5 | 28.4 | 32.7 | 19.4 |
r0.45
3pt
Spectral energy profiles (2 4) reveal distinct routing strategies across depths. DINOv2 exhibits highly localized energy allocation, concentrating over 72% of geometric energy within intermediate layers (\(l_{12}, l_{18}\)) before a sharp decline to approximately 10% at \(l_{24}\). This distribution suggests an empirical layer-wise affinity, where explicit geometric information is dominant in intermediate layers but declines in deeper ones. However, masked reconstruction and hybrid paradigms distribute this explicit signal. Both iBOT and MAE exhibit highly similar energy distributions that cluster near the uniform 0.25 baseline, requiring the linear probe to aggregate features across all depths simultaneously. This indicates that masked reconstruction distributes features across layers rather than concentrating them.
This global aggregation inherently blends distinct layer-wise states. For example, the multi-scale probe compensates for the final-layer drop in DINOv2 by relying on intermediate features, masking the abrupt loss of geometric capacity. To trace how spatial understanding evolves and identify where it degrades, we therefore transition to a strictly single-layer diagnosis.
To trace the layer-wise evolution of geometric representations, we apply subspace interventions strictly to single-layer features. 5 tracks the performance trajectory from an extreme low-rank state (\(k=8\)) to the full linear capacity, benchmarked against a non-linear upper bound. We establish this non-linear baseline using a lightweight decoder incorporating spatial convolutions and residual connections on isolated single-layer features. Full architectural details are provided in the Supplementary Material.
As shown in 5, DINOv2 exhibits significant geometric compactness in its early to middle layers. Up to layer 11, the \(k=8\) subspace performs nearly as well as the full-rank linear probe, indicating that self-distillation effectively aligns spatial primitives into a highly compressed, linearly accessible format. A distinct transition occurs near layer 12, where the \(k=8\) trajectory diverges from the full-rank baseline. This terminal decline in explicitly decodable geometry aligns with the localized intermediate energy routing observed in 4.2.2, implying a structural shift in the representational focus of the network. This transition motivates the subsequent analysis of layer-wise task affinities. In contrast, masked reconstruction distributes features across more dimensions. MAE shows immediate and persistent rank sensitivity, likely because pixel-level objectives preserve high-frequency textures that disperse geometric signals. Although iBOT exhibits some early-layer alignment, it does not achieve the low-rank compactness observed in DINOv2. Both masked reconstruction and hybrid models maintain a substantial entanglement gap across most depths, suggesting that their geometric information remains reliant on local non-linear structures.
Despite these divergent evolutionary paths, the \(k=64\) and \(k=128\) subspace trajectories closely track the full-rank linear baselines across nearly all depths in every paradigm. This consistency suggests a pervasive high compressibility, where explicitly decodable geometric representations can be recovered from a low-rank subspace regardless of the pre-training objective.
Our layer-wise analysis reveals that the terminal layers of DINOv2 show a significant decline in explicitly decodable geometric information. To determine whether this reflects a loss of capacity or a shift toward semantic abstraction, we train identical linear probes for surface normal estimation, depth estimation, and semantic segmentation on NYUv2. Given that the input images and the frozen backbone remain constant, this controlled setup ensures that divergent layer-wise peak performances are driven by downstream task affinities. While this section primarily focuses on DINOv2, we extend this layer-wise analysis to MAE and iBOT. We observe a similar yet distinct trend: across all models, surface normal estimation consistently peaks in the earlier layers. However, the performance peaks for depth estimation and semantic segmentation do not exhibit a sharp demarcation. Detailed results and comprehensive comparisons are provided in the Supplementary Material.
As illustrated in 7, the performance trajectories normalized against each task’s layer-wise peak reveal a sequential transition between different tasks. Intermediate layers exhibit a strong affinity for local geometric features, with surface normal estimation peaking at layer 18, while depth estimation maintains structural accuracy longer and peaks at layer 21. This attenuation of explicit geometry is consistent with a steady improvement in semantic segmentation, which reaches its maximum at layer 24. Qualitative visualizations (6) support this observation, showing that explicit geometric signals from intermediate layers are replaced by abstract representations in the terminal stages. This variation in task affinity suggests that relying solely on a terminal feature readout for multi-task dense prediction is sub-optimal, highlighting the need for depth-aware feature routing.
To rule out optimization artifacts, we evaluate the subspace similarity of the extracted bases (\(\mathbf{V}_k\)) across three random probe initializations. 8 reveals high consistency (, \(>0.93\) for DINOv2) at low ranks(\(k \le 16\)), suggesting that the geometric core is a stable structural property rather than an optimization byproduct. Conversely, the low similarity in the tail dimensions (\(k \ge 64\)) indicates a lack of stable geometric signals, making these bases highly susceptible to random initialization. It aligns with the low-rank compressibility shown in 2. Detailed stability metrics are provided in the Supplementary Material.
Self-supervised ViT models naturally learn robust semantic and geometric representations that transfer effectively to dense prediction tasks [5], [6], [23], [31], [32]. While the broader advantages and limitations of these learning mechanisms have been systematically reviewed [33], standard probing efforts predominantly evaluate these models from a macroscopic perspective. For instance, recent studies confirm DINOv2’s excellence in 2.5D view-centric geometry while revealing limitations in multi-view reasoning [13], [16], [34]. Crucially, these performance-driven evaluations treat the feature manifold as a black box, leaving the underlying organization of geometric primitives unexplained.
To address this limitation, recent research has shifted toward mechanistic interpretability. It is now established that visual concepts and spatial reasoning are not merely diffuse patterns but can be isolated into specific linear directions, attention heads [35], or dissected via overcomplete dictionary learning [36]. Our work extends this trajectory through controlled subspace intervention, directly isolating low-rank coordinate systems that encode explicit geometry.
The manifold hypothesis posits that high-dimensional visual data inherently resides on low-dimensional submanifolds [37], [38]. Empirical evidence confirms that highly parameterized pre-trained models exhibit remarkably low intrinsic dimensionality, yielding generalization bounds independent of their total parameter count [39], [40]. This pervasive low-rank bias in deep networks causes increasing depth to drive representational compression, strictly bounding the number of non-negligible singular values [41], [42]. In deep discriminative models, within-class variability of terminal-layer training activations collapses toward zero [43]. Specifically, Vision Transformers can experience exponential rank collapse within attention mechanisms, driving tokens toward a uniform state [44].
Crucially, self-supervised learning (SSL) objectives govern the topology of these low-rank manifolds. Contrastive and self-distillation frameworks explicitly constrain representations onto a low-dimensional, hard-shell hyperspherical manifold [45], effectively prioritizing invariant semantic concept extraction at the cost of spatial rigidity. In contrast, MAEs must preserve high-dimensional variance and high-frequency geometric primitives to satisfy dense pixel-level reconstruction constraints [11], [46]. Hybrid approaches combine these paradigms to balance global instance discriminability with fine-grained local awareness [12], [47]. Our analysis bridges these observations, revealing how distinct pre-training objectives dictate feature encoding formats and govern the layer-wise routing of explicit geometry and semantic abstraction.
This study explores the evolution of geometric representations in self-supervised vision models. Through targeted subspace intervention, we find that models like DINOv2 align geometric primitives into highly compressible, low-rank formats, whereas MAE disperses these signals across broader dimensions. Furthermore, the layer-wise analysis reveals a task affinity within deep representation spaces. We show that the decline of explicit geometric capacity in terminal layers is consistent with the emergence of peak semantic abstraction. By connecting these layer-wise representational shifts with downstream decoding complexity, our findings clarify the limitations of relying exclusively on terminal features for dense prediction. These findings provide a useful foundation for feature routing, more effective feature selection, and lightweight decoder design.
While our linear intervention rigorously isolates explicit geometric structures, it struggles to unroll highly non-linear feature entanglements. Furthermore, strict in-domain evaluation requires datasets with perfectly aligned depth, normals, and semantics. The scarcity of such comprehensive data limits broader outdoor or cross-domain validation. Additionally, due to resource constraints, we could not evaluate larger-scale models like ViT-G. Future work will explore non-linear topological interventions and synthetic multi-modal datasets to address these constraints.
This work was supported by JST CREST, Japan, under Grant Number JPMJCR2554, and by JSPS KAKENHI under Grant Number JP26K02785.
Corresponding author.↩︎