Liquid Fusion of Heterogeneous Representations Towards General Salient Object Detection


Abstract

General Salient Object Detection (SOD) aims to identify and segment visually interesting objects from uni-modality or multi-modality scenes, recently advanced by cutting-edge State Space Models (SSMs). However, a critical limitation of current approaches is their neglect of the inherent spectral biases exhibited by different neural network paradigms. By digging to the dataset-level spectral analysis of Convolutional Neural Networks (CNNs) and SSMs, their semantic representations are inherently complementary based on their complementary frequency preferences. Inspired by this, we harmonize heterogeneous representations from SSMs and CNNs to bridge their spectral biases for general salient object detection. To this end, inspired by the dynamic information propagation of Liquid Neural Networks (LNNs), we introduce a liquid fusion to dynamically integrates features from two backbones, including VMamba and ConvNeXt, referred to Liquid Fusion Network (LFNet). Concretely, by treating the continuous VMamba features and ConvNeXt features as evolving states and exogenous stimulus, respectively, LFNetemploys a dynamic gating mechanism for content-aware feature aggregation. Crucially, this state-stimulus paradigm enables to scale to multi-modal cues, resulting in flexibility in general SOD. Besides, a Saliency-Guided Upsampling (SGU) operator to propagate the features to the shallow layer, which leverages a spectral-spatial co-design to suppress upsampling artifacts while preserving semantics. Extensive experiments across five diverse tasks (RGB, RGB-D, RGB-T, VSOD, and VDT) demonstrate that LFNetachieves state-of-the-art performance, offering a superior trade-off between detection accuracy and model efficiency. Code has been released at https://github.com/cke520/LFNet.

1 Introduction↩︎

Salient object detection, commonly referred to as SOD, is a fundamental computer vision task dedicated to identifying and precisely segmenting the most visually prominent objects within a scene. By effectively filtering out background clutter, this technique serves as an indispensable preliminary step for a multitude of downstream applications, including visual tracking [1], image editing [2], scene understanding [3], [4], autonomous driving [5], [6], and robotic navigation [7].

A robust SOD model must construct comprehensive representations that satisfy two competing requirements: capturing broad semantic contexts for object localization and preserving fine-grained structural details for precise boundary delineation. Recently, the field has progressed toward general SOD [8], [9], an ambitious framework encompassing single-modal RGB [10], [11], dual-modal RGB-D/T [12], [13] and Video SOD (VSOD) [14], [15], as well as tri-modal Visible-Depth-Thermal (VDT) tasks [5], [16]. While Transformer-based methods [9], [17], [18] established strong baselines, their quadratic complexity limits efficiency. Consequently, State Space Models [19] (SSMs) like Mamba [20] have emerged as compelling alternatives. Notably, Samba [8] successfully adapted SSMs to general SOD, achieving state-of-the-art results by constructing efficient long-range dependencies with linear computational complexity.

Figure 1: Spectral response and multi-task performance. (a) Normalized frequency amplitude curves averaged over five representative datasets, i.e., PASCAL-S [21], NJUD [22], VT5000 [23], DAVIS [24], and VDT-2048 [25]. The intersecting patterns show that ConvNeXt (red) and VMamba (blue) have different energy preferences across frequency bands, necessitating their fusion for balanced full-spectrum perception. (b) Performance comparison (S_m) across five general SOD tasks, demonstrating our superior performance.

From a signal processing perspective, the fundamental nature of SOD demands robust representations across the entire frequency spectrum. Current SSM-based approaches predominantly rely on engineering increasingly intricate spatial scanning strategies (e.g., cross-shaped or continuous paths) to force a single architecture to capture all necessary multi-scale contexts. However, we argue that this direction overlooks the inherent architectural biases dictated by different neural processing mechanisms. To investigate this, we conduct a cross-dataset spectral analysis over representative benchmarks covering RGB, RGB-D, RGB-T, VSOD, and VDT SOD. Specifically, we extract hierarchical features across four scaling stages from a lightweight Convolutional Neural Network [26] (ConvNeXt-Pico [27]) and an SSM network [19] (VMamba-Small [28]), applying 2D Fast Fourier Transform (FFT [29]) to compute their radial frequency profiles.

As explicitly demonstrated in Fig. 1 (a), the spectral energy distributions of CNNs and SSMs exhibit distinct divergence and intersection patterns across different scaling stages (e.g., stage 1 and stage 3). This observed structural heterogeneity reveals that CNNs and SSMs encode spatial information in fundamentally different ways, exhibiting distinct spectral signatures. This factual spectral divergence mathematically proves that their representations are inherently complementary, and relying solely on a single paradigm inevitably creates representational blind spots.

Inspired by this natural complementarity, we harmonize heterogeneous representations from SSMs and CNNs to bridge their spectral biases for general salient object detection. To this end, inspired by the continuous-time dynamics of Liquid Neural Networks (LNNs) [30], [31], we recast them to a liquid fusion that dynamically integrate features from two backbones, including VMamba and ConvNeXt, which is referred to Liquid Fusion Network (LFNet). Concretely, by treating the continuous VMamba features and ConvNeXt features as evolving states and exogenous stimulus, respectively, LFNet employs a dynamic gating mechanism for content-aware feature aggregation. Crucially, this state-stimulus paradigm enables to scale to multi-modal cues. This ensures flexibility in general SOD beyond RGB SOD, including RGB-D SOD, RGB-T SOD, VSOD, and VDT SOD.

Besides, a Saliency-Guided Upsampling (SGU) operator to propagate the features to the shallow layer, which leverages a spectral-spatial co-design to suppress upsampling artifacts while preserving semantics. As evidenced by the quantitative comparisons in Fig. 1 (b), LFNetyields superior accuracy across diverse general SOD tasks.

In summary, our main contributions are four-fold:

  • We propose LFNet, a novel general SOD framework that harmonizes heterogeneous representations from SSMs and CNNs to bridge their inherent spectral biases.

  • We design a liquid fusion based on a continuous state-stimulus mechanism to dynamically aggregate heterogeneous features, serving as a highly scalable solution for multi-modal fusion.

  • We develop a saliency-guided upsampling operator, which utilizes a dual-branch spectral-spatial design to effectively propagate semantics during resolution restoration.

  • Extensive experiments demonstrate that LFNetachieves state-of-the-art performance across five diverse general SOD tasks.

2 Related Work↩︎

2.1 Salient Object Detection↩︎

To address complex real-world scenarios, Salient Object Detection (SOD) has evolved from single-image processing to a diverse set of tasks, encompassing single-modal RGB, dual-modal RGB-D/T, Video SOD (VSOD), and tri-modal Visible-Depth-Thermal (VDT) SOD.

RGB SOD. Early RGB SOD research was predominantly driven by CNN-based architectures [11], [32][34], which struggle with long-range global dependency modeling due to limited receptive fields. While recent Transformer-based approaches [9], [10], [17], [18] alleviate this by leveraging self-attention, their inherent quadratic computational complexity remains a critical bottleneck for high-resolution dense prediction tasks.

RGB-D and RGB-T SOD. To resolve visual ambiguities in challenging scenes, auxiliary modalities like depth (RGB-D [35], [36]) or thermal radiation (RGB-T [37], [38]) are introduced. While effective, fusing these heterogeneous cues via intricate cross-modal attention [39] or dynamic guidance networks [13] often incurs significant computational overhead compared to rudimentary concatenation, highlighting the demand for more elegant integration mechanisms.

Video SOD (VSOD). VSOD extends detection into the temporal domain [15], [40], necessitating the joint modeling of spatial appearance and motion coherence. Existing approaches typically rely on precomputed optical flow or heavy spatiotemporal attention to capture inter-frame dependencies [14], [41], [42]. Unfortunately, both paradigms suffer from high latency and computational redundancy, highlighting the critical need for highly efficient spatiotemporal modeling.

VDT SOD. Addressing extreme scenarios, VDT SOD leverages the synergy of visible, depth, and thermal modalities for robust detection. However, simultaneously aligning and fusing three heterogeneous inputs drastically increases model complexity [5], [43], typically sacrificing inference speed for accuracy. Ultimately, as the field progresses toward a general SOD framework, developing a scalable architecture that seamlessly handles single, dual, and tri-modal inputs—without suffering from quadratic computational costs—has become a pressing necessity.

2.2 State Space Models↩︎

Motivated by the success of sequence modeling in natural language processing, State Space Models (SSMs) have emerged as highly efficient alternatives to Transformers, achieving global receptive fields with linear computational complexity through hardware-aware selective scanning. Pioneering this shift, Vim [44] successfully adapted bidirectional SSMs for visual tasks, while subsequent architectures like VMamba [28] introduced refined visual state space blocks to enhance feature extraction across various domains, including semantic segmentation [45], object detection [46], and video understanding [47]. Within the specific domain of Salient Object Detection (SOD), Samba [8] pioneered the integration of SSMs to construct efficient contexts. To overcome the inherent 1D nature of SSMs when processing 2D visual data, a predominant trend involves engineering increasingly intricate scanning strategies, such as multi-directional diagonal paths [48], continuous 2D sequences [49], or Nested S-shaped Scanning (NSS) [50]. Despite these innovations, we argue that relying solely on increasingly complex scanning routes to force a single architecture to capture both broad semantics and fine-grained local textures often introduces significant architectural redundancy and optimization challenges. As revealed by our spectral analysis, pure SSMs suffer from inherent spectral biases that constrain their ability to represent high-frequency spatial features. This structural limitation highlights the fundamental difficulty of achieving comprehensive full-spectrum perception within a purely homogeneous SSM framework, thereby motivating our proposed heterogeneous hybrid paradigm that harmonizes SSMs with CNN-based local feature extraction.

2.3 Liquid Neural Networks↩︎

Liquid Neural Networks (LNNs) are continuous-time recurrent models governed by Liquid Time-Constant (LTC) dynamics [30]. Unlike traditional networks with fixed weights, LNNs offer highly expressive, input-dependent temporal adaptation [51]. Initially bottlenecked by numerical ODE solvers, the practical application of LNNs was revitalized by the Closed-form Continuous-time (CfC) network [31], which introduced a highly efficient analytical approximation. This breakthrough has propelled LNNs into diverse sequential and multimodal applications, including robotic control [52] and edge computing [53]. In this paper, we recognize that the continuous-time dynamics of LNNs perfectly align with the challenge of fusing heterogeneous spatial features. By adapting the LNN philosophy into our proposed Liquid Fusion Module (LFM), we move beyond static element-wise addition, treating global SSM representations and local CNN features as an evolving dynamic system. To the best of our knowledge, this work represents the first attempt to leverage liquid dynamics for constructing a cross-paradigm heterogeneous fusion framework in dense visual prediction tasks, such as general SOD.

3 Methodology↩︎

3.1 Preliminaries↩︎

Liquid Neural Networks and Closed-Form Dynamics. Unlike traditional recurrent models with fixed discrete dynamics, Liquid Neural Networks (LNNs) [30] exhibit continuous, input-dependent temporal behavior. The hidden state \(\mathbf{x}(t)\) evolves under an exogenous input \(\mathbf{I}(t)\) via a liquid time-constant (LTC) Ordinary Differential Equation (ODE): \[\frac{d\mathbf{x}(t)}{dt} = - \left[ w_\tau + f(\mathbf{x}, \mathbf{I}; \theta) \right] \odot \mathbf{x}(t) + A \odot f(\mathbf{x}, \mathbf{I}; \theta), \label{eq:ltc95ode}\tag{1}\] where \(w_\tau\) represents the base time constant and \(f(\cdot)\) denotes a nonlinearity. To bypass the computational bottleneck of stiff numerical solvers, Closed-form Continuous-depth (CfC) models [31] derive a bounded closed-form solution. Crucially, to mitigate vanishing gradients associated with exponential decay, CfC replaces the decay term with a learnable sigmoidal gate \(\sigma(\cdot)\), effectively functioning as a dynamic interpolation mechanism.

Inspired by this continuous-time gating mechanism [31], we translate the temporal dynamics into the spatial domain. We formulate our Liquid Fusion dynamic as a weighted equilibrium between the evolving memory state (derived from the continuous SSM stream \(\mathbf{h}\)) and the synaptic stimulus (derived from the static CNN stream \(\tilde{\mathbf{l}}\)), defined as: \[\mathbf{x}_{out} = (1 - \sigma) \odot \mathbf{h} + \sigma \odot \tilde{\mathbf{l}}, \label{eq:liquid95fusion95theory}\tag{2}\] where the dynamic permeability \(\sigma \in (0, 1)\) regulates the injection of exogenous stimuli. In this context, high permeability (\(\sigma \to 1\)) facilitates rapid stimulus integration, while low permeability (\(\sigma \to 0\)) prioritizes the preservation of the inherent memory state.

Figure 2: Overall architecture of the proposed LFNet. Given varying input modalities, parallel VMamba and ConvNeXt backbones extract heterogeneous features, which are then harmonized by Modality Fusion Blocks (MFB) and progressively aggregated through a top-down decoder using Liquid Fusion Modules (LFMs) and Saliency-Guided Upsampling (SGU) operators with multi-scale supervision.

3.2 Overview↩︎

Inspired by the distinct yet complementary frequency preferences observed between VMamba and ConvNeXt, we propose LFNetto harmonize these heterogeneous representations for general SOD. As illustrated in Fig. 2, our Heterogeneous Hybrid Encoder extracts representations across four hierarchical stages: a VMamba stream captures continuous sequence-based semantics, while a parallel ConvNeXt stream preserves grid-based spatial inductive biases. To seamlessly integrate these heterogeneous cues, our decoder employs the novel Liquid Fusion Module (LFM), an LNN-inspired gated fusion module, for content-aware dynamic feature aggregation. Finally, the Saliency-Guided Upsampling (SGU) module progressively reconstructs high-resolution predictions, utilizing a spectral-spatial co-design to propagate semantics to shallow layers during resolution restoration.

3.3 Heterogeneous Hybrid Encoder and Modality Fusion↩︎

To leverage the structural heterogeneity revealed in our spectral analysis, we construct a Heterogeneous Hybrid Encoder integrating two distinct backbones. We employ a pre-trained VMamba-Small [28] to generate continuous state-space representations with linear complexity, yielding features \(\mathbf{f}^v_i \in \mathbb{R}^{C_i \times H_i \times W_i}\) at stages \(i \in \{1, 2, 3, 4\}\). Complementing this, a parallel ConvNeXt-Pico [27] stream introduces a distinct architectural inductive bias, ensuring the capture of comprehensive spectral cues without relying on complex scanning engineering. To handle diverse inputs, a Modality Fusion Block (MFB) within the ConvNeXt stream generates task-adapted features \(\mathbf{f}^c_i\). The MFB applies a \(1\times1\) projection for single-modal RGB inputs, uses a single LFM for dual-modal tasks (RGB-D/T, VSOD), and employs a cascaded LFM structure for tri-modal VDT scenarios, effectively absorbing auxiliary cues without the quadratic cost of cross-attention.

Figure 3: Detailed architecture of the Liquid Fusion Module (LFM).

3.4 Liquid Fusion Module↩︎

Inspired by the dynamic equilibrium of Liquid Neural Networks [31], our LFM (detailed in Fig. 3) reformulates heterogeneous feature integration as a state-stimulus interaction process. We treat the VMamba feature \(\mathbf{f}^v_i\) as an evolving memory state and the ConvNeXt feature \(\mathbf{f}^c_i\) as an exogenous stimulus. Initially, the VMamba state is projected into an embedding \(\tilde{\mathbf{f}}^v_i\) via sequential \(1\times1\) and \(3\times3\) convolutions.

Adaptive Channel Modulation. To adaptively filter task-irrelevant details, we modulate the ConvNeXt stimulus using a channel attention map derived from the VMamba state. This modulation is mathematically expressed as: \[\tilde{\mathbf{f}}^c_i = \textit{Conv}_{1\times1}(\mathbf{f}^c_i) \odot \sigma \left( \mathcal{M}(\textit{AvgP}(\tilde{\mathbf{f}}^v_i)) + \mathcal{M}(\textit{MaxP}(\tilde{\mathbf{f}}^v_i)) \right),\] where \(\mathcal{M}\) denotes a shared Multi-Layer Perceptron (MLP), \(\textit{AvgP}\) and \(\textit{MaxP}\) represent spatial average and max pooling operations respectively, and \(\sigma\) designates the Sigmoid activation function.

Dynamic Spatial Gating. To achieve a dynamic balance between memory retention and stimulus injection, we first compute a spatial liquid gate \(\mathbf{G}_i\) based on the concatenated features \([\tilde{\mathbf{f}}^v_i, \tilde{\mathbf{f}}^c_i]\), calculated as: \[\mathbf{G}_i = \sigma \left( \textit{Conv}_{1\times1} \left( \textit{Conv}_{3\times3} ( [\tilde{\mathbf{f}}^v_i, \tilde{\mathbf{f}}^c_i] ) \right) \right).\] Leveraging the theoretical foundation established in Eq. 2 , we materialize the fusion process as a closed-form dynamic selection mechanism: \[\mathbf{f}_i = \textit{Conv}_{3\times3} \left( (1 - \mathbf{G}_i) \odot \tilde{\mathbf{f}}^v_i + \mathbf{G}_i \odot \tilde{\mathbf{f}}^c_i \right).\] Here, \(\mathbf{G}_i\) serves as the dynamic permeability parameter (analogous to \(\sigma\) in Eq. 2 ). Consequently, as \(\mathbf{G}_i \to 1\), the network prioritizes the injection of grid-based spatial cues from ConvNeXt (stimulus); conversely, as \(\mathbf{G}_i \to 0\), it prioritizes retaining the sequence-based context from VMamba (memory). This adaptive mechanism effectively reconciles the distinct architectural biases of the two streams.

Figure 4: Detailed architecture of the Saliency-Guided Upsampling (SGU).

3.5 Saliency-Guided Upsampling (SGU)↩︎

Standard bilinear upsampling often leads to spectral aliasing and blurred object boundaries. To preserve sharp details for SOD, our SGU module (illustrated in Fig. 4) employs a dual-branch design to enforce consistency in both spatial and frequency domains.

Spectral-Spatial Co-Design. We first upscale the fused feature \(\mathbf{f}_i\) via \(2\times\) interpolation to yield the intermediate feature \(\mathbf{f}'_i\). To preserve global shape integrity, the spectral branch transforms \(\mathbf{f}'_i\) via Fast Fourier Transform (FFT) and modulates the spectrum with a learnable complex weight matrix \(\mathbf{w}_i\), formulated as: \[\mathbf{F}^{spec}_i = \textit{IFFT} \left( \textit{FFT}(\mathbf{f}'_i) \odot \mathbf{w}_i \right),\] where \(\textit{IFFT}\) denotes the Inverse FFT. Concurrently, the spatial branch captures high-frequency edge cues via two stacked \(3\times3\) convolutions to generate the spatial representation \(\mathbf{F}^{spat}_i\).

Dual-Domain Fusion. The final reconstructed feature \(\mathbf{f}^{u}_i\) integrates both domains alongside a residual connection, derived as: \[\mathbf{f}^{u}_i = \textit{Conv}_{3\times3}\left( [\mathbf{F}^{spec}_i, \mathbf{F}^{spat}_i] \right) + \textit{Conv}_{1\times1}(\mathbf{f}'_i).\] By synergizing spatial precision with spectral consistency, SGU ensures that the decoding phase restores sharp boundaries without suffering from structural degradation.

3.6 Loss Function↩︎

To facilitate robust feature learning, we employ a deep supervision strategy. The total loss \(\mathcal{L}_{total}\) is defined as a weighted combination of the Binary Cross Entropy (BCE) loss and the Intersection-over-Union (IoU) loss, applied to predictions at all scales: \[\mathcal{L}_{total} = \sum_{k=1}^{4} \left( \mathcal{L}_{bce}(\mathbf{O}_k, \mathbf{GT}) + \mathcal{L}_{iou}(\mathbf{O}_k, \mathbf{GT}) \right),\] where \(\mathbf{O}_k\) represents the prediction map at stage \(k\) and \(\mathbf{GT}\) denotes the ground truth. This multi-scale supervision ensures that the model learns discriminative features progressively from coarse to fine levels.

4 Experiments and Results↩︎

4.1 Datasets and Metrics↩︎

To comprehensively evaluate the proposed LFNet, we conduct extensive experiments across five distinct tasks: RGB SOD, RGB-D SOD, RGB-T SOD, VSOD, and VDT SOD. For the RGB SOD task, we utilize five standard benchmark datasets: DUTS [54], DUT-O [55], HKU-IS [56], PASCAL-S [21], and ECSSD [57]. For RGB-D SOD, the evaluation is performed on NJUD [22], NLPR [58], SIP [59], STERE [60], and DUTLF-D [61]. Regarding RGB-T SOD, three benchmarks are employed: VT821 [62], VT1000 [63], and VT5000 [23]. For VSOD, we use DAVIS [24], DAVSOD-easy [64], FBMS [65], SegV2 [66], and VOS [67]. Lastly, for VDT SOD, we employ the VDT-2048 [25] benchmark dataset.

To quantitatively assess the model performance, we adopt three widely used saliency metrics: structure-measure (\(S_m\)), maximum F-measure (\(F_m\)), and maximum enhanced-alignment measure (\(E_m\)). Furthermore, to evaluate the model size and computational complexity, we report the total number of parameters (Params).

4.2 Implementation Details↩︎

The proposed LFNetis implemented in PyTorch and trained on a single NVIDIA RTX 4090 D GPU. Following standard protocols, we utilize established training splits for all five tasks, rigorously removing duplicate samples in joint datasets to prevent data leakage. During training, all input images are resized to \(512 \times 512\) and augmented using random flipping, cropping, and rotation. The model is optimized for 50 epochs with a batch size of 2 using the AdamW optimizer. The base learning rate is initialized at \(1 \times 10^{-4}\) with a weight decay of 0.05, while the pre-trained backbone networks use only five percent of this rate to preserve representational integrity. We apply a five-epoch linear warmup followed by a cosine annealing decay schedule. To enhance training efficiency and prevent gradient explosion, Automatic Mixed Precision (AMP) and gradient clipping (with a maximum norm threshold of 0.5) are integrated. The optimal model weights are selected based on the highest S-measure achieved on the validation set.

Table 1: Quantitative comparison of our against other SOTA RGB SOD methods on five benchmark datasets. “-” indicates the result is not available. “\(\uparrow\)” denotes larger is better. All metric values are in %. The best two results are highlighted in and .
Method Params DUTS [54] DUT-O [55] HKU-IS [56] PASCAL-S [21] ECSSD [57]
3-5 (lr)6-8 (lr)9-11 (lr)12-14 (lr)15-17 (M) \(S_m \uparrow\) \(F_m \uparrow\) \(E_m \uparrow\) \(S_m \uparrow\) \(F_m \uparrow\) \(E_m \uparrow\) \(S_m \uparrow\) \(F_m \uparrow\) \(E_m \uparrow\) \(S_m \uparrow\) \(F_m \uparrow\) \(E_m \uparrow\) \(S_m \uparrow\) \(F_m \uparrow\) \(E_m \uparrow\)
CSF-R2 [33] 36.53 89.0 86.9 92.9 83.8 77.5 86.9 - - - 86.3 83.9 88.5 93.1 94.2 96.0
EDN [11] 42.85 89.2 89.3 93.3 84.9 82.1 88.4 92.4 94.0 96.3 86.4 87.9 90.7 92.7 95.0 95.7
ICON-R [10] 33.09 89.0 87.6 93.1 84.5 79.9 88.4 92.0 93.1 96.0 86.2 84.4 88.8 92.8 94.3 96.0
MENet [34] 27.83 90.5 89.5 94.3 85.0 79.2 87.9 92.7 93.9 96.5 87.1 84.8 89.2 92.7 93.8 95.6
ICON-S [10] 94.30 91.7 91.1 96.0 86.9 83.0 90.6 93.6 94.7 97.4 88.5 86.0 90.3 94.1 95.4 97.1
BBRF [68] 74.40 90.8 90.5 95.1 85.5 82.0 89.8 93.5 94.6 93.6 87.1 88.4 92.5 93.9 95.7 97.2
VST-S ++ [18] 74.90 90.9 89.7 94.7 85.9 81.3 89.0 93.2 94.1 96.9 88.0 85.9 90.1 93.9 95.1 96.9
VSCode-S [9] 74.72 92.6 92.2 96.0 87.7 84.0 91.2 94.0 95.1 97.4 88.7 86.4 90.4 94.9 95.9 97.4
Samba [8] 49.59
Ours 43.23

2.5pt

Table 2: Quantitative comparison of our against other SOTA RGB-D SOD methods on five benchmark datasets.
Method Params NJUD [22] NLPR [58] SIP [59] STERE [60] DUTLF-D [61]
3-5 (lr)6-8 (lr)9-11 (lr)12-14 (lr)15-17  (M) \(S_m \uparrow\) \(F_m \uparrow\) \(E_m \uparrow\) \(S_m \uparrow\) \(F_m \uparrow\) \(E_m \uparrow\) \(S_m \uparrow\) \(F_m \uparrow\) \(E_m \uparrow\) \(S_m \uparrow\) \(F_m \uparrow\) \(E_m \uparrow\) \(S_m \uparrow\) \(F_m \uparrow\) \(E_m \uparrow\)
JL-DCF [69]  143.52 87.7 89.2 94.1 93.1 91.8 96.5 88.5 89.4 93.1 90.0 89.5 94.2 89.4 89.1 92.7
SP-Net [70]  67.88  92.5 92.8 95.7 92.7 91.9 96.2 89.4 90.4 93.3 90.7 90.6 94.9 89.5 89.9 93.3
DCF [71]      53.92  90.4 90.5 94.3 92.2 91.0 95.7 87.4 88.6 92.2 90.6 90.4 94.8 92.5 93.0 95.6
SPSN [72]    91.8 92.1 95.2 92.3 91.2 96.0 89.2 90.0 93.6 90.7 90.2 94.5 - - -
CATNet [35] 262.73 93.2 93.7 96.0 93.8 93.4 97.1 91.0 92.8 95.1 92.0 92.2 95.8 95.2 95.8 97.5
VST-S ++ [18]  143.15 92.8 92.8 95.7 93.5 92.5 96.4 90.4 91.8 94.6 92.1 91.6 95.4 94.5 95.0 96.9
CPNet [36] 216.50 93.5 94.1 96.3 94.0 93.6 97.1 90.7 92.7 94.6 92.0 92.2 96.0 95.1 95.9 97.4
VSCode-S [9]  74.72 94.4 94.9 97.0 94.1 93.2 96.8 92.4 94.2 95.8 93.1 92.8 95.8
Samba [8]      54.94  95.6 96.4 97.6
Ours 44.65

2.5pt

2.5pt

l | c | cccc | cccc | >cc >cc & & &
(lr)3-6 (lr)7-10 (lr)11-12 & & & & & & & & & & Ours
& 87.09 & 87.04 & - & 104.03 & 143.15 & 74.72 & - & 96.31 & 54.94 & 44.65
& \(S_m \uparrow\) & 89.1 & 89.9 & 89.4 & 91.3 & 89.7 & 92.6 & 91.5 & 91.6 & &
& \(F_m \uparrow\) & 87.0 & 88.5 & 87.2 & 90.0 & 86.8 & 91.0 & 87.9 & 89.6 & &
& \(E_m \uparrow\) & 93.3 & 93.6 & 93.2 & 94.9 & 92.5 & 95.4 & 94.1 & 94.8 & &
& \(S_m \uparrow\) & 92.9 & 92.9 & 93.1 & 94.1 & 94.0 & 95.2 & 94.3 & 94.1 & &
& \(F_m \uparrow\) & 92.1 & 92.1 & 92.7 & 94.3 & 93.1 & & 92.4 & 93.9 & &
& \(E_m \uparrow\) & 96.5 & 96.5 & 96.6 & 97.5 & 97.1 & 98.1 & 95.8 & 97.6 & &
& \(S_m \uparrow\) & 88.4 & 89.5 & 89.6 & 91.4 & 90.1 & & 92.0 & 92.4 & &
& \(F_m \uparrow\) & 84.6 & 86.4 & 87.7 & 90.5 & 86.1 & 90.0 & 89.9 & 91.8 & &
& \(E_m \uparrow\) & 93.0 & 93.6 & 93.9 & 95.4 & 93.6 & 95.9 & 95.6 & & &

Table 3: Quantitative comparison of our against other SOTA VSOD methods on five benchmark datasets.
Method Params DAVIS [24] DAVSOD-easy [64] FBMS [65] SegV2 [66] VOS [67]
3-5 (lr)6-8 (lr)9-11 (lr)12-14 (lr)15-17  (M) \(S_m \uparrow\) \(F_m \uparrow\) \(E_m \uparrow\) \(S_m \uparrow\) \(F_m \uparrow\) \(E_m \uparrow\) \(S_m \uparrow\) \(F_m \uparrow\) \(E_m \uparrow\) \(S_m \uparrow\) \(F_m \uparrow\) \(E_m \uparrow\) \(S_m \uparrow\) \(F_m \uparrow\) \(E_m \uparrow\)
FSNet [40] 83.41 92.2 90.9 97.2 76.0 63.7 79.6 87.5 86.7 91.8 84.9 77.3 92.0 67.8 62.1 75.5
DCFNet [73] 69.56 91.4 89.9 97.0 72.9 61.2 78.1 88.3 85.3 91.0 90.3 87.0 95.3 83.8 77.3 86.1
UGPL [15] 91.1 89.5 96.8 73.2 60.2 77.1 89.7 88.4 93.9 86.7 82.8 93.8 75.1 68.5 81.1
MMNet [41] 50.81 89.6 87.7 96.3 74.8 63.6 79.7 88.3 86.5 92.1 90.3 88.3 95.5 - - -
MGTNet [74]    150.91 92.5 91.9 97.6 76.5 65.3 80.0 90.0 88.1 92.9 90.3 86.1 94.6 81.4 72.7 81.9
UFO [14]        55.92 91.8 90.6 97.8 74.7 62.6 79.9 85.8 86.8 91.1 88.8 85.0 95.1 -
CoSTFormer [42] 92.3 90.6 97.8 77.9 66.7 81.9 86.9 86.1 91.3 87.4 81.3 94.3 79.1 70.8 81.1
VSCode-S [9] 74.72  93.6 92.2 97.3 80.0 71.0 83.5 90.5 90.2 93.9 93.7 98.4 - - -
Samba [8]      54.94  94.3
Ours 44.65

2.5pt

2.5pt

l | c | cc | cc | cccc | >cc >cc & & & &
(lr)3-4 (lr)5-6 (lr)7-10 (lr)11-12 & & & & & & & & & & Ours
& 92.39 & 124.72 & 4.57 & - & - & 103.24 & - & - & 60.28 & 46.07
& \(S_m \uparrow\) & 81.8 & 91.9 & 88.8 & 91.3 & 93.3 & 93.6 & & 93.2 & &
& \(F_m \uparrow\) & 45.9 & 72.9 & 74.3 & 85.4 & 89.7 & 90.1 & 90.1 & 91.0 & &
& \(E_m \uparrow\) & 68.6 & 89.6 & 92.0 & 97.7 & 98.9 & & & 98.8 & &

Figure 5: Visual comparison against SOTA methods on RGB and RGB-D SOD tasks. The top three rows show RGB scenarios, while the bottom three rows display RGB-D scenarios with corresponding depth maps.

4.3 Comparison with State-of-the-Art Methods↩︎

Quantitative Evaluation. Since LFNetis designed as a heterogeneous hybrid framework for general SOD, we conduct extensive comparative experiments against existing state-of-the-art (SOTA) methods across five distinct tasks: RGB SOD, RGB-D SOD, RGB-T SOD, VSOD, and VDT SOD. The comprehensive quantitative results are presented in Tables 12¿tbl:tab:rgbt95results?3, and ¿tbl:tab:vdt95results95comparison?. These comparisons demonstrate that LFNetconsistently outperforms leading CNN-based, Transformer-based, and Mamba-based competitors across all benchmark datasets, validating the superior efficacy of our proposed architecture.

Specifically, for the RGB SOD task (Table 1), our model achieves the best performance on nearly all metrics while maintaining a significantly lower parameter count compared to heavy Transformer-based methods. For instance, on the challenging DUTS dataset, LFNetsurpasses the heavy transformer ICON-S by 1.9% in \(S_m\) and 2.5% in \(F_m\), while using less than half of its parameters (43.23M vs. 94.30M). Even compared to the recent Mamba-based method Samba, our model achieves a consistent improvement of 0.4%–1.6% across five datasets, proving the advantage of our heterogeneous fusion over pure SSM modeling.

Regarding multi-modal tasks, including RGB-D SOD (Table 2) and RGB-T SOD (Table ¿tbl:tab:rgbt95results?), LFNetsets new state-of-the-art standards. In RGB-D SOD, our method outperforms the strong competitor VST-S++ by a large margin (e.g., +2.2% \(S_m\) on NJUD) with only 31% of its parameters (44.65M vs. 143.15M). Similarly, in RGB-T SOD, our method surpasses Samba on all three benchmarks, achieving a notable 0.7% \(S_m\) gain on the VT821 dataset.

Furthermore, in video-based tasks (VSOD and VDT), our model demonstrates exceptional temporal and multi-modal modeling capabilities. As shown in Table 3, LFNetachieves significant gains over VSCode-S on the DAVSOD-easy dataset (+3.1% \(S_m\), +5.2% \(F_m\)), highlighting its robustness in dynamic scenes. In the tri-modal VDT SOD task (Table ¿tbl:tab:vdt95results95comparison?), LFNetreaches an \(S_m\) of 94.2%, establishing the new state-of-the-art. Notably, compared to the strongest competitor Samba, LFNetnot only achieves superior segmentation accuracy across all five tasks but also benefits from a lower computational complexity. This indicates that our heterogeneous framework can effectively capture multi-modal and temporal saliency cues.

Qualitative Evaluation. To visually demonstrate the superiority of LFNet, we display qualitative comparisons in Fig. 5. In RGB scenarios (top three rows), our model excels in handling complex topologies and low-contrast objects. Specifically, in the \(1^{st}\) row, while competitors like Samba [8] and VST-S++ [18] fail to suppress the background gaps within the chair legs, LFNetcleanly delineates the object skeleton. In the \(2^{nd}\) row, it accurately segments the black cat against a dark background, and in the \(3^{rd}\) row, it recovers the complete boat structure despite severe internal occlusion, avoiding the fragmentation seen in ICON-R [10]. In RGB-D scenarios (bottom three rows), LFNeteffectively leverages depth cues to resolve visual ambiguities. For instance, in the \(4^{th}\) row, it distinguishes the statue from the complex building texture where others fail. Similarly, in the \(5^{th}\) and \(6^{th}\) rows, our method consistently produces sharp predictions for the toy animals and fountain statue, robustness against similar foreground-background colors and challenging lighting, outperforming depth-aware competitors like CPNet [36] and CATNet [35]. These results visually confirm that our heterogeneous hybrid paradigm effectively harmonizes global semantics with local details across diverse modalities. More extensive visual comparisons across diverse scenarios can be found in the Supplementary Material.

4.4 Ablation Study↩︎

To verify the contribution of each proposed component, we conduct thorough ablation studies across five representative datasets. As summarized in Table 4, our full architecture consistently outperforms all variants, validating the effectiveness of the heterogeneous hybrid design, the LFM, and the SGU operator.

Effectiveness of Architecture (Settings A). We evaluate the necessity of our heterogeneous hybrid design by comparing the full model with single-stream variants (A1, A2) and a naive dual-stream baseline (A3). The quantitative results demonstrate that relying solely on either the SSM-based stream (A1) or the CNN-based stream (A2) yields sub-optimal performance across all metrics. While the naive dual-stream baseline (A3) offers clear numerical improvements over both single streams by simply aggregating the two backbones, a noticeable performance gap persists compared to our full model. This confirms that the dual-stream architecture is inherently more effective than single streams, and our specific interaction design further maximizes their combined potential.

Effectiveness of Feature Fusion Strategy (Settings B). To validate our LFM, we replace it with standard operations: additive fusion (B1), simple concatenation (B2), and the widely-used cross-attention mechanism (B3). The metric comparisons consistently show that LFM achieves the highest scores across all five datasets. This numerical superiority indicates that our proposed dynamic fusion mechanism is a more effective strategy for aggregating heterogeneous features than conventional static fusion methods in dense prediction tasks.

Table 4: Ablation study of our on five datasets. All metric values are in %. Bolded results are the best.
Settings RGB SOD RGB-D SOD VDT
2-7 (lr)8-13 (lr)14-16 DUTS [54] DUT-O [55] NJUD [22] NLPR [58] VDT-2048 [25]
2-4 (lr)5-7 (lr)8-10 (lr)11-13 (lr)14-16 \(S_m \uparrow\) \(F_m \uparrow\) \(E_m \uparrow\) \(S_m \uparrow\) \(F_m \uparrow\) \(E_m \uparrow\) \(S_m \uparrow\) \(F_m \uparrow\) \(E_m \uparrow\) \(S_m \uparrow\) \(F_m \uparrow\) \(E_m \uparrow\) \(S_m \uparrow\) \(F_m \uparrow\) \(E_m \uparrow\)
Ours (Full) 93.6 93.6 97.0 90.4 88.4 93.8 95.0 95.8 97.8 94.9 94.3 97.7 94.2 91.9 99.2
A1: VMamba Only 92.0 91.7 96.4 89.5 87.1 93.6 94.3 94.7 97.3 94.2 93.5 97.4 91.4 87.4 97.9
A2: ConvNeXt Only 84.8 82.5 88.3 83.3 78.3 86.0 82.2 81.7 86.7 84.7 79.9 89.1 86.8 80.9 93.7
A3: Dual Stream Baseline 92.5 92.2 96.0 89.8 87.5 93.1 94.6 95.1 97.4 94.4 93.6 97.2 93.0 90.5 98.5
B1: Additive Fusion 92.7 92.6 96.1 89.9 87.8 93.2 94.7 95.3 97.5 94.5 93.8 97.3 93.5 90.9 98.7
B2: Concatenation 93.0 92.8 96.3 90.1 88.0 93.4 94.8 95.5 97.6 94.7 94.0 97.5 93.7 91.2 98.9
B3: Cross-Attention 93.2 93.1 96.7 90.2 88.1 93.5 94.7 95.3 97.5 94.7 94.0 97.4 94.0 91.6 99.0
C1: Bilinear 92.9 92.8 96.4 89.8 87.7 93.1 94.3 95.0 97.0 94.2 93.5 96.9 93.2 90.9 98.4
C2: Transposed Conv 93.2 93.1 96.7 90.1 88.0 93.4 94.6 95.4 97.4 94.6 93.9 97.3 93.5 91.3 98.7

2.5pt

Effectiveness of Upsampling Strategy (Settings C). The Saliency-Guided Upsampling (SGU) operator is designed to better propagate semantics across multi-level features during resolution restoration. Comparing SGU with standard bilinear interpolation (C1) and transposed convolution (C2), we observe consistent quantitative gains across all multi-modal tasks. These continuous metric improvements confirm that our specialized SGU effectively maintains semantic consistency during the upsampling process, leading to more accurate overall detection performance.

5 Conclusion↩︎

In this paper, we propose LFNet  a heterogeneous hybrid framework integrating VMamba and ConvNeXt for general SOD, designed to bridge the inherent spectral biases of single-paradigm networks. By revealing the complementary frequency preferences of VMamba and ConvNeXt, we developed a state-stimulus paradigm within the liquid fusion for dynamic feature aggregation. Complemented by the saliency-guided upsampling operator for effective feature propagation and boundary recovery, LFNetconsistently establishes new state-of-the-art benchmarks across five general SOD tasks. Future work will focus on extending this liquid fusion paradigm to broader dense prediction scenarios and optimizing the architecture for lightweight edge applications.

Acknowledgements↩︎

The paper was supported in part by the National Natural Science Foundation of China under Grant 62571068, 62306048; in part by Science and Technology Development Fund, Macao SAR (Grant No: 0054/2025/RIB2); in part by the Qing Lan Project of Jiangsu Universities; in part by the Major Program of Jiangsu Higher Education Institutions Basic Science (Natural Science) Research under Grant 25KJA520001; in part by Changzhou Applied Basic Research Fund Project under Grant CJ20242060, CQ20230092, CJ20235036.

References↩︎

[1]
Z. Zhou, W. Pei, X. Li, H. Wang, F. Zheng, and booktitle=Proceedings. of the I. international conference on computer vision He Zhenyu, “Saliency-associated object tracking,” 2021, pp. 9866–9875.
[2]
A. Hagiwara, A. Sugimoto, and booktitle=Proceedings. of the 1st. international workshop on pervasive eye tracking &. mobile eye interaction Kawamoto Kazuhiko, “Saliency-based image editing for guiding visual attention,” 2011, pp. 43–48.
[3]
A. Siris, J. Jiao, G. K. Tam, X. Xie, and booktitle=Proceedings. of the I. international conference on computer vision Lau Rynson WH, “Scene context-aware salient object detection,” 2021, pp. 4156–4166.
[4]
Y. Liu, Z. Xiong, Y. Yuan, and Q. Wang, “Transcending pixels: Boosting saliency detection via scene understanding from aerial imagery,” IEEE Transactions on Geoscience and Remote Sensing, vol. 61, pp. 1–16, 2023.
[5]
Y. Liu, C. Li, S. Xu, and J. Han, International Journal of Computer Vision, vol. 133, no. 7, pp. 4483–4503, 2025.
[6]
N. Ding, C. Zhang, and A. Eskandarian, “SalienDet: A saliency-based feature enhancement algorithm for object detection for autonomous driving,” IEEE Transactions on Intelligent Vehicles, vol. 9, no. 1, pp. 2624–2635, 2023.
[7]
R. Roberts, D.-N. Ta, J. Straub, K. Ok, and booktitle=Unmanned. S. T. X. Dellaert Frank, “Saliency detection and model-based tracking: A two part vision system for small robot navigation in forested environment,” 2012 , organization={SPIE}, vol. 8387, pp. 306–317.
[8]
J. He, K. Fu, X. Liu, and booktitle=Proceedings. of the C. V. and P. R. C. Zhao Qijun, “Samba: A unified mamba-based framework for general salient object detection,” 2025, pp. 25314–25324.
[9]
Z. Luo et al., “Vscode: General visual salient and camouflaged object detection with 2d prompt learning,” 2024, pp. 17169–17180.
[10]
M. Zhuge, D.-P. Fan, N. Liu, D. Zhang, D. Xu, and L. Shao, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 45, no. 3, pp. 3738–3752, 2022.
[11]
Y.-H. Wu, Y. Liu, L. Zhang, M.-M. Cheng, and B. Ren, IEEE Transactions on Image Processing, vol. 31, pp. 3125–3136, 2022.
[12]
Z. Liu, Y. Tan, Q. He, and Y. Xiao, “SwinNet: Swin transformer drives edge-aware RGB-d and RGB-t salient object detection,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 32, no. 7, pp. 4486–4497, 2021.
[13]
Z. Zhang, J. Wang, and booktitle=Proceedings. of the 31st. A. international conference on multimedia Han Yahong, “Saliency prototype for RGB-d and RGB-t salient object detection,” 2023, pp. 3696–3705.
[14]
Y. Su, J. Deng, R. Sun, G. Lin, H. Su, and Q. Wu, IEEE Transactions on Multimedia, vol. 26, pp. 313–325, 2023.
[15]
Y. Piao, C. Lu, M. Zhang, and H. Lu, Advances in neural information processing systems, vol. 35, pp. 5614–5627, 2022.
[16]
Y. Luo, F. Shao, B. Mu, H. Chen, Z. Li, and Q. Jiang, “Dynamic weighted fusion and progressive refinement network for visible-depth-thermal salient object detection,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 34, no. 11, pp. 10662–10677, 2024.
[17]
N. Liu, N. Zhang, K. Wan, L. Shao, and booktitle=Proceedings. of the I. international conference on computer vision Han Junwei, “Visual saliency transformer,” 2021, pp. 4722–4732.
[18]
N. Liu, Z. Luo, N. Zhang, and J. Han, “Vst++: Efficient and stronger visual saliency transformer,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 46, no. 11, pp. 7300–7316, 2024.
[19]
A. Gu, K. Goel, and C. Ré, arXiv preprint arXiv:2111.00396, 2021.
[20]
A. Gu and T. Dao, “Mamba: Linear-time sequence modeling with selective state spaces,” arXiv preprint arXiv:2312.00752, 2023.
[21]
Y. Li, X. Hou, C. Koch, J. M. Rehg, and booktitle=Proceedings. of the I. conference on computer vision and pattern recognition Yuille Alan L, “The secrets of salient object segmentation,” 2014, pp. 280–287.
[22]
R. Ju, L. Ge, W. Geng, T. Ren, and booktitle=2014. I. international conference on image processing (ICIP). Wu Gangshan, “Depth saliency based on anisotropic center-surround difference,” 2014 , organization={IEEE}, pp. 1115–1119.
[23]
Z. Tu, Y. Ma, Z. Li, C. Li, J. Xu, and Y. Liu, “RGBT salient object detection: A large-scale dataset and benchmark,” IEEE Transactions on Multimedia, vol. 25, pp. 4163–4176, 2022.
[24]
F. Perazzi, J. Pont-Tuset, B. McWilliams, L. Van Gool, M. Gross, and booktitle=Proceedings. of the I. conference on computer vision and pattern recognition Sorkine-Hornung Alexander, “A benchmark dataset and evaluation methodology for video object segmentation,” 2016, pp. 724–732.
[25]
K. Song, J. Wang, Y. Bao, L. Huang, and Y. Yan, “A novel visible-depth-thermal image dataset of salient object detection for robotic visual perception,” IEEE/ASME Transactions on Mechatronics, vol. 28, no. 3, pp. 1558–1569, 2022.
[26]
K. He, X. Zhang, S. Ren, and booktitle=Proceedings. of the I. conference on computer vision and pattern recognition Sun Jian, “Deep residual learning for image recognition,” 2016, pp. 770–778.
[27]
S. Woo et al., “ConvNeXt V2: Co-designing and scaling ConvNets with masked autoencoders,” arXiv preprint arXiv:2301.00808, 2023.
[28]
Y. Liu et al., “Vmamba: Visual state space model,” Advances in neural information processing systems, vol. 37, pp. 103031–103063, 2024.
[29]
L. Chi, B. Jiang, and Y. Mu, Advances in Neural Information Processing Systems, vol. 33, pp. 4479–4488, 2020.
[30]
R. Hasani, M. Lechner, A. Amini, D. Rus, and booktitle=Proceedings. of the A. C. on A. I. Grosu Radu, “Liquid time-constant networks,” 2021, vol. 35, pp. 7657–7666.
[31]
R. Hasani et al., Nature Machine Intelligence, vol. 4, no. 11, pp. 992–1003, 2022.
[32]
X. Qin, Z. Zhang, C. Huang, C. Gao, M. Dehghan, and booktitle=Proceedings. of the I. conference on computer vision and pattern recognition Jagersand Martin, “Basnet: Boundary-aware salient object detection,” 2019, pp. 7479–7489.
[33]
S.-H. Gao, Y.-Q. Tan, M.-M. Cheng, C. Lu, Y. Chen, and booktitle=European. conference on computer vision Yan Shuicheng, “Highly efficient salient object detection with 100k parameters,” 2020 , organization={Springer}, pp. 702–721.
[34]
Y. Wang, R. Wang, X. Fan, T. Wang, and booktitle=Proceedings. of the I. conference on computer vision and pattern recognition He Xiangjian, “Pixels, regions, and objects: Multiple enhancement for salient object detection,” 2023, pp. 10031–10040.
[35]
F. Sun, P. Ren, B. Yin, F. Wang, and H. Li, “CATNet: A cascaded and aggregated transformer network for RGB-d salient object detection,” IEEE Transactions on Multimedia, vol. 26, pp. 2249–2262, 2023.
[36]
X. Hu, F. Sun, J. Sun, F. Wang, and H. Li, “Cross-modal fusion and progressive decoding network for RGB-d salient object detection,” International Journal of Computer Vision, vol. 132, no. 8, pp. 3067–3085, 2024.
[37]
K. Wang, K. Chen, C. Li, Z. Tu, and booktitle=Proceedings. of the A. conference on artificial intelligence Luo Bin, “Alignment-free rgb-t salient object detection: A large-scale dataset and progressive correlation network,” 2025, vol. 39, pp. 7780–7788.
[38]
H. Tang, Z. Li, D. Zhang, S. He, and J. Tang, “Divide-and-conquer: Confluent triple-flow network for RGB-t salient object detection,” IEEE transactions on pattern analysis and machine intelligence, vol. 47, no. 3, pp. 1958–1974, 2024.
[39]
D.-P. Fan, Y. Zhai, A. Borji, J. Yang, and booktitle=European. conference on computer vision Shao Ling, “BBS-net: RGB-d salient object detection with a bifurcated backbone strategy network,” 2020 , organization={Springer}, pp. 275–292.
[40]
G.-P. Ji, K. Fu, Z. Wu, D.-P. Fan, J. Shen, and booktitle=Proceedings. of the I. international conference on computer vision Shao Ling, “Full-duplex strategy for video object segmentation,” 2021, pp. 4922–4933.
[41]
X. Zhao et al., “Motion-aware memory network for fast video salient object detection,” IEEE Transactions on Image Processing, vol. 33, pp. 709–721, 2024.
[42]
N. Liu, K. Nan, W. Zhao, X. Yao, and J. Han, “Learning complementary spatial–temporal transformer for video salient object detection,” IEEE Transactions on Neural Networks and Learning Systems, vol. 35, no. 8, pp. 10663–10673, 2023.
[43]
B. Wan et al., “MFFNet: Multi-modal feature fusion network for VDT salient object detection,” IEEE Transactions on Multimedia, vol. 26, pp. 2069–2081, 2023.
[44]
L. Zhu, B. Liao, Q. Zhang, X. Wang, W. Liu, and X. Wang, arXiv preprint arXiv:2401.09417, 2024.
[45]
Z. Wan et al., “Sigma: Siamese mamba network for multi-modal semantic segmentation,” 2025 , organization={IEEE}, pp. 1734–1744.
[46]
E. Zhu, Z. Chen, D. Wang, H. Shi, X. Liu, and L. Wang, “Unetmamba: An efficient unet-like mamba for semantic segmentation of high-resolution remote sensing images,” IEEE Geoscience and Remote Sensing Letters, vol. 22, pp. 1–5, 2024.
[47]
S. Chen, Y. Luo, Y. Ma, Y. Qiao, and booktitle=Proceedings. of the A. C. on A. I. Wang Yali, “H-mba: Hierarchical mamba adaptation for multi-modal video understanding in autonomous driving,” 2025, vol. 39, pp. 2212–2220.
[48]
S. Zhao, H. Chen, X. Zhang, P. Xiao, L. Bai, and W. Ouyang, “Rs-mamba for large remote sensing image dense prediction,” IEEE Transactions on Geoscience and Remote Sensing, vol. 62, pp. 1–14, 2024.
[49]
C. Yang et al., “Plainmamba: Improving non-hierarchical mamba in visual recognition,” arXiv preprint arXiv:2403.17695, 2024.
[50]
B. Li, H. Zhao, W. Wang, P. Hu, Y. Gou, and booktitle=Proceedings. of the C. V. and P. R. C. Peng Xi, “Mair: A locality-and continuity-preserving mamba for image restoration,” 2025, pp. 7491–7501.
[51]
M. Liu, D. Geißler, S. Bian, B. Zhou, and P. Lukowicz, “Assessing the impact of sampling irregularity in time series data: Human activity recognition as a case study,” arXiv preprint arXiv:2501.15330, 2025.
[52]
P. Kao, “Robust flight navigation with liquid neural networks,” PhD thesis, 2022 , school={Massachusetts Institute of Technology}.
[53]
T. Coskun, H. Vishwamith, M. Isik, J. Naoukin, and booktitle=2025. I. H. P. E. C. C. (HPEC). Dikmen I Can, “Exploring neuromorphic computing with loihi-2 for high-performance CFD simulations,” 2025 , organization={IEEE}, pp. 1–7.
[54]
L. Wang et al., “Learning to detect salient objects with image-level supervision,” 2017, pp. 136–145.
[55]
C. Yang, L. Zhang, H. Lu, X. Ruan, and booktitle=Proceedings. of the I. conference on computer vision and pattern recognition Yang Ming-Hsuan, “Saliency detection via graph-based manifold ranking,” 2013, pp. 3166–3173.
[56]
G. Li and booktitle=Proceedings. of the I. conference on computer vision and pattern recognition Yu Yizhou, “Visual saliency based on multiscale deep features,” 2015, pp. 5455–5463.
[57]
Q. Yan, L. Xu, J. Shi, and booktitle=Proceedings. of the I. conference on computer vision and pattern recognition Jia Jiaya, “Hierarchical saliency detection,” 2013, pp. 1155–1162.
[58]
H. Peng, B. Li, W. Xiong, W. Hu, and booktitle=European. conference on computer vision Ji Rongrong, “RGBD salient object detection: A benchmark and algorithms,” 2014 , organization={Springer}, pp. 92–109.
[59]
D.-P. Fan, Z. Lin, Z. Zhang, M. Zhu, and M.-M. Cheng, IEEE Transactions on neural networks and learning systems, vol. 32, no. 5, pp. 2075–2089, 2020.
[60]
Y. Niu, Y. Geng, X. Li, and booktitle=2012. I. conference on computer vision and pattern recognition Liu Feng, “Leveraging stereopsis for saliency analysis,” 2012 , organization={IEEE}, pp. 454–461.
[61]
Y. Piao, W. Ji, J. Li, M. Zhang, and booktitle=Proceedings. of the I. international conference on computer vision Lu Huchuan, “Depth-induced multi-scale recurrent attention network for saliency detection,” 2019, pp. 7254–7263.
[62]
G. Wang, C. Li, Y. Ma, A. Zheng, J. Tang, and booktitle=Chinese. C. on I. and G. T. Luo Bin, “RGB-t saliency detection benchmark: Dataset, baselines, analysis and a novel approach,” 2018 , organization={Springer}, pp. 359–369.
[63]
Z. Tu, T. Xia, C. Li, X. Wang, Y. Ma, and J. Tang, “RGB-t image saliency detection via collaborative graph learning,” IEEE Transactions on Multimedia, vol. 22, no. 1, pp. 160–173, 2019.
[64]
D.-P. Fan, W. Wang, M.-M. Cheng, and booktitle=Proceedings. of the I. conference on computer vision and pattern recognition Shen Jianbing, “Shifting more attention to video salient object detection,” 2019, pp. 8554–8564.
[65]
P. Ochs, J. Malik, and T. Brox, IEEE transactions on pattern analysis and machine intelligence, vol. 36, no. 6, pp. 1187–1200, 2013.
[66]
F. Li, T. Kim, A. Humayun, D. Tsai, and booktitle=Proceedings. of the I. international conference on computer vision Rehg James M, “Video segmentation by tracking many figure-ground segments,” 2013, pp. 2192–2199.
[67]
J. Li, C. Xia, and X. Chen, IEEE Transactions on Image Processing, vol. 27, no. 1, pp. 349–364, 2017.
[68]
M. Ma, C. Xia, C. Xie, X. Chen, and J. Li, IEEE Transactions on Image Processing, vol. 32, pp. 1026–1038, 2023.
[69]
K. Fu, D.-P. Fan, G.-P. Ji, and booktitle=Proceedings. of the I. conference on computer vision and pattern recognition Zhao Qijun, “JL-DCF: Joint learning and densely-cooperative fusion framework for RGB-d salient object detection,” 2020, pp. 3052–3062.
[70]
T. Zhou, H. Fu, G. Chen, Y. Zhou, D.-P. Fan, and booktitle=Proceedings. of the I. international conference on computer vision Shao Ling, “Specificity-preserving RGB-d saliency detection,” 2021, pp. 4681–4691.
[71]
W. Ji et al., “Calibrated RGB-d salient object detection,” 2021, pp. 9471–9481.
[72]
M. Lee, C. Park, S. Cho, and booktitle=European. conference on computer vision Lee Sangyoun, “Spsn: Superpixel prototype sampling network for rgb-d salient object detection,” 2022 , organization={Springer}, pp. 630–647.
[73]
M. Zhang et al., “Dynamic context-sensitive filtering network for video salient object detection,” 2021, pp. 1553–1563.
[74]
D. Min, C. Zhang, Y. Lu, K. Fu, and Q. Zhao, “Mutual-guidance transformer-embedding network for video salient object detection,” IEEE Signal Processing Letters, vol. 29, pp. 1674–1678, 2022.

  1. Corresponding author.↩︎