Thresholded Cross-Attention for Reliable Intensity-Chromaticity Fusion in Low-Light Image Enhancement


Abstract

Low-Light Image Enhancement (LLIE) requires a careful balance among noise suppression, color fidelity, and efficiency. Recent HVI-based methods alleviate color entanglement by decoupling intensity and chromaticity, yet how reliably the two streams are fused again is an overlooked factor that largely determines the final quality. We observe that the confidence of cross-stream attention is strongly layer-dependent, so the fixed-quota selection of Top-K sparse attention is mismatched to it, discarding informative dependencies in some layers while retaining noisy ones in others. Motivated by this observation, we propose TCA-Net, a network built around Thresholded Cross-Attention that targets reliable intensity–chromaticity fusion in the HVI space rather than introducing yet another color representation. At its core, TCA replaces the rigid Top-K quota with a fixed confidence threshold whose retained cardinality is input- and layer-adaptive, retaining only high-confidence cross-stream interactions while suppressing unreliable ones. Around this core, two complementary designs clean up the fusion before and after it: a Phase-guided Fourier Interaction Module provides a structure-aware brightness initialization for the intensity stream prior to fusion, and a Decoupled Dual-Stream Guidance Module constructs residual intensity features to suppress chromaticity leakage during reconstruction. A Scale-Aware Consistency Regularization further improves structural robustness under scale perturbations during training. Extensive experiments on LOL-v1, LOL-v2, Sony-Total-Dark, and LSRW-Huawei demonstrate that TCA-Net delivers competitive restoration accuracy, improved color fidelity, and a compact parameter size.

Low-light image enhancement, Intensity-chromaticity fusion, Thresholded cross-attention, Confidence-based sparse attention.

1 Introduction↩︎

Low-light image enhancement (LLIE) aims to recover visually pleasing images with clear structures and faithful colors from images captured under insufficient illumination [1]. Low-light images usually suffer from low contrast, noise amplification, color deviation, and loss of local details, which degrade both human visual perception and downstream vision tasks such as autonomous driving, video surveillance, and object detection [2][4]. Therefore, an effective LLIE method should not only improve brightness, but also suppress noise, preserve structural details, maintain color fidelity, and remain computationally efficient.

Early LLIE methods mainly rely on histogram equalization, gamma correction, or Retinex-based image formation models [5][9]. Although these methods improve image visibility to some extent, they often suffer from over-enhancement, amplified noise, and unstable color restoration in complex real-world scenes. With the development of deep learning, data-driven methods have achieved remarkable progress, ranging from CNN- and Transformer-based enhancement networks to semi-supervised, contrastive, diffusion-, and prior-guided illumination restoration models [10][18]. However, most of these methods operate directly in the RGB domain, where brightness, color, texture, and noise are highly entangled. As a result, enhancing brightness and restoring color simultaneously in RGB space may easily introduce color shifts, saturation distortion, and texture artifacts, especially under severe low-light degradation.

Figure 1: Motivation of the proposed Thresholded Cross-Attention (TCA), illustrated on channel-wise cross-stream attention. Each column shows a different attention distribution: a concentrated, high-confidence case (left) and a diffuse, low-confidence case (right). Solid blue bars are retained responses and dashed orange bars are discarded ones. (a) Vanilla attention keeps all channel responses, including weak noise-correlated ones. (b) Top-K selection retains a fixed proportion (\rho=0.5) of the highest-ranking responses regardless of the distribution, so it discards informative responses in the concentrated case while being forced to keep weak ones in the diffuse case. (c) TCA instead applies a single confidence threshold \tau shared across both cases: responses above \tau are retained and those below are suppressed, so the number of retained responses adapts to the distribution, preserving confident dependencies while removing low-confidence ones.

To alleviate this issue, recent studies have explored color-consistent or color-space-based decomposition strategies. For example, color-consistency learning and YCbCr-based decomposition reduce color interference by separating luminance-related and chromatic components [19], [20]. More recently, the HVI color space has been introduced for LLIE to better decouple intensity and chromaticity, leading to improved color consistency and restoration stability [21]. Despite its effectiveness, HVI-based enhancement still faces an important limitation: after intensity and chromaticity are separated, reliable cross-stream interaction remains difficult. In severe low-light regions, the intensity stream may contain strong noise and unstable structural cues, while the chromaticity stream may include color artifacts and local distortions. Direct or dense cross-stream fusion can therefore propagate noise-corrupted intensity features to the chromaticity branch, or inject chromatic artifacts back into the reconstruction process.

Existing attention-based fusion strategies are not fully suitable for this problem. Dense attention retains all cross-stream dependencies, including weak and noise-correlated responses. Top-K sparse attention reduces redundant interactions by preserving only a fixed proportion of high-ranking responses. However, we find that the reliability of cross-stream interactions is not uniform: the confidence of the cross-stream attention responses varies markedly across network depths, with some layers concentrating their weights in high-confidence ranges while others remain diffuse and low-valued. Against such a layer-dependent distribution, a fixed retention ratio is structurally mismatched. In concentrated layers it discards a fixed portion of informative cross-channel dependencies, while in diffuse layers it is forced to retain the same proportion of weak, noise-correlated responses simply to satisfy the quota. This behavior is illustrated conceptually in Fig. 1 and further supported by the real cross-stream attention statistics in Fig. 2. Across different LOL benchmarks, the attention distributions vary clearly across layers: some layers concentrate more responses in high-confidence ranges, while others contain more diffuse low-confidence responses. Under such distributions, a fixed-ratio Top-\(\mathrm{K}\) strategy may either discard informative dependencies or retain weak responses simply to satisfy the fixed quota. In contrast, threshold-based pruning selects interactions according to their confidence, allowing the retained ratio to adapt to the attention distribution. The corresponding layer-wise retention rates in Fig. 3 further confirm that TCA does not impose a fixed sparse quota, but produces different retained ratios across encoder, bottleneck, and decoder layers. These observations motivate us to develop a reliability-aware fusion mechanism that preserves confident cross-stream interactions while suppressing unreliable ones.

Building upon this observation, we propose TCA-Net, a network for low-light image enhancement built around Thresholded Cross-Attention. Instead of introducing another color representation, TCA-Net is organized around a single objective: making the cross-stream fusion in the HVI space reliable. At the core of the framework is Thresholded Cross-Attention (TCA), which prunes cross-stream channel dependencies with a fixed confidence threshold rather than a fixed Top-K quota, so that the number of retained interactions adapts to the input- and layer-dependent attention distribution instead of a rigid cardinality. The remaining two designs serve this core by cleaning up the fusion before and after it. Before fusion, a Phase-guided Fourier Interaction Module (PFIM) uses phase-derived structural cues to recalibrate the amplitude response of intensity features, providing a structure-aware brightness initialization so that TCA operates on a less noise-corrupted intensity stream. After fusion, a Decoupled Dual-Stream Guidance Module (DDSGM) constructs residual intensity features by subtracting chromaticity-correlated components and progressively guides illumination and color restoration, thereby suppressing residual chromaticity leakage during reconstruction. Finally, a Scale-Aware Consistency Regularization (SACR) strategy is adopted during training to improve structural robustness under scale perturbations.

The main contributions are summarized as follows:

  • We identify reliability-aware cross-stream fusion as a key but overlooked bottleneck of HVI-based LLIE, and show that the confidence of cross-stream attention is layer-dependent and spatially non-uniform, which makes the fixed-quota selection of Top-K sparse attention systematically mismatched to it.

  • Motivated by this observation, we propose TCA, which replaces the rigid Top-K quota with a fixed confidence threshold whose retained cardinality is input- and layer-adaptive, retaining high-confidence cross-stream dependencies and suppressing unreliable ones without the sorting overhead of rank-based selection.

  • We complement TCA with a Phase-guided Fourier interaction module that delivers a structure-aware, less noise-corrupted intensity initialization prior to fusion, and a residual intensity-guided fusion module that suppresses chromaticity-correlated interference after fusion, so that the three designs jointly govern the cross-stream fusion from initialization to reconstruction.

  • Extensive experiments on five LLIE benchmarks show that TCA-Net achieves competitive restoration performance across multiple evaluation settings, with improved color fidelity and a compact parameter size.

2 Related work↩︎

2.1 Deep Learning-based Low-Light Image Enhancement↩︎

Deep LLIE methods have evolved from direct low-to-normal mapping networks to more flexible supervised, unpaired, semi-supervised, and self-calibrated formulations [13], [22][24]. Recent studies further address complex degradations and efficient representations, including joint enhancement and deblurring [25], cross-data dehazing alignment [26], context-conditioned implicit enhancement [27], and state-space or RWKV-style restoration models [28][30]. Although these architectures improve restoration capacity, robustly balancing illumination recovery, noise suppression, and color fidelity remains challenging.

Figure 2: Softmax-normalized cross-stream attention score distributions before selection. The three rows correspond to LOL-v1, LOL-v2-Real, and LOL-v2-Synthetic, respectively. The sampled layers follow the network depth: layers 1–4 are encoder layers, layers 5–8 are bottleneck layers, and layers 9–12 are decoder layers. Blue and orange bars denote responses retained and discarded by TCA with \tau=0.025. The layer- and dataset-dependent distributions show why a fixed retention quota is mismatched to cross-stream confidence.
Figure 3: Layer-wise retention rates of TCA on LOL-v1, LOL-v2-Real, and LOL-v2-Synthetic. Although the same threshold \tau=0.025 is used across layers, the retained ratio varies with the attention distribution of each layer and dataset. This shows that TCA produces adaptive sparse patterns without imposing a fixed retention quota.

Recent LLIE studies also incorporate visual priors and real-world degradation modeling, including multi-prior collaboration [31], generative perceptual priors [18], cross-image disentanglement [32], and darkness-aware visible–infrared fusion [33]. However, RGB-domain enhancement can introduce color shifts, amplify noise, and destabilize local details, since illumination, texture, and chromatic information are strongly entangled [11], [12].

To reduce this entanglement, decoupled enhancement frameworks separate illumination-related components from other visual factors. Representative examples include Retinex-based decomposition [11], [34], color-consistent or YCbCr-based modeling [19], [20], HVI-space enhancement [21], and Fourier-based restoration [35][38]. These methods improve illumination and color restoration from different perspectives, but reliable interaction between intensity and chromaticity features after decomposition remains less explored. Different from existing HVI-based or frequency-based methods, TCA-Net focuses on reliability-aware intensity–chromaticity fusion through frequency-guided intensity initialization, confidence-thresholded cross-stream pruning, and residual intensity-guided reconstruction.

2.2 Confidence-Driven Sparse Attention↩︎

Sparse attention has been widely studied to reduce redundant interactions in Transformers. Early methods use fixed sparse patterns to lower memory and computational costs while preserving long-range modeling ability, as in Sparse Transformer [39] and BigBird [40]. Later methods introduce content-adaptive sparsity, where the attended regions or tokens are selected according to input features rather than a predefined pattern [41], [42]. These designs show that attention sparsity should not only reduce redundancy, but also preserve informative dependencies under varying visual content.

In image restoration and enhancement, sparse attention is often introduced to handle high-resolution feature maps efficiently. Window-based attention, such as Swin Transformer [43], restricts interactions to local windows and therefore reduces redundant global computation. However, low-light enhancement often requires consistent illumination recovery across distant regions, making purely local sparse patterns less suitable. Dynamic selection methods provide a more flexible alternative. For example, restoration-specific models such as DRSformer [44] use Top-\(\mathrm{K}\) selection to retain the highest-ranking attention responses. Nevertheless, Top-\(\mathrm{K}\) sparsification still relies on a manually fixed retention ratio, which may not match layer- or input-dependent attention distributions. It may discard useful responses in concentrated distributions or retain weak responses in diffuse ones.

Another group of methods induces sparsity by modifying the normalization function itself. Sparsemax [45] and Entmax [46] produce sparse probability distributions through simplex projection, while Rectified Linear Attention [47] replaces Softmax with a ReLU-based formulation. These methods can suppress low-scoring entries, but the pruning criterion is implicit in the projection or activation and may require additional sorting or iterative computation. For low-light enhancement, standard Softmax can also assign non-zero probabilities to noise-heavy responses [48], which may propagate unreliable intensity or chromaticity cues. Motivated by these observations, we keep the standard Softmax attention and apply an explicit confidence threshold after normalization. This provides an interpretable probability-level pruning rule, avoids a fixed retention quota, and better supports reliable intensity–chromaticity fusion.

3 Method↩︎

3.1 Overall Pipeline and Training Objective↩︎

As shown in Fig. 4, given a low-light input image \(\mathbf{X}_{low}\), TCA-Net first transforms it into the HVI color space to decouple the intensity component from the chromaticity components. The intensity stream is first encoded into shallow intensity features, which are enhanced by the proposed Phase-guided Fourier Interaction Module (PFIM) to provide a structure-aware brightness initialization. Then, Thresholded Cross-Attention (TCA) is employed to perform reliability-aware interaction between the intensity and chromaticity streams by pruning low-confidence cross-stream dependencies. Finally, the Decoupled Dual-Stream Guidance Module (DDSGM) reconstructs the enhanced image by using residual intensity features to reduce chromaticity-correlated interference. These three modules are organized into a Dual-Domain Decoupled Restoration Block (DDRB), as shown in Fig. 4, after which a perceptual-inverse HVI transform maps the result back to the RGB domain to produce the output \(\mathbf{X}_{out}\).

During training, the model is optimized with both external supervised reconstruction loss and internal SCAR. The total loss is formulated as: \[\mathcal{L}_{total} = \mathcal{L}_{sup} + \beta(t)\mathcal{L}_{sacr}, \label{eq:total95loss}\tag{1}\] where \(\mathcal{L}_{sup}\) denotes the supervised reconstruction loss, and \(\mathcal{L}_{sacr}\) denotes the proposed SACR

Specifically, the supervised loss is computed in both RGB and HVI spaces: \[\mathcal{L}_{sup} = \mathcal{L}_{rgb}(\hat{\mathbf{X}}, \mathbf{X}_{gt}) + \lambda_{hvi} \mathcal{L}_{hvi} \left( \mathcal{H}(\hat{\mathbf{X}}), \mathcal{H}(\mathbf{X}_{gt}) \right), \label{eq:sup95loss}\tag{2}\] where \(\hat{\mathbf{X}}\) and \(\mathbf{X}_{gt}\) denote the enhanced result and the ground-truth image, respectively, and \(\mathcal{H}(\cdot)\) represents the HVI transformation.

For a pair of prediction and target images \((\mathbf{X},\mathbf{Y})\), the reconstruction loss is defined as: \[\begin{align} \mathcal{L}_{rec}(\mathbf{X},\mathbf{Y}) =& \lambda_{1}\|\mathbf{X}-\mathbf{Y}\|_{1} + \lambda_{ssim}\left(1-\mathrm{SSIM}(\mathbf{X},\mathbf{Y})\right) \\ &+ \lambda_{edge}\left\|\Delta(\mathbf{X})-\Delta(\mathbf{Y})\right\|_{2}^{2} + \lambda_{per}\mathcal{L}_{per}(\mathbf{X},\mathbf{Y}), \end{align} \label{eq:rec95loss}\tag{3}\] where \(\Delta(\cdot)\) denotes the Laplacian edge operator, and \(\mathcal{L}_{per}\) is the VGG-based perceptual loss. Accordingly, we have \(\mathcal{L}_{rgb}=\mathcal{L}_{rec}(\hat{\mathbf{X}},\mathbf{X}_{gt})\) and \(\mathcal{L}_{hvi}=\mathcal{L}_{rec}(\mathcal{H}(\hat{\mathbf{X}}),\mathcal{H}(\mathbf{X}_{gt}))\).

Figure 4: Overall architecture of the proposed TCA-Net. The input \mathbf{X}_{low} is first mapped into the HVI space and split into an intensity stream \mathbf{F}_{i} and a chromaticity stream \mathbf{F}_{hv}, which are processed by the Dual-Domain Decoupled Restoration Block (DDRB) and transformed back by the perceptual-inverse HVI transform to produce \mathbf{X}_{out}. Within the DDRB, the Phase-guided Fourier Interaction Module (PFIM) provides a structure-aware initialization for the intensity stream, a stack of Thresholded Cross-Attention (TCA) layers performs reliability-aware intensity–chromaticity fusion, and the Decoupled Dual-Stream Guidance Module (DDSGM) reconstructs the result via residual intensity guidance. The lower-left panels detail PFIM and the SGB/OCAB blocks of DDSGM; the middle panel details the TCA layer; the right panel illustrates the Scale-Aware Consistency Regularization (SACR) used only during training. Legend symbols are defined at the top right.

3.2 Phase-guided Fourier Interaction Module (PFIM)↩︎

After HVI transformation, the intensity component is encoded into a shallow feature \(\mathbf{F}\in\mathbb{R}^{C\times H\times W}\), on which PFIM performs frequency-domain enhancement to provide a structure-aware initialization for subsequent intensity–chromaticity fusion.

Given \(\mathbf{F}\), we first project it with a \(1\times1\) convolution and transform it into the frequency domain: \[\mathbf{X}_{f} = \mathcal{F}\left(\psi_{pre}(\mathbf{F})\right), \quad \mathbf{M}=|\mathbf{X}_{f}|, \quad \mathbf{\Phi}=\angle \mathbf{X}_{f}, \label{eq:pfim95fft}\tag{4}\] where \(\psi_{pre}(\cdot)\) denotes the \(1\times1\) pre-projection, and \(\mathbf{M}\) and \(\mathbf{\Phi}\) denote the amplitude and phase components, respectively. Since amplitude mainly reflects global intensity distribution while phase preserves structural information, we modulate the amplitude under phase guidance. Specifically, the amplitude is processed by a lightweight convolutional block, while the phase is used to generate channel-wise attention: \[\mathbf{M}_{final} = \psi_{m}(\mathbf{M}) \odot \sigma\left( \psi_{a}\left(\mathrm{GAP}(\psi_{p}(\mathbf{\Phi}))\right) \right), \label{eq:pfim95modulation}\tag{5}\] where \(\psi_m(\cdot)\) denotes amplitude modulation, \(\psi_p(\cdot)\) denotes phase projection, \(\psi_a(\cdot)\) denotes the channel-attention network, and \(\odot\) represents element-wise multiplication.

The enhanced intensity feature is then reconstructed by inverse FFT with a residual connection: \[\mathbf{F}_{i} = \psi_{out} \left( \mathcal{F}^{-1} \left( \mathbf{M}_{final}\cdot e^{j\psi_{p}(\mathbf{\Phi})} \right) + \mathbf{F} \right), \label{eq:pfim95output}\tag{6}\] where \(\psi_{out}(\cdot)\) is the output projection. In this way, PFIM enhances the intensity representation in the frequency domain while preserving phase-guided structural cues.

3.3 Thresholded Cross-Attention (TCA)↩︎

Following the dual-branch HVI paradigm [21], our framework separately processes the intensity and chromaticity streams. Although this decomposition alleviates color entanglement, reliable cross-stream interaction is still crucial, since noise-corrupted intensity cues or chromatic artifacts may be propagated during fusion.

For the \(l\)-th cross-attention layer, we denote the source and target features as \(\mathbf{F}_{s}^{l}\) and \(\mathbf{F}_{t}^{l}\), where \(s,t\in\{i,hv\}\) and \(s\neq t\). Here, \(i\) and \(hv\) indicate the intensity and chromaticity streams, respectively. The query is generated from the source stream, while the key and value are projected from the target stream: \[\mathbf{Q}^{l}=\phi_q(\mathbf{F}_{s}^{l}), \quad \mathbf{K}^{l}=\phi_k(\mathbf{F}_{t}^{l}), \quad \mathbf{V}^{l}=\phi_v(\mathbf{F}_{t}^{l}), \label{eq:tca95qkv}\tag{7}\] where \(\phi_q(\cdot)\), \(\phi_k(\cdot)\), and \(\phi_v(\cdot)\) are convolutional projections. After reshaping \(\mathbf{Q}^{l}\), \(\mathbf{K}^{l}\), and \(\mathbf{V}^{l}\) to \(\mathbb{R}^{B\times h\times d\times HW}\), the dense channel-wise attention is computed as: \[\mathbf{A}^{l} = \operatorname{Softmax} \left( \gamma^{l}\mathbf{Q}^{l}(\mathbf{K}^{l})^{\top} \right), \quad \mathbf{Y}^{l}=\mathbf{A}^{l}\mathbf{V}^{l}, \label{eq:channel95attn}\tag{8}\] where \(\gamma^{l}\) is a learnable temperature parameter. Since Softmax assigns non-zero weights to all target channels, weak or noise-correlated responses may still be propagated across streams.

A common sparsification strategy is Top-\(\mathrm{K}\) selection, which keeps the \(\mathrm{K}\) largest attention responses for each source channel: \[\mathbf{M}^{\mathrm{K},l} = \operatorname{TopKMask}(\mathbf{A}^{l},\mathrm{K}), \quad \mathrm{K}=\lceil \rho d\rceil , \label{eq:channel95topk95mask}\tag{9}\] where \(\rho\) is a predefined retention ratio. The corresponding sparse attention is: \[\hat{\mathbf{A}}^{\mathrm{K},l} = \operatorname{Norm} \left( \mathbf{A}^{l}\odot\mathbf{M}^{\mathrm{K},l} \right), \quad \mathbf{Y}^{\mathrm{K},l} = \hat{\mathbf{A}}^{\mathrm{K},l}\mathbf{V}^{l}, \label{eq:channel95topk95attn}\tag{10}\] where \(\operatorname{Norm}(\cdot)\) denotes re-normalization along the target-channel dimension. However, Top-\(\mathrm{K}\) imposes a fixed retention quota on all layers and source channels. This rigid selection rule may discard useful dependencies in information-dense layers while retaining weak or noise-correlated responses in diffuse attention distributions.

To address this limitation, we propose Thresholded Cross-Attention (TCA), which performs confidence-based pruning on the normalized attention map. Instead of retaining a fixed number of responses, TCA preserves interactions whose attention confidence exceeds a fixed threshold \(\tau\): \[\mathbf{M}^{\tau,l} = \operatorname{Mask} \left( \mathbf{A}^{l}\geq \tau \right) \vee \operatorname{OneHotArgmax} \left( \mathbf{A}^{l} \right), \label{eq:channel95tca95mask}\tag{11}\] here, \(\operatorname{OneHotArgmax}(\cdot)\) is computed along the target-channel dimension and keeps the largest response for each source channel. This fallback prevents an all-zero mask when all responses are below \(\tau\). The pruned attention is then computed as: \[\hat{\mathbf{A}}^{\tau,l} = \operatorname{Norm} \left( \mathbf{A}^{l}\odot\mathbf{M}^{\tau,l} \right), \quad \mathbf{Y}^{\tau,l} = \hat{\mathbf{A}}^{\tau,l}\mathbf{V}^{l}. \label{eq:channel95tca95attn}\tag{12}\] where \(\operatorname{Norm}(\cdot)\) re-normalizes the masked attention along the target-channel dimension with a small numerical constant in the denominator.

In our implementation, we set \(\tau=0.025\) according to the ablation analysis. The threshold is applied to Softmax-normalized attention probabilities rather than raw feature activations, so it operates on a comparable confidence scale across inputs and layers. Although \(\tau\) is shared across layers, the retained cardinality and sparse pattern remain input- and layer-adaptive because they depend on the attention distribution of each input and layer. As shown in Fig. 2, the attention distributions vary across layers and datasets, while TCA consistently preserves high-confidence responses and suppresses low-confidence ones according to the same probability-level confidence criterion. The refined features are then fed into the Illumination Estimation Layer (IEL) and Chromaticity Denoising Layer (CDL) [21] to generate the enhanced intensity and chromaticity components.

3.4 Decoupled Dual-Stream Guidance Module (DDSGM)↩︎

After TCA, the refined intensity and chromaticity features still need to be effectively fused for final reconstruction. Direct concatenation may mix illumination and color information again, leading to chromatic interference. To alleviate this issue, we propose the Decoupled Dual-Stream Guidance Module (DDSGM), which explicitly constructs a residual intensity feature to reduce chromaticity-related leakage.

Given the refined intensity feature \(\mathbf{F}_{i}^{o}\) and chromaticity feature \(\mathbf{F}_{hv}^{o}\), we first generate a learnable adaptive map \(\mathbf{M}_{\mu}\) from the chromaticity stream and use it to remove chromaticity-correlated components from the intensity feature: \[\begin{gather} \mathbf{M}_{\mu} = \sigma(\mathrm{Conv}(\mathbf{F}_{hv}^{o})), \tag{13} \\ \mathbf{F}_{i}^{res} = \mathbf{F}_{i}^{o} - \mathbf{M}_{\mu} \odot \mathbf{F}_{hv}^{o}, \tag{14} \end{gather}\] where \(\sigma(\cdot)\) denotes the Sigmoid function and \(\odot\) represents element-wise multiplication. The residual intensity feature \(\mathbf{F}_{i}^{res}\) provides cleaner illumination guidance by suppressing chromaticity-correlated interference.

DDSGM then adopts a cascaded two-stage reconstruction process. The first stage uses \(\mathbf{F}_{i}^{res}\) to guide illumination restoration, while the second stage uses \(\mathbf{F}_{hv}^{o}\) to refine chromaticity details. To make the data flow explicit, we denote the reconstruction feature before stage \(k\) as \(\mathbf{U}_{k-1}\), with \(\mathbf{U}_{0}=\mathrm{Conv}_{3\times3}(\mathbf{X}_{low})\), and define the stage guidance as \(\mathbf{G}_{1}=\mathbf{F}_{i}^{res}\) and \(\mathbf{G}_{2}=\mathbf{F}_{hv}^{o}\). Each stage consists of a Spatial Guidance Block (SGB) for feature modulation and an Oriented Context Aggregation Block (OCAB) for spatial context modeling. For the \(k\)-th stage, SGB performs guidance-aware modulation as: \[\begin{align} \mathbf{S}_{k} &= \mathrm{Conv}_{3\times3}(\mathbf{U}_{k-1}) \odot \mathrm{Conv}_{1\times1}(\mathbf{G}_{k}), \tag{15}\\ \mathbf{U}'_{k} &= \mathrm{Conv}_{3\times3}(\mathbf{U}_{k-1}) \oplus \mathrm{GAP}(\mathrm{Conv}_{3\times3}(\mathbf{S}_{k})). \tag{16} \end{align}\]

After modulation, OCAB aggregates horizontal and vertical contextual information using dual-path pooling and large-kernel strip convolutions [49], producing \(\mathbf{U}_{k}=\operatorname{OCAB}(\mathbf{U}'_{k})\). The second-stage output is finally projected to the enhanced HVI representation. This formulation separates the illumination-guided and chromaticity-guided reconstruction paths while keeping their inputs and outputs well defined.

3.5 Scale-Aware Consistency Regularization (SACR)↩︎

To improve the structural robustness of the restored image under scale perturbations, we introduce a self-supervised Scale-Aware Consistency Regularization (SACR) during training. SACR is applied at the output level: it encourages the enhanced result to remain stable under mild scale degradation, while the supervised reconstruction loss still provides the main constraint for recovering fine-grained details.

Given the restored image \(\hat{\mathbf{X}}\), we first generate a weakly augmented output view and its scale-perturbed counterpart: \[\mathbf{X}_{weak} = \mathrm{T}_{weak}(\hat{\mathbf{X}}), \quad \mathbf{X}_{aug} = \mathrm{T}_{aug}(\mathbf{X}_{weak}), \label{eq:sacr95aug}\tag{17}\] where \(\mathrm{T}_{weak}\) denotes weak augmentation implemented by random cropping, and \(\mathrm{T}_{aug}\) denotes scale perturbation implemented by downsampling followed by bilinear upsampling to the original crop size. In our implementation, the weak augmentation crops a \(128\times128\) patch, and the scale perturbation adopts \(0.5\times\) downsampling followed by upsampling.

The SACR loss is defined as the \(\ell_2\) distance between the weakly augmented output and its scale-perturbed version: \[\mathcal{L}_{sacr} = \left\| \mathbf{X}_{weak} - \mathbf{X}_{aug} \right\|_{2}^{2}. \label{eq:sacr95loss}\tag{18}\]

As defined in Eq. 1 , SACR is used as an auxiliary regularization term together with the supervised reconstruction loss. Its weight follows a cosine decay schedule: \[\beta(t) = \beta_{0} \cdot \frac{1+\cos(\pi t/T)}{2}, \label{eq:beta95decay}\tag{19}\] where \(\beta_{0}\) is the initial regularization weight, \(t\) denotes the current training iteration, and \(T\) is the total number of training iterations. This schedule gradually relaxes the output-level scale-consistency constraint, reducing the risk of over-smoothing while helping the model maintain structural stability.

Table 1: Quantitative results in terms of PSNR\(\uparrow\), SSIM\(\uparrow\), and LPIPS\(\downarrow\) on the LOL-v1 and LOL-v2 datasets. The best and second-best results are highlighted in red and blue, respectively.
Methods Color Model LOL-v1 LOL-v2-Real LOL-v2-Synthetic
3-5 (lr)6-8 (lr)9-11 PSNR\(\uparrow\) SSIM\(\uparrow\) LPIPS\(\downarrow\) PSNR\(\uparrow\) SSIM\(\uparrow\) LPIPS\(\downarrow\) PSNR\(\uparrow\) SSIM\(\uparrow\) LPIPS\(\downarrow\)
RetinexNet [11] Retinex 18.915 0.427 0.470 16.097 0.401 0.543 17.137 0.762 0.255
KinD [34] Retinex 23.018 0.843 0.156 17.544 0.669 0.375 18.320 0.796 0.252
ZeroDCE [12] RGB 21.880 0.640 0.335 16.059 0.580 0.313 17.712 0.815 0.169
RUAS [50] Retinex 18.654 0.518 0.270 15.326 0.488 0.310 13.765 0.638 0.305
LLFlow [51] RGB 24.060 0.860 0.136 17.433 0.831 0.176 24.807 0.919 0.067
EnGAN [23] RGB 20.003 0.691 0.317 18.230 0.617 0.309 16.570 0.734 0.220
SNR-Aware [52] RGB 24.610 0.842 0.152 21.480 0.849 0.163 24.140 0.928 0.056
Bread [53] YCbCr 22.920 0.836 0.155 20.830 0.847 0.174 17.630 0.919 0.091
PairLIE [54] Retinex 23.526 0.755 0.248 19.885 0.778 0.317 19.074 0.794 0.230
Restormer [55] RGB 22.427 0.823 0.147 18.600 0.789 21.410 0.831
LLFormer [56] RGB 23.649 0.816 0.167 20.056 0.792 0.211 24.038 0.909 0.066
RetinexFormer [57] Retinex 25.161 0.845 0.129 22.794 0.840 0.171 25.670 0.930 0.059
QuadPrior [58] Kubelka-Munk 22.849 0.800 0.201 20.592 0.811 0.202 16.108 0.758 0.114
END [20] YCbCr 24.740 0.837 0.133 - - - - - -
CIDNet [21] HVI 23.809 0.857 0.079 23.900 0.865 0.108 25.705 0.942 0.045
Ours HVI 25.322 0.876 0.069 24.171 0.872 0.109 26.023 0.944 0.040

4 Experiments↩︎

4.1 Datasets↩︎

In our experiments, we evaluate the proposed method on five widely used LLIE benchmarks: LOL-v1 [11], LOL-v2-Real [59], LOL-v2-Synthetic [59], LSRW-Huawei [60], and Sony-Total-Dark [61]. The details of these datasets and training settings are summarized as follows.

LOL-v1 is a real-world paired benchmark for LLIE, consisting of 500 low-/normal-light image pairs, including 485 training pairs and 15 testing pairs. During training, we crop the images into \(256\times256\) patches and train the model for 2000 epochs with a batch size of 4.

LOL-v2-Real extends LOL-v1 with more diverse scenes and challenging illumination conditions. It contains 789 real-world image pairs, including 689 training pairs and 100 testing pairs. We crop the training images into \(400\times400\) patches and train for 1500 epochs with a batch size of 6.

LOL-v2-Synthetic provides large-scale synthetic paired data with accurate ground truth. It consists of 1,000 image pairs, with 900 pairs for training and 100 pairs for testing. We use \(256\times256\) training patches and train for 1500 epochs with a batch size of 4.

LSRW-Huawei is a real-world low-light benchmark collected for mobile photography scenarios. It contains 2,450 training pairs and 30 testing pairs captured by Huawei mobile devices under diverse natural lighting conditions.

Sony-Total-Dark is used to evaluate the robustness of the model under extremely low-light conditions. It is built from a modified subset of SID, where raw images are converted to sRGB without gamma correction to simulate severe underexposure. We crop the training images into \(256\times256\) patches and train for 1000 epochs with a batch size of 4.

4.2 Implementation Details↩︎

The proposed model is implemented in PyTorch and optimized using the Adam optimizer with \(\beta_1=0.9\) and \(\beta_2=0.999\). The initial learning rate is set to \(1\times10^{-4}\) and decayed to a minimum of \(1\times10^{-7}\) following a cosine annealing schedule over the whole training process. To stabilize training, gradient clipping is applied with a maximum \(\ell_2\) norm of \(0.01\). All models are trained with a batch size of \(4\) on \(256\times256\) patches, except where dataset-specific settings are noted in Sec. 4.1. The supervised reconstruction loss in Eq. 3 combines an \(\ell_1\) term, an SSIM term, an edge term, and a VGG-based perceptual term, with weights \(\lambda_1=1.0\), \(\lambda_{ssim}=0.5\), \(\lambda_{edge}=50.0\), and \(\lambda_{per}=1\times10^{-2}\), respectively. This reconstruction loss is applied in both the RGB and HVI spaces, where the HVI term is weighted by \(\lambda_{hvi}=1.0\) as in Eq. 2 . The scale-aware consistency regularization is weighted by \(\beta(t)\) following the cosine decay schedule in Eq. 19 . All experiments are conducted on a single NVIDIA GeForce RTX 4090 GPU.

4.3 Evaluation Metrics↩︎

We evaluate enhancement performance using fidelity, perceptual, and color-related metrics, including PSNR, SSIM [62], LPIPS [63], and chromaticity error, which measure pixel-level accuracy, structural consistency, perceptual similarity, and color restoration quality.

In addition to general image fidelity, we evaluate color restoration accuracy using a chromaticity-only error derived from the CIE Lab color-difference formulation [64]. The enhanced image \(\mathbf{X}_{out}\) and the ground-truth image \(\mathbf{X}_{gt}\) are first converted from RGB to Lab space. Since the \(L^{*}\) channel mainly represents luminance, we compute the color discrepancy only on the chromaticity channels \(a^{*}\) and \(b^{*}\): \[E_{ab}(p) = \sqrt{ \left( a_{out}(p)-a_{gt}(p) \right)^2 + \left( b_{out}(p)-b_{gt}(p) \right)^2 }, \label{eq:eab}\tag{20}\] where \(p\) denotes a spatial pixel location. \(a_{out}(p)\) and \(b_{out}(p)\) are the chromaticity values of the enhanced image, while \(a_{gt}(p)\) and \(b_{gt}(p)\) are those of the ground truth. Different from the full CIE \(\Delta E_{ab}^{*}\) color difference, this metric excludes the luminance channel and focuses only on chromaticity discrepancy. A lower \(E_{ab}\) value indicates more faithful chromaticity restoration. In our experiments, we first compute the average \(E_{ab}\) over all pixels of each test image, and then report the mean and standard deviation over the whole test set to measure both overall chromatic accuracy and color stability.

4.4 Main Results↩︎

Results on LOL datasets. We conduct experiments on the widely-used LOL-v1 and LOL-v2 datasets to evaluate the performance of our proposed method. For a comprehensive comparison, we evaluate our approach against fifteen representative and recent low-light image enhancement methods, including RetinexNet [11], KinD [34], ZeroDCE [12], RUAS [50], LLFlow [51], EnGAN [23], SNR-Aware [52], Bread [53], PairLIE [54], Restormer [55], LLFormer [56], RetinexFormer [57], QuadPrior [58], END [20], and CIDNet [21].

As summarized in Table 1, our method ranks first or remains competitive across most metrics, with only a marginal LPIPS difference on LOL-v2-Real compared with CIDNet. Furthermore, qualitative comparisons are illustrated in Fig. 5 (LOL-v1) and Fig. 6 (LOL-v2-Real). Compared with other existing methods, our approach restores more natural colors and preserves finer structural details.

Figure 5: Visual comparison of the enhanced images yielded by different methods on LOL-v1.
Figure 6: Visual comparison of the enhanced images yielded by different methods on LOL-v2-Real.
Figure 7: Chromaticity error visualization on representative LOL-v1 samples. Higher responses indicate larger chromaticity deviations between the enhanced result and the ground truth. Compared with other methods, our method produces fewer high-error regions, suggesting more faithful chromaticity restoration.
Table 2: \(E_{ab}\) chromaticity error comparison on the LOL-v1 test set.
Model Avg. \(E_{ab}\downarrow\) Std. \(E_{ab}\downarrow\)
RUAS [50] 12.132 2.723
SNR-Aware [52] 6.797 3.027
KinD [34] 5.618 3.278
CIDNet [21] 5.459 2.431
Ours 5.058 2.105

Color fidelity analysis on LOL-v1. To further evaluate chromaticity restoration, we compute the chromaticity error \(E_{ab}\) on the LOL-v1 test set following Eq. 20 . Since \(E_{ab}\) measures the discrepancy only on the chromaticity channels, it provides a direct evaluation of color restoration accuracy while excluding luminance-induced variations. As shown in Table 2, our method achieves the lowest average color error and the smallest standard deviation among all compared methods. Compared with CIDNet, which also benefits from the HVI color space, our method further reduces both Avg. \(E_{ab}\) and Std. \(E_{ab}\), demonstrating more accurate and stable chromaticity restoration. We further visualize the chromaticity error maps in Fig. 7. RUAS introduces severe color deviations over large image regions, while SNR-Aware and KinD still exhibit noticeable chromatic errors in textured and low-light areas. CIDNet effectively reduces the overall color discrepancy, but local color inconsistency can still be observed around complex structures. In contrast, our method produces broader low-error regions and fewer high-error responses, especially around dark areas, texture boundaries, and chromatically complex regions. These results further confirm the advantage of the proposed method in faithful color recovery.

Results on Sony-Total-Dark dataset. To evaluate the robustness of our framework in extremely low-light environments, we conduct experiments on the Sony subset of the SID dataset. This dataset is particularly challenging due to near-total darkness and severe noise degradation. We compare our method with several representative LLIE methods, including RetinexNet [11], ZeroDCE [12], RUAS [50], URetinexNet [65], LLFlow [51], and CIDNet [21].

As shown in Table 3, our method obtains the highest reported PSNR of 23.03 dB and SSIM of 0.677 among the compared methods. Compared with CIDNet, our method improves the PSNR by 0.13 dB while slightly improving SSIM from 0.676 to 0.677. These results indicate that the proposed method achieves stronger pixel-level reconstruction fidelity while maintaining competitive structural similarity under extremely low-light conditions. Qualitative comparisons are shown in Fig. 8.

Table 3: Quantitative results on the SID dataset. The top-ranking score is shown in red, and the second-best is shown in blue.
Methods PSNR\(\uparrow\) SSIM\(\uparrow\)
RetinexNet [11] 15.70 0.395
ZeroDCE [12] 14.09 0.090
RUAS [50] 12.62 0.081
URetinexNet [65] 15.52 0.323
LLFlow [51] 16.23 0.367
CIDNet [21] 22.90 0.676
Ours 23.03 0.677
Figure 8: Visual comparison of the enhanced images yielded by different methods on Sony-Total-Dark.

Results on LSRW-Huawei dataset. To further assess the generalization performance of our method, we conduct experiments on the LSRW-Huawei dataset, which is widely recognized for its challenging real-world low-light scenarios. We compare our approach with a range of representative methods, including KinD [34], RUAS [50], EnGAN [23], SNR-Aware [52], RetinexFormer [57], FourLLIE [35], UHDFour [36], Bread [53], and DarkIR [66].

As summarized in Table 4, our method obtains the highest PSNR in this comparison and maintains comparable SSIM to the leading methods, demonstrating its effectiveness in enhancing image brightness while preserving structural consistency. This further confirms the adaptability of our approach to complex real-world low-light conditions. Furthermore, we visualize several representative methods in Fig. 9.

Table 4: Quantitative results on the LSRW-Huawei dataset. The top-ranking score is shown in red, and the second-best is shown in blue.
Methods Venue PSNR\(\uparrow\) SSIM\(\uparrow\)
KinD [34] MM’19 16.58 0.569
EnGAN [23] TIP’21 16.31 0.470
RUAS [50] CVPR’21 14.44 0.428
SNR-Aware [52] CVPR’22 20.67 0.591
RetinexFormer [57] ICCV’23 21.23 0.631
FourLLIE [35] MM’23 21.11 0.626
UHDFour [36] ICLR’23 19.39 0.600
Bread [53] IJCV’23 19.20 0.618
DarkIR [66] CVPR’25 18.93 0.583
Ours 21.35 0.627
Figure 9: Visual comparison of the enhanced images yielded by different methods on LSRW-Huawei.

4.5 Task-Relevant Visual Analysis↩︎

Beyond standard restoration metrics, low-light enhancement should also preserve visual cues that are relevant to high-level visual understanding, such as stable object boundaries, sufficient foreground–background contrast, and reliable local textures. An enhancement result that only increases brightness may still be suboptimal if it introduces color shifts, over-smoothed structures, or noise-amplified regions.

Figure 10: Task-relevant visual comparison on a representative LOL-v2-Real image using YOLOv10 detection model. The text above each box denotes the detected category and the number denotes the confidence score. Compared with existing methods, our method restores clearer object structures, more stable colors, and better foreground–background separation.

As shown in Fig. 10, the low-light input contains weak structural responses and poor local contrast, making scene contents difficult to distinguish for YOLOv10 [67]. KiND and Restormer improve the overall brightness, but some object boundaries remain unclear. RUAS produces stronger contrast, yet its aggressive enhancement may amplify edges and noise-like textures. CIDNet gives a relatively stable visual appearance, but some small structures are still weakened by residual darkness and over-smoothed details. In contrast, our method recovers more coherent illumination while maintaining sharper local structures and more natural chromaticity, achieving better detection of bicycles and motorcycles. The enhanced results suggest that the proposed intensity-chromaticity fusion helps preserve task-relevant semantic and structural cues in addition to improving pixel-level reconstruction.

4.6 Computational Complexity and Inference Efficiency↩︎

To further assess the practical efficiency of the proposed method, we compare the model complexity and inference time with representative LLIE methods, as reported in Table 5. Specifically, we report the number of parameters, FLOPs, and single-image inference time to provide a comprehensive view of computational cost. All measurements are conducted with an input resolution of \(256 \times 256\), and the inference time is evaluated on the same NVIDIA GeForce RTX 4090 platform used in our experiments.

Table 5: Comparison of model complexity and inference efficiency. The inference time is reported in milliseconds.
Params (M) FLOPs (G) Time (ms)
RetinexFormer [57] 1.53 15.85 8.96
LLFlow [51] 37.06 533.34 52.40
LLFormer [56] 24.55 44.07 30.37
CIDNet [21] 1.88 7.57 11.20
EnGAN [23] 8.64 32.85 1.23
Ours 2.75 62.09 19.38

As shown in Table 5, TCA-Net maintains a compact parameter size of 2.75M, which is substantially smaller than those of LLFlow and LLFormer. Although the proposed frequency-domain interaction and intensity-chromaticity fusion introduce additional FLOPs, the inference time remains lower than those of LLFlow and LLFormer. Compared with lightweight methods such as CIDNet and RetinexFormer, TCA-Net requires a moderate increase in computational cost but achieves stronger restoration performance, as shown in Table 1. At the selection-rule level, TCA forms the sparse mask through element-wise threshold comparison followed by re-normalization, whereas Top-\(\mathrm{K}\) sparsification requires ranking or sorting attention scores to enforce a fixed quota. Therefore, the extra cost of TCA-Net mainly comes from feature restoration modules, while the proposed pruning rule itself avoids explicit rank-based sorting overhead. These results suggest that TCA-Net provides a favorable trade-off among restoration quality, model compactness, and inference efficiency, rather than simply minimizing theoretical complexity.

Figure 11: Qualitative comparison of different attention mechanisms on the LOL-v1 dataset. The enlarged yellow and red regions highlight local texture and color restoration details.
Table 6: Sensitivity analysis of the threshold \(\tau\) in TCA on different LOL benchmarks.
Threshold LOL-v1 LOL-v2-real LOL-v2-synthetic
2-4 (lr)5-7 (lr)8-10 PSNR\(\uparrow\) SSIM\(\uparrow\) LPIPS\(\downarrow\) PSNR\(\uparrow\) SSIM\(\uparrow\) LPIPS\(\downarrow\) PSNR\(\uparrow\) SSIM\(\uparrow\) LPIPS\(\downarrow\)
0 25.016 0.871 0.076 23.390 0.892 0.118 25.706 0.942 0.042
0.020 24.589 0.874 0.072 23.564 0.870 0.124 25.669 0.941 0.044
0.025 25.322 0.876 0.069 24.171 0.872 0.109 26.023 0.944 0.040
0.030 24.781 0.869 0.066 23.190 0.862 0.128 25.776 0.942 0.042
0.040 25.167 0.880 0.071 23.555 0.876 0.111 25.463 0.928 0.047

4pt

4.7 Ablation Study↩︎

We conduct a series of ablation experiments on the LOL-v1 dataset to verify the effectiveness of the proposed components.

Component ablation. To analyze the contribution of PFIM, DDSGM, and SACR, we evaluate different model variants on the LOL-v1 dataset. Unless otherwise specified, TCA is used with \(\tau=0.025\). As shown in Table 7, each component contributes from a different perspective. PFIM alone achieves a PSNR of 23.792 dB, indicating that phase-guided frequency interaction provides useful structural cues for illumination recovery. DDSGM and SACR alone obtain higher PSNR values of 24.458 dB and 24.392 dB, respectively, demonstrating the benefits of residual intensity-guided fusion and scale-aware consistency regularization. When combined, these modules show clear complementary effects. In particular, PFIM+DDSGM improves the PSNR to 25.128 dB, and the full model obtains the strongest PSNR and LPIPS among the variants while maintaining competitive SSIM. These results verify that the proposed modules collaboratively improve illumination recovery, color fidelity, and perceptual quality.

Table 7: Ablation study on the contribution of PFIM, DDSGM, and SACR on the LOL-v1 dataset.
PFIM DDSGM SACR PSNR\(\uparrow\) SSIM\(\uparrow\) LPIPS\(\downarrow\)
23.809 0.857 0.079
24.099 0.852 0.113
24.458 0.878 0.078
24.392 0.860 0.080
25.128 0.876 0.072
24.300 0.858 0.095
24.570 0.872 0.077
25.322 0.876 0.069

Analysis of the threshold in TCA. We further analyze the influence of the confidence threshold \(\tau\) in TCA. This threshold controls the pruning strength of low-confidence cross-stream attention responses after Softmax normalization, so it is defined on a probability-level confidence scale rather than on dataset-dependent feature magnitudes. When \(\tau=0\), TCA degenerates into dense cross-attention without confidence-based pruning. As reported in Table 6, we evaluate five threshold values, i.e., 0, 0.020, 0.025, 0.030, and 0.040. Compared with dense cross-attention, setting \(\tau=0.025\) improves the PSNR from 25.016 dB to 25.322 dB and also improves SSIM from 0.871 to 0.876, indicating that removing weak attention responses helps suppress unreliable cross-stream interactions. Although \(\tau=0.030\) achieves the lowest LPIPS and \(\tau=0.040\) obtains the highest SSIM, both settings lead to lower PSNR, suggesting that overly aggressive pruning may discard useful dependencies for pixel-wise restoration. Therefore, we choose \(\tau=0.025\) as the final setting because it provides the strongest PSNR while maintaining competitive SSIM and LPIPS across the evaluated LOL benchmarks. Although TCA yields input- and layer-dependent sparse patterns through a fixed probability-level threshold, the threshold value itself is shared across inputs during inference. This simple design keeps the pruning rule stable and efficient, but a more flexible image- or layer-conditioned threshold may further adapt the pruning strength to varying illumination conditions, noise levels, and cross-stream attention distributions. We leave adaptive threshold estimation as future work.

Table 8: Ablation study on different sparse attention mechanisms.
Method PSNR\(\uparrow\) SSIM\(\uparrow\) LPIPS\(\downarrow\)
Full Cross-Attention w/o Pruning 25.016 0.871 0.076
Window-based Sparse Attention 24.222 0.866 0.072
Top-\(\mathrm{K}\) Attention (\(\rho=0.6\)) 25.093 0.871 0.070
Top-\(\mathrm{K}\) Attention (\(\rho=0.7\)) 24.561 0.869 0.073
TCA (Ours) 25.322 0.876 0.069

Ablation on attention selection rules. To further validate the effectiveness of TCA, we compare it with representative attention variants on the LOL-v1 dataset, including dense cross-attention, window-based sparse attention, and Top-\(\mathrm{K}\) sparse attention [44]. Dense cross-attention retains all cross-stream responses, window-based attention restricts interactions to fixed local regions, and Top-\(\mathrm{K}\) attention keeps a fixed proportion of the highest-ranking responses. In contrast, TCA removes low-confidence cross-stream dependencies according to Softmax-normalized attention probabilities.

As shown in Table 8, dense cross-attention achieves a PSNR of 25.016 dB, but it may propagate noise-corrupted responses because all non-zero attention weights are retained. Window-based sparse attention obtains a lower PSNR of 24.222 dB, suggesting that fixed local windows may limit global illumination recovery. For Top-\(\mathrm{K}\) attention, the two predefined fixed retention ratios \(\rho=0.6\) and \(\rho=0.7\) yield PSNR values of 25.093 dB and 24.561 dB, respectively. Neither setting achieves optimal model performance, as fixed pruning quotas ignore layer-wise and input-specific variations in attention distributions. By comparison, TCA obtains the strongest PSNR and SSIM in this comparison, with 25.322 dB PSNR and 0.876 SSIM. These results show that confidence-based pruning is more effective for reliable intensity-chromaticity fusion than dense interaction, fixed local windows, or fixed-ratio selection.

Visual analysis with representative attention mechanisms. To further validate TCA, we compare it with Top-\(\mathrm{K}\) sparsification and Swin Transformer attention on the LOL-v1 dataset [11], as shown in Fig. 11. In the upper row, Top-\(\mathrm{K}\) with \(\rho=0.7\) introduces visible color shifts and distortions in the zoomed-in regions, suggesting that its fixed retention ratio may preserve noisy responses while discarding useful dependencies. In the lower row, Swin Transformer attention improves brightness but still produces blurred textures and desaturated colors, indicating that fixed local-window attention may limit long-range illumination and texture recovery.

In contrast, TCA produces results closer to the reference in both cases. By pruning low-confidence cross-stream interactions according to Softmax-normalized attention probabilities, TCA better preserves informative dependencies, leading to more faithful color restoration and cleaner structural details.

5 Conclusion↩︎

This paper presents TCA-Net for reliable intensity-chromaticity fusion in the HVI space. TCA-Net improves cross-stream fusion through three coordinated designs: PFIM provides phase-guided frequency initialization for the intensity stream, TCA suppresses low-confidence interactions using a fixed confidence threshold with input-adaptive retained cardinality, and DDSGM reduces chromaticity-related interference via residual intensity guidance. SACR further regularizes the restored output with a decayed scale-consistency constraint during training. Experiments on five LLIE benchmarks show that TCA-Net achieves competitive performance on the LOL datasets, improves chromaticity fidelity on LOL-v1, and remains effective on extremely dark and mobile low-light scenarios while using only 2.75M parameters.

References↩︎

[1]
C. Li et al., “Low-light image and video enhancement using deep learning: A survey,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 44, no. 12, pp. 9396–9416, 2021.
[2]
J. Li et al., Light the Night: A multi-condition diffusion framework for unpaired low-light enhancement in autonomous driving,” in Proc. IEEE/CVF conf. Comput. Vis. Pattern recognit. (CVPR), 2024, pp. 15205–15215.
[3]
X. Lin, J. Yue, S. Ding, C. Ren, L. Qi, and M.-H. Yang, “Dual degradation representation for joint deraining and low-light enhancement in the dark,” IEEE Trans. Circuits Syst. Video Technol., 2024.
[4]
X. Lu, Y. Yuan, X. Liu, L. Wang, X. Zhou, and Y. Yang, “Low-light salient object detection by learning to highlight the foreground objects,” IEEE Trans. Circuits Syst. Video Technol., vol. 34, no. 8, pp. 7712–7724, 2024.
[5]
C. Lee, C. Lee, and C.-S. Kim, “Contrast enhancement based on layered difference representation of 2D histograms,” IEEE Trans. Image Process., vol. 22, no. 12, pp. 5372–5384, 2013.
[6]
S.-C. Huang, F.-C. Cheng, and Y.-S. Chiu, “Efficient contrast enhancement using adaptive gamma correction with weighting distribution,” IEEE Trans. Image Process., vol. 22, no. 3, pp. 1032–1041, 2013.
[7]
D. J. Jobson, Z. Rahman, and G. A. Woodell, “A multiscale retinex for bridging the gap between color images and the human observation of scenes,” IEEE Trans. Image Process., vol. 6, no. 7, pp. 965–976, 1997.
[8]
X. Guo, Y. Li, and H. Ling, “LIME: Low-light image enhancement via illumination map estimation,” IEEE Trans. Image Process., vol. 26, no. 2, pp. 982–993, 2016.
[9]
X. Fu, D. Zeng, Y. Huang, X.-P. Zhang, and X. Ding, “A weighted variational model for simultaneous reflectance and illumination estimation,” in Proc. IEEE conf. Comput. Vis. Pattern recognit. (CVPR), 2016, pp. 2782–2790.
[10]
K. G. Lore, A. Akintayo, and S. Sarkar, “LLNet: A deep autoencoder approach to natural low-light image enhancement,” Pattern Recognit., vol. 61, pp. 650–662, 2017.
[11]
C. Wei, W. Wang, W. Yang, and J. Liu, “Deep retinex decomposition for low-light enhancement,” in Proc. Brit. Mach. Vis. Conf. (BMVC), 2018, p. 155.
[12]
C. Guo et al., “Zero-reference deep curve estimation for low-light image enhancement,” in Proc. IEEE/CVF conf. Comput. Vis. Pattern recognit. (CVPR), 2020, pp. 1780–1789.
[13]
W. Yang, S. Wang, Y. Fang, Y. Wang, and J. Liu, “From fidelity to perceptual quality: A semi-supervised approach for low-light image enhancement,” in Proc. IEEE/CVF conf. Comput. Vis. Pattern recognit. (CVPR), 2020, pp. 3063–3072.
[14]
D. Liang et al., “Semantically contrastive learning for low-light image enhancement,” in Proc. AAAI conf. Artif. intell., 2022, vol. 36, pp. 1555–1563.
[15]
Z. Wang, X. Zhang, L. Chang, S. Chen, J. Ma, and H. Zhang, “InterLight: Leveraging intrinsic illumination priors for low-light image enhancement,” arXiv preprint arXiv:2605.19982, 2026.
[16]
X. Zhang, H. Zhang, G. Wang, Q. Zhang, L. Zhang, and B. Du, “UniUIR: Considering underwater image restoration as an all-in-one learner,” IEEE Trans. Image Process., vol. 34, pp. 6963–6977, 2025.
[17]
C. He et al., “Reti-diff: Illumination degradation image restoration with retinex-based latent diffusion model,” in Proc. Int. Conf. Learn. Represent. (ICLR), 2025.
[18]
H. Zhou, W. Dong, X. Liu, Y. Zhang, G. Zhai, and J. Chen, “Low-light image enhancement via generative perceptual priors,” in Proc. AAAI conf. Artif. intell., 2025, vol. 39, pp. 10752–10760.
[19]
Z. Zhang, H. Zheng, R. Hong, M. Xu, S. Yan, and M. Wang, “Deep color consistent network for low-light image enhancement,” in Proc. IEEE/CVF conf. Comput. Vis. Pattern recognit. (CVPR), 2022, pp. 1899–1908.
[20]
H. Wang, X. Yan, X. Hou, K. Zhang, and Y. Dun, “Extracting noise and darkness: Low-light image enhancement via dual prior guidance,” IEEE Trans. Circuits Syst. Video Technol., vol. 35, no. 2, pp. 1700–1714, 2024.
[21]
Q. Yan et al., “Hvi: A new color space for low-light image enhancement,” in Proc. IEEE/CVF conf. Comput. Vis. Pattern recognit. (CVPR), 2025, pp. 5678–5687.
[22]
F. Lv, F. Lu, J. Wu, and C. Lim, MBLLEN: Low-light image/video enhancement using CNNs,” in Proc. Brit. Mach. Vis. Conf. (BMVC), 2018, p. 220.
[23]
Y. Jiang et al., “Enlightengan: Deep light enhancement without paired supervision,” IEEE Trans. Image Process., vol. 30, pp. 2340–2349, 2021.
[24]
L. Ma, T. Ma, R. Liu, X. Fan, and Z. Luo, “Toward fast, flexible, and robust low-light image enhancement,” in Proc. IEEE/CVF conf. Comput. Vis. Pattern recognit. (CVPR), 2022, pp. 5637–5646.
[25]
S. Zhou, C. Li, and C. Change Loy, “Lednet: Joint low-light enhancement and deblurring in the dark,” in Proc. Eur. Conf. Comput. Vis. (ECCV), 2022, pp. 573–589.
[26]
Y. Shi et al., “Scaling up single image dehazing algorithm by cross-data vision alignment for richer representation learning and beyond,” IEEE Trans. Instrum. Meas., vol. 74, pp. 1–9, 2025, doi: 10.1109/TIM.2025.3558788.
[27]
T. Chobola, Y. Liu, H. Zhang, J. A. Schnabel, and T. Peng, “Fast context-based low-light image enhancement via neural implicit representations,” in Proc. Eur. Conf. Comput. Vis. (ECCV), 2024, pp. 413–430.
[28]
J. Bai, Y. Yin, Q. He, Y. Li, and X. Zhang, “Retinexmamba: Retinex-based mamba for low-light image enhancement,” in Proc. Int. Conf. Neural inf. Process. (ICONIP), 2024, pp. 427–442.
[29]
X. Di et al., QMambaBSR: Burst image super-resolution with query state space model,” arXiv preprint arXiv:2408.08665, 2024.
[30]
R. Xu, Y. Niu, Y. Li, H. Xu, W. Liu, and Y. Chen, URWKV: Unified RWKV model with multi-state perspective for low-light image restoration,” in Proc. IEEE/CVF conf. Comput. Vis. Pattern recognit. (CVPR), 2025, pp. 21267–21276.
[31]
C. She, F. Han, L. Wang, S. Duan, and T. Huang, “MPC-net: Multi-prior collaborative network for low-light image enhancement,” IEEE Trans. Circuits Syst. Video Technol., vol. 34, no. 10, pp. 10385–10398, 2024, doi: 10.1109/TCSVT.2024.3408007.
[32]
L. Guo, R. Wan, W. Yang, A. Kot, and B. Wen, “Cross-image disentanglement for low-light enhancement in real world,” IEEE Trans. Circuits Syst. Video Technol., vol. 34, no. 4, pp. 2550–2563, 2024, doi: 10.1109/TCSVT.2023.3303574.
[33]
Q. Zhou et al., DFVO: Learning darkness-free visible and infrared image disentanglement and fusion all at once,” IEEE Trans. Instrum. Meas., vol. 74, pp. 1–12, 2025, doi: 10.1109/TIM.2025.3572155.
[34]
Y. Zhang, J. Zhang, and X. Guo, “Kindling the darkness: A practical low-light image enhancer,” in Proc. ACM int. Conf. Multimedia (ACM MM), 2019, pp. 1632–1640.
[35]
C. Wang, H. Wu, and Z. Jin, “Fourllie: Boosting low-light image enhancement by fourier frequency information,” in Proc. ACM int. Conf. Multimedia (ACM MM), 2023, pp. 7459–7469.
[36]
C. Li et al., “Embedding fourier for ultra-high-definition low-light image enhancement,” arXiv preprint arXiv:2302.11831, 2023.
[37]
T. Zhang, P. Liu, M. Zhao, and H. Lv, DMFourLLIE: Dual-stage and multi-branch fourier network for low-light image enhancement,” in Proc. ACM int. Conf. Multimedia (ACM MM), 2024, pp. 7434–7443.
[38]
C. She, F. Han, C. Fang, S. Duan, and L. Wang, “Exploring fourier prior and event collaboration for low-light image enhancement,” in Proc. ACM int. Conf. Multimedia (ACM MM), 2025, pp. 3017–3026.
[39]
R. Child, “Generating long sequences with sparse transformers,” arXiv preprint arXiv:1904.10509, 2019.
[40]
M. Zaheer et al., “Big bird: Transformers for longer sequences,” Adv. Neural Inf. Process. Syst., vol. 33, pp. 17283–17297, 2020.
[41]
X. Zhu, W. Su, L. Lu, B. Li, X. Wang, and J. Dai, “Deformable detr: Deformable transformers for end-to-end object detection,” arXiv preprint arXiv:2010.04159, 2020.
[42]
L. Zhu, X. Wang, Z. Ke, W. Zhang, and R. W. Lau, “Biformer: Vision transformer with bi-level routing attention,” in Proc. IEEE/CVF conf. Comput. Vis. Pattern recognit. (CVPR), 2023, pp. 10323–10333.
[43]
Z. Liu et al., “Swin transformer: Hierarchical vision transformer using shifted windows,” in Proc. IEEE/CVF int. Conf. Comput. Vis. (ICCV), 2021, pp. 10012–10022.
[44]
X. Chen, H. Li, M. Li, and J. Pan, “Learning a sparse transformer network for effective image deraining,” in Proc. IEEE/CVF conf. Comput. Vis. Pattern recognit. (CVPR), 2023, pp. 5896–5905.
[45]
A. Martins and R. Astudillo, “From softmax to sparsemax: A sparse model of attention and multi-label classification,” in Proc. Int. Conf. Mach. Learn. (ICML), 2016, pp. 1614–1623.
[46]
G. M. Correia, V. Niculae, and A. F. Martins, “Adaptively sparse transformers,” in Proc. Conf. Empirical methods natural lang. Process. Int. Joint conf. Natural lang. Process. (EMNLP-IJCNLP), 2019, pp. 2174–2184.
[47]
B. Zhang, I. Titov, and R. Sennrich, “Sparse attention with linear units,” in Proc. Conf. Empirical methods natural lang. Process. (EMNLP), 2021, pp. 6507–6520.
[48]
Y. Bondarenko, M. Nagel, and T. Blankevoort, “Quantizable transformers: Removing outliers by helping attention heads do nothing,” arXiv, vol. abs/2306.12929, 2023.
[49]
Z. Ni, X. Chen, Y. Zhai, Y. Tang, and Y. Wang, “Context-guided spatial feature reconstruction for efficient semantic segmentation,” in Proc. Eur. Conf. Comput. Vis. (ECCV), 2024, pp. 239–255.
[50]
R. Liu, L. Ma, J. Zhang, X. Fan, and Z. Luo, “Retinex-inspired unrolling with cooperative prior architecture search for low-light image enhancement,” in Proc. IEEE/CVF conf. Comput. Vis. Pattern recognit. (CVPR), 2021, pp. 10561–10570.
[51]
Y. Wang, R. Wan, W. Yang, H. Li, L.-P. Chau, and A. Kot, “Low-light image enhancement with normalizing flow,” in Proc. AAAI conf. Artif. intell., 2022, vol. 36, pp. 2604–2612.
[52]
X. Xu, R. Wang, C.-W. Fu, and J. Jia, “Snr-aware low-light image enhancement,” in Proc. IEEE/CVF conf. Comput. Vis. Pattern recognit. (CVPR), 2022, pp. 17714–17724.
[53]
X. Guo and Q. Hu, “Low-light image enhancement via breaking down the darkness,” Int. J. Comput. Vis., vol. 131, no. 1, pp. 48–66, 2023.
[54]
Z. Fu, Y. Yang, X. Tu, Y. Huang, X. Ding, and K.-K. Ma, “Learning a simple low-light image enhancer from paired low-light instances,” in Proc. IEEE/CVF conf. Comput. Vis. Pattern recognit. (CVPR), 2023, pp. 22252–22261.
[55]
S. W. Zamir, A. Arora, S. Khan, M. Hayat, F. S. Khan, and M.-H. Yang, “Restormer: Efficient transformer for high-resolution image restoration,” in Proc. IEEE/CVF conf. Comput. Vis. Pattern recognit. (CVPR), 2022, pp. 5728–5739.
[56]
T. Wang, K. Zhang, T. Shen, W. Luo, B. Stenger, and T. Lu, “Ultra-high-definition low-light image enhancement: A benchmark and transformer-based method,” in Proc. AAAI conf. Artif. intell., 2023, vol. 37, pp. 2654–2662.
[57]
Y. Cai, H. Bian, J. Lin, H. Wang, R. Timofte, and Y. Zhang, “Retinexformer: One-stage retinex-based transformer for low-light image enhancement,” in Proc. IEEE/CVF int. Conf. Comput. Vis. (ICCV), 2023, pp. 12504–12513.
[58]
W. Wang, H. Yang, J. Fu, and J. Liu, “Zero-reference low-light enhancement via physical quadruple priors,” in Proc. IEEE/CVF conf. Comput. Vis. Pattern recognit. (CVPR), 2024, pp. 26057–26066.
[59]
W. Yang, W. Wang, H. Huang, S. Wang, and J. Liu, “Sparse gradient regularized deep retinex network for robust low-light image enhancement,” IEEE Trans. Image Process., vol. 30, pp. 2072–2086, 2021.
[60]
J. Hai et al., “R2rnet: Low-light image enhancement via real-low to real-normal network,” J. Vis. Commun. Image Represent., vol. 90, p. 103712, 2023.
[61]
C. Chen, Q. Chen, J. Xu, and V. Koltun, “Learning to see in the dark,” in Proc. IEEE conf. Comput. Vis. Pattern recognit. (CVPR), 2018, pp. 3291–3300.
[62]
Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, “Image quality assessment: From error visibility to structural similarity,” IEEE Trans. Image Process., vol. 13, no. 4, pp. 600–612, 2004.
[63]
R. Zhang, P. Isola, A. A. Efros, E. Shechtman, and O. Wang, “The unreasonable effectiveness of deep features as a perceptual metric,” in Proc. IEEE/CVF conf. Comput. Vis. Pattern recognit. (CVPR), 2018, pp. 586–595.
[64]
A. R. Robertson, “The CIE 1976 color-difference formulae,” Color Res. Appl., vol. 2, no. 1, pp. 7–11, 1977, doi: 10.1002/j.1520-6378.1977.tb00104.x.
[65]
W. Wu, J. Weng, P. Zhang, X. Wang, W. Yang, and J. Jiang, “URetinex-net: Retinex-based deep unfolding network for low-light image enhancement,” in Proc. IEEE/CVF conf. Comput. Vis. Pattern recognit. (CVPR), 2022, pp. 5901–5910.
[66]
D. Feijoo, J. C. Benito, A. Garcia, and M. V. Conde, “DarkIR: Robust low-light image restoration,” in Proc. IEEE/CVF conf. Comput. Vis. Pattern recognit. (CVPR), 2025, pp. 10879–10889.
[67]
A. Wang et al., YOLOv10: Real-time end-to-end object detection,” arXiv preprint arXiv:2405.14458, 2024.

  1. This work was supported by the National Natural Science Foundation of China under Grant 62302105, and in part by Funding by Science and Technology Projects in Guangzhou under Grant 2025A04J3851. (Yanyi Wu and Xu Zhang contributed equally to this work.)(Corresponding author: Huan Zhang.)↩︎

  2. Yanyi Wu, Junkai Chen, Jianglei Di, and Huan Zhang are with the School of Information Engineering, Guangdong University of Technology, Guangzhou 510000, China (e-mail: wuyanyi@mails.gdut.edu.cn; chenjunkai1@mails.gdut.edu.cn; jiangleidi@gdut.edu.cn; huanzhang2021@gdut.edu.cn).↩︎

  3. Xu Zhang and Laibin Chang are with the School of Computer Science, Wuhan University, Wuhan 430000, China (e-mail: zhangx0802@whu.edu.cn; changlb666@whu.edu.cn).↩︎

  4. Jiaqi Ma is with the Department of Computer Vision, Mohamed bin Zayed University of Artificial Intelligence, Abu Dhabi, United Arab Emirates (e-mail: jiaqi.ma@mbzuai.ac.ae).↩︎

  5. Shi Chen is with the Department of Computer Science, University of Macau, Macau 999078, China (e-mail: chenshi@um.edu.mo).↩︎

  6. Linwei Zhu is with the Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China (e-mail: lw.zhu@siat.ac.cn).↩︎