WorksComputer Science
STARS: Stage-Adaptive Responsibility Separation for Shadow Removal in Remote Sensing Images
Abstract
Shadows are a ubiquitous radiative attenuation phenomenon in remote sensing images and can severely affect high-resolution remote sensing interpretation tasks. In shadow removal, although introducing a mask prior provides explicit positional information for the restoration network, it also causes non-shadow regions to be modulated by the shadow prior, producing a systematic brightness shift; notably, this phenomenon is independent of whether the mask is accurate. In remote sensing images, non-shadow regions usually occupy a larger proportion, so a small shift over these regions incurs a much higher cost on whole-image metrics than an equal gain in shadow regions. Adopting a task-decoupling perspective, we therefore decompose shadow removal into two tasks, shadow-region restoration and non-shadow-region identity, within a cascaded architecture, and handle them sequentially. Based on this insight, we propose STARS, a cascaded shadow removal framework that separates regional responsibilities across stages. The method retains the advantages of the shadow mask while resolving the degradation of non-shadow regions, without requiring a complex parallel dual-branch structure. Meanwhile, to introduce large-model prior knowledge into remote sensing tasks, we further design a Feature Selection and Fusion Adapter (FSFA). We conduct extensive experiments on three benchmark datasets, UAV-SC+, ISTD+ and WSRD+ 2026, demonstrating the superiority of STARS. The framework shows that decoupling regional responsibilities can resolve the intrinsic contradiction of mask priors, providing a new direction for image restoration with region heterogeneity.
Introduction
Shadows are a radiative attenuation phenomenon caused by objects occluding light [1, 2]. In high-resolution optical remote sensing images, shadows weaken the radiance information within shadowed areas, compress the dynamic range and alter the spectral distribution, posing significant interference to downstream tasks such as object detection and semantic segmentation [1, 2, 3, 4]. Shadow removal is therefore an important research direction in remote sensing image processing [1, 2]. In recent years, deep-learning-based shadow removal has advanced rapidly [1, 2, 5]. The shadow mask provides the most direct positional prior for the removal network: the detected shadow region exactly indicates the area to be restored, and introducing it as an input channel or an attention condition can substantially improve restoration quality in shadowed regions [6, 7, 8].
However, models that use a mask prior often exhibit the following phenomenon: for mask-conditioned networks such as ShadowFormer, the shadow and non-shadow regions are optimized jointly by a single set of weights, the two tasks compete during optimization, and the fidelity of non-shadow regions degrades markedly; for models such as SGCR-SR that originally contain no mask prior, directly introducing the mask improves restoration in shadowed regions but induces a systematic brightness shift in non-shadow regions, as shown in Figure 1.

Figure 1. Comparison between a method without a mask (SGCR-SR) and a method with a mask prior (ShadowFormer). ShadowFormer restores the shadow region better but exhibits an obvious brightness shift in the non-shadow region, whereas our method (Ours) achieves better restoration quality in both regions.
In remote sensing images, shadowed areas typically occupy only a small fraction of the whole image; sacrificing large non-shadow regions for better shadow restoration incurs losses far exceeding the gains. Methods that abandon the mask (e.g., OmniSR [11], SGCR-SR [9]) circumvent this problem but also discard the positional prior, limiting shadow restoration. This paper therefore seeks to retain the spatial prior of the mask while systematically resolving its side effect on non-shadow regions. The key to this lies in decoupling shadow removal by region: the task of the shadow region is to remove the shadow, whereas the task of the non-shadow region is to remain unchanged, and the two conflicting regional tasks should be explicitly separated and accomplished sequentially.
We realize this decoupling with a cascaded architecture and the shadow mask. In a cascade, the output of the previous stage is the input of the next, so a complex task can naturally be split across stages, and each stage has independent parameters, so adjusting the responsibility of one stage does not alter the structure of the others. Meanwhile, the shadow mask is an explicit regional marker. Combining the two, we let the shadow mask serve as a regional task marker so that the two conflicting regional tasks are assigned to different stages of the cascade, realizing an explicit division of regional tasks. Based on this understanding, we propose a responsibility separation strategy, STARS (Stage-Adaptive Responsibility Separation), with the following contributions:
We propose a cascaded responsibility separation strategy. This design turns the mask from a conventional spatial conditioning input into an explicit mechanism for coordinating regional restoration tasks across stages; the shadow removal task is decoupled into two regional subtasks that are assigned to different stages and accomplished sequentially.
We design a feature selection and fusion adapter that transfers DINOv3 semantic features, developed for natural images, to remote sensing shadow removal, offering a new solution for feature transfer and fusion between natural and remote sensing images.
We design a region-specific loss for non-shadow regions, which guarantees at the optimization level that the assigned responsibilities are actually executed, complementing the structural division.
Related Work
Shadow Processing in Remote Sensing Images
Shadow processing in remote sensing has evolved from physical models to data-driven methods. Early methods predict shadow extents using solar geometry parameters and digital elevation models (DEM) [12, 13], or estimate illumination compensation in shadowed regions with complex irradiance models [14, 15]; feature-based methods extract shadow attributes in specific color spaces and texture domains and apply thresholds [16]. These methods rely on high-accuracy auxiliary data or hand-crafted features, adapt poorly to complex urban environments, and often produce incomplete detections or hard reconstruction artifacts [12, 13, 15].
In recent years, deep learning has become the mainstream. Shadow detection in remote sensing follows binary semantic segmentation, and dense prediction frameworks such as U-Net with spatial attention have significantly improved detection accuracy in complex scenes [5]. Remote sensing shadow removal advances along two lines: end-to-end networks without shadow detection, e.g., ESCNet [1] builds the UAV-SC benchmark and performs restoration and radiometric correction with two subnets, and methods targeting shadow distribution properties, e.g., RMMamba [2] balances shadow pixels via random rearrangement and a color prior, while RSMamba [17] combines a Retinex prior with state-space modeling.
Methods in the natural image domain fall into two categories: mask conditioning (ST-CGAN [6] takes the mask as input; ShadowFormer [8] uses mask-weighted residuals and attention) and regional modeling (DMTN [18] decouples detection and removal; RASM [19] applies regional attention). Both complete the restoration of the two regions with shared weights; the mask prior degrades non-shadow fidelity, and the regional conflict remains unresolved at the structural level.
Semantic and Geometric Guidance and Cascaded Refinement
Task-agnostic representations from self-supervised visual foundation models are widely used as frozen guidance for restoration: DINOv2 [20] demonstrates the robustness and transferability of self-supervised ViT features, DINOv3 [21] extends the training to large-scale data, and Depth Anything v2 [22] provides monocular depth from which point maps and normals can be derived; OmniSR [11] and SGCR-SR [9] introduce such cues into shadow removal as representative baselines. Progressive refinement, where later stages correct residual artifacts of earlier ones [23, 24], is a classical restoration paradigm: ESCNet [1] divides restoration and radiometric compensation into two stages, while Li et al. [10] prove that shadow restoration and non-shadow identity mapping are incompatible under shared weights and propose parallel dual branches (IMB/IDB) to separate them.
Method
Overall Framework
Given a shadow image , the goal is to reconstruct a shadow-free image . We use a three-stage refinement cascade in which each stage keeps the ShadowFormer [8, 9] backbone; a single stage is shown in Figure 3. Let denote the semantic features extracted from the input; the geometric guidance, where is the normalized depth channel concatenated with RGB, and and are the point map and surface normal obtained by back-projecting depth, respectively; denotes the soft shadow mask. Let denote the -th stage backbone; the cascade is defined as

Figure 3. Structure of the improved ShadowFormer stage. (A) Single-stage backbone: the shadow mask serves as an additional input channel and participates in feature extraction together with the shadow image and depth ; (B) attention modulation: geometric cues and multi-scale semantic features modulate the SIM block attention, and semantic features are also concatenated into the bottleneck; (C) residual guidance: the backbone residual is weighted by the mask and a learnable coefficient , realizing structural-level regional responsibility division.
with the final prediction . Unlike previous work that uses the mask merely as a positional prior, our model lets the mask carry cross-stage responsibility assignment: stages receive masks in different forms ( or ), and the output residuals are gated by the mask in different directions, turning the stage division from an implicit, data-driven formation into an explicit structural specification. The overall framework is shown in Figure 2.

Figure 2. Overall framework. Our method consists of three parts: A, guidance extraction, which extracts semantic and geometric information with a frozen DINOv3 backbone and Depth Anything V2, respectively; C, an offline shadow mask detection head, a lightweight shadow detector trained on the AISD dataset and UAV-SC+ paired data, which extracts the shadow mask; B, a three-stage cascade composed of three consecutively connected ShadowFormers. STARS is embodied by the mask direction at each stage ( / ) and the residual modulation direction, and constrains only the non-shadow region of Stage 3.
STARS: Cascaded Responsibility Separation Strategy
As discussed in the introduction, injecting the mask into a shared-weight network causes a systematic brightness shift in non-shadow restoration that cannot be effectively alleviated. We therefore change the strategy: instead of trying to prevent the brightness shift in non-shadow regions, we allow it to appear first and then decouple the correction of the brightness shift from shadow removal as a new task assigned to the last stage. In the three-stage cascade used here, this decoupling and division are guided by a bidirectional shadow mask.
Offline Acquisition of the Shadow Mask
The core of cascaded responsibility separation is the shadow mask . Since remote sensing scenes lack manual shadow annotations and no ground-truth mask exists at inference time, can only be estimated from the shadow image itself, independently of the removal network, so as to avoid coupling with model parameters. We generate shadow probability maps with a frozen DINOv3 encoder and a lightweight decoding head: the head is first pretrained on the annotated AISD dataset [25], and then domain-adapted via proxy supervision constructed from the paired remote sensing dataset UAV-SC+ [1]. At inference, only the shadow image is fed, and the output probability map is binarized and softened to obtain . The mask is generated offline and kept fixed as a conditional input to the removal network; it does not participate in its training or inference updates.
Bidirectional Mask Input Channels
Introducing the shadow mask as an input channel is the lightest way to preserve the positional prior: at every stage the network directly sees where to operate, without extra branches or structural changes.
The soft mask obtained in § 3.2.1 enters the main restorer as the regional condition. The regional conditions of the three stages are defined as
Hence stages 1–2 take as input, and stage 3 takes . The mask is concatenated after depth ; the first four RGB-D channels remain unchanged, and the input-layer weights corresponding to the added channel are zero-initialized.
This design gives the mask different semantics across stages: for the first two stages, marks the shadow region to be restored, so restoration focuses there; for the last stage, hides the already-restored shadow region from its input, while marking the non-shadow region to be corrected. The mask thus serves as both a positional prior and a cross-stage task-allocation signal, separating regional responsibilities structurally.
Bidirectional Mask Residual Guidance
Input channels alone are not sufficient to realize the division of labor at each stage. We further apply a learnable mask gate to the residual at the output of each stage:
where is the residual predicted by the -th backbone, is the stage input, and is a learnable scalar per stage. The gating direction follows the regional responsibility of the stage: the first two stages use the shadow-region residual with a ratio tending to a constant, concentrating restoration energy inside shadows; the last stage fully uses the non-shadow residual and excludes the shadow residual, which cannot interfere with the regions already restored. Compared with feature-level modulation, this position produces the missing restoration information rather than scaling corrupted features. At initialization the gate equals the original residual connection, preserving the backbone’s refinement capability, and has non-zero gradients at the initial point, so each stage can learn its guidance strength.
Non-Shadow Region-Specific Supervision
The structural division specifies the last stage’s responsibility architecturally, but the non-shadow shift is small: with the global loss alone, the gradient vanishes as the error approaches zero and the last stage tends to make no correction. We therefore introduce non-shadow-region-specific supervision for the last stage:
This loss counts only non-shadow regions and excludes the shadow region from the gradient, so the last stage’s signal comes entirely from its responsibility scope without disturbing the first two stages; the L1 form keeps the gradient constant near zero and provides a strong drive for non-shadow regions.
Feature Selection and Fusion Adapter
Shadow contexts in remote sensing images are diverse, and the representation of the restoration network alone can hardly provide sufficient semantic cues. Large models pre-trained on natural images offer strong semantic priors, but this prior cannot be introduced directly into the cascade: existing restoration networks were trained on the feature distributions of specific semantic backbones, and the output features of different backbones are biased; direct connection would substantially degrade performance [20, 21]. To introduce the frozen DINOv3 semantic prior into remote sensing shadow removal, we design a feature selection and fusion adapter for the intermediate layers of ShadowFormer, whose structure is shown in Figure 4.

Figure 4. Structure of the semantic guidance adapter. The adapter first aligns the distributions of the features of each DINOv3 layer, then softly selects feature layers from the mid-level and deep pools with learnable weights, and finally fuses mid-level details with deep semantics through gated residuals.
The adapter first calibrates the features of each DINOv3 layer with per-image statistics (Eq. (5)) to capture cross-layer distribution differences, then performs interface adaptation with a low-gain bottleneck residual (Eq. (6)), obtaining calibrated features and separating shallow and deep semantics.
where and are the mean and standard deviation computed over the spatial positions of the same image and channel, respectively; is a positive stability term.
where is a layer-wise learnable scaling coefficient; and are the dimension-reduction and dimension-expansion projections, respectively; and denote group normalization and nonlinear reparameterization; is the learnable gate bias of the bottleneck residual branch; and is the sigmoid function. This transformation aligns the translation and scale of each layer’s features, so that layers can be fused in the shared interface while preserving the spatial distribution within each channel.
DINOv3 has many intermediate layers with different semantics; rather than hard-specifying several layers, we set learnable pooling weights with and (Eq. (7)), so that the adapter learns which layers to select and obtains .
where denotes the -th adapter output; and denote the pooled mid-level detail and deep-level semantic results of the -th output, respectively; and is a learnable logit for output , candidate layer and pooling type .
Selected layers spread over the deep pool and the mid-level pool : deep features are semantically strong but spatially coarse, whereas mid-level features are detail-rich but less abstract. A gated residual injects mid-level details into the deep semantic map so that the two levels complement each other (Eq. (8)), and the resulting modulates attention.
where is a projection residual branch acting only on , and is the mid-deep fusion branch.
Experiments
Experimental Settings
Datasets We conduct experiments on three challenging datasets, UAV-SC+ [1], ISTD+ [6, 26] and WSRD+ 2026 [27, 28], to validate the effectiveness of our method.
UAV-SC+ UAV-SC+ is a UAV remote sensing shadow correction benchmark refined from UAV-SC [1]. It provides paired shadow images and corresponding shadow-free reference images, with 5,771 pairs for training and 30 pairs for testing.
ISTD+ ISTD+ is a classic benchmark for natural-scene shadow removal, obtained by color-correcting ISTD [6, 26]. It consists of shadow images, shadow masks and shadow-free reference images, with 1,330 training groups and 540 testing groups.
WSRD+ 2026 WSRD+ 2026 is the benchmark adopted by the CVPR 2026 NTIRE Image Shadow Removal Challenge [27], evolved from the WSRD series of datasets [28]. It contains 836 and 150 pairs for training and testing, respectively.
Evaluation Metrics Following prior work [8, 9, 10], we report three widely used objective metrics: PSNR, SSIM [29] and LPIPS [30]. PSNR measures pixel-level fidelity, SSIM measures structural similarity in terms of luminance, contrast and structure, and LPIPS reflects texture details and perceptual naturalness.
Moreover, the core of our method is to resolve the side effect of the mask prior on non-shadow regions, and reporting whole-image metrics alone would conceal the performance difference between shadow and non-shadow regions. To reflect the behavior of the proposed method under practical deployment conditions, we further report PSNR on the shadow and non-shadow regions separately according to the shadow mask. In the following tables, S., N.S. and All denote the metrics on the shadow region, the non-shadow region and the whole image, respectively.
Implementation Details
Shadow Mask Extraction On the AISD dataset, we resize images to and train a lightweight shadow detection head on the intermediate features of layers 4, 8, 12, 16, 20 and 23 of a frozen DINOv3 [21] ViT-L/16 backbone for 100 epochs, with batch size 4, initial learning rate , weight decay , and cosine annealing to 5% of the initial learning rate. To better adapt the head to remote sensing images, we select 2,157 shadow/shadow-free image pairs from UAV-SC+ [1], obtain shadow masks by image differencing, and fine-tune the head. During training and inference on UAV-SC+, the output of the head is binarized and softened, and then used as the conditional input to the main restorer and for region-wise evaluation; an example of mask estimation is shown in Figure 5.

Figure 5. Examples of shadow mask estimation by the shadow detection head on UAV-SC+ images. After fine-tuning on UAV-SC+ shadow/non-shadow image pairs, the head achieves IoU 0.8607, F1 0.9252 and recall 0.9477 on the AISD dataset, indicating that it outputs trustworthy shadow masks.
Cascade Training All experiments are conducted on a single NVIDIA RTX A6000 GPU. We adopt three-stage progressive training with the AdamW optimizer: on UAV-SC+, the first, second and third stages are trained for 150, 250 and 90 epochs, which takes about 10 days in total, with learning rates of , and , which are cosine-annealed to , and , respectively, and the responsibility separation strategy takes full effect only from the third stage. For ISTD+ and WSRD+ 2026, the numbers of training epochs are scaled according to dataset size. The loss function adopts different configurations at different stages, as shown in Eq. (9). Since UAV-SC+ and WSRD+ 2026 have no officially annotated shadow masks, we use the output of the shadow detection head; for ISTD+, the official shadow masks are used. The training objectives of the stages are defined as
where , and are the training losses of phase 1, phase 2 and phase 3, respectively.
Comparison with State-of-the-Art Methods
The left part of Table 1 compares our method with state-of-the-art methods on the UAV-SC+ dataset. We rank first in whole-image PSNR (26.65 dB), and the PSNR in both the shadow and non-shadow regions is substantially improved (34.57 dB and 28.08 dB), which shows that our method not only improves the restoration quality of the shadow region but also effectively alleviates the degradation of the non-shadow region. Meanwhile, SSIM and LPIPS reach 0.897 and 0.0772, respectively, indicating that the mask prior better preserves region boundaries and texture details. The shadow removal results on UAV-SC+ are shown in Figure 6.
| UAV-SC+ dataset | ISTD+ dataset | ||||||||||
| Method | PSNR (dB) | SSIM | LPIPS | Method | PSNR (dB) | SSIM | LPIPS | ||||
| S. | N.S. | All | S. | N.S. | All | ||||||
| Mask-ShadowGAN [31] | 27.57 | 20.45 | 19.13 | 0.737 | 0.5754 | SP+M-Net [26] | 36.16 | 35.84 | 32.33 | 0.9479 | 0.0716 |
| G2R-ShadowNet [32] | 24.69 | 17.98 | 16.83 | 0.718 | 0.3376 | Param+M+D-Net [36] | 33.59 | 34.33 | 30.12 | 0.9420 | 0.0759 |
| DMTN [18] | 31.60 | 24.15 | 23.02 | 0.819 | 0.3059 | Fu et al. [37] | 36.41 | 31.01 | 29.43 | 0.8404 | 0.1673 |
| DHAN [33] | 33.06 | 25.17 | 24.13 | 0.862 | 0.3005 | LG-ShadowNet [38] | 32.65 | 33.36 | 29.20 | 0.9335 | 0.0920 |
| ShadowFormer [8] | 32.71 | 24.37 | 23.44 | 0.835 | 0.3053 | DC-ShadowNet [39] | 32.20 | 33.21 | 28.76 | 0.9219 | 0.1112 |
| TBRNet [34] | 31.22 | 23.66 | 22.57 | 0.772 | 0.3103 | G2R-ShadowNet [32] | 34.01 | 34.62 | 30.49 | 0.9330 | 0.0868 |
| NeFour [35] | 33.11 | 25.32 | 24.25 | 0.872 | 0.2989 | BMNet [40] | 37.30 | 35.06 | 32.30 | 0.9551 | 0.0567 |
| RASM [19] | 33.34 | 25.73 | 24.63 | 0.874 | 0.2994 | SG-ShadowNet [41] | 37.41 | 34.95 | 32.41 | 0.9524 | 0.0594 |
| RSMamba [17] | 33.20 | 25.48 | 24.41 | 0.874 | 0.2774 | Ours | |||||
| Ours | 34.57 | 28.08 | 26.65 | 0.897 | 0.0772 | Ours | 38.72 | 37.47 | 34.22 | 0.9612 | 0.0206 |
Table 1. Quantitative comparison with representative methods on UAV-SC+ and ISTD+. PSNR is reported on the shadow region (S.), the non-shadow region (N.S.) and the whole image (All) at ; SSIM and LPIPS are computed on the whole image. Best results are in bold.

Figure 6. Visual comparison of shadow removal on the UAV-SC+ dataset.
The right part of Table 1 compares our method with 8 representative methods on the ISTD+ dataset. Our method achieves the best results on all five metrics: the shadow-region and non-shadow-region PSNR are improved by 1.31 dB and 1.63 dB over the best respective baselines, and whole-image PSNR, SSIM and LPIPS also lead across the board. The other methods exhibit a clear trade-off between the two types of regions, whereas our method is optimal in both regions simultaneously, showing that the improvement in shadow removal quality achieved by cascaded responsibility separation is not limited to remote sensing images but also holds for natural images; the simultaneous improvement of SSIM and LPIPS also indicates that our method improves both structural fidelity and perceptual quality. Figure 7(a) shows the visual comparison on the ISTD+ dataset.

Figure 7. Visual comparison of shadow removal on the ISTD+ and WSRD+ 2026 datasets.
Table 2. On the WSRD+ 2026 dataset, we compare our method with the baseline SGCR-SR under identical test conditions. PSNR is reported on the shadow region, the non-shadow region and the whole image, respectively.
| Method | PSNR (dB) | SSIM | LPIPS | ||
| S. | N.S. | All | |||
| SGCR-SR [9] | 28.816 | 29.066 | 28.964 | 0.8992 | 0.0769 |
| Ours | 30.618 | 29.738 | 29.796 | 0.9029 | 0.0420 |
Table 2.
Table 2 compares our method with SGCR-SR, the winning solution of the CVPR 2026 NTIRE Image Shadow Removal Challenge. On the WSRD+ 2026 dataset, our method improves the PSNR on the shadow region, non-shadow region and whole image by 1.80 dB, 0.67 dB and 0.83 dB, respectively, improves SSIM by 0.0037 and reduces LPIPS by 0.0349, outperforming the winning solution on all metrics. Figure 7(b) shows the visual comparison on the WSRD+ 2026 dataset.
Ablation Study
We propose three modules: the responsibility separation strategy (STARS), the feature selection and fusion adapter (FSFA) and the non-shadow region-specific loss (). To verify the effectiveness of each module, we conduct a module-wise ablation on the UAV-SC+ dataset; the results are shown in Table 3. To ensure a fairer comparison, all metrics in the table are computed at the whole-image resolution. Therefore, the results of the full model differ noticeably from those in Table 1.
Table 3. Ablation results on the UAV-SC+ dataset.
| Method | PSNR (dB) ↑ | SSIM ↑ | LPIPS ↓ | ||
| S. | N.S. | All | |||
| Full model | 33.74 | 26.58 | 25.35 | 0.817 | 0.1743 |
| w/o STARS | 33.70 | 26.48 | 25.26 | 0.806 | 0.1683 |
| w/o FSFA | 32.68 | 25.30 | 24.01 | 0.804 | 0.1922 |
| w/o | 33.74 | 26.55 | 25.32 | 0.805 | 0.1686 |
Table 3 (PDF p. 8).
In Table 3, removing FSFA decreases the three PSNR values by 1.06/1.28/1.34 dB and degrades LPIPS from 0.1743 to 0.1922, which is the most obvious degradation, indicating that the large-model semantic prior is fundamental to cascade restoration; removing STARS decreases the whole-image PSNR by 0.09 dB and SSIM by 0.011, and the loss in the non-shadow region (0.10 dB) is larger than that in the shadow region (0.04 dB), consistent with its role of suppressing non-shadow degradation, while removing shows a similar but smaller trend, indicating that the structural division indeed requires the accompanying optimization signal to be fully executed. The full model is optimal in PSNR and SSIM, while its LPIPS is slightly higher than that of the variants without STARS or ; this is because LPIPS is more sensitive to high-frequency texture, whereas the two modules suppress over-correction in the non-shadow region and make the output smoother. Its difference in LPIPS is
far smaller than the fidelity gain, corresponding to a slight trade-off between fidelity and perceptual metrics.
Stage-wise Restoration Results
We extract the outputs of the individual stages inside the cascade and measure their PSNR, SSIM and LPIPS, so as to compare the restoration capability of the stages vertically. The results are listed in Table 4, and Figure 8 provides the visual illustration.

Figure 8. Stage-wise restoration results.
| Stage | PSNR (dB) ↑ | SSIM ↑ | LPIPS ↓ | ||
| S. | N.S. | All | |||
| Stage 1 | 33.79 | 27.13 | 25.74 | 0.884 | 0.0855 |
| Stage 2 | 34.37 | 27.78 | 26.35 | 0.893 | 0.0800 |
| Stage 3 | 34.58 | 28.04 | 26.62 | 0.897 | 0.0772 |
Table 4. Outputs of each stage extracted from the full model trained on the UAV-SC+ dataset, compared with each other.
As can be seen from Table 4, as the cascade proceeds, the PSNR in the shadow region, non-shadow region and whole image increases monotonically, SSIM rises from 0.884 to 0.897, and LPIPS decreases from 0.0855 to 0.0772, indicating that each stage brings a positive gain to the final result. The improvement from Stage 1 to Stage 2 is the largest, suggesting that the first two stages mainly handle the restoration of the main content; the gain from Stage 2 to Stage 3 is relatively smaller, but the non-shadow region still improves consistently, which is consistent with the role of the last stage in correcting the non-shadow region. These stage-wise gains show that the cascade is not merely repeated refinement, but lets different stages take different regional objectives and accumulate the restoration effect progressively.
Discussion
We propose STARS, a responsibility separation strategy built on a cascaded architecture, which separates shadow removal for shadow and non-shadow regions into different stages, and we design a feature selection and fusion adapter (FSFA) that introduces features from large-model semantic priors in a lightweight manner. On UAV-SC+, ISTD+ and WSRD+ 2026, our method achieves state-of-the-art performance; quantitative and qualitative evaluations show that explicitly dividing regional responsibilities is an effective way to alleviate the side effects of mask priors and improve both regions simultaneously.
Our method is based on a three-stage cascade and still requires higher time and computational cost; in future work, we will explore more efficient designs, such as reusing inter-stage parameters or adopting lighter semantic guidance, to improve practicality.
LLM Usage Statement
The authors used large language models (LLMs), DeepSeek and ChatGPT, during the preparation of this paper. Specifically, the LLMs were used for: (i) language polishing of the paragraphs that analyze the experimental results; (ii) translating the manuscript from Chinese into English; (iii) LaTeX typesetting and formatting of the paper; (iv) generating figures from the authors’ experimental data; and (v) collecting the baseline numbers of prior methods from their published papers for the comparison tables, such as the ISTD+ results in Table 1. The LLMs did not contribute research ideas, the proposed method, or the experimental results, and the assisted content is derived from the authors’ own work. The authors have checked all LLM-assisted text, numbers, figures and citations against the original sources, and take full responsibility for the content of this paper.
References
- [1]S. Luo, H. Li, Y. Li, C. Shao, H. Shen, L. Zhang. An evolutionary shadow correction network and a benchmark UAV dataset for remote sensing images. IEEE TGRS, 61:1–14, 2023. 1, 2, 3, 5, 6DOI
- [2]J. Chu, K. Chi, Q. Wang. RMMamba: Randomized mamba for remote sensing shadow removal. IEEE TGRS, 63:1–10, 2025. 1, 2DOI
- [3]S. K. Alavipanah et al. The shadow effect on surface biophysical variables derived from remote sensing: a review. Land, 2022.DOI
- [4]Q. Wang, L. Yan, Q. Yuan, Z. Ma. An automatic shadow detection method for VHR remote sensing orthoimagery. Remote Sensing, 9(5):469, 2017. 1DOI
- [5]Y. Jin, W. Xu, Z. Hu, H. Jia, X. Luo, D. Shao. GSCA-UNet: Towards automatic shadow detection in urban aerial imagery with global-spatial-context attention module. Remote Sensing, 12(17):2864, 2020. 1, 2DOI
- [6]J. Wang, X. Li, J. Yang. Stacked conditional generative adversarial networks for jointly learning shadow detection and shadow removal. CVPR, 2018. 1, 2, 5arxiv.org/abs/1712.02478
- [7]L. Jie, H. Zhang. MGRLN-Net: Mask-guided residual learning network for joint single-image shadow detection and removal. ACCV, 2022.DOI
- [8]L. Guo et al. ShadowFormer: Global context helps image shadow removal. AAAI, 2023. 1, 2, 3, 5, 7arxiv.org/abs/2302.01650
- [9]L. Beltrame et al. Winner of CVPR2026 NTIRE Challenge on Image Shadow Removal: Semantic and Geometric Guidance for Shadow Removal via Cascaded Refinement. CVPR Workshops (NTIRE), 2026. 1, 2, 3, 7arxiv.org/abs/2604.16177
- [10]X. Li, Q. Guo, P. Cai, W. Feng, I. W. Tsang, S. Wang. Learning restoration is not enough: Transferring identical mapping for single-image shadow removal. arXiv:2305.10640, 2023. 2, 5arxiv.org/abs/2305.10640
- [11]J. Xu et al. OmniSR: Shadow removal under direct and indirect lighting. AAAI, 2025. 1, 2arxiv.org/abs/2410.01719
- [12]P. M. Dare. Shadow analysis in high-resolution satellite imagery of urban areas. Photogramm. Eng. Remote Sens., 71(2):169–177, 2005. 2
- [13]K. R. M. Adeline, M. Chen, X. Briottet, S. K. Pang, N. Paparoditis. Shadow detection in very high spatial resolution aerial images: A comparative study. ISPRS J. Photogramm. Remote Sens., 80:21–38, 2013. 2
- [14]G. F. Silva, G. B. Carneiro, R. Doth, L. A. Amaral, D. F. G. de Azevedo. Near real-time shadow detection and removal in aerial motion imagery application. ISPRS J. Photogramm. Remote Sens., 140:104–121, 2018. 2DOI
- [15]L. Lorenzi, F. Melgani, G. Mercier. A complete processing chain for shadow detection and reconstruction in VHR images. IEEE TGRS, 50(9):3440–3452, 2012. 2DOI
- [16]H. Gong, D. P. Cosker. Interactive shadow removal and ground truth for variable scene categories. BMVC, 2014. 2DOI
- [17]K. Chi, S. Guo, J. Chu, Q. Li, Q. Wang. RSMamba: Biologically plausible Retinex-based Mamba for remote sensing shadow removal. IEEE TGRS, 63:1–10, 2025. 2, 7DOI
- [18]J. Liu et al. A decoupled multi-task network for shadow removal. IEEE Trans. Multimedia, 2023. 2, 7DOI
- [19]H. Liu, M. Li, X. Guo. Regional attention for shadow removal. ACM MM, 2024. 2, 7arxiv.org/abs/2411.14201
- [20]M. Oquab et al. DINOv2: Learning robust visual features without supervision. arXiv:2304.07193, 2023. 2, 4arxiv.org/abs/2304.07193
- [21]O. Siméoni et al. DINOv3: Learning robust visual features with Gram anchoring. arXiv:2508.10104, 2025. 2, 4, 6arxiv.org/abs/2508.10104
- [22]L. Yang et al. Depth Anything V2. arXiv:2406.09414, 2024. 2arxiv.org/abs/2406.09414
- [23]S. W. Zamir, A. Arora, S. Khan, M. Hayat, F. S. Khan, M.-H. Yang, L. Shao. Multi-stage progressive image restoration. CVPR, 2021. 2
- [24]W.-S. Lai, J.-B. Huang, N. Ahuja, M.-H. Yang. Deep Laplacian pyramid networks for fast and accurate super-resolution. CVPR, 2017. 2arxiv.org/abs/1704.03915
- [25]S. Luo, H. Li, H. Shen. Deeply supervised convolutional neural network for shadow detection based on a novel aerial shadow imagery dataset. ISPRS J. Photogramm. Remote Sens., 167:443–457, 2020. 3DOI
- [26]H. Le, D. Samaras. Shadow removal via shadow image decomposition. ICCV, 2019. 5, 7arxiv.org/abs/1908.08628
- [27]F.-A. Vasluianu, T. Seizinger, Z. Zhou, Z. Wu, R. Timofte, et al. NTIRE 2026 single image shadow removal challenge report. CVPR Workshops (NTIRE), 2026. 5
- [28]F.-A. Vasluianu, T. Seizinger, R. Timofte. WSRD: A novel benchmark for high resolution image shadow removal. CVPR Workshops (NTIRE), 2023. 5DOI
- [29]Z. Wang, A. C. Bovik, H. R. Sheikh, E. P. Simoncelli. Image quality assessment: From error visibility to structural similarity. IEEE Trans. Image Process., 13(4):600–612, 2004. 5pubmed.ncbi.nlm.nih.gov/15376593
- [30]R. Zhang, P. Isola, A. A. Efros, E. Shechtman, O. Wang. The unreasonable effectiveness of deep features as a perceptual metric. CVPR, 2018. 5arxiv.org/abs/1801.03924
- [31]X. Hu, Y. Jiang, C.-W. Fu, P.-A. Heng. Mask-ShadowGAN: Learning to remove shadows from unpaired data. ICCV, 2019. 7
- [32]Z. Liu, H. Yin, X. Wu, Z. Wu, Y. Mi, S. Wang. From shadow generation to shadow removal. CVPR, 2021. 7arxiv.org/abs/2103.12997
- [33]X. Cun, C.-M. Pun, C. Shi. Towards ghost-free shadow removal via dual hierarchical aggregation network and shadow matting. AAAI, 2020. 7arxiv.org/abs/1911.08718
- [34]J. Liu et al. A shadow imaging bilinear model and three-branch residual network for shadow removal. IEEE TNNLS, 2023. 7DOI
- [35]K. Chi, J. Li, W. Jing, Q. Li, Q. Wang. Neural implicit Fourier transform for remote sensing shadow removal. IEEE TGRS, 62:5628110, 2024. 7DOI
- [36]H. Le, D. Samaras. From shadow segmentation to shadow removal. ECCV, 2020. 7arxiv.org/abs/2008.00267
- [37]L. Fu, C. Zhou, Q. Guo, F. Juefei-Xu, H. Yu, W. Feng, Y. Liu, S. Wang. Auto-exposure fusion for single-image shadow removal. ICCV, 2021. 7arxiv.org/abs/2103.01255
- [38]Z. Liu, H. Yin, Y. Mi, M. Pu, S. Wang. Shadow removal by a lightness-guided network with training on unpaired data. IEEE Trans. Image Process., 30:1853–1865, 2021. 7DOI
- [39]Y. Jin, A. Sharma, R. T. Tan. DC-ShadowNet: Single-image hard and soft shadow removal using unsupervised domain-classifier guided network. ICCV, 2021. 7arxiv.org/abs/2207.10434
- [40]Y. Zhu et al. Bijective mapping network for shadow removal. CVPR, 2022. 7DOI
- [41]J. Wan, H. Yin, Z. Wu, X. Wu, Y. Liu, S. Wang. Style-guided shadow removal. ECCV, 2022. 7DOI