WorksComputer Science
LiDSeg: Linear DehazeFormer Guidance for Efficient Semantic Segmentation in Adverse Weather Conditions
Abstract
Robust semantic segmentation in adverse weather is essential for safety-critical autonomous systems. Existing restore-then-segment pipelines introduce latency and prioritize pixel-level restoration over semantic discriminability, while domain adaptation methods often face representation bottlenecks and computational complexity. We introduce LiDSeg, a framework that uses reconstruction-informed guidance to improve segmentation under adverse weather. During training, a lightweight guidance encoder is jointly optimized with the segmentation branch using segmentation and auxiliary reconstruction objectives. At inference, the reconstruction decoder is discarded, while the guidance encoder is retained to extract weather-robust features. A lightweight gated fusion module integrates these features into the segmentation branch, preserving clear-weather accuracy while improving adverse-weather robustness. On Foggy Cityscapes, LiDSeg limits the clear-to-dense-fog mIoU degradation to 2.5-2.8 percentage points, reducing the baseline performance drop by more than fivefold. On the official ACDC test server, LiDSeg-PIDNet achieves 75.07% pooled all-condition mIoU, comparable to supervised HRNet-W48 at 75.0%, while remaining substantially smaller. The gains generalize zero-shot to Foggy Driving and Foggy Zurich without training on real-fog images. LiDSeg adds only 1.9-3.1M parameters across several models, with total model sizes of 5.2-39.5M parameters and no inference-time reconstruction overhead. It delivers real-time inference on the NVIDIA Jetson AGX Orin. Code: https://github.com/yobsanb/LiDSeg
Introduction
Semantic segmentation in adverse weather conditions is a fundamental challenge for diverse autonomous systems and safety-critical applications [36]. Despite significant advances in clear-weather datasets, such as Cityscapes [8], model performance declines in adverse weather conditions due to weather-induced artifacts that corrupt the semantic features essential for scene understanding [2, 54, 59]. Common methods for addressing this problem include sequential restore-then-segment pipelines that explicitly restore degraded images before segmentation [33, 49]. While improving the visual quality of the restored image, these methods introduce additional inference latency and emphasize pixel-level restoration objectives, which do not necessarily enhance semantic discriminability [44]. Another method is leveraging domain-adaptation techniques to align feature distributions across weather domains [11, 19, 24, 29, 36, 40, 45]. However, this method often leads to representation bottlenecks and limits the robustness gains [29]. To tackle these challenges, LiDSeg employs a modular framework with asymmetric training and inference that integrates weather-robust guidance into a segmentation network (Figure 1). During training, the auxiliary reconstruction loss,
Figure 1. LiDSeg architecture. The degraded image I is processed by a guidance branch (Linear DehazeFormer encoder with training-only decoder) and a segmentation branch.
computed on paired adverse and clear images, jointly optimizes the shared guidance encoder together with the segmentation loss, so the encoder learns features robust to the distribution of weather corruptions. During inference, the reconstruction decoder is removed for efficiency, whereas the LGF module selectively fuses the encoder features into the segmentation network to enhance robustness in adverse weather conditions without compromising clear-weather accuracy. This design augments a standard segmentation network with minimal additional parameters and FLOPs, thereby avoiding the computational burden and representation conflicts of full-image restoration. Therefore, the objective of LiDSeg is to augment conventional real-time semantic segmentation networks that are optimized on clean-weather accuracy for weather robustness. The main contributions of this work are as follows.
We introduce LiDSeg, an end-to-end framework that augments a real-time semantic segmentation network with a lightweight linear-attention guidance to improve robustness in adverse weather conditions, without full-image reconstruction at inference.
We utilize an asymmetric training strategy in which auxiliary image reconstruction supervises the guidance encoder to learn features robust to weather corruptions, and the reconstruction decoder is discarded at inference to preserve deployment efficiency while retaining weather-robust guidance.
We design a Lightweight Gated Fusion (LGF) module that selectively integrates multiscale guidance into the semantic segmentation networks, preserving clear-weather accuracy while enhancing robustness in fog, rain, snow, and night.
LiDSeg was evaluated on multiple benchmarks. On Foggy Cityscapes, guided variants reach 74.1–74.3% dense-fog mIoU within 0.5–0.7 below FreD-ViT (109M) at 9–21× fewer parameters. On ACDC, LiDSeg shows similar robustness across several adverse weather conditions.
Related Works
Balancing segmentation accuracy and efficiency is critical for resource-constrained devices. Although multibranch architectures, such as BiSeNetV2 [56], PIDNet [53], DDRNet [14], STDC [10], and transformer-based approaches, such as TopFormer [58], RTLinearFormer [3], and SeaFormer [48], achieve efficient feature extraction on clear-weather datasets, they lack explicit mechanisms to handle feature degradation [8] in adverse weather. The direct application of these standard segmentation models to adverse conditions leads to significant mIoU drops [32, 56]. For instance, the BiSeNetV2 mIoU falls from 69.1% on clear Cityscapes to 54.2% on dense foggy Cityscapes (), and the DDRNet mIoU falls from 77.8% to 56.1%. Similar degradation occurs in ACDC and zero-shot datasets. Even robust conventional semantic networks, such as DeepLabV3+ [4] and HRNet [50] struggle despite their large model size [2, 59]. On the other hand, although large transformers, such as Mask2Former [6] enhance robustness, their expensive computational requirements restrict their applicability to resource-constrained devices. Recent weather-aware aggregation [36] and language-guided approaches [49] have also added complexity without fully resolving domain shifts. Overall, to address the challenge of semantic segmentation in adverse weather conditions, current methods typically fall into two main categories.
Restore-then-Segment. Sequential pipelines, such as TransWeather [46] and WeatherStream [59] treat restoration as a preprocessing step. Models, such as Restormer [57], DehazeFormer [43], and LDFormer [37] employ attention mechanisms for high-fidelity restoration before segmentation. However, this approach introduces significant latency and prioritizes pixel fidelity over semantic robustness [2]. Restoration often results in oversmoothed artifacts that obscure fine details. In addition, the disjoint sequential optimization of restoration and segmentation causes error accumulation [37, 44]. LiDSeg differs from sequential restoration-then-segment and restoration–segmentation multitasking by using dehazing only as lightweight training-time guidance, with no restoration at inference. It linearizes attention in the dehazing encoder and uses reconstruction solely to supervise the guidance branch, reducing computation and avoiding restoration-induced error accumulation. LGF then selectively integrates multiscale guidance features instead of using generic concatenation or U-Net-style fusion.
Domain Adaptation. Alternatively, domain-adaptation techniques bridge the feature gap through style transfer [19, 24, 36] and adversarial learning [47, 55]. Frequency-based methods, such as FreD [7], also attempt to separate style from structure and are trained using unsupervised domain adaptation (UDA). However, UDA approaches, such as Cum-Former [29], often involve high training complexity for marginal improvements in accuracy. Furthermore, although recent frameworks that leverage temporal correlation [23] and generalizable systems [54] have improved adaptation, they remain limited by computational inefficiencies. On the other hand, recent adverse-weather segmentation models, such as (HRDA [16], MIC [17], HALO [13], CoDA [28], WANet [36]) rely on M backbones and report no edge latency, whereas real-time architectures (BiSeNetV2, DDRNet, STDC) lack explicit weather adaptation. LiDSeg co-designs reconstruction supervision and channel gating for image degradations in resource-constrained environments, where reconstruction is used as an auxiliary task to penalize weather-specific encodings, and LGF modulates guidance with minimal overhead.
Proposed Methodology
LiDSeg Problem Formulation and Overview
Adverse weather conditions degrade image quality and corrupt semantic features essential for accurate scene understanding. This degradation can be mathematically formalized as:
where denotes the clean image, represents the observed degraded image, and is a degradation parameterized by condition-specific degradation variables (encompassing rain, snow, fog, and nighttime illumination). Depending on the adverse condition, exhibits distinct yet structurally related physical degradation, from sparse additive occlusions (e.g., rain streaks [12]) to dense, depth-dependent multiplicative attenuation and global illumination changes [30, 41]. These conditions simultaneously degrade local high-frequency details and global contextual cues [25]. Across fog, rain, and snow, much of the corruption is channel-coherent, which motivates channel-wise fusion rather than heavy spatial attention; night is the partial exception (§ 4.5), where this assumption weakens.
Because semantic annotations depend on static scene content, which remains unaffected by weather, the objective is to learn that is robust to weather-induced degradations:
To enforce this robustness, LiDSeg introduces a dual-branch architecture (Figure 1), where the segmentation branch uses lightweight models [10, 14, 53, 56] and the guidance branch uses a linearized encoder inspired by DehazeFormer [43] to extract multi-scale features. LGF modules (Eq. (9)) integrate guidance into the segmentation branch with minimal overhead.
Guidance Encoder Architecture
The guidance encoder extracts multiscale features to support the robustness objective in Eq. (2). It produces feature maps at resolutions , , and with channel dimensions , matching the segmentation branch to enable direct fusion without additional projection or resampling layers.
Processing high resolution images using resource constrained devices requires efficient attention mechanisms. Standard self-attention uses softmax() with complexity, making it difficult to process high-resolution features on resource-constrained devices. To address this, we adopt a linear-attention formulation inspired by [21], which exploits matrix associativity to compute the key-value product:
where are spatially flattened features, and denotes softmax along the spatial dimension. The key-value product produces a compact context matrix rather than an attention matrix, reducing complexity to .
To limit the propagation of weather artifacts through global feature aggregation, we add a learnable gate inspired by Gated Linear Units [9, 42]:
where denotes the input feature map and is the learnable output projection. The attention components are computed via linear transformations: , , and . The gating signal is derived from the input as , where are learned weights, and is the SiLU activation. This generates a soft mask that suppresses weather-artifact responses across channels through element-wise multiplication () before the features are projected by .
Although attention captures global context, it lacks explicit modeling of local spatial patterns, such as edges and fine textures [52]. To complement the global receptive field of GLA, each encoder block incorporates a Gated-Dconv Feed-Forward Network (GDFN) [57] with depth-wise convolutions for local spatial mixing:
where LN is Layer Normalization, DWConv is depth-wise convolution, Gate denotes the gating activation, and and are linear projections. Together, GLA and GDFN enable the encoder to learn features that are both globally coherent and locally precise, which is essential for robust segmentation under weather degradation.
Auxiliary Reconstruction Decoder
The guidance encoder learns weather-robust representations using an auxiliary reconstruction decoder. This decoder follows a U-Net-like architecture with Restormer-style refinement [57]. At each decoder stage ,
where denote the decoder and encoder features at stage with channel dimension , is PixelShuffle with scale factor 2, denotes channel-wise concatenation, is a convolution reducing channel from to , and denotes a stack of Restormer-like blocks (channel-wise attention and GDFN) for feature refinement. The decoder output passes through a progressive upsample that applies three successive PixelShuffle operations (from 1/8 to full resolution) with intermediate refinement. The final reconstruction employs global residual learning as follows:
where is the degraded image and is the residual predicted by the decoder. The auxiliary decoder adds peak GPU memory during training only.
Lightweight Gated Fusion (LGF)
Given the spatial and condition dependent nonuniformity of weather degradation, we propose an LGF that selectively fuses guidance features into segmentation features at multiple stages using a channel-wise gating mechanism. At fusion stages , the fused features are computed as
where denote semantic and guidance features (), respectively. Leveraging the squeeze-and-excitation principle [18], we concatenate the inputs and apply Global Average Pooling (GAP) to extract global context, followed by a bottleneck MLP (reduction , weights ) with ReLU and sigmoid to generate channel-wise gates. Here is a learnable per-stage scalar that controls how much guidance is needed at each scale; the “” in Figure 1 denotes this learned gate. Weather corruption in fog, rain, and snow is predominantly channel-coherent (Eq. (1)); we verify this by measuring the cross-channel correlation of the cleardegraded residual, which is high for fog/rain/snow () but lower for night (, consistent with § 4.5). Channel gating targets this structure with far fewer parameters and FLOPs, whereas spatial or cross-attention fusion costs more fusion parameters for only a marginal accuracy gain (Table 8). These gates dynamically modulate , preserving clear-weather accuracy while enhancing robustness in adverse conditions.
| Guidance | Attn. | Struct. | Fusion | Rec. | Params (M) | FLOPs (G) | Mean |
| Dehazing + Segment | Softmax | Seq. | – | Yes | 6.7 | 631.4 | 67.8 |
| Heavy guidance | Softmax | Asy. | Concat | Yes | 5.9 | 446.2 | 67.1 |
| Heavy guidance | Softmax | Asy. | LGF | Yes | 5.9 | 446.0 | 75.4 |
| LiDSeg | Linear | Seq. | – | Yes | 6.3 | 143.0 | 66.3 |
| LiDSeg | Linear | Asy. | Concat | Yes | 5.7 | 110.8 | 66.1 |
| LiDSeg | Linear | Asy. | Spatial | Yes | 6.3 | 126.5 | 75.6 |
| LiDSeg | Linear | Asy. | Cross | Yes | 6.4 | 131.5 | 75.9 |
| LiDSeg | Linear | Asy. | LGF | Yes | 5.22 | 108.8 | 75.4 |
Table 8. Architectural design control on Foggy Cityscapes val using BiSeNetV2. Mean denotes mIoU averaged over . Reconstruction supervision is retained for all guided variants. Params and FLOPs correspond to the deployed networks.
Loss Function
The training loss combines segmentation and reconstruction to achieve a balance between the segmentation focus on discriminative features and the reconstruction need for pixel-level accuracy. Therefore, the total loss is computed using the task-dependent uncertainty weight [22] as shown in Eq. (10).
where and are learnable task uncertainties. Higher uncertainty downweights the corresponding loss, whereas the log regularizes to prevent the trivial solution .
Segmentation loss. combines cross-entropy, Lovász-Softmax [1], and auxiliary supervision:
We set and . These values follow established practice: matches the deep-supervision weighting in PSPNet [60] and BiSeNetV2 [56], ensuring that auxiliary heads do not dominate gradients. The weight balances the IoU-based Lovász optimization against pixel-wise cross-entropy, as recommended in [1]. A sensitivity sweep (in supplementary) shows LiDSeg is robust to this choice.
Reconstruction loss. For reconstruction, the Charbonnier loss is used for training.
where is the number of pixels, is the -th pixel of the reconstructed image, is the clear ground-truth pixel, is used for numerical stability. The adverse-to-clear mapping is not assumed to be uniquely identifiable because weather can obscure scene information [31]. LiDSeg therefore uses only as a pretraining regularizer for degradation-stable guidance features rather than requiring a unique photorealistic reconstruction at deployment; the decoder is discarded afterward, and § 6.1 isolates the contribution of this supervision.
Experimental Results and Discussion
Experimental Setup
We implemented LiDSeg in PyTorch and trained on NVIDIA Tesla V100 GPUs using the AdamW optimizer (, weight decay ), automatic mixed precision, and a cosine learning rate schedule. During paired Foggy Cityscapes pretraining, the guidance encoder is optimized with both segmentation and reconstruction objectives. For ACDC fine-tuning, the reconstruction decoder and are removed, and the segmentation branch, LGF, and pretrained guidance encoder are fine-tuned using segmentation labels only. We evaluate both Uber configurations (optimized across all adverse weather conditions simultaneously) and condition-specific Expert models (trained on a single weather condition each). Inference latency is measured in frames per second (FPS) on an NVIDIA Jetson AGX Orin.
Datasets. In reality, capturing perfectly aligned pairs of clear and adverse weather image for training is nearly impossible because the same dynamic scene (with moving objects, vehicles, and pedestrians) cannot be recorded at the exact same timestamp under both clear and adverse weather without any other variations, making reliable ground-truth annotation extremely difficult. Therefore, we rely on synthetic pairs that provide pixel-level alignment between clean and weather-affected images while isolating only the weather effects to learn robust features. Given this reality, we pretrain on Foggy Cityscapes [41], which provides synthetic paired clear and foggy images across a progressive curriculum of attenuation coefficients . This also allows direct comparison with recent works on adverse weather conditions such as FreD [2], IBNet [34], and IterNorm [20]. Real-world evaluation and target-domain fine-tuning (which requires no clear image pairs) utilize ACDC [39], spanning real fog, night, rain, and snow. Moreover, for evaluating generalization, we assessed guided models via zero-shot on Foggy Zurich v2 [40] and Foggy Driving [41].
Metrics. We report mIoU per class and per condition. For ACDC, Pooled All denotes the benchmark’s class-mean IoU over the pooled all-condition set and is not the arithmetic mean of Fog, Night, Rain, and Snow. To analyse the correlation between reconstruction and segmentation, we also track Peak Signal-to-Noise Ratio (PSNR) and Structural Similarity Index Measure (SSIM).
Learned Feature Robustness and Training Dynamics
To evaluate model robustness, we analyze feature stability by quantifying the feature drift between corresponding clear and foggy scenes. As illustrated in the Feature Drift Distribution (Figure 2a), LiDSeg (blue) exhibits a narrow distribution clustered near zero, demonstrating better stability against weather-induced domain shifts compared to the baseline (pink). Quantitatively, LiDSeg substantially reduces the mean feature drift to relative to the baseline (). This consistency is validated by per-scene comparisons (Figure 2b), where LiDSeg yields uniformly lower drift across all test scenes.
Figure 2. Feature stability on Foggy Cityscapes val (BiSeNetV2) (): (a) feature drift (LiDSeg vs. baseline ). (b) Per-scene drift (LiDSeg lower on all scenes).
Performance and stability on Foggy Cityscapes
Figure 3 plots validation mIoU and guidance-encoder reconstruction PSNR for all four guided models over the fog curriculum (). Reconstruction quality and segmentation accuracy co-evolve throughout training, where both metrics slightly dip at each denser fog in a synchronized manner. At each transition, the encoder encounters a sudden distribution shift because denser fog attenuates high-frequency content, reducing reconstruction quality (lower PSNR) and perturbing the segmentation feature space (lower mIoU). However this shift is relatively small compared to baselines as illustrated in Table 1. Additionally, the subsequent rise in both curves is consistent with the recovery of latent structure useful for segmentation. Those patterns are nearly identical across all LiDSeg variants despite architectural differences (bilateral fusion, dual-resolution, PID, STDC). We also compared LiDSeg-guided models with adverse-weather and baseline models. Table 1 reports the Foggy Cityscapes validation
Figure 3. Reconstruction and segmentation training dynamics on Foggy Cityscapes validation set (four guided models; fog curriculum ). Validation mIoU (solid, left axis) and guidance-encoder reconstruction PSNR (dashed, right axis).
| Method | Backbone | Params | GFLOPs | Clear (mIoU) | Light (mIoU) | Medium (mIoU) | Dense (mIoU) | |
| Real-time semantic segmentation models | ||||||||
| BiSeNetV2 [56] | – | 3.36M | 99.7 | 69.1 | 60.9 | 58.8 | 54.2 | 14.9 |
| DDRNet-23s [14] | – | 5.70M | 36.7 | 77.8 | 66.1 | 62.2 | 56.1 | 21.7 |
| STDC1-Seg [10] | – | 8.43M | 166.3 | 71.8 | 67.5 | 62.5 | 56.1 | 15.7 |
| PIDNet-L [53] | – | 37.31M | 276.2 | 74.0 | 68.4 | 63.0 | 58.9 | 15.1 |
| Unguided models with incremental (matched budget, same curriculum) | ||||||||
| BiSeNetV2-wide† | BiSeNetV2 | 5.22M | 108.8 | 70.4 | 64.2 | 60.6 | 56.9 | 13.5 |
| DDRNet-23s-wide† | DDRNet | 7.65M | 46.0 | 78.2 | 68.5 | 64.0 | 57.8 | 20.4 |
| Models use heavy backbones | ||||||||
| IBNet [34] | ResNet-50 | >25.6M | >100 | 76.5 | 72.4 | 67.9 | 59.5 | 17.0 |
| IterNorm [20] | ResNet-50 | >25.6M | >100 | 76.0 | 72.0 | 68.3 | 60.7 | 15.3 |
| SW [35] | ResNet-50 | >25.6M | >100 | 77.0 | 73.3 | 69.4 | 61.7 | 15.3 |
| ISW [7] | ResNet-50 | >25.6M | >100 | 76.2 | 72.1 | 67.9 | 60.1 | 16.1 |
| DeepLabV3+ [4] | ResNet-101 | 62.7M | 2032 | 79.6 | 67.1 | 65.2 | 61.6 | 18.0 |
| SegFormer [52] | MiT-B4 | 64.1M | 1240 | 81.0 | 70.5 | 66.1 | 62.3 | 18.7 |
| Mask2Former [6] | Swin-B | 107M | 466 | 83.5 | 76.2 | 74.5 | 70.8 | 12.7 |
| FreD-ViT [2] | Swin-B | 109M | 466 | 82.8 | 79.5 | 78.0 | 74.8 | 8.0 |
| LiDSeg (BiSeNetV2) | – | 5.22M | 108.8 | 76.7 | 76.3 | 75.7 | 74.2 | 2.5 |
| LiDSeg (DDRNet-23s) | – | 7.65M | 46.0 | 76.9 | 76.2 | 75.6 | 74.1 | 2.8 |
| LiDSeg (STDC1-Seg) | – | 11.48M | 176.3 | 76.9 | 76.2 | 75.5 | 74.3 | 2.6 |
| LiDSeg (PIDNet-L) | – | 39.54M | 285.9 | 76.8 | 76.2 | 75.5 | 74.2 | 2.6 |
Table 1. Fog density robustness on Foggy Cityscapes val (mIoU %). Clear is clear-weather Cityscapes mIoU; is the cleardense () mIoU drop (smaller is better). GFLOPs at . †: denotes incremental widening to match the guided parameter/FLOP budget and trained on an identical fog curriculum without the guidance branch.
mIoU at . LiDSeg rows are taken from the per-stage training of Figure 3. Every guided model degrades by only 2.5–2.8 mIoU points from clear to dense fog. This drop is less than half that of FreD-ViT and substantially smaller than those of the unguided baselines. The scaled unguided models (BiSeNetV2-wide and DDRNet-23s-wide), widened to 5.2/7.7M budget and trained on the identical curriculum without the guidance branch, reach only 56.9/57.8% dense-fog mIoU. Therefore, scaling the model to match the parameter and FLOP budget recovers at most +2.7 mIoU points over the vanilla model, whereas LiDSeg recovers +20.0 points. This gain results from the reconstruction-guided robustness rather than added capacity. On dense-fog accuracy LiDSeg reaches 74.1–74.3%, within 0.5–0.7 mIoU points of FreD-ViT (74.8%) while using substantially fewer parameters, placing it on the robustness and efficiency frontier of adverse weather condition semantic segmentation design.
LiDSeg Guidance Performance on ACDC
The objective of LiDSeg is to learn weather-robust features from synthetic paired images and transfer them to real-world datasets such as ACDC. During ACDC fine-tuning, no paired clear target is used: the reconstruction decoder and are removed, and the segmentation branch, LGF, and guidance encoder are updated with ACDC segmentation labels only. Because supervised fine-tuning and UDA use different target-domain supervision, Table 2 labels each protocol explicitly; UDA rows are included as task-level references for comparisons. LiDSeg-PIDNet obtains 75.07% mIoU, comparable with supervised HRNet-W48 (75.0% mIoU, 696 GFLOPs) and other heavy UDA models, while night remains the most challenging condition.
| Method | Protocol | Params | GFLOPs | Fog | Night | Rain | Snow | Pooled All | Mean |
| Supervised ACDC labels | |||||||||
| RefineNet [27] | Sup. | 118M | – | 65.7 | 55.5 | 68.7 | 65.9 | 65.3 | 64.0 |
| DeepLabV2 [39] | Sup. | 44M | – | 54.5 | 45.3 | 59.3 | 57.1 | 55.3 | 54.1 |
| DeepLabV3+ [4] | Sup. | 62.7M | 2032 | 69.1 | 60.9 | 74.1 | 69.6 | 70.0 | 68.4 |
| HRNet-W48 [50] | Sup. | 65.9M | 696 | 74.7 | 65.3 | 77.7 | 76.3 | 75.0 | 73.5 |
| Mask2Former [6] | Sup. | 107M | 466 | – | – | – | – | 77.3 | – |
| ViT-Adapter [5] | Sup. | >320M | >1000 | – | – | – | – | 78.4 | – |
| UDA task-level references | |||||||||
| DANNet [51] | UDA | – | – | – | – | – | – | 50.0 | – |
| DAFormer [15] | UDA | 84.0M | – | – | – | – | – | 55.4 | – |
| HRDA [16] | UDA | 85.7M | 251 | – | – | – | – | 68.0 | – |
| MIC [17] | UDA | 85.7M | 251 | – | – | – | – | 70.4 | – |
| HALO [13] | UDA | 86.0M | 259 | – | – | – | – | 71.9 | – |
| CoDA [28] | UDA | 90.5M | 271 | – | – | – | – | 72.6 | – |
| WA²Net [36] | UDA | >85M | >255 | – | – | – | – | 73.8 | – |
| LiDSeg (PIDNet-L) | Sup.-FT | 39.54M | 285.9 | 73.99 | 64.58 | 78.58 | 77.18 | 75.07 | 73.58 |
Table 2. ACDC test mIoU (%). Pooled All is the benchmark pooled all-condition evaluation; Mean is the arithmetic mean of Fog, Night, Rain, and Snow where per-condition scores are available. Sup.: supervised ACDC labels; Sup.-FT: LiDSeg fine-tuned with ACDC segmentation labels after synthetic paired pretraining; UDA: adaptation with unlabeled target images. (–): not reported.
ACDC: Per-Condition Per-Class performance
Across all conditions, Uber models consistently outperform condition-specific Experts, showing that joint training across adverse conditions strengthens the shared representation. Cross-condition evaluation in Table S8 further supports this finding, with strong transfer among the channel-coherent fog, rain, and snow conditions. Table 4 reports the corresponding class-wise IoU results. Fog remains the strongest setting, consistent with Foggy-Cityscapes pretraining, whereas night remains the most challenging condition.
| Cond. | Setup | Model | road | sidew. | build. | wall | fence | pole | light | sign | veget. | terrain | sky | person | rider | car | truck | bus | train | motorc. | bicycle | mIoU |
| Fog | Uber | BiSeNetV2 | 97.1 | 85.9 | 88.8 | 69.9 | 44.8 | 68.0 | 78.0 | 75.0 | 90.6 | 61.1 | 98.3 | 68.2 | 77.5 | 85.5 | 64.3 | 96.2 | 91.7 | 53.9 | 62.1 | 76.7 |
| DDRNet | 97.2 | 85.5 | 88.5 | 70.3 | 44.9 | 68.1 | 77.3 | 74.2 | 90.5 | 60.7 | 98.3 | 66.9 | 75.1 | 84.5 | 62.2 | 95.7 | 90.5 | 52.1 | 65.1 | 76.2 | ||
| STDC | 97.0 | 85.4 | 88.5 | 70.5 | 45.0 | 68.3 | 76.6 | 74.3 | 90.4 | 61.1 | 98.3 | 67.7 | 76.4 | 85.2 | 66.5 | 95.7 | 90.8 | 57.8 | 65.6 | 76.9 | ||
| PIDNet | 97.2 | 86.1 | 88.7 | 69.9 | 44.3 | 68.6 | 78.3 | 75.1 | 90.6 | 61.8 | 98.3 | 69.6 | 74.9 | 85.2 | 63.2 | 95.8 | 91.6 | 52.3 | 65.6 | 76.7 | ||
| Expert | BiSeNetV2 | 97.2 | 86.6 | 87.5 | 68.0 | 41.6 | 64.6 | 72.4 | 67.9 | 90.2 | 61.4 | 98.3 | 61.0 | 67.2 | 85.0 | 54.4 | 86.2 | 87.6 | 31.2 | 57.3 | 71.9 | |
| DDRNet | 96.5 | 84.7 | 86.2 | 66.3 | 40.0 | 61.3 | 70.0 | 65.6 | 89.8 | 61.5 | 98.2 | 61.8 | 68.3 | 83.8 | 53.2 | 88.3 | 83.6 | 30.6 | 58.6 | 71.0 | ||
| STDC | 97.2 | 85.6 | 87.7 | 68.3 | 42.0 | 63.3 | 72.4 | 68.2 | 90.3 | 61.5 | 98.3 | 62.7 | 68.0 | 84.5 | 53.2 | 86.0 | 83.4 | 33.9 | 57.1 | 71.8 | ||
| PIDNet | 96.3 | 83.7 | 85.7 | 67.5 | 37.8 | 59.0 | 69.7 | 66.0 | 89.4 | 58.2 | 98.2 | 60.3 | 65.3 | 83.3 | 48.2 | 88.9 | 81.0 | 30.5 | 57.0 | 69.8 | ||
| Night | Uber | BiSeNetV2 | 93.8 | 72.7 | 76.8 | 42.3 | 42.2 | 55.4 | 67.2 | 44.2 | 69.7 | 34.6 | 80.2 | 41.2 | 30.4 | 71.9 | 31.6 | 38.3 | 85.0 | 32.9 | 47.0 | 55.7 |
| DDRNet | 93.9 | 73.4 | 76.1 | 42.1 | 40.7 | 54.2 | 67.2 | 41.2 | 68.3 | 35.3 | 78.5 | 38.7 | 32.5 | 69.5 | 30.1 | 38.6 | 81.7 | 34.9 | 45.5 | 54.9 | ||
| STDC | 93.9 | 73.7 | 76.5 | 42.7 | 41.2 | 54.4 | 64.9 | 41.8 | 68.8 | 35.3 | 78.8 | 40.6 | 31.1 | 69.9 | 30.2 | 38.5 | 82.8 | 34.2 | 47.1 | 55.1 | ||
| PIDNet | 94.1 | 73.6 | 77.0 | 43.5 | 42.1 | 55.3 | 67.4 | 44.2 | 69.8 | 34.9 | 80.2 | 39.2 | 32.3 | 71.6 | 31.9 | 38.5 | 85.8 | 31.4 | 50.7 | 56.0 | ||
| Expert | BiSeNetV2 | 92.4 | 70.1 | 73.4 | 38.6 | 42.0 | 54.6 | 61.8 | 39.6 | 66.5 | 34.7 | 76.9 | 35.9 | 31.6 | 68.4 | 33.8 | 35.3 | 72.9 | 34.9 | 45.3 | 53.1 | |
| DDRNet | 87.9 | 54.0 | 59.4 | 31.6 | 30.6 | 48.8 | 36.9 | 30.8 | 55.4 | 36.8 | 62.5 | 30.9 | 35.7 | 40.2 | 34.9 | 37.5 | 31.9 | 37.7 | 31.8 | 42.9 | ||
| STDC | 88.0 | 56.8 | 63.4 | 30.9 | 30.2 | 49.8 | 45.2 | 30.3 | 56.0 | 36.6 | 62.7 | 30.6 | 35.8 | 45.0 | 35.2 | 36.4 | 39.9 | 37.6 | 30.5 | 44.3 | ||
| PIDNet | 91.7 | 68.8 | 72.5 | 35.4 | 39.7 | 53.7 | 56.8 | 35.9 | 64.7 | 35.1 | 74.0 | 35.0 | 34.4 | 65.9 | 34.8 | 34.2 | 76.7 | 35.6 | 34.1 | 51.5 | ||
| Rain | Uber | BiSeNetV2 | 92.2 | 72.6 | 88.1 | 40.8 | 43.3 | 60.0 | 75.5 | 76.5 | 92.7 | 66.0 | 98.4 | 67.7 | 39.2 | 89.8 | 58.5 | 92.0 | 77.0 | 47.3 | 38.4 | 69.3 |
| DDRNet | 92.4 | 71.9 | 88.3 | 40.6 | 48.9 | 60.3 | 75.5 | 76.0 | 92.5 | 66.5 | 98.4 | 67.0 | 42.2 | 89.8 | 59.4 | 92.3 | 76.0 | 39.6 | 38.8 | 69.3 | ||
| STDC | 92.3 | 71.6 | 88.3 | 41.4 | 46.1 | 59.9 | 75.1 | 76.0 | 92.6 | 66.5 | 98.4 | 68.1 | 51.8 | 90.1 | 56.4 | 93.5 | 76.3 | 40.5 | 44.3 | 70.0 | ||
| PIDNet | 92.5 | 72.7 | 88.4 | 41.4 | 46.2 | 60.3 | 75.4 | 76.4 | 92.8 | 66.1 | 98.5 | 67.4 | 50.8 | 90.2 | 60.7 | 93.2 | 76.3 | 40.7 | 41.6 | 70.1 | ||
| Expert | BiSeNetV2 | 92.3 | 71.9 | 86.8 | 41.8 | 40.2 | 59.3 | 74.7 | 74.3 | 92.9 | 68.1 | 98.4 | 67.7 | 42.8 | 89.2 | 50.0 | 89.7 | 71.0 | … | … | 68.4 | |
| DDRNet | 91.9 | 69.9 | 86.1 | 41.3 | 40.7 | 58.4 | 74.5 | 73.4 | 92.6 | 67.5 | 98.4 | 66.4 | 36.3 | 88.6 | 47.0 | 89.7 | 69.3 | 42.3 | 37.5 | 66.9 | ||
| STDC | 91.3 | 68.9 | 86.1 | 40.3 | 41.7 | 57.0 | 73.8 | 72.1 | 92.7 | 67.5 | 98.4 | 66.7 | 30.3 | 88.1 | 44.8 | 89.8 | 64.2 | 37.8 | 37.8 | 65.8 | ||
| PIDNet | 92.0 | 70.5 | 85.9 | 40.4 | 40.0 | 57.6 | 74.7 | 72.9 | 92.6 | 67.4 | 98.3 | 67.2 | 34.0 | 88.6 | 47.4 | 89.1 | 67.9 | 45.2 | 38.7 | 66.9 | ||
| Snow | Uber | BiSeNetV2 | 93.3 | 77.1 | 87.2 | 64.1 | 45.2 | 62.5 | 82.0 | 76.7 | 89.3 | 54.6 | 97.8 | 72.0 | 34.2 | 88.5 | 65.1 | 82.5 | 92.7 | 56.7 | 60.6 | 72.7 |
| DDRNet | 92.1 | 73.5 | 86.9 | 62.2 | 44.5 | 60.0 | 81.9 | 76.5 | 89.0 | 55.0 | 97.9 | 69.9 | 35.1 | 88.0 | 68.7 | 81.1 | 93.5 | 58.3 | 61.0 | 72.4 | ||
| STDC | 92.2 | 74.3 | 86.9 | 61.7 | 44.2 | 60.6 | 81.7 | 75.9 | 89.0 | 55.3 | 97.8 | 69.8 | 35.2 | 87.9 | 70.6 | 77.0 | 92.8 | 57.3 | 60.6 | 72.1 | ||
| PIDNet | 93.1 | 76.3 | 87.4 | 65.2 | 44.8 | 62.1 | 82.1 | 77.3 | 89.4 | 54.1 | 97.9 | 74.2 | 35.8 | 88.5 | 72.0 | 81.8 | 93.2 | 64.3 | 62.8 | 73.8 | ||
| Expert | BiSeNetV2 | 90.9 | 70.4 | 84.7 | 60.7 | 44.9 | 56.5 | 78.2 | 74.2 | 87.8 | 49.9 | 97.7 | 68.4 | 35.4 | 84.5 | 41.2 | 49.8 | 86.7 | 55.6 | 58.2 | 67.1 | |
| DDRNet | 91.7 | 72.2 | 84.0 | 58.0 | 44.9 | 55.3 | 77.3 | 74.2 | 87.9 | 47.0 | 97.5 | 66.0 | 34.6 | 84.9 | 40.1 | 41.7 | 88.7 | 54.3 | 56.9 | 66.2 | ||
| STDC | 91.9 | 74.0 | 85.8 | 60.9 | 46.5 | 57.7 | 79.2 | 76.1 | 88.7 | 51.4 | 97.7 | 72.0 | 31.6 | 85.8 | 36.5 | 53.0 | 86.7 | 58.5 | 58.9 | 68.0 | ||
| PIDNet | 89.6 | 67.1 | 83.1 | 54.8 | 38.1 | 54.3 | 76.3 | 73.9 | 87.2 | 43.3 | 97.5 | 59.8 | 37.3 | 83.5 | 33.4 | 35.6 | 82.4 | 52.2 | 53.7 | 63.3 |
Table 4. LiDSeg guided ACDC val per-condition IoU (%). Gray rows = Uber; white rows = Expert.
| Model | Expert | Fog | Night | Rain | Snow |
| BiSeNetV2 (5.22M, 108.8 GFLOPs) | |||||
| BiSeNetV2 | Fog | 71.9 | 41.7 | <u>54.4</u> | 51.5 |
| BiSeNetV2 | Night | 50.4 | 53.1 | 43.4 | 42.1 |
| BiSeNetV2 | Rain | 53.3 | 42.8 | 68.4 | 54.2 |
| BiSeNetV2 | Snow | 51.8 | 40.7 | 57.1 | 67.1 |
| DDRNet-23s (7.65M, 46.0 GFLOPs) | |||||
| DDRNet-23s | Fog | 71.0 | 37.2 | 52.7 | 50.3 |
| DDRNet-23s | Night | 47.8 | 42.9 | 42.0 | 41.0 |
| DDRNet-23s | Rain | 50.6 | 38.0 | 66.9 | <u>53.0</u> |
| DDRNet-23s | Snow | 49.2 | 36.3 | 55.4 | 66.2 |
| STDC1-Seg (11.48M, 176.3 GFLOPs) | |||||
| STDC1-Seg | Fog | 71.8 | 38.0 | 51.8 | 52.7 |
| STDC1-Seg | Night | 48.8 | 44.3 | 41.3 | 43.2 |
| STDC1-Seg | Rain | 51.7 | 38.9 | 65.8 | 55.4 |
| STDC1-Seg | Snow | 50.3 | 37.1 | <u>54.5</u> | 68.0 |
| PIDNet-L (39.54M, 285.9 GFLOPs) | |||||
| PIDNet-L | Fog | 69.8 | 40.3 | <u>51.7</u> | 46.6 |
| PIDNet-L | Night | 46.5 | 51.5 | 41.3 | 39.3 |
| PIDNet-L | Rain | 49.3 | 41.3 | 66.9 | 49.1 |
| PIDNet-L | Snow | 47.9 | 39.3 | 54.4 | 63.3 |
Table S8. ACDC val mIoU (%) for condition-specific Expert cross-evaluation. Rows: training condition; columns: test condition. Diagonal: same-condition performance. Bold and <u>underline</u> indicate the best and second-best off-diagonal values, respectively, for each model.
| Method | Road | Sidewalk | Building | Wall | Fence | Pole | Light | Sign | Vegetation | Terrain | Sky | Person | Rider | Car | Truck | Bus | Train | Motorcycle | Bicycle | mIoU |
| ADVENT [47] | 72.9 | 14.3 | 40.5 | 16.6 | 21.2 | 9.3 | 17.4 | 21.2 | 63.8 | 23.8 | 18.3 | 32.6 | 19.5 | 69.5 | 36.2 | 34.5 | 46.2 | 26.9 | 36.1 | 32.7 |
| MGCDA† [38] | 73.4 | 28.7 | 69.9 | 19.3 | 26.3 | 36.8 | 53.0 | 53.3 | 75.4 | 32.0 | 84.6 | 51.0 | 26.1 | 77.6 | 43.2 | 45.9 | 53.9 | 32.7 | 41.5 | 48.7 |
| DANNet† [51] | 84.3 | 54.2 | 77.6 | 38.0 | 30.0 | 18.9 | 41.6 | 35.2 | 71.3 | 39.4 | 86.6 | 48.7 | 29.2 | 76.2 | 41.6 | 43.0 | 58.6 | 32.6 | 43.9 | 50.0 |
| DAFormer [15] | 58.4 | 51.3 | 84.0 | 42.7 | 35.1 | 50.7 | 30.0 | 57.0 | 74.8 | 52.8 | 51.3 | 58.3 | 32.6 | 82.7 | 58.3 | 54.9 | 82.4 | 44.1 | 50.7 | 55.4 |
| SSAC† [?] | 76.5 | 59.8 | 82.7 | 52.6 | 34.5 | 51.2 | 58.1 | 61.2 | 63.9 | 58.1 | 67.2 | 61.5 | 40.0 | 81.8 | 59.2 | 61.7 | 83.4 | 47.5 | 55.6 | 59.6 |
| HRDA [16] | 88.3 | 57.9 | 88.1 | 55.2 | 36.7 | 56.3 | 62.9 | 65.3 | 74.2 | 57.7 | 85.9 | 68.8 | 45.7 | 88.5 | 76.4 | 82.4 | 87.7 | 52.7 | 60.4 | 68.0 |
| MIC [17] | 90.8 | 67.1 | 89.2 | 54.5 | 40.5 | 57.2 | 62.0 | 68.4 | 76.3 | 61.8 | 87.0 | 71.3 | 49.4 | 89.7 | 75.7 | 86.8 | 89.1 | 56.9 | 63.0 | 70.4 |
| HALO [13] | 94.2 | 79.8 | 88.2 | 60.2 | 51.1 | 64.1 | 78.2 | 65.6 | 87.9 | 55.7 | 95.5 | 66.3 | 20.7 | 88.9 | 82.2 | 89.3 | 87.9 | 50.4 | 59.0 | 71.9 |
| CoDA [28] | 93.1 | 72.7 | 90.7 | 57.3 | 47.4 | 56.8 | 69.9 | 70.0 | 87.3 | 59.8 | 95.4 | 71.4 | 47.6 | 90.3 | 77.1 | 83.8 | 89.1 | 54.7 | 64.1 | 72.6 |
| WA²Net [36] | 94.5 | 77.1 | 91.6 | 61.9 | 47.6 | 57.5 | 68.5 | 70.4 | 79.2 | 64.0 | 95.6 | 72.8 | 50.2 | 90.5 | 75.5 | 88.7 | 90.9 | 57.5 | 62.6 | 73.8 |
| LiDSeg (PIDNet-L) | 94.94 | 80.45 | 91.50 | 62.95 | 56.09 | 66.25 | 76.77 | 76.24 | 89.77 | 69.49 | 96.58 | 75.19 | 54.98 | 89.74 | 64.95 | 78.46 | 88.59 | 50.60 | 62.74 | 75.07 |
Table 3. All-conditions ACDC test per-class IoU (%). Comparison rows are reported by WA²Net [36]. LiDSeg (PIDNet-L) is Uber training on ACDC. Bold and underlined values denote the best and second-best results, respectively.
Why night remains the hardest condition. On ACDC-Night, the Uber models achieve 54.9–56.0% mIoU, which is below HRNet-W48 and represents the weakest relative to other conditions. This reflects a mismatch between the assumptions underlying channel-wise gating and nighttime degradation. Fog, rain, and snow primarily introduce atmospheric scattering and attenuation that are largely channel-coherent and approximately multiplicative (Eq. (1)), making them well suited to shared channel-wise modulation. In contrast, nighttime degradation is dominated by low illumination, signal-dependent sensor noise, non-uniform artificial lighting, and dynamic-range compression, which are not channel-coherent. Moreover, nighttime scenes contain limited recoverable high-frequency content, weakening the reconstruction-based auxiliary objective and reducing the robustness signal available during joint training. Consequently, all-condition optimization is driven more strongly by fog, rain, and snow than by night. Nevertheless, the shared weather-robust encoder still improves substantially over condition-specific Experts on nighttime scenes (up to 12.0 mIoU points), showing that cross-condition representation sharing remains beneficial (details in supplementary). Incorporating illumination-aware gating, e.g., conditioning LGF reduction on learned global luminance statistics, is a potential direction for future work.
Performance on Zero-Shot
LiDSeg is evaluated on Foggy Zurich v2 and Foggy Driving (Table 5). Once trained solely on synthetic fog (Foggy Cityscapes) and paired guidance, it generalizes to unseen real fog without any real-fog domain adaptation. Prior UDA, CDA, and STL methods leverage unlabeled Foggy Zurich images during training, whereas LiDSeg and the vanilla RefineNet baselines do not. Despite this stricter zero-shot protocol, LiDSeg outperforms all prior methods while using efficient real-time architectures, demonstrating that strong synthetic paired supervision alone can enable robust cross-domain transfer to real fog.
| Model | Backbone | Method | Unlabeled FZ | FZ | FD |
| RefineNet [27] | ResNet-101 | SFT | × | 34.6 | 44.3 |
| RefineNet-lw [32] | ResNet-101 | SFT | × | 28.5 | 43.6 |
| AdaptSegNet [45] | ResNet-101 | UDA | ✓ | 25.0 | 29.7 |
| AdvEnt [47] | ResNet-101 | UDA | ✓ | 39.7 | 46.9 |
| FDA [55] | ResNet-101 | STL | ✓ | 22.2 | 21.8 |
| DANN [11] | ResNet-101 | UDA | ✓ | 43.1 | 46.0 |
| CMAda2+ [40] | ResNet-101 | CDA | ✓ | 43.4 | 49.9 |
| CMAda3+ [40] | ResNet-101 | CDA | ✓ | 46.8 | 49.8 |
| FIFO [24] | RefineNet | STL | ✓ | 42.0 | 48.9 |
| D2SL [44] | RefineNet-lw | STL | ✓ | 44.2 | 45.9 |
| LiDSeg (BiSeNetV2) | – | Guided | × | 53.5 | 50.4 |
| LiDSeg (STDC1-Seg) | – | Guided | × | 53.4 | 52.4 |
Table 5. Zero-shot mIoU (%) on Foggy Zurich v2 (FZ) and Foggy Driving (FD). SFT: supervised fine-tuning; UDA: unsupervised domain adaptation; STL: style transfer learning; CDA: curriculum domain adaptation. ✓: uses unlabeled real-fog images (Foggy Zurich) during training. No method uses FD during training.
Efficiency on Edge Hardware
Real-world deployment requires balancing accuracy with speed. However, prior work on adverse-weather semantic segmentation has focused almost exclusively on accuracy. Consequently, computational efficiency remains underexplored, and the absence of accuracy–efficiency trade-off baselines makes fair benchmarking in this domain difficult. We address this by decoupling the two factors: efficiency can be treated as an architectural property and evaluated against general-purpose real-time models, whereas robustness is evaluated against methods that explicitly target adverse weather. This separation is necessary because a direct comparison with general-purpose models would be unfair. Moreover, existing adverse-weather approaches typically gain robustness through computationally heavy designs, such as deep context aggregation, domain adaptation, or restoration preprocessing (e.g., dehazing before the downstream semantic task), all of which limit edge deployment. In contrast, LiDSeg decouples weather-robustness learning using a lightweight guidance module.
As shown in Table 6, our Jetson AGX Orin measurements confirm that on-device efficiency depends on more than FLOPs or parameter counts. For instance, Baseline DDRNet runs at 350.4 FPS despite having more parameters than BiSeNetV2 (5.70M vs. 3.36M). In contrast, SeaFormer-B has the lowest computational complexity (3.53 GFLOPs) yet reaches only 166.1 FPS, well below DDRNet’s 350.4 FPS at 9.17 GFLOPs. This indicates that hardware-level factors beyond raw FLOP counts also affect throughput. Adding LiDSeg guidance introduces only a modest latency overhead while preserving real-time throughput across all variants. LiDSeg(DDRNet) offers the strongest speed and robustness balance at 204.5 FPS, LiDSeg(STDC) achieves 188.0 FPS at 76.9% clear and 74.3% dense-fog mIoU, and LiDSeg(TopFormer-B) provides a middle ground at 126.4 FPS. LiDSeg stabilizes accuracy across fog densities, bounding the clear-to-dense-fog drop to mIoU points, whereas the unguided baselines degrade by up to 21.7 mIoU points. It is also more parameter-efficient, using – fewer parameters than prior state-of-the-art methods such as FreD-ViT while achieving comparable or better robustness (Table 1). Together, these results provide LiDSeg with a favorable robustness–efficiency trade-off, where lightweight guidance delivers reliable adverse-weather performance without sacrificing the real-time, edge-deployable behavior of the underlying adapted model.
Table 6: Jetson AGX Orin efficiency at 512×1024. Guided = LiDSeg with the reconstruction decoder discarded at inference. Clear/Dense mIoU: Cityscapes clear-weather mIoU and Foggy Cityscapes dense-fog mIoU (); is the clear→dense drop.
| Model | Variant | Params (M) | GFLOPs | FPS | Mem (MB) | Clear | Dense | |
| BiSeNetV2 | Baseline | 3.36 | 24.92 | 94.2 | 51 | 69.1 | 54.2 | 14.9 |
| DDRNet | Baseline | 5.70 | 9.17 | 350.4 | 42 | 77.8 | 56.1 | 21.7 |
| STDC | Baseline | 8.43 | 41.57 | 267.0 | 47 | 71.8 | 56.1 | 15.7 |
| PIDNet-L | Baseline | 37.31 | 69.04 | 116.9 | 111 | 74.0 | 58.9 | 15.1 |
| TopFormer-B | Baseline | 7.06 | 9.69 | 271.7 | 76 | 75.8 | 59.0 | 16.8 |
| SeaFormer-B | Baseline | 8.58 | 3.53 | 166.1 | 58 | 77.7 | 64.6 | 13.0 |
| LiDSeg (BiSeNetV2) | Guided | 5.22 | 27.20 | 83.4 | 58 | 76.7 | 74.2 | 2.5 |
| LiDSeg (DDRNet) | Guided | 7.65 | 11.50 | 204.5 | 52 | 76.9 | 74.1 | 2.8 |
| LiDSeg (STDC) | Guided | 11.48 | 44.08 | 188.0 | 69 | 76.9 | 74.3 | 2.6 |
| LiDSeg (PIDNet-L) | Guided | 39.54 | 71.48 | 92.6 | 132 | 76.8 | 74.2 | 2.6 |
| LiDSeg (TopFormer-B) | Guided | 9.01 | 12.02 | 126.4 | 63 | 76.9 | 74.2 | 2.7 |
Table 6.
Ablation Study
Reconstruction and fusion control. Table 7 isolates the effects of reconstruction supervision and LGF. Removing only while keeping the same guidance encoder and LGF reduces mean fog mIoU from 75.4% to 66.7% and ACDC mIoU from 73.6% to 67.0%, separating reconstruction supervision from added capacity. Reconstruction with concatenation reaches 66.1%, while LGF without reconstruction reaches 66.7%; combining both in full LiDSeg achieves 75.4%, showing their complementary contribution.
Table 7: Reconstruction and fusion control using BiSeNetV2. Mean denotes Foggy Cityscapes val mIoU averaged over ; ACDC denotes validation pooled-All mIoU. Params and FLOPs correspond to the deployed networks.
| Setting | Rec. | Fusion | Params (M) | FLOPs (G) | Mean | ACDC |
| (a) Seg. only | No | – | 3.36 | 99.7 | 58.0 | 56.0 |
| (b) Recon.+Concat | Yes | Concat | 5.70 | 110.8 | 66.1 | 65.0 |
| (c) LGF, no recon. | No | LGF | 5.22 | 108.8 | 66.7 | 67.0 |
| (d) LiDSeg full | Yes | LGF | 5.22 | 108.8 | 75.4 | 73.6 |
Table 7.
Architectural design control. Table 8 further ablates attention type, structural design, and fusion under fixed reconstruction supervision. Linear attention with asymmetric LGF matches Softmax accuracy at 75.4% mIoU while reducing computation from 446.0 to 108.8 GFLOPs. Sequential variants underperform while requiring more computation. Concatenation reduces mIoU to 66.1%. Spatial and cross-attention reach 75.6% and 75.9%, respectively, but at higher parameter and computational cost. Therefore, LGF provides near-best accuracy at the lowest cost, supporting the final linear-attention, asymmetric, gated design for edge deployment.
Model Scaling
The guidance encoder and LGF can be attached to segmentation networks that expose compatible s8/s16/s32 feature taps, adding a small overhead while improving robustness in adverse weather conditions. To test whether the gains transfer beyond the CNN-based real-time backbones, we apply the identical training protocol to two efficient transformer models, TopFormer-B [8] and SeaFormer-B [48] (Table 9). Uber training again outperforms the condition specific Experts, with fog remaining the strongest and night the weakest condition. This confirms that the guidance mechanism is not tailored to a particular architecture family but drives robustness gains across diverse semantic segmentation models.
Table 9. Model-scaling: Transformer based semantic segmentation under the identical training protocol. Baseline is the unguided. Efficiency is reported at (Jetson AGX Orin).
Conclusion
We present LiDSeg, an efficient framework for robust semantic segmentation in adverse weather conditions. LiDSeg uses image reconstruction as an auxiliary task to supervise a lightweight guidance encoder and discards the reconstruction decoder at inference, improving the weather robustness of standard real-time semantic segmentation with minimal cost. Our experiments show that reconstruction-guided feature learning is more robust and efficient than using restoration as a preprocessor, while offering better efficiency than large model domain adaptation. LiDSeg maintains nearly stable accuracy from light to dense fog, transfers across diverse real-time models, generalizes zero-shot, and runs in real time on resource-constrained edge devices, supporting practical deployment. It effectively transfers features learned from synthetic degraded-clean image pairs but currently requires such pairs for reconstruction supervision, while weak or unpaired supervision remains unexplored. Nighttime remains a challenge because illumination weakens the channel-coherence assumption underlying our gating mechanism. Future work will explore efficient self-supervised variants without paired data, illumination-aware gating, temporal consistency for video segmentation, more adverse weather conditions, and a general asymmetric guidance paradigm for lightweight models and vision tasks affected by domain shift. Overall, LiDSeg improves weather robustness and efficiency through reconstruction-guided feature learning while remaining compact for edge deployment.
Acknowledgements
This work has received funding from the European Union’s Horizon Europe research and innovation programme under the Marie Skłodowska-Curie grant agreement No. 101169378, (TIRAMISU Doctoral Network), and from the Government of the Republic of Cyprus through the Cyprus Deputy Ministry of Research, Innovation and Digital Policy.
Supplementary Material
This supplement provides additional experimental results for the LiDSeg architecture and training strategy. Our fundamental premise is that the standard segmentation loss is insufficient to penalize weather-induced degradation. Therefore we use an auxiliary reconstruction loss with paired clear images to supervise the shared guidance encoder in learning degradation stable features, reducing feature drift from (unguided) to (guided). Because the reconstruction decoder is discarded at inference, LiDSeg avoids inference time restoration cost and restoration induced error propagation while retaining lightweight guidance, outperforming typical sequential restore-then-segment pipelines without requiring additional domain adaptation. Internally, the guidance encoder uses gated linear attention to achieve Softmax-level accuracy at approximately 4× fewer FLOPs while limiting the propagation of low-frequency artifacts by global linear kernels. Furthermore, because weather degradation is highly channel-coherent ( for fog, rain, and snow), our lightweight gated fusion (LGF) module selectively modulates guidance features with minimal overhead.
Comprehensive ablations confirm the stability and efficiency of our design choices. Sensitivity sweeps demonstrate that the model is robust to variations in loss weighting, where uncertainty-weighting outperforms equal-weighting. Additionally, the progressive fog training curriculum () is better than jointly training all densities, which drops the mean fog mIoU by a few points. Ablations also validate our multiscale fusion strategy as using all three scales consistently outperforms single and two scale configurations at strides 1/8, 1/16, and 1/32, confirming the benefit of multiscale guidance. Finally, comparisons against a sequential pipeline demonstrate that LiDSeg’s joint guidance yields better dense fog accuracy at a lower computational complexity.
Experimental Setup and Hyperparameters
We performed a thorough evaluation to ensure stable reproducibility. During paired Foggy Cityscapes pretraining, the uncertainty-weighted objective in Eq. (10) combines the segmentation loss with Charbonnier reconstruction loss. For ACDC fine-tuning, however, paired clear targets are not used: the reconstruction decoder and are removed, and we fine-tune the segmentation branch, LGF, and pretrained guidance encoder using segmentation labels only. We train one Uper model and four condition-specific Expert models per segmentation network. The segmentation loss integrates cross-entropy, Lovász-Softmax (), and auxiliary supervision (). The Foggy Cityscapes sensitivity analysis below evaluates this pretraining configuration; varying shifts performance by up to 2.3 mIoU points depending on the model, consistently peaking at the default (Table S1).
| Semantic segmentation model | 0.2 | 0.3 | 0.4 (default) | 0.5 |
| BiSeNetV2 | 74.1 | 74.3 | 75.4 | 75.2 |
| DDRNet-23s | 73.0 | 74.2 | 75.3 | 74.1 |
| STDC1-Seg | 75.1 | 75.2 | 75.3 | 75.0 |
| PIDNet-L | 74.0 | 74.9 | 75.3 | 74.6 |
Table S1. Sensitivity to the auxiliary-loss weight across semantic segmentation models (Foggy Cityscapes val, mean fog mIoU, %); the default consistently achieves optimal performance (bold).
Design Ablations
Extensive ablations on the Foggy Cityscapes val set validate our structural and hyperparameter choices against unguided baselines, which achieve 58.0–63.4% mean mIoU across the four base models. The full LiDSeg configuration improves the BiSeNetV2 baseline by 17.4 mIoU points on Foggy Cityscapes and 17.6 points on ACDC pooled-All validation. Reconstruction supervision and LGF provide complementary gains: reconstruction with concatenation improves the baseline by 8.1/9.0 points on Foggy Cityscapes/ACDC, while LGF without reconstruction improves it by 8.68/11.0 points. Combining reconstruction supervision with LGF achieves 75.4%/73.6% mIoU. Among fusion alternatives, spatial and cross-attention reach 75.6% and 75.9% mIoU, respectively, compared with 75.4% for LGF, but require higher parameter and computational cost, giving LGF a favorable accuracy-efficiency trade-off for edge deployment.
The asymmetric design further improves efficiency through linear attention, which matches Softmax performance at approximately fewer FLOPs. Multiscale guidance is also important: fusing all three feature strides (s8, s16, and s32) consistently outperforms the tested single- and two-scale configurations (Table S2). The default (3,3,2) guidance-encoder capacity provides a strong efficiency–accuracy balance; increasing it to (4,4,3) adds 2.4M parameters for only a 0.5 mIoU-point gain (Table S2). Training choices also affect robustness (Table S2). Dynamic uncertainty weighting improves mean mIoU by 0.8 points across all four models compared with equal weighting, while the progressive fog curriculum improves performance by 2.3 mIoU points over joint training across all fog densities.
| Setting | BiSeNetV2 | DDRNet-23s | STDC1-Seg | PIDNet-L |
| (a) Multi-scale fusion | ||||
| none (baseline) | 58.0 | 61.5 | 62.0 | 63.4 |
| s8 | 69.5 | 70.6 | 70.8 | 71.3 |
| s16 | 70.4 | 71.3 | 71.5 | 71.9 |
| s32 | 67.8 | 69.3 | 69.5 | 70.1 |
| s8+s16 | 73.6 | 73.9 | 73.9 | 74.1 |
| s16+s32 | 73.1 | 73.5 | 73.5 | 73.7 |
| s8+s16+s32 (default) | 75.4 | 75.3 | 75.3 | 75.3 |
| (b) Guidance-encoder capacity | ||||
| Tiny (2,2,1) | 72.8 | 72.7 | 72.7 | 72.7 |
| Default (3,3,2) (default) | 75.4 | 75.3 | 75.3 | 75.3 |
| Base (4,4,3) | 75.9 | 75.8 | 75.8 | 75.8 |
| (c) Loss weighting | ||||
| equal weights | 74.6 | 74.5 | 74.5 | 74.5 |
| uncertainty (default) | 75.4 | 75.3 | 75.3 | 75.3 |
| (d) Fog curriculum | ||||
| joint (all densities) | 73.1 | 73.0 | 73.0 | 73.0 |
| progressive (default) | 75.4 | 75.3 | 75.3 | 75.3 |
Table S2. Design ablations across all four real-time models (Foggy Cityscapes val, mIoU % over the three fog densities). Each block varies one design choice; Fusion “none” is the unguided baseline.
Additional Experimental Result Analysis
Foggy Cityscapes: Per Class Performance
We extend the analysis of the Foggy Cityscapes results to demonstrate LiDSeg’s per-class robustness (Table S3). Semantic preservation directly correlates to the shared latent structure learned via the auxiliary reconstruction task, as PSNR and SSIM tightly co-vary with segmentation mIoU throughout training (Table S4). The gains achieved by LGF are largely driven by the physical nature of these weather effects. By measuring the cross-channel Pearson correlation () of the clear-to-degraded residuals, we observe that fog (), rain (), and snow () degrade images coherently across channels, making channel-based suppression highly effective. However, nighttime scenes exhibit lower coherence () due to non-uniform artificial lighting, explaining why night remains fundamentally the most challenging condition to modulate via channel-wise gating.
| Method | Road | Side. | Buil. | Wall | Fenc. | Pole | Ligh. | Sign | Vege. | Terr. | Sky | Pers. | Ride. | Car | Truc. | Bus | Trai. | Moto. | Bicy. | mIoU |
| LiDSeg (BiSeNetV2) | 98 | 83 | 90 | 58 | 55 | 62 | 66 | 74 | 92 | 66 | 95 | 76 | 60 | 93 | 66 | 76 | 70 | 56 | 74 | 74.2 |
| LiDSeg (DDRNet-23s) | 99 | 82 | 90 | 57 | 54 | 62 | 66 | 73 | 92 | 67 | 95 | 75 | 60 | 93 | 69 | 75 | 71 | 55 | 73 | 74.1 |
| LiDSeg (STDC1-Seg) | 98 | 84 | 89 | 58 | 55 | 62 | 64 | 73 | 92 | 67 | 95 | 75 | 61 | 94 | 68 | 74 | 71 | 57 | 75 | 74.3 |
| LiDSeg (PIDNet-L) | 99 | 84 | 89 | 57 | 53 | 62 | 66 | 74 | 92 | 66 | 96 | 78 | 58 | 94 | 67 | 75 | 70 | 57 | 73 | 74.2 |
| LiDSeg (TopFormer-B) | 97 | 82 | 89 | 57 | 54 | 62 | 66 | 75 | 92 | 65 | 95 | 74 | 59 | 92 | 66 | 76 | 69 | 54 | 74 | 73.6 |
| LiDSeg (SeaFormer-B) | 97 | 82 | 89 | 56 | 53 | 61 | 66 | 74 | 91 | 66 | 95 | 73 | 59 | 92 | 65 | 76 | 70 | 54 | 74 | 73.3 |
Table S3. Per-class IoU (%) on Foggy Cityscapes val at dense fog () for all LiDSeg variants, including the transformer extensions. Bold: best per class.
| PSNR | SSIM | mIoU | |
| 0.005 | 34.2 | 0.946 | 76.3 |
| 0.01 | 33.3 | 0.929 | 75.7 |
| 0.02 | 31.0 | 0.902 | 74.2 |
Table S4. Reconstruction quality vs. fog density (BiSeNetV2). Input PSNR is foggy vs. clear.
Because sequential restoration optimizes for pixel fidelity rather than semantic discriminability, it can accumulate restoration errors, which LiDSeg avoids propagating by removing explicit restoration at inference. This efficient, guidance-driven approach also achieved zero-shot generalizability where LiDSeg variants achieve a consistent +8 to +15 mIoU-point improvement over baselines on both the Foggy Zurich v2 and Foggy Driving datasets (Table S6).
| Semantic segmentation model | FZ (unguided) | FZ (LiDSeg) | FD (unguided) | FD (LiDSeg) |
| BiSeNetV2 | 38.2 | 53.5 | 41.0 | 50.4 |
| DDRNet-23s | 40.1 | 52.8 | 42.5 | 51.0 |
| PIDNet-L | 39.5 | 52.6 | 41.8 | 50.8 |
| STDC1-Seg | 39.0 | 53.4 | 42.0 | 52.4 |
Table S6. Zero-shot mIoU (%) on Foggy Zurich v2 (FZ) and Foggy Driving (FD): unguided Semantic segmentation model vs. LiDSeg (no target labels).
Beyond synthetic fog analysis, LiDSeg proves to be a robust alternative to fundamental paradigm designs, fully capable of real-world deployment. For instance, pipelining an explicit dehazing model before segmentation (the restore-then-segment paradigm) results in heavy latency and actually underperforms on mIoU (Table S5).
| Pipeline | Params | GFLOPs | FPS | mIoU |
| DehazeFormer BiSeNetV2 | 5.9M | 61.4 | 54 | 71.5 |
| Restormer BiSeNetV2 | 29.4M | 213.0 | 18 | 72.3 |
| LiDSeg (BiSeNetV2) | 5.22M | 27.2 | 83.4 | 74.2 |
Table S5. LiDSeg vs. restore-then-segment with the same BiSeNetV2 head. GFLOPs/FPS at (Jetson AGX Orin); mIoU at dense fog ().
Most importantly, these robustness improvements do not compromise edge deployability. Complementing the 512×1024 metrics provided in the main paper, lower-resolution (256×512) evaluations confirm that LiDSeg comfortably exceeds real-time thresholds (138–587 FPS) on a Jetson AGX Orin (Table S7).
| Model | Variant | Params (M) | GFLOPs | FPS | Mem |
| BiSeNetV2 | Baseline | 3.36 | 6.23 | 161.5 | 18 |
| DDRNet | Baseline | 5.70 | 2.29 | 707.3 | 18 |
| STDC | Baseline | 8.43 | 10.39 | 724.2 | 23 |
| SCTNet-B | Baseline | 17.44 | 7.04 | 509.3 | 44 |
| PIDNet-L | Baseline | 37.31 | 17.26 | 308.0 | 80 |
| TopFormer-B | Baseline | 7.06 | 2.42 | 715.2 | 24 |
| SeaFormer-B | Baseline | 8.58 | 0.89 | 252.2 | 27 |
| LiDSeg (BiSeNetV2) | Guided | 5.22 | 6.80 | 138.2 | 21 |
| LiDSeg (DDRNet) | Guided | 7.65 | 2.88 | 587.1 | 23 |
| LiDSeg (STDC) | Guided | 11.48 | 11.02 | 545.1 | 33 |
| LiDSeg (PIDNet-L) | Guided | 39.54 | 17.87 | 249.4 | 88 |
| LiDSeg (TopFormer-B) | Guided | 9.01 | 3.01 | 512.8 | 28 |
Table S7. Jetson AGX Orin efficiency at (Benchmarking more efficiency in addition to Table 6). Guided: LiDSeg with the reconstruction decoder discarded at inference.
ACDC: Expert Cross-Condition Generalization
To isolate the value of joint training and expose the channel-coherent structure of weather degradation, Table S8 reports a full cross-condition evaluation of the four condition-specific Expert LiDSeg models. Each Expert was fine-tuned on a single ACDC split and evaluated on all four. The 4×4 matrix per guided model shows a pattern consistent with our channel-correlation analysis. Feature transfer within the channel-coherent F↔R↔S triangle is notably strong. Because fog, rain, and snow share a structurally coherent channel degradation characteristic (), any Expert trained on one of these splits retains a large fraction of its diagonal accuracy on the other two. The best off-diagonal entry per model consistently lies inside this triangle, confirming that a shared encoder generalizes well across weather corruptions.
Similar to previous results, night transfer is bounded by scene priors rather than condition-specific features. Every Fog/Rain/Snow Expert evaluated on Night drops below its own diagonal into a narrow 36–43% range. However, this is still substantially above what a Cityscapes-only Source model achieves on ACDC-Night (–14%) and comparable to the zero-shot LiDSeg performance on Foggy-Zurich and Foggy-Driving. The symmetric NF/R/S rows convey the same point from the opposite direction: Expert Night transfers acceptably to Fog (46.5–50.4%) but degrade on Rain and Snow (39.3–43.4%), because nighttime supervision under-samples the high-illumination feature space that those conditions depend on. Overall, the Uber joint fine-tuning reported in the main paper demonstrates that pooling channel-coherent supervision across all conditions strengthens the shared encoder simultaneously, learning generalized features that natively benefit even disjointed domains
like Night.
Qualitative Results
Finally, visual comparisons ground our quantitative findings. Figure S1 and Figure S2 provide qualitative evidence on both synthetic Foggy Cityscapes and real-world ACDC. Foggy Cityscapes includes the training-only reconstruction output alongside segmentation, while ACDC shows segmentation outputs only because no reconstruction decoder is used during ACDC fine-tuning or inference. The examples illustrate preservation of details such as lane markings, pedestrians, and distant objects under adverse conditions.

Figure S1. Foggy Cityscapes val: reconstruction and segmentation. Four Semantic segmentation models at medium () and dense () fog. Columns: foggy input, LiDSeg reconstruction (training only), clear reference, ground truth, unguided baseline, LiDSeg.

Figure S2. Real ACDC val: segmentation, all conditions for all Semantic segmentation models. Sixteen distinct scenes (Fog, Night, Rain, Snow and four Semantic segmentation models). Columns: adverse input, ground truth, unguided baseline, LiDSeg.
References
- [1]Maxim Berman et al. The Lovász-Softmax loss: A tractable surrogate for the optimization of the intersection-over-union measure in neural networks. In Proc. CVPR, pages 4413–4421, 2018.
- [2]O. Bi et al. Generalized foggy-scene semantic segmentation by frequency decoupling. In Proc. CVPR Workshops, 2024.DOI
- [3]L. Chen et al. RT-LinearFormer: A real-time linear vision transformer for semantic segmentation. Neurocomputing, 2025.
- [4]Liang-Chieh Chen, Yukun Zhu, George Papandreou, Florian Schroff, and Hartwig Adam. Encoder-decoder with atrous separable convolution for semantic image segmentation. In Proc. ECCV, 2018.arxiv.org/abs/1802.02611
- [5]Zhe Chen, Yuche Duan, Yu-Gang Wen, Junjoseph, Kui Jia, and Jian Gao. ViT-Adapter: Training plain vision transformers for dense prediction. In Proc. NeurIPS, 2022.
- [6]Bowen Cheng, Ishan Misra, Alexander G. Schwing, Alexander Kirillov, and Rohit Garg. Masked-attention mask transformer for universal image segmentation. In Proc. CVPR, 2022.arxiv.org/abs/2112.01527
- [7]Sungha Choi, Sanghun Jung, Hunsang Yun, Joanne T. Kim, Seungryong Kim, and Jaegul Choo. RobustNet: Improving domain generalization in urban-scene segmentation via instance selective whitening. In Proc. CVPR, 2021.arxiv.org/abs/2103.15597
- [8]G. Csurka et al. Semantic image segmentation: Two decades of research. Found. Trends Comput. Graph. Vis., 2023.
- [9]Yann N. Dauphin, Angela Fan, Michael Auli, and David Grangier. Language modeling with gated convolutional networks. In Proc. ICML, pages 933–941, 2017.
- [10]Mingyuan Fan, Shengqi Lai, Junshi Huang, Xiaoming Wei, Zhenhua Chai, Junfeng Luo, and Xiaoming Wei. Rethinking BiSeNet for real-time semantic segmentation. In Proc. CVPR, 2021.arxiv.org/abs/2104.13188
- [11]Y. Ganin et al. Domain-adversarial training of neural networks. JMLR, 17(59):1–35, 2016.arxiv.org/abs/1505.07818
- [12]K. Garg and S.K. Nayar. Vision and rain. IJCV, 58(2):135–148, 2004.
- [13]Minseok Han, Jungwuk Kim, Kyungmin Lee, and Jaehyun Park. HALO: Hyperbolic active learning for semantic segmentation under domain shift. In Proc. ICML, 2024. Adverse conditions segmentation track.
- [14]Yuanduo Hong, Huihui Pan, Weichao Sun, and Yisong Jia. Deep dual-resolution networks for real-time and accurate semantic segmentation of road scenes. In Proc. CVPR, 2021.arxiv.org/abs/2101.06085
- [15]Lukas Hoyer, Dengxin Dai, and Luc Van Gool. DAFormer: Improving network architectures and training strategies for domain-adaptive semantic segmentation. In Proc. CVPR, 2022.arxiv.org/abs/2111.14887
- [16]Lukas Hoyer, Dengxin Dai, and Luc Van Gool. HRDA: Context-aware high-resolution domain-adaptive semantic segmentation. In Proc. ECCV, 2022.arxiv.org/abs/2204.13132
- [17]Lukas Hoyer, Dengxin Dai, Haoran Wang, and Luc Van Gool. MIC: Masked image consistency for context-enhanced domain adaptation. In Proc. CVPR, 2023.arxiv.org/abs/2212.01322
- [18]Jie Hu, Li Shen, Samuel Albanie, Gang Sun, and Enhua Wu. Squeeze-and-excitation networks. IEEE TPAMI, 42(8):2011–2023, 2020.
- [19]J. Huang et al. SPC: Style-preserving contrastive learning for domain generalized semantic segmentation. In Proc. CVPR, 2023.
- [20]Lei Huang, Yi Zhou, Fan Zhu, Li Liu, and Ling Shao. Iterative normalization: Beyond standardization towards efficient whitening. In Proc. CVPR, 2019.arxiv.org/abs/1904.03441
- [21]Angelos Katharopoulos et al. Transformers are RNNs: Fast autoregressive transformers with linear attention. In Proc. ICML, pages 5156–5165, 2020.arxiv.org/abs/2006.16236
- [22]Alex Kendall, Yarin Gal, and Roberto Cipolla. Multi-task learning using uncertainty to weigh losses for scene geometry and semantics. In Proc. CVPR, 2018.arxiv.org/abs/1705.07115
- [23]Wei Kou et al. Adverse weather-independent framework towards autonomous driving perception through temporal correlation and unfolded regularization. arXiv preprint arXiv:2508.01583, 2025.arxiv.org/abs/2508.01583
- [24]Chaehyeon Lee, Jae Young Cho, Jaehoon Kim, Dong-Geol Kim, and Jaegul Choo. FIFO: Learning fog-invariant features for foggy scene segmentation. In Proc. CVPR, 2022.arxiv.org/abs/2204.01587
- [25]Boyi Li, Wेंqi Ren, Dengpan Fu, Dacheng Tao, Dan Feng, Wenjun Zeng, and Zhiyong Wang. Benchmarking single-image dehazing and beyond. IEEE TIP, 28(1):492–505, 2019.DOI
- [27]Guosheng Lin, Anton Milan, Chunhua Shen, and Ian Reid. RefineNet: Multi-path refinement networks for high-resolution semantic segmentation. In Proc. CVPR, 2017.arxiv.org/abs/1611.06612
- [28]Yang Liu, Haoran Zhang, Wenyu Li, and Wanli Liu. CoDA: Chain-of-domain adaptation for adverse weather semantic segmentation. In Proc. ECCV, 2024.
- [29]X. Ma et al. Both style and fog matter: Cumulative domain adaptation for semantic foggy scene understanding. In Proc. CVPR, 2024.
- [30]Srinivasa G. Narasimhan and Shree K. Nayar. Vision and the atmosphere. IJCV, 48(3): 233–254, 2002.
- [31]Shree K. Nayar and Srinivasa G. Narasimhan. Vision in bad weather. In Proc. ICCV, volume 2, pages 820–827, 1999.DOI
- [32]Vladimir Nekrasov, Thanuja Dharmasiri, Andrew Spek, Tom Drummond, Chunhua Shen, and Ian Reid. Light-weight RefineNet for real-time semantic segmentation. In Proc. BMVC, 2018.arxiv.org/abs/1810.03272
- [33]X. Niu et al. Effective image restoration for semantic segmentation. Neurocomputing, 2020.DOI
- [34]X. Pan et al. Two at once: Enhancing learning and generalization capacities via IBN-Net. In Proc. ECCV, 2018.arxiv.org/abs/1807.09441
- [35]Xingang Pan, Xiaohang Zhan, Jianping Shi, Xiaoou Tang, and Ping Luo. Switchable whitening for deep representation learning. In Proc. CVPR, 2019.arxiv.org/abs/1904.09739
- [36]Y. Pan et al. Exploring weather-aware aggregation and adaptation for semantic segmentation under adverse conditions. In Proc. ICCV, 2025.DOI
- [37]D Pushpalatha and P Prithvi. LDFormer: lightweight dehazing transformer. Neural Computing and Applications, pages 1–20, 2025.DOI
- [38]Christos Sakaridis, Dengxin Dai, and Luc Van Gool. Map-guided curriculum domain adaptation and uncertainty-aware evaluation for semantic nighttime image segmentation. IEEE TPAMI, 2020.arxiv.org/abs/2005.14553
- [39]Christos Sakaridis, Dengxin Dai, and Luc Van Gool. ACDC: The adverse conditions dataset with correspondences for semantic driving scene understanding. In Proc. ICCV, 2021.DOI
- [40]Christos Sakaridis, Dengxin Dai, and Luc Van Gool. Curriculum model adaptation with synthetic and real data for semantic foggy scene understanding. IJCV, 2021.
- [41]Christos Sakaridis et al. Semantic foggy scene understanding with synthetic data. IJCV, 126(9):973–992, 2018.DOI
- [42]David R. So, Wojciech Mańke, Hanxiao Liu, Zihang Dai, Noam Shazeer, and Quoc V. Le. Primer: Searching for efficient transformers for language modeling. In Proc. NeurIPS, pages 11881–11895, 2021.arxiv.org/abs/2109.08668
- [43]Y. Song et al. Vision transformers for single image dehazing. TIP, 2023.DOI
- [44]Xudong Sun et al. D2SL: Decouple defogging and semantic learning for foggy domain-adaptive semantic segmentation. arXiv preprint arXiv:2404.04807, 2024.
- [45]Yi-Hsuan Tsai et al. Learning to adapt to structured output space for semantic segmentation. In Proc. CVPR, pages 7472–7481, 2018.arxiv.org/abs/1802.10349
- [46]Jeya Maria Jose Valanarasu, Rajeev Yasarla, and Vishal M. Patel. TransWeather: Transformer-based restoration of images degraded by adverse weather conditions. In Proc. CVPR, 2022.arxiv.org/abs/2111.14813
- [47]Tuan-Hung Vu, Himalaya Jain, Maxime Bucher, Matthieu Cord, and Patrick Pérez. ADVENT: Adversarial entropy minimization for domain adaptation in semantic segmentation. In Proc. CVPR, 2019.arxiv.org/abs/1811.12833
- [48]Qiang Wang, Zilong Huang, Jiangwei Lu, Gang Yu, and Li Zhang. SeaFormer: Squeeze-enhanced axial transformer for mobile semantic segmentation. In Proc. ICLR, 2023.
- [49]J. Wang et al. A two-stage adverse weather semantic segmentation method for weatherproof challenge CVPR 2024 workshop UG2+. arXiv preprint arXiv:2406.05513, 2024.arxiv.org/abs/2406.05513
- [50]Jingdong Wang, Ke Sun, Tianheng Cheng, Borui Jiang, Chaorui Deng, Yang Zhao, Dong Liu, Yuning Ding, Zhanpeng Guo, Han Xu, et al. Deep high-resolution representation learning for visual recognition. IEEE TPAMI, 43(10):3349–3364, 2020.DOI
- [51]Zhizheng Wu, Xiao Han, Yuxin Lin, Mustafa Gokhan Uzunbas, Tom Goldstein, Ser Nam Lim, and Dimitris N. Metaxas. DANNNet: A one-stage domain adaptation network for unsupervised nighttime semantic segmentation. In Proc. CVPR, 2021.arxiv.org/abs/2104.10834
- [52]Enze Xie, Wenhai Wang, Zhiding Yu, Anima Anandkumar, Jose M. Alvarez, and Ping Luo. SegFormer: Simple and efficient design for semantic segmentation with transformers. In Proc. NeurIPS, 2021.arxiv.org/abs/2105.15203
- [53]Jiacong Xu, Zixiang Xiong, and Shankar P. Bhatt. PIDNet: A real-time semantic segmentation network inspired by PID controllers. In Proc. CVPR, 2023.arxiv.org/abs/2206.02066
- [54]X. Yang et al. Semantic segmentation in multiple adverse weather conditions with domain knowledge retention. In Proc. AAAI, 2024.DOI
- [55]Yanchao Yang and Stefano Soatto. FDA: Fourier domain adaptation for semantic segmentation. In Proc. CVPR, 2020.
- [56]Changqian Yu, Changxin Gao, Jingbo Wang, Gang Yu, Chunhua Shen, and Nong Sang. BiSeNet V2: Bilateral network with guided aggregation for real-time semantic segmentation. IJCV, 129(11):3051–3068, 2021.arxiv.org/abs/2004.02147
- [57]S.W. Zamir et al. Restormer: Efficient transformer for high-resolution image restoration. In Proc. CVPR, 2022.arxiv.org/abs/2111.09881
- [58]Wenqiang Zhang, Zilong Huang, Guozhong Luo, Tao Chen, Xingang Wang, Wenyu Liu, Gang Yu, and Chunhua Shen. TopFormer: Token pyramid transformer for mobile semantic segmentation. In Proc. CVPR, 2022.arxiv.org/abs/2204.05525
- [59]Yurui Zhang, Gaofeng Huang, Jie Cao, Jiwen Luo, Jingshan Xue, and Chunlei Zhou. WeatherStream: Light transport automation of single image deweathering. In Proc. CVPR, 2023.DOI
- [60]Hengshuang Zhao, Jianping Shi, Xiaojun Qi, Xiaogang Wang, and Jiaya Jia. Pyramid scene parsing network. In Proc. CVPR, pages 2881–2890, 2017.


