WorksComputer Science
Signal Scaffolding: Unlocking the Potential of Lightweight Models for Self-Supervised Monocular Depth Estimation
Abstract
With the rising demand for edge devices, lightweight self-supervised monocular depth estimation methods have continued to evolve; however, existing methods generally suffer from poor accuracy. We find that the root cause may lies in the failure of conventional training regimes to fully exploit the inherent potential of lightweight models. To address this, we propose a novel three-phase training strategy for lightweight self-supervised monocular depth estimation, termed Signal Scaffolding (SS). Without introducing any additional dataset or parameters, we apply SS to ReForgeDepth, a lightweight network of our own design. Experiments on the KITTI and Cityscapes datasets demonstrate that our method achieves state-of-the-art performance in the accuracy-efficiency trade-off and running in real time on edge devices. These results suggest that lightweight models can be improved further within their existing capacity, and that the central question may be less about how parameters are allocated than about how to unlock this latent potential through training.
Introduction
Monocular depth estimation is a core perception capability for autonomous driving and robotics. Supervised methods rely on costly LiDAR or manual annotation, whereas self-supervised methods recover depth from monocular video via photometric consistency alone [17, 63]. The pursuit of benchmark accuracy has driven a steady increase in model scale: transformer-based [42, 61] and diffusion-based self-supervised methods [18, 25, 44] routinely exceed tens of millions of parameters while pushing the state of the art. However, as perception tasks increasingly shift toward resource-constrained edge devices, deploying networks at such scale poses considerable challenges. Consequently, compact architectures have emerged as an active research direction [58, 59, 66].1

Figure 1. Performance and qualitative comparison. (a) Qualitative depth predictions: the proposed ReForgeDepth recovers finer boundary details than representative lightweight methods while using the fewest parameters. (b) Accuracy-cost trade-off on KITTI, where ReForgeDepth sits closer to the upper right corner.
Existing research on lightweight monocular depth estimation focuses primarily on network architecture design [12, 32, 57, 66]. For instance, Lyu et al. [37] introduced high-resolution skip connections to preserve spatial details; Zhang et al. [59] proposed a lightweight CNN-Transformer hybrid; and more recently, Chen et al. [4] introduced feature purification to improve estimation efficiency. However, despite continual architectural innovation, lightweight monocular depth estimation has long faced an unexplained accuracy ceiling: the most competitive compact models cluster within a narrow accuracy band, and pushing beyond it typically demands more parameters or more data [12, 32, 57, 59, 66].
In our experiments, we observe that pretraining does not always substantially improve the performance of lightweight networks—a phenomenon consistent with that reported by Muralidharan et al. [39] in supervised tasks. The prevailing view holds that this issue can only be resolved by further scaling up the network [66] or by introducing additional semantic segmentation datasets [48]; yet both remedies run counter to the original intent of lightweight design and severely constrain the development of lightweight monocular depth estimation. We argue that the root cause might lie in the training pipeline inherited from networks of conventional scale: pretrain first, then fine-tune directly [14, 15]. Networks with rich redundancy naturally absorb pretraining knowledge [20, 27, 55]; lightweight networks, with fewer parameters and lower redundancy, can likewise absorb this knowledge, yet ultimately transfer only a small fraction of it.
To address this challenging issue, we propose Signal Scaffolding (SS), a three-phase training strategy that extends the conventional pretrain-then-fine-tune pipeline. Its central insight is that, once network parameters and training data are fixed, the performance bottleneck is determined not solely by model capacity but also by the training strategy. We therefore opt to restructure the training pipeline so as to recover much of the representational capacity lost under the standard procedure. The strategy operates on how training is organized rather than on the parameters themselves. To instantiate and validate this strategy, we further design ReForgeDepth, a lightweight network that incorporates a Gated Multi-Dilation Block (GMD) and a Detail-Compensated Global Interaction (DCGI), together with an RGB Boundary Residual in the decoder, reducing the parameter count while leaving detail and receptive field intact. Applied to ReForgeDepth, SS leaves the architecture, parameters, and dataset untouched; the model still attains state-of-the-art performance in the accuracy-efficiency trade-off on KITTI and Cityscapes, and it also generalizes well to Make3D and runs in real time on edge devices. Our main contributions are summarized as follows:
We propose Signal Scaffolding (SS), a novel three-phase training strategy designed to recover much of the representational capacity lost under the standard training procedure; it substantially improves the accuracy of lightweight models without modifying the network architecture or introducing any additional parameters or dataset.
We design ReForgeDepth, a lightweight network whose core comprises a Gated Multi-Dilation Block (GMD) and a Detail-Compensated Global Interaction (DCGI), together with an RGB Boundary Residual in the decoder, reducing the parameter while leaving detail and receptive field intact.
Experiments on the KITTI and Cityscapes datasets demonstrate that ReForgeDepth, when trained with SS, achieves state-of-the-art performance in the accuracy-efficiency trade-off, and runs in real time on edge devices.
Related Work
Monocular Depth Estimation.
Depth estimation is an ill-posed problem from a single image, so learning-based methods mainly differ in their source of supervision. Early models learned from dense annotations: Eigen et al. (2014) established the CNN formulation, followed by up-projection [28], ordinal discretization [11], and transformer backbones [42]. This accuracy depends on costly, range-limited, and noisy LiDAR or depth cameras, restricting data scale and label quality. Self-supervised methods instead use photometric consistency, judging depth by how well it reconstructs a nearby view. Godard et al. (2017) [16] derived this objective from calibrated stereo with left–right consistency, while Zhou et al. (2017) [63] showed that a moving monocular camera can jointly estimate depth and ego-motion. Because occlusions and static pixels corrupt photometric error, Monodepth2 [17] introduced minimum reprojection and auto-masking. In parallel, PackNet-SfM [19] proposed 3D packing for resolution-robust generalization, and MonoViT [61] combined convolutional and transformer blocks for long-range context.
Lightweight Depth Estimation
Accurate depth networks are costly for edge devices, motivating self-supervised research. Early systems enabled embedded inference through compact encoder-decoder designs and pruning [9, 52], followed by lightweight backbones [40, 41] and hybrid CNN–Transformer architectures [36, 45]. Lite-Mono [59] showed that compact, sub-3M encoders can remain competitive. However, reduced capacity weakens fine structures and sharp depth discontinuities. This penalty has two sources: what a compact architecture cannot represent, and what it can represent but fails to reach under a direct self-supervised objective. The former is a genuine capacity limit; the latter is recoverable through the training signal alone, at no architectural cost—the source this paper targets.
Training-Signal Design for Lightweight Depth Estimation
Lightweight depth estimation is often approached through architectural design, but the training signal also determines how effectively a compact model adapts to the target task. Prior work has explored teacher–student distillation and self-distillation for monocular depth estimation [24, 33, 54, 56], demonstrating the value of informative training signals. Conventional distillation, however, has the student mimic the teacher’s outputs [22], with a ceiling set by the teacher; self-distillation [33] instead refines the model’s own predictions. Both act as replacement signals rather than ones aligned with the student’s representations. Signal Scaffolding (SS) departs from this paradigm:
Methods
We propose ReForgeDepth, a lightweight architecture whose Gated Multi-Dilation Block and Detail-Compensated Global Interaction substantially reduce parameters, enabling effective deployment on mobile devices (Figure 2). The DepthNet adopts an encoder (§ 3.1) and decoder (§ 3.2) design and is jointly optimized with a PoseNet (§ 3.3) in a self-supervised manner (§ 3.4). A Signal Scaffolding (SS) training strategy (§ 3.5) further yields sharper structural details and object contours without inflating the parameter budget or requiring additional data.

Figure 2. (a) Overall Architecture of the ReForgeDepth. The proposed architecture comprises three innovative modules: GMD, and DCGI, with detailed implementations illustrated in Figure 3. (b) The proposed Signal Scaffolding training strategy. Instead of allocating model capacity, it optimizes the training strategy of a fixed capacity—first adapting the student to the target domain through photometric self-supervision, then gradually introducing domain-matched depth guidance. This three-phase strategy aligns the guidance with the student’s task-adapted representations, helping it better exploit its existing capacity.
Encoder Design
Motivation. A compact monocular-depth encoder must balance broad context for ambiguous regions with high-frequency cues for boundaries and thin structures. Stacked dilated blocks increase context at repeated feed-forward network (FFN) and projection cost, while fixed fusion cannot adapt to scene structure. Gated Multi-Dilation Block (GMD) therefore performs parallel consecutive dilated convolutions in one block with input-conditioned gates and road-oriented anisotropic kernels. At each stage end, Detail-Compensated Global Interaction (DCGI) couples local features with stage inputs, preserves signed high-frequency residuals, and adds global channel interaction. Together, GMD extracts adaptive local context, while DCGI restores detail and stage-level context efficiently.
Gated Multi-Dilation Block (GMD). GMD merges three consecutive dilated convolutions blocks, and their FFNs, into one residual block of parallel depthwise dilated convolutions with input-adaptive gates computed from the input (Figure 3, (a)); branches use anisotropic kernels whose taller axis favors the vertical structure dominant in road scenes. Given :

Figure 3. Structures of the proposed GMD and DCGI module.
and the gating path
where is ReLU, the sigmoid, GAP is the Global Average Pooling operator and bias-free pointwise maps; the outputs reshape into per-branch gates , following the squeeze-and-excitation lineage [23, 29] extended to dilation rates, and the zero-initialized gate head lets all branches contribute equally at the start of training. With , the block output is
where FFN is an MLP with GELU [21] and is a LayerScale parameter [46].
Detail-Compensated Global Interaction (DCGI). Each stage terminates with a DCGI block (Figure 3, (b)). The block takes the last local block’s output and the downsampled stage input ; a fixed, parameter-free pooling extracts the signed high-frequency residual , the fine structure that lightweight networks lose first, kept unrectified so that both edge polarities survive. A depthwise–pointwise transform then refines it, and two learnable channel-wise scales form the attention input:
Attention is cross-covariance attention (XCA) [1], operating on channel cross-covariance at cost: with , the -normalized projections of ( a Fourier encoding), the value projection, a learnable per-head temperature, and the output projection,
The block output is
where , are LayerScale parameters [46] and the scalar a zero-initialized gate on the direct attention residual [2].
Decoder and RGB Boundary Residual
We keep the decoder deliberately simple: prior work [59] shows a plain design already performs excellently in lightweight monocular depth, so we add no auxiliary components such as attention [3] and follow [17]: multi-scale features are fused via convolutional blocks and bilinearly upsampled, and a Sigmoid activation yields the final depth map at full resolution and and of it.
To sharpen boundaries, an RGB Boundary Residual (BR) augments the full-resolution output: the RGB image is converted to luminance and passed through fixed Sobel filters, giving the edge tensor ( for numerical stability). A depthwise–pointwise path encodes into an edge feature , and the full-scale decoder feature is projected and upsampled to :
where up denotes upsampling and is GELU. The two are then concatenated and fused:
A sigmoid gate modulates a residual projection, both single-channel:
where and are independently learned convolutions. With the base full-resolution logit:
PoseNet
The pose network follows PoseNet [17, 63]: an ImageNet-pretrained ResNet-18 encoder takes two consecutive frames concatenated along the channel dimension, and a lightweight convolutional decoder predicts the 6-DoF relative pose (Figure 4). This component is kept identical across all training configurations; it participates only in the self-supervised objective and is discarded at inference.

Figure 4. PoseNet is employed to estimate the poses between adjacent frames.
Self-supervised Objective
Similar to [63], depth and camera motion are jointly optimized. For a target frame , the depth network predicts and the pose network the relative transform for each neighboring source frame ; source pixels gathered at the projected locations synthesize the target view,
where is bilinear sampling and maps each target pixel to its location in . Training minimizes the photometric discrepancy
combining SSIM [50] with the distance, as in [17, 63], .
Occlusion and out-of-view pixels corrupt the signal: a pixel absent from a source frame admits no explaining warp, yet a loss summed over frames penalizes the network there. Following [17], we take, per pixel, the minimum over source frames,
in place of the frame-summed loss.
When the camera is stationary, a surface lies at infinity, or an object moves rigidly with the camera, they are excluded by auto-masking [17],
where is the Iverson bracket, the identity reprojection warps the target to itself, and .
Since photometric error is uninformative in weakly textured regions, we additionally regularize the inverse depth with the edge-aware smoothness of [17],
where is the mean-normalized inverse depth. The base objective is
where by default and denoted scale.
Decoupling Depth from Capacity
The performance plateau of lightweight depth models might stems from a capacity–training mismatch: direct fine-tuning may fail to reach the useful portion of a compact student’s hypothesis space. Signal Scaffolding (SS) progressively organizes training signals, unlocking the student’s recoverable capacity without architectural or data changes. A domain-matched teacher (Flex-Large [66]) stimulates this latent capability. Our ablation experiments show that this potential does not come entirely from the teacher, but mainly from the inherent potential of the student model.
Both networks predict inverse depth up to an unknown per-image scale; we align each prediction by its median over the image domain ,
where is the inverse depth obtained from the disparity . The aligned predictions are compared in the log domain, making the discrepancy a relative error that large depths cannot dominate:
where indexes the full, , and outputs, the valid pixels at scale , and . The per-scale terms are aggregated with geometrically decaying weights :
The overall objective couples this with the self-supervised loss,
where is the objective of Eq. (16), , and represents the number of training rounds counted from zero at third phase.
SS will not incur any additional parameters, data or inference overhead.
Experiments
This section presents ReForgeDepth and its Signal Scaffolding framework, and evaluates their effectiveness. For conciseness, the main text reports condensed experimental results, while the complete results are provided in the supplementary material.

Figure 5. Qualitative results on the KITTI Eigen test split. Zoom-in views of the regions marked by colored boxes. Monodepth2 [17] and Lite-Mono [59] blur object boundaries and lose fine details, whereas R-MSFM3-GC [65] and PuriLight [4] oversmooth fine structures. ReForgeDepth, in contrast, preserves sharp boundaries and fine details.
Implementation
We evaluate ReForgeDepth in PyTorch on standard and cross-dataset benchmarks (Intel Core Ultra 7 270K CPU, NVIDIA RTX 5080, 48 GB RAM). Training uses AdamW [35] ( decay) and drop-path in GMD/DCGI: 60 epochs at (cosine learning rate schedule [34]) from scratch, or 30 at with ImageNet pretraining [6], then 30 at with a frozen Flex-Large teacher.
Datasets
KITTI. We train and evaluate on KITTI [13] with the standard Eigen split [7]: 39,180 monocular triplets for training, 4,424 validation images, and 697 test images.
Cityscapes. Cityscapes [5] features crowded urban streets with abundant moving objects and serves as our benchmark for dynamic scenes. We use the 58,335 training and 1,525 test images of [10] at a resolution of .
Make3D. To assess cross-dataset generalization, we apply the KITTI-trained model directly to Make3D [43], which provides 134 outdoor test images, without any fine-tuning.
Results
We evaluate ReForgeDepth on the KITTI [13] and Cityscapes [5] benchmarks (Table 1).2 At KITTI , with 1.5M parameters it attains Abs Rel 0.102, the best among lightweight methods—0.004 ahead of LEDepth [58] and PuriLight [4]—and surpasses Flex-Small [66] with under 25% of its parameters; only Flex-Medium/Large [66] stay ahead. At it again achieves the best Abs Rel, matching the best published result even without ImageNet pretraining. On Cityscapes it reaches 0.091, again the best among lightweight methods, surpassing all high-capacity baselines except Flex-Medium/Large [66]. Across all settings, ReForgeDepth markedly shifts the accuracy–parameter trade-off beyond same-scale models.
| Method | Year | Train | Abs Rel | Sq Rel | RMSE | RMSE log | Params. | |||
| Lite-Mono-tiny [59] | 2023 | M | 0.110 | 0.837 | 4.710 | 0.187 | 0.880 | 0.960 | 0.982 | 2.2M |
| Lite-Mono-small [59] | 2023 | M | 0.110 | 0.802 | 4.671 | 0.186 | 0.879 | 0.961 | 0.982 | 2.5M |
| Lite-Mono [59] | 2023 | M | 0.107 | 0.765 | 4.561 | 0.183 | 0.886 | 0.963 | 0.983 | 3.1M |
| MViTDepth-tiny [12] | 2023 | M | 0.111 | 0.825 | 4.731 | 0.187 | 0.881 | 0.961 | 0.983 | 1.8M |
| MViTDepth-small [12] | 2023 | M | 0.107 | 0.788 | 4.579 | 0.183 | 0.887 | 0.963 | 0.983 | 2.8M |
| R-MSFM3-GC [65] | 2024 | M | 0.112 | 0.789 | 4.621 | 0.189 | 0.880 | 0.960 | 0.982 | 3.5M |
| R-MSFM6-GC [65] | 2024 | M | 0.112 | 0.789 | 4.597 | 0.189 | 0.881 | 0.961 | 0.981 | 3.8M |
| LEDepth [58] | 2025 | M | 0.106 | 0.780 | 4.602 | 0.183 | 0.888 | 0.963 | 0.985 | 3.1M |
| ADDepth-tiny [57] | 2025 | M | 0.112 | 0.815 | 4.642 | 0.186 | 0.880 | 0.962 | 0.983 | 1.8M |
| ADDepth-small [57] | 2025 | M | 0.108 | 0.741 | 4.503 | 0.182 | 0.885 | 0.965 | __0.984__ | 2.8M |
| EdgeMono [49] | 2025 | M | 0.107 | 0.799 | 4.606 | 0.183 | 0.886 | 0.962 | 0.982 | 4.3M |
| PuriLight [4] | 2025 | M | __0.106__ | 0.747 | 4.536 | 0.182 | __0.890__ | __0.964__ | __0.984__ | 2.7M |
| LEA-depth-tiny [32] | 2026 | M | 0.109 | 0.776 | 4.528 | 0.182 | 0.884 | __0.964__ | 0.983 | __1.8M__ |
| LEA-depth-small [32] | 2026 | M | 0.107 | 0.758 | __4.489__ | __0.181__ | 0.888 | __0.964__ | __0.984__ | 3.0M |
| Flex-Nano [66] | 2026 | M | 0.110 | 0.794 | 4.678 | 0.184 | 0.878 | 0.961 | 0.983 | 1.5M |
| Ours | 2026 | M | 0.102 | 0.726 | 4.459 | 0.179 | 0.891 | 0.964 | 0.983 | 1.5M |
| Flex-Nano [66] | 2026 | M | 0.107 | 1.261 | 6.133 | 0.164 | 0.893 | 0.971 | __0.989__ | 1.5M |
| PuriLight [4] | 2025 | M | __0.099__ | __1.014__ | __5.892__ | __0.153__ | __0.901__ | __0.976__ | 0.992 | 2.7M |
| Ours | 2026 | M | 0.091 | 0.918 | 5.590 | 0.146 | 0.912 | 0.978 | 0.992 | 1.5M |
Table 1. Quantitative results. We compare ReForgeDepth with representative methods on the KITTI Eigen split [7]. The best and second-best results in lightweight are highlighted in bold and underlined, respectively. M: KITTI monocular videos.
Figure 5 compares ReForgeDepth with Monodepth2 [17] and recent lightweight models on KITTI [13]: it renders sharper depth discontinuities at object boundaries, where the others over-smooth edges or leak depth, and recovers fine structure with fewer artifacts, consistent with Table 1. Transferred to Make3D [43] without fine-tuning [17], it outperforms all lightweight methods (Table 2) with clearer boundaries and cleaner geometry (See supplementary materials). Overall, ReForgeDepth delivers the best accuracy–efficiency trade-off: 1.5M parameters matching models 4–22× larger.
Table 2. Quantitative results. Comparison of ReForgeDepth with representative methods on the Make3D [43] dataset.
Complexity and Runtime
Table 3 reports model complexity and speed at on a MacBook Air (M2) and an iPhone 12 (A14), measured with Apple Core ML (Float32) and averaged over 200 runs after 50 warm-ups. ReForgeDepth attains the highest FPS on both devices, sustaining real-time inference on the iPhone 12 with the best accuracy–efficiency trade-off.
Why FLOPs fail to predict on-device latency. On mobile SoCs, latency depends more on operator-level hardware support than on FLOPs. Although Monodepth2-Res18 [17] requires more FLOPs than ReForgeDepth, both achieve nearly identical latency on the iPhone 12 because Monodepth2-Res18’s convolution-only architecture is well optimized by mobile inference engines. Conversely, PuriLight [4] has modest FLOPs but runs significantly slower because its frequency-domain operations are poorly supported on mobile devices.
Ablation Study
DepthNet (See supplementary materials). All variants are trained from scratch to isolate the architecture from pre-training. In every pairing, our GMD and DCGI match or outperform the Lite-Mono [59] CDC and LGFI at roughly half the parameters and 25% fewer FLOPs (0.124 at 1.29M vs. 2.67M); adding BR yields the best from-scratch result.
Table 3. Model complexity and inference speed. All models process inputs. Params: number of parameters; FLOPs: floating-point operations; FPS: frames per second.
Signal Scaffolding (Table 4, Table 5, Table 6). Table 4 applies SS to different model scales under identical data. The gain decreases from 0.005 Abs Rel for Lite-Mono-tiny [59] to 0.001 for Lite-Mono-8M [59], with the smallest model benefiting most. Under the same teacher, gains likewise shrink as model size grows. Teacher capability is thus a secondary factor; what dominates, instead, is likely the student’s recoverable capacity and its ability to exploit the training signal3. Table 5 shows that constant weights and delayed onset are suboptimal: full strength hinders optimization, while weaker weights lead to underfitting. Ramping the signal from zero performs best, allowing small networks to adapt gradually. Table 6 further shows that teacher quality and domain alignment matter: low-redundancy students amplify teacher noise, while cross-domain teachers introduce gaps that hinder learning. Simply extending training epochs provides little additional benefit.
| Method | Abs Rel | Sq Rel | RMSE | |||
| w/o | w/ | w/o | w/ | w/o | w/ | |
| (a) Teacher: Lite-Mono-8M | ||||||
| Lite-Mono-tiny | 0.110 | 0.106 | 0.837 | 0.799 | 4.710 | 4.574 |
| Flex-Nano | 0.110 | 0.108 | 0.794 | 0.789 | 4.678 | 4.627 |
| Lite-Mono | 0.107 | 0.105 | 0.765 | 0.747 | 4.561 | 4.511 |
| ReForgeDepth (ours) | 0.110 | 0.104 | 0.894 | 0.746 | 4.748 | 4.521 |
| (b) Teacher: Flex-Large | ||||||
| Lite-Mono-tiny | 0.110 | 0.105 | 0.837 | 0.773 | 4.710 | 4.516 |
| Flex-Nano | 0.110 | 0.106 | 0.794 | 0.757 | 4.678 | 4.547 |
| Lite-Mono-8M | 0.101 | 0.100 | 0.729 | 0.696 | 4.454 | 4.356 |
| ReForgeDepth (ours) | 0.110 | 0.102 | 0.894 | 0.726 | 4.748 | 4.459 |
Table 4. Generalization of the Signal Scaffolding (SS) on the KITTI Eigen split. “w/o SS” denotes training with ImageNet initialization only, and “w/ SS” further applies Signal Scaffolding.
Table 5. Sensitivity of the weight and its schedule on the KITTI Eigen split. is the coefficient of the distillation loss in Eq. (20); “Start ep.” denotes the epoch at which distillation is activated, and “Warm-up” indicates whether increases gradually from zero.
| Weight | Warm-up | Start ep. | Teacher | Abs Rel |
| (a) Distillation weight, activated from epoch 0 | ||||
| 0.1 | 0 | LiteMono-8M | 0.106 | |
| 0.1 | 0 | Flex-Large | 0.104 | |
| 0.05 | 0 | LiteMono-8M | 0.107 | |
| 0.05 | 0 | Flex-Large | 0.105 | |
| 0.025 | 0 | LiteMono-8M | 0.108 | |
| 0.025 | 0 | Flex-Large | 0.106 | |
| (b) Distillation weight, activated from epoch 5 | ||||
| 0.1 | 5 | LiteMono-8M | 0.106 | |
| 0.1 | 5 | Flex-Large | 0.105 | |
| 0.05 | 5 | LiteMono-8M | 0.107 | |
| 0.05 | 5 | Flex-Large | 0.105 | |
| 0.025 | 5 | LiteMono-8M | 0.108 | |
| 0.025 | 5 | Flex-Large | 0.106 | |
| (c) Warm-up () | ||||
| 0.1 | 5 | LiteMono-8M | 0.107 | |
| 0.1 | 5 | Flex-Large | 0.104 | |
| 0.1 | 0 | LiteMono-8M | 0.104 | |
| 0.1 | 0 | Flex-Large | 0.102 |
Table 6. Ablation of training components and teacher choice. Phase I denotes ImageNet initialization, Phase II denotes photometric self-supervised training, and Phase III denotes teacher distillation. A teacher name indicates that Phase III is used; indicates that it is omitted. Best Abs Rel is in bold.
| Configuration | KITTI Eigen | ||
| Phase I | Phase II | Phase III | Abs Rel |
| (a) Training-component ablation | |||
| Lite-Mono-8M | 0.120 | ||
| Flex-Large | 0.147 | ||
| 0.117 | |||
| Lite-Mono-8M | 0.115 | ||
| Flex-Large | 0.115 | ||
| 0.110 | |||
| Teacher-free (30 epoch.) | 0.110 | ||
| Lite-Mono-8M | 0.113 | ||
| Flex-Large | 0.111 | ||
| (b) Teacher choice under the full SS strategy | |||
| Depth Anything V3-Small | 0.114 | ||
| Lite-Mono-3.1M | 0.107 | ||
| LiteMono-8M | 0.104 | ||
| Flex-Large | 0.102 |
Overall, SS has enhanced the depth accuracy of compact models without increasing the inference burden. The longer the self-supervised training time of the traditional training strategy, the more limited the improvement achieved. These results indicate that the traditional training strategy may not be able to achieve the performance that compact models can reach, while SS reduces the mismatch between training strategy and model capacity and enables small models to better utilize their existing expressive capabilities.
Conclusion
This paper reveals the mismatch between the training strategy and model capacity in lightweight self-supervised depth estimation. We propose “Signal Scaffolding”—a three-phase strategy that gradually adjusts the training signals to approach the target task, thereby unlocking the latent representational capacity of the lightweight model without the need for additional dataset or parameters. In addition, we design ReForgeDepth, which reduces the number of parameters while retaining detailed information and the receptive field. On the KITTI and Cityscapes datasets, ReForgeDepth achieves the best balance of accuracy and efficiency among the compared methods, and outperforms other models of the same scale by a large margin.
Two limitations remain: photometric consistency degrades depth around moving objects, and the lack of ground-truth depth caps accuracy. Future work will integrate motion-aware masking into Signal Scaffolding and explore stronger geometric priors in even more compact architectures, narrowing the supervised gap while preserving on-device efficiency.
LLM Usage Statement
During the preparation of this work, the authors used a large language model (LLM) to polish the language of the manuscript. The tool was not used to generate technical content, to conduct or analyze experiments, or to produce citations. All AI-assisted text was reviewed and edited by the authors, who take full responsibility for the content of this paper.
Supplementary data and results
This section provides the complete data and results that complement the main paper: full quantitative comparisons on KITTI [13] and Cityscapes [5] (Table 9 and Table 7), qualitative results on Make3D [43] (Figure 6), and extended ablations on Signal Scaffolding, the distillation weight, the architecture, and the progressive training framework (Table 8, Table 10, Table 11 and Table 12).
| Method | Year | Train | Abs Rel | Sq Rel | RMSE | RMSE log | Params. | |||
| 416×128 (M) | ||||||||||
| Lightweight (<5M) | ||||||||||
| Flex-Nano [66] | 2026 | M | 0.107 | 1.261 | 6.133 | 0.164 | 0.893 | 0.971 | 0.989 | 1.5M |
| PuriLight[4] | 2025 | M | 0.099 | 1.014 | 5.892 | 0.153 | 0.901 | 0.976 | 0.992 | 2.7M |
| Ours | 2026 | M | 0.091 | 0.918 | 5.590 | 0.146 | 0.912 | 0.978 | 0.992 | 1.5M |
| High-capacity | ||||||||||
| ManyDepth [51] | 2021 | M | 0.114 | 1.193 | 6.223 | 0.170 | 0.875 | 0.967 | 0.989 | 29.3M |
| ManyDepth2 [62] | 2025 | M | 0.097 | 0.792 | 5.827 | 0.154 | 0.903 | 0.975 | 0.993 | 22.6M |
| DynamicDepth [10] | 2022 | MS | 0.103 | 1.000 | 5.867 | 0.157 | 0.895 | 0.974 | 0.991 | 29.3M |
| ProDepth [53] | 2024 | M | 0.095 | 0.876 | 5.531 | 0.146 | 0.908 | 0.978 | 0.993 | 27.7M |
| MonoViT [61] | 2022 | M | 0.114 | 1.238 | 6.589 | 0.174 | 0.860 | 0.965 | 0.990 | 27.9M |
| FGTO [38] | 2024 | MS | 0.096 | 0.930 | 5.806 | 0.152 | 0.905 | 0.976 | 0.992 | 27.9M+ |
| Self-Distillation [56] | 2025 | M | 0.118 | 1.091 | 6.076 | 0.173 | 0.854 | 0.960 | 0.988 | 27.9M+ |
| Flex-Small [66] | 2026 | M | 0.100 | 1.078 | 5.813 | 0.153 | 0.904 | 0.975 | 0.991 | 6.1M |
| Flex-Medium [66] | 2026 | M | 0.089 | 0.885 | 5.358 | 0.143 | 0.917 | 0.979 | 0.993 | 12.7M |
| Flex-Large [66] | 2026 | M | 0.087 | 0.911 | 5.310 | 0.139 | 0.924 | 0.981 | 0.993 | 15.2M |
Table 7. Table 7. Quantitative results. We compare ReForgeDepth with representative methods on the Cityscapes . The best and second-best results in lightweight are highlighted in bold and <u>underlined</u>, respectively. M: monocular videos, MS: monocular videos + semantic segmentation.
| Method | Abs Rel↓ w/o | Abs Rel↓ w/ | Sq Rel↓ w/o | Sq Rel↓ w/ | RMSE↓ w/o | RMSE↓ w/ | RMSE log↓ w/o | RMSE log↓ w/ |
| (a) Teacher: Lite-Mono-8M [59] | ||||||||
| Lite-Mono-tiny [59] | 0.110 | 0.106 | 0.837 | 0.799 | 4.710 | 4.574 | 0.187 | 0.182 |
| Flex-Nano [66] | 0.110 | 0.108 | 0.794 | 0.789 | 4.678 | 4.627 | 0.184 | 0.184 |
| Lite-Mono [59] | 0.107 | 0.105 | 0.765 | 0.747 | 4.561 | 4.511 | 0.183 | 0.181 |
| ReForgeDepth (ours) | 0.110 | 0.104 | 0.894 | 0.746 | 4.748 | 4.521 | 0.186 | 0.180 |
| (b) Teacher: Flex-Large [66] | ||||||||
| Lite-Mono-tiny [59] | 0.110 | 0.105 | 0.837 | 0.773 | 4.710 | 4.516 | 0.187 | 0.180 |
| Flex-Nano [66] | 0.110 | 0.106 | 0.794 | 0.757 | 4.678 | 4.547 | 0.184 | 0.182 |
| Lite-Mono-8M [59] | 0.101 | 0.100 | 0.729 | 0.696 | 4.454 | 4.356 | 0.178 | 0.176 |
| ReForgeDepth (ours) | 0.110 | 0.102 | 0.894 | 0.726 | 4.748 | 4.459 | 0.186 | 0.179 |
Table 8. Table 8. Generalization of the Signal Scaffolding (SS) on the KITTI Eigen split. “w/o SS” denotes training with ImageNet initialization only, and “w/ SS” further applies Signal Scaffolding.
Table 9. Quantitative results. We compare ReForgeDepth with representative methods on the KITTI Eigen split [7]. The best and second-best results in lightweight are highlighted in bold and <u>underlined</u>, respectively. M{sup}†: not pre-trained on ImageNet {citep}[6], M: KITTI monocular videos, MS: monocular videos + semantic segmentation, M{sup}∗: input resolution of 1024 × 320.
| Method | Year | Train | Abs Rel | Sq Rel | RMSE | RMSE log | Params. | |||
| 1024 × 320 (M∗) | ||||||||||
| Lightweight (<5M) | ||||||||||
| R-MSFM3 [64] | 2021 | M∗ | 0.112 | 0.773 | 4.581 | 0.189 | 0.879 | 0.960 | 0.982 | 3.5M |
| R-MSFM6 [64] | 2021 | M∗ | 0.108 | 0.748 | 4.470 | 0.185 | 0.889 | 0.963 | 0.982 | 3.8M |
| MViTDepth-tiny [12] | 2023 | M∗ | 0.109 | 0.818 | 4.603 | 0.184 | 0.887 | 0.963 | 0.983 | 1.8M |
| MViTDepth-small [12] | 2023 | M∗ | 0.104 | 0.772 | 4.460 | 0.180 | 0.893 | 0.965 | 0.984 | 2.8M |
| Lite-Mono-tiny [59] | 2023 | M∗ | 0.104 | 0.764 | 4.487 | 0.180 | 0.892 | 0.964 | 0.983 | 2.2M |
| Lite-Mono-small [59] | 2023 | M∗ | 0.103 | 0.757 | 4.449 | 0.180 | 0.894 | 0.964 | 0.983 | 2.5M |
| Lite-Mono [59] | 2023 | M∗ | 0.102 | 0.746 | 4.444 | 0.179 | 0.896 | 0.965 | 0.983 | 3.1M |
| LEDepth [58] | 2025 | M∗ | 0.101 | 0.744 | 4.425 | 0.177 | 0.899 | 0.965 | 0.985 | 3.1M |
| PuriLight [4] | 2025 | M∗ | 0.100 | 0.718 | 4.403 | 0.177 | 0.901 | 0.967 | 0.985 | 2.7M |
| Ours | 2026 | M∗ | 0.098 | 0.712 | 4.339 | 0.174 | 0.902 | 0.967 | 0.984 | 1.5M |
| High-capacity | ||||||||||
| Monodepth2-Res18 [17] | 2019 | M∗ | 0.115 | 0.882 | 4.701 | 0.190 | 0.879 | 0.961 | 0.982 | 14.3M |
| HR-Depth [37] | 2021 | M∗ | 0.106 | 0.755 | 4.472 | 0.181 | 0.892 | 0.966 | 0.984 | 14.7M |
| MViTDepth [12] | 2023 | M∗ | 0.102 | 0.756 | 4.415 | 0.177 | 0.899 | 0.966 | 0.984 | 6.3M |
| Lite-Mono-8M [59] | 2023 | M∗ | 0.097 | 0.710 | 4.309 | 0.174 | 0.905 | 0.967 | 0.984 | 8.7M |
| 640 × 192 (M) | ||||||||||
| Lightweight (<5M) | ||||||||||
| Lite-Mono-tiny [59] | 2023 | M | 0.110 | 0.837 | 4.710 | 0.187 | 0.880 | 0.960 | 0.982 | 2.2M |
| Lite-Mono-small [59] | 2023 | M | 0.110 | 0.802 | 4.671 | 0.186 | 0.879 | 0.961 | 0.982 | 2.5M |
| Lite-Mono [59] | 2023 | M | 0.107 | 0.765 | 4.561 | 0.183 | 0.886 | 0.963 | 0.983 | 3.1M |
| MViTDepth-tiny [12] | 2023 | M | 0.111 | 0.825 | 4.731 | 0.187 | 0.881 | 0.961 | 0.983 | 1.8M |
| MViTDepth-small [12] | 2023 | M | 0.107 | 0.788 | 4.579 | 0.183 | 0.887 | 0.963 | 0.983 | 2.8M |
| R-MSFM3-GC [65] | 2024 | M | 0.112 | 0.789 | 4.621 | 0.189 | 0.880 | 0.960 | 0.982 | 3.5M |
| R-MSFM6-GC [65] | 2024 | M | 0.112 | 0.789 | 4.597 | 0.189 | 0.881 | 0.961 | 0.981 | 3.8M |
| LEDepth [58] | 2025 | M | 0.106 | 0.780 | 4.602 | 0.183 | 0.888 | 0.963 | 0.985 | 3.1M |
| ADDepth-tiny [57] | 2025 | M | 0.112 | 0.815 | 4.642 | 0.186 | 0.880 | 0.962 | 0.983 | 1.8M |
| ADDepth-small [57] | 2025 | M | 0.108 | 0.741 | 4.503 | 0.182 | 0.885 | 0.965 | 0.984 | 2.8M |
| EdgeMono [49] | 2025 | M | 0.107 | 0.799 | 4.606 | 0.183 | 0.886 | 0.962 | 0.982 | 4.3M |
| PuriLight [4] | 2025 | M | 0.106 | 0.747 | 4.536 | 0.182 | 0.890 | 0.964 | 0.984 | 2.7M |
| LEA-depth-tiny [32] | 2026 | M | 0.109 | 0.776 | 4.528 | 0.182 | 0.884 | 0.964 | 0.983 | 1.8M |
| LEA-depth-small [32] | 2026 | M | 0.107 | 0.758 | 4.489 | 0.181 | 0.888 | 0.964 | 0.984 | 3.0M |
| Flex-Nano [66] | 2026 | M | 0.110 | 0.794 | 4.678 | 0.184 | 0.878 | 0.961 | 0.983 | 1.5M |
| Ours | 2026 | M | 0.102 | 0.726 | 4.459 | 0.179 | 0.891 | 0.964 | 0.983 | 1.5M |
| High-capacity | ||||||||||
| Monodepth2-Res18 [17] | 2019 | M | 0.115 | 0.903 | 4.863 | 0.193 | 0.877 | 0.959 | 0.981 | 14.3M |
| Monodepth2-Res50 [17] | 2019 | M | 0.110 | 0.831 | 4.642 | 0.187 | 0.883 | 0.962 | 0.982 | 32.5M |
| SGDepth [26] | 2020 | MS | 0.113 | 0.835 | 4.693 | 0.191 | 0.879 | 0.961 | 0.981 | 16.3M |
| MonoFormer [3] | 2022 | M | 0.108 | 0.806 | 4.594 | 0.184 | 0.884 | 0.963 | 0.983 | 23.9M+ |
| MViTDepth [12] | 2023 | M | 0.106 | 0.766 | 4.507 | 0.180 | 0.891 | 0.964 | 0.984 | 6.3M |
| Lite-Mono-8M [59] | 2023 | M | 0.101 | 0.729 | 4.454 | 0.178 | 0.897 | 0.965 | 0.983 | 8.7M |
| Mono-ViFi-Res18 [31] | 2024 | M | 0.105 | 0.708 | 4.446 | 0.179 | 0.887 | 0.965 | 0.984 | 14.3M |
| R-MSFMX3-GC [65] | 2024 | M | 0.111 | 0.765 | 4.591 | 0.189 | 0.880 | 0.961 | 0.982 | 5.0M |
| R-MSFMX6-GC [65] | 2024 | M | 0.109 | 0.761 | 4.552 | 0.186 | 0.885 | 0.962 | 0.982 | 5.2M |
| ADDepth [57] | 2025 | M | 0.106 | 0.712 | 4.425 | 0.180 | 0.889 | 0.965 | 0.984 | 6.3M |
| LEA-depth [32] | 2026 | M | 0.103 | 0.718 | 4.406 | 0.178 | 0.893 | 0.966 | 0.984 | 5.8M |
| Flex-Small [66] | 2026 | M | 0.104 | 0.713 | 4.458 | 0.179 | 0.890 | 0.964 | 0.983 | 6.1M |
| Flex-Medium [66] | 2026 | M | 0.096 | 0.639 | 4.253 | 0.172 | 0.903 | 0.968 | 0.985 | 12.7M |
| Flex-Large [66] | 2026 | M | 0.095 | 0.642 | 4.199 | 0.171 | 0.906 | 0.968 | 0.984 | 15.2M |
| 640 × 192, Not Pre-trained on ImageNet (M†) | ||||||||||
| Lightweight (<5M) | ||||||||||
| R-MSFM3 [64] | 2021 | M† | 0.128 | 0.965 | 5.019 | 0.207 | 0.853 | 0.951 | 0.977 | 3.5M |
| R-MSFM6 [64] | 2021 | M† | 0.126 | 0.944 | 4.981 | 0.204 | 0.857 | 0.952 | 0.978 | 3.8M |
| Lite-Mono-Tiny [59] | 2023 | M† | 0.125 | 0.935 | 4.986 | 0.204 | 0.853 | 0.950 | 0.978 | 2.2M |
| Lite-Mono-small [59] | 2023 | M† | 0.123 | 0.919 | 4.926 | 0.202 | 0.859 | 0.951 | 0.977 | 2.5M |
| Lite-Mono [59] | 2023 | M† | 0.121 | 0.876 | 4.918 | 0.199 | 0.859 | 0.953 | 0.980 | 3.1M |
| RTIA-Mono [60] | 2025 | M† | 0.118 | 0.858 | 4.810 | 0.196 | 0.865 | 0.955 | 0.980 | 1.4M |
| EdgeMono [49] | 2025 | M† | 0.117 | 0.886 | 4.817 | 0.195 | 0.867 | 0.957 | 0.981 | 4.3M |
| PuriLight [4] | 2025 | M† | 0.121 | 0.908 | 4.908 | 0.199 | 0.862 | 0.954 | 0.980 | 2.7M |
| Ours | 2026 | M† | 0.117 | 0.860 | 4.767 | 0.195 | 0.868 | 0.957 | 0.980 | 1.5M |
| High-capacity | ||||||||||
| Monodepth2-Res18 [17] | 2019 | M† | 0.132 | 1.044 | 5.142 | 0.210 | 0.845 | 0.948 | 0.977 | 14.3M |
| Monodepth2-Res50 [17] | 2019 | M† | 0.131 | 1.023 | 5.046 | 0.206 | 0.849 | 0.951 | 0.979 | 32.5M |
Table 9.

Figure 6. Qualitative results on the Make3D dataset. Validation on challenging scenes from the Make3D dataset. Compared with prior lightweight models, ReForgeDepth captures a wider receptive field and finer details, demonstrating superior generalization to unseen data.
| Weight | Warm-up | Start ep. | Teacher | Abs Rel | Sq Rel | RMSE | RMSE log | |||
| (a) Distillation weight, activated from epoch 0 | ||||||||||
| 0.1 | ✗ | 0 | LiteMono-8M [59] | 0.106 | 0.795 | 4.603 | 0.183 | 0.887 | 0.962 | 0.983 |
| 0.1 | ✗ | 0 | Flex-Large [66] | 0.104 | 0.772 | 4.552 | 0.181 | 0.888 | 0.963 | 0.983 |
| 0.05 | ✗ | 0 | LiteMono-8M [59] | 0.107 | 0.820 | 4.641 | 0.184 | 0.886 | 0.962 | 0.982 |
| 0.05 | ✗ | 0 | Flex-Large [66] | 0.105 | 0.795 | 4.605 | 0.182 | 0.887 | 0.962 | 0.983 |
| 0.025 | ✗ | 0 | LiteMono-8M [59] | 0.108 | 0.841 | 4.675 | 0.184 | 0.885 | 0.962 | 0.982 |
| 0.025 | ✗ | 0 | Flex-Large [66] | 0.106 | 0.804 | 4.625 | 0.183 | 0.886 | 0.962 | 0.983 |
| (b) Distillation weight, activated from epoch 5 | ||||||||||
| 0.1 | ✗ | 5 | LiteMono-8M [59] | 0.106 | 0.810 | 4.628 | 0.183 | 0.886 | 0.962 | 0.982 |
| 0.1 | ✗ | 5 | Flex-Large [66] | 0.105 | 0.773 | 4.567 | 0.181 | 0.888 | 0.963 | 0.983 |
| 0.05 | ✗ | 5 | LiteMono-8M [59] | 0.107 | 0.814 | 4.648 | 0.184 | 0.886 | 0.962 | 0.982 |
| 0.05 | ✗ | 5 | Flex-Large [66] | 0.105 | 0.788 | 4.607 | 0.183 | 0.887 | 0.962 | 0.983 |
| 0.025 | ✗ | 5 | LiteMono-8M [59] | 0.108 | 0.836 | 4.673 | 0.184 | 0.886 | 0.962 | 0.982 |
| 0.025 | ✗ | 5 | Flex-Large [66] | 0.106 | 0.803 | 4.628 | 0.183 | 0.887 | 0.962 | 0.982 |
| (c) Warm-up () | ||||||||||
| 0.1 | ✓ | 5 | LiteMono-8M [59] | 0.107 | 0.812 | 4.631 | 0.183 | 0.887 | 0.962 | 0.982 |
| 0.1 | ✓ | 5 | Flex-Large [66] | 0.104 | 0.769 | 4.565 | 0.181 | 0.888 | 0.963 | 0.983 |
| 0.1 | ✓ | 0 | LiteMono-8M [59] | 0.104 | 0.746 | 4.521 | 0.180 | 0.887 | 0.964 | 0.983 |
| 0.1 | ✓ | 0 | Flex-Large [66] | 0.102 | 0.726 | 4.459 | 0.179 | 0.891 | 0.964 | 0.983 |
Table 10. Sensitivity of the weight and its schedule on the KITTI Eigen split. is the coefficient of the distillation loss in Eq. (20); “Start ep.” denotes the epoch at which distillation is activated, and “Warm-up” indicates whether increases gradually from zero.
| CDC | GMD | LGFI | DCGI | BR | Abs Rel | Sq Rel | RMSE | RMSE log | Params (M) | FLOPs (G) | |||
| (Encoder configuration) | (Accuracy) | (Complexity) | |||||||||||
| ✓ | 0.124 | 0.995 | 4.995 | 0.199 | 0.860 | 0.954 | 0.979 | 2.67 | 4.403 | ||||
| ✓ | 0.124 | 0.952 | 4.983 | 0.203 | 0.850 | 0.952 | 0.979 | 1.29 | 3.253 | ||||
| ✓ | ✓ | 0.121 | 0.876 | 4.918 | 0.199 | 0.859 | 0.953 | 0.980 | 3.07 | 5.032 | |||
| ✓ | ✓ | 0.120 | 0.880 | 4.874 | 0.199 | 0.861 | 0.953 | 0.979 | 1.70 | 3.760 | |||
| ✓ | ✓ | 0.121 | 0.942 | 4.872 | 0.199 | 0.864 | 0.954 | 0.979 | 2.90 | 4.775 | |||
| ✓ | ✓ | 0.119 | 0.880 | 4.831 | 0.196 | 0.866 | 0.956 | 0.981 | 1.53 | 3.503 | |||
| ✓ | ✓ | ✓ | 0.117 | 0.860 | 4.767 | 0.195 | 0.868 | 0.957 | 0.980 | 1.53 | 3.626 |
Table 11. Ablation study of the ReForgeDepth architecture on the KITTI Eigen split. CDC and LGFI are the encoder blocks and the feature-interaction module of Lite-Mono, respectively; GMD, DCGI, and BR are our contributions. All experiments were trained from scratch to highlight the impact of the architecture. Best accuracy is in bold.
| Phase I | Phase II | Phase III | Abs Rel | Sq Rel | RMSE | RMSE log | |||
| (a) Training strategies | |||||||||
| ✗ | ✗ | Lite-Mono-8M [59] | 0.120 | 0.890 | 4.887 | 0.198 | 0.860 | 0.954 | 0.980 |
| ✗ | ✗ | Flex-Large [66] | 0.147 | 1.105 | 5.444 | 0.219 | 0.807 | 0.939 | 0.977 |
| ✗ | ✓ | ✗ | 0.117 | 0.860 | 4.767 | 0.195 | 0.868 | 0.957 | 0.980 |
| ✗ | ✓ | Lite-Mono-8M [59] | 0.115 | 0.833 | 4.739 | 0.193 | 0.871 | 0.958 | 0.981 |
| ✗ | ✓ | Flex-Large [66] | 0.115 | 0.836 | 4.722 | 0.193 | 0.872 | 0.958 | 0.981 |
| ✓ | ✓ | 0.110 | 0.894 | 4.748 | 0.186 | 0.884 | 0.961 | 0.982 | |
| ✓ | ✓ | Teacher-free (30 epoch.) | 0.110 | 0.871 | 4.714 | 0.186 | 0.884 | 0.961 | 0.982 |
| ✓ | ✗ | Lite-Mono-8M [59] | 0.113 | 0.847 | 4.642 | 0.185 | 0.878 | 0.962 | 0.983 |
| ✓ | ✗ | Flex-Large [66] | 0.111 | 0.762 | 4.636 | 0.185 | 0.873 | 0.961 | 0.984 |
| (b) Teacher model | |||||||||
| ✓ | ✓ | Depth Anything V3-Small [30] | 0.114 | 0.875 | 5.642 | 0.205 | 0.848 | 0.945 | 0.978 |
| ✓ | ✓ | Lite-Mono-3.1M [59] | 0.107 | 0.810 | 4.588 | 0.184 | 0.884 | 0.962 | 0.982 |
| ✓ | ✓ | Lite-Mono-8M [59] | 0.104 | 0.746 | 4.521 | 0.180 | 0.887 | 0.964 | 0.983 |
| ✓ | ✓ | Flex-Large [66] | 0.102 | 0.726 | 4.459 | 0.179 | 0.891 | 0.964 | 0.983 |
Table 12. Ablation of training components and teacher choice. Phase I denotes ImageNet initialization, Phase II denotes photometric self-supervised training, and Phase III denotes teacher distillation. A teacher name indicates that Phase III is used; ✗ indicates that it is omitted. Best Abs Rel is in bold.
Table 9 reports the complete results on the KITTI Eigen split under three settings. 1024×320 (M). In models with fewer than 5M parameters, ReForgeDepth uses only 1.5M parameters and achieves the best or near-best results on all error metrics. Its absolute relative error ratio is as low as 0.001 compared to the large-capacity model Lite-Mono-8M [59], which is 5.8 times larger in size; at the same time, it outperforms most of the other high-capacity baseline models in terms of most metrics, including MViTDepth [12], HR-Depth [37], and Monodepth2-Res18 [17].
640×192 (M). ReForgeDepth achieves 0.102 Abs Rel with 1.5M parameters, ranking first among all lightweight methods and exceeding most high-capacity models, e.g., LEA-depth [32], Mono-ViFI-Res18 [31], and ADDepth [57]; only Lite-Mono-8M [59], Flex-Medium [66] and Flex-Large [66], which are 8.5× and 10.1× larger, obtain lower errors.
Without ImageNet pretraining (M). Although removing pretraining degrades all methods, ReForgeDepth still ties EdgeMono [49] for the best Abs Rel with 2.9× fewer parameters, and achieves the best RMSE, RMSE log, , and , indicating that our gains do not rely on stronger initialization. Table 7 lists the results on Cityscapes [5] at 416×128. ReForgeDepth reaches 0.091 Abs Rel with 1.5M parameters, reducing the error of PuriLight [4] by 8.1% and that of the equally sized Flex-Nano [66] by 15.0%. It also outperforms all high-capacity baselines except Flex-Medium [66] and Flex-Large [66], e.g., ProDepth [53], ManyDepth2 [62], and ManyDepth [51].
Figure 6 shows qualitative predictions on challenging scenes from Make3D [43]. The model is trained solely on KITTI [13] and evaluated on Make3D [43] without any fine-tuning [17]. ReForgeDepth predicts depth over a wider scene range and recovers finer structures than prior lightweight models, confirming its generalization beyond the training domain.
Generality of Signal Scaffolding Table 8 applies SS to four students under two teachers. SS improves every student–teacher pair, and the gain is inversely related to student size: Lite-Mono-tiny [59] improves by 0.004–0.005, Lite-Mono [59] by 0.002, and the 8.7M Lite-Mono-8M [59] by only 0.001. This phenomenon can be quantified through a transitivity analysis. Let , , and . If the teacher prior were the sole determinant, the gain would depend only on the teacher: since improves by 1%, it should likewise improve by roughly 1%; in practice, improves by 4.6%—4.6 times the predicted value. Conversely, replacing student ’s teacher with the roughly 6% stronger raises the gain only from 3.6% to 4.6% (+1.0%), whereas swapping the student from to under the same teacher raises the gain from 1% to 4.6% (+3.6%). Teacher capability is thus a secondary factor; what dominates, instead, is likely the student’s recoverable capacity and its ability to exploit the training signal. Two independent observations are consistent with this reading. First, even after SS, still trails by 5%, indicating that the teacher’s knowledge is not transferred wholesale— absorbs only about one-sixth of the teacher–student gap, so the bottleneck lies in student capacity rather than the teacher prior. Second, under the same 1.5M parameter budget and the same teacher, ReForgeDepth improves far more than Flex-Nano [66], indicating that the recoverable capacity also depends on the architecture. These results confirm that SS, by reducing the capacity–training mismatch, lets small models better exploit their existing expressive power.
Sensitivity to the Distillation Weight Table 10 examines , its activation epoch, and warm-up. With a constant weight (a), is best and smaller weights underfit (0.107–0.108 vs. 0.106 for Lite-Mono-8M [59]). Delaying the onset to epoch 5 (b) removes early guidance and slightly degrades the results. With warm-up (c), ramping from zero starting at epoch 0 is consistently the best across both teachers (0.104 and 0.102), supporting the design adopted in the main paper.
Architecture Ablation Table 11 compares our blocks with their Lite-Mono [59] counterparts, all trained from scratch. Replacing CDC with GMD yields the same Abs Rel (0.124) with 51.7% fewer parameters (1.29M vs. 2.67M) and 26.1% fewer FLOPs. Replacing the CDC–LGFI pair with GMD–DCGI improves Abs Rel (0.121→0.119) while reducing the model size from 3.07M to 1.53M.. Adding BR brings a final, consistent improvement on all metrics (0.119→0.117) at a negligible cost of 0.12 GFLOPs. The resulting configuration coincides with the not-pretrained entry (0.117) in Table 9.
Progressive Training and Teacher Selection Table 12 dissects the three-phase strategy and the teacher choice. (a) Every phase is necessary: distilling directly from scratch collapses, especially with the strongest teacher Flex-Large [66] (0.147); self-supervised Phase II alone reaches 0.117; adding ImageNet initialization lowers it to 0.110 and prolonging the training does not change it; and the full recipe with distillation reaches 0.104 (Lite-Mono-8M [59]). Skipping Phase II while keeping Phase I and III also degrades, showing that the intermediate self-supervised phase is not redundant. (b) Under the full strategy, the teacher’s domain match and accuracy jointly determine the outcome: the cross-domain Depth Anything V3-Small [30] even degrades the student, the weak in-domain Lite-Mono [59] brings a limited gain, and stronger in-domain teachers improve the student monotonically, from 0.104 (Lite-Mono-8M [59]) to 0.102 (Flex-Large [66]).
References
- [1]Alaaeldin Ali, Hugo Touvron, Mathilde Caron, Piotr Bojanowski, Matthijs Douze, Armand Joulin, Ivan Laptev, Natalia Neverova, Gabriel Synnaeve, Jakub Verbeek, et al. Cross-covariance image transformers. NeurIPS, 34, 2021. 4
- [2]Thomas Bachlechner, Bodhisattwa Prasad Majumder, Henry Mao, Gary Cottrell, and Julian McAuley. Rezero is all you need: Fast convergence at large depth. In UAI, 2021. 4arxiv.org/abs/2003.04887
- [3]Jinwoo Bae, Sungho Moon, and Sunghoon Im. Monoformer: Towards generalization of self-supervised monocular depth estimation with transformers. In AAAI, 2023. 4
- [4]Yujie Chen, Li Zhang, Xiaomeng Chu, and Tian Zhang. Purilight: A lightweight shuffle and purification framework for monocular depth estimation. In ECAI, 2025. 1, 6, 7, 2, 3, 4
- [5]Marius Cordts, Mohamed Omran, Sebastian Ramos, Timo Rehfeld, Markus Enzweiler, Rodrigo Benenson, Uwe Franke, Stefan Roth, and Bernt Schiele. The cityscapes dataset for semantic urban scene understanding. In CVPR, 2016. 6, 2arxiv.org/abs/1604.01685
- [6]Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, and Li Fei-Fei. Imagenet: A large-scale hierarchical image database. In CVPR, 2009. 6, 4
- [7]David Eigen and Rob Fergus. Predicting depth, surface normals and semantic labels with a common multi-scale convolutional architecture. In ICCV, 2015. 6, 7, 4arxiv.org/abs/1411.4734
- [9]Sara Elkerdawy, Hong Zhang, and Nilanjan Ray. Lightweight monocular depth estimation model by joint end-to-end filter pruning. In ICIP, 2019. 2DOI
- [10]Ziyue Feng, Liang Yang, Longlong Jing, Haiyan Wang, YingLi Tian, and Bing Li. Disentangling object motion and occlusion for unsupervised multi-frame monocular depth. In ECCV, 2022. 6, 3arxiv.org/abs/2203.15174
- [11]Huan Fu, Mingming Gong, Chaohui Wang, Kayhan Batmanghelich, and Dacheng Tao. Deep ordinal regression network for monocular depth estimation. In CVPR, 2018. 2arxiv.org/abs/1806.02446
- [12]Wei Gao, Di Rao, Yang Yang, and Jie Chen. Edge devices friendly self-supervised monocular depth estimation via knowledge distillation. IEEE Rob. Autom. Lett., 8(12): 8470–8477, 2023. 1, 7, 2, 4DOI
- [13]A Geiger, P Lenz, C Stiller, and R Urtasun. Vision meets robotics: The kitti dataset. Int. J. Rob. Res., 32(11):1231–1237, 2013. 6, 2DOI
- [14]Ross Girshick. Fast r-cnn. In CVPR, 2015. 2
- [15]Ross Girshick, Jeff Donahue, Trevor Darrell, and Jitendra Malik. Rich feature hierarchies for accurate object detection and semantic segmentation. In CVPR, 2014. 2arxiv.org/abs/1311.2524
- [16]Clément Godard, Oisin Mac Aodha, and Gabriel J. Brostow. Unsupervised monocular depth estimation with left-right consistency. In CVPR, 2017. 2arxiv.org/abs/1609.03677
- [17]Clement Godard, Oisin Mac Aodha, Michael Firman, and Gabriel Brostow. Digging into self-supervised monocular depth estimation. In ICCV, 2019. 1, 2, 4, 5, 6, 7arxiv.org/abs/1806.01260
- [18]Ming Gui, Johannes Schusterbauer, Ulrich Prestel, Pingchuan Ma, Dmytro Kotovenko, Olga Grebenkova, Stefan Andreas Baumann, Vincent Tao Hu, and Björn Ommer. Depthfm: Fast generative monocular depth estimation with flow matching. In AAAI, 2025. 1DOI
- [19]Vitor Guizilini, Rares Ambrus, Sudeep Pillai, Allan Raventos, and Adrien Gaidon. 3d packing for self-supervised monocular depth estimation. In CVPR, 2020. 2arxiv.org/abs/1905.02693
- [20]Kaiming He, Ross Girshick, and Piotr Dollár. Rethinking imagenet pre-training. In ICCV, 2019. 2arxiv.org/abs/1811.08883
- [21]Dan Hendrycks and Kevin Gimpel. Bridging nonlinearities and stochastic regularizers with gaussian error linear units. CoRR, 2016. 4
- [22]Geoffrey Hinton, Oriol Vinyals, and Jeff Dean. Distilling the knowledge in a neural network. arXiv preprint arXiv:1503.02531, 2015. 2arxiv.org/abs/1503.02531
- [23]Jie Hu, Li Shen, and Gang Sun. Squeeze-and-excitation networks. In CVPR, 2018. 3
- [24]Junjie Hu, Chenyoy Fan, Hualie Jiang, Xiyue Guo, Yuan Gao, Xiangyong Lu, and Tin Lun Lam. Boosting lightweight depth estimation via knowledge distillation. In KSEM, 2023. 2arxiv.org/abs/2105.06143
- [25]Bingxin Ke, Anton Obukhov, Shengyu Huang, Nando Metzger, Rodrigo Caye Daudt, and Konrad Schindler. Repurposing diffusion-based image generators for monocular depth estimation. In CVPR, 2024. 1arxiv.org/abs/2312.02145
- [26]Marvin Klingner, Jan-Aike Termöhlen, Jonas Mikolajczyk, and Tim Fingscheidt. Self-supervised monocular depth estimation: Solving the dynamic object problem by semantic guidance. In ECCV, 2020. 4
- [27]Simon Kornblith, Jonathon Shlens, and Quoc V. Le. Do better imagenet models transfer better? In CVPR, 2019. 2arxiv.org/abs/1805.08974
- [28]Iro Laina, Christian Rupprecht, Vasileios Belagiannis, Federico Tombari, and Nassir Navab. Deeper depth prediction with fully convolutional residual networks. In 3DV, 2016. 2arxiv.org/abs/1606.00373
- [29]Xiang Li, Wenhai Wang, Xiaolin Hu, and Jian Yang. Selective kernel networks. In CVPR, 2019. 3arxiv.org/abs/1903.06586
- [30]Haotong Lin, Sili Chen, Junhao Liew, Donny Y Chen, Zhenyu Li, Guang Shi, Jiashi Feng, and Bingyi Kang. Depth anything 3: Recovering the visual space from any views. arXiv preprint arXiv:2511.10647, 2025. 3, 6arxiv.org/abs/2511.10647
- [31]Jinfeng Liu, Lingtong Kong, Bo Li, Zerong Wang, Hong Gu, and Jinwei Chen. Mono-vifi: A unified learning framework for self-supervised single and multi-frame monocular depth estimation. In ECCV, 2024. 2, 4arxiv.org/abs/2407.14126
- [32]Youchen Liu, Qinq Wang, and Chong Tan. Lea-depth: a lightweight self-supervised monocular depth estimation with attention fusion and edge-aware distillation. MULTIMEDIA SYST., 32(3):218, 2026. 1, 7, 2, 4DOI
- [33]Zhong Liu, Ran Li, Shuwei Shao, Xingming Wu, and Weihai Chen. Self-supervised monocular depth estimation with self-reference distillation and disparity offset refinement. IEEE TCSVT, 33(12):7565–7577, 2023. 2DOI
- [34]Ilya Loshchilov and Frank Hutter. SGDR: Stochastic gradient descent with warm restarts. In ICLR, 2017. 6arxiv.org/abs/1608.03983
- [35]Ilya Loshchilov and Frank Hutter. Decoupled weight decay regularization. arXiv preprint arXiv:1711.05101, 2017. 6arxiv.org/abs/1711.05101
- [36]Albert Luginov and Ilya Makarov. Swiftdepth: An efficient hybrid cnn-transformer model for self-supervised monocular depth estimation on mobile devices. In ISMAR-Adjunct, pages 642–647, 2023. 2DOI
- [37]Xiaoyang Yu, Liang Liu, Mengmeng Wang, Xin Kong, Lina Liu, Yong Liu, Xinxin Chen, and Yi Yuan. Hr-depth: High resolution self-supervised monocular depth estimation. In AAAI, 2021. 1, 2, 4
- [38]Jaeho Moon, Juan Luis Gonzalez Bello, Byeongjun Kwon, and Munchurl Kim. From-ground-to-objects: Coarse-to-fine self-supervised monocular depth estimation of dynamic objects with ground contact prior. In CVPR, 2024. 3arxiv.org/abs/2312.10118
- [39]Srikant Muralidharan, Heitor R Medeiros, Masih Ambeidokhti, Eric Granger, and Marco Pedersoli. Pretraining helps when capacity allows: Evidence from ultra-small convnets. In WACV, 2026. 1DOI
- [40]Matteo Poggi, Filippo Aleotti, Fabio Tosi, and Stefano Mattoccia. Towards real-time unsupervised monocular depth estimation on cpu. In IROS, 2018. 2arxiv.org/abs/1806.11430
- [41]Matteo Poggi, Fabio Aleotti, Filippo Aleotti, and Stefano Mattoccia. Real-time self-supervised monocular depth estimation without gpu. IEEE TITS, 23(10):17342–17353, 2022. 2DOI
- [42]René Ranftl, Alexey Bochkovskiy, and Vladlen Koltun. Vision transformers for dense prediction. In ICCV, 2021. 1, 2arxiv.org/abs/2103.13413
- [43]Ashutosh Saxena, Min Sun, and Andrew Y. Ng. Make3d: Learning 3d scene structure from a single still image. IEEE TPAMI, 31(5):824–840, 2009. 6, 7, 2
- [44]Shuwei Shao, Zhongcai Pei, Weihai Chen, Dingchi Sun, Peter CY Chen, and Zhengguo Li. Monodiffusion: Self-supervised monocular depth estimation using diffusion model. IEEE TCSVT, 35(4):3664–3678, 2024. 1arxiv.org/abs/2311.07198
- [45]Xin Sui, Song Gao, Aigong Xu, Cong Zhang, Changqiang Wang, and Zhengxu Shi. Lightweight monocular depth estimation using a fusion-improved transformer. Sci. Rep., 14(1):22472, 2024. 2DOI
- [46]Hugo Touvron, Matthieu Cord, Alexandre Sablayrolles, Gabriel Synnaeve, and Hervé Jégou. Going deeper with image transformers. In ICCV, 2021. 4arxiv.org/abs/2103.17239
- [47]Chaoyang Wang, Jose Miguel Buenaposada, Rui Zhu, and Simon Lucey. Learning depth from monocular videos using direct methods. In CVPR, 2018. 7
- [48]Pengfei Wang, Shuhan Liu, Qiang Li, Yugen Yi, and Jianzhong Wang. Mg-mono: A lightweight multi-granularity method for self-supervised monocular depth estimation. Pattern Recognit., 171:112223, 2026. 1DOI
- [49]Yingxuan Wang and Ruizhuo Song. Edgemono: A lightweight self-supervised monocular depth estimation framework for edge devices. In WFIoT, 2025. 7, 2, 4DOI
- [50]Zhou Wang, A.C. Bovik, H.R. Sheikh, and E.P. Simoncelli. Image quality assessment: from error visibility to structural similarity. IEEE TIP, 13:600–612, 2004. 5pubmed.ncbi.nlm.nih.gov/15376593
- [51]Jamie Watson, Oisin Mac Aodha, Victor Prisacariu, Gabriel Brostow, and Michael Firman. The temporal opportunist: Self-supervised multi-frame monocular depth. In CVPR, 2021. 2, 3arxiv.org/abs/2104.14540
- [52]Diana Wolff, Fangchang Ma, Tien-Ju Yang, Sertac Karaman, and Vivienne Sze. Fastdepth: Fast monocular depth estimation on embedded systems. In ICRA, 2019. 2
- [53]Sungmin Woo, Wonjoon Lee, Woo Jin Kim, Dogyooun Lee, and Sangyoun Lee. Prodepth: Boosting self-supervised multi-frame monocular depth with probabilistic fusion. In ECCV, 2024. 2, 3arxiv.org/abs/2407.09303
- [54]Cho-Ying Wu, Jialiang Wang, Michael Hall, Ulrich Neumann, and Shuochen Su. Toward practical monocular indoor depth estimation. In CVPR, 2022. 2arxiv.org/abs/2112.02306
- [55]Jason Yosinski, Jeff Clune, Yoshua Bengio, and Hod Lipson. How transferable are features in deep neural networks? NeurIPS, 27, 2014. 2arxiv.org/abs/1411.1792
- [56]Ting Yu, Shan Pan, Wei Chen, Zijian Tian, Zehua Wang, F Richard Yu, and Victor CM Leung. Exploiting the potential of self-supervised monocular depth estimation via patch-based self-distillation. IEEE Internet Things J., 12 (11):18042–18055, 2025. 2, 3DOI
- [57]Junding Zhang, Di Rao, Youssef Akoudad, Wei Gao, and Jie Chen. Lightweight self-supervised monocular depth estimation for all-day scenes using generative adversarial network. In ICASSP, 2025. 1, 7, 2, 4
- [58]Lei Zhang, Chengzhi Lyu, Pan Wang, Hong He, and Fang Dai. LeDepth: A lightweight self-supervised monocular depth estimation network combining cnn and transformer. SIGNAL IMAGE VIDEO P, 19(14):1208, 2025. 1, 6, 7, 4DOI
- [59]Ning Zhang, Francesco Nex, George Vosselman, and Norman Kerle. Lite-mono: A lightweight cnn and transformer architecture for self-supervised monocular depth estimation. In CVPR, 2023. 1, 2, 4, 6, 7, 8, 3arxiv.org/abs/2211.13202
- [60]Bowen Zhao, Hongdou He, Hang Xu, Peng Shi, Xiaobing Hao, and Guoyan Huang. Rtia-mono: Real-time lightweight self-supervised monocular depth estimation with global-local information aggregation. DSP, 156:104769, 2025. 4DOI
- [61]Chaoqiang Zhao, Youmin Zhang, Matteo Poggi, Fabio Tosi, Xianda Guo, Zheng Zhu, Guan Huang, Yang Tang, and Stefano Mattoccia. Monovit: Self-supervised monocular depth estimation with a vision transformer. In 3DV, 2022. 1, 2, 3DOI
- [62]Kaichen Zhou, Jia-Wang Bian, Jian-Qing Zheng, Jiaxing Zhong, Qian Xie, Niki Trigoni, and Andrew Markham. Manydepth2: Motion-aware self-supervised monocular depth estimation in dynamic scenes. IEEE Rob. Autom. Lett., 10(7):6704–6711, 2025. 2, 3arxiv.org/abs/2312.15268
- [63]Tinghui Zhou, Matthew Brown, Noah Snavely, and David G. Lowe. Unsupervised learning of depth and ego-motion from video. In CVPR, 2017. 1, 2, 4, 5arxiv.org/abs/1704.07813
- [64]Zhongkai Zhou, Xinnan Fan, Pengfei Shi, and Yuanxue Xin. R-msfm: Recurrent multi-scale feature modulation for monocular depth estimating. In ICCV, 2021. 7, 4DOI
- [65]Zhongkai Zhou, Xinnan Fan, Pengfei Shi, Yuanxue Xin, Dongliang Duan, and Liuqing Yang. Recurrent multiscale feature modulation for geometry consistent depth learning. IEEE TPAMI, 46(12):9551–9566, 2024. 6, 7, 4DOI
- [66]Zhaowen Zhu, Li Zhang, Yujie Chen, Tian Zhang, Yingjie Wang, and Mingxia Zhan. Towards robust driving perception: A flexible scale-driven family for self-supervised monocular depth estimation. In ECCV, 2026. 1, 5, 6, 7, 2, 3, 4DOI