WorksComputer Science
GOFish: Full Field-of-View Gaussian Splatting and Mesh Extraction
Abstract
Robots, autonomous vehicles, and consumer 360° cameras use fisheye lenses for wide fields of view (FoVs). Simulation-ready digital twins require photorealistic rendering across the full FoV and an aligned collision mesh. However, prior fisheye Gaussian Splatting methods only rasterize up to 180° and do not produce meshes, while Gaussian surface reconstruction methods assume pinhole training images. We present GOFish, the first 3D Gaussian Splatting surface reconstruction method to train directly on fisheye images, rasterize FoVs beyond 180°, and extract an aligned mesh from the same scene. Calibrated densification recovers the surface across the entire FoV, while Calibrated Mip Filtering and Wide-Angle Appearance Modeling keep pixel blur and lens falloff out of the scene and mesh. Across the 200° FIORD and 205° FullCircle benchmarks, GOFish improves PSNR over the best prior method by 2.28 and 1.97 dB, respectively. It also outperforms fisheye rendering baselines within their own FoVs and achieves the highest mesh F-score on FIORD and the main ScanNet++ set. Together, the Gaussian scene and mesh form a LiDAR-free, simulation-ready digital twin that renders in real time, ray traces the full FoV, and provides collision geometry.
Introduction
Digital twins are virtual replicas of real environments used for robot simulation and training. To support visual perception and physical interaction, they must combine photorealistic appearance with aligned collision geometry. Fisheye cameras are commonly used for robotic perception and mapping [35] [21], while consumer cameras pair back-to-back fisheye lenses for omnidirectional scene capture [5]. LiDAR scans are expensive to collect at scale, motivating recovery of both appearance and geometry directly from calibrated fisheye images over their full field of view (FoV).
No prior 3D Gaussian Splatting [17] method delivers both. Fisheye Gaussian Splatting rasterizers [3, 14, 22, 31, 32] cover at most , while 3DGRT [24] ray traces the full FoV but bakes pixel blur into the scene; neither produces a mesh. Conversely, Gaussian Opacity Fields (GOF) [37] and other Gaussian surface methods [2, 7, 26, 27] extract aligned meshes but assume pinhole training images. Using fisheye captures therefore requires rectification, which discards peripheral rays and prevents rendering the native FoV required for accurate sensor simulation.
We present GOFish, the first 3D Gaussian Splatting surface reconstruction method to train directly on fisheye images, rasterize calibrated FoVs beyond , and extract an aligned mesh from the same Gaussian scene. A calibration-defined domain and complete admission cover every valid ray, while calibrated densification recovers the surface across the FoV. We further introduce Calibrated Mip Filtering and Wide-Angle Appearance Modeling to keep view-specific sampling and camera response outside the shared scene representation used for meshing. Figure 1 illustrates GOFish’s full-FoV rendering and aligned mesh on a 200° FIORD capture [8], while Figure 6 demonstrates full-FoV ray tracing and mesh-based physics simulation.

Figure 1. GOFish reconstructs Hall_In from FIORD [8] as a Gaussian Splatting scene and aligned mesh over its full field of view. 3DGUT + PPISP [31, 4] stops at and does not extract a mesh. Figure 6 demonstrates full-FoV ray tracing and physical simulation.

Figure 6. Ray tracing and mesh-based physics simulation. 3DGUT ray traces its FoV using 3DGRT [24] and does not produce a mesh, so simulated objects have no surface to collide with. GOFish covers the full FoV and supports collisions.
GOFish leads every rendering metric across the 200° FIORD, 205° FullCircle, 127° ScanNet++, and pinhole Tanks & Temples benchmarks [5, 18, 34]. On average, it also outperforms all fisheye baselines within their respective fields of view, confirming higher rendering quality even without its coverage advantage. Furthermore, its meshes achieve the highest F-score on FIORD and the main ScanNet++ set. Beyond these gains, GOFish renders in real time, ray traces the full FoV, and provides collision geometry, turning native fisheye captures into LiDAR-free, simulation-ready digital twins.
In summary, our contributions are:
Full Field-of-View Rasterization: Calibration-defined domains and complete admission extend Gaussian rasterization beyond 180° for the first time, with a 2.28 dB PSNR lead over the best prior baseline on FIORD.
Wide-Angle Appearance Modeling: Camera-fixed attenuation captures steep rim falloff outside the 3D scene, improving FIORD PSNR by 3.17 dB over PPISP [4].
Full Field-of-View Mesh Extraction: Calibrated densification and filtering enable an aligned full-FoV opacity-field mesh, achieving the highest mean F-score and recall among Gaussian surface methods on FIORD.
Related Work
Gaussian surface methods extract meshes from 3D Gaussian Splatting scenes [17]. Gaussian Opacity Fields (GOF) [37] constructs a 3D opacity field by compositing per-view Gaussian responses and taking the minimum across views. SOF [26] adds per-pixel sorting, geometry losses, and fast extraction, while CoMe [27] adds confidence-driven optimization. PGSR [2] uses planar Gaussians with geometric consistency. MiLo [7] jointly refines a Gaussian scene and its extracted mesh. Other approaches use surface-oriented primitives or explicit mesh connectivity [6, 12, 13, 39]. Existing Gaussian surface methods assume pinhole or rectified inputs, precluding direct mesh reconstruction from fisheye imagery.
Fisheye Gaussian Splatting methods train directly on distorted images. Fisheye-GS [22] and DirectFisheye-GS [32] modify the splatting projection, while Self-Calibrating GS [3] learns a lens deformation. 3DGUT [31] supports arbitrary camera models, and 3DGEER [14] evaluates Gaussians exactly along rays up to 180°. However, their rasterizers stop short of the full per-lens FoVs of the dual-fisheye 360° cameras used to capture FIORD and FullCircle [5, 8]. 3DGRT [24] ray traces the full field of view with one ray per pixel, baking pixel blur into the Gaussian scene while rendering substantially more slowly than rasterized methods. Omnidirectional methods [5, 19, 20] target panoramas and casual 360° captures. None of these methods includes mesh extraction. GOFish instead trains directly on fisheye images, rasterizes the full field of view, and extracts a mesh from the same Gaussian scene.
When unmodeled, sampling and appearance effects are absorbed into the Gaussian scene, degrading rendering and mesh extraction. Mip-Splatting [36] suppresses aliasing in pinhole Gaussian Splatting with 3D and screen-space filters. Gaussian surface methods use VastGaussian’s appearance model [23] to keep photometric inconsistencies from creating spurious geometry [26, 37]. PPISP [4] instead limits corrections to camera effects, but its low-order vignetting misses steep rim falloff in wide-FoV fisheye images. GOFish adapts Mip-Splatting’s filters to calibrated fisheye cameras and extends PPISP to model this falloff.
Background
3D Gaussian Splatting (3DGS) [17] represents a scene using Gaussians, each with mean , covariance , opacity , and view-dependent color. Its rasterizer linearizes a pinhole projection at each Gaussian mean [40], so the standard rasterizer cannot consume native fisheye images or represent rays beyond 90°. GOFish instead builds on 3DGUT [31], which evaluates Gaussians directly in 3D along calibrated pixel rays. A ray is , where is the camera center, a unit direction, and the distance along the ray. For Gaussian , 3DGUT’s ray-maximum response occurs at the minimum Mahalanobis distance over the valid ray interval:
Here is the valid distance interval, and caps the response. GOF [37] meshes this response, while 3DGRT [24] ray traces the same Gaussians.
3DGUT depth-sorts Gaussians and composites their alphas as in 3DGS. However, for a ray at angle with optical-axis component , camera-space depth becomes negative beyond 90°, so sorting by depth reverses the near-to-far order. Its tile selection also approximates each Gaussian’s image extent by projecting unscented-transform sigma points [15] through the camera. Because instead depends on the ray-to-Gaussian Mahalanobis distance , this bound can omit tiles whose rays reach the Gaussian. Figure 2 illustrates the tile mismatch and two field-of-view limits: the half-angle crop stops at 80° from the axis, and the positive-depth test rejects valid content beyond 90°.

Figure 2. 3DGUT failures over a full field of view. (a) Its half-angle limit cuts rays beyond 80° from the axis (orange), and its positive-depth test fails beyond 90° (red). (b) Tiles come from the projected sigma-point extent (blue) but alpha from the exact ray response (red), so the Gaussian is skipped in the hatched tiles. (Bottom) 3DGUT + PPISP leaves a cutoff ring and tile-shaped smears, while GOFish renders the full FoV cleanly.
Background
Fisheye Gaussian Splatting methods train directly on distorted images. Fisheye-GS [22] and DirectFisheye-GS [32] modify the splatting projection, while Self-Calibrating GS [3] learns a lens deformation. 3DGUT [31] supports arbitrary camera models, and 3DGEER [14] evaluates Gaussians exactly along rays up to 180°. However, their rasterizers stop short of the full per-lens FoVs of the dual-fisheye 360° cameras used to capture FIORD and FullCircle [5, 8]. 3DGRT [24] ray traces the full field of view with one ray per pixel, baking pixel blur into the Gaussian scene while rendering substantially more slowly than rasterized methods. Omnidirectional methods [5, 19, 20] target panoramas and casual 360° captures. None of these methods includes mesh extraction. GOFish instead trains directly on fisheye images, rasterizes the full field of view, and extracts a mesh from the same Gaussian scene.
When unmodeled, sampling and appearance effects are absorbed into the Gaussian scene, degrading rendering and mesh extraction. Mip-Splatting [36] suppresses aliasing in pinhole Gaussian Splatting with 3D and screen-space filters. Gaussian surface methods use VastGaussian’s appearance model [23] to keep photometric inconsistencies from creating spurious geometry [26, 37]. PPISP [4] instead limits corrections to camera effects, but its low-order vignetting misses steep rim falloff in wide-FoV fisheye images. GOFish adapts Mip-Splatting’s filters to calibrated fisheye cameras and extends PPISP to model this falloff.
Background
3D Gaussian Splatting (3DGS) [17] represents a scene using Gaussians, each with mean , covariance , opacity , and view-dependent color. Its rasterizer linearizes a pinhole projection at each Gaussian mean [40], so the standard rasterizer cannot consume native fisheye images or represent rays beyond 90°. GOFish instead builds on 3DGUT [31], which evaluates Gaussians directly in 3D along calibrated pixel rays. A ray is , where is the camera center, a unit direction, and the distance along the ray. For Gaussian , 3DGUT’s ray-maximum response occurs at the minimum Mahalanobis distance over the valid ray interval:
Here is the valid distance interval, and caps the response. GOF [37] meshes this response, while 3DGRT [24] ray traces the same Gaussians.
3DGUT depth-sorts Gaussians and composites their alphas as in 3DGS. However, for a ray at angle with optical-axis component , camera-space depth becomes negative beyond 90°, so sorting by depth reverses the near-to-far order. Its tile selection also approximates each Gaussian’s image extent by projecting unscented-transform sigma points [15] through the camera. Because instead depends on the ray-to-Gaussian Mahalanobis distance , this bound can omit tiles whose rays reach the Gaussian. Figure 2 illustrates the tile mismatch and two field-of-view limits: the half-angle crop stops at 80° from the axis, and the positive-depth test rejects valid content beyond 90°.
Method
GOFish builds on 3DGUT [31] to train one Gaussian scene directly from fisheye images over the camera’s full field of view (FoV) and extract an aligned mesh. Calibration defines valid pixels, complete admission assigns Gaussians to tiles, and calibrated densification recovers the surface. Calibrated Mip Filtering and Wide-Angle Appearance Modeling keep view-specific blur and sensor falloff out of the scene and mesh. GOFish then extracts the mesh from the resulting pixel-filter-free opacity field. Together, the Gaussian scene and mesh form a simulation-ready digital twin.
Full Field-of-View Rasterization
3DGUT’s rasterizer defines a ray for each pixel, assigns Gaussians to image tiles, and composites them along each ray in depth order. As Figure 2 shows, each step breaks at wide angles: rays outside its 160° field of view are cut and receive no supervision, projected extents omit Gaussians from tiles their rays reach, and depth order reverses beyond 90°. GOFish replaces these steps with a calibration-defined domain, complete admission, and ray-distance sorting, extending rasterization to the full calibrated FoV.
A pixel is valid if it lies in the calibrated image domain and defines a unique ray. For a radial fisheye mapping ray angle to image radius , rays are unique up to
where . The calibration itself, rather than a preset cutoff, therefore bounds the valid domain of any radial central camera, including FoVs wider than 200°. Rendering, admission, and meshing share this domain, which Appendix § 12.§ 1 defines formally.
Let be the valid image domain of view and its pixel centers. We require complete admission: Gaussian is drawn in every tile containing a valid pixel whose ray intersects its effective support , the region where the renderer can return a visible alpha:
Here is pixel ’s ray-to-Gaussian Mahalanobis distance from Eq. (1). We cap the opacity-dependent radius at , conservatively enclosing 3DGUT’s renderer cutoff. 3DGUT’s projected sigma-point extents can omit tiles whose rays reach the Gaussian, and conventional projection-based bounds fail beyond 90°. We instead use three conservative rejection tests, defined in Appendix § 12.§ 2, each of which drops a Gaussian only if it proves that every valid ray in the tile misses . Together, they guarantee:
Proposition 1 (Complete admission). Given a central camera, exact arithmetic, and conservative enclosures, the three tests of Appendix § 12.§ 2 admit Gaussian to every tile containing a valid pixel whose ray intersects .
The same appendix gives the proof. In practice, we round every rejection bound outward to keep the tests conservative under floating-point arithmetic. Because beyond 90°, depth reverses the near-to-far order. We therefore sort the admitted Gaussians at each pixel by ray distance, following StopThePop [25].
Calibrated Mip Filtering
Complete ray coverage alone is not enough: each image pixel averages radiance over a finite footprint whose size and shape vary across a fisheye image. The 3D Gaussian scene is shared by every view and later meshed, so this view-specific blur must remain outside it. Without a pixel filter, however, the exact ray response can match the blur only by baking it into the scene. For pinhole cameras, Mip-Splatting [36] separates a view-independent 3D scene filter from a 2D pixel filter. The 3D filter makes scene detail to what the finest training view can resolve, while the 2D filter matches each view’s pixel footprint.
As illustrated in Figure 3, we adapt this 3D filter to calibrated cameras by deriving its scale from the camera Jacobian while leaving opacity unchanged. For each training view observing Gaussian , the calibrated Jacobian be the Jacobian of ’s lens-distorted projection at . The smaller singular value is the coarser of the view’s two image-space sampling rates. Using Mip-Splatting’s 3D-filter variance of , we set

Figure 3. Calibrated Mip Filtering. The finest training view’s Jacobian sets the 3D filter in the stored Gaussian covariance (blue). Rendering view adds the footprint and rescales opacity by (orange), while meshing uses directly.
The maximum selects the finest observing view, and dividing by its sampling rate converts the pixel-space filter width to a world-space radius. From here on, denotes Gaussian ’s covariance after adding .
The finest view sets the 3D filter, so a Gaussian may project to less than one pixel in a coarser view. For each view , we therefore add the minimum-trace 3D covariance that projects to 3DGS’s fixed screen-space filter of variance [17]. We also rescale opacity to preserve the image integral. Let have full row rank, and let denote its pseudo-inverse. Then
View then evaluates Eq. (1) with covariance and opacity . and are recomputed for every view and never stored, so neither enters mesh extraction. The covariance lift has the following minimality guarantee:
Proposition 2 (Minimum-trace footprint lift). For full-row-rank and , is the unique positive-semidefinite matrix of minimum trace satisfying . It adds no variance along the viewing-ray direction, which spans the null space of .
The added covariance projects through to , matching the form of Mip-Splatting’s 2D filter but using 3DGS’s variance. Within the same linearization, the ray-maximum response projects to a 2D Gaussian with covariance , whose image integral scales with . The factor in Eq. (5) cancels this growth, so the footprint preserves the image integral whenever the cap is inactive. Mip-Splatting instead rescales opacity by the 3D volume ratio , which preserves the Gaussian’s 3D integral. Proposition 3 shows that this ratio equals times a ray-dependent factor of at most one:
Proposition 3 (Ray-maximum normalization). After linearizing the camera projection at , let denote the viewing-ray direction. The conditional variance along this ray is . The 3D volume ratio and image-space normalization are then related by
with equality exactly when is an eigenvector of .
Using it would therefore dim Gaussians whose principal axes are not aligned with the ray, darkening surfaces viewed at grazing angles. Appendix A.3 proves both propositions.
Calibrated Densification
The calibrated Jacobian also drives the densification that recovers the surface. A 3D gradient measures image-space displacement in world units, whose pixel equivalent varies with distance and ray angle, while a pinhole projection fails beyond 90°. We therefore map each mean’s gradient into the calibrated image with , allowing one image-space threshold and SOF’s densification schedule to serve the full FoV. Appendix A.4 details the mapping and schedule. Calibrated Mip Filtering prevents Gaussians from fitting each view’s blur; Section 6.2 shows that removing it produces several times more Gaussians without improving quality.
Wide-Angle Appearance Modeling
Exposure, vignetting, and rim falloff are image-formation effects that must remain outside the 3D scene. Gaussian surface methods handle photometric variation with VastGaussian’s per-image appearance network [23, 26, 37], but its corrections are not limited to camera effects. We instead build on PPISP [4], which restricts corrections to exposure, vignetting, color, and camera response. At inference, its controller predicts exposure and color for novel views in real time. CoMe [27] reports that PPISP outperforms its improved VastGaussian model and nearly matches the full method on pinhole scenes. However, PPISP’s low-order vignetting does not capture the steep rim falloff, leaving the darkest rim pixels too bright and their neighbors too dark. This residual is baked into Gaussian colors, making Gaussians seen at the rim too dark near the center of other views.
We therefore multiply PPISP’s vignetting by a per-camera wide-angle attenuation . At pixel of view ,
where is the rendered radiance, is the view’s exposure, is its color transform, and CRF is the camera response function. The normalized radius is the distance of from the principal point divided by the larger image dimension.
The radial profile is nonincreasing, and is a low-resolution flat-field log-attenuation map. Both yield unit attenuation over the inner half of the image radius: and . This anchoring prevents either from absorbing global exposure changes. We optimize both terms as detailed in Appendix A.4. is applied after Gaussian rendering and shared across a camera’s views, so it models only camera-fixed effects and never enters the 3D scene or mesh. For pinhole cameras, setting reduces the model to PPISP.
Full Field-of-View Mesh Extraction
GOFish uses the same ray-maximum response as GOF [37], enabling opacity-field mesh extraction over every training view’s full calibrated domain. Let be Gaussian ’s alpha from Eq. (1) on the ray segment from view to point , evaluated with stored covariance and opacity . We omit the per-view pixel filter to keep view-specific footprints out of the field and mesh. The opacity field is
where ranges over training views with a valid ray to , and over Gaussians admitted along that ray by the mesh rule of Appendix A.5. Following GOF, points that no training view observes remain occupied, with . A cropped renderer therefore leaves points visible only through peripheral rays filled in, whereas full-FoV coverage evaluates them. We extract the level set using the tetrahedral opacity-field readout and filters inherited from SOF and GOF; Appendix A.5 details both steps.
GOFish optionally adds SOF’s Geometry Objective [26], replacing pinhole depth with distance along calibrated rays. Its opacity term evaluates the 3D scene without the per-view pixel footprint, so it supervises the same footprint-free per-view opacity from which the mesh field is built. Appendix A.4 gives the adapted objective.
Experiments
GOFish extends the 3DGUT [31] codebase. We evaluate GOFish with and without SOF’s Geometry Objective [26] from § 6.5. Each variant uses one parameter set across datasets except ScanNet++, where, following prior surface methods, we add CoMe’s confidence and normal-variance losses [27] and use SOF’s scene-extent rule for large-Gaussian pruning. Appendices A.4 and B provide additional optimization and evaluation details.
Datasets. FIORD [8] and FullCircle [5] use dual-fisheye 360° cameras. FIORD pairs synchronized nominal 200° views with LiDAR; FullCircle provides roughly 205° views without geometry ground truth. ScanNet++ [34] provides 127° fisheye DSLR images and laser-scan ground truth. We use 3DGUT’s six scenes, while Appendix C additionally evaluates CoMe’s set. For pinhole evaluation, we use six Tanks & Temples [18] scenes with ground-truth geometry. Appendix B.1 covers FIORD’s registration and calibration issues; Appendix B.2 details scenes, resolutions, and splits.
Baselines. We use each baseline’s released code and recipe. Fisheye baselines retain their native camera pipelines, including 3DGUT’s angular crop, while surface baselines train on the rectifications marked in the tables. Appendix § 13.3 details adaptations and hardware exceptions.
Metrics. We report PSNR, SSIM, and LPIPS on held-out test views. All tabulated GOFish rendering scores use the complete-admission renderer of § 6.1, while FPS uses the real-time renderer detailed in Appendix § 12.§ 8. Full scores each camera’s calibrated FoV, and unrendered pixels count as black. Common () scores every method on the shared rectified FIORD images used by the surface baselines. For geometry, we report precision, recall, and F-score under the protocols detailed in Appendix § 13.§ 2: a 10 cm threshold on FIORD, CoMe’s 5 cm protocol on ScanNet++, and the official evaluator on Tanks & Temples.
Results
Across its base and Geometry Objective variants, GOFish ranks first in every full-FoV rendering metric on the three fisheye benchmarks in Table 1. Its PSNR exceeds the best prior result by 2.28 dB on FIORD, 1.97 dB on FullCircle, and 0.46 dB on ScanNet++ [5, 8, 34]. The gains are not merely due to coverage; on average, GOFish also outper-
| Method | FoV | FIORD [8] Full (200°) PSNR↑ | SSIM↑ | LPIPS↓ | GOFish @ FoV ΔPSNR↑ | ΔSSIM↑ | ΔLPIPS↑ | FullCircle [5] Full (205°) PSNR↑ | SSIM↑ | LPIPS↓ | GOFish @ FoV ΔPSNR↑ | ΔSSIM↑ | ΔLPIPS↑ | ScanNet++ [34] Full (127°) PSNR↑ | SSIM↑ | LPIPS↓ |
| Fisheye-GS* [22] | 145° | 17.78 | 0.685 | 0.395 | +5.06 | +0.119 | +0.167 | 14.01 | 0.630 | 0.495 | +14.05 | +0.263 | +0.397 | 26.28 | 0.895 | 0.256 |
| 3DGUT [31] | 160° | 19.86 | 0.740 | 0.316 | +3.95 | +0.057 | +0.046 | 21.58 | 0.842 | 0.262 | +1.62 | +0.013 | +0.030 | 28.93 | 0.913 | 0.214 |
| 3DGUT + PPISP [31, 4] | 160° | 20.18 | 0.743 | 0.312 | +4.04 | +0.058 | +0.048 | 21.45 | 0.841 | 0.262 | +1.88 | +0.014 | +0.030 | 28.93 | 0.913 | 0.213 |
| 3DGEER* [14] | 178° | 12.79 | 0.679 | 0.328 | +2.03 | +0.026 | +0.027 | 12.65 | 0.715 | 0.336 | +4.25 | +0.040 | +0.036 | 28.59 | 0.914 | 0.201 |
| Self-Calibrating GS* [3] | 180° | 17.73 | 0.688 | 0.352 | +5.65 | +0.129 | +0.135 | 17.29 | 0.669 | 0.435 | +10.44 | +0.219 | +0.291 | 27.67 | 0.885 | 0.240 |
| DirectFisheye-GS [32] | 180° | 22.08 | 0.753 | 0.304 | +2.21 | +0.070 | +0.079 | 20.67 | 0.805 | 0.292 | +5.31 | +0.053 | +0.069 | 29.28 | 0.910 | 0.207 |
| 3DGRT [24] | Full | 15.84 | 0.685 | 0.343 | +8.52 | +0.142 | +0.133 | 23.32 | 0.870 | 0.228 | +2.15 | +0.005 | +0.020 | 28.83 | 0.904 | 0.278 |
| 3DGRT + PPISP [24, 4] | Full | 18.42 | 0.712 | 0.313 | +5.94 | +0.115 | +0.103 | 23.50 | 0.872 | 0.222 | +1.97 | +0.004 | +0.015 | 29.71 | 0.911 | 0.247 |
| GOFish (Ours) | Full | 24.36 | 0.827 | 0.210 | 25.47 | 0.876 | 0.207 | 30.17 | 0.921 | 0.172 | ||||||
| + Geometry Objective | Full | 24.18 | 0.820 | 0.217 | 25.31 | 0.871 | 0.213 | 30.12 | 0.921 | 0.171 |
Table 1. Quantitative comparison against wide-angle rendering baselines. The best, second best, and third best entries are highlighted. GOFish’s gain at each baseline’s FoV is highlighted. * Appendix B.3 details baseline adaptations for wide-angle rendering.
forms all released fisheye renderers within their respective fields of view. Figure 4 shows that prior methods blur, smear, or ring near the FoV boundary, whereas GOFish keeps walls, windows, and branches sharp and correctly exposed to the rim. Figure 6 shows the recovered periphery in full-FoV reflections and the extracted mesh supporting collision physics. Appendix § 14.§ 7 shows additional scenes, and Appendix § 14.§ 6 reports per-scene metrics.

Figure 4. Qualitative rendering results on FIORD [8] and FullCircle [5]. Held-out views span the full FoV; metrics are per-scene.
GOFish leads both full-FoV rendering and FIORD mesh F-score in Table 2. Appendix § 14.§ 1 confirms the lead across three runs, with base GOFish at 0.245±0.001 and PGSR [2] at 0.239 ± 0.002. The Geometry Objective [26] raises F-score further to 0.249. Calibrated densification recovers more surface across the FoV, giving GOFish the highest recall and F-score. Appendix § 14.§ 1 shows that GOFish leads within the shared field of view and for rays beyond from the optical axis, so wider coverage alone does not explain the advantage. Figure 5 shows broad peripheral patches or holes in surface-baseline meshes, while GOFish preserves finer structure.
| Method | FoV | FIORD [8] | ScanNet++ [34] | |||||||||||||
| Full (200°) | Common (90°) | Geometry | Full (127°) | Geometry | ||||||||||||
| PSNR↑ | SSIM↑ | LPIPS↓ | PSNR↑ | SSIM↑ | LPIPS↓ | P ↑ | R ↑ | F ↑ | PSNR↑ | SSIM↑ | LPIPS↓ | P ↑ | R ↑ | F ↑ | ||
| GOF [37] | Rectified | 17.03 | 0.676 | 0.353 | 28.20 | 0.883 | 0.278 | 0.168 | 0.248 | 0.198 | 27.54 | 0.904 | 0.212 | 0.579 | 0.629 | 0.601 |
| PGSR [2] | Rectified | 16.81 | 0.670 | 0.363 | 28.44 | 0.892 | 0.273 | 0.225 | 0.293 | 0.239 | 27.39 | 0.898 | 0.241 | 0.698 | 0.677 | 0.687 |
| SOF [26] | Rectified | 16.62 | 0.660 | 0.363 | 26.15 | 0.852 | 0.311 | 0.163 | 0.240 | 0.192 | 27.10 | 0.898 | 0.218 | 0.620 | 0.667 | 0.641 |
| MiLo [7] | Rectified | 17.05 | 0.680 | 0.368 | 28.21 | 0.882 | 0.297 | 0.180 | 0.261 | 0.210 | 27.61 | 0.903 | 0.234 | 0.651 | 0.701 | 0.675 |
| CoMe [27] | Rectified | 17.64 | 0.696 | 0.332 | 27.43 | 0.881 | 0.272 | 0.190 | 0.296 | 0.227 | 28.11 | 0.909 | 0.190 | 0.652 | 0.730 | 0.687 |
| GOFish (Ours) | Full | 24.36 | 0.827 | 0.210 | 29.00 | 0.911 | 0.221 | 0.200 | 0.331 | 0.245 | 30.17 | 0.921 | 0.172 | 0.637 | 0.795 | 0.706 |
| + Geometry Objective | Full | 24.18 | 0.820 | 0.217 | 28.51 | 0.906 | 0.229 | 0.202 | 0.340 | 0.249 | 30.12 | 0.921 | 0.171 | 0.630 | 0.801 | 0.704 |
Table 2. Quantitative comparison against surface reconstruction baselines. The best, second best, and third best entries are highlighted. Full scores each calibrated FoV and Common the shared rectified images; § 7 defines both.

Figure 5. Qualitative mesh results on FIORD [8] and FullCircle [5]. GOFish uses the Geometry Objective. Metrics are per-scene.
Across its two variants, GOFish leads rendering, recall, and F-score on the main ScanNet++ set. Appendix § 14.§ 2 evaluates the ScanNet++ scene set used by CoMe [27] and provides the full pinhole comparison. On Tanks & Temples [18], GOFish renders best, and Appendix § 14.§ 7 shows visibly fewer rendering artifacts than the surface baselines. A single Gaussian scene thus provides both the best full-FoV rendering and, on FIORD and the main ScanNet++ set, the most complete reconstructed surface.
Rendering Gain by Ray Angle
Figure 7 compares GOFish with 3DGUT + PPISP [4, 31] across ray angles and isolates the contribution of Wide-Angle Appearance Modeling. Within the baseline’s FoV, GOFish gains dB on FIORD and dB on FullCircle, of which appearance modeling accounts for only and dB, respectively. Complete admission, calibrated densification, and Calibrated Mip Filtering therefore drive most of the shared-region improvement. The FIORD gain peaks at dB in the – bin spanning the baseline’s cutoff, while FullCircle reaches dB beyond , where the baseline renders nothing. In the outer-most bin, Wide-Angle Appearance Modeling adds dB on FIORD and dB on FullCircle. On FIORD, this exceeds GOFish’s lead over the baseline—without appearance modeling, GOFish renders the dark rim too brightly and scores below the baseline’s unrendered black pixels.
Figure 7. Rendering gain by ray angle on FIORD [8] (cyan) and FullCircle [5] (magenta). PSNR gain of GOFish over 3DGUT + PPISP [31, 4] (solid) and over GOFish without Wide-Angle Appearance (dashed). As in Figure 2, 3DGUT + PPISP cuts rays beyond 80° (orange) and fails beyond 90° (red).
Component Analysis
Table 3 cumulatively adds GOFish’s components to 3DGUT + PPISP. Full Field-of-View Rasterization improves rendering but leaves F-score at , confirming that coverage alone does not recover the surface. Adding calibrated densification and Calibrated Mip Filtering then raises F-score to while PSNR remains nearly unchanged. Together, these stages account for 3.6 dB of GOFish’s 4.0 dB gain within the baseline’s 160° view. Wide-Angle Appearance Modeling raises Full PSNR by 3.17 dB to 24.36 dB, consistent with modeling rim falloff as an image-formation effect outside the Gaussian scene. Finally, the optional Geometry Objective raises F-score to 0.249 at a cost of 0.18 dB PSNR. The reference rows show that neither 3DGRT’s full-FoV ray tracing [24] nor adding SOF’s losses [26] to 3DGUT yields a competitive mesh.
| Variant | FoV | PSNR↑ | SSIM↑ | LPIPS↓ | F↑ | Train↓ | FPS↑ |
| GOF [37] | 90° | 17.03 | 0.676 | 0.353 | 0.198 | 104m | 11.0 |
| 3DGUT + PPISP [24, 4] | Full | 18.42 | 0.712 | 0.313 | 0.159 | 108m | 22.3 |
| 3DGUT + SOF [26, 31] | 160° | 18.46 | 0.671 | 0.374 | 0.168 | 111m | 17.9 |
| 3DGUT + PPISP [31, 4] | 160° | 20.18 | 0.743 | 0.312 | 0.141 | 29m | 84.3 |
| + Full-FoV Rasterization | Full | 21.21 | 0.798 | 0.253 | 0.139 | 162m | 91.1 |
| + Calibrated Mip Filtering | Full | 21.19 | 0.804 | 0.239 | 0.240 | 103m | 81.1 |
| + Wide-Angle Appearance | Full | 24.36 | 0.827 | 0.210 | 0.245 | 107m | 79.3 |
| + Geometry Objective | Full | 24.18 | 0.820 | 0.217 | 0.249 | 116m | 86.8 |
Table 3. Component analysis on FIORD [8]. Components are added cumulatively. + Calibrated Mip Filtering includes calibrated densification, and + Wide-Angle Appearance completes base GOFish. Appendix § 13.§ 2 details the configurations.
The split ablation in Appendix § 14.§ 1 confirms the division of labor predicted in § 6.2. No individual part—the image-space statistic, SOF’s schedule, or the filter—is sufficient alone. For the two scenes with filtered and unfiltered meshes, F-score is essentially unchanged, indicating that calibrated densification drives surface recovery. At matched rendering quality, Calibrated Mip Filtering makes that recovery tractable by reducing the Gaussian count by 2.2–5.4× and preventing out-of-memory failures during training and meshing on a 24 GB GPU.
On an NVIDIA A10G GPU, the compact scene and real-time renderer reach 79 FPS on FIORD, nearly matching 3DGUT + PPISP at 84 FPS and far exceeding 3DGRT + PPISP at 22 FPS. Appendix § 12.§ 8 shows that the real-time renderer trails the complete-admission renderer by only 0.03 dB in Full PSNR. Together, the scene and mesh form a simulation-ready digital twin with full-FoV rendering quality, real-time speed, ray tracing, and collision geometry.
Limitations and Future Work
GOFish inherits opacity-field limitations [26, 37]. Taking the minimum across views can misplace reflective surfaces or carve thin structures, while sparse observations can leave holes and mesh overfill, as illustrated in Appendix § 14.3. Full-FoV coverage cannot recover information lost to sparse sampling or rim attenuation, and reconstruction remains sensitive to calibration and pose errors documented in Appendix § 13.§ 1. Among our datasets, only FIORD provides geometry ground truth beyond 180°. GOFish assumes static scenes and central camera models, so moving content, rolling shutter, and non-central cameras remain unsupported. Complete admission and per-pixel sorting slow training relative to rendering-only 3DGUT, although Appendix § 14.§ 2 shows that GOFish remains faster than GOF end to end on FIORD and renders in real time.
Depth supervision, normal priors, or Taubin smoothing [28, 30] could reduce surface artifacts. Sparse optimization and pruning [9, 10, 29] could reduce training cost and improve rendering speed. Selective super-resolution [1] could improve the undersampled rim, and extending complete admission to rolling-shutter and non-central cameras would broaden camera support. Agentic 3D modeling pipelines [11] could build on GOFish digital twins by refining their meshes, simplifying colliders, and adding semantic labels to create task-ready simulation environments for training robot policies.
Conclusion
We introduced GOFish, the first 3D Gaussian Splatting surface reconstruction method to train directly on fisheye images, rasterize fields of view (FoVs) beyond 180°, and extract an aligned mesh from the same Gaussian scene. A calibration-defined domain and complete admission cover every valid ray, while calibrated densification recovers the surface across the FoV. Calibrated Mip Filtering and Wide-Angle Appearance Modeling keep view-specific sampling and camera effects out of the Gaussian scene and mesh. GOFish leads every rendering metric across the 200° FIORD, 205° FullCircle, 127° ScanNet++, and pinhole Tanks & Temples benchmarks. Its meshes also achieve the highest F-score on FIORD and the main ScanNet++ set. Together, the Gaussian scene and mesh form a LiDAR-free, simulation-ready digital twin that renders in real time, ray traces the full FoV, and provides collision geometry.
Acknowledgements
This work was completed during an internship at Amazon. We thank Ziyang Long, Mellon M. Zhang, Chenqi Li, Sarosij Bose, Srikumar Sastry, Amin Kheradmand, Yongqing Ye, David Stafford, Huixian Gong, Yun He, Zeping Liu, Haiyang Ying, Alex Hanson, Chengyue Huang, and Chen Xu for helpful discussions and feedback on this work.
Additional Method Details
We make the view index explicit, so , , and denote the quantities of Eq. (5) for view . Throughout, is the Euclidean norm for vectors and spectral norm for matrices, is the Frobenius norm, and is the closed Euclidean ball with center and radius .
Camera Domain
The camera domain determines which pixels participate in rendering, supervision, admission, and meshing. For view , let be the continuous calibrated image domain and its finite set of raster pixel centers. Let denote the unit ray direction obtained by unprojecting , when that direction is unique. We define the valid domain as , and rendering and admission operate on . For the OpenCV fisheye model, a ray at angle from the optical axis maps to image radius . Here are the calibrated radial-distortion coefficients. Rays are unique up to of Eq. (3). Dataset masks do not alter . Masks apply only to supervision, densification statistics, and PPISP [4] pooling. Rendering, reporting, and meshing use the full domain. Losses that compare neighboring pixels, such as SSIM, include only pixels whose full stencil lies within the domain. We measure camera-local distance as view-space depth for pinhole cameras and radial ray distance for fisheye cameras, and use the same convention for SOF’s distortion coordinate [26].
Complete Admission
Let be the covariance used by the renderer and define the corresponding Mahalanobis distance as . The closed effective support conservatively contains every point where the renderer can return . For Gaussian opacity , we use the outward-rounded radius . If , the support is empty, so the Gaussian may be rejected. 3DGUT’s renderer [31] uses a kernel cutoff of 0.0113, corresponding to radius , so the cap contains its support. Complete admission omits the 0.2 near-plane cull of 3DGS [17] and 3DGUT.
For each Gaussian–view pair, we test every tile once. A tile is rejected only when one of three tests certifies that no valid ray can reach ; a failed or inconclusive test retains it. The Domain test rejects a tile with no pixel in , or when the angular cap of seen from lies entirely beyond the calibrated maximum ray angle. For the Taylor test, suppose lies outside a ball . For the active view, let denote its projection and the projection Jacobian at . We enclose in a rectangle centered at with half-extents
where indexes the image coordinates. The bound is the outward-rounded interval bound on the Frobenius norm of the projection Hessian at unit range over the ray-angle band of . The certified factor bounds the error in the renderer’s floating-point inverse of , while encloses numerical errors in and . The test rejects a tile only if none of its pixel centers lies in this rectangle. For supports that cross the maximum ray angle, we apply the same bound in an angular chart. When the Taylor bound cannot be certified, the Cone test encloses all pixel-ray directions of the tile in a ball . Choose to include a bound on the renderer’s floating-point error, and define , , and . The tile is rejected if
If the camera lies inside the enlarged support or cannot be certified outside it, every tile containing a valid pixel is retained. We retain 3DGUT’s unscented-transform parameters and renderer constants but replace its projected sigma-point extent with complete admission. Admitted Gaussians are ordered by radial distance using StopThePop’s per-pixel hierarchical sort [25].
Assumptions of Proposition 1. The camera is central, and every valid pixel satisfies for all in the chart. The angular cap encloses every direction from to , the ball encloses every valid ray direction of the tile, and the rectangle of Eq. (9) contains whenever .
Proof of Proposition 1. Consider a valid pixel in the tile whose ray intersects , and choose on that ray, with . If , then , so it is not provably outside the support, and every valid tile is kept. Otherwise . The Domain test cannot reject the tile because it contains , whose valid ray points to and therefore lies inside the angular cap and calibrated range. The Taylor test cannot reject it because , so and lies inside the rectangle. For the Cone test, write , where . For some to satisfy , the quadratic requires and , or equivalently . Because , we have and . Either rejection condition in Eq. (10) would therefore prevent from reaching . But gives , so the Cone test cannot reject the tile.
Calibrated Mip Filtering
3D filter. A training view observes Gaussian when . We detach the mean and Jacobians when computing , then freeze it with the scene when geometry optimization ends. Following Mip-Splatting [36], a Gaussian unseen by every training view receives the largest among the observed Gaussians. Proposition 3 shows that Mip-Splatting’s 3D volume-ratio scaling does not generally preserve ray-maximum image integrals, so we leave opacity unchanged. Mesh extraction uses the filtered covariance and optimized opacity , while the per-view factor is applied only during rendering.
Pixel footprint. We detach the mean and Jacobian when computing the lift of Eq. (5), so creates no position gradient along the viewing ray. For pinhole cameras, is the analytic perspective Jacobian, and we skip the footprint below a view-space depth of 0.2. Other cameras require a full-row-rank Jacobian at the Gaussian mean within the valid camera chart. If none exists, we set and ; admission still uses the covariance rendered for that view. We compute in double precision using a pivoted QR factorization of because normal equations lose accuracy at grazing angles.
Proof of Proposition 2. Let the columns of form an orthonormal basis for the row space of , and let be a unit null vector. In the basis , write in blocks , , and . Because , the constraint becomes and uniquely fixes . Positive semidefiniteness gives . Since , the minimum requires , which in turn forces . Thus the unique minimizer is . Using , this equals and has .
Opacity normalization. Minimizing Mahalanobis distance along a ray, as in Eq. (1), yields the same transverse profile as integrating the Gaussian along that ray, up to the factor defined below. Under a local projection, this response is a 2D Gaussian with covariance . When the cap is inactive, its integral over the tangent image plane is proportional to . Preserving this integral as grows to gives in Eq. (5). The 3D volume ratio instead preserves the 3D integral.
Proof of Proposition 3. Choose an orthonormal frame with one axis along and two transverse axes, and write in blocks , , and . The determinant factorizes as , where the Schur complement is positive definite and conditioned on transverse position. Because , the determinant is proportional to , with the same proportionality for . Hence , which gives the identity. The lift of Proposition 2 changes only the transverse block. Writing its positive-definite transverse component as , we obtain
Because , the bracket is positive definite, so equality holds exactly when , which is equivalent to being an eigenvector of .
Optimization
Objective. Following 3DGS [17], GOFish uses the photometric loss . The Geometry Objective of § 6.5 adds SOF’s terms [26] with their original weights and warm-ups after adapting camera-dependent quantities to the calibrated ray domain,
Following GOF [37], the distortion loss fixes compositing weights and differentiates hit depths only through Gaussian positions and shapes; differentiating the weights as in SOF gives nearly identical results on FLORD. We use no pose optimization or transient modeling. On ScanNet++, we add CoMe’s confidence-weighted photometric loss and normal-variance regularizer [27] with their released weights from iteration 500. We omit its confidence-steered densification and color-variance loss, which would compete with PPISP. Appendix C.1 reports these losses on every dataset.
Opacity and depth–normal terms. SOF’s opacity loss drives accumulated ray opacity toward 0.5 at the surface crossing. As in its released code, we solve in closed form on the rising side of the Gaussian that takes opacity through 0.5 and hold it fixed during backpropagation. A second pass evaluates the Gaussian scene without the pixel footprint, stopping at or traversing the full ray when no crossing exists. The depth-normal loss compares rendered normals with normals computed from the detached depth at wherever opacity reaches 0.5. Unlike SOF, which passes a straight-through gradient through this depth, GOFish detaches it. We retain SOF’s edge-aware normal smoothness loss unchanged.
Distortion and extent terms. These terms require two camera-domain adaptations of SOF’s objective. Let be a hit’s peak parameter along a unit ray whose direction has camera-frame optical-axis component , and define
For compositing weights , where is the incoming transmittance, define
where is SOF’s normalized-device-coordinate scale for far and near planes and . The clamp applies only to this loss coordinate and does not affect rendering. Pinhole hits above the near plane match SOF’s coordinate exactly. The extent term accumulates each Gaussian’s alpha-weighted along-ray standard deviation in world units. This removes the near-camera bias of normalized device coordinates and penalizes oversized Gaussians viewed obliquely. As in SOF’s released code, the compositing alphas are detached in this term, and we keep SOF’s weight 0.1 for it on every dataset.
Densification. For a full-row-rank Jacobian, we recover the image gradient as and scale it to normalized device coordinates as in SOF. For AbsGS [33], we accumulate the absolute gradient components alongside SOF’s norm. We densify a Gaussian when its signed image-space gradient exceeds or its absolute gradient exceeds a quantile chosen, following GOF, to select the same fraction of Gaussians. Densification and pruning run every 100 iterations from 500 to 15k, and opacities are reset to 0.01 every 3k iterations as in 3DGS.
Pruning. We retain SOF’s opacity threshold of 0.05 and prune Gaussians larger than 0.1 of the scene extent. On FIORD [8] and Tanks & Temples [18], we use 3DGUT’s robust extent, 1.1 times the median camera distance from the coordinatewise-median camera center, so one distant capture cannot inflate it. On ScanNet++ [34], we use SOF’s extent, 1.1 times the maximum camera distance from the camera centroid. The median rule fails on ScanNet++ 0a5c, whose compact 2 m camera path gives a 4.6 cm threshold that deletes 40% of the Gaussians and leaves near-camera floaters. Conversely, the maximum rule retains large Gaussians that create off-surface mesh on FIORD and Tanks & Temples. We omit 3DGS’s 20-pixel screen-size prune, inherited by SOF, GOF, and CoMe, because densification resets the screen radii before it can run.
Appearance. The Gaussian scene and PPISP train jointly for 30k iterations, after which only PPISP’s novel-view controller trains for 5k iterations. We extract the mesh from the 30k scene. Beyond adding the wide-angle attenuation of Eq. (7), we modify PPISP only so its pooling and gating ignore pixels outside the calibrated domain. For noncircular fisheye images such as ScanNet++, the image corner defines the maximum image radius. The radial profile has 50 knots over the outer half of this radius, and the flat field is a grid. Both are initialized to unit attenuation and use a smoothness weight of .
Mesh Extraction
Following GOF, we place nine sites per Gaussian and build a fresh Delaunay tetrahedralization over all sites. We evaluate of Eq. (8) at each site and extract the level set with Marching Tetrahedra. Let and denote Gaussian ’s rotation and scale before filtering. The isotropic 3D filter preserves its rotation and gives , where is evaluated elementwise on the diagonal. The sites are and the eight points for . Here is defined in Appendix A.2 and capped at 3, matching GOF’s box for sufficiently opaque Gaussians. Sites are placed only for Gaussians with .
Field evaluation. Mesh extraction uses a separate practical admission rule, the union of 3DGUT’s projected sigma-point extent and a tile box enclosing the projected angular cap of the support. As in GOF, view validity in Eq. (8) checks only the calibrated camera domain, not occlusion. We refine each Marching Tetrahedra crossing with eight bisection steps on the same field, where unobserved midpoints remain opaque as in GOF and SOF.
Filters. Before Marching Tetrahedra, we apply the cell filter described by GOF [37] and remove any tetrahedron with an edge longer than the sum of its endpoint Gaussians’ support extents. Neither the GOF nor SOF release implements this filter. We then apply SOF’s released filter, which retains a crossing vertex when its generating edge is no longer than the sum of the endpoint scales, then retains a face only if all three vertices remain. The cell filter does not determine the comparison, since without it GOFish still reaches an F-score of 0.244 on FIORD against 0.239 for PGSR [2].
Real-Time Renderer
GOFish’s reported FPS uses the real-time renderer described here, while training and every tabulated rendering metric use the complete-admission renderer of § 6.1. The real-time renderer uses the same trained Gaussians, filtering, and PPISP model, recomputing PPISP each frame while caching camera-fixed terms such as .
Gaussian admission starts from 3DGUT’s projected sigma-point extent, with out-of-domain sigma points mirrored from valid counterparts. If the extent remains undefined and the Gaussian subtends more than , a conservative cone test admits it. The renderer sorts admitted Gaussians per tile and composites them through a 12-entry per-pixel buffer. Tiles containing more than 2048 Gaussians are divided among four thread blocks.
With complete admission and per-pixel sorting enabled, it reproduces the training renderer byte for byte. Relative to the complete-admission renderer, it lowers Full PSNR by 0.03 dB on FIORD, 0.14 dB on FullCircle, and 0.002 dB on ScanNet++ without changing any first-place Full ranking.
Additional Experimental Details
FIORD Data
FIORD [8] provides full-FoV fisheye images with metric ground truth. Figure 8 shows the excluded SfM trajectories, Corridor_Out’s re-registration, and field-of-view calibration. We render seven of its ten scenes and evaluate geometry on six after method-independent registration and calibration checks.

Figure 8. FIORD capture and calibration diagnostics [8]. (Top) SfM reconstructions are overlaid on LiDAR (gray). Points within 10 cm of LiDAR are green and others orange. Night_Out has no LiDAR. Cameras are black; red marks those more isolated than any retained camera, including one off-panel (arrow). (a) Full-FoV 95th-percentile training luma (left) and a rim crop (right) for Building_In camera 2. Curves mark total field angles of 167° (blue) and 200° (orange), while magenta marks the dark band. (b) Held-out ground truth (left) and GOFish rendering (right) at the rim, with the calibrated edge in white.
Excluded scenes. The authors’ SfM reconstructions of Night_Out, Building_Out, and Upstairs_In do not form coherent camera trajectories. Every retained camera is within 0.29 SfM units of another; the most isolated cameras in these scenes are 1.21, 0.96, and 100.6 units from the rest, respectively. In Upstairs_In, the outlier is supported by only 33 of the scene’s 22,247 keypoints and lies 234 m from the remaining trajectory. We therefore exclude all three; Night_Out also lacks LiDAR ground truth.
Registration. Corridor_Out’s images and poses are internally consistent and retained for rendering, but its SfM–LiDAR registration is invalid. Global re-registration with Fast Point Feature Histograms (FPFH), Random Sample Consensus (RANSAC), and robust Iterative Closest Point (ICP) reduces the camera-up tilt from 14.6° to 1.7° but leaves an inlier root-mean-square error of 0.114 m, above our 0.10 m limit. We therefore exclude Corridor_Out from the geometry mean and report it only for rendering. A method-independent ICP alignment between Hall_In’s SfM points and LiDAR consistently corrects its 3.4° tilt, and we apply it to all methods.
Field-of-view calibration. The published FIORD intrinsics are extrapolated at the image-circle boundary. On six cameras, the calibration maps this boundary to total FoVs of 198° to 244° for a nominal 200° lens. On the other eight, it loses monotonicity before the boundary, which ends the valid domain between 186° and 229°. Six of the 14 cameras contain a dark band at calibrated total field angles of at least 167°, covering 3.1–5.7% of the valid image domain. Although the calibration assigns scene rays to this band, its 95th-percentile training luma remains below 0.10 because it receives no scene light in any training frame. A static scene cannot reproduce this camera-fixed darkness, so the per-camera attenuation of § 6.4 absorbs it without entering the scene. We retain the full calibrated FoV, including this band, when scoring every method. Excluding it lowers Full PSNR by 0.07 dB for the Geometry Objective variant and 0.04 dB for DirectFisheye-GS [32].
Evaluation Protocol
Datasets. Camera-native methods train on 816×816 FIORD images and 720×720 FullCircle images per lens [5], both downsampled by 4×. ScanNet++ [34] uses 876×584 DSLR fisheye images downsampled by 2×, while Tanks & Temples [18] uses images near 980×545 from GOF’s preprocessing [37]. Rectified methods use matching 800×800 images for FIORD and FullCircle and the official undistorted 876×584 images for ScanNet++. Every eighth image is held out for testing, except FullCircle, which uses separately captured tripod frames. ScanNet++ uses the six scenes of 3DGUT and Fisheye-GS [22, 31], and Tanks & Temples uses GOF’s six scenes.
Rendering. We use no test-time color, exposure, or pose fitting and leave learned image processors unchanged. Full is the calibrated FoV of Appendix § 12.§ 1, excluding only the tripod pixels of FullCircle’s test mask. Common is the rectified training raster; camera-native predictions are resampled onto it with the fixed rectification operator.
Camera-native methods use their released renderers. For rectified methods, we port each rasterizer to the calibrated lens while preserving its activations, filters, sorting, alpha rules, appearance handling, and background, with no GOFish component. On rectified test views, every port matches its released renderer within 0.01 dB PSNR, 0.0002 SSIM, and 0.0004 LPIPS [38] on every scene. SOF and CoMe [26, 27] match byte for byte. For each FullCircle scene, we use whichever of two GOF ports, differing only in numeric precision, passes this check.
To avoid renderer conversion, the GOFish @ FoV columns use each baseline’s released renderer on its own domain and score GOFish on the same pixels. That domain contains pixels whose ray angle is at most half the renderer’s listed FoV. SSIM uses an 11×11 Gaussian window and LPIPS uses VGG, both restricted to each scored region; on the GOFish @ FoV domains, LPIPS is averaged over 64×64 tiles. On Tanks & Temples, each method uses its released pinhole renderer; when dimensions differ, we resize only the prediction with a fixed operator.
Geometry. Every baseline retains its released mesh post-processing; GOFish uses Appendix § 12.§ 7. On FIORD, observed ground truth comprises LiDAR points that hidden-point removal [16] finds visible within the calibrated domain from at least two training cameras. Recall counts a point as recovered when its nearest prediction is within 10 cm. As on Tanks & Temples and ScanNet++, precision is evaluated only in regions supported by the ground truth. Predicted samples must lie inside the LiDAR’s axis-aligned bounding volume and be observable by the same test front from at least one training camera. Both visibility selections depend only on the ground truth and training cameras. On ScanNet++, every method follows CoMe’s protocol of scaled ICP per mesh, cropping to the ground-truth volume, 2.5 cm voxel downsampling, and a 5 cm threshold. On Tanks & Temples, we use the official crop, alignment, thresholds, and evaluator.
Runtime. All times are wall-clock measurements on one NVIDIA A10G GPU. Training includes the full schedule and the novel-view controller phase of PPISP [4]; meshing includes extraction and post-processing of the 30k scene. Rendering speed is measured at each method’s evaluation resolution over 200 synchronized held-out frames after 20 warm-ups, timing only the trained-scene renderer; GOFish uses Appendix § 12.§ 8. GOFish’s training times use an optimized build with a bit-identical forward pass and gradients that agree up to rounding; metrics use standard runs.
Component analysis. In Table 3, F averages the six geometry scenes and Train excludes meshing. The + Full-FoV Rasterization row keeps 3DGUT’s densification, and from + Calibrated Mip Filtering on, rows use the calibrated densification gradient and the schedule of Appendix § 12.§ 6. Every 3DGUT and 3DGRT [24] row uses the same opacity-field readout, and empty extractions score 0. The + Full-FoV Rasterization row includes only exact speedups and reports FPS from its own configuration without the Mip filter.
Baseline Adaptations
On FIORD, SOF [26] uses its released large-scene recipe at the rectified resolution; on Tanks & Temples, PGSR’s released preprocessing [2] supplies scene bounds absent from GOF’s inputs. MiLo [7] exceeds the 24 GB memory of the NVIDIA A10G GPU on FIORD Corridor_Out and Road_Out, so we train those scenes with the same released configuration on a 40 GB NVIDIA A100 GPU.
Fisheye-GS [22] supports only an equidistant fisheye model. On FIORD and ScanNet++, we reproject training images to its equidistant camera and map held-out predictions back to the native raster for scoring. Pixels outside the source image use zeros on FIORD and reflected borders on ScanNet++. On Tanks & Temples, we make its training script honor pinhole mode. We also restore the forward-pass projection clamp at assumed by its backward pass, as in 3DGS [17]. Without the clamp, Gaussians far outside the frustum render without the intended bound while receiving clamped gradients, producing floaters in held-out views.
| Method | \multicolumn{9}{c | }{ScanNet++ (3DGUT set) [31, 34]} | \multicolumn{9}{c | }{ScanNet++ (CoMe set) [27, 34]} | ||||||||||||||
| \multicolumn{3}{c | }{Full (127°)} | \multicolumn{3}{c | }{Common} | \multicolumn{3}{c | }{Geometry} | \multicolumn{3}{c | }{Full (127°)} | \multicolumn{3}{c | }{Common} | \multicolumn{3}{c | }{Geometry} | |||||||
| Method | PSNR↑ | SSIM↑ | LPIPS↓ | PSNR↑ | SSIM↑ | LPIPS↓ | ↑ | ↑ | ↑ | PSNR↑ | SSIM↑ | LPIPS↓ | PSNR↑ | SSIM↑ | LPIPS↓ | ↑ | ↑ | ↑ |
| GOF [37] | 27.54 | 0.904 | 0.212 | 30.01 | 0.920 | 0.208 | 0.579 | 0.629 | 0.601 | 26.10 | 0.874 | 0.234 | 27.34 | 0.889 | 0.233 | 0.578 | 0.693 | 0.630 |
| PGSR [2] | 27.39 | 0.898 | 0.241 | 29.66 | 0.916 | 0.229 | 0.698 | 0.677 | 0.687 | 25.69 | 0.870 | 0.258 | 26.94 | 0.887 | 0.249 | 0.694 | 0.728 | 0.710 |
| SOF [26] | 27.10 | 0.898 | 0.218 | 28.83 | 0.914 | 0.214 | 0.620 | 0.667 | 0.641 | 26.29 | 0.876 | 0.221 | 27.20 | 0.889 | 0.225 | 0.603 | 0.724 | 0.657 |
| MiLo [7] | 27.61 | 0.903 | 0.234 | 29.75 | 0.916 | 0.231 | 0.651 | 0.701 | 0.675 | 26.35 | 0.877 | 0.247 | 27.50 | 0.891 | 0.247 | 0.652 | 0.726 | 0.687 |
| CoMe [27] | 28.11 | 0.909 | 0.190 | 29.92 | 0.921 | 0.193 | 0.652 | 0.730 | 0.687 | 26.65 | 0.880 | 0.207 | 27.55 | 0.893 | 0.211 | 0.631 | 0.768 | 0.692 |
| GOFish (Ours) | 30.17 | 0.921 | 0.172 | 30.72 | 0.925 | 0.185 | 0.637 | 0.795 | 0.706 | 27.61 | 0.888 | 0.195 | 28.24 | 0.899 | 0.208 | 0.604 | 0.828 | 0.698 |
| + Geometry Objective | 30.12 | 0.921 | 0.171 | 30.68 | 0.925 | 0.185 | 0.630 | 0.801 | 0.704 | 27.61 | 0.889 | 0.193 | 28.20 | 0.899 | 0.207 | 0.592 | 0.846 | 0.696 |
Table 4. Quantitative comparison on both ScanNet++ scene sets [34]. Left uses the six scenes of 3DGUT and Fisheye-GS [22, 31]; right uses CoMe’s six [27]. Full is the native image and Common the official undistortion. GOFish is mapped to Common with the official map and a box downsample; geometry uses CoMe’s 5 cm protocol. The best, second best, and third best entries are highlighted.
Self-Calibrating GS [3] initializes its lens network from a fisheye calibration file. For the pinhole Tanks & Temples images, we supply a zero-distortion pinhole calibration, so the lens starts at identity rather than its equidistant fallback. On ScanNet++, its cube-face guard rescales only the vertical focal length, although the same intrinsics define the fisheye-to-cube mapping. We retain the calibrated focal length for that mapping and keep the face intrinsics consistent in the evaluation cameras. We also use the dataset’s Kannala–Brandt calibration instead of its equidistant default for the base lens mapping. Training does not save the cubemap network, so the method’s own initialization refits it before the released held-out render pass used for timing.
3DGUT and 3DGRT [24, 31] use a released loader that sets FullCircle’s field-of-view limit from the image corner. The corner lies beyond the calibration’s monotone range, producing folded rays and collapsing 3DGUT training on room3 to 11.7 dB full PSNR. We cap the limit at the end of the monotone range and assign no ray beyond it, matching FullCircle’s treatment of border pixels.
3DGEER [14] uses KB mode on FIORD and FullCircle and BEAP training with KB rendering on ScanNet++, following its released configurations at our splits and resolutions. Because its fisheye models assume forward-facing rays, we use the release’s mask to exclude rays at least from the optical axis, limiting its field of view to . These rays receive no loss and are scored as unrendered black pixels, as for every baseline. We supply one ray map per FIORD camera, computed with a converged inverse of the KB model, because the release’s three-step Newton inverse does not converge on FIORD’s lenses. We also cull Gaussians whose KB pixel bound is inverted for a view, a case the release does not catch and that crashes training on two outdoor scenes. On FullCircle lounge, 3DGEER exceeds the memory of our 24 GB and 32 GB GPUs at its released densification threshold, so we double it to 0.0000 and leave all other settings unchanged.
| Method | PSNR↑ | SSIM↑ | LPIPS↓ | ↑ | ↑ | ↑ |
| \multicolumn{1}{c | }{} | \multicolumn{3}{c | }{Rendering} | \multicolumn{3}{c | }{Geometry} | |
| Fisheye-GS* [22] | 24.71 | 0.838 | 0.236 | |||
| 3DGUT [31] | 25.11 | 0.852 | 0.221 | |||
| 3DGUT + PPISP [31, 4] | 26.51 | 0.868 | 0.199 | |||
| 3DGEER* [14] | 24.42 | 0.837 | 0.235 | |||
| Self-Calibrating GS* [3] | 22.66 | 0.759 | 0.332 | |||
| DirectFisheye-GS [32] | 25.37 | 0.846 | 0.227 | |||
| 3DGRT [24] | 23.95 | 0.842 | 0.232 | |||
| 3DGRT + PPISP [24, 4] | 26.42 | 0.863 | 0.200 | |||
| GOF [37] | 22.85 | 0.833 | 0.231 | 0.511 | 0.417 | 0.451 |
| PGSR [2] | 23.63 | 0.840 | 0.212 | 0.476 | 0.585 | 0.514 |
| SOF [26] | 22.96 | 0.814 | 0.248 | 0.520 | 0.422 | 0.454 |
| MiLo [7] | 22.96 | 0.813 | 0.281 | 0.522 | 0.396 | 0.445 |
| CoMe [27] | 22.45 | 0.814 | 0.245 | 0.574 | 0.495 | 0.521 |
| GOFish (Ours) | 26.77 | 0.872 | 0.187 | 0.389 | 0.422 | 0.399 |
| + Geometry Objective | 26.52 | 0.868 | 0.193 | 0.406 | 0.435 | 0.414 |
Table 5. Quantitative comparison on Tanks & Temples [18]. The best, second best, and third best entries are highlighted. * Appendix B.3 details baseline adaptations.
Additional Results
Table 4 compares ScanNet++ [34] on the six scenes used by 3DGUT and Fisheye-GS [22, 31] and the six used by CoMe [27]. Across its base and Geometry Objective variants, GOFish leads rendering and recall on both sets. Base GOFish also leads F-score on the 3DGUT set and ranks second on CoMe’s set, 0.698 against 0.710 for PGSR [2]. On the pinhole Tanks & Temples benchmark [18] in Table 5, GOFish renders best, while dedicated surface methods retain higher F-score. Figure 15 shows every scene; on Courthouse, floaters cover CoMe’s rendering while GOFish recovers the facade.

Figure 15. Qualitative rendering and mesh results on Tanks & Temples [18]. Metrics are per-scene.
Ablations and Robustness
Cross-dataset losses. Across separate full training runs, CoMe’s confidence-weighted photometric loss and normalvariance regularizer raise F-score by 0.011, 0.028, and 0.013 on FIORD [8], ScanNet++, and Tanks & Temples. Full PSNR changes by −0.13, +0.06, and −0.11 dB, respectively. Following CoMe’s ScanNet++ protocol, GOFish uses these losses only there. The cross-dataset runs show that both metrics improve on ScanNet++, whereas modest F-score gains on FIORD and Tanks & Temples come with lower Full PSNR.
Run-to-run variation. Each of three repetitions covers every evaluated FIORD scene for both GOFish and PGSR. Across the six geometry scenes, base GOFish averages an F-score of 0.245 ± 0.001 versus 0.239 ± 0.002 for PGSR, and every GOFish run exceeds every PGSR run. Its seven-scene mean Full PSNR varies by only ±0.02 dB. The F-score gap therefore exceeds run-to-run variation.
Densification split. Table 3 adds calibrated densification and filtering together. We separate them on four of FIORD’s six geometry scenes [8]: Kitchen_In, Road_Out, MeetingRoom_In, and Bridge_Out. The Building_In runs used an earlier training configuration, while unfiltered Hall_In training ran out of GPU memory. With only the image-space statistic, only SOF’s schedule [26], or only the filter, the mean F-score is 0.146, 0.214, and 0.140, against 0.301 for the full row on these scenes. On Kitchen_In and MeetingRoom_In, where both variants produce meshes, calibrated densification without the filter scores 0.573 and 0.503, against 0.560 and 0.505 with it.
With and without the filter, Full PSNR differs by at most 0.1 dB on these four scenes and on Corridor_Out, which has no geometry ground truth. The filter reduces the Gaussian count by 2.2–5.4×, from 1.05–2.94 M to 0.42–0.69 M, and raises real-time rendering speed on Kitchen_In and MeetingRoom_In from 65 to 86–90 FPS on an NVIDIA A10G GPU. Without the filter, Bridge_Out mesh extraction ran out of GPU memory, while Road_Out mesh extraction did not finish. Thus calibrated densification drives surface recovery, while filtering controls scene size and memory.
Geometry by region. We assign each FIORD ground-truth point and predicted sample the smallest ray angle from which any training camera observes it. We separately identify samples observed by any camera within 90° rectification. This rectified region contains 94% of the observed ground truth. GOFish leads every surface method within the shared 90° FoV, 0.254 against 0.243 for PGSR, and for rays beyond 90° from the optical axis, 0.112 against 0.102 for CoMe. Its overall advantage therefore does not come only from evaluating the wider FoV.
Efficiency
Table 6 separates training, meshing, and rendering cost from representation size. On FIORD, GOFish completes training and mesh extraction in 153 minutes, faster end to end than GOF’s 208 minutes [37]. Its real-time renderer reaches 79 FPS, close to the 84 FPS of rendering-only 3DGUT + PPISP [4, 31] and more than three times the 22 FPS of 3DGRT + PPISP [24]. The same renderer reaches 99 FPS on ScanNet++ and 82 FPS on Tanks & Temples. Despite covering the full FoV, GOFish averages 0.60 million Gaussians on FIORD, compared with 1.03 million for 3DGUT + PPISP. The optional Geometry Objective adds little end-to-end cost and does not reduce rendering speed.
| Method | FIORD [8] | ScanNet++ [34] | Tanks & Temples [18] | |||||||||||||||
| Train↓ | Mesh↓ | Total↓ | FPS↑ | Gaussians | Triangles | Train↓ | Mesh↓ | Total↓ | FPS↑ | Gaussians | Triangles | Train↓ | Mesh↓ | Total↓ | FPS↑ | Gaussians | Triangles | |
| 3DGS [17] | 23m | 23m | 124 | 0.95M | 16m | 16m | 168 | 0.97M | 22m | 22m | 107 | 1.31M | ||||||
| Fisheye-GS⋆ [22] | 42m | 42m | 135 | 0.60M | 119m | 119m | 74.0 | 0.96M | 21m | 21m | 115 | 1.49M | ||||||
| 3DGUT [31] | 28m | 28m | 92.1 | 1.03M | 10m | 10m | 238 | 0.37M | 24m | 24m | 105 | 1.00M | ||||||
| 3DGUT + PPISP [31, 4] | 29m | 29m | 84.3 | 1.03M | 11m | 11m | 209 | 0.35M | 25m | 25m | 96.5 | 1.00M | ||||||
| 3DGEER⋆ [14] | 51m | 51m | 46.7 | 1.90M | 67m | 67m | 112 | 1.41M | 71m | 71m | 97.2 | 4.27M | ||||||
| Self-Calibrating GS⋆ [3] | 123m | 123m | 7.0 | 0.51M | 98m | 98m | 6.8 | 0.34M | 84m | 84m | 30.7 | 2.03M | ||||||
| DirectFisheye-GS [32] | 28m | 28m | 208 | 0.46M | 56m | 56m | 137 | 0.66M | 29m | 29m | 191 | 0.97M | ||||||
| 3DGRT [24] | 104m | 104m | 23.1 | 1.03M | 27m | 27m | 95.7 | 0.53M | 63m | 63m | 39.8 | 1.00M | ||||||
| 3DGRT + PPISP [24, 4] | 108m | 108m | 22.3 | 1.03M | 28m | 28m | 93.5 | 0.50M | 67m | 67m | 37.2 | 1.00M | ||||||
| GOF [37] | 104m | 104m | 208m | 11.0 | 0.73M | 9.9M | 76m | 51m | 127m | 18.2 | 0.98M | 16.7M | 93m | 46m | 139m | 11.7 | 1.34M | 28.3M |
| PGSR [2] | 49m | 309m | 358m | 103 | 0.53M | 20.6M | 45m | 1m | 46m | 118 | 0.60M | 4.9M | 69m | 4m | 73m | 43.6 | 1.44M | 22.9M |
| SOF [26] | 37m | 10m | 47m | 53.4 | 0.85M | 8.5M | 34m | 9m | 43m | 52.5 | 0.99M | 16.8M | 41m | 10m | 51m | 42.6 | 1.35M | 28.2M |
| MiLo [7] | 62m⋆ | 6m⋆ | 68m⋆ | 312 | 0.16M | 4.8M | 77m | 7m | 85m | 314 | 0.21M | 6.1M | 94m | 10m | 104m | 194 | 0.23M | 7.0M |
| CoMe [27] | 41m | 9m | 50m | 40.2 | 0.69M | 12.0M | 43m | 11m | 54m | 34.8 | 1.20M | 21.0M | 55m | 14m | 69m | 29.1 | 1.79M | 29.0M |
| GOFish (Ours) | 107m | 46m | 153m | 79.3 | 0.60M | 19.3M | 129m | 29m | 158m | 98.8 | 0.97M | 26.7M | 99m | 22m | 121m | 81.5 | 1.32M | 41.4M |
| + Geometry Objective | 116m | 45m | 161m | 86.8 | 0.60M | 18.6M | 135m | 28m | 163m | 107 | 0.97M | 26.5M | 103m | 21m | 124m | 84.0 | 1.32M | 39.6M |
Table 6. Efficiency and representation size. Dataset averages follow Appendix § 13.§ 2. Training, meshing, and FPS are measured on an NVIDIA A10G GPU. GOFish FPS uses the real-time renderer detailed in Appendix § 12.§ 8. ⋆ denotes an NVIDIA A100 GPU run detailed in Appendix § 13.3.
Surface Failure Cases
Figure 9 shows challenges shared across Gaussian surface reconstruction methods [2, 7, 26, 37]. Reflective surfaces and thin structures challenge the minimum-over-views field in panels (a) and (b), while sparse observations produce holes and overfill in panels (c) and (d).

Figure 9. Representative surface-reconstruction failure cases. Panels (a)–(c) compare ground truth (left) with GOFish meshes (right). Panel (d) shows GOFish’s rendering (left) and mesh (right).
Per-Scene Metrics
Tables 7–10 provide per-scene results for the aggregates in Tables 1, 2, 4, and 5. They also include FullCircle surface-baseline results and Tanks & Temples rendering and geometry that the body tables do not report. Rendering domains follow Appendix § 13.§ 2: Full is the calibrated FoV, Common the shared rectification, and GOFish @ FoV compares GOFish on the pixels rendered by each baseline. Blank cells denote unreported domains, and asterisks mark baseline adaptations detailed in Appendix § 13.3.
Additional Qualitative Results
Figures 10–15 show one held-out view per scene, emphasizing scenes not shown in the body. Every dataset has a rendering comparison; FIORD [8], ScanNet++ [34], and Tanks & Temples [18] also have surface comparisons, while FullCircle [5] lacks geometry ground truth. Badges report per-scene metrics. Meshes are rendered from the held-out camera and shaded as in Figure 5; black marks missing surfaces. GOFish uses the Geometry Objective for meshing.
| Dataset | Abbreviation | Scene |
| FIORD [8] | Kit. | Kitchen_In |
| Cor. | Corridor_Out | |
| Road | Road_Out | |
| Bld. | Building_In | |
| Meet. | MeetingRoom_In | |
| Bri. | Bridge_Out | |
| Hall | Hall_In | |
| FullCircle [5] | Dark | dark |
| F1 | flat1 | |
| F2 | flat2 | |
| Lab | lab | |
| Lou. | lounge | |
| Per. | persons | |
| R1 | room1 | |
| R2 | room2 | |
| R3 | room3 | |
| ScanNet++ [34] | 0a5c | 0a5c013435 |
8d56 | 8d563fc2cc | |
bb87 | bb87c292ad | |
d415 | d415cc449b | |
e8ea | e8ea9b4da8 | |
fe17 | fe1733741f | |
| Tanks & Temples [18] | Barn | Barn |
| Cat. | Caterpillar | |
| Court. | Courthouse | |
| Ign. | Ignatius | |
| Meet. | Meetingroom | |
| Truck | Truck |
Table 11. Scene abbreviations for Tables 7–10.
Table 7. Per-scene rendering results on FIORD [8] and FullCircle [5] for fisheye baselines. The best, second best, and third best entries are highlighted. GOFish’s gain at each baseline’s FoV is highlighted. Protocols follow Appendix § 13.§ 2.
| Metric | Method | FoV | FIORD Full (200°): Kit. | Cor. | Road | Bld. | Meet. | Bri. | Hall | FIORD GOFish @ FoV: Kit. | Cor. | Road | Bld. | Meet. | Bri. | Hall | FullCircle Full (205°): Dark | F1 | F2 | Lab | Lou. | Per. | R1 | R2 | R3 | FullCircle GOFish @ FoV: Dark | F1 | F2 | Lab | Lou. | Per. | R1 | R2 | R3 | |
| PSNR↑ | Fisheye-GS* [22] | 145° | 18.72 | 16.22 | 17.19 | 18.18 | 16.28 | 17.47 | 20.42 | +5.66 | +2.93 | +2.59 | +6.56 | +9.65 | +3.43 | +4.63 | 13.44 | 13.87 | 14.53 | 14.38 | 12.80 | 13.25 | 14.97 | 14.59 | 14.28 | +15.05 | +13.98 | +14.05 | +14.29 | +8.24 | +15.82 | +15.51 | +15.64 | +13.88 | |
| PSNR↑ | 3DGUT [31] | 160° | 20.20 | 17.62 | 19.49 | 19.03 | 19.62 | 24.25 | 18.84 | +3.99 | +4.01 | +2.48 | +6.36 | +5.27 | −1.51 | +7.04 | 22.17 | 21.06 | 20.44 | 20.32 | 20.14 | 22.55 | 22.30 | 23.21 | 22.06 | +1.40 | +2.69 | +1.15 | +1.71 | −1.46 | +2.63 | +2.13 | +2.68 | +1.63 | |
| PSNR↑ | 3DGUT + PPISP [31, 4] | 160° | 20.34 | 18.78 | 19.70 | 19.68 | 19.48 | 24.38 | 18.93 | +4.36 | +3.26 | +2.14 | +6.51 | +6.12 | −1.17 | +7.09 | 22.03 | 20.99 | 20.58 | 20.31 | 20.00 | 22.06 | 22.09 | 23.07 | 21.93 | +1.74 | +2.53 | +1.44 | +1.82 | −1.42 | +3.13 | +2.84 | +3.00 | +1.82 | |
| PSNR↑ | 3DGEER* [14] | 178° | 14.19 | 10.39 | 11.52 | 12.29 | 13.50 | 10.06 | 17.55 | −0.39 | +4.80 | +3.55 | +1.53 | +0.46 | +4.85 | −0.60 | 13.45 | 12.96 | 10.02 | 10.36 | 13.07 | 14.75 | 13.57 | 13.47 | 12.19 | +4.66 | +3.70 | +5.22 | +5.34 | +1.48 | +4.35 | +4.86 | +4.87 | +3.72 | |
| PSNR↑ | Self-Calibrating GS* [3] | 180° | 18.59 | 18.68 | 17.40 | 17.67 | 18.46 | 13.90 | 19.39 | +4.91 | +4.39 | +4.34 | +6.45 | +6.39 | +5.98 | +7.04 | 17.01 | 17.40 | 16.61 | 16.45 | 16.01 | 18.18 | 16.79 | 19.79 | 17.42 | +11.05 | +10.37 | +10.98 | +11.94 | +5.31 | +11.01 | +12.42 | +9.78 | +11.12 | |
| PSNR↑ | DirectFisheye-GS [32] | 180° | 23.13 | 20.56 | 20.56 | 20.93 | 22.94 | 23.07 | 23.35 | +1.09 | +2.24 | +1.76 | +4.70 | +2.76 | +0.62 | +2.31 | 21.12 | 20.55 | 19.51 | 19.91 | 18.92 | 21.83 | 21.06 | 22.24 | 20.87 | +5.44 | +5.34 | +6.44 | +6.55 | +0.70 | +5.63 | +5.73 | +6.20 | +5.81 | |
| PSNR↑ | 3DGRT [24] | Full | 16.97 | 14.88 | 15.17 | 15.83 | 17.34 | 14.44 | 16.22 | +7.21 | +8.19 | +7.70 | +9.17 | +8.23 | +10.29 | +8.88 | 22.87 | 23.63 | 21.19 | 23.06 | 21.32 | 25.43 | 22.87 | 25.37 | 24.10 | +2.66 | +2.32 | +3.03 | +2.84 | −0.32 | +2.03 | +2.35 | +2.17 | +2.29 | |
| PSNR↑ | 3DGRT + PPISP [24, 4] | Full | 19.19 | 15.11 | 17.89 | 18.69 | 19.16 | 21.97 | 16.92 | +4.99 | +7.96 | +4.98 | +6.31 | +6.41 | +2.76 | +8.18 | 23.67 | 23.77 | 21.38 | 23.08 | 21.37 | 25.61 | 23.08 | 25.43 | 24.07 | +1.86 | +2.18 | +2.84 | +2.82 | −0.37 | +1.85 | +2.14 | +2.11 | +2.32 | |
| PSNR↑ | GOFish (Ours) | Full | 24.18 | 23.07 | 22.87 | 25.00 | 25.57 | 24.73 | 25.10 | 25.53 | 25.95 | 24.22 | 25.90 | 21.00 | 27.46 | 25.22 | 27.54 | 26.39 | |||||||||||||||||
| PSNR↑ | + Geometry Objective | Full | 24.08 | 22.81 | 22.56 | 24.96 | 25.46 | 24.43 | 24.94 | 25.27 | 25.93 | 24.26 | 25.89 | 19.60 | 27.62 | 25.23 | 27.68 | 26.27 | |||||||||||||||||
| SSIM↑ | Fisheye-GS* [22] | 145° | 0.738 | 0.610 | 0.641 | 0.712 | 0.666 | 0.706 | 0.729 | +0.055 | +0.096 | +0.103 | +0.116 | +0.211 | +0.093 | +0.143 | 0.643 | 0.613 | 0.719 | 0.599 | 0.579 | 0.649 | 0.717 | 0.659 | 0.655 | +0.268 | +0.265 | +0.202 | +0.282 | +0.355 | +0.280 | +0.278 | +0.207 | +0.228 | |
| SSIM↑ | 3DGUT [31] | 160° | 0.791 | 0.615 | 0.673 | 0.750 | 0.796 | 0.805 | 0.719 | +0.044 | +0.064 | +0.075 | +0.072 | +0.052 | −0.018 | +0.105 | 0.864 | 0.824 | 0.867 | 0.810 | 0.768 | 0.825 | 0.889 | 0.885 | 0.855 | +0.017 | +0.027 | +0.018 | +0.015 | −0.038 | +0.024 | +0.012 | +0.019 | +0.020 | |
| SSIM↑ | 3DGUT + PPISP [31, 4] | 160° | 0.786 | 0.628 | 0.677 | 0.762 | 0.791 | 0.834 | 0.721 | +0.055 | +0.063 | +0.072 | +0.071 | +0.057 | −0.017 | +0.104 | 0.866 | 0.825 | 0.867 | 0.807 | 0.767 | 0.821 | 0.888 | 0.884 | 0.845 | +0.017 | +0.025 | +0.018 | +0.019 | −0.038 | +0.018 | +0.019 | +0.019 | +0.020 | |
| SSIM↑ | 3DGEER* [14] | 178° | 0.740 | 0.565 | 0.582 | 0.688 | 0.718 | 0.646 | 0.795 | −0.005 | +0.066 | +0.076 | +0.023 | +0.000 | +0.021 | −0.001 | 0.738 | 0.711 | 0.731 | 0.687 | 0.621 | 0.709 | 0.762 | 0.753 | 0.725 | +0.038 | +0.040 | +0.043 | +0.056 | +0.036 | +0.043 | +0.029 | +0.040 | +0.032 | |
| SSIM↑ | Self-Calibrating GS* [3] | 180° | 0.737 | 0.594 | 0.631 | 0.715 | 0.740 | 0.700 | 0.699 | +0.106 | +0.147 | +0.141 | +0.124 | +0.191 | +0.097 | +0.170 | 0.750 | 0.670 | 0.726 | 0.604 | 0.484 | 0.679 | 0.684 | 0.771 | 0.695 | +0.206 | +0.216 | +0.187 | +0.268 | +0.293 | +0.260 | +0.246 | +0.159 | +0.195 | |
| SSIM↑ | DirectFisheye-GS [32] | 180° | 0.813 | 0.630 | 0.680 | 0.759 | 0.811 | 0.790 | 0.780 | +0.058 | +0.116 | +0.100 | +0.087 | +0.053 | +0.104 | +0.077 | 0.832 | 0.798 | 0.823 | 0.773 | 0.710 | 0.901 | 0.848 | 0.755 | 0.800 | +0.055 | +0.059 | +0.068 | +0.064 | +0.018 | +0.071 | +0.046 | +0.159 | +0.195 | |
| SSIM↑ | 3DGRT [24] | Full | 0.732 | 0.561 | 0.621 | 0.735 | 0.759 | 0.757 | 0.647 | +0.123 | +0.173 | +0.160 | +0.129 | +0.110 | +0.074 | +0.219 | 0.885 | 0.862 | 0.890 | 0.848 | 0.789 | 0.911 | 0.914 | 0.875 | 0.013 | +0.011 | +0.013 | +0.008 | −0.030 | +0.008 | +0.007 | +0.006 | +0.007 | ||
| SSIM↑ | 3DGRT + PPISP [24, 4] | Full | 0.754 | 0.580 | 0.669 | 0.735 | 0.776 | 0.797 | 0.671 | +0.101 | +0.154 | +0.112 | +0.115 | +0.093 | +0.034 | +0.195 | 0.885 | 0.864 | 0.896 | 0.849 | 0.791 | 0.911 | 0.915 | 0.876 | +0.013 | +0.009 | +0.007 | +0.007 | −0.030 | +0.008 | +0.007 | +0.007 | +0.006 | ||
| SSIM↑ | GOFish (Ours) | Full | 0.855 | 0.734 | 0.781 | 0.850 | 0.869 | 0.831 | 0.866 | 0.898 | 0.973 | 0.903 | 0.856 | 0.759 | 0.916 | 0.922 | 0.882 | ||||||||||||||||||
| SSIM↑ | + Geometry Objective | Full | 0.853 | 0.718 | 0.767 | 0.849 | 0.866 | 0.827 | 0.862 | 0.895 | 0.917 | 0.903 | 0.856 | 0.759 | 0.916 | 0.922 | 0.880 | ||||||||||||||||||
| LPIPS↓ | Fisheye-GS* [22] | 145° | 0.361 | 0.409 | 0.402 | 0.415 | 0.469 | 0.406 | 0.300 | +0.162 | +0.101 | +0.102 | +0.200 | +0.326 | +0.130 | +0.151 | 0.472 | 0.520 | 0.479 | 0.504 | 0.557 | 0.484 | 0.466 | 0.486 | 0.490 | +0.377 | +0.403 | +0.396 | +0.430 | +0.485 | +0.340 | +0.415 | +0.369 | +0.354 | |
| LPIPS↓ | 3DGUT [31] | 160° | 0.279 | 0.391 | 0.360 | 0.332 | 0.299 | 0.259 | 0.290 | +0.029 | +0.046 | +0.053 | +0.066 | +0.053 | −0.013 | +0.084 | 0.252 | 0.311 | 0.249 | 0.246 | 0.212 | 0.298 | 0.225 | 0.275 | 0.285 | +0.036 | +0.046 | +0.039 | +0.021 | −0.036 | +0.044 | +0.026 | +0.051 | +0.040 | |
| LPIPS↓ | 3DGUT + PPISP [31, 4] | 160° | 0.284 | 0.377 | 0.356 | 0.330 | 0.297 | 0.256 | 0.285 | +0.045 | +0.050 | +0.052 | +0.065 | +0.052 | −0.014 | +0.081 | 0.255 | 0.310 | 0.249 | 0.251 | 0.220 | 0.300 | 0.227 | 0.257 | 0.285 | +0.073 | +0.079 | +0.087 | +0.061 | +0.018 | +0.072 | +0.061 | +0.080 | +0.081 | |
| LPIPS↓ | 3DGEER* [14] | 178° | 0.428 | 0.418 | 0.415 | 0.320 | 0.296 | 0.373 | 0.203 | +0.001 | +0.052 | +0.055 | +0.035 | +0.014 | +0.031 | +0.003 | 0.332 | 0.365 | 0.343 | 0.330 | 0.314 | 0.359 | 0.292 | 0.346 | 0.345 | +0.035 | +0.040 | +0.047 | +0.051 | +0.020 | +0.032 | +0.048 | +0.039 | +0.035 | |
| LPIPS↓ | Self-Calibrating GS* [3] | 180° | 0.310 | 0.391 | 0.395 | 0.360 | 0.351 | 0.369 | 0.285 | +0.123 | +0.121 | +0.117 | +0.161 | +0.159 | +0.093 | +0.175 | 0.490 | 0.464 | 0.423 | 0.451 | 0.457 | 0.430 | 0.418 | 0.418 | 0.449 | +0.272 | +0.288 | +0.287 | +0.339 | +0.330 | +0.248 | +0.318 | +0.257 | +0.281 | |
| LPIPS↓ | DirectFisheye-GS [32] | 180° | 0.256 | 0.368 | 0.351 | 0.336 | 0.295 | 0.298 | 0.225 | +0.058 | +0.089 | +0.086 | +0.116 | +0.091 | +0.041 | +0.077 | 0.284 | 0.333 | 0.293 | 0.275 | 0.250 | 0.198 | 0.331 | 0.302 | 0.304 | +0.073 | +0.079 | +0.086 | +0.061 | +0.018 | +0.072 | +0.061 | +0.080 | +0.081 | |
| LPIPS↓ | 3DGRT [24] | Full | 0.305 | 0.417 | 0.402 | 0.327 | 0.303 | 0.314 | 0.274 | +0.114 | +0.141 | +0.144 | +0.127 | +0.119 | +0.107 | +0.177 | 0.226 | 0.267 | 0.224 | 0.212 | 0.195 | 0.253 | 0.190 | 0.233 | 0.250 | +0.025 | +0.026 | +0.024 | +0.064 | +0.005 | +0.017 | +0.061 | +0.021 | +0.024 | |
| LPIPS↓ | 3DGRT + PPISP [24, 4] | Full | 0.281 | 0.389 | 0.353 | 0.315 | 0.287 | 0.272 | 0.295 | +0.090 | +0.113 | +0.095 | +0.115 | +0.103 | +0.047 | +0.158 | 0.228 | 0.263 | 0.206 | 0.202 | 0.189 | 0.235 | 0.224 | 0.230 | 0.241 | +0.073 | +0.079 | +0.086 | +0.061 | +0.018 | +0.072 | +0.061 | +0.080 | +0.081 | |
| LPIPS↓ | GOFish (Ours) | Full | 0.191 | 0.276 | 0.258 | 0.200 | 0.184 | 0.225 | 0.137 | 0.201 | 0.241 | 0.187 | 0.188 | 0.200 | 0.236 | 0.174 | 0.212 | 0.226 | |||||||||||||||||
| LPIPS↓ | + Geometry Objective | Full | 0.194 | 0.288 | 0.274 | 0.205 | 0.188 | 0.231 | 0.141 | 0.196 | 0.304 | 0.295 | 0.224 | 0.174 | 0.227 | 0.259 | 0.246 | 0.308 |
Table 8. Per-scene rendering results on FIORD [8] and FullCircle [5] for surface baselines. The best, second best, and third best entries are highlighted. Protocols follow Appendix § 13.§ 2.
| Metric | Method | FoV | FIORD Full (200°) | FIORD Common (90°) | FullCircle Full (205°) |
| PSNR↑ | GOF [37] | Rectified | 18.02 17.42 14.92 17.64 19.35 12.86 19.03 | 30.96 24.15 22.44 28.19 31.88 30.60 29.20 | 21.48 22.62 19.94 22.81 18.67 22.97 22.36 22.95 22.77 |
| PSNR↑ | PGSR [2] | Rectified | 17.82 17.12 14.56 18.36 18.81 12.59 18.43 | 30.37 25.14 24.34 29.31 31.00 29.34 29.54 | 21.08 23.35 20.04 23.30 18.31 23.08 22.46 23.10 23.59 |
| PSNR↑ | SOF [26] | Rectified | 18.08 16.92 13.26 17.00 19.30 12.73 19.05 | 30.07 25.31 17.87 26.00 30.57 28.65 28.32 | 21.13 22.41 19.55 22.72 19.62 22.03 22.02 22.67 23.63 |
| PSNR↑ | MiLo [7] | Rectified | 17.57 17.87 14.94 18.21 18.86 12.26 19.67 | 30.02 25.18 24.35 29.46 30.25 29.19 29.01 | 21.30 23.10 19.79 22.89 20.82 23.17 22.26 23.35 22.70 |
| PSNR↑ | CoMe [27] | Rectified | 18.18 19.34 14.91 18.64 19.59 12.77 20.06 | 30.05 24.36 20.70 29.01 29.86 28.90 29.11 | 22.00 22.95 20.18 22.90 19.94 23.50 22.31 23.34 23.50 |
| PSNR↑ | GOFish (Ours) | Full | 24.18 23.07 22.87 25.00 25.57 24.73 25.10 | 30.61 26.61 25.24 30.94 30.72 27.86 31.06 | 25.53 25.95 24.22 25.90 21.00 27.46 25.22 27.54 26.39 |
| PSNR↑ | + Geometry Objective | Full | 24.08 22.81 22.56 24.96 25.46 24.43 24.94 | 30.57 25.94 24.67 30.63 30.29 26.99 30.66 | 25.27 25.93 24.26 25.89 19.60 27.62 25.23 27.68 26.27 |
| SSIM↑ | GOF [37] | Rectified | 0.731 0.571 0.588 0.726 0.780 0.671 0.664 | 0.936 0.773 0.805 0.901 0.945 0.927 0.891 | 0.844 0.810 0.831 0.827 0.685 0.798 0.875 0.862 0.862 |
| SSIM↑ | PGSR [2] | Rectified | 0.715 0.582 0.584 0.737 0.760 0.662 0.677 | 0.933 0.799 0.836 0.917 0.942 0.922 0.898 | 0.828 0.807 0.825 0.783 0.649 0.792 0.862 0.855 0.822 |
| SSIM↑ | SOF [26] | Rectified | 0.741 0.543 0.496 0.705 0.789 0.674 0.671 | 0.933 0.720 0.702 0.880 0.942 0.914 0.877 | 0.837 0.807 0.822 0.788 0.696 0.786 0.877 0.859 0.835 |
| SSIM↑ | MiLo [7] | Rectified | 0.723 0.589 0.598 0.745 0.774 0.655 0.677 | 0.929 0.783 0.827 0.914 0.932 0.909 0.883 | 0.817 0.834 0.789 0.707 0.804 0.873 0.864 0.826 |
| SSIM↑ | CoMe [27] | Rectified | 0.744 0.606 0.572 0.758 0.792 0.695 0.705 | 0.934 0.774 0.763 0.919 0.946 0.929 0.901 | 0.848 0.832 0.786 0.694 0.807 0.877 0.866 0.830 |
| SSIM↑ | GOFish (Ours) | Full | 0.855 0.734 0.781 0.850 0.869 0.831 0.866 | 0.937 0.839 0.872 0.934 0.944 0.922 0.931 | 0.898 0.873 0.903 0.856 0.759 0.869 0.918 0.922 0.882 |
| SSIM↑ | + Geometry Objective | Full | 0.853 0.718 0.767 0.849 0.866 0.827 0.862 | 0.935 0.826 0.864 0.932 0.942 0.917 0.928 | 0.895 0.871 0.901 0.856 0.732 0.867 0.916 0.920 0.880 |
| LPIPS↓ | GOF [37] | Rectified | 0.306 0.405 0.448 0.358 0.286 0.383 0.286 | 0.211 0.379 0.385 0.293 0.186 0.228 0.297 | 0.259 0.246 0.308 0.227 0.259 0.246 0.308 0.227 0.297 |
| LPIPS↓ | PGSR [2] | Rectified | 0.326 0.397 0.430 0.357 0.324 0.402 0.307 | 0.355 0.343 0.273 0.202 0.252 0.268 0.277 | 0.324 0.257 0.283 0.324 0.240 0.308 0.299 |
| LPIPS↓ | SOF [26] | Rectified | 0.293 0.426 0.501 0.369 0.273 0.394 0.284 | 0.213 0.434 0.495 0.319 0.187 0.250 0.280 | 0.265 0.317 0.282 0.248 0.237 0.313 0.220 0.292 0.282 |
| LPIPS↓ | MiLo [7] | Rectified | 0.321 0.406 0.439 0.373 0.307 0.424 0.308 | 0.220 0.376 0.364 0.302 0.220 0.289 0.302 | 0.267 0.280 0.261 0.242 0.235 0.303 0.235 0.303 0.302 |
| LPIPS↓ | CoMe [27] | Rectified | 0.292 0.383 0.457 0.319 0.260 0.363 0.252 | 0.209 0.378 0.435 0.263 0.163 0.215 0.245 | 0.311 0.275 0.253 0.241 0.295 0.220 0.282 0.288 |
| LPIPS↓ | GOFish (Ours) | Full | 0.191 0.276 0.258 0.200 0.184 0.225 0.137 | 0.193 0.289 0.281 0.218 0.167 0.220 0.180 | 0.201 0.241 0.187 0.188 0.200 0.236 0.174 0.212 0.226 |
| LPIPS↓ | + Geometry Objective | Full | 0.194 0.288 0.274 0.205 0.188 0.231 0.141 | 0.196 0.304 0.295 0.224 0.174 0.227 0.184 | 0.245 0.192 0.189 0.235 0.241 0.174 0.216 0.225 |
| Method | FoV | 0a5c | 8d56 | bb87 | d415 | e8ea | fe17 | 0a5c | 8d56 | bb87 | d415 | e8ea | fe17 | Barn | Cat. | Court. | Ign. | Meet. | Truck |
| Fisheye-GS* [22] | 145° | 24.50 | 24.17 | 29.21 | 26.13 | 29.28 | 24.40 | 28.30 | 23.75 | 22.58 | 22.35 | 25.90 | 25.41 | ||||||
| 3DGUT [31] | 160° | 29.54 | 26.09 | 30.97 | 28.21 | 33.10 | 25.66 | 29.10 | 23.65 | 22.84 | 22.82 | 26.30 | 25.96 | ||||||
| 3DGUT + PPISP [31, 4] | 160° | 29.84 | 25.94 | 30.99 | 28.11 | 33.16 | 25.54 | 30.18 | 26.00 | 24.02 | 25.01 | 27.06 | 26.79 | ||||||
| 3DGEER* [14] | 178° | 27.50 | 26.29 | 31.22 | 28.37 | 32.16 | 26.01 | 28.63 | 23.50 | 22.91 | 21.84 | 25.23 | 24.39 | ||||||
| Self-Calibrating GS* [3] | 180° | 28.50 | 25.71 | 29.60 | 26.36 | 31.21 | 24.62 | 26.70* | 22.45* | 18.37* | 21.21* | 23.33* | 23.93* | ||||||
| DirectFisheye-GS [32] | 180° | 29.70 | 26.68 | 31.52 | 28.41 | 33.40 | 25.95 | 29.00 | 24.41 | 23.42 | 22.73 | 26.74 | 25.91 | ||||||
| 3DGRT [24] | Full | 29.19 | 26.40 | 30.98 | 28.62 | 31.90 | 25.89 | 27.68 | 22.78 | 22.00 | 21.95 | 24.43 | 24.87 | ||||||
| 3DGRT + PPISP [24, 4] | Full | 30.17 | 26.73 | 32.29 | 28.98 | 34.05 | 26.03 | 29.45 | 26.08 | 23.68 | 25.11 | 27.86 | 26.35 | ||||||
| GOF [37] | Rectified | 28.12 | 25.71 | 30.01 | 26.92 | 29.47 | 25.04 | 30.48 | 27.11 | 32.42 | 29.33 | 34.25 | 26.45 | 26.22 | 21.77 | 20.28 | 21.01 | 24.71 | 23.13 |
| PGSR [2] | Rectified | 28.18 | 25.32 | 29.56 | 27.19 | 29.34 | 24.77 | 30.42 | 26.62 | 31.83 | 29.48 | 33.65 | 25.96 | 27.89 | 22.30 | 20.87 | 21.72 | 24.07 | 24.91 |
| SOF [26] | Rectified | 23.81 | 25.69 | 30.32 | 26.90 | 30.69 | 25.18 | 25.21 | 26.72 | 32.05 | 28.60 | 34.20 | 26.19 | 27.82 | 22.53 | 16.93 | 21.78 | 23.70 | 25.00 |
| MiLo [7] | Rectified | 28.41 | 25.75 | 29.66 | 27.47 | 29.34 | 25.04 | 30.53 | 27.03 | 31.87 | 29.42 | 33.46 | 26.17 | 26.56 | 21.44 | 21.76 | 20.64 | 24.57 | 22.80 |
| CoMe [27] | Rectified | 28.97 | 26.00 | 30.19 | 27.87 | 30.44 | 25.20 | 30.61 | 27.05 | 32.08 | 29.57 | 34.12 | 26.07 | 26.79 | 21.17 | 17.99 | 21.45 | 22.86 | 24.42 |
| GOFish (Ours) | Full | 30.84 | 26.93 | 32.81 | 29.46 | 34.59 | 26.38 | 31.51 | 27.46 | 33.40 | 30.06 | 34.94 | 26.95 | 30.25 | 26.32 | 23.81 | 24.92 | 28.65 | 26.65 |
| + Geometry Objective | Full | 30.78 | 26.88 | 32.72 | 29.44 | 34.58 | 26.33 | 31.47 | 27.42 | 33.32 | 30.03 | 34.96 | 26.88 | 30.20 | 26.04 | 23.33 | 24.94 | 28.00 | 26.58 |
| Fisheye-GS* [22] | 145° | 0.905 | 0.883 | 0.926 | 0.874 | 0.930 | 0.848 | 0.859 | 0.803 | 0.797 | 0.809 | 0.883 | 0.874 | ||||||
| 3DGUT [31] | 160° | 0.934 | 0.900 | 0.938 | 0.891 | 0.951 | 0.867 | 0.888 | 0.824 | 0.814 | 0.811 | 0.889 | 0.887 | ||||||
| 3DGUT + PPISP [31, 4] | 160° | 0.933 | 0.900 | 0.938 | 0.891 | 0.951 | 0.865 | 0.892 | 0.852 | 0.825 | 0.838 | 0.906 | 0.896 | ||||||
| 3DGEER* [14] | 178° | 0.929 | 0.901 | 0.939 | 0.891 | 0.952 | 0.870 | 0.867 | 0.803 | 0.801 | 0.797 | 0.883 | 0.871 | ||||||
| Self-Calibrating GS* [3] | 180° | 0.909 | 0.885 | 0.913 | 0.838 | 0.931 | 0.831 | 0.804* | 0.731* | 0.659* | 0.725* | 0.818* | 0.814* | ||||||
| DirectFisheye-GS [32] | 180° | 0.928 | 0.902 | 0.936 | 0.881 | 0.948 | 0.864 | 0.868 | 0.809 | 0.809 | 0.814 | 0.893 | 0.882 | ||||||
| 3DGRT [24] | Full | 0.920 | 0.887 | 0.930 | 0.889 | 0.944 | 0.856 | 0.876 | 0.811 | 0.803 | 0.801 | 0.878 | 0.881 | ||||||
| 3DGRT + PPISP [24, 4] | Full | 0.930 | 0.898 | 0.937 | 0.891 | 0.949 | 0.861 | 0.886 | 0.847 | 0.819 | 0.833 | 0.906 | 0.890 | ||||||
| GOF [37] | Rectified | 0.926 | 0.892 | 0.934 | 0.873 | 0.946 | 0.854 | 0.937 | 0.908 | 0.946 | 0.900 | 0.957 | 0.874 | 0.882 | 0.804 | 0.752 | 0.803 | 0.876 | 0.885 |
| PGSR [2] | Rectified | 0.924 | 0.886 | 0.926 | 0.870 | 0.940 | 0.842 | 0.936 | 0.904 | 0.939 | 0.954 | 0.862 | 0.862 | 0.890 | 0.807 | 0.782 | 0.809 | 0.870 | 0.880 |
| SOF [26] | Rectified | 0.875 | 0.895 | 0.934 | 0.873 | 0.950 | 0.859 | 0.908 | 0.909 | 0.944 | 0.892 | 0.958 | 0.873 | 0.879 | 0.799 | 0.646 | 0.808 | 0.865 | 0.885 |
| MiLo [7] | Rectified | 0.926 | 0.893 | 0.928 | 0.875 | 0.943 | 0.849 | 0.935 | 0.908 | 0.939 | 0.897 | 0.952 | 0.865 | 0.849 | 0.756 | 0.778 | 0.770 | 0.865 | 0.859 |
| CoMe [27] | Rectified | 0.929 | 0.898 | 0.935 | 0.889 | 0.951 | 0.853 | 0.938 | 0.911 | 0.945 | 0.906 | 0.959 | 0.866 | 0.871 | 0.766 | 0.689 | 0.808 | 0.865 | 0.887 |
| GOFish (Ours) | Full | 0.939 | 0.907 | 0.944 | 0.903 | 0.957 | 0.877 | 0.943 | 0.915 | 0.948 | 0.904 | 0.959 | 0.883 | 0.895 | 0.857 | 0.821 | 0.849 | 0.913 | 0.895 |
| + Geometry Objective | Full | 0.939 | 0.907 | 0.944 | 0.904 | 0.957 | 0.876 | 0.943 | 0.916 | 0.948 | 0.904 | 0.959 | 0.882 | 0.893 | 0.854 | 0.812 | 0.846 | 0.909 | 0.893 |
| Fisheye-GS* [22] | 145° | 0.273 | 0.270 | 0.246 | 0.215 | 0.275 | 0.258 | 0.234 | 0.265 | 0.292 | 0.201 | 0.240 | 0.184 | ||||||
| 3DGUT [31] | 160° | 0.207 | 0.219 | 0.213 | 0.194 | 0.222 | 0.230 | 0.194 | 0.243 | 0.262 | 0.221 | 0.241 | 0.166 | ||||||
| 3DGUT + PPISP [31, 4] | 160° | 0.207 | 0.216 | 0.212 | 0.193 | 0.219 | 0.230 | 0.189 | 0.212 | 0.248 | 0.189 | 0.215 | 0.141 | ||||||
| 3DGEER* [14] | 178° | 0.201 | 0.204 | 0.206 | 0.175 | 0.205 | 0.213 | 0.230 | 0.249 | 0.288 | 0.207 | 0.239 | 0.197 | ||||||
| Self-Calibrating GS* [3] | 180° | 0.229 | 0.231 | 0.238 | 0.239 | 0.245 | 0.260 | 0.292* | 0.330* | 0.470* | 0.297* | 0.346* | 0.260* | ||||||
| DirectFisheye-GS [32] | 180° | 0.201 | 0.206 | 0.210 | 0.190 | 0.215 | 0.223 | 0.219 | 0.259 | 0.272 | 0.202 | 0.231 | 0.178 | ||||||
| 3DGRT [24] | Full | 0.320 | 0.330 | 0.278 | 0.193 | 0.277 | 0.272 | 0.237 | 0.249 | 0.299 | 0.225 | 0.228 | 0.156 | ||||||
| 3DGRT + PPISP [24, 4] | Full | 0.272 | 0.279 | 0.245 | 0.188 | 0.246 | 0.254 | 0.187 | 0.221 | 0.253 | 0.191 | 0.206 | 0.140 | ||||||
| GOF [37] | Rectified | 0.203 | 0.222 | 0.215 | 0.182 | 0.214 | 0.235 | 0.198 | 0.220 | 0.211 | 0.176 | 0.208 | 0.234 | 0.202 | 0.245 | 0.344 | 0.196 | 0.240 | 0.159 |
| PGSR [2] | Rectified | 0.234 | 0.256 | 0.246 | 0.199 | 0.254 | 0.255 | 0.217 | 0.246 | 0.234 | 0.192 | 0.234 | 0.252 | 0.176 | 0.240 | 0.292 | 0.188 | 0.234 | 0.145 |
| SOF [26] | Rectified | 0.295 | 0.207 | 0.214 | 0.175 | 0.198 | 0.219 | 0.262 | 0.211 | 0.212 | 0.177 | 0.200 | 0.225 | 0.200 | 0.245 | 0.459 | 0.190 | 0.238 | 0.157 |
| MiLo [7] | Rectified | 0.226 | 0.237 | 0.238 | 0.210 | 0.236 | 0.256 | 0.222 | 0.236 | 0.231 | 0.211 | 0.228 | 0.258 | 0.255 | 0.334 | 0.324 | 0.284 | 0.272 | 0.216 |
| CoMe [27] | Rectified | 0.175 | 0.190 | 0.206 | 0.159 | 0.183 | 0.226 | 0.176 | 0.195 | 0.205 | 0.162 | 0.186 | 0.232 | 0.209 | 0.282 | 0.426 | 0.192 | 0.221 | 0.138 |
| GOFish (Ours) | Full | 0.157 | 0.176 | 0.180 | 0.145 | 0.180 | 0.190 | 0.171 | 0.191 | 0.187 | 0.166 | 0.188 | 0.208 | 0.179 | 0.196 | 0.257 | 0.149 | 0.198 | 0.140 |
| + Geometry Objective | Full | 0.156 | 0.174 | 0.180 | 0.145 | 0.179 | 0.190 | 0.170 | 0.189 | 0.186 | 0.166 | 0.188 | 0.208 | 0.184 | 0.203 | 0.270 | 0.154 | 0.203 | 0.143 |
Table 9. Per-scene rendering results on ScanNet++ [34] and Tanks & Temples [18]. The best, second best, and third best entries are highlighted. Protocols follow Appendix § 13.§ 2.
| Method | Kit. | Road | Bld. | Meet. | Bri. | Hall | 0a5c | 8d56 | bb87 | d415 | e8ea | fe17 | Barn | Cat. | Court. | Ign. | Meet. | Truck |
| Precision↑ | ||||||||||||||||||
| GOF [37] | 0.488 | 0.016 | 0.108 | 0.292 | 0.031 | 0.074 | 0.539 | 0.546 | 0.615 | 0.647 | 0.562 | 0.566 | 0.522 | 0.402 | 0.432 | 0.726 | 0.400 | 0.585 |
| PGSR [2] | 0.647 | 0.025 | 0.176 | 0.346 | 0.066 | 0.090 | 0.702 | 0.643 | 0.696 | 0.786 | 0.648 | 0.715 | 0.521 | 0.337 | 0.190 | 0.831 | 0.368 | 0.611 |
| SOF [26] | 0.473 | 0.006 | 0.103 | 0.307 | 0.031 | 0.060 | 0.561 | 0.555 | 0.702 | 0.675 | 0.608 | 0.622 | 0.586 | 0.393 | 0.506 | 0.682 | 0.399 | 0.553 |
| MiLo [7] | 0.532 | 0.012 | 0.137 | 0.307 | 0.027 | 0.065 | 0.705 | 0.590 | 0.619 | 0.706 | 0.644 | 0.646 | 0.551 | 0.368 | 0.413 | 0.774 | 0.426 | 0.602 |
| CoMe [27] | 0.508 | 0.016 | 0.148 | 0.352 | 0.039 | 0.077 | 0.639 | 0.562 | 0.716 | 0.667 | 0.680 | 0.648 | 0.558 | 0.446 | 0.543 | 0.801 | 0.491 | 0.604 |
| GOFish (Ours) | 0.478 | 0.022 | 0.142 | 0.420 | 0.074 | 0.064 | 0.662 | 0.579 | 0.662 | 0.636 | 0.670 | 0.615 | 0.363 | 0.298 | 0.389 | 0.452 | 0.371 | 0.461 |
| + Geometry Objective | 0.507 | 0.019 | 0.135 | 0.407 | 0.076 | 0.067 | 0.647 | 0.561 | 0.671 | 0.636 | 0.651 | 0.617 | 0.395 | 0.316 | 0.389 | 0.511 | 0.373 | 0.454 |
| Recall↑ | ||||||||||||||||||
| GOF [37] | 0.641 | 0.036 | 0.193 | 0.493 | 0.074 | 0.054 | 0.634 | 0.626 | 0.546 | 0.751 | 0.565 | 0.651 | 0.448 | 0.400 | 0.205 | 0.626 | 0.209 | 0.615 |
| PGSR [2] | 0.641 | 0.097 | 0.162 | 0.481 | 0.319 | 0.055 | 0.638 | 0.601 | 0.677 | 0.745 | 0.667 | 0.733 | 0.563 | 0.686 | 0.386 | 0.793 | 0.350 | 0.733 |
| SOF [26] | 0.647 | 0.011 | 0.128 | 0.513 | 0.093 | 0.049 | 0.630 | 0.651 | 0.631 | 0.774 | 0.615 | 0.700 | 0.485 | 0.409 | 0.198 | 0.671 | 0.215 | 0.554 |
| MiLo [7] | 0.713 | 0.029 | 0.201 | 0.521 | 0.063 | 0.039 | 0.754 | 0.655 | 0.629 | 0.779 | 0.664 | 0.724 | 0.392 | 0.352 | 0.238 | 0.615 | 0.204 | 0.574 |
| CoMe [27] | 0.709 | 0.019 | 0.218 | 0.600 | 0.170 | 0.060 | 0.749 | 0.705 | 0.669 | 0.801 | 0.736 | 0.719 | 0.507 | 0.489 | 0.245 | 0.763 | 0.301 | 0.665 |
| GOFish (Ours) | 0.728 | 0.041 | 0.244 | 0.619 | 0.283 | 0.071 | 0.877 | 0.743 | 0.694 | 0.870 | 0.781 | 0.804 | 0.447 | 0.376 | 0.290 | 0.627 | 0.264 | 0.527 |
| + Geometry Objective | 0.764 | 0.044 | 0.238 | 0.623 | 0.295 | 0.078 | 0.872 | 0.751 | 0.729 | 0.869 | 0.746 | 0.838 | 0.470 | 0.406 | 0.277 | 0.684 | 0.261 | 0.514 |
| F-score↑ | ||||||||||||||||||
| GOF [37] | 0.554 | 0.022 | 0.139 | 0.367 | 0.044 | 0.063 | 0.583 | 0.583 | 0.578 | 0.695 | 0.563 | 0.606 | 0.482 | 0.401 | 0.278 | 0.672 | 0.275 | 0.599 |
| PGSR [2] | 0.644 | 0.040 | 0.169 | 0.403 | 0.109 | 0.068 | 0.668 | 0.621 | 0.686 | 0.765 | 0.657 | 0.724 | 0.541 | 0.452 | 0.254 | 0.811 | 0.359 | 0.667 |
| SOF [26] | 0.547 | 0.008 | 0.114 | 0.384 | 0.046 | 0.054 | 0.593 | 0.599 | 0.664 | 0.721 | 0.611 | 0.659 | 0.530 | 0.401 | 0.285 | 0.676 | 0.280 | 0.553 |
| MiLo [7] | 0.609 | 0.017 | 0.163 | 0.387 | 0.038 | 0.049 | 0.729 | 0.620 | 0.624 | 0.741 | 0.654 | 0.683 | 0.458 | 0.360 | 0.302 | 0.685 | 0.276 | 0.588 |
| CoMe [27] | 0.592 | 0.018 | 0.176 | 0.444 | 0.064 | 0.068 | 0.689 | 0.625 | 0.692 | 0.728 | 0.707 | 0.682 | 0.531 | 0.467 | 0.338 | 0.781 | 0.373 | 0.633 |
| GOFish (Ours) | 0.577 | 0.029 | 0.180 | 0.501 | 0.117 | 0.067 | 0.754 | 0.651 | 0.677 | 0.735 | 0.721 | 0.697 | 0.401 | 0.333 | 0.332 | 0.525 | 0.308 | 0.492 |
| + Geometry Objective | 0.610 | 0.027 | 0.172 | 0.492 | 0.121 | 0.072 | 0.743 | 0.642 | 0.699 | 0.735 | 0.695 | 0.711 | 0.429 | 0.355 | 0.324 | 0.585 | 0.307 | 0.482 |
Table 10. Per-scene geometry results. The best, second best, and third best entries are highlighted. Protocols follow Appendix § 13.§ 2.

Figure 10. Additional qualitative rendering results on FIORD [8]. Metrics are per-scene.

Figure 11. Additional qualitative rendering and mesh results on FIORD [8]. Metrics are per-scene.

Figure 12. Additional qualitative rendering results on FullCircle [5]. Metrics are per-scene.

Figure 13. Qualitative rendering results on ScanNet++ [34]. Metrics are per-scene.

Figure 14. Qualitative rendering and mesh results on ScanNet++ [34]. Metrics are per-scene.
References
- [1]Pranav Asthana, Alex Hanson, Allen Tu, Tom Goldstein, Matthias Zwicker, and Amitabh Varshney. SplatSuRe: Selective super-resolution for multi-view consistent 3D Gaussian Splatting. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 11840–11849, 2026.arxiv.org/abs/2512.02172
- [2]Danpeng Chen, Hai Li, Weicai Ye, Yifan Wang, Weijian Xie, Shangjin Zhai, Nan Wang, Haomin Liu, Hujun Bao, and Guofeng Zhang. PGSR: Planar-based Gaussian Splatting for efficient and high-fidelity surface reconstruction. IEEE Transactions on Visualization and Computer Graphics, 31(9):6100–6111, 2025.DOI
- [3]Youming Deng, Wenqi Xian, Guandao Yang, Leonidas Guibas, Gordon Wetzstein, Steve Marschner, and Paul Debevec. Self-calibrating Gaussian Splatting for large field-of-view reconstruction. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), pages 25124–25133, 2025.arxiv.org/abs/2502.09563
- [4]Isaac Deutsch, Nicolas Moënne-Loccoz, Gavriel State, and Zan Gojcic. PPISP: Physically-plausible compensation and control of photometric variations in radiance field reconstruction. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 7289–7298, 2026.arxiv.org/abs/2601.18336
- [5]Yalda Foroutan, Ipek Oztas, Daniel Rebain, Aysegul Dundar, Kwang Moo Yi, Lily Goli, and Andrea Tagliasacchi. FullCircle: Effortless 3D reconstruction from casual 360° captures. arXiv preprint arXiv:2603.22572, 2026.arxiv.org/abs/2603.22572
- [6]Antoine Guédon and Vincent Lepetit. SuGaR: Surface-aligned Gaussian Splatting for efficient 3D mesh reconstruction and high-quality mesh rendering. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 5354–5363, 2024.arxiv.org/abs/2311.12775
- [7]Antoine Guédon, Diego Gomez, Nissim Maruani, Bingchen Gong, George Drettakis, and Maks Ovsjanikov. MILo: Mesh-in-the-loop Gaussian Splatting for detailed and efficient surface reconstruction. ACM Transactions on Graphics, 44(6):1–15, 2025.
- [8]Ulas Gunes, Matias Turkulainen, Xuquian Ren, Arno Solin, Juho Kannala, and Esa Rahtu. FIORD: a fisheye indoor-outdoor dataset with LIDAR ground truth for 3D scene reconstruction and benchmarking. In Proceedings of the Scandinavian Conference on Image Analysis (SCIA), pages 3–17, 2025. 1, 2, 4, 5, 6, 7, 8, 13, 14, 17, 18, 19, 21, 22arxiv.org/abs/2504.01732
- [9]Alex Hanson, Allen Tu, Geng Lin, Vasu Singla, Matthias Zwicker, and Tom Goldstein. Speedy-Splat: Fast 3D Gaussian Splatting with sparse pixels and sparse primitives. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 21537–21546, 2025. 8arxiv.org/abs/2412.00578
- [10]Alex Hanson, Allen Tu, Vasu Singla, Mayuka Jayawardhana, Matthias Zwicker, and Tom Goldstein. PUP 3D-GS: Principled uncertainty pruning for 3D Gaussian Splatting. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 5949–5958, 2025. 8arxiv.org/abs/2406.10219
- [11]Yun He, Kelin Yu, and Matthias Zwicker. SceneOrchestra: Efficient agentic 3D scene synthesis via full tool-call trajectory generation. In Proceedings of the European Conference on Computer Vision (ECCV), pages 521–538, 2026. 8arxiv.org/abs/2604.19907
- [12]Jan Held, Sanghyun Son, Renaud Vandeghen, Daniel Rebain, Matheus Gadelha, Yi Zhou, Anthony Cioppa, Ming C. Lin, Marc Van Droogenbroeck, and Andrea Tagliasacchi. MeshSplatting: Differentiable rendering with opaque meshes. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 7320–7329, 2026. 2arxiv.org/abs/2512.06818
- [13]Binbin Huang, Zehao Yu, Anpei Chen, Andreas Geiger, and Shenghua Gao. 2D Gaussian Splatting for geometrically accurate radiance fields. In Proceedings of the ACM SIGGRAPH 2024 Conference Papers, pages 1–11, 2024. 2DOI
- [14]Zixun Huang, Cho-Ying Wu, Yuliang Guo, Xinyu Huang, and Liu Ren. 3DGER: 3D Gaussian rendering made exact and efficient for generic cameras. In International Conference on Learning Representations (ICLR), 2026. 1, 2, 4, 16, 17, 19, 20arxiv.org/abs/2505.24053
- [15]Simon J. Julier and Jeffrey K. Uhlmann. New extension of the Kalman filter to nonlinear systems. In Signal Processing, Sensor Fusion, and Target Recognition VI, pages 182–193. SPIE, 1997. 2DOI
- [16]Sagi Katz, Ayellet Tal, and Ronen Basri. Direct visibility of point sets. ACM Transactions on Graphics, 26(3):24, 2007. 15
- [17]Bernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, and George Drettakis. 3D Gaussian Splatting for real-time radiance field rendering. ACM Transactions on Graphics, 42(4):1–14, 2023. 1, 2, 4, 11, 12, 16, 17arxiv.org/abs/2308.04079
- [18]Arno Knapitsch, Jaesik Park, Qian-Yi Zhou, and Vladlen Koltun. Tanks and Temples: Benchmarking large-scale scene reconstruction. ACM Transactions on Graphics, 36(4):1–13, 2017. 2, 5, 7, 13, 15, 16, 17, 18, 20, 21, 26
- [19]Suyoung Lee, Jaeyoung Chung, Jaeyoo Huh, and Kyoung Mu Lee. OGDS: 3D scene reconstruction from omnidirectional images with 3D Gaussian Splattings. In Advances in Neural Information Processing Systems (NeurIPS), pages 57050–57075, 2024. 2arxiv.org/abs/2410.20686
- [20]Longwei Li, Xuhui Huang, Sai-Kit Yeung, and Hui Cheng. OmniGS: Fast radiance field reconstruction using omnidirectional Gaussian Splatting. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), pages 2260–2268, 2025. 2 Yiyi Liao, Jun Xie, and Andreas Geiger. KITTI-360: A novel dataset and benchmarks for urban scene understanding in 2D and 3D. IEEE Transactions on Pattern Analysis and Machine Intelligence, 45(3):3292–3310, 2023. 1
- [22]Zimu Liao, Siyan Chen, Rong Fu, Yi Wang, Zhongling Su, Hao Luo, Li Ma, Lanning Xu, Bo Dai, Hengjie Li, Zhilin Pei, and Xingcheng Zhang. Fisheye-GS: Lightweight and extensible Gaussian Splatting module for fisheye cameras. arXiv preprint arXiv:2409.04751, 2024. 1, 2, 4, 15, 16, 17, 19, 20arxiv.org/abs/2409.04751
- [23]Jiaqi Lin, Zihao Li, Xiao Tang, Jianzhuang Liu, Shiyong Liu, Jiayue Liu, Yangdi Lu, Xiaofei Wu, Songcen Xu, Youliang Yan, and Wenming Yang. VastGaussian: Vast 3D Gaussians for large scene reconstruction. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 5166–5175, 2024. 2, 4arxiv.org/abs/2402.17427
- [24]Nicolas Moenne-Loccoz, Ashkan Mirzaei, OPerel, Ricardo de Lutio, Janick Martinez Esturo, Gavriel State, Sanja Fidler, Nicholas Sharp, and Zan Gojcic. 3D Gaussian ray tracing: Fast tracing of particle scenes. ACM Transactions on Graphics, 43(6):1–19, 2024. 1, 2, 4, 7, 8, 15, 16, 17, 19, 20
- [25]Lukas Radl, Michael Steiner, Mathias Parger, Alexander Weinrauch, Bernhard Kerbl, and Markus Steinberger. StopThePop: Sorted Gaussian Splatting for view-consistent real-time rendering. ACM Transactions on Graphics, 43(4):1–17, 2024. 3, 11arxiv.org/abs/2402.00525
- [26]Lukas Radl, Felix Windisch, Thomas Deixelberger, Jozef Hladky, Michael Steiner, Dieter Schmalstieg, and Markus Steinberger. SOF: Sorted opacity fields for fast unbounded surface reconstruction. In Proceedings of the SIGGRAPH Asia 2025 Conference Papers, pages 1–11, 2025. 1, 2, 4, 5, 6, 8, 11, 12, 15, 16, 17, 18, 19, 20, 21arxiv.org/abs/2506.19139
- [27]Lukas Radl, Felix Windisch, Andreas Kurz, Thomas Köhler, Michael Steiner, and Markus Steinberger. Confidence-based mesh extraction from 3D Gaussians. In Proceedings of the European Conference on Computer Vision (ECCV), pages 307–325, 2026. 1, 2, 5, 6, 12, 15, 16, 17, 19, 20, 21arxiv.org/abs/2603.24725
- [28]Gabriel Taubin. A signal processing approach to fair surface design. In Proceedings of the 22nd Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH), pages 351–358, 1995. 8
- [29]Allen Tu, Haiyang Ying, Alex Hanson, Yonghan Lee, Tom Goldstein, and Matthias Zwicker. SpeedyDe3DGS: Speedy deformable 3D Gaussian Splatting with temporal pruning and motion grouping. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 26083–26093, 2026. 8arxiv.org/abs/2506.07917
- [30]Matias Turkulainen, Xuqian Ren, Iaroslav Melekhov, Otto Seiskari, Esa Rahtu, and Juho Kannala. DN-Splatter: Depth and normal priors for Gaussian Splatting and meshing. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), pages 2421–2431, 2025. 8arxiv.org/abs/2403.17822
- [31]Qi Wu, Janick Martinez Esturo, Ashkan Mirzaei, Nicolas Moënne-Loccoz, and Zan Gojcic. 3DGUT: Enabling distorted cameras and secondary rays in Gaussian Splatting. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 26036–26046, 2025. 1, 2, 3, 4, 5, 7, 8, 11, 15, 16, 17, 19, 20arxiv.org/abs/2412.12507
- [32]Zhengxian Yang, Fei Xie, Xutao Xue, Rui Zhang, Taicheng Huang, Yang Liu, Mengqi Ji, and Tao Yu. DirectFisheye-GS: Enabling native fisheye input in Gaussian Splatting with cross-view joint optimization. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 4942–4952, 2026. 1, 2, 4, 15, 16, 17, 19, 20arxiv.org/abs/2604.00648
- [33]Zongxin Ye, Wenyu Li, Sidun Liu, Peng Qiao, and Yong Dou. AbsGS: Recovering fine details in 3D Gaussian Splatting. In Proceedings of the 32nd ACM International Conference on Multimédia (MM), pages 1053–1061, 2024. 13DOI
- [34]Chandan Yeshwanth, Yueh-Cheng Liu, Matthias Nießner, and Angela Dai. ScanNet++: A high-fidelity dataset of 3D indoor scenes. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), pages 12–22, 2023. 2, 4, 5, 6, 13, 15, 16, 17, 18, 20, 21, 24, 25
- [35]Senthil Yogamani, Ciarán Hughes, Jonathan Horgan, Ganesh Sistu, Padraig Varley, Derek O’Dea, Michal Uricar, Stefan Milz, Martin Simon, Karl Amende, et al. WoodScape: A multi-task, multi-camera fisheye dataset for autonomous driving. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), pages 9308–9318, 2019. 1arxiv.org/abs/1905.01489
- [36]Zehao Yu, Anpei Chen, Binbin Huang, Torsten Sattler, and Andreas Geiger. Mip-Splatting: Alias-free 3D Gaussian Splatting. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 19447–19456, 2024. 2, 3, 12arxiv.org/abs/2311.16493
- [37]Zehao Yu, Torsten Sattler, and Andreas Geiger. Gaussian opacity fields: Efficient adaptive surface reconstruction in unbounded scenes. ACM Transactions on Graphics, 43(6):1–13, 2024. 1, 2, 4, 5, 8, 12, 13, 15, 16, 17, 18, 19, 20, 21arxiv.org/abs/2404.10772
- [38]Richard Zhang, Phillip Isola, Alexei A. Efros, Eli Shechtman, and Oliver Wang. The unreasonable effectiveness of deep features as a perceptual metric. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 586–595, 2018. 15arxiv.org/abs/1801.03924
- [39]Ziyu Zhang, Binbin Huang, Hanqing Jiang, Liyang Zhou, Xiaojun Xiang, and Shuhan Shen. Quadratic Gaussian Splatting: High quality surface reconstruction with second-order geometric primitives. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), pages 28260–28270, 2025. 2arxiv.org/abs/2411.16392
- [40]Matthias Zwicker, Hanspeter Pfister, Jeroen van Baar, and Markus Gross. EWA splatting. IEEE Transactions on Visualization and Computer Graphics, 8(3):223–238, 2002. 2DOI
