betaFeedback

WorksPhysics and Astronomy

Improving On-board Shape Models Using Sun Sensors and Implicit Representations

Abstract

We propose an original, end-to-end approach to generate and refine the onboard 3D shape model of irregular small bodies, such as asteroids, using only low-cost Sun sensor eclipse data and coarse a priori knowledge, tailored for resource-constrained missions like CubeSats. Leveraging EclipseNets, a differentiable neural model of eclipse boundaries, our pipeline first refines 2D silhouettes by learning from real-time entry and exit events during spacecraft orbits, avoiding the limitations of traditional imaging or lidar in bandwidth-starved environments. These silhouettes then supervise a compact neural signed-distance field with periodic activations, enabling incremental updates to a high-fidelity implicit geometry representation capable of capturing fine-scale features and concavities. In simulations of the body Eros under realistic orbital dynamics, the method increases silhouette IoU from 0.70 to 0.87 and produces coherent 3D reconstructions, suggesting our approach could find a place in future autonomous architectures for small-body exploration.

Introduction

Small bodies such as asteroids and comets, remnants of the early Solar System, preserve pristine materials and yield critical insights into the chemical and physical processes driving its formation [1, 2]. Beyond their scientific value, small bodies have also drawn attention for the risk they pose as impact hazards to Earth [3]. Consequently, increasing attention has been devoted to their exploration through spacecraft missions, including sample-return campaigns and technology demonstrations [4, 5, 6, 7, 8]. As more exploration missions emerge, accurately understanding the dynamical environment around these bodies becomes increasingly important, particularly because of the challenges posed by their irregular shapes, weak gravitational forces, and complex physical characteristics [9].

Sizes, materials, and properties of these bodies vary so wildly, few generalizations can be made across different targets. While ground-based techniques like photometry and radar provide valuable preliminary constraints on size, shape, and albedo [10, 11], detailed morphological characterization ultimately requires in-situ observations collected by an orbiting spacecraft [12].

The irregular geometry of small bodies strongly affects their local dynamical environment. Shape determines the gravitational field, constrains internal mass distribution, and influences orbital stability and spacecraft maneuvering. It also affects illumination and eclipse conditions, which modulate solar radiation pressure, a dominant perturbation in the weak-gravity regime of small bodies. Accurate shape estimation is therefore fundamental for mission design, guidance, navigation, control, and operational safety, as well as for optimizing scientific observation strategies.

Currently, high-fidelity shape models are generated by combining multiple images or lidar scans, processed using photogrammetry, stereophotoclinometry [13, 14], or shape-from-silhouette techniques [15]. While producing highly detailed 3D reconstructions, these methods are computationally intensive and depend on continuous ground-based processing. This workflow limits real-time adaptability, which is increasingly problematic given the rise of small, low-cost satellites with constrained onboard resources and communication bandwidth [16, 17].

To address these challenges, autonomous onboard shape reconstruction has become an active area of research [18, 19]. Machine learning approaches, in particular, offer the potential to efficiently generate and refine 3D models from sparse or partial observations [15, 20, 21]. Among these, occupancy networks and other implicit surface representations are especially promising for small-body missions, as they can represent complex geometries and be updated incrementally with new measurements. However, existing learning-based methods typically require RGB imagery or depth data and assume sufficient downlink capacity for ground processing. No prior work has demonstrated end-to-end onboard shape reconstruction using only eclipse events from Sun sensors, a capability that could reveal useful for low-cost missions.

In this work, we leverage EclipseNets [22, 23], pretrained on rough a priori knowledge of the asteroid’s shape, to bootstrap the reconstruction process. As the spacecraft orbits the target and collects additional silhouette information (derived, for instance, from points of entrance and exit in eclipse regions detected with a simple Sun sensor), this data is used to iteratively train an occupancy network. The resulting workflow produces a continuously improving 3D representation of the asteroid, enabling real-time, onboard shape reconstruction. This approach is particularly suited to the challenges of modern small-body exploration, supporting autonomous navigation, hazard assessment, and efficient scientific operations on missions with limited computational and communication resources.

The proposed pipeline operates in three stages. First, a weak EclipseNet model is trained offline from coarse a priori asteroid knowledge to approximate eclipse boundaries. During the mission, Sun sensor eclipse entry and exit events are collected and used to refine this model in situ. The refined EclipseNet generates silhouettes for arbitrary viewpoints, which are then converted into orthographic rays and used to train a neural signed-distance field representation of the asteroid. This final representation produces a continuously improving 3D model suitable for onboard navigation and scientific analysis.

Methodology

Silhouette Generation from a Priori Knowledge

The first stage of our approach generates 2D silhouettes of the asteroid based on a priori knowledge of the asteroid shape. We leverage EclipseNets, a neural implicit model trained to predict the occurrence of solar eclipses as a function of spacecraft position and Sun direction. Given the spacecraft position r\mathbf{r} and Sun unit vector s^\hat{\mathbf{s}}, EclipseNet, a neural network with learnable parameters θ\theta, outputs a scalar eclipse function eθ(r,s^)e_{\theta}(\mathbf{r}, \hat{\mathbf{s}}): a signed distance function (SDF) defined as negative inside the shadow, positive outside, and zero along the silhouette boundary. EclipseNet employs SIREN periodic activation functions [24], enabling it to capture high-frequency details of complex asteroid contours. The model is initially trained using coarse prior knowledge of the asteroid’s shape before the spacecraft visit, following the approach detailed in previous work [22]. The EclipseNet used in this work comprises three hidden layers of width 32 with sinusoidal activation functions and contains 2,369 trainable parameters, requiring approximately 9.5 kB of FP32 parameter memory.

In-Situ Model Refinement

The second stage focuses on iterative onboard refinement of the asteroid’s 3D shape using eclipse events collected during the mission. Instead of relying on high-resolution imaging or lidar, we exploit precise entry and exit points of the eclipse, derived from spacecraft position and Sun direction. These events are collected via a Sun sensor instead of a traditional camera and serve as ground truth data for continuous training and refinement.

To generate realistic data from a Sun sensor, we simulate multiple orbital trajectories with randomized initial conditions. Orbital radii are varied between 1.2 and 4 times the semi-major axis of the Eros ellipsoid (≈32km\approx32\mathrm{km}), while inclinations are uniformly sampled from 0∘0^\circ to 90∘90^\circ. Our experiments simulate 25 virtual satellites over 100-day orbits, yielding 1.4 million eclipse events, roughly comparable to the 2.1 million samples per epoch used in offline EclipseNet training and thus enabling a good comparison of refinement efficacy. Although these orbits are not optimized and no control is applied, the resulting eclipse events serve to demonstrate the potential of our method under random conditions.

The spacecraft dynamics are modeled in a body-centered frame as [23]:

r˙=v,v˙=−G∑j=0Nmj∥r−rj∥3(r−rj)−2ω×v−ω×(ω×r)−ην(r)s^(t),(1)\dot{\mathbf{r}} = \mathbf{v}, \\ \dot{\mathbf{v}} = -G \sum_{j=0}^{N} \frac{m_j}{\lVert\mathbf{r} - \mathbf{r}_j \rVert^3}(\mathbf{r} - \mathbf{r}_j) - 2\boldsymbol{\omega} \times\mathbf{v} - \boldsymbol{\omega} \times(\boldsymbol{\omega} \times\mathbf{r}) - \eta\nu(\mathbf{r}) \hat{\mathbf{s}}(t), \tag*{(1)}

where r\mathbf{r} and v\mathbf{v} are the spacecraft position and velocity, mjm_j and rj\mathbf{r}_j represent mascon masses and positions modeling the asteroid’s irregular gravity field, ω\boldsymbol{\omega} is the asteroid’s angular velocity, and η\eta quantifies acceleration due to solar radiation pressure (10−3 m/s210^{-3}\ \mathrm{m}/\mathrm{s}^2 outside eclipse). The eclipse factor ν(r)\nu(\mathbf{r}) is zero in shadow and one otherwise. Since the eclipse factor is smooth and differentiable via EclipseNet, a Taylor integrator can accurately track eclipse transitions [23].

Neural Implicit Representation of 3D Shapes

We approach the 3D reconstruction problem using a neural network with a SIREN-SDF at its core, bypassing the limitations of traditional view-based algorithms. Methods such as visual hulls [25], Gaussian splatting, and NeRFs [26, 27] are unsuitable for purely binary silhouettes, as they often fail to capture concavities, overestimate volume, or require RGB and depth information. Our implicit neural representation of the investigated body is given by the following expression:

ϕθ′(x)=∥x∥−r0⏟sphere SDF init+fθ′(x)⏟SIREN residual(2)\phi_{\theta'}(\mathbf{x}) = \underbrace{\lVert\mathbf{x} \rVert- r_0}_{\text{sphere SDF init}} + \underbrace{f_{\theta'}(\mathbf{x})}_{\text{SIREN residual}} \tag*{(2)}

Equation [2] evaluates whether a given point is inside or outside the body, with positive values of ϕθ′(x)\phi_{\theta'}(\mathbf{x}) corresponding to being outside the body, and negative ones to being inside. The sphere prior provides an initial topology, while the residual is trainable (with parameters θ′\theta') to deform this macro-shape. The SIREN activation enables the neural network to model high frequency details. To convert this expression to occupancy, we use the following sigmoid expression:

oθ′(x)=σ(−αϕθ′(x))(3)o_{\theta'}(x) = \sigma(-\alpha\phi_{\theta'}(x)) \tag*{(3)}

The sigmoid function σ\sigma converts a given output of the SIREN-SDF to a value bounded by the range [0,1][0,1], where α\alpha controls the sharpness of the transition. After applying this expression, an output of 0 (1) denotes high confidence of this point being outside (inside) the body.

During training, we generate a number of views (represented by binary silhouettes of the body) using the earlier stage’s EclipseNet. Training is performed for 1,000 epochs. At each optimization step, eight silhouettes (or views) are sampled, with 384 rays selected per silhouette and 64 points evaluated along each ray. This corresponds to 3,072 rays and 196,608 ray-sampled SDF evaluations per optimization step. The SIREN-SDF used in this work comprises six hidden layers of width 192 and contains 186,241 trainable parameters, requiring approximately 745 kB of FP32 parameter memory.

For each view, a random set of points on this 2D binary silhouette is converted into a set of (parallel) rays. Such a ray (r(t)=o+tdr(t) = o + td) is clipped by training bounding box to produce (tnear,tfar)(t_{near},t_{far}). The binary silhouette can be considered as an orthographic camera, with each pixel in the silhouette being equivalent to a parallel camera ray casting towards the asteroid.

This method of sample conversion is illustrated in Figure 1. In this figure, (a) gives a schematic representation of the target body as generated by the SIREN-SDF. + denotes where the ray r(t)r(t) intersects the body. (b) shows a sampled silhouette as generated by the refined eclipseNet model. fgfg and bgbg denote the foreground (silhouette) and background (empty space) of the silhouette, with X showing the sampled point from which the ray is converted.

Schematic representation of the point to orthographic ray conversion

Figure 1. Schematic representation of the point to orthographic ray conversion, (a) shows the target body as generated by the SIREN-SDF, (b) shows a silhouette generated by the refined eclipseNet.

As the 2D silhouettes from which we are training do not contain depth information, we must collapse individual point oθ′(x)o_{\theta'}(x) evaluations down to a single 2D prediction (on the plane of the view) by calculating Equation (4),

Phit=max⁡ioi(4)P_{hit} = \max_i o_i \tag*{(4)}

Results

Contour Reconstruction Accuracy

First, we evaluate the 2D contour accuracy using the following three metrics: Intersection over Union (IoU) quantifies the spatial overlap between the predicted silhouette and the ground truth, where a value of 1.0 indicates perfect alignment. The XOR error measures the area of disagreement (sum of false positives/negatives). Finally, the Fill metric denotes the proportion of predicted foreground pixels. The results are shown in Table 1, where we can see that from weak to refined there is a strong jump in both IoU and fill.

ModelEvents SeenFillIoUXOR
Ground TruthN/A0.0629811.0000000.000000
Refined13762560.0623320.8675140.007698
Weak00.0438610.6956170.019119

Table 1. Metric comparison summary between the weak baseline, the refined model, and ground truth.

The final loss is then computed by comparing the PhitP_{hit}, produced by evaluating multiple points along the chosen ray, and the ray’s associated 0 (outside) or 1 (inside).

To summarize, EclipseNets is used to produce 2D views, we obtain rays from points in these views. Then these rays are evaluated using the SIREN-SDF, the loss is then evaluated and we train to reduce the mismatch between this evaluated value and the original 2D view’s value on that point. Lastly, the training also includes scheduled curvature regularization to encourage smooth global geometry and stable normals. This is scheduled to start halfway through the training, as regularization that is too eager will prevent the model from learning the macro-shape and will limit its extremities too much. During inference the threshold of oθ′(x)o_{\theta'}(x) at which we consider a space occupied is swept for using the resulting best "Intersection over Union" (IoU) between [0,1][0,1].

This matches what can be visually observed in Figure 3. The first column provides the ground truth silhouettes (also shown in the other columns as the black outline). The second column displays the predictions from the weakly trained EclipseNet upon initial deployment, where structural underfilling is visible. The third column demonstrates the output of the refined model after the network has processed the additional in-orbit samples. The additional in-orbit samples alleviate the initial overfilling, closely aligning the model with the ground truth. We can also see that though the model’s fitting is significantly improved, on the view of azimuth=180∘azimuth = 180^\circ, elevation=45∘elevation = 45^\circ, the boundary doesn’t precisely match and is the least improved of all views shown. This is possibly related to the number of of samples (the in-situ samples are slightly over 1 million, and one training epoch of the offline training is 2.1 million samples), or to the distribution of samples (the angles contained in the eclipse events).

Ground truth, weak representation, and refined model

Figure 3. Plot of the ground truth (first column), the initial representation of the target body upon Earth departure (second column) and the refined model (third column).

3D Model Reconstruction Accuracy

In Figure 2, the visual evolution of the volume represented by the occupancy network across the training epochs is shown (ending at training epoch 1000). The network initially diverges from the sphere prior before rapidly converging

Training process of the occupancy network based on EclipseNet silhouettes

Figure 2. The process of training the occupancy network based on the provided EclipseNet silhouettes. Curvature regularization starts halfway through the training process. Groundtruth shapes are shown in the first column.

ing to a plausible target shape, with subsequent curvature regularization removing anomalous occupancies.

The complete reconstructed shape is shown as a polygonal 3D model in Figure 4 from several angles. This model can then be used for navigation, asteroid landing, or geodesy on-board. The code and data to reproduce the results in this paper is available on GitHub [28].

Orthographic reconstructed model from four angles

Figure 4. 3D render of the final reconstructed shape, based on the trained occupancy network. Four angles (a, b, c and d) are presented.

Discussion

This work presents a pipeline for in-situ reconstruction of asteroid morphology using only Sun sensors and neural implicit representations. The results demonstrate that meaningful geometric information can be extracted from sparse event-based measurements and used to iteratively refine an onboard model of the target body. Starting from a weak prior representation encoded in an EclipseNet, the incorporation of in-orbit eclipse entry and exit events significantly improves silhouette reconstruction accuracy. These refined silhouettes can subsequently be used to train an implicit signed distance representation, producing a plausible three-dimensional model of the asteroid.

The quantitative results indicate that the refinement stage substantially improves silhouette agreement with the ground truth. Visually, the refined silhouettes capture the morphology of the target body and reduce the systematic underfilling present in the weak baseline model.

Although the reconstruction problem is inherently ill-posed when relying solely on binary silhouettes, the use of a sphere prior combined with a SIREN residual model to capture higher-frequency geometric features seem to be able to infer a smooth, coherent and globally consistent surface that satisfies the observed silhouettes constraints. The resulting shape reconstruction preserves silhouette consistency across viewpoints while producing a physically plausible volume.

From an operational perspective, the proposed pipeline is particularly relevant for resource-constrained spacecraft missions. As this pipeline bypasses the specialized imaging hardware and extensive ground processing required by traditional techniques, which may be incompatible with small spacecraft platforms. In contrast, the method presented here relies entirely on Sun sensor measurements, which are among the most common and lightweight sensors available on spacecraft.

Despite these promising results, several limitations must be acknowledged. First, reconstruction quality depends heavily on the distribution of observed eclipse events, dictated by spacecraft trajectory and illumination geometry. Future work should investigate ad-hoc orbit design strategies to maximize silhouette diversity. Second, the pipeline assumes the coarse prior shape initializing EclipseNet approximates the true geometry. Incorporating uncertainty-aware priors or adaptive regularization strategies may improve robustness against poor initial estimates. Sun-sensor noise’s impact on the in-situ training has also not yet been taken into account. Finally, further qualitative assessment of the reconstructed 3D Shape of its geometric accuracy in various metrics also requires further development.

Overall, the results demonstrate that eclipse-based observations combined with neural implicit representations provide a viable pathway for autonomous small-body morphology reconstruction. By leveraging simple sensors and onboard learning, spacecraft could incrementally refine their understanding of the target body’s geometry during operations. This capability has potential applications in autonomous navigation for future asteroid exploration missions.

Acknowledgments

Zacharia A. Rudge acknowledges funding from the European Space Agency’s Open Space Innovation Platform (contract number 4000140774). Dominik Dold was supported by the Horizon Europe’s Marie Skłodowska-Curie Actions (MSCA) Project 101103062 (BASE).

References

  1. [1]Safronov, V. S. (S. Evolution of the protoplanetary cloud and formation of the earth and the planets eng; rus. ISBN: 0706512251 (Israel Program for Scientific Translations, Jerusalem, 1972).
  2. [2]Yeomans, D. Small bodies of the solar system. Nature 404, 829–832 (2000).pubmed.ncbi.nlm.nih.gov/10786778
  3. [3]Cheng, A. F. et al. AIDA DART asteroid deflection test: Planetary defense and science objectives. Planetary and Space Science 157, 104–115 (2018).DOI
  4. [4]Fujiwara, A. et al. The rubble-pile asteroid Itokawa as observed by Hayabusa. Science 312, 1330–1334 (2006).pubmed.ncbi.nlm.nih.gov/16741107
  5. [5]Yada, T. et al. Preliminary analysis of the Hayabusa2 samples returned from C-type asteroid Ryugu. Nature Astronomy 6, 214–220 (2022).DOI
  6. [6]Snodgrass, C. et al. The 67P/Churyumov–Gerasimenko observation campaign in support of the Rosetta mission. Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences 375 (2017).DOI
  7. [7]Prockter, L. et al. The NEAR shoemaker mission to asteroid 433 eros. Acta Astronautica 51, 491–500 (2002).DOI
  8. [8]Lauretta, D. et al. OSIRIS-REx: sample return from asteroid (101955) Bennu. Space Science Reviews 212, 925–984 (2017).DOI
  9. [9]Scheeres, D. J. Orbit mechanics about asteroids and comets. journal of Guidance, Control, and Dynamics 35, 987–997 (2012).DOI
  10. [10]Harris, A. W. & Lupishko, D. F. Photometric lightcurve observations and reduction techniques. Asteroids II, 39–53 (1989).
  11. [11]Millis, R. & Dunham, D. Precise measurement of asteroid sizes and shapes from occultations. Asteroids II, 148–170 (1989).
  12. [12]Scheeres, D. et al. Navigation for low-cost missions to small solar-system bodies. Acta Astronautica 35, 211–220 (1995).DOI
  13. [13]Gaskell, R. et al. Stereophotoclinometry on the OSIRIS-REx mission: mathematics and methods. The Planetary Science Journal 4, 63 (2023).DOI
  14. [14]Terik Daly, R. et al. Shape modeling of dimorphos for the double asteroid redirection test (DART). The Planetary Science Journal 3, 207 (2022).DOI
  15. [15]Bandyopadhyay, S., Nesnas, I., Bhaskaran, S., Hockman, B. & Morrell, B. Silhouette-based 3d shape reconstruction of a small body from a spacecraft in 2019 IEEE Aerospace Conference (2019), 1–13.DOI
  16. [16]Starek, J. A., Ackmese, B., Nesnas, I. A. & Pavone, M. In Advances in control system technology for aerospace applications 1–48 (Springer, 2015).
  17. [17]Nesnas, I. A. et al. Autonomous exploration of small bodies toward greater autonomy for deep space missions. Frontiers in Robotics and AI 8, 650885 (2021).DOI
  18. [18]Dennison, K., Stacey, N. & D’Amico, S. Autonomous asteroid characterization through nanosatellite swarming. IEEE Transactions on Aerospace and Electronic Systems 59, 4604–4624 (2023).
  19. [19]Villa, J., McMahon, J., Hockman, B. & Nesnas, I. Autonomous navigation and deep shape reconstruction using stereophotogrammetry at small celestial bodies in Proceedings of the 44th Annual American Astronautical Society Guidance, Navigation, and Control Conference, 2022 (2022), 1325–1347.
  20. [20]Chen, S., Wu, B., Li, H., Li, Z. & Liu, Y. Asteroid-NeRF: A deep-learning method for 3D surface reconstruction of asteroids. Astronomy & Astrophysics 687, A278 (2024).DOI
  21. [21]Tang, Y., Ying, C., Xia, C., Zhang, X. & Jiang, X. Asteroid shape inversion with light curves using deep learning. Astronomy & Astrophysics 696, A55 (2025).DOI
  22. [22]Acciarini, G., Izzo, D. & Biscani, F. EclipseNETs: Learning irregular small celestial body silhouettes. Acta Astronautica (2025).arxiv.org/abs/2504.04455
  23. [23]Biscani, F. & Izzo, D. Reliable event detection for Taylor methods in astrodynamics. Monthly Notices of the Royal Astronomical Society 513, 4833–4844 (2022).DOI
  24. [24]Sitzmann, V., Martel, J., Bergman, A., Lindell, D. & Wetzstein, G. Implicit neural representations with periodic activation functions. Advances in neural information processing systems 33, 7462–7473 (2020).arxiv.org/abs/2006.09661
  25. [25]Laurentini, A. The Visual Hull Concept for Silhouette-Based Image Understanding. IEEE Trans. Pattern Anal. Mach. Intell. 16, 150–162. https://api.semanticscholar.org/CorpusID:27660563 (1994).DOI
  26. [26]Kerbl, B., Kopanas, G., Leimkühle, T. & Drettakis, G. 3D Gaussian Splatting for Real-Time Radiance Field Rendering. ACM Transactions on Graphics 42. https://repo-sam.inria.fr/fungraph/3d-gaussian-splatting/ (July 2023).arxiv.org/abs/2308.04079
  27. [27]Mildenhall, B. et al. NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis in ECCV (2020).arxiv.org/abs/2003.08934
  28. [28]Asteroid Occupancy GitHub Repository accessed Sept. 2026. https://github.com/HeatPhoenix/asteroid-occupancy.

Paper details

vlnc:W_99qfff6n
Version
v1 · latest
Published
Fresh — added to the Hub within the last 30 days
Added
License
CC BY 4.0
Usage

views · 10

downloads · 0

A view counts once per browser per day, a download each time the PDF is requested.

  • Physics and Astronomy

Not recorded for this paper

View statement
Looking for related papers…
Contents