WorksMathematics
On the discretization of the object space in inverse problems with application to cryo-electron microscopy
Abstract
In many inverse problems, the aim is to recover a probability distribution on a latent (or object state) space from indirect, noisy observations. When the observations can be modelled as noisy samples from the mixing latent distribution, the recovery problem is a deconvolution problem on the space of probability measures. A common strategy is to fix a finite set of candidate points and estimate a weight for each, turning the problem into a finite-dimensional concave maximum likelihood problem on the simplex. We study the combined effect of this discretization and of the noise in the context of cryo-electron microscopy (cryo-EM), where the candidate points are biomolecular conformations and the weights describe the relative frequency of each conformation. Our results pertain to both statistical and algorithmic aspects of the estimator. We analyze the weight-recovery problem in which the candidate states and their likelihoods are known. A nearby pair of candidates forces a near-null direction. More generally, the grid and the noise level impose a uniform lower bound on the achievable Kullback–Leibler divergence between observation densities, even with infinite data. The finite-grid estimator is asymptotically normal when its population target is in the interior of the simplex; at a boundary target, its limit is a cone-projected Gaussian. Finally, the exact proximal form of Expectation–Maximization leads to a global high-noise comparison between an early iterate and a KL-penalized likelihood, without a basin assumption or a linearization of the recursion. Tests on synthetic images of the Hsp90 molecule illustrate the theoretical findings and translate them into practical guidelines for interpreting reweighted ensembles.
Introduction
An objective of science is describing accurately how and why certain quantities or objects fluctuate. The prototypical example of interest for this paper is understanding different conformations of a molecule, i.e., the different states in which that molecule can be found in the nature and their probabilities. There usually is a continuum of such states and, if one had direct observations, the problem would be a distribution-estimation problem. We call this distribution the ensemble distribution; the standard usage in the mixture-model and empirical-Bayes literature would be mixture distribution, and the space on which it lives the latent space. For our purposes, the space is rather called the conformational space as latent space bears a different meaning in the cryo-EM community.
In the setting of interest, one does not have direct observations from the conformational space as data is usually stained by noise or only indirectly observed due to the imaging projection. Simplifying a bit, each observation is a noisy sample from the mixing distribution, with Gaussian noise of known variance. The density of the observations is therefore the convolution of the mixing distribution with a Gaussian kernel, and recovering the mixing distribution from the observations is a deconvolution problem on the space of probability measures. As no parametric form for the mixing distribution usually exists, various approaches (see Section 3.4 below for a review) approximate it by a discrete distribution, i.e., a weighted sum of Dirac masses supported on a finite set of candidate points, as done by Tang et al. (2023) [43] in cryo-EM to cite but one. The weights are then estimated from the data, usually by maximum likelihood. The candidate points can come from domain knowledge, from numerical simulations such as molecular dynamics (MD), or from a regular grid. In Section 3.4, we further discuss the importance of discretization in a variety of schemes.
This paper is about the combined effect of the Gaussian noise and of the discretization step. Once the support is fixed, the maximum likelihood problem becomes a finite-dimensional concave optimization on the simplex of weights, which is computationally convenient.
We argue that the noise level and the geometry of the candidate points interact in ways a practitioner should know about. How many candidate points there are, how far apart they sit, and how well they cover the conformational space, together with the noise level , control three things at once: the conditioning of the optimization problem, the best KL approximation of the observation density that can be achieved even with infinite data, and the way reconstructed weights relate to the empirical frequencies (“populations” in the cryo-EM literature) one would estimate from the data. In a cryo-EM context this means, concretely, that two candidate structures which are close compared to the noise level can exchange weight almost freely without changing the likelihood, that an MD run which fails to explore a region of the landscape produces a population observation-density KL floor that more data cannot lower, and that large reconstructed weights should not be read directly as large conformational probabilities. Quantifying these statements is the goal of the paper.
More precisely, we explain
why a nearby pair of candidates forces a nearly flat direction for the optimization, at a scale controlled by their spacing relative to the noise;
why the candidate points (obtained for instance from MD), together with the noise level, influence the best achievable KL divergence, even with infinite data;
why sparse fitted weights need not correspond to large conformational probabilities;
what the statistical properties of the estimator are.
The main theoretical results include the uniform fixed-grid bound of Theorem 1, the global early-EM comparison of Proposition 6, the additional-noise stability result of Theorem 2, and the constrained limit distribution of Theorem 3.
Besides these statistical aspects, the solver used can subtly influence the outcome. The Expectation-Maximization (EM) algorithm is a popular way to solve this optimization problem, even though off-the-shelf convex solvers could also provide a solution. The EM algorithm is easy to implement and has a small computational cost per iteration.
The maximum-likelihood objective is concave. The fitted vector is unique, and the weights are unique under the tangent-injectivity condition introduced below. The estimate can nevertheless be sparse or spiky; see [27] (2020, Section 3) or panel f. of Figure 1.
Figure 1. The estimation of the weights as a function of the EM iteration, illustrated on the cryo-EM Hsp90 example from Section 7, with images and candidates, where the distribution is shown as a function of the chain opening collective variable . The blue curve is the displayed truncated target density; normalized grid weights are used when a weight divergence is reported. a. Molecule Hsp90 of interest for the cryo-EM simulations. The motion simulated is the opening and closing of the angle between the two chains, illustrated by the transparent models and collective variable . b. Example of simulated cryo-EM images. c. Evolution of a scaled negative log-likelihood as a function of the number of iterations (log scale). d. Estimation of the frequency (population) of each structure based on the number of nearest neighbors. e. Estimated weights at iteration number 5000, 50,000 and 150,000, respectively, of the EM algorithm. The sparsity pattern evolves towards the SCS fit in panel f. f. Convex-optimization fit produced by CVXPY/SCS with absolute and relative tolerances .
We explain why EM can become slow when components are similar or the optimum lies on the boundary. From a positive initialization it stays in the relative interior, and in the high-noise regime its proximal interpretation makes precise how early stopping can regularize the weights. We also study practical stopping diagnostics.
Organization. We start with a more formal description of the problem that we tackle in Section 2. Then, Section 3 provides additional background: we introduce cryo-EM (Sec. 3.1), the statistical-physics view of conformational distributions (Sec. 3.2), the ensemble-reweighting scheme of [43] (2023) and its connection with nonparametric maximum likelihood (Sec. 3.3), and related work in cryo-EM (Sec. 3.4). Section 4 analyses the objective function: we compute its gradient and Hessian and quantify the ill-conditioning caused by close structures (Sec. 4.1), establish self-concordance, establish a fundamental KL lower bound when the grid fails to cover the conformational space (Sec. 4.3), and close with an exact clusterwise description of how empirical frequencies enter the objective (Sec. 4.4). Section 5 is devoted to the Expectation–Maximization algorithm used in practice: we explain when early stopping can induce an implicit regularization, give a proximal-point interpretation, and discuss stopping criteria. Section 6 studies stability under an additional noise component and a central limit theorem for the estimated weights . Section 7 illustrates the theoretical findings through simulations on the Hsp90 molecule. We finalize with a conclusions Section 8. The remaining proofs are deferred to Appendix A. An additional example illustrating theoretical findings, the IgG molecule, is provided in Appendix B.
Problem formulation
In this section, we formally introduce the problem and fix notation for the rest of the paper. A mixing distribution with density is given, and i.i.d. sample points are drawn from it. One does not observe the directly, but rather , where the are independent Gaussian random vectors with covariance . This is the weight-recovery subproblem obtained when the forward operators and candidate structures are treated as known; we expect the same mechanisms to remain relevant in the full cryo-EM problem.
Write for the density of . In the simplified model we consider, each has density
the convolution of with the Gaussian kernel.
The measure will be estimated by a discrete measure of the form , where the points are given and lies in the simplex . The associated maximum likelihood problem is
Fixing the points rather than optimizing over them is common practice in integrative structural biology methods that rely on reweighting structural ensembles against experimental data [6]. Finding the optimal then amounts to reweighting the structures. In the running example of this work, each represents a conformation of Hsp90. The latter are indexed by an opening angle and the ’s would be the relative proportions. General background on this application is provided in Section 3 and the particular running example is shown on Figure 1 and developed in Section 7.1.
Background
The goal of this paper is to analyze the properties and limitations of a previously introduced denoising method [43, 15] for cryo-EM data. This method leverages noisy experimental data as well as output of numerical simulations, such as MD, and combines both sources with the objective of retrieving the most accurate representation of the underlying probability density of the molecules. Though our focus is on the reweighting scheme, our results extend beyond the method analyzed here, and we give related work in Section 3.4.
Cryo-electron microscopy
Biomolecules undergo changes between various conformations to perform different functions. An important research problem is to understand the various conformations a biomolecule can take and subsequently infer the underlying biophysical mechanisms. These conformations can be studied through cryo-EM, a leading technique for imaging biomolecules at near atomic resolution [34]. This method has become a fundamental scientific tool: the 2017 Nobel prize in chemistry was awarded to Dubochet, Frank and Henderson for the development of cryo-EM, and the experiment was labeled a “Method to Watch” by Nature Methods in 2022 [14]. In cryo-EM, a solution of many copies of biomolecule is flash frozen and imaged with a transmission electron microscope. Due to fast freezing, the biomolecules remain in a near-native state and the resulting images capture noisy snapshots of various conformations. This contrasts with crystallization-based techniques that restrict the conformational variability.
Analyzing the acquired images is very challenging. As the molecules are flash-frozen, each is in a random unknown orientation. Also, one only observes a two-dimensional view of the 3D volume. Finally, the noise level is extremely high, which makes the problem of recovering the conformation landscape, i.e., the set of possible conformations, more intricate. Usually, the image formation process is modeled as in (2).
Our analysis is motivated by the forward model for heterogeneous cryo-EM datasets. In this forward model, one considers a dataset of images, where each image is a projection of an (unknown) volume corresponding to the electrostatic potential of the molecule of interest in the -th conformation. The collection of acquired images is then modeled as
where is a 3D rotation operator corresponding to the random orientation of the volume , is the 2D projection operator and is a 2D translation operator corresponding to the offset of the projected volume with respect to the center of the image. Both and are specific to each particle image and are unknown. is the Point Spread Function operator applied to the projected image and can be thought of as a convolution coming from the fact that the microscope is imperfect and distorts the signal. Finally, is some random noise, often assumed to be Gaussian, the covariance matrix of which we do not specify for now. For initial processing of an image dataset, , , are all unknown in addition to for , and must be estimated, often through alternating minimization using a likelihood similar to (3) [42].
The composition of the various functions appearing in (2) is called the forward operator, which we denote . In practice, the conditional density for a volume , usually is taken to be Gaussian, i.e.,
where is the number of pixels, and is the fixed noise level, which we assume is known. We note that we take the cryo-EM forward operator (2) and likelihood (3) as our inspiration, but for the analysis we will consider an identity forward operator and Gaussian likelihood with large variance, as explained in Section 3.3.
Modeling the conformational ensemble distribution
A fundamental idea of statistical physics is that the variations of the configuration of a molecule, i.e., the different conformations should depend on the energy level of the configuration and the temperature. That is, one expects to observe only configurations that are stable and thus have a low energy level. At higher temperatures, as the system gets more excited, more variability can be expected. The probability distribution underlying the configurations is modeled as the Boltzmann distribution
where is the molecular Hamiltonian characterizing the energy, is the normalizing constant and the inverse temperature parameter. Unfortunately, the Hamiltonian is not known exactly, which is why understanding of molecular conformations is still an active topic of research.
In parallel to the experiments and the data they deliver, computational advances from MD ([24]) or AlphaFold ([1]) for instance, enable one to predict such conformations. A natural direction is then to combine the strength of those numerical methods with the datasets available to obtain the most accurate reconstructions possible and eventually improve the understanding of the conformational landscape. This strand of ideas is known as integrative biology, see [45] and [7]. This combination is important, as the computational methods are only providing approximations of the unknown truth and might exhibit biases.
Ensemble reweighting as nonparametric maximum likelihood
An integrative approach as the one above is put forward in [43] and subsequent works ([41]). Their procedure is the one that we focus on in this paper, even though some of the phenomena we highlight are relevant for other types of analyses. Let us stress that we get rid of the issue of the rotations and projections for the analyses of the present work.
[43] propose the approach below. For the analysis conducted in this paper, we work with a simplified version of their setting: the cryo-EM forward operator of equation (2) is replaced by the identity, the random rotations, translations and PSF are discarded, and the noise is assumed to be isotropic Gaussian with known variance . This simplification lets us isolate the statistical properties of the reweighting step itself, independently of the pose-estimation and PSF calibration problems, and study ill-conditioning, early-stopping regularization, and spike formation within this subproblem. We assume that an i.i.d. sample of images can be produced, call it . For simplicity, assume again that the images are vectorized and live on where is the total number of pixels.
Let us introduce the initial candidate probability density of the conformations , which could come from a model or any educated guess. Then, to incorporate the information contained in the data, a class of functions depending on is introduced. The parameter will be learnt so that describes more accurately the conformational space. One can then write the conditional likelihood of the data given the reweighting function as
As a parametric form for is not to be expected, the authors propose to consider a discrete counterpart of the likelihood, which reads
where the vector lies in the -simplex and is a representative subset of the possible conformations, for instance a discrete conformational path, which will be obtained from MD simulations. The weight vector now plays the role of the reweighting density above. Finally note that
which is convenient in many cases as noted by the authors.
Let us take a step back and start again from the fact that no parametric form for could be postulated. Indeed, no explicit form of an -parametrized Hamiltonian is usually available or sufficiently accurate1, so that a parametrization of the form is not feasible. Still, following the principle of maximum likelihood, one could then maximize the log-likelihood over all possible distributions, i.e.,
where is the set of probability distributions supported on . This problem is classical in statistics, known as the nonparametric maximum likelihood estimation problem, which at least dates back to [38]. A book-long exposition of the subject is [30] and the interested reader might profit from Chapters 1, 5 and 6 in particular.
This problem has been studied much over the past decades and keeps on being an active research field. We refer to the lecture notes by [20]. An important fact is that the objective functional is concave in . As it is an infinite dimensional problem, however, modifications have to be performed to make the problem computationally-friendly. Following [29], [22] considered the idea of restricting the set of measures in the optimization problem above by fixing the support of to a (large) discrete set of points, say . With the set of points fixed, maximizing over all measures is then equivalent to optimizing the measures weights as is suggested above.
This is the first takeaway: fixing the support to a discrete grid is a classical and principled way of making the NPMLE problem tractable. In our setting, this choice is not made freely: the grid is determined by MD simulations, which is precisely what makes the reweighting problem an instance of integrative biology instead of a purely statistical question.
Having to optimize over the weights only is a great advantage: the log-likelihood problem (5) is concave and finite-dimensional; classical optimization tools can thus be used. To that end, [28] proposed to solve that problem using duality and an interior point solver, for instance. The more recent algorithm by [27] reports better performance in the case . Finally, [46] further improved on the computations.
Discretization of conformational space and related work in cryo-EM
Within cryo-EM workflows, the reweighting and discretization updates analyzed here serve as foundational building blocks for several existing algorithms and pipelines. Both in cryoSPARC ([36]) and RELION ([39]), two dominant software tools in the field, the conformational space is discretized, although structures are not given. In the Flatiron Challenge for Cryo-EM Conformational Heterogeneity ([2]), the participants were required to submit a discrete set of structures, i.e., provide a discrete estimate of the conformational space. In multi-class expectation maximization such as in FREALIGN ([32]), the scheme alternates between the reweighting update and an optimization step for the volumes of 3D classes and corresponds to soft assignment of particles to structures. The relationship to hard assignment is discussed in [15]. Similarly, the reweighting scheme mentioned above corresponds to an E step in another EM algorithm used to learn both structures and denoise at the same time, see for instance [4]. Thus, our results inform that scheme as well, even though capturing only part of the subtleties recently put forward. We further note that other empirical Bayes problems arise in cryo-EM: [18] apply a PCA approach which induces a hierarchical linear model with heteroscedastic noise on latent cryo-EM volumes.
Related work also considers Bayesian approaches to compare MD structures with cryo-EM images using the same likelihood as (4) ([43, 19]) or focusing on calculating (3) more efficiently when the pose is unknown [13]. More recently, [33] introduce an information-theoretic framework to determine the optimal discretization of conformational space in cryo-EM ensemble reweighting. By maximizing mutual information between structural weights and noisy simulated images, it is shown that measurement noise sets a limit on the ensemble resolution, enabling the selection of representative structures that capture molecular heterogeneity without spatial redundancy.
From the inverse-problems viewpoint, the fixed candidate set is a discretization of the unknown measure, and the EM iteration count can act as a smoothing or iterativeregularization parameter; Proposition 6 quantifies one high-noise sense in which this occurs. Discretization effects have long been studied in statistical inverse problems [23, ?]bertero2009_image_deblurring_with``. Our focus is the interaction of these two effects in the finite-grid weight problem.
Properties of the MLE objective function
As discussed above, the reweighting problem is an optimization problem. It is therefore fundamental to study the properties of the objective function.
Gradient, Hessian and optimality condition.
The objective function has a specific structure that determines computational tractability. We now characterize its curvature properties, which govern both optimization difficulty and statistical efficiency. Set , , and .
Proposition 1. For every ,
and
where the inverse is understood componentwise. Thus is concave, and it is strictly concave on the simplex when
In that case the maximizer is unique; otherwise, the fitted vector is still unique.
Note that condition (8) can hold only if . Moreover, it holds that
Hence the KKT conditions are
Equivalently, if , while if . The following proposition quantifies the loss of curvature when two structures are close. Define the smallest tangent curvature by
Proposition 2. For distinct candidate indices and , let , , denote the objective in (1) obtained by replacing with , while keeping the data, , and the other candidate points fixed. For the Gaussian kernel,
This implies that weight can be shifted between two close structures with negligible effect on the objective.
Under the high-noise scaling , with and , , and the remaining candidate points fixed, the same left-hand side is as , uniformly for in a fixed neighborhood of zero.
Self-concordance of the objective
Importantly, the objective function exhibits a special structure called self-concordance. Self-concordance is a particularly convenient property for the analysis of the Newton algorithm, see for example [8].
Definition 1. Let be open and convex. A convex, three-times differentiable function is called -self-concordant if
for every and . The case is the standard normalization.
Proposition 3. Let
The negative objective is -self-concordant on . Equivalently, is standard self-concordant. Its Hessian is positive definite on the simplex tangent space exactly under (8).
Fundamental limits of grid-based estimation
We first quantify the population likelihood gap created when the candidate points cannot match the target moments.
For , set . At the population level,
Thus, the population maximum likelihood minimizes this KL divergence.
For , put and . We further place ourselves in the high noise case, i.e., one should think of large with respect to the signal in the images, which is what one expects in cryo-EM.
As we have seen, maximizing the objective function is equivalent to minimizing the Kullback–Leibler divergence. Even in the case of infinite data, the latter cannot be zero unless
Let us also define
More intuitively, is the largest degree up to which all moments of can be matched simultaneously by for a suitable choice of . Under the bounded-support assumption below, if and only if for some ; this follows from compactness of the simplex and moment determinacy on compact sets. The theorem concerns the remaining case.
Theorem 1. Suppose that has bounded support and let be defined by (11). Then, for constants and depending only on and the candidate points,
The theorem shows that an incomplete grid leaves a nonzero approximation error, even with infinite data, in the forward KL divergence between the true observation density and the best convolved candidate mixture.
(12) also reveals that a higher noise level reduces the lower bound. This does not mean that the estimate gets better with higher noise level. As , the signal is progressively lost and different weight vectors become increasingly difficult to distinguish. One could say that “if you squint your eyes enough, everything looks the same”. Seen differently, the objective function gets flat.
The moment-matching picture in Theorem 1 is closely related to the low-SNR expansions of [25] and [16], who study Gaussian mixture log-likelihoods with unknown centers. Our setting differs: the candidate points are fixed, and the inference is over the simplex of weights. The same moment-matching obstruction reappears, now in terms of which moments of the fixed grid can reproduce. For a fixed pair of Gaussian-smoothed measures, [9] obtain exact high-noise KL asymptotics. The point of Theorem 1 is different: its one-sided bound is uniform over the simplex, so even weights allowed to depend on cannot remove the moment obstruction imposed by the fixed grid.
The practical implication is the following. As there are nonconstant coordinate moments through order and since an -point measure has free weights, a generic moment vector requires, for fixed , of order . This necessary dimension-counting condition might not be a sufficient condition for a fixed grid. It further holds in the case of infinite data. However, as the conditioning deteriorates with structures close to one another, a smaller number of structures might deliver better results in finite sample applications. Initial work has confirmed this in the integrative structural biology setting, where [33] sub-sample structures through clustering procedures that stabilize quantities related to the Hessian.
Empirical frequencies and candidate geometry
The optimizer can lie on the boundary and be spiky. We next consider a correctly specified on-grid model and describe how empirical frequencies and candidate geometry enter the objective.
To understand the role of empirical frequencies, condition on labels and suppose that the observations are independent with . Set and .
Proposition 4 (Clusterwise representation). Assume that , and the candidate centers are fixed, and fix . If, as , , then, conditionally on the labels, uniformly in ,
Remark 1 (High-noise consequence). The first-order case of [25] (2023, Theorem 2.1), applied with truth and candidate measure , gives, uniformly in and ,
Writing , combining the two displays gives, for fixed and up to terms independent of ,
Thus the term is maximized by the weights whose barycenter is . Empirical frequencies determine this barycenter; the candidate geometry determines which weights share it.
Expectation-Maximization and early-stopping regularization
There is a long tradition of solving mixture problems with the expectation-maximization algorithm. The history goes back at least 50 years, with application in fields such as astrophysics, medical imaging, finance, and information theory, see for example [31], [44], and [12]. We refer to [37] and [3] for a complete introduction, the underlying motivation and further background.
The EM algorithm updates the weight vectors
Write and initialize at . We use for the number of iterations. Define
so that the recursion reads . This nonlinear recursion remains particularly challenging to study. Also note that are usually called responsibilities.
This algorithm, in spite of its great popularity in practice, can be slow in some settings. Indeed, [30] stated: “However, one key feature of the algorithm is that it commonly displays a very slow linear rate of convergence, where the rate constant is related to the amount of information in the missing portion of the data. If the components are similar in their densities, then the convergence is extremely slow. The convergence will also be slow when the maximum likelihood solution requires some of the weight parameters to be zero, because the algorithm can never reach such a boundary point.”
As hinted at in the Introduction, we aim at raising awareness in the community that there can be a regularization phenomenon through early stopping, as the EM might not be run long enough in the case of very small or zero optimal weights. This might however be a feature for the applications of interest. Recall that other fast convex-optimization methods exist and were discussed in Section 3.3; they can produce the same spiky boundary solutions in our examples (see Figure 1 panel f.). The stopping time along the EM path matters, as the spikiness of the converged fit is both a blessing and a curse. The converged fit indeed is adaptive, but might also introduce non-physical spikes. We believe that a properly early-stopped EM algorithm might provide the best of both worlds.
As detailed in Section 7.1, we use the Hsp90 system and a simplified cryo-EM simulation setup as an example to recover a distribution over the chain opening angle (shown in blue in Figure 1). That function is discretized and its atoms are used as the candidates to reweight. The figure follows EM towards the convex-optimization fit produced by SCS. The latter is sparser than the displayed target, which is not desirable in this example.
Remark that the update can be rewritten
which is a diagonally scaled multiplicative gradient step. At the first step, as , this is an ordinary gradient step of size in the simplex tangent direction . Remark further that once an entry of the vector is zero, it cannot become positive again.
The proximal point algorithm view on early stopping regularization
Another way of seeing the algorithm is as a proximal-point algorithm, as in [11] ; see also [26]. With the responsibilities defined in
(16), set
We use the standard extended-value conventions , for , and the corresponding infinite-KL convention.
Proposition 5. The EM update is the unique maximizer of and, for a constant independent of ,
Thus EM is an exact proximal-point iteration with a KL penalty between the responsibilities at two successive weight vectors.
Observe that the curvature of in coordinate is ; it therefore becomes large near the boundary when . This explains why the EM algorithm slows down.
Figure 2 illustrates this proximal update on a three-dimensional simplex. On that figure, the red broken line represents the iteration path, the blue dot the starting vector of weights, the green dot the optimizer and the two black arrows represent the two competing terms in equation (18).
Figure 2. Visualization of the trajectory of the EM algorithm (red) on the simplex (transparent blue), when initialized at the equal weight vector (blue point). The solution of the optimization problem is the point in green. At each step, the algorithm balances the two terms in Equation (18), which are represented by the black arrows.
There is no tunable step size: the nonnegative penalty changes with the iterate and vanishes at the current one. This makes the implicit regularization of the scheme hard to parse in full generality. The high-noise comparison in Proposition 6 below makes the role of the iteration count as a regularization parameter precise. To establish that result, let , with . Recall and set
For an integer , let be the unique maximizer of
over .
Proposition 6 (Early EM as KL regularization). Fix , , , the means , and the candidate grid, with . If is deterministic and , then
Thus, EM updates are, to first order, equivalent to maximizing the regularized objective .
Early stopping and variability of the estimates
Theorem 3 describes the local fluctuations of the finite-grid MLE, while Proposition 6 compares an early-stopped EM iterate with a penalized optimizer. The two effects are distinct: sampling changes the estimator, whereas early stopping changes how well the objective is optimized. Intuitively, with less iterates, the iterates must remain closer to the uniform initialization and are therefore less variable but biased. On the other hand, a fully solved optimization problem comes with a high variability because of the flatness of the objective when candidate structures are close. Completely understanding and quantifying this phenomenon rigorously remains an interesting challenge.
Stopping criteria
In view of the KKT condition, the gap
vanishes exactly at a maximizer, and concavity gives . Indeed, concavity bounds the difference by , which equals (20) by (9). The infinity norm may still be useful empirically, but need not vanish at a sparse solution.
For the EM step, write and define
(17) gives the useful identity
Thus is the variance gap of Chok and Vasil (2025) [10], a weighted squared norm that downweights coordinates approaching zero. For , define the local seminorm .
Proposition 7. Let , put , and assume
Then
Corollary 1. Let . Then
Thus, is a certified optimization gap, while is a smoother EM diagnostic as we shall further show in Figure B3.

Figure B3. Comparison of the “variance gap” from Equation (21) (red) against the -norm gap , for the IgG example considered in Appendix B, with the same data as figure B2.
Practical considerations on stopping criteria
For early stopping, we compare the variance-gap criterion with the interior fixed-point diagnostic , using . Empirically, the square root of the variance gap behaves like a smoothed version of this diagnostic, so we use
with .
The square root of the variance gap can be interpreted as a weighted -norm of with respect to the weights , and is also related to the time-derivative of for a continuous-time flow on the simplex (Chok and Vasil, 2025) [10]. Connecting these interpretations to our results, with the goal of stronger numerical guidance for practitioners, is an important focus for future development.
Statistical properties
Stability under an additional noise component
Recall that the ambient image dimension is . As above, is obtained from the signal plus noise model. Let , , be noise vectors in and set . Let denote the objective computed from . Let maximize , and let be any maximizer of . Set
Theorem 2. Assume that the collection is independent of the uncorrupted data, that , and that . Write . For fixed , , suppose (8) holds almost surely. Then, as ,
Here, for a positive random scale means . The random factor records the conditioning of the uncorrupted problem. In particular, their distance converges to zero whenever in probability. Therefore, for heteroscedastic noise that is not “too spiky” in the sense that is not too large, the estimates will be robust to noise.
Asymptotic distribution of the finite-grid
We use the standard constrained -estimation limit [17]. We now return to the fixed ambient dimension of Section 2, keep the finite grid fixed as , and parametrize the simplex by
This parametrization is useful for the central limit theorem below as any element on the simplex has degrees of freedom. Let and
Let be a maximizer of over . Let and be the first coordinates of and , respectively. Put
As the MLE is constrained, the constraint will be relevant for the limiting distribution. We thus introduce the critical cone
Theorem 3. Suppose that has density , where is a boundedly supported probability measure, and that the candidate points are pairwise distinct. Then is positive definite and
where denotes convergence in distribution. If is in the interior of , the limit is .
Remark 2 (Correct specification and boundary points). If has density , then and is the tangent cone. After multiplication by , the limit in (24) is the Euclidean projection of a standard Gaussian vector onto . At a boundary point this projection is generally non-Gaussian.
Remark 3 (Misspecification at the boundary). At a boundary maximizer under misspecification, need not vanish. For a feasible displacement , the full log-likelihood has leading deterministic term , while its random fluctuation is . If , the deterministic loss rules out that direction asymptotically. Thus retains only feasible directions satisfying .
Simulation results
In this section, we present numerical experiments illustrating the issues that were theoretically investigated above. In Section 7.1, we present the biomolecular system and cryo-EM setup that we used as an example. In Section 7.2, we exhibit how the weights can be biased when the structures do not cover the space well enough, thereby illustrating the practical consequence of Theorem 1. In Section 7.3, the question is similar, but instead of having part of the conformational space not covered, the density of the structures is too low in a certain region. In Section 7.4, we then numerically investigate what determines where the spike appears, echoing Proposition 4.
A running example: Hsp90
The molecule of interest for our experiments will be Hsp90, a classical example used by the community to simulate biomolecular changes in cryo-EM [40]. In a nutshell, the heat shock protein 90 is a molecule assisting other proteins to fold properly. Images are generated with the cryojax library [35]. For each candidate structure we read centered, hydrogen-free atomic coordinates from a PDB file and build the electron-scattering potential as a sum of per-atom Gaussians from the tabulated Peng scattering factors, retaining atomic -factors. A Gaussian-mixture integrator (with error-function pixel integration) then yields the clean projection on a grid of pixels at Å/pixel and kV, with no PSF or translation and a single fixed pose (Euler angles ) shared across all structures. Two images therefore differ only through their conformation and noise, which is the identity-forward-operator setting analyzed above. Let be a cosine-tapered circular mask of radius 42 pixels (one third of the image width, one-pixel roll-off). Each clean projection is standardized within the mask to unit signal variance,
and the observed image for a sampled conformation is , . The noise is thus i.i.d. standard Gaussian ( per pixel) and the signal scales as , so SNR is the in-mask signal-to-noise power ratio and small SNR is the per-pixel high-noise regime of interest. Example images are shown in Figure 1b.
The ground truth distribution is generated by picking conformations at random among the frames of the trajectory and assigning each to the nearest candidate structure; in some cases, we chose a uniform distribution while in other cases a bimodal one, see the orange line on the figures below.
Reference structures not covering the space
Recall that Figure 1 showed how early stopping in the EM acted as a regularizer while the exact solution to the reweighting optimization problem is spiky. We now turn to addressing the question of the importance of the candidates points covering the space well enough, which is the setting of Theorem 1. We first consider the set of reference structures with the motion shown in Figure 1a to generate the data with varying signal-to-noise ratio and number of sample points. To reflect the possibility that the set of reference structures might not be complete enough, we remove the structures with opening angle between 15 and 20 degrees in the set of candidates.
On Figure 4, one clearly sees that the candidate structure closer to the structures that have no representative in the dataset gets too much weight, which matches intuition. Also, even though less pronounced, a larger sample size yields a distribution that is closer to the uniform, while decreasing the signal-to-noise ratio also deteriorates the recovery (Figure 4b).

Figure 4. Output of the optimization procedure when the reference structures do not cover a part of the conformational space, while the ground truth is uniform over a larger set of structures. Left: Comparison of the exact solutions of the problem for a sample size and SNR. Right: KL, averaged over 10 replications of the same random setting. For larger sample sizes and signal-to-noise ratio, the KL diminishes. It does not converge to zero as the set of candidate structures is not covering part of the conformational space. For very small SNR, the spikiness translates into higher KL-divergence.
Recovery of low-population states
In practice, even if the reference structures cover the entire conformational space, there will be regions in which the density of the structures is larger and regions of lower density (i.e., low-populated states). This is what we explore in the following example. As the spacing between the bins in the middle suggest, there are less structures in the middle of the conformational trajectory than at the boundaries. The actual motion is an opening, similar to that of Figure 1a. The optimal weights given a dataset are optimized using an exact convex solver and the results are reported in Figure 5. In this example, as the reference structures do not cover the space well enough compared with the ground truth, they receive a much larger weight.

Figure 5. Output of the optimization procedure when the reference structures coarsely cover the central part of the conformational space, while the ground truth is uniform over a larger set of structures. Left: Comparison of the exact solutions of the problem for a sample size and SNR=2. Right: KL(), averaged over 10 replications of the same random setting. For larger sample sizes and signal-to-noise ratio, the KL diminishes. It does not converge to zero as the set of candidate structures is not covering part of the conformational space. For very small SNR, the spikiness translates into higher KL-divergence.
Where do the spikes appear?
Section 4.4 showed how empirical frequencies and candidate geometry enter the objective. Figures 6 and 7 illustrate that frequencies alone do not predict the reconstructed weights. Indeed, the fact that a structure has been sampled (red) more than the ground truth does not imply that the reconstructed weight (green) is above the ground truth as well. The observed spike locations reflect the joint effect of candidate geometry, empirical frequencies and noise.
Conclusions
In this work, we analyzed cryo-EM ensemble reweighting over a fixed set of candidate structures as a computational surrogate for a nonparametric maximum-likelihood estimation problem. We developed theoretical results and complemented them with numerical experiments illustrating the behavior of the recovered weights.
Our first conclusion is that the discretization induced by fixing a set of candidate structures is more than a mere approximation and is not a harmless computational convenience: the interplay between the noise level and the coverage of the candidate set of structures fundamentally controls identifiability, conditioning, and interpretability, as also discussed in [33]. Candidate structures that are closer than the noise scale induce ill-conditioning, thereby making the weights sensitive to small perturbations. Conversely, when the candidates do not cover the space well enough, there is an unavoidable bias. These insights explain why spiky solutions are neither an

Figure 6. Comparison between the reconstructed weights, the actual frequencies in the data and the ground truth. From left to right, the sample size is and the SNR is 0.1 and 0.01, respectively.

Figure 7. Comparison between the reconstructed weights, the actual frequencies in the data and the ground truth. From left to right, the sample sizes are and , and the SNR is 0.1.
anomaly nor necessarily conveying important information about the data; rather, they are an expected outcome of maximum-likelihood fitting on a discrete support.
We also showed that the choice of algorithm (and its parameters) has an important impact on the recovered solutions. In particular, EM slowdowns arise precisely in the near-nonidentifiable regime where structures are similar. Its tendency toward increasingly spiky fits motivates viewing the iteration count as an implicit regularization parameter. Importantly, this means that early stopping might be beneficial. The intricate nonlinear nature of the recursion prevents providing a clear theoretical rule, but we proposed principled stopping diagnostic tools. Future work may benefit from drawing analogs to regularization and early stopping in Richardson-Lucy iteration for image deconvolution (see for example [5], a close historical analog to our problem.
Overall, our work suggests shifting emphasis from solving the reweighting problem to a more nuanced approach in which one iteratively crafts the candidate set and carefully investigates the early-stopping potential for each dataset analyzed, extending simulation frameworks such as in [41]. Extending to the full cryo-EM model, i.e., including the pose and projection parts of the forward model, as well as reconstruction, is a step we aim to take in the future.
Acknowledgment
Research reported in this publication was supported by the National Institute of General Medical Sciences of the National Institutes of Health under Award Number R35GM157226. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health. The work was also supported by the Alfred P. Sloan Foundation (FG-2023-20853), and the Simons Foundation (1288155). The Flatiron Institute is a division of the Simons Foundation.
Proofs
Proof of Proposition 1. Direct differentiation gives the two formulas, and
This proves the curvature claims. If two maximizers had different fitted vectors, strict concavity of would give a contradiction at their midpoint.
Proof of Proposition 2. Write for the likelihood matrix defining and let . For , the Rayleigh quotient and (7) give
On a fixed neighborhood of zero, smoothness and positivity of the Gaussian kernel give constants such that, uniformly in , , and ,
The bound (A.1) is therefore uniformly in . Under the stated high-noise scaling, divide the numerator and denominator by . The likelihood ratios of the fixed candidates are , while locally uniformly in . This gives the final claim.
Proof of Proposition 3. For , put . Direct differentiation gives
Therefore,
Multiplication by changes the self-concordance constant from to , and the displayed Hessian vanishes in direction precisely when .
Proof of Theorem 1. For , define the symmetric moment-difference tensor
Matching all coordinate moments of total degree is equivalent to . By maximality of , no makes
all zero. These tensors depend continuously on , and the simplex is compact. Consequently,
Let
where, for a finite measure ,
The supports of and of every lie in one fixed ball. Taylor’s formula for therefore gives, uniformly in and for ,
Let . The map
is injective on . Hence the -norm of the resulting polynomial is equivalent to the Euclidean norm of its coefficients. It follows from (A.2) that, for every ,
Set . By (A.3), the -norm of the remainder satisfies
uniformly in . Therefore,
Choosing , it holds, for every , uniformly in , that
After squaring, this gives
Since
Plancherel’s identity and the change of variables yield
Both and are bounded above by . The KL–Hellinger inequality gives
Combining this with (A.6) gives, uniformly in , . □
Proof of Proposition 4. Write
If , write for expectation under its law. Finiteness of the candidate grid gives, uniformly in , and ,
Indeed, the mixture density is a weighted average of the component densities, so it lies between their minimum and maximum; this gives the first bound. For the second, the mean-value inequality for the logarithm gives
For Gaussian components with the same variance, the ratio on the right is bounded by . Both bounds are square integrable. The standard maximal bound for this fixed-dimensional Lipschitz class therefore gives, conditionally on the labels,
Moreover,
Summing over the fixed number of clusters and using proves (13). □
Proof of Proposition 5. Up to an -independent constant,
whose unique simplex maximizer is . Expanding the KL divergence in gives (18).
Proof of Proposition 6. Put , , and
The Gaussian likelihood gives
Let
The preceding identity and polarization give
Moreover,
Since the law of does not depend on , this bound is uniform for the continuum limit , and therefore . In particular, , and on this event . Hence . Since is a convex combination of the entries in row ,
It follows that
For a tangent vector , direct differentiation and give
Since each is a probability vector, the preceding row-wise bound implies
Integrating along the segment joining and therefore gives
The bound gives . Moreover, the EM recursion yields
and
Write . Since diverges at the boundary and is strictly convex in the relative interior, the penalized objective has a unique interior maximizer. Its stationarity equations are
Multiplying by and summing gives . Multiplying the th stationarity equation by and using gives
Thus , and consequently
Together with the preceding bound on , this shows that the numerator in (19) is .
It remains to control the denominator. With and , a first-order softmax expansion at the uniform weights gives
Since the grid is fixed, . The bound on and therefore give
Because , the map has positive rank, so the Gaussian vector on the right is nonzero almost surely. Consequently, . Combining this with the bound on the numerator gives
Proof of Proposition 7. Let , , and . If , then and the claim is immediate. Otherwise, Proposition 3 gives , whence
Squaring and integrating over gives the two bounds in (22).
Proof of Theorem 2. Start by locally defining
For some independent of , the perturbed objective is
For each , the exponents in the sum above differ by at most . Consequently, coordinatewise, the corresponding summands of the two gradients have a ratio between and ; the same is true after averaging over . The KKT conditions at then give
Under (8), continuity and compactness give . With , strong concavity and the optimality conditions give
Therefore
At the uniform vector , restrict to the -dimensional space . The sum of its eigenvalues is . Since is no larger than any of these eigenvalues and is a probability vector,
Here the last inequality uses . Thus . If , the preceding bound and give
If , both maximizers lie in the simplex, whose diameter is . Using also gives
Hence the last bound holds in both cases. Finally,
Chebyshev’s inequality and a finite union bound give , which proves (23).
Proof of Theorem 3. Write and . Write , where and are independent. Bounded support of gives , and
Since is bounded by the left-hand side, compactness of and continuity give
Choose with . Since ,
Each ratio on the right is the exponential of an affine function of . The random vector has finite exponential moments in every linear direction, so is finite. Moreover, for ,
The density is positive everywhere, and distinct Gaussian translates are linearly independent, which can be seen by taking Fourier transforms. Hence this display can vanish only for , proving that is positive definite.
Linearity of gives the exact identity
for every feasible . If were another population maximizer, concavity would make the population criterion constant on the segment joining the two maximizers, whereas this identity and the finite second score moment give the strictly negative second directional derivative . Thus the population maximizer is unique and the uniform law above gives in probability.
Put and
Finite second moments give
and the multivariate central limit theorem gives . Uniformly for in a fixed compact set with , Taylor expansion in the exact identity now gives
Population optimality gives in every feasible local direction. If is the smallest eigenvalue of , the last display is therefore at most on the feasible sphere . Consistency, concavity, and then give .
Because is defined by linear inequalities, its root- local feasible directions eventually satisfy exactly the first two conditions in the definition of on every compact set. Along a convergent feasible sequence, the local criterion tends to if ; if , its upper limit is at most
Conversely, every is eventually feasible and attains this limit. Tightness and the argmax argument for these concave criteria give (24); positive definiteness of gives uniqueness of the limiting maximizer.
If is interior, first-order optimality gives and . The limit is then , with covariance .
In the case where the model is correctly specified,
so is the tangent cone and . Moreover,
Therefore, after multiplication by , the minimizer is the Euclidean projection of onto .
Additional Stopping Criterion on IgG example
We now consider a different benchmark example to illustrate the stopping-criterion issue discussed in Section 5. The simulation is from the 100 structures of the IgG-1d example from the benchmark [21], but simulated with conformations taking a multimodal distribution as considered in [15] (Figure B1). Unlike the Hsp90 example above, the EM algorithm overfits very quickly, within 1000 iterations. Here, the threshold criteria at is too strict, unlike the previous example in Figure 3. The iteration at which overfitting begins varies considerably between examples, and understanding this stopping time is an important direction for future work. Figures B2 and B3 report the corresponding stopping diagnostics.

Figure 3. Comparison of thresholds for the interior fixed-point diagnostic on the Hsp90 example (, ). a.–c. Estimated weights at thresholds , , . d.–f. Loss, diagnostic, and weight divergence to the displayed true weights. The saved stopping iterations are 19, 603, and 369458.

Figure B1. Example structures of the IgG molecule used in Appendix B, with diagram of the distribution of structures along the dihedral angle , as considered in [15].

Figure B2. Comparison of various thresholds for the gap on the IgG example from Appendix B. a.-c. Estimated weights at thresholds , , respectively. d.-f. Loss, gap, and divergence to true weights respectively, plotted against iteration number. The blue, orange, and green lines denote the iteration index where the , , gap thresholds are reached.
References
- [1]Abramson, Josh et al. (2024). “Accurate structure prediction of biomolecular interactions with AlphaFold 3”. In: Nature 630.8016, pp. 493–500.DOI
- [2]Astore, Miro A et al. (2025). “The inaugural flatiron institute cryo-em conformational heterogeneity challenge”. In: bioRxiv.DOI
- [3]Balakrishnan, Sivaram an, Martin J Wainwright, and Bin Yu (2017). “Statistical guarantees for the EM algorithm: From population to sample-based analysis”. In: The Annals of Statistics 45.1, pp. 77–120.
- [4]Balanov, Amnon, Wasim Huleihel, and Tamir Bendory (2025). “Expectation-maximization for multi-reference alignment: Two pitfalls and one remedy”. In: arXiv preprint arXiv:2505.21435.
- [5]Bertero, Mario et al. (2009). “Image deblurring with Poisson data: from cells to galaxies”. In: Inverse Problems 25.12, p. 123006.DOI
- [6]Bottaro, Sandro, Tone Bengtsen, and Kresten Lindorff-Larsen (2020). “Integrating molecular simulation and experimental data: a Bayesian/maximum entropy reweighting approach”. In: Structural bioinformatics: methods and protocols. Springer, pp. 219–240.
- [7]Bottaro, Sandro and Kresten Lindorff-Larsen (2018). “Biophysical experiments and biomolecular simulations: A perfect match?” In: Science 361.6400, pp. 355–360.DOI
- [8]Boyd, Stephen and Lieven Vandenberghe (2004). Convex optimization. Cambridge university press.
- [9]Chen, Hong-Bin and Jonathan Niles-Weed (2021). “Asymptotics of smoothed Wasserstein distances”. In: Potential Analysis, pp. 1–25.
- [10]Chok, James and Geoffrey M Vasil (2025). “Optimization Over a Probability Simplex”. In: Journal of Machine Learning Research 26.73, pp. 1–35.
- [11]Chrétien, Stéphane and Alfred O Hero (2008). “On EM algorithms and their proximal generalizations”. In: ESAIM: Probability and Statistics 12, pp. 308–326.
- [12]Cover, T. (1984). “An algorithm for maximizing expected log investment return”. In: IEEE Transactions on Information Theory 30.2, pp. 369–373.DOI
- [13]Dingeldein, Lars et al. (2025). “Amortized template matching of molecular conformations from cryoelectron microscopy images using simulation-based inference”. In: Proceedings of the National Academy of Sciences 122.23, e2420158122.DOI
- [14]Doerr, Allison (2022). “A dynamic direction for cryo-EM”. In: Nature Methods 19.1, pp. 29–29.
- [15]Evans, Luke et al. (2026). “Counting particles in cryo-electron microscopy may result in incorrect population estimates”. In: Communications Biology 9.1, p. 421.DOI
- [16]Fan, Zhou et al. (2024). “Maximum likelihood for high-noise group orbit estimation and single-particle cryo-EM”. In: The Annals of Statistics 52.1, pp. 52–77.
- [17]Geyer, Charles J. (1994). “On the asymptotics of constrained M-estimation”. In: The Annals of Statistics 22.4, pp. 1993–2010.
- [18]Gilles, Marc Aurèle and Amit Singer (2025). “Cryo-EM heterogeneity analysis using regularized covariance estimation and kernel regression”. In: Proceedings of the National Academy of Sciences 122.9, e2419140122.
- [19]Giraldo-Barreto, Julian et al. (2021). “A Bayesian approach to extracting free-energy profiles from cryo-electron microscopy experiments”. In: Scientific reports 11.1, p. 13657.
- [20]Ignatiadis, Nikolaos and Bodhisattva Sen (2024). Empirical Bayes. Preliminary lecture notes.
- [21]Jeon, Minkyu et al. (2024). “CryoBench: Diverse and challenging datasets for the heterogeneity problem in cryo-EM”. In: Advances in Neural Information Processing Systems 37, pp. 89468–89512.arxiv.org/abs/2408.05526
- [22]Jiang, Wenhua and Cun-Hui Zhang (2009). “General maximum likelihood empirical Bayes estimation of normal means”. In: The Annals of Statistics 37.4, pp. 1647–1684.DOI
- [23]Johnstone, Iain M. and Bernard W. Silverman (1991). “Discretization effects in statistical inverse problems”. In: Journal of Complexity 7.1, pp. 1–34.
- [24]Jung, Hendrik et al. (2023). “Machine-guided path sampling to discover mechanisms of molecular self-organization”. In: Nature Computational Science 3.4, pp. 334–345.DOI
- [25]Katsevich, Anya and Afonso S Bandeira (2023). “Likelihood maximization and moment matching in low SNR Gaussian mixture models”. In: Communications on Pure and Applied Mathematics 76.4, pp. 788–842.
- [26]Keys, Kevin L, Hua Zhou, and Kenneth Lange (2019). “Proximal distance algorithms: Theory and practice”. In: Journal of Machine Learning Research 20.66, pp. 1–38.
- [27]Kim, Youngseok et al. (2020). “A fast algorithm for maximum likelihood estimation of mixture proportions using sequential quadratic programming”. In: Journal of Computational and Graphical Statistics 29.2, pp. 261–273.
- [28]Koenker, Roger and Ivan Mizera (2014). “Convex optimization, shape constraints, compound decisions, and empirical Bayes rules”. In: Journal of the American Statistical Association 109.506, pp. 674–685.DOI
- [29]Laird, Nan (1978). “Nonparametric maximum likelihood estimation of a mixing distribution”. In: Journal of the American Statistical Association 73.364, pp. 805–811.
- [30]Lindsay, Bruce G (1995). Mixture models: theory, geometry, and applications. Vol. 5. NSF-CBMS Regional Conference Series in Probability and Statistics. Institute of Mathematical Statistics.
- [31]Lucy, Leon B (1974). “An Iterative Technique for the Rectification of Observed Distributions”. In: Astronomical Journal, Vol. 79, p. 745 (1974) 79, p. 745.DOI
- [32]Lyumkis, Dmitry et al. (2013). “Likelihood-Based Classification of Cryo-EM Images Using FREALIGN”. In: Journal of structural biology 183.3, pp. 377–388.DOI
- [33]Mattingly, Henry H, Luke Evans, and Pilar Cossio (2026). “Measurement-limited learning of conformational heterogeneity in cryo-electron microscopy”. In: arXiv preprint arXiv:2606.14449.arxiv.org/abs/2606.14449
- [34]Nakane, Takanori et al. (2020). “Single-particle cryo-EM at atomic resolution”. In: Nature 587.7832, pp. 152–156.
- [35]O’Brien, Michael J et al. (2026). “CryoJAX: a cryo-electron microscopy image-simulation library in JAX”. In: Acta Crystallographica Section D: Structural Biology 82.3, pp. 155–167.
- [36]Punjani, Ali et al. (2017). “cryoSPARC: algorithms for rapid unsupervised cryo-EM structure determination”. In: Nature Methods 14, pp. 290–296.DOI
- [37]Redner, Richard A and Homer F Walker (1984). “Mixture densities, maximum likelihood and the EM algorithm”. In: SIAM review 26.2, pp. 195–239.
- [38]Robbins, Herbert (1950). “A generalization of the method of maximum likelihood-estimating a mixing distribution”. In: Annals of mathematical statistics. Vol. 21. 2, pp. 314–315.
- [39]Scheres, Sjors H. W. (2012). “RELION: implementation of a Bayesian approach to cryo-EM structure determination”. In: Journal of Structural Biology 180.3, pp. 519–530.DOI
- [40]Seitz, Evan et al. (2019). “Simulation of cryo-EM ensembles from atomic models of molecules exhibiting continuous conformations”. In: BioRxiv, p. 864116.DOI
- [41]Silva-Sánchez, David et al. (2026). “Cryo-Electron Microscopy Structural Ensemble Optimization Using Individual Particles”. In: Journal of Chemical Theory and Computation 22.10, pp. 4922–4938.
- [42]Singer, Amit and Fred J Sigworth (2020). “Computational methods for single-particle electron cryomicroscopy”. In: Annual review of biomedical data science 3.1, pp. 163–190.DOI
- [43]Tang, Wai Shing et al. (2023). “Ensemble reweighting using cryo-EM particle images”. In: The Journal of Physical Chemistry B 127.24, pp. 5410–5421.
- [44]Vardi, Y. and D. Lee (1993). “From Image Deblurring to Optimal Investments: Maximum Likelihood Solutions for Positive Linear Inverse Problems”. In: Journal of the Royal Statistical Society: Series B (Methodological) 55.3, pp. 569–598.
- [45]Ward, Andrew B, Andrej Sali, and Ian A Wilson (2013). “Integrative structural biology”. In: Science 339.6122, pp. 913–915.
- [46]Zhang, Yangjing et al. (2024). “On efficient and scalable computation of the nonparametric maximum likelihood estimator in mixture models”. In: Journal of Machine Learning Research 25.8, pp. 1–46.

