WorksPhysics and Astronomy
Regressing bubble cluster dynamics as a disordered many-body system
Abstract
The coherent dynamics of bubble clusters in liquid are of fundamental and industrial importance and are elusive due to the complex interactions of disordered bubble oscillations. Here we introduce and demonstrate unsupervised learning of the coherent physics by combining theory and principal component analysis. From data, the method extracts and quantifies coherent dynamical features based on their energy. We analyze simulation data sets of disordered clusters under harmonic excitation. Results suggest that the coherence is lowered by polydispersity and nonlinearity but in cavitating regimes underlying correlations can be isolated in a single cohererent mode characterized by mean-field interactions, regardless of the degree of disorders. Our study provides a valuable tool and a guidance for future studies on cavitation and nucleation in theory, simulation, and experiments.
Introduction
Bubble clusters nucleate when the liquid pressure rapidly falls below a certain threshold. These clusters coherently oscillate and violently collapse to cause extreme energy concentration that leads to various critical consequences and use in applications as diverse as hydraulic machines [1, 2], medical ultrasound [3, 4, 5], surface cleaning [6, 7], chemical synthesis [8, 9], and bio-inspired devices [10]. Characterizing the dynamics is a challenge due to the complex interactions of bubbles involving disorders and stochasticity. Nuclei are typically micro-sized and polydisperse and randomly distributed. Their rapid oscillations are, except in controlled experiments [11], practically not measurable. Molecular and hydrodynamics simulations can provide detailed insights into nucleation [12, 13], while their time- and spatial scales have not reached those of practical cluster oscillations. Analyses have been made on the interaction dynamics in various regimes [14], yet no common knowledge has been established if the many-body coherence globally exists and if so scaling is possible, beyond the consensus that polydispersity induces strong disorders.
For the past decades, the Rayleigh-Plesset (R-P) equation and its variations have been actively explored to investigate the dynamics of single bubbles [15, 16]. Relatively few studies addressed the theory of clusters. By using mean field approach to interacting bubbles modeled by the R-P equation, d’Agostino and Brennen [17] derived a scaling parameter that dictates the coherent oscillations of nearly equilibrium, monodisperse clusters, the so-called ”cloud interaction parameter”. Zeravcic and co-workers [18] used the coupled R-P equations and identified disorders represented by the Anderson localization of acoustic energy in polydisperse, lattice-like clouds under weak excitation. With the aid of computation, we have recently extended the interaction parameter to the non-equilibrium, cavitating clusters under strong excitation by combining the mean-field and the explicit approaches [19, 20, 21]. To recall, we scale the kinetic energy of liquid induced by oscillating bubbles as
where is the extended parameter: , and and denote the characteristic (reference) bubble radius and velocity, denotes the radius of the cluster, and is the liquid density. For bubbles out of equilibrium, is expressed as , where and denote time average during a period in which bubble dynamics are statistically stationary and the mean value about the bubbles in the cluster, respectively. Despite rather audacious averaging, was found to control well both the coherent dynamics of clusters and their acoustic emission. Overall, previous studies indicate that the coherence can depend on both polydispersity and nonlinearity in a non-separable manner, posing perplexing questions about the universality of the scaling.
Theoretical characterization of the nonlinear dynamics of disordered many-body systems is in general not a simple task. Meanwhile, greater computing power has enabled learning physics by analysing big data. Principal component analysis (PCA) is a powerful method for unsupervised learning which has seen recent success in characterizing the coherent physics of many-body and high-dimensional systems in fields including quantum information and fluid dynamics [22, 23, 24]. PCA extracts dominant states and dynamical features as well as their amplitudes, such as coherent quantum state and turbulent structures, as the eigenmode and the variance of the co-variance matrix of measurement and simulation data. The variance is designed consistent with the norm induced by an energetic inner product of the system (e.g. kinetic energy) [25, 26].
Here, we propose and demonstrate a method for the unsupervised learning of the coherent bubble cluster dynamics by combining theory and PCA. Direct application of standard PCA to Lagrangian bubble dynamics data is not physically meaningful as the extracted features do not account for the interaction potential. To make PCA physically meaningful, we introduce strategic pre-processing of the data prior to PCA such that the PC-variance becomes theoretically consistent with the interaction energy modeled by the R-P equation. Analysing simulation data sets of clusters, we show that the PCA can systematically extract not only coherent but also incoherent features whose magnitudes are respectively measured by the PC-variance and the von Neumann entropy. We discover that the coherence is lost by disorders induced by polydispersity and nonlinearity, while under strong excitation the underlying correlations are globally isolated in a single coherent feature scaled by , regardless of the disorders.
For clusters modeled by the coupled R-P equations, observable variables are bubbles’ radial velocities and radii, and . Assume data matrices contain observations with a constant temporal interval: and , where and denote the radial velocities and the radii of the bubbles at time : and . A standard PCA can be conducted through, for instance, the singular value decomposition (SVD) of : [27, 28]. The -th PC (feature) is stored in , where keeps the -th largest singular value and zero elsewhere. However, corresponding PC-variances do not measure the energy.
Now we revisit eq. (1). can be explicitly expressed as
where , , and are the radius and the radial velocity of bubble , and distance between the centers of bubble and , respectively. The second term in the bracket represents the contribution of the long-range interactions. At each instant, can be expressed as a weighted inner product of : , where
and the weight matrix, , can be obtained through the Cholesky factorization of : . This expression suggests the weighted data, , is appropriate as the input for PCA. However, and are time-dependent, and incompatible with PCA requiring constant weight.
We overcome this obstacle by pre-processing the data. The schematic is shown in Figure 1. We transform into new variables and find a corresponding constant weight matrix, namely , such that the PCA of weighted data, , becomes physically meaningful. is the transformed data matrix: . Such can be identified by considering the R-P equation. First, we consider a single bubble. By transformation , the R-P equation can be expressed as

Figure 1. Schematics of the feature extraction by PCA from Lagrangian bubble dynamics data, , after pre-processing. The variance of the resulting features is consistent with the interaction potential energy predicted by the Rayleigh-Plesset equation.
and are the pressure inside the bubble and that in infinity, respectively. Next, we project the system. Given data, a time average can be obtained for as . Using , eqs. (4), we project the system onto a space spanned by a set of new variables .
Although and are partially decoupled, this system models the dynamical features of the R-P equation including bifurcation. Physically speaking, the rapid change of has a relatively small influence on the evolution of at the timescale of (statistically) stationary bubble oscillations. This projected system informs that can be approximated using : . Now we can apply the same procedures to clusters. can be approximated for and as
Now, the constant is obtained through . The PC decomposition is performed as . The -th PC is stored in . We denote the -th largest singular value of as . The degree of coherence can be measured by , the ratio of the first PC-variance to the total energy.
We introduce two additional key measures to characterize the coherent physics. First, to quantify the degree of incoherence through PCA, we define the von Neumann entropy of the co-variance matrix of , . is a quantum analogue of the Shannon entropy and is used to quantify the entanglement of states from a density matrix [29]. Here, . We normalize by : . When bubbles are in perfect correlation, we expect to excite only the first PC capturing the entire energy of the system: and . In contrast, when the energy is equi-partitioned into all PCs, and . Second, we define the coherence measure : . quantifies the degree to which the coherent interactions represented by the first PC is controlled by . is a portion of the first PC-variance excluding the contribution of the interaction potential, obtained from PCA of weighted by an alternative matrix . is defined through , where includes only the diagonal entries of : . The corresponding inner product, , represents the energy excluding the interactions. In the limit of perfect correlation, (see eq. (1)) and . This condition is typically realized in monodisperse clusters under weak (linear) oscillations [17].
We neglect bubble’s translation and deformation; their effects are short-range and can be less dominant than volumetric oscillations for the coherent physics. PCA can nevertheless incorporate dynamical variables controlling the bubble’s position [30] and the shape [31]. Of course, the models able to capture these effects are usually computationally expensive and the generation of database may become prohibitive.
To verify and demonstrate PCA, we use data sets of spherical clusters excited by 40 cycles of harmonic pressure excitation. Each cluster contains bubbles with their initial radii following log-normal distributions with a reference radius of ; , where is the polydispersity measure [19]. The bubbles are randomly distributed in the spherical region with a specified cluster radius. Similar parameters of clusters were previously simulated to compare with experiments [19, 21]. The sparsity of bubbles is characterized by , the equilibrium value of . The excitation frequency is 500 kHz unless noted, near the adiabatic resonant frequency of the reference bubble. The pressure amplitude, , is normalized by 1.0 atm. For data generation, we use mesh-free, coupled Keller-Miksis equations by modifying previous methods [32, 33]. Details are provided in supplementary material [34]. For PCA, the method for data generation can incorporate experimental measurements as well as other numerical approaches. The cluster’s shape can be arbitrary.
To show the effectiveness of the pre-processing, in Figure 2, we plot the relative errors of the time-averaged kinetic energy of sparse and dense clusters with and 5.0, computed using the original and transformed variables and against the excitation amplitude. At , the error is nearly zero for both approximations. At , at which bubble dynamics become nonlinear, the error grows with for the former, while it remains small for the latter. This result confirms the improved approximation by the pre-processing.

Figure 2. Relative error of the mean kinetic energy of clusters obtained by the two approximations, and , against the excitation pressure amplitude. Results for two polydispersities (black: , red: ) are shown.
The coherent dynamics critically depend on the excitation amplitude. This dependence is best highlighted in the sparse, weakly polydisperse cluster (, ). Figure 3a shows the correlations of , , and with . The relative importance of the first PC, , decays nearly monotonically from 0.9 to 0.2 through three distinct regimes. For , meaning the entire energy is captured by the first PC. Then rapidly decays to 0.4 and stays nearly constant up to . At , decays again and stay nearly constant around 0.2. The decay indicates the decrease in the coherence with increasing and can be explained by the excitation of the nonlinear oscillations and cavitation triggered at and above. has a profile vertically mirrored to ; increases from around 0.1 to 0.5 through the three regimes, indicating more partitioning of the energy into multiple PCs and increase of incoherence, by increasing . The mirrored profiles of and suggest that these parameters are complementary.

Figure 3. (a) The first PC-variance (), the normalized von Neumann entropy (), and the coherence measure (), against the excitation amplitude. (b-d) The PC spectral profiles at , , and . Insets show the evolution of the square-root of the normalized total energy () and the first and the second PC-variances ( and ), during the four periods of excitation, being a non-dimensional time . The -axis of each inset is normalized by the maximum value of .
Remarkably draws a square-well like profile, where for both low () and large () amplitudes reaching a minimum value () at . This counter-intuitive result suggests that the
coherence scaled by is dominant, while the scaling is lost only for the intermediate range at . To gain deeper insights, in Figure 3b-Figure 3d we show the PC-variances obtained at , , and , for the first 10 PCs. The insets show the evolution of the square-root of the normalized total energy and those of the relative amplitude of the first and the second PC-variances (, , and ), during the four periods of excitation in statistically stationary states. As expected, in the linear regime (Figure 3b), the first PC occupies nearly the entire energy. evolves at the fundamental frequency. In the transition regime (Figure 3c), the first PC occupies 40% of the energy and the rest is partitioned into the sub-dominant PCs with a smooth decay. Both and evolve with similar a-periodic profiles. We interpret that both PCs represent the coherent component of the energy. Interestingly, in the nonlinear regime (Figure 3d) the energy partition is non-smooth; the first PC occupies 20% of the total energy, while the rest is broadly distributed into the other PCs with a much smaller amplitude. The evolution of is noisy, which can be explained by the chaotic response of individual bubbles. The evolution of is, in contrast, much smoother and periodic, and somewhat resembles that of Figure 3b. The evolution of is a-periodic. The results suggest that, in this regime, only the first PC captures the coherent feature and the others represent the incoherent dynamics as broadband noise. The resemblance of the evolution of the first PCs in the linear and the nonlinear regimes can explain the recovery of at in Figure 3a. Although the overall dynamics are much noisier in the nonlinear regime, the contribution of the coherent interactions to the system’s energy effectively appears only in the first PC in both regimes and therefore the degree of this contribution is scaled by in a similar manner, also implying that the underlying coherence in the nonlinear regime represents the perfect correlation.
To assess the universality of the scaling at large , in Figure 4 we plot against for clusters with various values of , , , and other parameters, and constant (2 MPa). Supplementary material summarizes the parameters [34]. Surprisingly, the data points are collapsed on the line of , meaning that the coherence of these clusters are scaled by , regardless of the parameters. In the linear regime, the scaling is found to hold only for monodisperse clusters [34], agreeing with the previous theories [17, 18]. The results suggest that the scaling is universal for cavitating clusters, which are typically excited at MPA and above. Physically speaking, linear mean field represented by originally identified for monodisperse clusters is found here to control the underlying coherence in highly disordered clusters. This finding also explains the previous success of in characterizing and controlling polydisperse cavitating clusters observed in experiments [19, 21].

Figure 4. against , for clusters with various values of , , , and other physical parameters [34] in the nonlinear regime, excited at . The data points are collapsed on the line of , indicating that near-perfect correlation is isolated in the first PC and globally scaled by , regardless of the parameters.
In conclusion, to address the long-standing question on the coherent dynamics of bubble clusters, we propose a method for unsupervised learning of the many-body physics of interacting bubbles by combining theory and PCA. The method pre-processes bubble dynamics data and extracts coherent dynamical features whose energies are consistent with the R-P equation. Analyzing simulation data sets of clusters under harmonic excitation, we show that the coherence and incoherence are respectively quantified by the PC-variance and the von Neumann entropy. The PCA also shows that the coherence is lowered by polydispersity and nonlinearity, while under strong excitation near-perfect correlation is isolated in a single coherent mode globally scaled by , regardless of the disorders. These results highlight the method’s use as well as indicate that the underlying coherent dynamics may be universal in cavitating clusters. For future studies, the scaling argument may provide for a theoretical ground that cavitation and nucleation can be characterized and controlled without measuring individual nuclei.
Some of the computation presented here utilized the Extreme Science and Engineering Discovery Environment (XSEDE), which is supported by NSF under grant TG-CTS190009. K.M. conceived and designed the study, developed methodology, and performed data processing and analysis. Both authors contributed to data generation and the manuscript.
Keller-Miksis equation for multiple bubbles
In this section, we provide details of the formulation of the Keller-Miksis (K-M) equation for multiple bubbles that is used to generate the Lagrangian bubble dynamics data.
Various extensions of the Rayleigh-Plesset equation to a system of ODEs which describe the dynamics of multiple bubbles are available [S1-4]. As a variant of such extensions, we employ the K-M equation for multiple bubbles to account for liquid compressibility which becomes important for the dynamics of cavitating bubbles. To begin with, we recall the general formulation for interacting spherical bubbles in weakly compressible liquid with arbitrary inter-bubble distances, as provided in Appendix 2.4 of [5]. With being the sound speed in liquid, the radial evolution of bubble is described as
where and represent the forcing due to the external potential and the inter-bubble interaction, respectively, and are expressed as
and
is the velocity potential of liquid at infinity, and and are the potential and the enthalpy of liquid evaluated at the surface of bubble . is the retarded time defined as , where represents the travel time for the pressure wave to reach bubble from the surface of the bubble and is the distance between the centers of those bubbles. In the sparse limit, the equation recovers the original Keller-Miksis equation [6].
To close the equations, several relations are considered. Using the Bernoulli’s equation, the potential for the bubble can be expressed as
The velocity potentials at the bubble and bubble satisfy the following relation.
The enthalpy and the potential derivative are approximated as
Finally, is the background pressure known a-priori (the pressure at the location of the bubble excluding the contributions of the bubbles oscillations, typically equivalent with the excitation pressure imposed by external sources).
This system of ODEs, however, involves time delay (delayed differential equations: DDE) and simulations can become cumbersome. Therefore, we newly simplify the system by invoking further approximations. First, consider that the bubble cluster size is smaller than the characteristic length-scale of the pressure wave in the field, . The inter-bubble distance in the cluster is naturally smaller than :
Dividing both sides with ,
where and are the characteristic frequency and the period of the wave in the field. Therefore, the difference between and is much smaller than the characteristic timescale of the dynamics. Given this knowledge, we approximate that . Second, we neglect the terms in the order of . Using these approximations, we can simplify and as
and
For harmonic excitation,
We use polytropic law to describe the pressure of the gas inside each bubble [7].
where is the constant polytropic exponent. Eqns. (7), (17) and (18), together with relations (19) and (20) provide a complete system of ODEs for the radius of interacting bubbles, which can be readily solved with a given initial condition using a standard time integration method.
Summary of the parameters
| [mm] | [m] | [kHz] | ||
| 16 | 0.33–2.0 | 10 | 0.1–0.7 | 500 |
| 32 | 0.33–2.0 | 10 | 0.1–0.7 | 500 |
| 64 | 0.33–2.0 | 10 | 0.1–0.7 | 500 |
| 128 | 0.33–2.0 | 10 | 0.1–0.7 | 500 |
| 256 | 0.33–2.0 | 10 | 0.1–0.7 | 500 |
| 512 | 0.8–2.0 | 10 | 0.1–0.7 | 500 |
| 64 | 0.33–2.0 | 5 | 0.1–0.7 | 500 |
| 64 | 0.33–2.0 | 10 | 0.1–0.7 | 250 |
Table 1. Summary of the parameters used for the simulation of clusters plotted in Figure 4 of the main manuscript.
Table 1 summarizes a set of parameters for the clusters plotted in Figure 4 of the main manuscript. The number of bubbles , cluster radius , reference bubble radius , polydispersity measure , and the forcing frequency were varied.

Figure S1. as a function of , for clusters with various parameters. (a) and (b) .
Scaling in the linear and the transition regimes
In order to assess the scaling of the coherence in the linear and the transition regimes of bubble clusters, we simulate various parameters of clusters with a weak () and an intermediate amplitude () of pressure waves. The parameters used for these simulations are summarized in Table 2.
| [mm] | [m] | [kHz] | ||
| 16 | 0.33–2.0 | 10 | 0.1–0.7 | 500 |
| 32 | 0.33–2.0 | 10 | 0.1–0.7 | 500 |
| 64 | 0.33–2.0 | 10 | 0.1–0.7 | 500 |
| 128 | 0.33–2.0 | 10 | 0.1–0.7 | 500 |
Table 2. Summary of the parameters used for the simulation of clusters plotted in Supplementary figure 1.
Figure 1 shows as a function of for these clusters. For the case of the weak amplitude, bubble oscillations are in a linear regime and . The data points are collapsed on the coherence line () for , while data are scattered for the other values of . This result is expected as was originally defined to scale the coherence of the monodisperse, perfectly correlated bubbles in the linear regime. For the intermediate amplitude case, the bubble oscillations are nonlinear. The data points are scattered from the coherence line, regardless of the value of . In this regime, the result indicates that the coherence is lost due to the nonlinear dynamics, regardless of polydispersity.
References
- [5][S5] D. Fuster and T. Colonius. Modelling bubble clusters in compressible liquids. J. Fluid Mech., 688:352–389, 2011.
- [6][S6] J.B. Keller and M. Miksis. Bubble oscillations of large amplitude. J. Acoust. Soc. Am., 68(2):628–633, 1980.
- [7][S7] C.E. Brennen. Cavitation and bubble dynamics. Cambridge University Press, 2014.