betaFeedback

WorksPhysics and Astronomy

Multiplexed digital holography for fluid surface profilometry

Abstract

Digital holography (DH) has been widely used for imaging and characterization of micro and nanostructures in materials science and biology and has the potential to provide high-resolution, non-destructive measurements of fluid surfaces as well. Digital holographic setups capture the complex wavefronts of light scattered by an object or reflected from a surface, allowing for quantitative measurements of their shape and deformation. However, their use in fluid profilometry is scarce and has not been explored in much depth. We present an alternative usage for a DH setup that can measure and monitor the surface of fluid samples. Based on DH reflectometry, our modelling shows that multiple reflections from the sample and the reference interfere and generate multiple holograms of the sample, resulting in a multiplexed image of the wavefront. The individual interferograms can be isolated in the spatial-frequency domain, and the fluid surface can be digitally reconstructed from them. We further show that this setup can be used to track changes in the surface of a fluid over time, such as during the formation and propagation of waves or evaporation of surface layers.

Introduction

The need for fast and accurate measurements of surfaces has exploded with the advent of automatic production lines and progress in computer vision. Today, popular methods are based on correlating images taken from slightly displaced vantage points [1], local deformations of periodic patterns [2, 3], and time-of-flight imaging. Despite such great advances in profilometry, precision detection of fluid interfaces, usually between liquid and gas, remains a challenge and has resulted in various developments in experimental fluid studies. Some notable methods applied to fluids include Fourier Transform Profilometry (FTP) and Digital Image Correlation (DIC). For instance, the former has been implemented using the projection of fringe patterns [4] or a background reference checkerboard [5]. While image correlations using random backdrops have also been used to reconstruct fluid surfaces [6].

Over the last two decades, an interesting avenue for high-precision profilometry has appeared in the field of digital holography [7, 8, 9, 10, 11, 12, 13, 14]. Holography, the complete reconstruction of the optical wavefront using diffraction theory, was introduced by Gabor in 1948 [15]. In the years that followed, Gabor demonstrated the ability to extract 3D information from a 2D hologram to regain focus and spatial resolution [16, 17]. The first successful image reconstruction using digital holography appeared already in 1967 [18]. However, it was not until 1994 that Schnars and Jüptner introduced the first ever digitally reconstructed hologram using a CCD camera [19], based on the off-axis method proposed by Leith [20]. Subsequently, Cuche et al. introduced the possibility of using digital holography (DH) as a quantitative phase measurement [21], now called off-axis digital holography. Spatially modulated phase-fronts are often used in the field, sometimes carrying several modulations that can be separated in the spatial-frequency domain (SFD) [22, 23, 24, 25, 26].

Here, we extend fluid profilometry and digital holography methods to develop a detection scheme for fluid surfaces. When one arm in a Michelson interferometry setup probes a fluid sample, the resulting hologram is a multiplexed composition of several interference patterns, whose phases are proportional to the profile of the fluid surface. We present a systematic method to harvest the latter from modulations on the carrier peaks of each pattern, which can be singled out in the spatial frequency domain. By employing relative off-axis adjustments of the beam paths, we can optimise the separation of the carriers in the frequency domain. The relative demodulation between consecutive time frames can then be used to accurately reconstruct variations on the fluid surface.

Modelling and Simulation

As commonly employed in off-axis Digital Holography (DH), we begin with a Michelson interferometer, shown in Fig. 1. In this setup, a laser beam of wavelength λ\lambda is expanded to the desired width before being parted into two arms at the beam splitter. One acts as a reference (RR) by reflecting from a mirror (MrM_{\mathrm{r}}). The other arm probes the sample, where the beam is reflected partially by the fluid surface and partially by the mirror (MbM_{\mathrm{b}}). The general strategy of off-axis DH that we explore here is to slightly misalign the reference with respect to the probe beam resulting in a plurality of linear interference patterns. Hence, after the two arms recombine in the beam-splitter, a digital camera (CC) captures the interferograms (or holograms). In what follows, we briefly discuss the relations between the sample’s height profile and the fringe patterns resulting from the path differences of various components of the probe beam.

Figure 1. Schematic of proposed setup. A laser source (L) emits a collimated beam that expands to the desired diameter by passing through a Beam Expander (BE). A Beam Splitter (BS) divides the beam into two, namely a probe going through the fluid sample and a reference (RR), both reflecting from adjustable mirrors (MM). The reflected trajectories recombine in the beam splitter and the resulting beam is captured by a camera (C). In the figure, the multiple beams reflected from the fluid surface (FF) and the probe mirror (B1B_1, B2B_2) contribute to the multiple interference peaks discussed in section 2II A.

Phase differences and sample’s height profile

We begin by examining the optical paths of different types of rays as they traverse an air-fluid interface z=h(t,r)z=h(t,\mathbf{r}). More precisely, consider a ray that starts at some reference height z=Hz=H with transverse horizontal coordinate r\mathbf{r}, and moves downwards to the fluid interface z=hz=h, where it will be partially transmitted, partially reflected. We shall refer to the latter as an FF-type ray. The transmitted ray travels through the fluid and reaches a submerged plane mirror MbM_b at the bottom of the basin. Consequently, the fluid interface and the mirror act as a cavity, producing a collection of partially transmitted rays BjB_j, labelled by the number jj of internal reflections inside the fluid (see Fig. 1). At the beam splitter, the probe arm, containing FF and BjB_j rays, recombines with the reference arm RR reflected from the mirror MrM_r, which yields a beam exhibiting four families of interferograms, namely: RFRF, RBjRB_j, FBjFB_j, BℓBjB_\ell B_j. For any pair ABAB of these rays, their phase difference ΦAB=ΦA−ΦB\Phi_{AB}=\Phi_A-\Phi_B is proportional to their optical path differences. Camera CC captures the interfered beam and generates an image Y=(Yij)Y=(Y_{ij}) displaying the combined intensity profile of all interferograms, for positive integer pixel locations (i,j)(i,j). We shall assume all phase differences ΦAB\Phi_{AB} to have small modulations ϕ(AB)(t,r)\phi^{(AB)}(t,\mathbf{r}) around a stationary planar phase kAB⋅r\mathbf{k}_{AB}\cdot\mathbf{r}. That is, ΦAB(t,r)=ϕ(AB)(t,r)+kAB⋅r\Phi_{AB}(t,\mathbf{r})=\phi^{(AB)}(t,\mathbf{r})+\mathbf{k}_{AB}\cdot\mathbf{r}, so that

Yij=Y0(1+∑ABA≠BAABexp⁡(ikAB⋅rij+iϕij(AB)))+δYij,(1)Y_{ij}=Y_0\left(1+\sum_{\substack{A B\\A\ne B}}\mathcal{A}_{AB}\exp\left(i\mathbf{k}_{AB}\cdot\mathbf{r}_{ij}+i\phi_{ij}^{(AB)}\right)\right)+\delta Y_{ij}, \tag*{(1)}

where δYij\delta Y_{ij} is a stochastic variable that describes the noise in the image, for an arbitrary intensity Y0Y_0 and amplitudes AAB\mathcal{A}_{AB} (see Supplemental Document for their formulae).

Let us now consider that both mirrors are slightly tilted with respect to the optical axis z^\hat{\mathbf{z}}, i.e., their normal unit vectors mb\mathbf{m}_b and mr\mathbf{m}_r are such that mb⋅r^≪1\mathbf{m}_b\cdot\hat{\mathbf{r}}\ll1 and mr⋅r^≪1\mathbf{m}_r\cdot\hat{\mathbf{r}}\ll1. In these conditions, one can show that for weak surface slopes, i.e., ∣∇h∣≪1|\nabla h|\ll1, the phase differences carried by each family of holograms read (cf. [27, 28])

ΦRF=2k0n1(h+mr⋅r+ΔH),(2)\Phi_{RF}=2k_0n_1\left(h+\mathbf{m}_r\cdot\mathbf{r}+\Delta H\right), \tag*{(2)}
ΦRBj=2k0[(n1−jn2)h+(n1mr−jn2mb)⋅r+n1ΔH],(3)\Phi_{RB_j}=2k_0\left[(n_1-jn_2)h+(n_1\mathbf{m}_r-jn_2\mathbf{m}_b)\cdot\mathbf{r}+n_1\Delta H\right], \tag*{(3)}
ΦFBj=2k0n2[jh+jmb⋅r],(4)\Phi_{FB_j}=2k_0n_2\left[jh+ j\mathbf{m}_b\cdot\mathbf{r}\right], \tag*{(4)}
ΦBℓBj=2k0n2[(ℓ−j)h+(ℓ−j)mb⋅r],(5)\Phi_{B_\ell B_j}=2k_0n_2\left[(\ell-j)h+(\ell-j)\mathbf{m}_b\cdot\mathbf{r}\right], \tag*{(5)}

where ΔH≡HR−H\Delta H\equiv H_R-H is the difference in arm length of the reference beam HRH_R and the probe beam HH, n1n_1 and n2n_2 are the refractive indices of the surrounding medium (e.g. air) and the fluid, respectively. We define the laser’s wavenumber as k0=2π/λk_0=2\pi/\lambda.

From (10), we see that the planar phases kAB⋅r\mathbf{k}_{AB}\cdot\mathbf{r} are proportional to mb⋅r\mathbf{m}_b\cdot\mathbf{r} and mr⋅r\mathbf{m}_r\cdot\mathbf{r}. In the presence of non-vanishing small tilts in the normal vectors mr\mathbf{m}_r and mb\mathbf{m}_b, an image YijY_{ij} obtained from the camera displays the collection of distinguishable fringe patterns, with phases given by (10). One such simulated image frame is given in panel (a) of Fig. 2. By performing a two-dimensional Fourier transform F\mathcal{F} of the image, i.e. Y^ij=F[Y]ij\hat{Y}_{ij}=\mathcal{F}[Y]_{ij}, one can inspect its spectrum in spatial-frequency domain (SFD), where the holograms separate into distinct spatial carrier frequencies. Fig. 2 (b) shows the frequency domain of the corresponding simulated image YijY_{ij} in Fig. 2 (a). The signal, the interfacial height h(t,r)h(t,\mathbf{r}) here, appears as a modulation of the spatial carrier kAB\mathbf{k}_{AB}, for any family of interferograms ABAB. Thus, the corresponding δϕAB\delta\phi_{AB} in the phase of a carrier due to deformations δh\delta h on the sample’s interface are given by

(δϕAB2π)=2αAB(δhλ),(6)\left(\frac{\delta\phi_{AB}}{2\pi}\right)=2\alpha_{AB}\left(\frac{\delta h}{\lambda}\right), \tag*{(6)}
αAB={n1,for AB=RF;jn2,for AB=FBj;n1−jn2,for AB=RBj.\alpha_{AB}= \begin{cases} n_1, & \text{for } AB=RF;\\ jn_2, & \text{for } AB=FB_j;\\ n_1-jn_2, & \text{for } AB=RB_j. \end{cases}

When there are multiple rays with different carrier frequencies, as in (10), the resulting intensity is referred to as Multiplexed Off-axis Digital Holography (see, e.g. [25]). Here multiplexing refers to the fact that several independent measurements can be packed into a single snapshot. of the intensity due to their separation in SFD. While the multitude of rays resulting from partial reflection has been exploited in existing digital holography techniques, called Digital Holographic Reflectometry [27, 28], there is one important difference from the approach presented here. By introducing a tilt mb\mathbf{m}_{b} of the submerged mirror, the collection of partially reflected rays separate and isolated off-axis holograms may be formed by any pair of rays. With the adjustability of the submerged mirror, we may use a simple Michelson interferometer in Fig. 1 to perform simultaneous, independent measurements of the surface by virtue of the multiplexing in (10). That is, our method is a multiplexed off-axis extension of digital holographic reflectometry. It is worth noting that because of the tilts, different holograms will image slightly shifted regions of the fluid interface. Hence, the reconstructed profile hABh_{AB} of an interferogram ABAB is related to the fluid surface profile hh by hAB(t,r)=h(t,r+δAB)h_{AB}(t,\mathbf{r}) = h(t,\mathbf{r} + \boldsymbol{\delta}_{AB}), where δAB\boldsymbol{\delta}_{AB} is a spatial displacement related to the physical tilt between rays AA and BB (see Fig. 2). It is worth noting that a similar argument would apply to variations in time. However, the time that the BjB_j rays take to travel through the fluid, reflect from the bottom mirror or the surface and recombine with other rays is negligible compared to the time scales of low-frequency waves on the fluid surface.

Numerical phase-tracing and simulated holograms

We initially investigate the validity of the proposed model by numerically simulating the result of an experimental acquisition. This can be done by iteratively propagating a mesh of rays through a mathematical formulation of the setup presented in Fig. 1 (see Supplemental Material for details). We model the two mirrors as tilted planes z=−mb⋅rz = -\mathbf{m}_{b} \cdot\mathbf{r} and z=−mr⋅rz = -\mathbf{m}_{r} \cdot\mathbf{r}, and define the interface z=h(t,r)z = h(t,\mathbf{r}) for some analytic function h(t,r)h(t,\mathbf{r}). We then start with a cartesian mesh of reference positions for the initial ray and all directions to be equal and perfectly downward-facing. Each ray in the mesh may then be propagated linearly to the intersection point z=h(t,r)z = h(t,\mathbf{r}), where the Fresnel boundary conditions can be used to split the initial amplitude in a reflected and refracted component. The refracted mesh of rays produces new rays at each reflection of the free surface from below. At every interface encountered, the amplitudes are modified, and at every propagation of length between interfaces, the phase attains a contribution proportional to the optical path difference. By collecting all rays that reach the detector plane at z=Hz = H within a number NiN_i of iterations and interpolating them to shared horizontal coordinates, we are left with a collection of discretized estimates for the rays RR, FF, {Bj}\{B_j\}. A synthetic image may then be produced by combining the intensities of all families of interferograms and sampling from a Poisson distribution to include noise in the simulation. By evolving

Figure 2. Numerical simulation. In (a), we display a numerically simulated intensity image YY with an inset highlighting an expanded region (white dashed rectangle) of the image. A white line on the lower-left corner depicts a length of 2 mm. The spatial Fourier transform Y^\hat{Y} of the simulated intensity YY is shown in (b), where the brightness of each pixel is proportional to the logarithmic amplitude log⁡∣Y^∣\log|\hat{Y}|. White lines are drawn to illustrate the carrier frequencies for the holograms RB1RB_{1}, RFRF, FB1FB_{1} and RB2RB_{2} in line with (10). In (c)-(f), we show the four corresponding phase differences δϕ(AB)\delta\phi^{(AB)} between two consecutive time frames for holograms ABAB with a shared colorbar. The visibly correlated spatial dependence of the phases is proportional to the change in fluid height δh(r)\delta h(\mathbf{r}). Slices of the phases at the white, dashed lines in (c)-(f) are shown in (g) already converted to height variations δh\delta h using the prefactors obtained from the model of (6). The black line indicates the ground-truth height change δh\delta h used to generate the simulation. The spatial displacement between the reconstructed curves and the ground truth confirms the expected shift due to the relative tilts between the sample and reference mirrors.

the simulated fluid surface in time intervals of δt\delta t, we obtain consecutive frames of the intensity image YijY_{ij}. The result of this procedure for the fluctuation in height profile δh(t0,r)=h(t0+δt,r)−h(t0,r)\delta h(t_0,\mathbf{r}) = h(t_0+\delta t,\mathbf{r}) - h(t_0,\mathbf{r}) for two consecutive times of standing waves in a square basin is shown in Fig. 2.

The Detection Method

We turn to the reconstruction of different phase fields from a digital image. We discuss in this section the canonical approach, which in the context of digital holography is referred to as the Angular Method [7], and Fourier Demodulation [29] in that of fluid profilometry. We then explore the alternatives for identifying the various families of peaks in an experimental setup.

Digital recovery of the phase

With the Michelson setup presented in Fig. 1, a digital image YijY_{ij} as in (1) can be obtained. The Fourier spectrum of YijY_{ij} displays intensity peaks around the kAB\mathbf{k}_{AB} vectors, whose positions are proportional to mr\mathbf{m}_r and mb\mathbf{m}_b, as per (10). For convenience, we label each peak by an integer mm, and provided with some function Gm(k)G_m(\mathbf{k}) that is non-vanishing around the carrier km\mathbf{k}_m only, we define a Fourier filter Fm≡F−1Gm(k)FF_m \equiv\mathcal{F}^{-1}G_m(\mathbf{k})\mathcal{F} around each peak. In line with the Fourier Demodulation, see e.g. [2, 5], we select a reference image (Y0)ij(Y_0)_{ij} filtered around one of the carriers, i.e., Fm[Y0]ijF_m[Y_0]_{ij}, to recover the phase variations Δϕij(m)\Delta\phi_{ij}^{(m)} with respect to the reference. Neglecting noise contributions, the outcome is then:

Δϕij(m)=Im⁡{log⁡[(Fm[Y]ij)(Fm[Y0]ij)∗]}.(7)\Delta\phi_{ij}^{(m)} = \operatorname{Im}\left\{\log\left[(F_m[Y]_{ij})(F_m[Y_0]_{ij})^*\right]\right\}. \tag*{(7)}

Numerically, this equation will only yield values between −π-\pi and π\pi. Thus, if the change in phase Δϕij(m)\Delta\phi_{ij}^{(m)} resulting from a height variation δh\delta h in (6) is larger than one period of 2π2\pi, then a phase unwrapping algorithm, such as that of [30], is required.

One way to avoid the issue of phase wrappings is to consider changes in phase from some reference time t0t_0 to the time tt in question. If the carrier’s position does not drift from t0t_0 to tt, i.e. km(t0)=km(t)\mathbf{k}_m(t_0) = \mathbf{k}_m(t), then, the reconstructed phase difference reads Δϕij(m)≡ϕij(m)(t)−ϕij(m)(t0)\Delta\phi_{ij}^{(m)} \equiv\phi_{ij}^{(m)}(t) - \phi_{ij}^{(m)}(t_0). Given a sequence of images {Yij(tn)}n=1N\{Y_{ij}(t_n)\}_{n=1}^{N} taken at equidistant times δt≡tn+1−tn\delta t \equiv t_{n+1} - t_n, there are two canonical choices for the reference time t0t_0. First, one may choose t0t_0 to be a constant reference, e.g. the initial frame t0=t1t_0 = t_1. We shall refer to this approach as the absolute reconstruction. Alternatively, one can choose the previous image as the reference, i.e. t0=t−δtt_0 = t-\delta t. We shall refer to this approach as the relative reconstruction. Lastly, we shall refer to the full reconstructed phase ϕij(m)\phi_{ij}^{(m)} using a synthetic reference image of a plane wave exp⁡(ikm⋅r)\exp(i\mathbf{k}_m\cdot\mathbf{r}) as synthetic reconstruction, which is always determined

up to a global phase wrapping value ℓm\ell_m. In the simulated data of Fig. 2, we employed the relative reconstruction to obtain the phases displayed in (c)-(f) (See Supplemental Document for more details).

Peak identification and prefactor estimates

There are two different approaches which one may use to identify the peaks and estimate the prefactors, and hence the height fluctuations δh(r,t)\delta h(\mathbf{r},t). The first one is an experimental procedure that can be followed when acquiring data and will be discussed in section 4IV A. When manipulating the experimental setup is not possible or desirable, the second method may be used by employing a statistical tool called Principal Component Analysis (PCA) [31, 32]. Along this line, the holograms may be identified directly from the reconstructed phases ϕij(m)\phi_{ij}^{(m)}. From (6), we note that the phases ϕij(m)(t)\phi_{ij}^{(m)}(t) scale linearly with the surface height h(rij,t)h(\mathbf{r}_{ij},t). Thus, we can recover the proportionality prefactors between measured phases and the profile of the fluid surface and use them to estimate the refractive indices. The collection of reconstructed phases {ϕij(m)}m=1M\{\phi_{ij}^{(m)}\}_{m=1}^{M} can be seen as an MM-dimensional vector field p=(ϕij(1),…,ϕij(M))\mathbf{p} = \left(\phi_{ij}^{(1)},\ldots,\phi_{ij}^{(M)}\right). Spatial or temporal fluctuations δh\delta h in the surface height hh will result in a change in p\mathbf{p} given by δp=2k0∇δh\delta\mathbf{p} = 2k_0\nabla\delta h, for a constant vector v=(α1,…,αM)\mathbf{v} = (\alpha_1,\ldots,\alpha_M), which depends on the refractive indices exclusively.

We employ to this configuration a Principal Component Analysis (PCA). For that, we consider the spectrum Cℓm=λkCkmC_{\ell m} = \lambda_k C_{km} of the covariance matrix Cℓm=⟨Xij(ℓ)Xij(m)⟩C_{\ell m} = \left\langle X_{ij}^{(\ell)}X_{ij}^{(m)}\right\rangle, for centralised variables Xij(m)≡ϕij(m)−⟨ϕij(m)⟩X_{ij}^{(m)} \equiv\phi_{ij}^{(m)} - \left\langle\phi_{ij}^{(m)}\right\rangle. Here, the average ⟨⋅⟩\langle\cdot\rangle may be performed over space (pixels (i,j)(i,j)) or time (frames) according to the required application. If the retrieved phases measure the same surface hh, the covariance matrix CC has a principal component, i.e., one eigenvector vp\mathbf{v}_p with eigenvalue λp\lambda_p much larger than the others. In our case, the vector of prefactors v\mathbf{v} must then be the principal component of CC. To evaluate how well the data in p\mathbf{p} can be represented by a single quantity hh along the direction of v\mathbf{v}, we observe the normalised eigenvalues sg⁡p≡λp/∑kλk\operatorname{sg}_p \equiv\lambda_p/\sum_k\lambda_k. We denoted this quantity as the confidence of PCA, and it takes values from 0 to 1, where sg⁡p=1\operatorname{sg}_p = 1 implies that all variation in the data is along the principal component vp\mathbf{v}_p. Whereas for sg⁡p=0\operatorname{sg}_p = 0, there is no variation in the data.

Results and discussion

The setup, as shown in Fig. 1, is proposed to be used as a profile sensor over a circular area on the fluid surface. For this, we employ a diode pumped solid state laser source with wavelength 532 nm and power of 1 mW and expand the input beam to our desired width of approximately 20mm using a beam expander. The fluid sample is placed in a square basin of side 84 mm with a 1-inch mirror at its bottom. The expanded probe and reference beams are then set in off-axis alignment as described previously. The multiple reflections from the mirror and the fluid surface give rise to multiple interferograms, in line with (1), and are acquired over time using a grayscale CMOS camera with bit-depth if 12 bits. Using the procedure presented in section 3III A, the phases of the available interferograms are then numerically reconstructed. This, in turn, gives information on the fluctuations on the fluid surface, which are mainly due to vibrational noise but also thermal effects, changes in refractive index or other external disturbances. For the purposes of this work, the data was acquired from a setup assembled on a noise-isolating table.

Fluid surface profile

An example frame Y\mathbf{Y} is shown in Figure 3(a) with its spatial Fourier transform F[Y]\mathcal{F}[\mathbf{Y}] displayed in Figure 3(b). Unlike the simulated image in Fig. 2, Figure 3(b) contains many extra dimmer peaks, which are from partial reflections at the faces of the optical components, mainly the beam-splitter. In the experimental Fourier spectrum, it is not straightforward to label the correct peaks associated with different holograms. We developed a graphical user interface with a live view of the spatial frequency domain to aid in the labelling of the various peaks. The reconstructed phase and interferograms can also be viewed in real-time using this application. The most prominent peak in the Fourier space is always the RB1RB_1 because of the beams of maximum intensities reflected from the reference and probe mirrors. When the reflected beam from the reference mirror is blocked, the only remaining interference is between the probe mirror and the fluid surface, i.e., holograms of the family FBjFB_js. The brightest one in this group can be labelled as FB1FB_1. Further adjustments in the reference mirror alone keep the positions of FBjFB_js fixed, and with the adjustments in the probe mirror alone, the position of RFRF remains unaffected. This method allows for the preliminary identification and labelling of the prominent peaks from the spatial-frequency domain of the experimental data.

Image not extracted

Figure 3. Reconstruction of water surface profile. In (a), a sample image frame acquired from the experimental setup, the solid, white line indicates a length of 2 mm. The spatial-frequency domain of the image in (a) is shown in (b). The four main peaks labelled by the procedure described in the text are shown in (b). Their reconstructed height change obtained by using the inferred prefactors of (6) are shown in (c)-(f). The white dashed line in (c)-(f) corresponds to a diameter of 15.5 mm. In (g), we display a horizontal slice of δh\delta h for all labelled peaks. The shaded regions indicate the root-mean-square deviation from the average reconstruction δh=14∑ABδhAB\delta h = \frac{1}{4}\sum_{AB}\delta h_{AB} of the four interferograms given by ⟨∣δhAB−δh∣2⟩τ\sqrt{\langle|\delta h_{AB}-\delta h|^2\rangle_\tau}. All curves in (g) qualitatively and quantitatively recover the same interface with various degrees of noise. Albeit small, we see that the spatial shift introduced by the relative tilts between the sample and reference mirrors persists.

Upon identifying the peaks and hence their phase-prefactors according to (6), the height fluctuations δh(r,t)\delta h(\mathbf{r},t) on the fluid surface can be determined using the reconstructed phases. In Figure 3(c)-(Figure 3f), we display the height change δh\delta h reconstructed from multiple peaks between two consecutive frames 12.5 ms apart, i.e., δh≡h(r,t+δt)−h(r,t)\delta h \equiv h(\mathbf{r},t+\delta t)-h(\mathbf{r},t). The panels (c-f) in Figure 3 are ordered by decreasing intensity of their corresponding peak, i.e., RB1RB_1 is the brightest and RB2RB_2, the faintest. It is clear that all four independent reconstructions retrieve the same qualitative profile of the surface. However, as

evident in Figure 3(g), the quality of the reconstruction varies amongst the peaks. For instance, since RB2RB_2 has low intensity, its signal is more likely to be overwhelmed by the background noise level, resulting in a noisier reconstruction, as can be seen in Figure 3(f) and by the dashed, blue curve in Figure 3(g).

Depth change in fluids

Digital holography is a promising technique to monitor the dynamic changes in the probe arm. In the previous section, we showed that it is possible to resolve relative temporal changes down to nanometric scales. However, we offer an alternative analysis for identifying the peaks through data processing of the acquired images. Here, the principles of our modelling are used to evaluate the time evolution of the fluid depth with respect to a reference time. For the experiments that follow, we coarsely aligned the reference and sample mirrors to demonstrate the potential application of our methods in scenarios where careful alignment cannot be guaranteed, such as for usage in noisy environments. Consequently, the spatial frequency domain of the acquired data may display common signal processing faults, such as spatial Fourier harmonics and folding, repeated peaks and aliasing [33]. Due to these digital artefacts, it is also expected that, in this case, not all peaks will be present or be identified in the process.

For the following analysis, we note that the overall change in time of the sample’s depth is directly proportional to the change in the spatial average of the phases, i.e., ⟨δh(r,t)⟩r∝⟨δϕ(m)(r,t)⟩r\langle\delta h(\mathbf{r},t)\rangle_{\mathbf{r}} \propto\langle\delta\phi^{(m)}(\mathbf{r},t)\rangle_{\mathbf{r}}, for a peak mm. The latter can be inferred from the complex value of the peak alone, as it carries the spatial average in its phase ϕ(m)\phi^{(m)} [33]. Thus, by employing the phase recovery procedure of (7) to all peaks in the Fourier spectrum, we can obtain the change in the spatially averaged phases. We can then apply the PCA procedure presented in section 3III B to identify the phase prefactors that give the appropriate relative fluid depth.

Controlled change in volume

In order to confirm that our setup can be used to reliably monitor the change in depth of the fluid sample, we devised an experiment where the volume of fluid in the basin was varied in a controlled way and monitored independently. A known volume change dVdV is injected into the sample basin, and the corresponding phase change dϕ(AB)d\phi^{(AB)} is given by,

dϕ(AB)=dV2k0αABA(8)d\phi^{(AB)} = \frac{dV}{2k_0\alpha_{AB}A} \tag*{(8)}

where AA is the area of the cross-section of the basin, which for this experiment was 70.6(2) cm270.6(2)\ \mathrm{cm}^2. The height fluctuations h(r,t)h(\mathbf{r},t) are calculated from the reconstructed phases ϕ\phi and are then compared with the predicted change in volume. The fluid level in the basin was changed steadily by employing a syringe system attached to a remote-controlled stepper motor. Water is injected into the basin at a rate of 12.3 μL/s12.3\ \mu\mathrm{L}/\mathrm{s}. Figure 4(c) and Figure 4(b) show the rate of change in the volume of the fluid over 130 seconds and the corresponding phase change for different holograms.

Figure 4. Fluid depth monitoring. In (a), temporal PCA to identify peaks labelled as the hologram indices mm and calculate their prefactors. The coloured points indicate the prefactors estimated with a PCA confidence at 97.40%. (b) displays the phase changes retrieved from different peaks identified in (a). In (c), the blue line indicates the average volume change calculated from different peaks, and the shaded region indicates the RMS deviation of the average from the rest. The dotted line shows the volume measurement done by tracking the movement of the syringe.

From the temporal PCA, it was found that the phases from different holograms were consistent towards a single principal component with confidence of 97.40%, which shows the reliability of the method of reconstruction. The phase prefactors αAB\alpha_{AB} obtained from the analysis are given in Figure 4(a). Similar to what was discussed above, the phase prefactor obtained for the holograms 0, 2, 12, 15 and 17 is n2−n1n_2-n_1, which indicates that all of them correspond to the same height variation as RB1RB_1 and repetitions of its peak. The holograms 1, 3, 5 and 16, with prefactors 2(n2−n1)2(n_2-n_1), are consistent with the first harmonics of the RB1RB_1 peak and its repetitions, and they are artefacts of digital processing. We could not identify confidently peak 13 within our model, similar to those in Figure 5(c). The holograms shown in grey in Figure 4(a) with a prefactor less than n2−n1n_2-n_1 are not used further as they are not well correlated to the height field h(r,t)h(\mathbf{r},t).

Figure 5. Evaporation rate of Water. In (a), the instantaneous height fluctuations retrieved from the reconstructed phases of multiple peaks and the dotted line gives the average of them. In (b), the linear fit of the average depth change in (a) and thus, the evaporation rate is depicted as the dotted line, the coloured points give the evaporation rates estimated from linear fits of each of the relevant peaks. The evaporation rate extracted from the slope of the PCA averaged depth is 0.8159(2) μ\mum/min. From Hisatake et al. [34] and [35], for low air-current speeds and similar ambient temperatures and water surface area, we should expect evaporation rates in the range of 0.6 − 1.2 μ\mum/min. The temperature of the experiment was at 20.8(2)°C. The peak identification and prefactor estimates of different peaks using temporal PCA with confidence at 99.94% in shown in (c). For this data set, data were acquired at a rate of 2 frames per second.

Evaporation Rates

In this study, the sample fluid in the fluid cell was allowed to remain idle for 15 minutes on a noise-isolating table in a controlled environment, with negligible air currents and variations in temperature. Figure 5 and Figure 6 show the results of the temporal PCA done on the data acquired using water (n2=1.333n_2 = 1.333) and isopropanol (n2=1.377n_2 = 1.377), respectively, as the samples. Panels (a) in both figures depict the various reconstructed depth changes over time for the available peaks with respect to the initial position, set to zero for convenience. We used the root-mean-square deviation of each curve with respect to the average (dotted, black line) as a measure of uncertainty for the prefactors obtained through the PCA. With water, the PCA confidence was at sgp=99.94%s_{\mathrm{gp}} = 99.94\%, which confirms that the different holograms correspond to the same depth change trend with a high level of accuracy.

Figure 6. Evaporation rate of Isopropanol. Panels (a) and (b) display the same content as in Figure 5, but for isopropanel as the fluid sample. The evaporation rate extracted from the slope of the PCA averaged depth is 5.720(1) μ\mum/min. From Mackay and van Wesenbeeck [36] and references therein, we can also estimate rates in the range of 5 − 6 μ\mum/min. The temperature in the surroundings of the experiment was at 23.2(2)°C. In (c), we show the peak identification and prefactor estimates of different peaks using temporal PCA with confidence at 99.25%. The hologram index mm is the order of peaks identified in the Fourier space. For this dataset, images were acquired at a rate of 10 frames per second.

Figure 5 (c) shows the phase-prefactors αAB\alpha_{AB} obtained from the phase analysis using water as the sample. The holograms are numbered in descending order of their intensities. Thus, hologram 0, which is the most prominent (brightest) one, corresponds to RB1R_{B1} and hence its prefactor can be identified as n2−n1n_2 - n_1. The same phase prefactor was obtained for the holograms 1, 2, 3, 8, 13, and 15, which indicates that all of them correspond to the same height variation as RB1R_{B1} and are likely to have come from repetitions of this peak. Holograms 4 and 12 have the highest phase prefactor among all the peaks. With the pre-factor close to n2n_2, allowing to identify them as the FB1FB_1 hologram and a repeated peak. The hologram 6 with a prefactor n1n_1 represents the RFRF. The other holograms shown in the figure are either weakly correlated to the height changes δh(r,t)\delta h(\mathbf{r},t) (grey points) and can be discarded, or do not correspond to peaks predicted by our modelling, such as interference with other optical components (e.g., the beam splitter), but still result in a hologram of the fluid surface. Similar conclusions can be derived from the data using isopropanol as shown in Figure 6, with a PCA confidence of 99.25%. In both experiments, the evaporation rates (ER) of the fluids were estimated from the linear fit of the various depth change curves in Panels (a), and the values were found to agree with those from relevant literature (see captions of Figure 5 and Figure 6).

Conclusion

In this work, we presented an off-axis DH setup that achieves multiplexing by considering the multiple reflections from the transparent fluid sample and other optical components. The multitude of holograms embedded in the interfered intensity image can then be separated into individual contributions that appear as brightness peaks in the spatial frequency domain (SFD) of the image. Phase modulations around each of these peaks are directly proportional to the height of the sample. We showed that a simple optical configuration based on a Michelson interferometer, when combined with a refined analysis of the acquired data, can retrieve a reliable reconstruction of spatial and time-dependent variations of the surface profile of the sample.

By carefully aligning the relative tilt between the reference and basin mirrors, our current setup can resolve nanometric changes in a water-air interface (see Figure 3). The phases of different holograms resulted in the same reconstructed profile with varying noise. We further showed that the position of the first four brightest peaks in SFD is in line with the prediction of our model in (10). Thus, by identifying two of the peaks, the position of the remaining ones can be inferred from the appropriate combination of the position vectors in SFD using (10). This method could be used to investigate the dynamics of fluid flows and the dispersion of interfacial waves with improved precision than conventional methods in Fluid Profilometry [5].

We then offered an alternative statistical treatment of the data to target scenarios where the alignment may not be accurately done. By employing a principal component analysis on the spatial averages of various phases, we showed that it is possible to precisely monitor changes in the depth of the sample when the volume of fluid is slowly varied in a known fashion. The same principles used in this benchmark were extended to investigate the evaporation rate of liquids. Our results are in accordance with the literature on the subject and confirm a possible application for the method. By trading the careful alignment for statistical treatment, it is not always possible to identify all the expected holograms, and the RB1RB_1 family seems to be dominant in all cases presented here.

Our method heads towards the development of profilometry sensors with uncomplicated designs relying strongly on digital processing and statistical tools to deliver better performance. The quality of the reconstructed profiles can be improved and adapted to different samples by modifying specific components, such as the camera, the laser source, or the optical parts, granting our approach a modular feature. With fast-evolving machine learning algorithms and artificial intelligence favouring automation, further investigation includes combining automatic alignment of the setup with appropriate statistical treatment of the data to optimise the result of the reconstruction in a wide range of applications.

Acknowledgements. We thank the members of the Gravity Laboratory and the Quantum Simulators for Fundamental Physics extended community for fruitful discussions and helpful suggestions. We are grateful to the Technology Transfer Office team and the technical support team of the Physics & Astronomy department at the University of Nottingham for their continued support in the development of this work. SW acknowledges support provided by the Leverhulme Research Leadership Award (RL-2019- 020), the Royal Society University Research Fellowship (UF120112, RF\ERE\210198) and the Royal Society Enhancements Awards and Grants (RGF\EA\180286, RGF\EA\181015), and partial support by the Science and Technology Facilities Council (Theory Consolidated Grant ST/P000703/1), the Science and Technology Facilities Council on Quantum Simulators for Fundamental Physics (ST/T006900/1) as part of the UKRI Quantum Technologies for Fundamental Physics programme.

Disclosures. AG, VSB and SW: University of Nottingham, UK Patent Application Number GB2214343.2 (P).

Data availability. Data underlying the results presented in this paper are not publicly available at this time but may be obtained from the authors upon reasonable request.

Multiplexed digital holography for fluid surface profilometry: Supplemental document

This supplementary material constitutes the basic theoretical framework and the analytical techniques used in the simulation and data analysis.

Theoretical calculation of the phases and the amplitudes

Consider a collection of (complex) propagating electromagnetic waves that are traversing a medium, which is considered to be homogeneous on length scales comparable to the wavelength λ\lambda. Within the geometrical optics limit, the electric field strengths can be written as,

En=E0Anexp⁡(iΦn−iωt),forΦ≡∫k⋅dr.(9)\mathbf{E}_n = E_0\mathbf{A}_n \exp\left(i\Phi_n-i\omega t\right), \qquad\text{for}\quad\Phi\equiv\int\mathbf{k}\cdot\mathrm{d}\mathbf{r}. \tag*{(9)}

Here ω\omega is the angular frequency of the ray, and An\mathbf{A}_n is a complex, dimensionless vector directed along the axis of polarization. Its magnitude ∣An∣\lvert\mathbf{A}_n\rvert gives the relative amplitude with respect to the electric field amplitude E0E_0. For a superposition {En}\{\mathbf{E}_n\} of rays of the form (1) at the same frequency ω\omega, the (time-averaged) intensity is given by,

I(t,r)≡I0+I0∑n≠mAnm(t,r)eiΦnm(t,r).(10)I(t,\mathbf{r}) \equiv I_0+I_0\sum_{n\ne m} A_{nm}(t,\mathbf{r})e^{i\Phi_{nm}(t,\mathbf{r})}. \tag*{(10)}

for An†Am≡Anm\mathbf{A}_n^\dagger\mathbf{A}_m \equiv A_{nm} and Φnm≡Φn−Φm\Phi_{nm}\equiv\Phi_n-\Phi_m. Here, and in what follows, the conjugate transpose is denoted by a superscript †\dagger. The average total intensity is I0≡12εc∣E0∣2I_0\equiv\frac{1}{2}\varepsilon c\lvert E_0\rvert^2, where ε\varepsilon and cc are the medium’s electric permittivity and speed of light, respectively. Hence, ∣E0∣\lvert E_0\rvert is defined through the relation ∑n∣En∣2≡∣E0∣2\sum_n\lvert\mathbf{E}_n\rvert^2\equiv\lvert E_0\rvert^2 or, equivalently, ∑n∣An∣2=1\sum_n\lvert\mathbf{A}_n\rvert^2=1.

From equation (2), it follows that for any two distinct rays nn and kk with unequally varying phases (Φnk≠0\Phi_{nk}\ne0 and ∣∇Φnk∣≠0\lvert\nabla\Phi_{nk}\rvert\ne0), the intensity II must fluctuate locally in space. Due to the short wavelengths of light, the resulting intensity distributions, commonly referred to as interferograms or interference patterns, are highly sensitive to relative changes along or of the paths travelled by the interfering beams.

Consider that the beam splitter divides the laser beam into reference (RR) and probe (PP) beams. Let zz be the direction of the incident beam. The probe beam is now illuminating the fluid surface, z=h(t,r)z=h(t,\mathbf{r}), where h=constanth=\text{constant}, when the fluid is at rest. Here, tt is time and r=xex+yey\mathbf{r}=x\mathbf{e}_x+y\mathbf{e}_y are the coordinates for the horizontal plane. A plane mirror, z=−mb⋅rz=-\mathbf{m}_b\cdot\mathbf{r} is submerged under the interface. Here, mb\mathbf{m}_b is the angle of rotation of the mirror from the optical axis, assuming that the tilt is small, and mb=0\mathbf{m}_b=0 corresponds to the submerged mirror being parallel with the undisturbed fluid interface z=constantz=\text{constant}. The water in the basin acts as a cavity to the incoming ray PP, and gives rise to multiple reflections and transmissions. A ray that passes through an infinitesimal distance dz\mathrm{d}z of an isotropic medium with refractive index nn attains a phase dΦ=k0ndz\mathrm{d}\Phi=k_0n\mathrm{d}z, where k0=2π/λ0k_0=2\pi/\lambda_0 is the wave number of the ray in vacuum. The additional reference ray, labelled RR, is reflected from the mirror MrM_r but with a different tilt, mb→mr\mathbf{m}_b\to\mathbf{m}_r, and a different arm length, H→HrH\to H_r.

We shall now consider the phases accumulated by different types of rays as they traverse a fluid interface z=h(t,r)z=h(t,\mathbf{r}). Let FF be the beam reflected from the surface of water and BjB_j’s, the ones reflected from the submerged mirror. The amplitudes of these beams are, then, given by,

AR=14,(11)A_R=\frac{1}{4}, \tag*{(11)}
AF=14R,(12)A_F=\frac{1}{4}\mathcal{R}, \tag*{(12)}
ABj=14Rj−1(1−R2),(13)A_{B_j}=\frac{1}{4}\mathcal{R}^{j-1}\left(1-\mathcal{R}^2\right), \tag*{(13)}

Here, R≡n2−n1n1+n2\mathcal{R}\equiv\frac{n_2-n_1}{n_1+n_2} is the reflection coefficient of water-air interface and n1n_1, n2n_2, the refractive indices of air and water, respectively. The factor 14\frac{1}{4} in the equations above is due to the beams propagating through the beam splitter multiple times. It comes from the factor of RBTBR_BT_B that should be applied to the amplitudes if the intensity I0I_0 is to refer to the intensity prior to passing a beam splitter with transmission coefficient TBT_B and reflection coefficient RBR_B. The corresponding phases are given by,

ΦR=2kn1(z0−mr⋅r),(14)\Phi_R=2kn_1(z_0-\mathbf{m}_r\cdot\mathbf{r}), \tag*{(14)}
ΦF=2kn1(z0−h),(15)\Phi_F=2kn_1(z_0-h), \tag*{(15)}
ΦBj=2kn1(z0−h)+2kjn2(h−mb⋅r),(16)\Phi_{B_j}=2kn_1(z_0-h)+2kjn_2(h-\mathbf{m}_b\cdot\mathbf{r}), \tag*{(16)}

The interferograms used to reconstruct the surface fluctuations in the media are from the interferences of reference beam R with the surface reflection F and multiply reflected beams BjB_j’s, and those between F and BjB_j’s, leading to various peaks in the Fourier spectrum. The interferograms can now be expressed as:

Interferogram⁡(RF)→ARFcos⁡(ΦRF),(17)\operatorname{Interferogram}(\mathrm{RF}) \to A_{RF}\cos(\Phi_{RF}), \tag*{(17)}
Interferogram⁡(RBj)→ARBjcos⁡(ΦRB),(18)\operatorname{Interferogram}(\mathrm{RB}_j) \to A_{RB_j}\cos(\Phi_{RB}), \tag*{(18)}
Interferogram⁡(FBj)→AFBjcos⁡(ΦFB),(19)\operatorname{Interferogram}(\mathrm{FB}_j) \to A_{FB_j}\cos(\Phi_{FB}), \tag*{(19)}
Interferogram⁡(BℓBj)→ABℓBjcos⁡(ΦBℓBj),(20)\operatorname{Interferogram}(\mathrm{B}_{\ell}\mathrm{B}_j) \to A_{B_{\ell}B_j}\cos(\Phi_{B_{\ell}B_j}), \tag*{(20)}

where ARFA_{RF}, ARBjA_{RB_j}, AFBjA_{FB_j} and ABℓBjA_{B_{\ell}B_j} are the effective amplitudes and ΦRF\Phi_{RF}, ΦRBj\Phi_{RB_j}, ΦFBj\Phi_{FB_j} and ΦBℓBj\Phi_{B_{\ell}B_j} are the effective phase differences from the interferences.

The phase differences are given by

ΦRF=2k0n1(h+mr⋅r+ΔH),(21)\Phi_{RF}=2k_0n_1\left(h+\mathbf{m}_r\cdot\mathbf{r}+\Delta H\right), \tag*{(21)}
ΦRBj=2k0[(n1−jn2)h+(n1mr−jn2mb)⋅r+n1ΔH],(22)\Phi_{RB_j}=2k_0\left[(n_1-jn_2)h+(n_1\mathbf{m}_r-jn_2\mathbf{m}_b)\cdot\mathbf{r}+n_1\Delta H\right], \tag*{(22)}
ΦFBj=2k0n2[jh+jmb⋅r],(23)\Phi_{FB_j}=2k_0n_2\left[jh+j\mathbf{m}_b\cdot\mathbf{r}\right], \tag*{(23)}
ΦBℓBj=2k0n2[(ℓ−j)h+(ℓ−j)mb⋅r],(24)\Phi_{B_{\ell}B_j}=2k_0n_2\left[(\ell-j)h+(\ell-j)\mathbf{m}_b\cdot\mathbf{r}\right], \tag*{(24)}

with ΔH≡HR−H\Delta H\equiv H_R-H the difference in arm length of the reference beam HRH_R and the probe beam HH. While the corresponding amplitudes take the form

ARF=18R,(25)A_{RF}=\frac{1}{8}\mathcal{R}, \tag*{(25)}
ARBj=18(1−R2)Rj−1,(26)A_{RB_j}=\frac{1}{8}(1-\mathcal{R}^2)\mathcal{R}^{j-1}, \tag*{(26)}
AFBj=18(1−R2)Rj,(27)A_{FB_j}=\frac{1}{8}(1-\mathcal{R}^2)\mathcal{R}^{j}, \tag*{(27)}
ABℓBj=18(1−R2)2Rℓ+j−2,(28)A_{B_{\ell}B_j}=\frac{1}{8}(1-\mathcal{R}^2)^2\mathcal{R}^{\ell+j-2}, \tag*{(28)}

Because ∣R∣|\mathcal{R}| is typically small (∣R∣≃14.16%|\mathcal{R}|\simeq14.16\% for air-water interfaces), the RB1RB_1 interferogram has the largest amplitude. The sensitivity of the phase to variations in the height, ∂hΦRB1=2k0(n1−mn2)\partial_h\Phi_{RB_1}=2k_0(n_1-mn_2), however, is the smallest. The most phase-sensitive of the j=1j=1 interferograms is FB1FB_1, with ∂hΦFB1=2k0n2\partial_h\Phi_{FB_1}=2k_0n_2. Crucially, the intensity contributed by the three interferograms RFRF, RB1RB_1 and FB1FB_1 have distinct external influences. For example, inhomogeneities in the bulk of the surrounding gas, from changes in the composition of the gas, the temperature, or from sound waves, are picked up by RFRF and RB1RB_1, but not by FB1FB_1, which only probes the fluid bulk. For transparent fluids, FB1FB_1 is expected to have the largest signal-to-noise ratio, provided the reflection coefficient ∣R∣|\mathcal{R}| is large enough so its intensity is detectable.

We can then consider the spatial Fourier spectrum of the combined intensity (10) for phases given by (6). By virtue of the distinct tilts mr\mathbf{m}_r and mb\mathbf{m}_b of the reference and bottom mirrors respectively, the interferograms separate into distinct spatial carrier frequencies (see Fig. 1). Their separation in spatial-frequency domain is what guarantees that our methods presented in the main text can be applied.

Simulation with numerical phase tracing

The numerical phase tracing is based on the iterative propagation of a mesh of rays through a synthetically generated model of the setup. More precisely, we represent the two mirrors as tilted planes z=−mb⋅rz=-\mathbf{m}_b\cdot\mathbf{r} and z=−mr⋅rz=-\mathbf{m}_r\cdot\mathbf{r}, and then the interface z=h(r)z=h(\mathbf{r}) takes the form:

h(r)=h0+A[cos⁡(k1⋅r)+cos⁡(k2⋅r)],(29)h(\mathbf{r})=h_0+A[\cos(\mathbf{k}_1\cdot\mathbf{r})+\cos(\mathbf{k}_2\cdot\mathbf{r})], \tag*{(29)}

Now, consider a cartesian mesh of starting positions for the initial ray, which is a set of two-dimensional points rij∈R2\mathbf{r}_{ij}\in\mathbb{R}^2 in the (x,y)-plane, at a fixed altitude z=z0z=z_0. The origin of the rays is then given by xij=z0dij+rij\mathbf{x}_{ij}=z_0\mathbf{d}_{ij}+\mathbf{r}_{ij}, where dij=−ez\mathbf{d}_{ij}=-\mathbf{e}_z is the initial direction of the rays. The initial phase and relative amplitude associated with the rays are taken as ϕij=0\phi_{ij}=0 and 1, respectively.

The refracted mesh of rays initiates new rays at each reflection of the free surface from below. At every interface encountered, the amplitudes are modified, and at every propagation of length LL between interfaces, the phase attains a contribution kL=k0nLkL=k_0nL, where k0k_0 is the wave number of the ray in vacuum and nn is the refractive index of the traversed medium.

Separation of Carrier Peaks

Figure 1 (PDF p. 12). Separation of Carrier Peaks The separation of spatial carrier frequencies k=(kx,ky)\mathbf{k}=(k_x,k_y) that results from small tilts mb\mathbf{m}_b and mr\mathbf{m}_r of the submerged mirror and reference mirror respectively. Each node represents a hologram specified by the label. The holograms are categorised into three groups (yellow, blue and red). Yellow holograms are independent of the configuration of the reference mirror mr\mathbf{m}_r, the red hologram is independent of the submerged mirror mb\mathbf{m}_b and the blue nodes respond to adjustments in both mirrors.

Step 1: For each mathematical surface Fk(x)F_k(\mathbf{x}), numerically solve the equation, Fk(xij+skdij)=0F_k(\mathbf{x}_{ij}+s_k\mathbf{d}_{ij})=0, for sks_k, and determine the k=k0k=k_0 with smallest non-negative value ss for sks_k, and label Fk0F_{k_0} as the current surface. If there are no solutions sks_k, choose s=(z0−xij⋅ez)/(dij⋅ez)s=(z_0-\mathbf{x}_{ij}\cdot\mathbf{e}_z)/(\mathbf{d}_{ij}\cdot\mathbf{e}_z) to propagate the ray back to z0z_0, and move to step (4) after this step. Update the position xij⟶xij+sdij\mathbf{x}_{ij}\longrightarrow\mathbf{x}_{ij}+s\mathbf{d}_{ij} and the phase ϕij⟶ϕij+k0nijs∣dij∣\phi_{ij}\longrightarrow\phi_{ij}+k_0n_{ij}s\lvert\mathbf{d}_{ij}\rvert.

Step 2: Compute the normal vector n≡∇Fk0/∣∇Fk0∣\mathbf{n}\equiv\nabla F_{k_0}/\lvert\nabla F_{k_0}\rvert of the current surface and find the reflected dijr\mathbf{d}_{ij}^{r} and refracted dijt\mathbf{d}_{ij}^{t} directions about the surface normal using Snell’s law, i.e.

dijr=2cnanddijt=nrdij−(nrc+1−nr2(1−c2))n,(30)\mathbf{d}_{ij}^{r}=2c\mathbf{n}\quad\text{and}\quad\mathbf{d}_{ij}^{t}=n_r\mathbf{d}_{ij}-\left(n_rc+\sqrt{1-n_r^2(1-c^2)}\right)\mathbf{n}, \tag*{(30)}

where c=n⋅dijc=\mathbf{n}\cdot\mathbf{d}_{ij} and nr=na/nbn_r=n_a/n_b is the current refractive index nan_a divided by the refractive index nbn_b behind the surface. Duplicate the current ray, assign the (reflected) direction dijr\mathbf{d}_{ij}^{r} to the duplicate, and reduce the amplitude by the Fresnel reflection coefficient, i.e. Aij⟶RabAijA_{ij}\longrightarrow\mathcal{R}_{ab}A_{ij}. Pass the duplicate to step (3). Update the refractive index na⟶nbn_a\longrightarrow n_b, direction dij⟶dijt\mathbf{d}_{ij}\longrightarrow\mathbf{d}_{ij}^{t} and amplitude Aij⟶τabAijA_{ij}\longrightarrow\tau_{ab}A_{ij} of the current ray and pass it to step (3). Here, τab\tau_{ab} is the Fresnel transmission coefficient.

Step 3: If the amplitude is sufficiently large, i.e. ∣Aij∣>ϵ\lvert A_{ij}\rvert>\epsilon for some ϵ\epsilon (the chosen value here is ϵ=5×10−4\epsilon=5\times10^{-4}), send the ray back to step (1). If not, discard the ray.

Step 4: Wait for all rays to reach this step. When they do, move to step (5).

Step 5: Use the (x,y)(x,y)-coordinates of the current position xij\mathbf{x}_{ij} to interpolate the amplitudes AijA_{ij} and phases ϕij\phi_{ij} to the original transverse coordinate rij\mathbf{r}_{ij}. Then use (17) for rays AijeiϕijA_{ij}e^{i\phi_{ij}} to compute the intensity IijI_{ij}. The value of the resulting image YijY_{ij} at pixel (i,j)(i,j) is chosen by sampling from a Poisson distribution with mean γIij\gamma I_{ij}. Here γ\gamma is the average number of photons arriving in the camera during the exposure time, we chose it to be 800.

Demodulation of Noisy Carriers

Consider an image YijY_{ij} created from intensities of the form (10), Yij=Γ[I(rij)]+δYijY_{ij}=\Gamma[I(\mathbf{r}_{ij})]+\delta Y_{ij} where δYij\delta Y_{ij} is a stochastic variable that describes the noise in the image, rij\mathbf{r}_{ij} is the spatial (pixel) coordinate, and Γ\Gamma is a function that transforms physical intensities to pixel values. We shall assume all phase differences Φmk=Φm−Φk\Phi_{mk}=\Phi_m-\Phi_k to have small variations ϕ\phi around a stationary planar phase k⋅r\mathbf{k}\cdot\mathbf{r}. That is, ΔΦ(t,r)=ϕ(t,r)+k⋅r\Delta\Phi(t,\mathbf{r})=\phi(t,\mathbf{r})+\mathbf{k}\cdot\mathbf{r}, so that

Yij=Y0+∑nBnexp⁡[ikm⋅rij+ϕij(m)]+δYij≡Re⁡[Yij]+δYij,(31)Y_{ij}=Y_0+\sum_n B_n\exp\left[i\mathbf{k}_m\cdot\mathbf{r}_{ij}+\phi_{ij}^{(m)}\right]+\delta Y_{ij}\equiv\operatorname{Re}[Y_{ij}]+\delta Y_{ij}, \tag*{(31)}

for Bn≡Y0AmB_n \equiv Y_0 A_m and Y0≡ΓI0Y_0 \equiv\Gamma I_0, the pixel value corresponding to the spatially averaged intensity I0I_0. The equation above shows that the Fourier spectrum of the image YijY_{ij} displays intensity peaks around the km\mathbf{k}_m vectors. Their positions in the frequency domain are defined in accordance with the wavevectors in the planar phases. If the peaks are sufficiently separated, one can identify them as in figure 1. Since YijY_{ij} is real, each non-zero carrier km\mathbf{k}_m must have a so-called twin at −km-\mathbf{k}_m.

Now let FmF_m be a Fourier filter around a single carrier peak km\mathbf{k}_m, i.e. Fm≡F−1Gm(k)FF_m \equiv\mathcal{F}^{-1}G_m(\mathbf{k})\mathcal{F}, where F\mathcal{F} is a two-dimensional spatial Fourier transform with inverse F−1\mathcal{F}^{-1}, and GmG_m is a window function that is only non-zero in the vicinity of the mm’th carrier peak km\mathbf{k}_m. The role of the filter FmF_m is to isolate each modulated plane wave to get,

Fm[Y~]ij=Bmexp⁡[ikm⋅rij+ϕij(m)]+Fm[δY]ij,(32)F_m[\widetilde{Y}]_{ij} = B_m \exp\left[i\mathbf{k}_m \cdot\mathbf{r}_{ij} + \phi_{ij}^{(m)}\right] + F_m[\delta Y]_{ij}, \tag*{(32)}

The simplest choice for Gm(k)G_m(\mathbf{k}) is a two-dimensional tophat-filter centred at km\mathbf{k}_m, i.e. Gm(k)=1G_m(\mathbf{k}) = 1 if ∣k−km∣≤kc\lvert\mathbf{k} - \mathbf{k}_m \rvert\leq k_c with Gm(k)=0G_m(\mathbf{k}) = 0 otherwise, for some appropriate choice of filter size kck_c. However, the reconstruction can be significantly improved by using a Raised-Cosine filter. Using the Fourier filter FnF_n, we have extracted a complex signal whose only deviation from a complex plane wave, other than the noise, is due to the spatial variations of ϕij(m)\phi_{ij}^{(m)}. Assuming the noise to be much smaller than the signal in each peak, i.e. Fm[δY]ij≪Y~ijF_m[\delta Y]_{ij} \ll\widetilde{Y}_{ij}, the complex phase of the filtered image Fm[Y]ijF_m[Y]_{ij} takes the form,

Im⁡{log⁡[Fm[Y~]ij]}=km⋅xij+ϕij(m)−Re⁡[δϕij(m)]forδϕij(m)≡iFn[δY]ijY~ij(m),(33)\operatorname{Im}\left\{\log\left[F_m[\widetilde{Y}]_{ij}\right]\right\} = \mathbf{k}_m \cdot\mathbf{x}_{ij} + \phi_{ij}^{(m)} - \operatorname{Re}\left[\delta\phi_{ij}^{(m)}\right]\quad\text{for}\quad\delta\phi_{ij}^{(m)} \equiv i\frac{F_n[\delta Y]_{ij}}{\widetilde{Y}_{ij}^{(m)}}, \tag*{(33)}

for some integer field ℓij(m)∈Z\ell_{ij}^{(m)} \in\mathbb{Z} enumerating the number of phase-wrappings at the pixel location (i,j)(i,j). Note that most of the quantities on the right side of (34) are accessible from the image YijY_{ij}. The carrier peak km\mathbf{k}_m is found from the peaks of ∣FY∣\lvert\mathcal{F}Y\rvert and is used to construct the filter FmF_m, and the phase wrapping ℓij(m)\ell_{ij}^{(m)} can be reduced to a single integer ℓm∈Z\ell_m \in\mathbb{Z} using e.g. the algorithm of [1]. This leaves only one scalar quantity, the global phase wrapping ℓn\ell_n, in addition to the noise δϕij(m)\delta\phi_{ij}^{(m)}, that is yet to be determined.

The phases can now be computed in different ways - synthetic, relative or absolute reconstruction as per the requirements. Assuming that there is no variation in the carrier km\mathbf{k}_m, the phase variations Δϕij(m)\Delta\phi_{ij}^{(m)} are then given by,

Δϕij(m)=Im⁡log⁡(Fm[Y]ij)−km⋅rij.(34)\Delta\phi_{ij}^{(m)} = \operatorname{Im}\log\left(F_m[Y]_{ij}\right) - \mathbf{k}_m \cdot\mathbf{r}_{ij}. \tag*{(34)}

This method is called synthetic reconstruction in which we used a synthetic wavefront as a reference for the reconstruction.

Relative reconstruction involves estimating the phases by considering pairs of consecutive interferograms [Ym]ij[Y_m]_{ij} and [Ym+1]ij[Y_{m+1}]_{ij} such that

Δϕij(m)=Im⁡{log⁡[(Fm[Ym]ij)(Fm[Ym+1]ij)∗]},(35)\Delta\phi_{ij}^{(m)} = \operatorname{Im}\left\{\log\left[(F_m[Y_m]_{ij})(F_m[Y_{m+1}]_{ij})^*\right]\right\}, \tag*{(35)}

where ∗* denotes the complex conjugate. In the third method, absolute reconstruction, the phases are calculated by taking the first interferogram [Y0]ij[Y_0]_{ij} as the reference, as follows,

Δϕij(m)=Im⁡{log⁡[(Fm[Ym]ij)(Fm[Y0]ij)∗]}.(36)\Delta\phi_{ij}^{(m)} = \operatorname{Im}\left\{\log\left[(F_m[Y_m]_{ij})(F_m[Y_0]_{ij})^*\right]\right\}. \tag*{(36)}

In figure 2, we display an example of phase distortion from a jet of compressed air, which causes variations in temperature, pressure and composition of the bulk.

Peak identification and prefactor estimates using principal component analysis

As already discussed, one could use different approaches to identify and label the peaks in the Fourier space. In this section, we discuss the peak identification using the Principal Component Analysis (PCA) [2, 3]. PCA is a statistical tool that can be used when multiple features of a data set correspond to the same observable in the experiment. Here, the relative phases reconstructed from different peaks correspond to the same height fluctuations δh(r,t)\delta h(r,t) on the fluid surface.

A jet of compressed air leaving the tip of an air duster, shown in hologram panels (a), (b), and (c)

Figure 2 (PDF p. 14). A jet of compressed air leaving the tip (white region) of an air duster. The jet modifies the local composition {γi}\{\gamma_i\} of the air, and also its temperature and pressure, which results in local deformations of the hologram panels (a) and (c), which, when reconstructing the RB1RB_1 phase (panel (b)), leaves a clear profile of the density of the jet.

Assume that we have a collection of MM reconstructed phases {ϕij(m)}m=1M\{\phi_{ij}^{(m)}\}_{m=1}^{M} that can be seen as an MM-dimensional vector field,

p=∑mϕij(m)(t,r) em.(37)\mathbf{p} = \sum_m \phi_{ij}^{(m)}(t,\mathbf{r})\,\mathbf{e}_m. \tag*{(37)}

A spatial or temporal fluctuation of the height h→h+δhh \to h+\delta h results in a fluctuation p→p+2k0vδh\mathbf{p} \to\mathbf{p}+2k_0\mathbf{v}\delta h for a constant vector,

v=∑mαmem(38)\mathbf{v} = \sum_m \alpha_m\mathbf{e}_m \tag*{(38)}

which depends only on the refractive indices. The vector p\mathbf{p} always responds to variations in hh along the same axis of v\mathbf{v}, and this axis determines all the phase ratios. Consider the spectrum Cvk=λkvkC\mathbf{v}_k = \lambda_k\mathbf{v}_k of the covariance matrix,

Cab=⟨Xij(a)Xij(b)⟩(39)C_{ab} = \left\langle X_{ij}^{(a)} X_{ij}^{(b)} \right\rangle \tag*{(39)}

for the centralised variables Xij(a)≡ϕij(a)−⟨ϕij(a)⟩X_{ij}^{(a)} \equiv\phi_{ij}^{(a)}-\left\langle\phi_{ij}^{(a)}\right\rangle.

Here, we mostly use temporal PCA which involves time averaging rather than spatial PCA. The choice of averaging depends on the data sets and the requirements of the analysis. Assuming all phases measure the same interface, there is one eigenvector vk\mathbf{v}_k of CabC_{ab} with eigenvalue λk\lambda_k much larger than the others, hereby referred to as the principal component. The confidence of the PCA,

sgk=∣λk∣∑a≠k∣λa∣,(40)s g_k = \frac{|\lambda_k|}{\sum_{a\ne k}|\lambda_a|}, \tag*{(40)}

where λk\lambda_k is the eigenvalue of the principal component, representing how well the height fluctuations can be aligned with the data p\mathbf{p}. As per the phase equations (6), the principal component vk\mathbf{v}_k fixes the ratios of the phase fields. Hence, to get all of the phase prefactors, it is required to estimate one of them and locate it in vk\mathbf{v}_k. For example, in the analysis presented in the paper, RB1RB_1 is the easiest peak to identify by its brightness with respect to the others. The ratio between the entries of vk\mathbf{v}_k and the RB1RB_1 entry, vk,0v_{k,0}, equals the ratio between the prefactors αm\alpha_m, that is,

vk,mvk,0=αmα0.\frac{v_{k,m}}{v_{k,0}} = \frac{\alpha_m}{\alpha_0}.

Hence, it suffices to know the prefactor of one of the peaks, in the latter case αRB1≡α0\alpha_{RB_1} \equiv\alpha_0, to estimate the remaining prefactors αAB≡αm\alpha_{AB} \equiv\alpha_m.

References

  1. [1]M. A. Sutton, J. J. Orteu, and H. Schreier, Image correlation for shape, motion and deformation measurements: basic concepts, theory and applications (Springer Science & Business Media, 2009).DOI
  2. [2]M. Takeda, H. Ina, and S. Kobayashi, JosA 72, 156 (1982).
  3. [3]X. Su and W. Chen, Optics and lasers in Engineering 35, 263 (2001).
  4. [4]P. J. Cobelli, A. Maurel, V. Pagneux, and P. Petitjeans, Experiments in fluids 46, 1037 (2007).
  5. [5]S. Wildeman, Experiments in Fluids 59, 97 (2018).
  6. [6]F. Moisy, M. Rabaud, and K. Salsac, Experiments in Fluids 46, 1021 (2009).
  7. [7]M. K. Kim, SPIE Reviews 1, 018005 (2010).
  8. [8]G. Di Caprio, M. A. Ferrara, L. Miccio, F. Merola, P. Memmolo, P. Ferraro, and G. Coppola, Holographic imaging of unlabeled sperm cells for semen analysis: A review (2014), arXiv:1411.7374 [physics].
  9. [9]T. Kreis, IEEE Transactions on Industrial Informatics 12, 240 (2016).
  10. [10]T. Tahara, X. Quan, R. Otani, Y. Takaki, and O. Matoba, Microscopy 67, 55 (2018).
  11. [11]M. Paturzo, V. Pagliarulo, V. Bianco, P. Memmolo, L. Miccio, F. Merola, and P. Ferraro, Optics and Lasers in Engineering Optical Tools for Metrology, Imaging and Diagnostics, 104, 32 (2018).
  12. [12]G. Nehmetallah, L. Williams, and T. Nguyen, Latest Advances in Single and Multiwavelength Digital Holography and Holographic Microscopy (IntechOpen, 2020).DOI
  13. [13]J. Zhang, S. Dai, C. Ma, T. Xi, D. Jianglei, and Z. Jianlin, Light: Advanced Manufacturing 10.37188/lam.2021.023 (2021).
  14. [14]T. Zeng, Y. Zhu, and E. Y. Lam, Opt. Express 29, 40572 (2021).
  15. [15]D. Gabor, Nature 161, 777 (1948).
  16. [16]D. Gabor, Proceedings of the Royal Society of London. Series A. Mathematical and Physical Sciences 197, 454 (1949).
  17. [17]D. Gabor, Proceedings of the Physical Society. Section B 64, 449 (1951).
  18. [18]J. W. Goodman and R. W. Lawrence, Applied Physics Letters 11, 77 (1967).
  19. [19]U. Schmars and W. Jüptner, Applied Optics 33, 179 (1994).
  20. [20]E. N. Leith and J. Upatnieks, JOSA 52, 1123 (1962).
  21. [21]E. Cuche, F. Bevilacqua, and C. Depeursinge, Optics Letters 24, 291 (1999).
  22. [22]C. Yuan, G. Situ, G. Pedrini, J. Ma, and W. Osten, Applied Optics 50, B6 (2011).
  23. [23]B. Sha, X. Liu, X.-L. Ge, and C.-S. Guo, Optics Express 22, 23066 (2014).
  24. [24]V. Mico, C. Ferreira, Z. Zalevsky, and J. García, Optics Express 22, 14929 (2014).
  25. [25]M. Rubin, G. Dardikman, S. K. Mirsky, N. A. Turko, and N. T. Shaked, Optics Letters 42, 4611 (2017), arXiv:1904.01446 [physics].
  26. [26]G. Dardikman and N. T. Shaked, Journal of the Optical Society of America A 36, A1 (2019), arXiv:1903.12209 [physics].DOI
  27. [27]T. Colomb, S. Krivec, H. Hutter, A. A. Akatay, N. Pavillon, F. Montfort, E. Cuche, J. Kühn, C. Depeursinge, and Y. Emery, Opt. Express 18, 3719 (2010).
  28. [28]T. Colomb and Y. Emery, in 2012 International Symposium on Optomechatronic Technologies (ISOT 2012) (2012) pp. 1–2.DOI
  29. [29]M. Takeda and K. Mutoh, Appl. Opt. 22, 3977 (1983).
  30. [30]M. A. Herraez, D. R. Burton, M. J. Lalor, and M. A. Gdeisat, Applied Optics 41, 7437 (2002).
  31. [31]I. T. Jolliffe, Weather 45, 375 (1990).
  32. [32]I. Jolliffe, Principal Component Analysis, Springer Series in Statistics (Springer New York, 2013).
  33. [33]D. Sundararajan, Digital image processing: a signal processing and algorithmic approach (Springer, 2017).DOI
  34. [34]K. Hisatake, M. Fukuda, J. Kimura, M. Maeda, and Y. Fukuda, Journal of applied physics 77, 6664 (1995).
  35. [35]K. Hisatake, S. Tanaka, and Y. Aizawa, Journal of applied physics 73, 7395 (1993).
  36. [36]D. Mackay and I. van Wesenbeeck, Environmental science & technology 48, 10259 (2014).

Paper details

vlnc:W_h3vjgfyc
Version
v1 · latest
Published
Fresh — added to the Hub within the last 30 days
Added
License
CC BY 4.0
Usage

views · 11

downloads · 0

A view counts once per browser per day, a download each time the PDF is requested.

  • Physics and Astronomy

Not recorded for this paper

View statement
Looking for related papers…
Contents