WorksMathematics
A rank-associated measure of population heterogeneity based on order statistics
Abstract
This paper introduces a rank-associated measure of population heterogeneity that quantifies how population differences are reflected in the relative positions of observations within a pooled sample. The measure is defined as a weighted average of Kolmogorov-Smirnov distances between conditional and unconditional distributions of order statistics, conditional on the population of origin at each rank. We establish its main properties, including boundedness, invariance under common strictly monotone transformations, and a characterization of its null value through independence between order statistics and population indicators. We derive bounds relating the measure to weighted pairwise distributional distances and population diversity across ranks, and examine the contributions of the minimum and maximum, obtaining a simple expression for two populations. Monte Carlo simulations with four populations assess its finite-sample behavior and asymptotic convergence. The empirical application reveals a shift in heterogeneity toward higher ranks in the germ-free group.
Introduction
Comparing heterogeneous populations is an important problem in statistics, with applications in reliability and survival analysis, economics, environmental studies, and experimental research. A common approach is to compare their marginal distributions. For continuous distributions , one possibility is the average Kolmogorov–Smirnov distance,
where denotes the Kolmogorov–Smirnov distance [9, 4]. Although useful for comparing marginal distributions, such measures do not account for how population identities are reflected in the relative positions of observations in the pooled sample.
In this paper, we approach population heterogeneity from this perspective. Consider independent random variables , where represents an observation from population , and let denote their order statistics [3]. The indicator identifies whether the observation from population occupies rank . The relationship between order statistics and their associated rank indicators has been studied in several contexts. [1] established characterizations under proportional hazard rates, while [8] investigated related results through order structures. [5] considered the independence between time and cause. More recently, [12] developed general characterizations of independence between order statistics and rank indicators, with particular attention to the minimum and maximum in right- and left-censoring models, respectively.
Motivated by this line of research, we introduce a rank-associated measure of population heterogeneity that considers all order statistics and population indicators. The measure is constructed by comparing the conditional distribution of each order statistic, given the population supplying the corresponding observation, with its unconditional distribution. We aggregate the resulting Kolmogorov–Smirnov distances across ranks and populations, weighting each contribution by . In this way, the measure captures how population identities are distributed across the pooled ordering, complementing comparisons based solely on marginal distributions.
We establish the main properties of the proposed measure, including boundedness, invariance under common strictly monotone transformations, and a characterization of its null value in terms of independence between order statistics and population indicators. We also derive bounds connecting it to weighted pairwise distributional distances and to the diversity of population identities across ranks. Finally, we examine its decomposition into contributions from the minimum, maximum, and intermediate order statistics.
The remainder of the paper is organized as follows. Section 2 introduces the measure and establishes its main properties. Section 3 considers two populations through an example involving independent exponential random variables. Section 4 compares the proposed measure with marginal heterogeneity using a lognormal example. Section 5 presents simulation results and an application to real data. Finally, Section 6 discusses the interpretation and limitations of the proposed measure, summarizes the main findings, and outlines directions for future research.
A rank-associated measure of heterogeneity
Let be independent, absolutely continuous random variables, with respective distribution functions and densities . Throughout this section, assume that ties occur with probability zero; that is, for all .
For , define the rank indicator , which equals one if the observation from population occupies rank and zero otherwise. Let
For each rank , these probabilities satisfy . Moreover, for each population , .
Whenever , define the conditional distribution function
This is the distribution of an observation from population conditional on its occupying rank in the pooled ordering. This conditional representation is closely related to the characterizations of independence between order statistics and rank indicators considered in Vila and Almeida [12].
The distribution function of the th order statistic is denoted by . Since exactly one population supplies the observation occupying rank , the law of total probability gives
where is as given in (1).
Thus, the distribution of an order statistic is a mixture of the conditional distributions associated with the possible population identities, with mixing probabilities given by the rank probabilities.
Definition 2.1. The rank-associated heterogeneity measure is defined as
where terms with are defined to be zero.
The measure averages, over all ranks, the discrepancies between the conditional distribution associated with each population and the unconditional distribution of the corresponding order statistic. The factor gives equal weight to the different ranks, while reflects the probability that population occupies rank .
The measure has a direct probabilistic interpretation. A large value of indicates that knowing the population identity of an observation occupying a particular rank can substantially change the distribution of the corresponding order statistic. A small value indicates that the conditional distributions are close to their unconditional counterparts.
Proposition 2.1. The measure satisfies .
Furthermore, if and only if for every pair such that .
Proof. Since the Kolmogorov–Smirnov distance between two distribution functions belongs to , and since , we obtain
Averaging over the ranks yields .
Since all terms in (4) are nonnegative, if and only if every term with positive weight is zero. This is equivalent to the stated equality of distribution functions. ■
The preceding result establishes that the proposed measure is zero precisely when the population identity does not affect the distribution of the order statistic, conditional on the rank being specified.
This interpretation can be expressed in terms of independence.
Proposition 2.2. For any and such that , and are independent if and only if .
Consequently, if and only if is independent of for every pair with .
Proof. The first equivalence follows from Vila and Almeida [12], which establishes that the independence between an order statistic and its corresponding rank indicator is equivalent to the equality of the associated conditional and unconditional distributions.
For the second assertion, since all terms defining are nonnegative, if and only if for every pair such that . The result then follows directly from the first equivalence.
An immediate consequence is that when the random variables are independent and identically distributed (i.i.d.) with a continuous distribution. In this case, the population identity is independent of the rank occupied by the observation, so the conditional distribution of the corresponding order statistic is the same regardless of the population from which the observation originates.
Proposition 2.3. For each , let
Then
In particular, .
Proof. For each , the mixture representation (3) and the triangle inequality imply
Consequently,
Finally, applying the Cauchy–Schwarz inequality, we have . Since , this immediately implies , thereby establishing the stated universal bound.
The quantity in Proposition 2.3 is the Gini–Simpson diversity index ([6]) associated with the population identity of the observation occupying the th rank. Thus, the preceding result shows that the contribution of each rank to is bounded by the diversity of the corresponding rank assignment. In particular, the upper bound depends not only on the number of populations but also on how evenly the populations are represented at each rank.
A representation in terms of the marginal distributions
The conditional distributions in (4) can be expressed directly in terms of the marginal distribution functions and densities.
For each , define
This is the probability that exactly observations from populations other than are smaller than . Since
by independence, the probability can be written as
By definition, . Since the random variables are independent and continuously distributed, conditioning on gives
Consequently, for any measurable set , the law of total probability yields
Taking , we obtain the probability that occupies rank :
Furthermore, provided that , the conditional distribution of given is absolutely continuous, with density
Thus, the rank probabilities are given by
By combining (3) and (5), the density of the th order statistic is given by
The expressions in (6) and (7) follow from the standard density representation of order statistics for independent, not necessarily identically distributed, random variables; see David and Nagaraja [3].
For the minimum and maximum, these expressions simplify considerably. In particular, and . It follows that
These two expressions reveal an important distinction between the lower and upper extremes. For the minimum, the observation from population must be smaller than all the remaining observations. For the maximum, it must be larger than all the remaining observations. Thus, the conditional distributions associated with the two extremes reflect different aspects of the marginal distributions, particularly their lower- and upper-tail behavior.
Connection with pairwise distributional dispersion
The proposed measure in (4) can also be related to a weighted average of pairwise distances between the conditional distributions.
For each rank , define
where is as given in (1).
Here, measures the weighted dispersion of the conditional distributions around their mixture, whereas measures their weighted pairwise dispersion.
Proposition 2.4. For every ,
Consequently, defining
we have
Proof. By the mixture representation (3) and the triangle inequality,
Multiplying by and summing over gives the upper bound.
For the lower bound, the triangle inequality yields
Multiplying by and summing over and , we obtain . This proves (9). Averaging over the ranks gives (10). ■
This result establishes a direct mathematical connection between the proposed measure and a weighted pairwise distributional dispersion. The distinction is that measures deviations from the natural mixture distribution , rather than comparing all conditional distributions directly.
Heterogeneity associated with the minimum and maximum
The proposed measure in (4) aggregates the contributions of all order statistics. However, the minimum and maximum deserve particular attention because they represent the two extreme positions in the pooled ordering.
Define
where is as given in (1).
The contribution of the intermediate order statistics is
where when . The overall measure can then be decomposed as
The decomposition in (11) makes it possible to distinguish heterogeneity associated with the lower extreme from heterogeneity associated with the upper extreme. In particular, measures the extent to which the distribution of the minimum depends on the population supplying that minimum, whereas measures the corresponding dependence for the maximum.
For two populations, there are no intermediate order statistics, and therefore
The decomposition in (12) has two components that also admit a simple pairwise representation. Let . Since, by (3), and , we obtain and . Therefore,
The representation in (13) shows explicitly that the overall heterogeneity measure for two populations is determined by the discrepancies between the conditional distributions of the minimum and maximum, weighted by the probability of the two possible population orderings.
The relative contribution of the two extremes can also be summarized by
provided that . It follows from (14) that . Positive values indicate that the maximum contributes more than the minimum, whereas negative values indicate the opposite. A value of zero means that the two extreme contributions are equal. This quantity complements by describing the direction of the heterogeneity associated with the extremes.
Invariance properties
The proposed measure in (4) is invariant under a common strictly increasing transformation of all the observations.
Proposition 2.5. Let be independent, absolutely continuous random variables, and let be a strictly monotone function. Then
Moreover, if is strictly decreasing, then
for .
Proof. If is strictly increasing, the result follows from the invariance of the Kolmogorov–Smirnov distance under strictly increasing transformations and the preservation of the ranks. Suppose now that is strictly decreasing. In this case, the ordering of the observations is reversed. In particular, the observation occupying rank after transformation is the one that occupied rank before transformation. Thus, the rank probabilities satisfy .
Furthermore, the conditional distributions associated with rank after transformation are the images, under , of the conditional distributions associated with rank before transformation. Since the Kolmogorov–Smirnov distance is invariant under a common strictly monotone transformation, we obtain
Summing over and using the fact that is a permutation of gives
This completes the proof.
The preceding result shows that the proposed measure is invariant under both increasing and decreasing changes of scale. Although an increasing transformation preserves the ordering of the observations, a decreasing transformation reverses the rank-specific contributions. Consequently, the overall heterogeneity measure remains unchanged, whereas its rank profile is reflected around the central rank.
The case of two populations
The case provides a particularly transparent interpretation of the proposed measure. Let and be independent, absolutely continuous random variables with distribution functions and , respectively. Define . Then , , and , .
From (8) the conditional densities associated with the minimum are
and those associated with the maximum are
These expressions are useful for both theoretical investigations and numerical evaluation; see also David and Nagaraja [3].
An illustrative example: exponential populations
The distinction between the minimum and maximum contributions becomes particularly clear when the two populations follow exponential distributions. Let , , independently, where are the rate parameters. The probability that population 1 supplies the minimum is
The conditional distribution of the minimum given that it comes from population 1 is exponential with rate . The same distribution is obtained when the minimum comes from population 2. Hence, , which implies
The situation is different for the maximum. Its conditional survival functions are
These distributions are different whenever . Therefore,
for unequal rates. Combining this result with (17), we obtain
Thus, by (18), for two exponential populations with different rates, the proposed measure detects heterogeneity through the maximum but not through the minimum. This behavior is a consequence of the memoryless property of the exponential distribution: conditional on being the first observation, the minimum has the same exponential distribution regardless of which population supplies it; see Ross [10].
This example illustrates why separating the minimum and maximum contributions can be informative. Although both extremes are derived from the same two marginal distributions, their conditional distributions may exhibit markedly different behavior. In this case, the minimum does not reveal the difference between the populations through the proposed conditional comparison, whereas the maximum does.
Comparison with marginal heterogeneity
We now investigate whether the proposed measure in (4) provides information that is not captured by a conventional marginal heterogeneity measure.
For two populations, consider the marginal Kolmogorov–Smirnov measure
Unlike , the measure in (19) compares the original marginal distributions directly. It does not explicitly account for the conditional distributions associated with the minimum and maximum.
The following example demonstrates that two population configurations can have the same value of but substantially different values of .
Let denote the lognormal distribution with parameters and , so that its logarithm follows a normal distribution with mean and variance .
Consider the following two configurations.
Configuration A. , .
Configuration B. , .
In both configurations, the populations are independent. The parameters of the second population were selected so that the marginal Kolmogorov–Smirnov distances are approximately equal. By using densities in (15) and (16), numerical integration gives the results reported in Table 1.
| Quantity | Configuration A | Configuration B |
| 0.3800 | 0.3800 | |
| 0.7584 | 0.6359 | |
| 0.1758 | 0.4469 | |
| 0.1758 | 0.5850 | |
| 0.0644 | 0.2389 |
Table 1. Marginal and rank-associated heterogeneity measures for the two lognormal configurations.
The values of are obtained from (13). For Configuration A, . For Configuration B, .
Thus, although the two configurations have essentially the same marginal heterogeneity, their rank-associated heterogeneity measures differ considerably. In fact, .
This difference illustrates the additional information provided by the proposed measure.
In Configuration A, the two populations have the same log-scale standard deviation. Their difference is primarily associated with a shift in location. The conditional distributions associated with the minimum and maximum are relatively close. In Configuration B, the populations differ in both location and scale. In particular, the second population has a substantially larger log-scale standard deviation. Although the marginal Kolmogorov–Smirnov distance remains approximately the same as in Configuration A, the conditional distributions associated with the ranks are much more different.
The example highlights an important distinction. The marginal measure quantifies how different the two original distributions are, whereas quantifies how different the rank-conditioned distributions are from the corresponding unconditional order-statistic distributions. The two measures therefore describe related but distinct aspects of population heterogeneity.
The separate contributions of the minimum and maximum also provide useful information. The two configurations can be compared not only through the overall value of , but also through the relative importance of and . This distinction helps identify whether the observed rank-associated heterogeneity is primarily related to the lower or upper extreme.
Simulation results and application
This section presents a numerical evaluation of the asymptotic and finite-sample properties of the proposed heterogeneity measures, using a comprehensive simulation study and an application to real data. Specifically, we analyze the performance of the global and local measures under diverse structural configurations that encompass a broad range of location and scale heterogeneity among populations.
Simulation results
For illustrative purposes, the observations in this section were generated from log-normal distributions. In each scenario, four random variables, , , , , were simultaneously drawn from log-normal distributions to represent the () populations. To ensure consistency across sample sizes and minimize the impact of sampling variability on the asymptotic convergence analysis, we first constructed a master dataset comprising observations. Smaller sample sizes, ranging from (1,000) to (250,000), were then obtained by subsampling from this master dataset in such a way that all observations in smaller samples were nested within those of the larger samples.

Figure 1. Conditional density, , and cumulative distribution, , functions across ranks () and simulation scenarios, along with the corresponding estimates of .

Figure 2. Asymptotic convergence of the global heterogeneity index across sample sizes under the four simulation scenarios is demonstrated.
The study considers four distinct structural scenarios to evaluate the effects of varying forms and degrees of heterogeneity among populations. In the first scenario (Independence), the four random variables are independent and identically distributed, with and for all , resulting in . The second scenario (Position) introduces progressive differences exclusively in the location parameter, , while keeping the scale parameter fixed (); specifically, with . The third scenario (Scale) varies only the scale parameter, holding the location parameter constant, so that and with . Finally, the fourth scenario (Position and Scale) represents a more complex setting in which both location and scale parameters vary simultaneously across populations, allowing for the investigation of the proposed procedure under combined sources of distributional heterogeneity: and for all .
Figures 1 and 2 illustrate the statistical stability and asymptotic convergence of the global estimator with increasing sample size (n). Specifically, approaches zero under the independence scenario (Scenario 1), whereas it converges to nonzero values reflecting the degree of structural divergence in the alternative scenarios (Scenarios 2–4). Moreover, the conditional density and cumulative distribution functions ( and , respectively) exhibit strong discriminatory power across ranks. The effects of location, scale, and their combination are clearly reflected in the corresponding curves, particularly at higher ranks ( and ).
Application results
The Hoel [7] dataset comprises two groups: Control () and Germ-free (). The three causes of failure () were treated as competing populations. In the Control group, the proportions were 22.22% () for thymic lymphoma, 38.38% () for reticulum cell sarcoma, and 39.39% () for other causes. In the Germ-free group, the corresponding proportions were 35.37% (), 18.29% (), and 46.34% (), respectively. The analysis was stratified by experimental group, with rank-conditioned survival times modeled using the log-normal distribution and parameters estimated by maximum likelihood. This stratification prevents potential distortions in that could arise from aggregating groups with different survival time scales, while enabling the assessment of heterogeneity in failure-time distributions across the three competing causes within each environmental condition.
The comparative stratified analysis of the Hoel [7] data (see Figure 3) demonstrates that the germ-free environment not only extends animal longevity but also alters the competitive dynamics among risks. The global heterogeneity measures indicate similar structural levels between groups (Control: ; Germ-free: ), reflecting comparable overall dispersion across failure cause ranks. In contrast, the asymmetry measure exhibits a pronounced sign inversion (Control: ; Germ-free: ), suggesting that the absence of microbiota shifts heterogeneity from early-stage failures to higher ranks and reduces the rigidity of temporal separation between pathologies. Notably, for the extreme ranks ( and ), only two curves are shown instead of three, due to insufficient occurrences (, where denotes the number of observations experiencing cause at rank ) for certain causes to serve as the absolute minimum or maximum failure time.

Figure 3. Rank-conditioned functions for competing risks data ( causes), stratified by group (Control and Germ-free). The left and right panels display the functions for the Control and Germ-free groups, respectively.
Consequently, rank-conditioned log-normal parametric modeling demonstrates that the absence of microbiota systematically alters the hierarchy of competing causes. The environmental factor serves both as a global retarding mechanism for failure time and as a modulator of temporal dispersion throughout the organisms’ lifespan.
Discussion and concluding remarks
This paper introduced a rank-associated measure of population heterogeneity based on the conditional distributions of order statistics. Unlike conventional measures of marginal heterogeneity, the proposed measure accounts for the association between population identity and rank in the pooled sample. In particular, while compares the original population distributions, quantifies the discrepancies between the conditional and unconditional distributions of the order statistics, thereby capturing heterogeneity associated with pooled rankings.
The construction is related to the measures of departure from independence studied in Vila and Almeida [12], which focus on the minimum and maximum in right- and left-censoring settings, respectively. The present approach extends this perspective to all order statistics and population indicators, providing an aggregate assessment of rank-associated heterogeneity. We established that if and only if each order statistic is independent of its corresponding population indicator whenever . This characterization connects the proposed measure to the literature on independence and characterizations involving order statistics and their associated indicators [1, 8, 5, 12]. We also established boundedness, invariance under common strictly monotone transformations, and bounds relating to weighted pairwise distributional distances and the diversity of population identities across ranks.
The use of the Kolmogorov–Smirnov distance allows nonparametric comparisons of entire distribution functions without requiring finite moments [9, 4]. Moreover, the probabilities provide natural weights and determine an upper bound for through the diversity of population identities across ranks. The decomposition into minimum, maximum, and intermediate contributions also helps identify where rank-associated heterogeneity arises. For example, in the exponential case, the minimum contribution vanishes, whereas the maximum contribution is positive when the populations have different rates. Thus, heterogeneity may vary substantially across order statistics.
The numerical results reveal differences in rank-associated heterogeneity even when marginal heterogeneity is identical. Monte Carlo simulations support the stability and asymptotic convergence of the proposed measure, while the empirical application illustrates its ability to identify structural differences in competing risks. In particular, the results indicate a shift in failure heterogeneity toward higher ranks in the absence of microbiota, a pattern that may not be apparent from marginal distributional comparisons alone. These findings highlight the complementary information provided by incorporating population identity and rank into the assessment of heterogeneity.
Some limitations of the proposed measure should be acknowledged. The Kolmogorov–Smirnov distance captures the largest absolute discrepancy between distribution functions and may therefore overlook differences in moments or absolute scale. Additionally, probability weighting can reduce the influence of population–rank combinations with small probabilities. Consequently, is best viewed as a complementary measure of rank-associated population heterogeneity rather than a universal measure of distributional differences.
Future research could investigate alternative probability distances, particularly Wasserstein-based measures, as considered in Vila and Almeida [12] for the minimum and maximum. Such alternatives may provide complementary perspectives on distributional discrepancies, with different sensitivities to location, scale, and tail behavior. Their properties and relationships with marginal heterogeneity and population diversity across ranks remain open questions [4, 11].
Declarations
Ethics Approval Not applicable.
Disclosure statement There are no conflicts of interest to disclose.
Author Contributions Statement All authors contributed equally to the conception and design of the study, data analysis, interpretation of the results, manuscript preparation, and revision. All authors read and approved the final version of the manuscript.
Data availability The dataset analyzed in this study is publicly available at https://raw.githubusercontent.com/IowaBiostat/data-sets/main/Hoel1972/Hoel1972, as described in Hoel [7].
References
- [1]Bapat, R. B. and Kochar, S. C. (1993). Characterizations of identically distributed independent random variables using order statistics. Statistics & Probability Letters, 17:225–230.DOI
- [3]David, H. A. and Nagaraja, H. N. (2003). Order Statistics, 3rd ed. Wiley, Hoboken, New Jersey.
- [4]Gibbs, A. L. and Su, F. E. (2002). On choosing and bounding probability metrics. International Statistical Review, 70(3), 419–435.
- [5]Kella, O. (2024). On independence of time and cause. Statistics & Probability Letters, 204:109944.arxiv.org/abs/2207.05328
- [6]Jost, L. (2006). Entropy and diversity. Oikos, 113(2), 363–375. https://doi.org/10.1111/j.2006.0030-1299.14714.x
- [7]Hoel, David G. (1972). A representation of mortality data by competing risks. Biometrics, 28(2), 475–488.pubmed.ncbi.nlm.nih.gov/4556703
- [8]Malov, S. V. (1996). On characterizations of independent identically distributed random variables via order structures. Statistics & Probability Letters, 26:97–104.DOI
- [9]Massey, F. J. (1951). The Kolmogorov–Smirnov test for goodness of fit. Journal of the American Statistical Association, 46(253), 68–78.DOI
- [10]Ross, S. M. (2014). Introduction to Probability Models, 11th ed. Academic Press.
- [11]Székely, G. J. and Rizzo, M. L. (2013). Energy statistics: A class of statistics based on distances. Journal of Statistical Planning and Inference, 143(8), 1249–1272. https://doi.org/10.1016/j.jspi.2013.03.018.
- [12]Vila, R. and Almeida, F. (2026). Characterizations of independence between order statistics and rank indicators. Preprint. Avaliable at https://arxiv.org/abs/2608.05428.