WorksEconomics, Econometrics and Finance
Taste or Strategy? Nationalistic Bias and Competitor Penalties in Figure Skating Judging
Abstract
Many decisions rest on expert panels whose members have ties to some candidates, and favoritism is hard to tell from shared taste or better information. Using a rich dataset from figure skating, we find evidence of a strategic compatriot premium and a targeted penalty on the compatriot's close rivals. The premium falls along a randomly drawn start order and, before 2022/23, rises when close rivals have their own judges on the panel. The penalty grows with the compatriot's placement chances and fades once she is out of contention. A counterfactual analysis shows that these biases can shape close competitions.
Introduction
Many important decisions rest on the subjective judgments of panels of experts, who mark candidates competing for a limited number of opportunities, such as admissions, promotions, research grants (Li, 2017), election to academies [11], sports competitions [23], and the prizes, scholarships and positions awarded by top international ballet, piano and violin competitions [12]. Panel members often have ties to some of the candidates: a shared nationality or hometown, a candidate they once taught, or a common teacher. A favorable mark may then reflect favoritism, a shared taste [23], or better information [1] if the evaluator is risk-averse. These are hard to tell apart because distortions in performance measures are rarely observed directly [9], and even when they are, few settings reveal how panels are formed, how each member evaluates each candidate, and which candidates are tied to which members.
In this paper, we utilize a rich dataset from figure skating competitions to separate the motives behind a judge’s favorable mark that deviates from the rest of the judging panel. The sport is particularly suitable for the analysis as it reveals each judge’s marks, the order of evaluation and the judges’ national ties to the skaters. It also offers variation in what a judge knows and in what her mark can achieve. In some competitions the start order of the first segment is randomly drawn, so how much of the field a judge has seen when she marks her compatriot is random. The scores are announced after each performance, so a judge knows whether her compatriot is still in contention when she marks a rival. At major championships and in the individual events of the Olympics, the judging panels are randomly drawn from eligible federations, so whether a skater faces a compatriot judge is partially determined by chance. Our dataset covers the major international competitions in the ten seasons since the International Skating Union (ISU) ended anonymous judging in 2016, and we collected skater’s ISU biography information in addition to the official competition markings. As far as we know, it is the most comprehensive dataset of individual judges’ scores used to study any group judged sport. Many of the institutional features we use to tell favoritism apart from other unintentional factors have not been used before in the literature of subjective panel judging.
In figure skating, the compatriot premium is well-documented. Zitzewitz [23], following the 2002 Salt Lake City scandal2, finds that judges score athletes from their own federations and those from other panel judges’ federations higher. More recently, the judging of the ice dance at the 2026 Winter Olympic Games in Milan sparked heated online discussions3. The literature (e.g., Zitzewitz, [23, 24]; Krumer, Otto and Pawlowski, [16]; Ansorge and Scheer, [3]; Heiniger and Mercier, [15]; Sandberg, [22], among many others) has long suggested nationalistic incentives behind the premium but could not disentangle from non-intentional explanations such as taste (Zitzewitz, [23]) or familiarity (Aigner and Cain, [1]). Leveraging the institutional design of figure skating, we find that the premium is, at least in part, strategic. Even when the start order is purely random, a judge’s premium for her compatriot declines as the competition goes on. Since neither taste or familiarity depend on a random start position, the premium of the last starter bounds how much these other factors can explain: at least a fifth of the average premium is something else. This declining pattern is consistent with strategic nationalistic scoring under uncertainty. When she marks an early-starting compatriot, a judge cannot tell how big a premium she needs to award to make it matter, whereas for a late-starting compatriot she knows better whether a premium is worthwhile and, if it is, how large it must be to change a placement. The compatriot premium also rises when the compatriot’s close rivals, especially those who start later, have judges of their own federations on the panel. In the Beijing Olympic cycle, we find that the compatriot premium rises with the share of the compatriot’s close rivals who have a judge of their own federation on the panel. The increase is larger when the other judges have a more biased reputation, which we estimate from the previous PyeongChang cycle and correct in the second step for its estimation error (Chen, Gu and Kwon, [6]).
Judges also mark down their compatriots’ close rivals, and more importantly, in a targeted way. The finding is new to the literature, where evidence for the competitor penalty is thin and mixed4. The literature defines close rivals by placement outcomes. To avoid the reverse-causality problem, we instead define close rivals by the segment start order. Our rival definition is a strong proxy of the true rivalry in Segment 2 competitions, where the leaders after the first segment skate last. We find that a judge marks a rival who skates after her compatriot significantly lower, but only while the compatriot is still in contention, as is defined by the standings of the field when the rival skates.
The competitor penalty also rises with the compatriot’s chance of a good placement. In Segment 2, the penalty grows with the compatriot’s start position, from about zero when the compatriot starts first to about half a percent of the scale when she starts last and competes for the podium.
This paper also revisits the empirical finding of Zitzewitz [23] that judges in figure skating give higher scores to other judges’ compatriots. We call it the colleague-compatriot premium rather than vote trading since other reasons such as judges’ courtesy to colleagues would produce it as well. We find that the evidence of colleague-compatriot premium in data is much weaker once we control for performance quality, such as the start position, the skater’s prior placements at the World and World Junior Championships, the program’s choreographer, etc. These controls are not needed in regressions that use within-performance judges score deviations for identification, but are crucial to cross-panel regressions for studying colleague-compatriot premium, home advantage, and the impact of panel composition on placement outcomes. We also find a compatriot premium on the technical panel. The premium is sizable, considering that the base values the technical panel sets enter every judge’s score. The home ice advantage, in turn, is awarded by the guest judges rather than by the home federation’s own judge.
The same cross-panel regressions discussed above are also subject to the non-convex average (negative weight) problem discussed in de Chaisemartin and D’Haultfœuille [10] and Goldsmith-Pinkham, Hull and Kolesár [13] for the use of multi-way fixed effects. The problem arises because the coefficient is identified from changes in panel composition across competitions, and at some competitions almost every performance has a compatriot judge on the panel. To our knowledge, this problem has not been discussed in the literature of subjective panel judging before, where cross-panel regression models are frequently used. In our analysis, the check of negative weight share and weight mass leads to better understandings of the model and points us to a subsample of competitions with randomly drawn judge panels, under which the problem nearly disappears.
With the above mentioned findings of strategic nationalistic scoring, we carry out a counterfactual analysis of the figure skating events at the 2026 Milan Winter Olympic Games. We show that the compatriot premium, the competitor penalty, and the colleague-compatriot premium, through the random draw of judge panels, can jointly shape close competitions. In the analysis we redraw admissible panels under ISU’s draw rules for Winter Olympic Games and rescore each performance under each redraw. We find that the ice dance title changes hands in 45 to 57 percent of the redraws and the women’s title 20 to 27 percent, depending on how the judges’ honest disagreement is modeled. The ISU’s trimmed mean offers little protection. We derive how much of one judge’s bias a nine-judge trim removes, and trimming removes only a small part of the compatriot premium or the competitor penalty of a typical size. We therefore suggest keeping the federations of the leading skaters off the judging panel, when feasible, as the ISU already does for the technical panel.
Last but not least, we would like to point out that, in this paper, we refrain from either selecting a set of biased judges with multiple testing procedures or ranking the judges, although we obtain judge-specific compatriot premium estimates as an intermediate step of our regression analysis. This is because a multiple testing procedure is more likely to single out judges who sit on more panels and come from larger federations, while the point estimates are unstable for judges that do not have a substantial presence in the data. Readers can reproduce the judge-specific estimates from our replication package, but we caution against reading too much into the numbers or using them as evidence against specific judges. To properly identify the most nationalistic judges in the data, proper statistical methods for ranking and selection such as Armstrong, Kolesár and Plagborg-Møller [4]; Gu and Koenker (2023); Mogstad et al. [20]; Andrews, Kitagawa and McCloskey [2], among others, need to be adopted.
The rest of the paper is organized as follows. § 2 introduces the institutional background, points out the identification challenges in the literature, and describes the data. § 3 presents our benchmark regressions, confirming a strong compatriot premium found in the literature and uncovering a new precisely estimated targeted competitor penalty. § 4 further explores strategic nationalistic scoring, showing that compatriot premium and competitor penalty are strategic, both varying along the start order, and the premium also responding to the panel composition. Section 5 examines how the judge panel composition can impact competition outcomes and carries out a counterfactual analysis of the 2026 Olympic events. Section 6 concludes and provides policy implications. The appendix gives further institutional background and reports robustness checks for the main results. Although our setting is figure skating, the findings carry lessons for other settings where economic decisions rest on subjective evaluations by expert panels.
Institutional Background and Data Summary
Figure Skating Competitions and the Scoring Mechanism
Figure skating is a sport in which athletes or athlete pairs perform choreographed programs of jumps, spins, lifts, and other moves together with music. Scores of figure skating performances are fully determined by officials: a technical panel and a judge panel. Important figure skating competitions include, for the seniors, World, European, and Four Continents Championships, the Grand Prix (GP) series, and the GP Final, and, for the juniors, World Junior Championships, the Junior Grand Prix (JGP) series, and the JGP Final. Every four years, there are also the Winter Olympic Games, the Winter Youth Olympic Games, and the Asian Winter Games.5 All figure skating competitions span across multiple disciplines (Men, Women, Pair, Ice Dance)6 and sometimes also different tiers (Junior, Senior) and different types (Individual, Team). Regardless of discipline, tier, and type, each category of a figure skating competition consists of two segments, a short program (in ice dance, the rhythm dance, called the short dance before 2018/19) first, and 1-3 days later, a longer free skate (in ice dance, the free dance).
The score of each segment has three parts: the Total Element Score (TES), the Program Component Score (PCS), and deductions. The Total Segment Score (TSS) is the TES plus the PCS minus the deductions. A skater’s final ranking is determined by the sum of the two segment scores.
Two groups of officials produce the TES. The technical panel identifies each element (e.g. jumps, spins, step sequences), assigns difficulty levels (Basic, then Level 1 through 4), and flags errors. such as under-rotations, wrong edges, and falls. These calls determine the Base Value (BV) of each element. The technical panel consists of a Technical Controller and two Technical Specialists. During the performance the Technical Specialist identifies each element as it is executed and calls the level of difficulty when needed. The Technical Controller supervises and may correct a call.
The judges mark how well each element was executed (on an integer scale from −5 to +5 post 2018/19 and from −3 to +3 before), and their marks are aggregated by a trimmed mean into the grade of execution (GOE). For each element, the single highest and lowest marks are dropped and the rest are converted into points and averaged. An element’s score is its BV plus its GOE, and the TES is the sum over the program’s elements. The technical panel’s calls affect the GOE both directly, because GOE grades of jumps and step sequences are converted into points as a fixed share of the base value, and indirectly, through their influences on judges’ execution markings.
After the performance, each judge also marks the program components on a scale in steps of 0.25 up to 10.00. Since 2022/23 there are three components (five before): Composition, Presentation and Skating Skills. Each component’s trimmed mean is multiplied by the segment’s factor and the products are summed. Appendix § 8 gives out an example by working through the math with an official protocol of a performance.
Our dataset starts from the 2016/17 season because the ISU ended anonymous judging after the 2015/16 season. The protocols do not name the judges, but there is a separate Panel of Judges document that the ISU, or the organizing committee/federation for the events, publishes for every segment, which we use to identify the names of judges. In the appendix, we also explain in details how judges are linked to their federations.
Judge Assignment and Performance Start Order
In this section, we provide contexts for how judges are assigned to panels and how the start order of competitions is set. Judge assignment explains why some regression models used in the literature suffer from potential endogeneity and the non-convex average problem, and how choosing a specific subsample mitigates the problem. The start order is used to define competitors.
Panel formation rules vary across competitions. In important competitions such as the individual events of the Olympics, the World Junior and World Championships, and the Europeans, the panel is drawn randomly. First, thirteen federations are drawn for each discipline, among eligible federations6, who nominate judges after being selected. Before the first segment, a nine judge panel is drawn out of the thirteen. The four not drawn to the first segment sit the second automatically. The other five seats for the second are then drawn from the nine who sat the first. Some other competitions like Four Continents and the Youth Olympic Games use a simplified random draw process which only draws federations but keep the same judges for both segments of a discipline. At the GP events, all judges are invited by the host. For the GP Final, the ISU invites the judges, with priority given to the federations with qualified skaters. At the JGP events, each federation with skaters entered may send 1-2 judges. When more judges are present than a discipline’s nine seats, a panel draw takes place.
The start position is determined by different regimes. For the first segment, there are three regimes: open draw, which mostly happens in JGP events, reverse ranking based on the ISU World Standings, and seeded draw, where competitors are divided into groups by their standings with higher-ranked groups starting later and random draws within the group. In the second segment, skaters start in the reverse order of the first-segment result, either exactly or by a random draw within groups that are formed on the first-segment result.
Data Summary
The dataset covers the competitions listed in § 2.1 and the World Team Trophy from 2016/17 to 2025/267, except for 2020 Cup of China and the three 2020/21 GP events which are run with domestic panels because of COVID-19. We also exclude the team event of the 2020 Winter Youth Olympic Games, because the teams were formed with mixed skaters from different federations. All data entries are parsed from the official PDF protocols downloaded from the ISU results website or from the websites of the host federation or organizers.8 The regression sample has 172 competitions, 23,254 performances by 2,470 skaters, pairs, and couples from 78 federations, and 206,983 performance-judge pairs from 620 judges of 59 federations.
Table 1 summarizes the judges’ grades and marks and their synthetic segment scores by era.
| Score type | Judges per performance | Range | Minimum increment | Mean | |
| Era A. 2016/17–2017/18 (PyeongChang cycle) (GOE to , five components; 5,277 performances) | |||||
| GOE grade (per element) | 6–9 | to | 1 | 0.30 | 402,705 |
| Program component mark | 6–9 | 0.25 to 10 | 0.25 | 6.37 | 235,030 |
| Segment score (one per performance) | 6–9 | 3 to 223 | 0.01 | 78.61 | 5,277 |
| Era B. 2018/19–2021/22 (Beijing cycle) (GOE to , five components; 7,424 performances) | |||||
| GOE grade (per element) | 5–9 | to | 1 | 0.72 | 557,277 |
| Program component mark | 5–9 | 0.25 to 10 | 0.25 | 6.61 | 329,940 |
| Segment score (one per performance) | 5–9 | 5 to 225 | 0.01 | 82.32 | 7,424 |
| Era C. 2022/23–2025/26 (Milan cycle) (GOE to , three components; 10,553 performances) | |||||
| GOE grade (per element) | 5–9 | to | 1 | 0.47 | 793,515 |
| Program component mark | 5–9 | 0.25 to 10 | 0.25 | 6.47 | 281,967 |
| Segment score (one per performance) | 5–9 | 10 to 238 | 0.01 | 81.35 | 10,553 |
Table 1. Data Summary By Discipline and Era
ISU changed the marking scale twice during our ten seasons sample period. From 2018/19 GOE grade ranges changed from to grades and the second-half jump bonus are restricted to the last single jump of the short program and the last three of the free skating. From 2022/23 the five program components were reduced to three. Both changes took effect in the season after an Olympic Winter Games. Therefore, we divide the ten seasons into three eras: Era A consists of the last two seasons of the PyeongChang cycle; Era B is the Beijing cycle; Era C is the Milan cycle.
NOTE: The data includes a total of 172 competitions from 2016/17 to 2025/26: the World Championships, the European Championships, the Four Continents Championships, the World Junior Championships; the Olympic Winter Games, the Winter Youth Olympic Games; the World Team Trophy, the Asian Winter Games, the Grand Prix, the Junior Grand Prix, and (Junior) Grand Prix Final.
Table 2 shows that scores differ widely across disciplines and segments. The average performance score is 128.45 for Men FS and 50.96 for Women SP. To unify scores across disciplines, segments, and seasons, we express each judge’s marks in percent of a reference value. Let index a judge and a performance. For the GOE, we define
| Discipline and segment | Mean | Standard deviation | Mean | Overall | Within | Correlation | ||
| Men SP | 3,603 | 66.58 | 16.93 | 32,252 | 66.56 | 17.10 | 2.85 | 0.987 |
| Men FS | 3,186 | 128.45 | 33.69 | 28,568 | 128.36 | 33.95 | 4.76 | 0.991 |
| Women SP | 4,297 | 50.96 | 13.75 | 38,475 | 50.98 | 13.87 | 2.30 | 0.988 |
| Women FS | 3,842 | 96.95 | 28.73 | 34,383 | 96.95 | 28.90 | 3.82 | 0.992 |
| Pairs SP | 1,669 | 57.78 | 11.57 | 14,941 | 57.74 | 11.78 | 2.50 | 0.980 |
| Pairs FS | 1,570 | 106.18 | 22.95 | 14,071 | 106.08 | 23.22 | 3.97 | 0.987 |
| Ice dance SD/RD | 2,690 | 59.81 | 13.67 | 23,458 | 59.95 | 13.89 | 2.80 | 0.982 |
| Ice dance FD | 2,397 | 91.72 | 20.75 | 20,835 | 92.04 | 20.96 | 3.65 | 0.986 |
| All | 23,254 | 81.04 | 34.31 | 206,983 | 81.11 | 34.47 | 3.40 | 0.996 |
Table 2. Data Summary By Discipline
which places the GOE points judge awards on the range from the lowest to the highest she could award, given the BV set by the technical panel. In the formula, is the grade judge awarded to element , converts a grade on that element into points under the rules of the season, and are the highest/lowest grades the season allows. We measure the GOE rather than the TES because the latter is dominated by the BV, which makes up over 90% of the TES on average and, being set by the technical panel, is the same for every judge on the panel. For the PCS, we define
which is the share of the full component score that judge awarded. Here is judge ’s mark on component , and the number of components.
NOTE: SP is the short program, the first segment of men, women, and pairs. FS is the free skate, the second segment of men, women, and pairs. SD and RD are the short dance and the rhythm dance, the first segment of ice dance through 2017/18 and from 2018/19. FD is the free dance, the second segment of ice dance. Within standard deviation is the standard deviation of scores across the judges of the same performance.
For the TSS, we use the judge’s synthetic total, which is not an official score but the score a performance would have received had every judge on the panel given that judge’s marks, measured against the scale of comparable performances:
where is judge ’s synthetic segment score for performance , and is the highest score achieved in the performance’s season discipline segment cell7, by any skater other than the cell’s top scorer so that one exceptional skater does not set the unit (e.g., Ilia Malinin’s personal best in Men’s free skate in 2025/26 is 11.9% above the personal best of all other skaters).
Figure 1 shows that, after the normalization, the percent outcomes are comparable in scale across seasons, disciplines and segments. We do not remove the difference between the junior and senior tiers, which we view as a reflection of performance quality gap between the two age groups. For every performance, each judge on the panel has a GOE, a PCS, and a synthetic TSS pct outcome. The use of synthetic score outcomes allow us to control for performance fixed effects and explore judges’ strategic behavior from within-performance score variations.
Figure 1. Summary Of the Three Synthetic Score Percent Outcomes
NOTE: Panel (a): by season. The 2020/21 season has only two competitions and therefore drawn hollow. The dotted verticals mark the change of the GOE scale to ±5 (2018/19) and of five program components to three (2022/23). Panel (b): by discipline × program. Ice Dance RD is the ice-dance short segment, the short dance through 2017/18 and the rhythm dance after.
Existing Models and Their Identification Challenges
Let denote skaters (single skaters, pairs, and ice dance couples, all called skaters below), judges, performances, and (resp. ) the federation of skater (resp. judge ). Let denote the segment of performance and the panel of judges scoring the segment . Ideally, judge ’s mark on performance should only reflect her perception of the performance quality, and the perception is determined by the true quality of and unintended factors such as ’s judgment error and her overall leniency. In reality, many other factors come into play. Previous studies [23, 22, 15, 16 among many others] have documented evidence of compatriot bias, vote trading, and home advantage.
using the following regression models and their variations:
In these equations, indicates whether skater and judge are from the same federation, indicates whether a judge other than on the panel is from skater ’s federation8, indicates whether the skater is from the host country of the competition, is the performance fixed effect (e.g., performance quality), the judge fixed effect (e.g., leniency), the skater fixed effect (e.g., ability or popularity that does not change over time), the segment (competition discipline segment) fixed effect, and the regression error.
Model (1) is more robust than model (1′) because of the performance fixed effects. Even so, the compatriot premium estimated from (1) cannot reveal judge’s intent. The premium can arise from a taste that judges share with their compatriot skaters, which Zitzewitz [23] counts as compatriot unconscious bias. It can also arise from familiarity since judges typically know their compatriot skaters’ ability more precisely, having watched them at domestic competitions. As Aigner and Cain [1] discuss, risk-averse evaluators may discount candidates whose quality they know less precisely, and therefore rate the candidates they have ties with higher on average even when their true quality is the same. In this paper, we argue that favoritism aimed at improving compatriot skaters’ standings produces scoring strategies that vary with the information judges have when they mark, while shared taste or familiarity cannot produce these scoring patterns.
Model (1′) and its variants are often used in the literature to study the colleague-compatriot premium and home advantage. The equation replaces the performance fixed effect, i.e., the skater segment fixed effect, with separate skater and segment fixed effects, because would absorb the home ice indicator, and the other-panel compatriot indicator is perfectly collinear with and . As a result, the coefficients in (1′) may pick up the effects of uncontrolled performance9 specific factors. For example, is biased upward if federations choose where to send their judges when they can. As a skater develops, she may build a reputation among the judges and work with more capable choreographers on her programs. Her federation may also earn, through her results, the right to enter a judge at the major championships and the Olympics, and expecting her to place well, be more willing to send a judge to competitions where it has a say. The skater, segment, and judge fixed effects in (1′) cannot fully absorb such latent, time-varying ability, which in turn biases the estimates. To address this problem, we collect additional controls for performance quality from the skaters’ season biography pages on the ISU website. We find that the colleague-compatriot premium shrinks substantially when these novel controls are included.
For inference, we cluster by competition and by athlete, using the two-way cluster-robust variance estimator of Cameron, Gelbach and Miller [5]. Appendix § 11 reports two robustness checks for the inference choice: clustering by competition and athlete federation10 instead, and using the jackknife variation of two-way competition and athlete clustering following MacKinnon, Nielsen and Webb [19]. Under both checks, the TSS estimates behind our main findings remain significant at the 5 percent level, except for the technical judge premium, which moves to the 10 percent level with the jackknife method.
Last but not least, we note that models (1) and (1′) impose a common premium, , and , for all observations. If the premium instead differs across observations, the OLS estimate is a weighted sum of the heterogeneous premia [10] , and . Then, by the Frisch-Waugh-Lovell theorem, , for instance, is an unbiased estimate of over the compatriot rows, with where is the residual of regressing on other regressors including the performance and judge fixed effects. The weights can be negative when the predicted probability of exceeds one. Therefore, in all our analysis, we report both the share of observations with negative weights and the range of negative weight mass (i.e., ). We find that the non-convex average problem arises with (1′) and other regression models that exploit cross-panel variations in the panel composition for identification. In § 3.2, we show how choosing a subsample of competitions with randomly drawn judge panels helps with the non-convex average problem in our empirical setting.
Descriptive Analysis
Before starting the main analysis, we use model (1) and its heterogeneity analysis extensions to describe the data. Figure 2 estimates the model with a separate compatriot coefficient for each season (Table A.1 in Appendix § 10.§ 1 reports the corresponding estimates). The premium is positive in every season and on every outcome, and statistically significant whenever a valid standard error can be computed.11 The seasons fall roughly into three periods: 2016/17 to 2017/18, 2018/19 to 2020/21, and 2021/22 to 2025/26. The premium is steady within each period and steps down in between: the TSS premium averages 2.43 percent in the first period, 1.92 in the second (COVID-impacted 2020/21 left out) and 1.44 in the third. The first drop follows the PyeongChang Olympics and coincides with several events that happened before the 2018/19 season: the ISU suspended two Chinese judges for national bias at the PyeongChang Olympics Games; the ISU Congress required the Officials Assessment Commission (OAC), which reviews every judge’s marks after each ISU event, to report suspected national bias at every competition; and several rule changes including the GOE scale change. The second drop came in the 2021/22 season. This coincides with the publication of an ISU Communication (2369) that added more details to the OAC reviews, requesting the commission to compare each judge’s total score for a skater with totals for the two skaters placed immediately above and the two placed immediately below, and report all cases of possible nationalistic bias. Around the same time, the ISU suspended a judge for one year for national bias at the World Championships 2021.
Figure 2. Compatriot Premium By Season. NOTE: Each estimate with its pointwise 95% interval and the familywise 95% interval. In our sample, the 2020/21 season has only two competitions and therefore no interval.
Figure 3 plots the compatriot premium by discipline and segment, estimated with model (1) separately for each discipline segment cell (Table A.2 in Appendix § 10.§ 1 reports the estimates). The discipline differences are large. Ice dance carries a TSS premium about twice the size of men’s and women’s, and the point estimates follow the ordering of men < women < pairs < ice dance within each program on both TSS and GOE. On PCS, the three disciplines with jumps lie between 1.4-1.8 percent, while ice dance is above 2.5.
Figure 3. Compatriot Premium By Discipline × Segment. NOTE: Each estimate with its pointwise 95% interval and the familywise 95% interval.
In Table A.3 and Table A.4 of the appendix, we also estimate the compatriot premium in each program component score, and the premium in GOE scores grouped by different types of elements in the singles competitions. Among the components, the premium is smallest on skating skills and largest on composition in every discipline and under both component systems, except for pairs in 2016/17–2021/22, where the premium is slightly larger on interpretation. Among the elements, step and choreographic sequences carry the largest premium in both programs of both singles disciplines rather than jumps and spins. The premium thus seems to be largest where the mark relies most on the judge’s own subjective reading.
Benchmark Models and Estimation Results
Compatriot Premium and Targeted Competitor Penalties
In this section, we estimate the compatriot premium together with the competitor penalty, a judge’s tendency to mark down the rivals of her compatriot skaters. As discussed in the introduction, the evidence on a competitor penalty is mixed in the literature, with competitors defined by final placement results. We define competitors by the start order of a segment to avoid the two-way causality problem. The cost is that the start order identifies a compatriot’s competitors with noise and biases the estimated penalty toward zero. Even so, we estimate the competitor penalty precisely and discover that the penalty is targeted. In the discussions below, we use competitor and rival interchangeably.
Let denote the set of skaters performing in segment . Let , where and denote the skater and the start number of a performance, respectively. A skater in set is considered a close rival of ’s skater, as she comes from a different federation and starts within three numbers of performance . Consider the outcome equation:
where indicates if judge comes from the same federation as any of skater ’s close rivals. In the Appendix § 10.§ 3, we use alternative definitions of for robustness checks.
Columns (1)–(3) of Table 3 report estimates of model (3), for each of the three percent-of-scale outcomes described in § 2.3. On average, a judge marks a skater from her own federation 1.73 percent of the scale higher on TSS than the other judges on the same panel, 2.64 and 1.82 percent higher for GOE and PCS respectively. As discussed in § 2.4, alone cannot separate nationalistic bias from other causes of the compatriot premium. We return to this question in § 4.1. Besides the compatriot premium, the table documents negative and statistically significant competitor penalties on all three outcomes: −0.124 on TSS, −0.261 on GOE, and −0.080 on PCS.
| Variable | (1) TSS pct | (2) GOE pct | (3) PCS pct | (4) Segment 1, open draw | (5) Segment 1, seeded order | (6) Segment 2 |
| Compatriot | +1.727*** | +2.644*** | +1.816*** | +1.611*** | +1.842*** | +1.700*** |
| (0.060) | (0.106) | (0.067) | (0.096) | (0.081) | (0.062) | |
| Rival | -0.124*** | -0.261*** | -0.080*** | -0.086* | -0.032 | -0.204*** |
| (0.023) | (0.037) | (0.030) | (0.044) | (0.033) | (0.027) | |
| Performance FE | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| Judge FE | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| N | 206,983 | 206,983 | 206,983 | 46,208 | 62,918 | 97,857 |
| # of Competitions (G) | 172 | 172 | 172 | 70 | 102 | 172 |
| Mass of negative weights | 0.000 | 0.000 | 0.000 | 0.000 | ||
| Share of negative weights | 0% | 0% | 0% | 0% |
Table 3. The Baseline Compatriot Premium and the Competitor Penalty
Columns (4)–(6) of Table 3 repeat the analysis for TSS on three subsamples that differ in how the start order is determined. Column (4) uses the first segments whose start order is set by an open draw. Column (5) uses the other first segments, whose start order is set by a seeded draw. Column (6) uses all second segments, where the start order follows the result of the first segment therefore tracks who actually competes with whom. As is expected, the competitor penalty is statistically significant at the 5% level only for the Segment 2 subsample. The slope coefficient is −0.204, about one eighth of the compatriot premium.
Compared with the compatriot premium, the competitor penalty coefficient may seem small. However, the compatriot premium comes from a single judge, since a federation has at most one judge on the panel of a segment, whereas the competitor penalty comes from every rival judge on the panel. In our sample, a performance has on average 2.4 rival judges, and 47 percent of performances have three or more. Summing over the panel, the competitor penalty can add up to 36–48% of the compatriot premium for a skater who faces three or four rival judges in Segment 2. And it only offers a lower bound, in absolute value, of the true competitor bias due to the attenuation bias.
Note that the rival penalty in Column (4) of Table 3 is marginally significant at the 10% significance level under an open draw. We checked whether some competitions had been misclassified as open draws and found no sign of it. We therefore read this marginally significant estimate as either a chance rejection at the 10% level or a small penalty that judges give to skaters who happen to perform close to their compatriots. Table 3 also reports the share of negative weights and the mass of negative weights for each regression estimates and finds no problems. The need to report such statistics is discussed in § 2.4, following de Chaisemartin and D’Haultfœuille [10].
NOTE: All ten seasons, 2016/17-2025/26. Segment 1, open draw: the first segments whose start order is an open lot (the JGP, the 2016/17 GP events and Final, and the 2025 Asian Winter Games). Segment 1, seeded order: the first segments whose order (or group order) follows the reverse of ISU World Standing. Segment 2: the free segments, whose order (or group order) follows the reverse of first segment’s result. Two-way (competition + athlete) cluster-robust standard errors in parentheses, with degrees of freedom, the column’s competitions; *** , ** , * . Of the two alternative standard errors in Appendix § 11, clustering by competition and athlete federation changes no significance level, and the two-way cluster jackknife changes only that of Rival in column (3), from the 1 to the 5 percent level.
One may argue that, just like the compatriot premium, the competitor penalty may come from unintended factors. We therefore repeat the analysis of model 2, with the rivals split by whether they skate before or after the judges’ compatriot and for those who skate after her, by whether the compatriot is still in contention. If the penalty came from a distaste for skating styles of other federations, or from judges marking neighboring performances harder, there would be no reason for the competitor penalty to vary with the start side or the compatriot’s standing after her performance.
Let (resp. ) denote the set of skaters starting within three numbers after (resp. before) performance . We consider the following model of targeted competitor bias:
where indicates if a skater of judge ’s federation starts within three numbers after performance , $R_{ijp}^- = 1{C_{ij} = 0} \cdot 1{\exists s \in S_R^-(p) : indicates if a skater of judge ’s federation starts within three numbers before performance , indicates whether such an earlier compatriot is in contention when performance starts, with if skater is still in contention when performance starts, that is, if her segment score ranks among the top three of the performances skated so far and, in a second segment, she also placed in the top eight after the first segment, and indicates that judge ’s earlier compatriots within three start numbers of performance are all already out of contention.
NOTE: Columns (1)-(3) are on the whole sample. Columns (4)-(6) are on three subsamples partitioned by the start order mechanism; same definitions as Table 3. Two-way (competition + athlete) cluster-robust standard errors in parentheses, with degrees of freedom, the column’s competitions; *** , ** , * . Of the two alternative standard errors in Appendix § 11, clustering by competition and athlete federation moves Rival starting later, in contention in column (1) from the 1 to the 5 percent level, Rival starting later, out of contention in column (2) to not significant, and Rival starting earlier in column (4) from the 10 to the 5 percent level. The two-way cluster jackknife changes no significance level.
Table 4 reports the estimates for all three score outcomes on all observations and then for TSS only on the three start-order subsamples. Columns (1)-(3) show that judges mark down their compatriots’ close rivals, unless the marked skater performs after the judge’s compatriot, and the compatriot is already out of contention. The exception is a small GOE penalty on the rivals who start after a compatriot who is already out of contention (−0.095), and no significant PCS penalty on the rivals who start after a compatriot who is still in contention.13 For rivals who start before the compatriot skater, although the judge does not know yet how her compatriot will perform, every point taken from the marked skater lowers the bar that her compatriot has to clear, which can help boost her confidence and ease her nervousness. When the compatriot has already skated and is out of contention, the penalty on TSS () is both small and statistically insignificant. Similar to findings in Table 3, columns (4) and (5) of Table 4 do not have any coefficients reporting statistical significance at the 5% level.
| Variable | (1) TSS pct | (2) GOE pct | (3) PCS pct | (4) Segment 1, open draw | (5) Segment 1, seeded order | (6) Segment 2 |
| Compatriot | +1.726*** (0.060) | +2.647*** (0.106) | +1.814*** (0.067) | +1.614*** (0.096) | +1.847*** (0.081) | +1.692*** (0.062) |
| Rival starting earlier | -0.158*** (0.022) | -0.260*** (0.037) | -0.142*** (0.031) | -0.082* (0.047) | -0.047 (0.037) | -0.262*** (0.029) |
| Rival starting later, in contention | -0.101*** (0.035) | -0.253*** (0.056) | -0.032 (0.046) | -0.093 (0.069) | +0.023 (0.051) | -0.264*** (0.048) |
| Rival starting later, out of contention | -0.004 (0.028) | -0.095** (0.045) | +0.033 (0.039) | -0.021 (0.065) | -0.021 (0.050) | +0.006 (0.033) |
| Performance FE | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| Judge FE | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| N | 206,983 | 206,983 | 206,983 | 46,208 | 62,918 | 97,857 |
| # of Competitions (G) | 172 | 172 | 172 | 70 | 102 | 172 |
| Mass of negative weights | 0.000 | 0.000 | 0.000 | 0.000 | ||
| Share of negative weights | 0% | 0% | 0% | 0% |
Table 4. How Rival Penalty Changes with Start Order and Compatriot’s Realized Performance Quality
Colleague-Compatriot Premium, Home Ice Advantage, and Technical Judge Premium
In this section, we study whether judges give higher marks to the compatriot skaters of their colleagues on the same panel. We call this the colleague-compatriot premium rather than vote trading [23] because a positive premium can also have other behavioral explanations such as courtesy toward a colleague, since every judge’s marks in our sample period are published together with their names. This section also studies the home ice advantage and the compatriot bias of the technical panel.
For reasons discussed in § 2.4, we replace the performance fixed effects in (3) with skater and segment fixed effects. Further, we include a vector of performance quality controls to reduce the potential endogeneity caused by dropping the performance fixed effects. Specifically, we consider the following cross-panel design:
where (resp. ) indicates whether the skater and the technical controller (resp. one of two technical specialists) come from the same federation, and where is a vector of performance quality controls constructed using information from skater’s bio page posted every season on the ISU website. The vector includes: prior placements at the Junior World and World Championships, whether first season in junior/senior events, and indicators of choreographers and of chosen music types.
NOTE: Columns (1)-(6) All rows, 2016/17-2025/26. Columns (7)-(9), World (Junior) Championships, European Championships, and Olympic Games. Two-way (competition + athlete) cluster-robust standard errors in parentheses, with degrees of freedom, the column’s competitions; *** , ** , * . Of the two alternative standard errors in Appendix D, clustering by competition and athlete federation moves Rival from the 1 to the 10 percent level in column (1) and makes it significant at the 10 percent level in column (7), and moves Other-panel compatriot from the 5 to the 10 percent level in column (1) and from the 10 to the 5 percent level in column (9). The two-way cluster jackknife moves Rival in column (1) from the 1 to the 5 percent level, and Compatriot Technical Controller in columns (1), (4) and (7) from the 5 to the 10 percent level.
Table 5 reports the main slope coefficients of model {(2’)}. Comparing Columns (1)-(3) with Columns (4)-(6) confirms the importance of using performance quality controls in this cross-panel model. With them, the evidence for colleague-compatriot premium becomes much weaker: the TSS estimate of falls by about half and is no longer significant. Only the PCS estimate remains significant, at about 60 percent of its size once the controls are added. Skaters competing at home also receive higher marks, which may be influenced by crowd support from the audience, or the skater’s familiarity with the venue. Interestingly, the table also reports a negative and statistically significant slope coefficient of the compatriot and home ice interaction term, implying that the guest judges award more home ice advantage than home federation’s own judge. At the Championships and Olympics, where only 4.9 percent of the compatriot rows are on home ice, is small and statistically insignificant.
| Variable | Without performance quality controls (1) TSS pct | Without performance quality controls (2) GOE pct | Without performance quality controls (3) PCS pct | With performance quality controls (4) TSS pct | With performance quality controls (5) GOE pct | With performance quality controls (6) PCS pct | Championships and Olympics (7) TSS pct | Championships and Olympics (8) GOE pct | Championships and Olympics (9) PCS pct |
| Compatriot | +2.012*** (0.140) | +2.776*** (0.203) | +2.279*** (0.105) | +1.860*** (0.130) | +2.709*** (0.197) | +2.082*** (0.094) | +2.207*** (0.236) | +3.260*** (0.400) | +2.245*** (0.181) |
| Rival | -0.084*** (0.031) | -0.229*** (0.046) | +0.033 (0.034) | -0.124*** (0.030) | -0.247*** (0.046) | -0.024 (0.032) | -0.094 (0.060) | -0.281*** (0.074) | -0.023 (0.054) |
| Other-panel compatriot | +0.270** (0.126) | +0.122 (0.175) | +0.420*** (0.084) | +0.135 (0.118) | +0.063 (0.171) | +0.246*** (0.072) | +0.271 (0.208) | +0.381 (0.317) | +0.247* (0.121) |
| Other-segment compatriot | +0.362 (0.299) | +0.601 (0.401) | +0.272 (0.164) | ||||||
| Home ice | +0.634*** (0.185) | +1.063*** (0.240) | +0.473*** (0.144) | +0.740*** (0.171) | +1.140*** (0.237) | +0.582*** (0.125) | +1.201*** (0.344) | +1.925*** (0.585) | +0.888*** (0.212) |
| Compatriot × home ice | -0.428*** (0.111) | -0.539*** (0.175) | -0.563*** (0.129) | -0.412*** (0.110) | -0.532*** (0.176) | -0.534*** (0.129) | +0.084 (0.349) | +0.182 (0.655) | +0.298 (0.315) |
| Compatriot Technical Controller | +0.400** (0.185) | +0.197 (0.273) | -0.058 (0.155) | +0.370** (0.160) | +0.180 (0.260) | -0.113 (0.121) | +0.856** (0.351) | +0.681 (0.514) | +0.306 (0.185) |
| Compatriot Technical Specialist | +0.283 (0.196) | +0.041 (0.230) | -0.020 (0.133) | +0.292 (0.180) | +0.035 (0.221) | -0.001 (0.116) | +0.250 (0.310) | -0.196 (0.451) | +0.060 (0.200) |
| ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ||||
| Skater FE | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| Segment FE | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| Judge FE | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| N | 206,983 | 206,983 | 206,983 | 206,983 | 206,983 | 206,983 | 55,276 | 55,276 | 55,276 |
| # of Competitions (G) | 172 | 172 | 172 | 172 | 172 | 172 | 30 | 30 | 30 |
| Mass of negative weights, Other-panel/segment compatriot | 0.047 | 0.050 | 0.000–0.006 | ||||||
| Mass of negative weights, all other coefficients | 0.000–0.015 | 0.000–0.015 | 0.000–0.008 | ||||||
| Share of negative weights, Other-panel/segment compatriot | 18% | 18% | 1%–4% | ||||||
| Share of negative weights, all other coefficients | 0%–5% | 0%–5% | 0%–10% |
Table 5. Colleague-Compatriot Premium, Home Ice Advantage, and Technical Judge Premium
The regressions also find compatriot bias among technical judges. A compatriot technical controller raises the TSS by 0.37 percent of the scale with the controls and by 0.86 at the Championships and Olympics, which is about a fifth and two fifths of a compatriot judge’s premium. The technical specialist’s coefficient is not significant in any column, and neither indicator is significant for the GOE or the PCS, which is consistent with the technical judges working mainly through setting the base values of the elements. Although the and estimates look small in the table, their effects on the official score are sizable. The base values the technical panel sets enter every judge’s score, unlike the compatriot premium and the competitor penalty, which enter the official score through the panel’s trimmed mean.
Notice that regressions in columns (1)-(6) report that 18 percent of the observations used to identify enter its estimate with a negative weight, and the mass of negative weights is around 5 percent. As is discussed in § 2.4, these negative weights arise because the coefficient is identified from changes in panel composition across competitions, and in some competitions almost every performance by a skater from a large federation has a compatriot judge on the panel. In columns (7)–(9), we repeat the analysis on a subsample of Championships and Olympic Games. At these competitions, federations are randomly drawn to form a pool of judges for each discipline, and the judges who sit each segment are drawn from that pool, which mitigates the problem of negative weights. As we see from the table, the share of negative weights behind falls from 18 to 4 percent (the technical judges’ shares rise to 10 percent, but their negative weights sum to less than 0.01), and the mass falls from 5 to 0.6 percent. With the new subsample, empirical findings from the full sample still holds. The other-panel compatriot premium is only significant for the PCS. Columns (7)–(9) also include an other-segment compatriot indicator, which is from the random panel draw rules of these championship and Olympics events, as judges not sitting on the current panel will still sit on the other segment’s panel. Its coefficients are of the same size as the other-panel compatriot’s but not significant due to lack of statistical precision.
Table A.5 and A.6 in the appendix report the slope estimates of the performance controls used in columns (4)-(9) of Table 5. Because the regressions include skater fixed effects, these coefficients compare a skater with herself. A skater placed at an earlier World Championships scores 2.8 percent of the scale more on the TSS, and one who has placed at an earlier World Junior Championships scores 1.3 percent more. In the first season in junior events, a skater scores 1.8 percent less, while the first season in senior events makes no significant difference. Some choreographer indicators are also producing large and significant coefficients, although they need not to be causal, as a skater may work with a better-known choreographer in seasons when she is in a better form.
Strategic Nationalistic Scoring
Start Order and the Nationalistic Bias
§ 3.1 showed that judges target their competitor penalties in a way that is hard to explain by unintentional factors such as taste, cultural differences, or simply judges being harsher on skaters who perform close to their compatriots. In this section, we ask the same question for compatriot premium: do judges target it too? Does a judge adjust the premium to how well her compatriot has skated, or to the compatriot’s start position? If so, can this be explained by unintentional factors, or is it instead in line with nationalistic incentives?
Extending model (4), Table 6 reports estimates of the following regression model:
| Variable | (1) TSS pct | (2) GOE pct | (3) PCS pct | (4) Segment 1, open draw | (5) Segment 1, seeded order | (6) Segment 2 |
| Compatriot | +1.741*** | +2.665*** | +1.823*** | +1.641*** | +1.863*** | +1.710*** |
| (0.062) | (0.110) | (0.068) | (0.099) | (0.083) | (0.065) | |
| Rival starting earlier | -0.133*** | -0.234*** | -0.112*** | -0.044 | -0.027 | -0.232*** |
| (0.023) | (0.038) | (0.032) | (0.046) | (0.038) | (0.029) | |
| Rival starting later, in contention | -0.088** | -0.236*** | -0.033 | -0.047 | +0.022 | -0.246*** |
| (0.034) | (0.057) | (0.045) | (0.069) | (0.051) | (0.049) | |
| Rival starting later, out of contention | -0.005 | -0.098** | +0.035 | -0.018 | -0.026 | +0.006 |
| (0.030) | (0.048) | (0.041) | (0.069) | (0.053) | (0.034) | |
| Compatriot start position | -0.711*** | -0.454*** | -1.162*** | -0.697*** | -0.536*** | -0.702*** |
| (0.094) | (0.167) | (0.121) | (0.192) | (0.185) | (0.129) | |
| Rival starting earlier compatriots’ start position | -0.346*** | -0.525*** | -0.379*** | -0.176 | -0.238 | -0.468*** |
| (0.094) | (0.146) | (0.127) | (0.149) | (0.168) | (0.130) | |
| Rival starting later, in contention compatriots’ start position | -0.553*** | -0.494** | -0.757*** | -0.434 | -0.419** | -0.734*** |
| (0.127) | (0.219) | (0.157) | (0.269) | (0.205) | (0.214) | |
| Rival starting later, out of contention compatriots’ start position | -0.215* | -0.148 | -0.324* | +0.176 | -0.642* | -0.358** |
| (0.125) | (0.203) | (0.176) | (0.240) | (0.340) | (0.154) | |
| , , and | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| Performance FE | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| Judge FE | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| N | 206,983 | 206,983 | 206,983 | 46,208 | 62,918 | 97,857 |
| # of Competitions (G) | 172 | 172 | 172 | 70 | 102 | 172 |
| Mass of negative weights, main regressors | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | |
| Mass of negative weights, Compatriot start position | 0.036 | 0.010 | 0.063 | 0.010 | 0.063 | 0.045 |
| Mass of negative weights, the three Rival compatriots’ start position | 0.033–0.052 | 0.012–0.034 | 0.050–0.066 | 0.032–0.053 | ||
| Share of negative weights, main regressors | 0% | 0% | 0% | 0% | 0% | 0% |
| Share of negative weights, Compatriot start position | 18% | 10% | 21% | 21% | ||
| Share of negative weights, the three Rival compatriots’ start position | 20%–22% | 12%–18% | 22%–24% | 19%–22% |
Table 6. Start Order, the Size of the Compatriot Premium and the Competitor Penalty
where is the start position of performance within its segment expressed as a fraction of the field, is the average start position, in the same units, of judge ’s compatriots who are the close rivals of performance , and (resp. ) are their means over the compatriot rows and over the early-starting rival rows (resp. the late-starting rival rows with the compatriot in/out of contention) used for normalization, and , with the vector of discipline segment junior/senior top 20 skater federations season dummies, the top 20 judge federation dummies, and the performance quality controls defined in § 3.2.
The reason for controlling for is to avoid the interaction slopes , , , and picking up judge marking variations from discipline, segment, tier, skater/judge federation or performance quality. All controls are demeaned as well.
NOTE: , where is the vector of discipline segment defined by start order type (segment 1 open draw, segment 1 seeded order, segment 2) junior/senior top 20 federations by the # of performances (the other pooled) season (with 2020/21 merged with 2019/20) dummies, is the vector of dummies for the judge’s federation among the same top 20 federations (the other pooled), and is the same vector of performance quality controls used in Table 5. The compatriots’ start position is the average start position of the judge’s compatriots within three start numbers of the marked skater. Each interaction is centered at its mean over the rows of its indicator. Two-way (competition + athlete) cluster-robust standard errors in parentheses, with degrees of freedom, the column’s competitions; *** , ** , * . Appendix § 11 reports alternative standard errors clustered by competition and skater federation and with the two-way cluster jackknife.
Table 6 reports the regression results. First, we look at column (4), which uses the subsample of open-draw first segments. There, is random and the rivalry definition carries no information about competitiveness. It is not surprising that none of the three rival terms nor their interactions is statistically significant. The compatriot premium, however, adjusts with the random start order.
The slope estimate of is negative and statistically significant. The compatriot premium is 1.64 on average, but the difference between the first starter and the last starter is as large as 0.70.
If the compatriot premium is pure taste, we would not expect it to depend on a randomly assigned start position. If, instead, the premium is at least partly aimed at improving the compatriot’s placement, it may change with the start position, since the earlier the compatriot skates, the less the judge knows about the rest of the field, and the more uncertainty she faces in determining how large a premium would improve her compatriot’s standing. If the compatriot skates late, most of that uncertainty has been resolved, and the judge can decide with high precision whether it is still worthwhile to mark her compatriot higher, and if the answer is yes, how much she should inflate the compatriot’s score. Column (4) therefore bounds the role of taste. If the taste and unfamiliarity discount do not depend on the start position, their part of the compatriot premium is at most the premium of the last starter. Reading from column (4), the compatriot premium is 1.29 percent of the scale on TSS for the last starter, 1.99 percent of the scale for the first starter, and 1.64 on average. At least about a fifth of the average compatriot premium, therefore, needs another explanation.
The other columns of the table show that is stable regardless of how start order is determined. The interaction term of competitor penalty and compatriot start position, however, behaves differently, and in an informative way. In the open draw, where the start order says nothing about the standings, no rival slope is significant. In the second segments, where the order is the reverse of the first-segment result and the compatriot’s start position hence correlates with the chance of a good placement, each rival term is marked down more the later the judge’s compatriot starts. Moving the compatriot from the first to the last start position lowers her close rival’s TSS by 0.47 percent of the scale if the rival skates before her, and by 0.73 percent of the scale if the rival skates after her while she is still in contention, both significant at 1 percent level. The seeded first segments, whose order follows the World Standings, show the same pattern but with smaller slopes. Tables A.7 and A.8 in the appendix repeat columns (4)–(6) of Table 6 under alternative definitions of being in contention and of a close rival. The empirical findings are qualitatively the same.
Figure 4 plots how the compatriot premium and the competitor penalty on TSS respond to the start position of the judge’s compatriot skater. The compatriot premium declines with the start position in much the same way across the three figures separately representing the open draw Segment 1 subsample, the seeded order Segment 1 subsample, and the Segment 2 subsample. In the two first segment subsamples, the competitor penalties are small with confidence bands including zero at almost every start position. For Segment 2, however, both the penalty on a rival who starts before the compatriot and the penalty on a rival who starts after a compatriot still in contention grow, in absolute value, with the compatriot’s start position. The penalty on a rival who starts after a compatriot already out of contention is close to zero and is not drawn.
Figure 4. Compatriot Premium and Competitor Penalty Along the Compatriot’s Start Position. NOTE: Lines are point estimates of the compatriot premium and the competitor penalty evaluated at different values of the start position. Bands are their associated pointwise 95% confidence intervals.
Figure 5 repeats the analysis of Figure 4 with the compatriot premium and the competitor penalties measured on GOE and PCS. In the first segments, the patterns we see in Figure 5 on TSS carries over to both components. The compatriot premium falls with the start position even when it is randomly drawn, while the competitor penalties are small with confidence bands including zero at every start position in the open draw. In the seeded order, the GOE penalties on both rival types grow with the start position, and their bands exclude zero when the compatriot starts in the last two fifths of the field (a rival starting earlier) or in its last quarter (a rival starting later, while the compatriot is in contention). In Segment 2, the two components of TSS show different data patterns. On PCS, the compatriot premium falls steeply, from 2.60 to 1.16 percent of the scale, and the penalty on a rival who starts after a compatriot still in contention grows the most, to 0.64 percent of the scale on average when the compatriot starts last. On GOE, the premium is flat with respect to the start position, while the rival penalties grow with the compatriot’s start position, which in Segment 2 tracks her chance of having a good placement.
Figure 5. Compatriot Premium and Competitor Penalty On GOE and PCS. NOTE. Lines are point estimates of the compatriot premium and the competitor penalty evaluated at different values of the start position. Bands are their associated pointwise 95% confidence intervals.
Why the GOE premium does not fall in Segment 2 is not obvious. One possibility is that it reflects performance quality that rises with the start order that our control vector fails to capture. If the GOE premium rises with the quality that the Segment 2 start order carries, that rise can offset the decline the premium would otherwise show along the start order. This explanation does not extend to the competitor penalties, however. On PCS, judges’ scores vary less within the panel for the late starters (the standard deviation of a performance’s PCS marks falls by 16 percent from the first to the last fifth of Segment 2, and by 15 percent among the judges with no stake in it), yet the penalty on a rival who starts after a compatriot still in contention grows the most there.
The share and mass of negative weights for the compatriot indicator and the three rival indicators are calculated as discussed in § 2.4. Those for the centered interaction terms are calculated following the non-binary case discussed in the appendix of de Chaisemartin and D’Haultfœuille [10]. Both measures are essentially zero for the indicators and larger for the interactions. Given the size and the precision of the slope estimates, we do not expect negative weight mass of at most 7% to change the empirical findings of Table 5 qualitatively.
We conclude this subsection by noting that, in the literature on group judged competitions, Ginsburgh and van Ours [12] find that the order of appearance influences the scores at a top international music competition, and even the musicians’ later careers. Our paper, as far as we know, is the first that links start order with the compatriot premium and the competitor penalty.
Escalation in Response to Colleagues’ Reputations
In this subsection, we bring together the strategic compatriot premium and targeted competitor penalty documented so far to study whether judges escalate their nationalistic bias in response to panel composition and colleagues’ reputation. We ask, whether the marks a judge gives her compatriot and her compatriot’s rivals depend on who else sits on the panel. Does the premium rise when more of her compatriot’s close rivals have a compatriot judge on the panel? Does it rise further when those judges are known to be biased? Likewise, does a judge mark a rival down harder when the rival has a compatriot judge on the panel? Or does she spare the rival to avoid retaliation from the rival’s compatriot judge? Escalation behavior can arise from judges’ own preferences over the results of their compatriots, from federation incentives, or from both.
To answer these questions, we use a two-step estimation procedure inspired by the teacher value-added literature (Chetty, Friedman and Rockoff, 2014a,b; Mulhern, 2023), which uses teacher fixed effect estimates from an earlier sample to study the impact of teacher quality on students’ longer-term outcomes in a later sample. In the same spirit, we split our ten seasons of data into three eras, divided by the Olympic cycles. In Step 1, we use the data of an earlier era as the training sample to estimate judge-specific compatriot premiums. In Step 2, we use these judge-specific estimates to approximate judges’ reputation on judging fairness and ask whether the compatriot premium and/or competitor penalty a judge gives in a later era depend on how biased the compatriot judges of the rivals are known to be.
The first step in the two-step estimation procedure uses the following model:
with the estimates of denoted by . Recall that (resp. ) denotes the set of skaters starting within three positions after (resp. before) performance . Let be the average bias of skater ’s later rivals’ compatriot judges, and (resp. ) be similarly defined average bias of the compatriot judges of skater ’s earlier rivals in (resp. out of) contention. Let be the trained premium of the compatriot judge of performance . if performance does not have a compatriot judge on the panel or the performance has a compatriot judge who is known to be unbiased. If a judge has no estimate from the training window, or is not measured there due to insufficient compatriot markings,12 she is assigned the mean trained premium of the measured judges as her reputation.
The second step in the two-step estimation procedure uses the following outcome equation:
where with defined as before. In the model, slope coefficients and measure whether a judge escalates the premium she awards her compatriot when her compatriot’s close rivals’ compatriot judges have a reputation for being more biased, or when more of her compatriot’s close rivals have compatriot judges on the panel. Slope coefficients and measure whether a judge penalizes a rival more (a negative ) or less (a positive ) if the rival has a more biased compatriot judge on the panel. Interaction controls are included so that the key escalation coefficients do not pick up other sources of variations in the premium or penalty, such as skaters from larger federations starting later and at the same time having neighboring skaters also from larger federations and have compatriot judges sitting on the panel.
Because and are built from the first-step estimates, the second-step coefficients are corrected13 for the first-step estimation error following Chen, Gu and Kwon [6]. For inference, our setup is slightly more general, as our first-step errors map into the second-step generated regressors through a linear design matrix with overlapping coverage: each judge’s first-step estimate enters the generated regressors of many performances. As a result, our asymptotic variance formula has an extra first-step variance term, which the setting of Chen, Gu and Kwon [6] does not need, and allows for two-way clustering. Again, we cluster by competition and by skater [5] as the default and report in the appendix clustering by competition and by skater federation and the two-way cluster jackknife of MacKinnon, Nielsen and Webb [19] as robustness checks. No empirical findings change qualitatively with the inference method choice.
Before discussing the regression results, we plot the distribution of judge-specific compatriot premium to show that judge-specific compatriot premium estimates are not pure noise. Figure 6 is estimated with all ten seasons of data14, and a judge’s compatriot premium estimate is considered measured if she has scored in at least four compatriot competitions, for four compatriot athletes and thirty non-compatriot performances. The figure shows that the median premium is 1.65 percent of the TSS season-cell scale. The 10th percentile is 0.13 and the 90th percentile is as high as 3.30. Multiple testing with Holm’s step down identifies 60 judges with a statistically significant positive premium, while no judge has a statistically significant negative premium. Since these are raw estimates, the histogram is the distribution of the true premia with estimation noise, and its spread is larger than that of the true premia.
Figure 6. Judge-specific Compatriot Premium on TSS pct. NOTE: A judge’s compatriot premium is considered measured and drawn on the graph only if the judges scored at least 4 competitions with at least 4 compatriot athletes and 30 non-compatriot performances over the ten seasons.
Table 7 reports the estimates of equation (8), with the premia trained on all Era A data and escalation response evaluated on the Segment 2 subsample of Era B. The compatriot premium rises with the trained premia of the later rivals. The coefficient is significant at the 1 percent level on TSS and at the 5 percent level on both GOE and PCS. The earlier rivals’ compatriot judges do not move the premium, whether those rivals are still in contention or not. In the first segments, no is significant even at the 5% significance level. The competitor penalty does not respond to the rival’s own compatriot judge. The three terms are not jointly significant. One estimate, for later rivals still in contention on the full sample, is significant at the 5% level. This can be from randomness in testing, or if one really wants to interpret it, a judge may spare a rival whose compatriot judge is known to be more biased.
| Variable | (1) TSS pct | (2) GOE pct | (3) PCS pct | (4) Segment 1, open draw | (5) Segment 1, seeded order | (6) All rows |
| Compatriot | +1.747***<br>(0.090) | +2.644***<br>(0.144) | +1.776***<br>(0.098) | +1.530***<br>(0.120) | +1.784***<br>(0.093) | +1.716***<br>(0.076) |
| Rival starting earlier | -0.220***<br>(0.058) | -0.356***<br>(0.100) | -0.200***<br>(0.072) | +0.038<br>(0.080) | -0.025<br>(0.062) | -0.111**<br>(0.042) |
| Rival starting later, in contention | -0.125<br>(0.079) | -0.273**<br>(0.127) | -0.100<br>(0.095) | -0.052<br>(0.163) | -0.043<br>(0.074) | -0.075<br>(0.055) |
| Rival starting later, out of contention | -0.034<br>(0.051) | -0.134<br>(0.089) | -0.016<br>(0.071) | -0.037<br>(0.118) | +0.072<br>(0.093) | -0.007<br>(0.041) |
| Compatriot × , in contention | +0.052<br>(0.072) | +0.153<br>(0.132) | +0.009<br>(0.079) | -0.116<br>(0.141) | +0.000<br>(0.079) | +0.002<br>(0.056) |
| Compatriot × , out of contention | +0.045<br>(0.065) | -0.039<br>(0.099) | +0.129<br>(0.089) | -0.376*<br>(0.184) | -0.092<br>(0.111) | -0.047<br>(0.059) |
| Compatriot × | +0.192***<br>(0.064) | +0.262**<br>(0.105) | +0.193**<br>(0.082) | -0.020<br>(0.118) | +0.036<br>(0.078) | +0.114**<br>(0.050) |
| Rival starting earlier × | +0.059<br>(0.039) | +0.085<br>(0.062) | +0.063<br>(0.050) | -0.011<br>(0.072) | -0.001<br>(0.047) | +0.020<br>(0.025) |
| Rival starting later, in contention × | +0.056<br>(0.085) | +0.073<br>(0.147) | +0.077<br>(0.099) | -0.039<br>(0.107) | +0.141*<br>(0.082) | +0.113**<br>(0.053) |
| Rival starting later, out of contention × | +0.035<br>(0.049) | +0.051<br>(0.082) | +0.032<br>(0.061) | +0.014<br>(0.116) | -0.169<br>(0.109) | -0.022<br>(0.037) |
| , , and | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| Performance FE | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| Judge FE | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| N | 31,312 | 31,312 | 31,312 | 13,814 | 20,862 | 65,988 |
| # of Competitions (G) | 57 | 57 | 57 | 21 | 36 | 57 |
| Mass of negative weights, , , , | 0.000 | 0.000 | 0.000 | 0.000 | ||
| Mass of negative weights, | 0.034 | 0.039 | 0.031 | 0.032 | ||
| Mass of negative weights, all other interactions | 0.027–0.075 | 0.029–0.065 | 0.028–0.075 | 0.029–0.046 | ||
| Share of negative weights, , , , | 0% | 0% | 0% | 0% | 0% | 0% |
| Share of negative weights, | 20% | 19% | 18% | 19% | ||
| Share of negative weights, all other interactions | 16%–27% | 15%–23% | 17%–22% | 17%–23% |
Table 7. Escalation of the Compatriot Premium and the Competitor Penalty: Era A → Era B. NOTE: Era A: 2016/17-2017/18. Era B: 2018/19-2021/22. Each interaction is centered at its mean over the rows of its indicator. Two-way (competition + athlete) cluster-robust standard errors in parentheses, with a term for the estimation error of the first-step trained premia added to the variance. with degrees of freedom, the column’s competitions; *** , ** , * . Appendix D reports alternative standard errors clustered by competition and skater federation and with the two-way cluster jackknife.
Table 8 repeats the analysis of Table 7 but with the premia trained on Era B and escalation evaluated on Era C. We see that none of the estimates is significant at even the 10% significance level. Some estimates for earlier starting rivals with protected judges are negative and significant at the 5%, suggesting that for Segment 1 with seeded draws in Era C, judges mark an earlier rival down harder when the rival’s compatriot judge has a larger trained premium. The change from Era B to Era C is in line with the general decline in the compatriot premium shown in Figure 2 of § 2.5. The average premium in Segment 2 is 1.392 in Era C (Table 8) against 1.747 in Era B (Table 7), and the measured judges’ trained premia average 2.52 when trained in Era A but drop to 1.79 when trained in Era B.
| Variable | (1) TSS pct | (2) GOE pct | (3) PCS pct | (4) Segment 1, open draw | (5) Segment 1, seeded order | (6) All rows |
| Compatriot | +1.392***<br>(0.086) | +1.802***<br>(0.109) | +1.513***<br>(0.102) | +1.149***<br>(0.141) | +1.605***<br>(0.114) | +1.417***<br>(0.084) |
| Rival starting earlier | -0.227***<br>(0.039) | -0.340***<br>(0.053) | -0.204***<br>(0.058) | -0.125*<br>(0.065) | -0.006<br>(0.048) | -0.141***<br>(0.031) |
| Rival starting later, in contention | -0.186**<br>(0.071) | -0.409***<br>(0.105) | -0.087<br>(0.094) | +0.063<br>(0.120) | +0.069<br>(0.073) | -0.025<br>(0.051) |
| Rival starting later, out of contention | +0.058<br>(0.052) | -0.043<br>(0.073) | +0.141*<br>(0.073) | -0.098<br>(0.100) | -0.014<br>(0.074) | +0.008<br>(0.047) |
| Compatriot × , in contention | +0.006<br>(0.098) | +0.079<br>(0.162) | -0.038<br>(0.114) | +0.150<br>(0.243) | +0.065<br>(0.108) | +0.065<br>(0.060) |
| Compatriot × , out of contention | +0.060<br>(0.068) | +0.026<br>(0.105) | +0.119<br>(0.105) | -0.155<br>(0.232) | -0.206<br>(0.185) | -0.023<br>(0.060) |
| Compatriot × | -0.004<br>(0.056) | +0.042<br>(0.094) | -0.039<br>(0.065) | +0.252<br>(0.169) | +0.097<br>(0.105) | +0.053<br>(0.058) |
| Rival starting earlier × | -0.027<br>(0.044) | -0.036<br>(0.058) | -0.025<br>(0.063) | -0.092<br>(0.080) | -0.179***<br>(0.059) | -0.084**<br>(0.032) |
| Rival starting later, in contention × | -0.016<br>(0.092) | -0.119<br>(0.119) | +0.062<br>(0.124) | +0.022<br>(0.129) | -0.064<br>(0.060) | -0.040<br>(0.054) |
| Rival starting later, out of contention × | -0.108**<br>(0.051) | -0.110<br>(0.070) | -0.146**<br>(0.072) | +0.220*<br>(0.121) | +0.040<br>(0.082) | +0.004<br>(0.042) |
| , , and | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| Performance FE | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| Judge FE | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| 44,679 | 44,679 | 44,679 | 20,290 | 29,020 | 93,989 | |
| # of Competitions (G) | 76 | 76 | 76 | 28 | 48 | 76 |
| Mass of negative weights, , , , | 0.000 | 0.000 | 0.000 | 0.000 | ||
| Mass of negative weights, | 0.023 | 0.038 | 0.027 | 0.024 | ||
| Mass of negative weights, all other interactions | 0.025–0.071 | 0.047–0.067 | 0.024–0.049 | 0.032–0.044 | ||
| Share of negative weights, , , , | 0% | 0% | 0% | 0% | ||
| Share of negative weights, | 17% | 21% | 15% | 16% | ||
| Share of negative weights, all other interactions | 14%–27% | 14%–19% | 16%–20% | 14%–22% |
Table 8. Escalation of the Compatriot Premium and the Competitor Penalty: Era B → Era C. NOTE: Era B: 2018/19-2021/22. Era C: 2022/23-2025/26. Each interaction is centered at its mean over the rows of its indicator. Two-way (competition + athlete) cluster-robust standard errors in parentheses, with a term for the estimation error of the first-step trained premia added to the variance. with degrees of freedom, the column’s competitions; *** , ** , * . Appendix § 11 reports alternative standard errors clustered by competition and skater federation and with the two-way cluster jackknife.
NOTE: Era A: 2016/17-2017/18. Era B: 2018/19-2021/22. Each interaction is centered at its mean over the rows of its indicator. Two-way (competition + athlete) cluster-robust standard errors in parentheses, with degrees of freedom, the column’s competitions; *** , ** , * . Appendix § 11 reports alternative standard errors clustered by competition and skater federation and with the two-way cluster jackknife.
Notice that if we set every to 1 in the second step regression model in (8), and reduce to the shares of later and earlier rivals protected by a compatriot judge on the panel and $P_p reduces to an indicator for whether performance has a compatriot judge on the panel. We estimate this special case in Table 9. We find that the pattern of Table 7 holds even if we simply consider the proportion of rivals protected by their own compatriot judges. In Segment 2, the compatriot premium rises by 0.42 percent of the scale on TSS when all of the later rivals are protected by a compatriot judge.
| Variable | Segment 2 (1) TSS pct | Segment 2 (2) GOE pct | Segment 2 (3) PCS pct | TSS pct (4) Segment 1, open draw | TSS pct (5) Segment 1, seeded order | TSS pct (6) All rows |
| Compatriot | +1.747*** (0.090) | +2.641*** (0.144) | +1.780*** (0.098) | +1.531*** (0.120) | +1.786*** (0.093) | +1.716*** (0.076) |
| Rival starting earlier | -0.221*** (0.059) | -0.358*** (0.100) | -0.201*** (0.072) | +0.036 (0.080) | -0.026 (0.063) | -0.112*** (0.042) |
| Rival starting later, in contention | -0.126 (0.079) | -0.274** (0.127) | -0.101 (0.094) | -0.053 (0.162) | -0.040 (0.074) | -0.075 (0.055) |
| Rival starting later, out of contention | -0.034 (0.051) | -0.135 (0.089) | -0.016 (0.071) | -0.039 (0.118) | +0.074 (0.092) | -0.007 (0.041) |
| Compatriot × share earlier, in contention | +0.147 (0.186) | +0.433 (0.329) | +0.039 (0.223) | -0.369 (0.338) | +0.035 (0.209) | -0.002 (0.144) |
| Compatriot × share earlier, out of contention | +0.129 (0.166) | -0.114 (0.254) | +0.359 (0.223) | -1.129** (0.470) | -0.172 (0.338) | -0.136 (0.158) |
| Compatriot × share later | +0.423*** (0.151) | +0.525** (0.253) | +0.467** (0.195) | -0.139 (0.329) | +0.100 (0.179) | +0.238* (0.121) |
| Rival starting earlier × compatriot judge | +0.182* (0.096) | +0.189 (0.150) | +0.243* (0.136) | -0.013 (0.189) | -0.033 (0.132) | +0.056 (0.066) |
| Rival starting later, in contention × compatriot judge | +0.206 (0.214) | +0.105 (0.392) | +0.370 (0.250) | +0.029 (0.253) | +0.535*** (0.192) | +0.367*** (0.136) |
| Rival starting later, out of contention × compatriot judge | +0.075 (0.137) | +0.108 (0.216) | +0.074 (0.174) | -0.005 (0.260) | -0.411 (0.281) | -0.073 (0.099) |
| , , and | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| Performance FE | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| Judge FE | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| N | 31,312 | 31,312 | 31,312 | 13,814 | 20,862 | 65,988 |
| # of Competitions (G) | 57 | 57 | 57 | 21 | 36 | 57 |
| Mass of negative weights, , , , | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 |
| Mass of negative weights, share later | 0.032 | 0.032 | 0.032 | 0.042 | 0.029 | 0.031 |
| Mass of negative weights, all other interactions | 0.020–0.087 | 0.020–0.087 | 0.020–0.087 | 0.026–0.071 | 0.032–0.075 | 0.021–0.050 |
| Share of negative weights, , , , | 0% | 0% | 0% | 0% | 0% | 0% |
| Share of negative weights, share later | 20% | 20% | 20% | 20% | 21% | 19% |
| Share of negative weights, all other interactions | 14%–28% | 14%–28% | 14%–28% | 15%–24% | 17%–22% | 16%–25% |
Table 9. Table 7 Robustness Check: First-step Judge-specific Compatriot Premium All Set to One
Tables A.11 and A.12 in the Appendix repeat Table 7 and Table 8 for senior and junior events, Segment 2. In the Era A Era B analysis, the escalation of the compatriot premium comes mostly from the junior events. There, the premium rises with the trained premia of the later rivals’ compatriot judges on TSS and PCS, and also with those of the earlier rivals still in contention on TSS and GOE. Since the scores of these earlier rivals are known when the compatriot performs, junior-event judges seem to respond not only to a threat that is yet to come but also to one that has already been realized. This is not revealed in Table 7, as the analysis there pools the senior and junior events together. Table A.11 also shows that the competitor penalty responds to the rival’s compatriot judge only in the senior events, and only for the later rivals of a compatriot already out of contention. A senior-event judge marks such a rival higher relative to the rest of the panel, the larger the trained premium of the rival’s compatriot judge. This data pattern is in line with the colleague-compatriot premium of § 3.2, which the literature reads as vote trading [23]. But since the three terms are not jointly significant in Table A.11 (p-value= 0.17 − 0.22 across the three outcomes), we read the result with cautious. In the Era B Era C analysis, no escalation behavior is found significant at the 5 percent level in either tier, which is in line with our readings of Table 8.
Table A.13 nest Table A.11 and Table 9 for senior and junior events, asking whether the escalation responds to how many of the rivals are protected by a compatriot judge or to how biased these judges are known to be. So the regressions include both C W and its share counterpart in Table 9, and both R P and its compatriot judge presence counterpart. Because the two sets of terms are highly collinear, the regressions fail to estimate the individual slopes precisely. The only interaction coefficients significant at the 5 percent level are those on the later rivals in the junior events on GOE, where the coefficient on the compatriot indicator times is positive and significant, and that on the compatriot indicator times the share of protected later rivals is negative and significant. It might be tempting to interpret the results as judges responding to the reputation of the rivals’ compatriot judges beyond their presence on the panel, but we would like to read this evidence with caution, since both coefficients carry large shares and masses of negative implicit weights. We also carried out a similar unfruitful attempt trying to examine whether there is a nonlinear response to the colleagues’ reputation, by adding to the existing models. The results are likewise inconclusive because of the collinearity between and . With these caveats, we read the results of this section as follows. Judges respond to the composition of the panel. The compatriot premium rises with the share of the skater’s later rivals whose federation holds a seat on the panel, and, under a linearity assumption, with those judges’ trained premia. These empirical findings support strategic nationalistic scoring. Positive estimates of in the Era A Era B analysis show that the premium is, at least in part and in the Beijing Olympic cycle, a strategic response to the panel composition.
The Effect of Nationalistic Bias on Competition Outcomes
Panel Composition and Competition Outcomes
The previous section studies the impact of judge biases on synthetic judge scores. In this section, we ask whether such biases affect real competition outcomes. Since there is only one placement outcome for each performance, compared to 6-9 judge synthetic scores used in earlier sections, regressions run in this section are far less precisely estimated, even with our large dataset.
Table 10 report the regression results on all competitions and on a subsample of Championships and Olympics competitions whose panels are randomly drawn. Results are qualitatively similar across the columns, with having a compatriot judge increasing the final placement percentile of the skater. Specifically, in Championships and Olympics, having a compatriot judge in one of the two segments raises the placement percentile by 1.62, and having a compatriot judge in both segments raises the placement percentile by 2.49. A percentile point is places with being the field size. So these estimates are 1/4 to 2/5 of a place in an average event of 17.8 starters, and about 1/2 to 3/4 a place on the drawn competitions, whose fields are larger (30.3 starters on average).
| Variable | All competitions | Championships and Olympics | ||||
| (1) Segment 1 | (2) Segment 2 | (3) Event | (4) Segment 1 | (5) Segment 2 | (6) Event | |
| Compatriot judge | +1.932*** (0.452) | +0.961** (0.468) | +2.725*** (0.637) | -0.204 (1.040) | ||
| Compatriot judge in one of the two segments | +2.115*** (0.531) | +1.622* (0.823) | ||||
| Compatriot judge in both segments | +2.093*** (0.512) | +2.494*** (0.741) | ||||
| Share of rivals protected, segment 1 | +0.968 (1.032) | -0.130 (0.988) | +1.697 (1.537) | +0.062 (1.471) | ||
| Share of rivals protected, segment 2 | -0.513 (0.972) | +2.086 (1.782) | ||||
| Home ice | +1.136 (0.723) | +0.754 (0.673) | +0.332 (0.752) | +2.613* (1.303) | +1.882 (1.434) | +0.197 (1.134) |
| Compatriot Technical Controller, Technical Specialist | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | |
| Skater FE | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| Segment FE | ✓ | ✓ | ✓ | ✓ | ||
| Event FE | ✓ | ✓ | ||||
| N | 11,971 | 10,768 | 10,767 | 3,633 | 2,511 | 2,511 |
| # of Competitions (G) | 167 | 167 | 167 | 30 | 30 | 30 |
| Skaters | 2,470 | 2,375 | 2,374 | 1,131 | 788 | 788 |
| Mass of negative weights | 0.001–0.096 | 0.001–0.128 | 0.001–0.123 | 0.000–0.013 | 0.000–0.022 | 0.000–0.010 |
| Share of negative weights | 1%–23% | 2%–25% | 1%–26% | 0%–7% | 0%–8% | 0%–5% |
Table 10. Compatriot Premium and Competitor Penalty on Official Placement Percentiles. NOTE: Two-way (competition + athlete) cluster-robust standard errors in parentheses, with degrees of freedom, the column’s competitions; *** , ** , * .
Whether the panel composition changes the podium outcomes is much harder to detect. Table 11 studies the outcomes of finishing among the top-three and among the top-sixth using the championship and the Olympics competitions. None of the segment-level estimates are statistically significant. In the event standing, however, having a compatriot judge in one of the two segments raises the probability of a top-three finish by 3.46 percentage points and a top-six finish by 4.28 percentage points. The impact of rivals judges is small and statistically insignificant in almost all columns except for Column (3), where having all close rivals protected by a compatriot judge in segment 1 lowers the probability of the skater standing on the podium by about 7.5 percentage points. The share of rivals protected in Segment 2 is not used as a regressor in the event-level regressions as it is determined by the Segment 1 results, which are part of the event-level outcome. So adding the regressor would potentially cause a reverse-causality problem.
| Variable | A top-three placement | A top-six placement | ||||
| (1) Segment 1 | (2) Segment 2 | (3) Event | (4) Segment 1 | (5) Segment 2 | (6) Event | |
| Compatriot judge | +1.814<br>(1.327) | -1.147<br>(1.627) | +1.640<br>(1.694) | -0.150<br>(1.881) | ||
| Compatriot judge in one of the two segments | +3.464*<br>(1.806) | +4.280**<br>(1.989) | ||||
| Compatriot judge in both segments | +0.189<br>(2.030) | +1.813<br>(2.001) | ||||
| Share of rivals protected, segment 1 | -3.988<br>(3.403) | -7.492**<br>(3.541) | -6.393<br>(4.129) | -7.118<br>(5.045) | ||
| Share of rivals protected, segment 2 | -2.454<br>(4.107) | +4.763<br>(4.115) | ||||
| Home ice | +2.099<br>(2.591) | +5.896<br>(4.767) | +2.695<br>(3.912) | +1.228<br>(2.507) | +3.250<br>(3.770) | +0.244<br>(2.848) |
| Compatriot Technical Controller, Technical Specialist | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | |
| Skater FE | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| Segment FE | ✓ | ✓ | ✓ | ✓ | ||
| Event FE | ✓ | ✓ | ||||
| N | 3,633 | 2,511 | 2,511 | 3,633 | 2,511 | 2,511 |
| # of Competitions (G) | 30 | 30 | 30 | 30 | 30 | 30 |
| Skaters | 1,131 | 788 | 788 | 1,131 | 788 | 788 |
| Mass of negative weights | 0.000–0.013 | 0.000–0.022 | 0.000–0.010 | 0.000–0.013 | 0.000–0.022 | 0.000–0.010 |
| Share of negative weights | 0%–7% | 0%–8% | 0%–5% | 0%–7% | 0%–8% | 0%–5% |
Table 11. Table 10 with the Top-three and Top-six Placements as the Outcome
NOTE: Two-way (competition + athlete) cluster-robust standard errors in parentheses, with degrees of freedom, the column’s competitions; *** , ** , * .
A Counterfactual Analysis for the Milan Olympic Games
We now return to the ice dance event at the 2026 Milan Olympic Games discussed in the introduction and carry out a counterfactual analysis. The goal of this analysis is not to question the official result nor the ISU’s response to the controversy that followed, but, instead, to show that the compatriot premium, the competitor penalty, and the colleague-compatriot premium studied in this paper, together with the randomness of the panel draw, can change the result of a close competition. One might expect that the use of trimmed mean in official score calculation can protect skaters from a biased judge, but trimming in fact only removes a small part of a typical judge’s biases. In Appendix § 9, we model a nine-judge panel in which every judge’s mark carries independent normal noise and one judge adds a premium to her compatriot’s mark. The average pass-through rate is the share of the premium’s effect on the untrimmed mean that survives in the trimmed mean. At the median of our judge-specific estimates, the pass-through rate is about 97 percent. At the 95th percentile, it falls to 87.5 percent. For the French judge at Milan, the pass-through rates marks on the French and the American couples lie between 86 and 96 percent. Trimming therefore removes only a small part of a judge’s bias, and the panel’s composition can change outcomes.
At the Milan Olympic Games, the judge pool of an event typically had thirteen judges. A segment’s panel is any nine of them, so a segment has possible panels, and the event has possible pairs of panels, since the four judges not drawn for the first segment sit the second and its other five seats are drawn from the nine who sat the first. The panels that judged at Milan are one of these pairs. In the ice dance event, the French judge was randomly drawn twice for judging while the American judge was drawn only to mark the free dance.
If the realized scores were pure signals of the performance quality and no judge biases, a redraw of the panels could change the result only through the judges’ honest disagreement. To measure how much, our first counterfactual analysis treats each couple’s realized score as the true performance quality. Every judge on every possible panel, whether she sat at Milan or is drawn in, gives a score that is equal to that quality plus an independent normal shock with the standard deviation set to the within-panel estimate at the event (3.00 points in the rhythm dance and 3.62 in the free dance). No compatriot premium, rival penalty or colleague-compatriot premium considerations enter this first counterfactual analysis. The analysis shows that, without the shocks, every panel would return the Milan scores, and the French couple would win on every draw. With the shocks, the French couple would lead the rhythm dance in 60.2 percent of the draws over the 715 possible panels and lead the free dance in 64.8 percent of the draws. The couple would also keep the title in 66.3 percent of the draws of admissible panel pairs. This exercise supports the ISU’s statement after the Milan ice dance event that it is normal for different judges on a panel to give a range of scores17: with honest disagreement among the judges, which the random shocks in our model represent, the result of a close competition is naturally probabilistic. With judge biases, however, these probabilities do depend on who sits on the panel, because the judges no longer mark the same way.
In the second counterfactual analysis, we illustrate how judge biases can work together with the random panel draw to shape competition results. Let denote the observed panel and a panel redraw. Let denote the set of all admissible redraws. For a judge and a performance of couple , we set her counterfactual score, in percent of the scale, as
That is, a judge who sat keeps the score she gave, with a colleague-compatriot premium adjustment with respect to the new panel composition, and a judge who did not sit marks at a baseline plus three strategic scoring terms estimated from Table 12: is the estimated compatriot premium of the judge’s federation, and and are the segment’s competitor penalty and colleague-compatriot premium estimates. The baseline is drawn from a normal distribution with the mean calculated from the average judge scores of the realized panel net of the three terms, excluding those from top-three’s federations (i.e., France, the United States and Canada), and the variance being either zero or from within-panel estimates. These counterfactual scores are then rescaled back to raw points for the analysis, and a couple’s score under is the trimmed mean of its nine marks. Note that this trims the judges’ totals, whereas the official score trims each element and component separately. In our data the two ways of trimming give close results. At the Milan Games, the two trimming methods give the same segment winner in all 16 segments of the individual and team events, and the same medalists, in order, in each of the four individual events.
| Variable | Segment 1 | Segment 2 | ||||||
| (1) Men | (2) Women | (3) Pairs | (4) Ice dance | (5) Men | (6) Women | (7) Pairs | (8) Ice dance | |
| Compatriot, CAN judges | +2.951*** (0.475) | +3.665*** (0.726) | ||||||
| Compatriot, FRA judges | +2.585*** (0.379) | +1.411** (0.514) | ||||||
| Compatriot, GEO judges | +2.313 (1.383) | |||||||
| Compatriot, GER judges | +2.911*** (0.817) | +1.372** (0.611) | ||||||
| Compatriot, JPN judges | +1.623 (0.991) | -0.119 (0.933) | +0.923 (0.836) | +0.629 (1.588) | ||||
| Compatriot, KAZ judges | +2.197** (1.039) | +0.848 (2.013) | ||||||
| Compatriot, USA judges | +1.701** (0.740) | +3.390*** (0.508) | +0.630 (0.830) | +2.618*** (0.454) | ||||
| Rival | +0.068 (0.138) | -0.035 (0.158) | +0.061 (0.162) | -0.277** (0.113) | -0.271 (0.162) | -0.161 (0.171) | -0.286* (0.142) | -0.110 (0.158) |
| Other-panel compatriot | +0.829 (0.543) | +0.459 (0.423) | +0.718 (0.681) | +0.197 (0.262) | -0.311 (0.668) | -0.581 (0.542) | -1.201** (0.587) | -0.142 (0.410) |
| Home ice, Compatriot Technical Controller and Specialist | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | |
| Skater, segment and judge FE | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| N | 9,648 | 10,224 | 5,003 | 7,812 | 6,462 | 6,462 | 4,292 | 5,373 |
| # of Competitions (G) | 30 | 30 | ||||||
| Mass of negative weights | 0.000–0.001 | 0.000–0.002 | 0.000–0.028 | 0.000–0.006 | 0.000–0.003 | 0.000–0.001 | 0.000–0.030 | 0.000–0.019 |
| Share of negative weights | 0%–1% | 0%–1% | 0%–9% | 0%–4% | 0%–2% | 0%–2% | 0%–11% | 0%–6% |
Table 12. Compatriot Premium, Competitor Penalty, and Colleague-compatriot Premium Used for the Counterfactual Analysis. NOTE: Two-way (competition + athlete) cluster-robust standard errors in parentheses, with degrees of freedom, the column’s competitions; *** , ** , * .
Table 12 reports the coefficients the counterfactual analysis uses. The model is an extension of the cross-panel model studied in § 3.2, fitted for each segment and with the compatriot premium separately estimated for each federation that had a judge at the discipline’s Milan competition, although the table only reports the coefficients for federations with both a judge and a skater on the podium. The sample used for Table 12 includes Championships and Olympics where the judge panel is randomly drawn.
Table 13 reports how often the French couple leads each segment among all the panel draws in the resampling exercise. Columns (1) and (2) have no shock, or , so that each panel
| Which of the two judges the draw seats | No shock, — (1) Rhythm dance | No shock, — (2) Free dance | of the event’s panels — (3) Rhythm dance | of the event’s panels — (4) Free dance |
| Neither judge seated | 0.0% [−0.96, −0.22] | 81.8% [−0.31, +0.66] | 24.1% [−1.97, +0.78] | 64.2% [−1.42, +2.03] |
| Only the French judge | 80.0% [−0.20, +0.64] | 98.8% [+0.11, +1.47] | 64.8% [−1.05, +1.65] | 85.0% [−0.68, +2.72] |
| Only the American judge | 0.0% [−1.57, −0.77] | 43.0% [−0.64, +0.63] | 11.6% [−2.60, +0.40] | 48.7% [−1.73, +1.62] |
| Both seated | 11.2% [−0.80, +0.09] | 83.9% [−0.23, +1.32] | 41.8% [−1.67, +1.30] | 74.5% [−1.02, +2.31] |
| Every panel | 23.6% [−1.36, +0.44] | 77.8% [−0.42, +1.33] | 38.8% [−2.02, +1.30] | 70.2% [−1.25, +2.33] |
| Every panel, both judges struck | 3.9% [−1.11, −0.03] | 70.1% [−0.53, +0.88] | 26.0% [−2.15, +0.94] | 61.8% [−1.66, +2.23] |
Table 13. Share of the Possible Panels on Which the French Couple Leads the Segment. NOTE: The percentage number is the share of the panels in the redraws on which the French couple leads the segment. The interval is the 5th and the 95th percentiles of the French couple winning margin over the best other couple, in points. The last row drops out both French and American judges from every panel in the redraws, which is not a case the current rules allow for.
gives one score per couple. Columns (3) and (4) add the shock, and each panel is repeated drawn 1,000 times. In the table, the percentage number is the share of the panels for which the French couple leads the segment, so 100 means that they lead on every panel in the group and 0 that they lead on none. The bracket beneath it gives the 5th and the 95th percentiles of the French couple’s winning margin, across all panel redraws.
Seating the French judge turns out to raise the French couple’s margin by about 0.8 points in the rhythm dance and 0.6 points in the free dance on average over the panels without the shock, and by about 0.9 and 0.7 points with it. Without the shock, the French couple leads the rhythm dance on 80.0% of the panels that seat the French judge alone, on 11.2% of those that seat both judges, and on none of those that seat neither judge or the American judge alone. With the shock, the shares are 64.8%, 41.8%, 24.1% and 11.6%, for the panels that seat the French judge alone, both judges, neither judge and the American judge alone. The free dance is less close, and the French couple leads with a higher share in the counterfactual analysis. The last row of Table 13 drops both judges from every panel on which they are drawn. The French couple then trails in the rhythm dance but leads the free dance in most of the panel redraws.
NOTE: Every possible panel is scored judge by judge: a judge who sat keeps her real mark, moved by the change in her fitted response between the two panels; a judge the real panel did not have enters at the skater’s mean residual mark from the real panel’s judges who are not from one of the event’s top three’s federations, plus her fitted response, plus a random shock drawn from where is a measure of within-panel score spread. The marks are then trimmed and the field re-ranked. Judge pool sizes is 13 for ice dance, 12 for men, 13 for women, and 13 for pairs.
Table 14 moves from the segment to the event and reports the counterfactual analysis results for all four disciplines. For counterfactual analysis of the event, one also needs to take into account the fact that the second segment’s start order depends on the first, and the start order enters the regression both as a control and as an input for the competitor definition. Therefore, for each redrawn segment panel pairs, we re-form the second-segment start order from the counterfactual first-segment ranking, recompute the rival indicators, and adjust each skater’s counterfactual second-segment scores with respect to these changes.
Table 14. Counterfactual Analysis of All Four disciplines in Milan 2026 Olympic Games. Champion changes (%). Each discipline’s coefficients; Men, women and pairs pooled.
The counterfactual analysis shows that, in ice dance, the top placement changes in 45-57% of the 90,090 admissible pairs of panels, with the exact number depending on how the shock is handled. In the women’s event the champion changes in 20%-27% of the redraws. Part of these changes would occur without any bias, because results of close competitions are probabilistic. In the first, pure-signal analysis, with the same shocks, honest disagreement alone changes the champion in 32-34% of the ice dance redraws and in 14-19% of the women’s. In the men’s and pairs’ events, no admissible panel redraw changes the top placement as the champions in these two events won by more than ten points. Table 14 also reports a robustness check that pools the estimation over the men’s, women’s, and pairs’ events for more precise estimates, since these disciplines share the same judging license and are more likely to have the same judges.
Overall, the draw of the panel matters for the result of close competitions. With judge biases, the draw decides which federations have a judge on each panel, and the compatriot premium, the competitor penalty, and the colleague-compatriot premium then move the result. We suggest keeping the federations of the leading skaters off the judging panel when feasible. This rule is already adopted for the technical panel at the Olympic Winter Games. In the individual events of the three Olympic Winter Games in our sample, no technical controller, technical specialist or referee came from a medalist’s federation, in line with the ISU rule that no member of the technical panel may serve in a discipline if skaters of their own federation are expected to place in the top five of the Games. If keeping the federations of the leading skaters off the judging panel is not feasible, an alternative could be to seat the judges of the contending federations symmetrically, either all of them on a segment or none of them. The trimmed mean offers no alternative. As discussed above and in Appendix § 9, trimming removes only a small part of a typical judge’s bias.
Conclusion
In the data analysis above, we find that targeted scoring exists both in the compatriot premium and in the competitor penalty, which provide evidence for strategic nationalistic bias. The compatriot premium falls along a randomly drawn start order and rises when the compatriot’s close rivals have their own judges on the panel. Judges also mark down close rivals who skate before their compatriot and close rivals who skates after while the compatriot skater is still in contention, and the penalty grows with the compatriot’s chance of a good placement. We also find that the judge gives more compatriot premium when more of her compatriot’s close rivals have a compatriot judge on the panel, and that the premium rises further when those judges are known to be biased in past competitions. In the counterfactual analysis of 2026 Milan Winter Olympic Games, we find that, in close events, the compatriot premium, the competitor penalty, and the colleague compatriot premium influence competition results through the random draw of the panel composition. The ISU’s trimming rule does not offer much protection as it removes only a small part of a compatriot premium or a competitor penalty of a typical size. We recommend keeping the federations of the leading skaters off the judging panels where feasible, or seating their judges symmetrically, either all of them on a segment or none of them.
A general remedy often proposed for judge bias is to let artificial intelligence judge. At the 2026 Artistic Gymnastics World Championships in Rotterdam, the International Gymnastics Federation used an AI-based judging support system to aid judge scoring. The system recognizes the elements a gymnast performs, on which the difficulty score is built. The federation’s president has said that its long-term aim is for computers and AI to award all the scores15. Figure skating, in our view, is different from artistic gymnastics. Skaters perform in a large space at high speed, and much of judges’ decisions rest on interpretation. Machines could probably take over some of the technical panel’s calls, such as determining the rotation of a jump or the difficulty level of a spin, but the marks on grades of execution and program components should, in our view, remain the judges’, even if unconscious bias rooted from taste or cultural differences cannot be avoided: the styles of skating, jumping and spinning, and in pairs of lifts and throws, as well as the music and the choreography, differ widely from one skater to the other, and this diversity is much of what defines the sport.
Over the ten seasons we study, the compatriot premium fell by 44-51% (§ 2.5), and its two sharp declines, in 2018/19 and 2021/22, coincide with the ISU’s sanctions of judges for nationalistic bias and with its decision of ramping up statistical screening of judges’ scores for national bias. We therefore suggest building on this approach: using statistical tools and judges’ marking records to monitor their behavior and to find ways to reduce the intentional and strategic parts of the compatriot premium, rather than handing the judging to machines. The ISU should make sure to extend such monitoring efforts to the competitor penalty, which we show is strategic and targeting to increase the compatriot’s chance of a good placement. Because we identify close rivals by the start order, which identifies a compatriot’s competitors with noise, our estimates of the penalty are lower bounds. The true competitor penalty is, if anything, larger and therefore deserves careful investigations.
Notes
federations have under 1 percent each. The effective number of federations, the inverse Herfindahl index of their shares, is 23 for all observations and 15 for the compatriot observations.
Official Protocols and Panel of Judges Documents
This appendix works through the scoring rules described in § 2.1 using the example of one performance.
Figure A.1 shows the official free skate protocol of Mikhail Shaidorov, the gold medalist in men’s singles at the 2026 Olympic Winter Games in Milan. The header reports the TES (114.68), the PCS (83.96) and Deductions (0.00), which together give the TSS: . A skater’s final ranking in a category is determined by the sum of the two segment scores. Shaidorov was fifth after the short program (92.94) and won the free skate, taking the gold medal with 291.58.

Figure A.1. The official protocol for one performance
NOTE: Judges Details per Skater: Men Single Skating, Free Skating, 2026 Olympic Winter Games (Milano Cortina).
The judges’s execution marks are shown in the columns J1-J9 in the upper block of the protocol.
For example, the grades for the quadruple flip (“4F”) are . With one 3 and one 2 deleted, the trimmed mean of this element is . The GOE column converts grades into points at 10% of the base value per grade: . For a combination the scale is the BV of its most valuable jump, without any bonus. For “3A+1Eu+4S” that jump is the quadruple Salchow (9.70), so the GOE is . The Scores of Panel column adds the BV and the GOE, e.g. for the 4F. Summing over the twelve elements gives TES .
The program component marks are shown in the columns J1-J9 as well but in the lower block. Each component’s trimmed mean is multiplied by the segment’s factor (3.33 in the men’s free skate) and the products are summed: . The PCS therefore consists of the judges’ marks alone.
On the protocol the technical panel’s calls appear under Executed Elements, in the Info column, and in the Base Value column. In Figure A.1, 4Lz is a quadruple Lutz with BV 11.50. The flag “q” on the 4Lz marks a jump landed a quarter short in revolution: it keeps its full base value of 11.50, but the judges are expected to reduce their GOE, and all nine grades are negative. If a 4Lz is under-rotated for over a quarter but less than a half of revolution, it will be marked “<” with BV discounted by 20%. If it is called downgraded (“<<”), the 4Lz would be valued as a triple Lutz with BV 5.90. Level calls work the same way. The flag “x” marks jumps that earn the 10% bonus for the last three jump elements executed in the second half of the program, e.g. for “4T+3T”. “SEQ” marks a jump sequence and “ChSq1” is the choreographic sequence, which carries a fixed base value of 3.00 and 0.50 points per GOE grade. The sum of base values is, therefore, set by the technical panel alone. Its calls affect the GOE both directly, as the basis for the multiplication, and indirectly, through their influences on judges’ execution markings.
On the protocol displayed above, judges are not named. A separate Panel of Judges document names them, so that we can link each name to a federation. For example, for Shaidorov’s free skate performance at the 2026 Olympic Winter Games, J8 was from Kazakhstan, Shaidorov’s own federation. Judges’ names are further linked to their federation. On GP, JGP and World Team Trophy Panel of Judges pages, federations are printed beside judges’ names. On the pages of the World Championships and the Olympic and Youth Olympic Games, federations are not printed. We then link these judges to federations using pages that print the same judge’s federation in the same season, then in any other season if she represented a single federation throughout, and otherwise the ISU’s seasonal List of Officials, which also dates the eight judges who changed federation within our sample.
The Impact of Trimming on Score
Suppose the panel includes nine judges, and judge ’s score follows the model where and for the compatriot judge and 0 otherwise. The model assumes that the non-compatriot judges scores reflect an honest judgment on the performance quality plus judge-specific idiosyncratic shocks . The compatriot adds a premium . The larger the premium relative to the shocks, the more likely the compatriot judge’s score is the highest on the panel and gets trimmed off. Let judge 1 be the compatriot judge and normalize and , so that is measured in units of . In a nine-judge panel, the expected trimmed average is
where and ; by symmetry. The average pass-through of the premium in the trimmed average (relative to an untrimmed average), is
Meanwhile, the marginal pass-through rate is the response of the expected trimmed average to marginal change of the premium, so
where and are the standard normal probability and cumulative distribution functions.
Both functions are plotted in Figure A.2 against , the premium in the unit of within-panel standard deviation. A pass-through close to one means that the premium moves the score as much as it would do without the trimming, so the trimming makes little difference. As a benchmark, Figure A.2 marks the 5th, 50th, and 95th percentiles of the judge-specific compatriot premium estimates of Figure 6, re-estimated with outcome scores normalized by the within-panel standard deviation () of its cell (age tier discipline program season). Trimming removes little of a typical judge’s compatriot premium: at the median, about 97% of the premium reaches the trimmed score. Even at the 95th percentile, the average pass-through rate is still 87.5%. Figure A.2 also marks, in the same units, the compatriot bias of each ISU investigated cases as well as French judge’s compatriot premium and rival penalty in each segment of the Milan ice dance event. The French judge’s marks on the French couple and on the American couple pass through at 86% or more. Even among the ISU-investigated cases, trimming removes a substantial share of the bias only at the extreme.
Supplementary Analysis
Data Description
Table A.1 estimates equation (1) on each season subsample and reports the compatriot premium season by season. Results of Table A.1 are reported in Figure 1a in § 2.5. The seasons fall roughly into three periods: 2016/17 to 2017/18, 2018/19 to 2020/21, and 2021/22 to 2025/26. The premium is steady within each period and steps down in between: the TSS premium averages 2.43 percent in the first period, 1.92 in the second (COVID-impacted 2020/21 left out) and 1.44 in the third.
Table A.2 estimates equation (1) on each discipline by segment subsample and reports the compatriot premium of each cell. Results of Table A.2 are reported in Figure 1b in § 2.5.
Figure A.2. Pass-through of Compatriot Bias Under Trimming in a Nine-judge Panel. NOTE: The solid curve is the average pass-through rate and the dashed curve is the marginal pass-through rate. Both are functions of the premium in the unit of the within-panel standard deviation . The dotted vertical lines are 5th, 50th, and 95th percentiles of the judge-specific compatriot premium estimates. The French judge at the Milan 2026 ice dance event, in the rhythm dance (RD) and the free dance (FD), her mark on the French couple (pointing up) and on the American couple (pointing down), is her score minus the mean of the other judges’ scores on the same performance minus gap on the non-compatriot skaters at the event (her own generosity at the event), normalized by the within-panel standard deviation. The seven ISU investigations marked on the graph: HUANG and CHEN were suspended for nationalistic bias at the 2018 Olympics; CHIGOGIDZE was suspended for nationalistic bias at the 2021 World Championships; WILLIAMS received a warning for the 2023 World Championships; PETHES, LISOVA and MÄDER’S cases were dismissed.
| Season | (1) TSS pct | (2) GOE pct | (3) PCS pct |
| 2016/17 | 2.465*** | 4.103*** | 2.724*** |
| (0.127) | (0.241) | (0.123) | |
| 2017/18 | 2.390*** | 4.392*** | 2.609*** |
| (0.124) | (0.249) | (0.125) | |
| 2018/19 | 1.887*** | 2.807*** | 1.969*** |
| (0.115) | (0.174) | (0.130) | |
| 2019/20 | 1.962*** | 2.897*** | 2.060*** |
| (0.125) | (0.205) | (0.115) | |
| 2020/21 | 2.304 | 3.576 | 2.077 |
| (–) | (–) | (–) | |
| 2021/22 | 1.325*** | 2.112*** | 1.302*** |
| (0.088) | (0.141) | (0.096) | |
| 2022/23 | 1.447*** | 1.906*** | 1.532*** |
| (0.145) | (0.176) | (0.184) | |
| 2023/24 | 1.549*** | 2.211*** | 1.510*** |
| (0.131) | (0.166) | (0.145) | |
| 2024/25 | 1.482*** | 2.048*** | 1.517*** |
| (0.156) | (0.190) | (0.166) | |
| 2025/26 | 1.375*** | 2.049*** | 1.329*** |
| (0.131) | (0.166) | (0.135) | |
| Equal premium in every season, | 11.04 (p < 0.001) | 13.52 (p < 0.001) | 14.87 (p < 0.001) |
| Performance FE | ✓ | ✓ | ✓ |
| Judge FE | ✓ | ✓ | ✓ |
Table A.1. Compatriot Premium by Season
NOTE: Two-way (competition + athlete) cluster-robust standard errors in parentheses, with degrees of freedom, the column’s competitions; *** , ** , * .
The discipline differences are large. Ice dance carries a TSS premium about twice the size of men’s and women’s, and the point estimates follow the ordering of men < women < pairs < ice dance within each program on both TSS and GOE. On PCS, the three disciplines with jumps lie between 1.4-1.8 percent, while ice dance is above 2.5.
| Cell | (1) TSS pct | (2) GOE pct | (3) PCS pct |
| Men SP | +1.187*** (0.093) | +2.040*** (0.160) | +1.376*** (0.121) |
| Men FS | +1.407*** (0.094) | +2.077*** (0.150) | +1.761*** (0.121) |
| Women SP | +1.525*** (0.089) | +2.322*** (0.141) | +1.678*** (0.114) |
| Women FS | +1.461*** (0.089) | +2.191*** (0.134) | +1.624*** (0.114) |
| Pairs SP | +1.811*** (0.140) | +2.758*** (0.215) | +1.712*** (0.153) |
| Pairs FS | +1.724*** (0.118) | +2.608*** (0.194) | +1.697*** (0.133) |
| IceDance RD | +2.714*** (0.097) | +4.168*** (0.200) | +2.606*** (0.108) |
| IceDance FD | +2.665*** (0.107) | +4.231*** (0.216) | +2.491*** (0.108) |
| N (TSS), per cell (total) | 14,071–38,475 (206,983) | ||
| Equal premium in the eight cells, | 31.68 (p < 0.001) | 19.75 (p < 0.001) | 14.35 (p < 0.001) |
Table A.2. Compatriot Premium by Discipline × Segment. NOTE: Two-way (competition + athlete) cluster-robust standard errors in parentheses, with degrees of freedom, the column’s competitions; *** , ** , * .
Table A.3 estimates the compatriot premium separately for each program component score before and after the number of components changed to three. In both periods, the premium is smallest on skating skills and largest on composition, except for pairs in 2016/17-2021/22, where it is slightly larger on interpretation. Across disciplines, ice dance has the largest premium in every component under both component systems. Table A.4 groups the premium in singles’ GOE scores by element type. Step and choreographic sequences carry the largest premium in all four categories, from 2.354 (men’s short program) to 3.021 (men’s free skate).
| Component | (1) Men | (2) Women | (3) Pairs | (4) Ice dance |
| 2016/17–2021/22: five components | ||||
| Skating skills | ||||
| Transitions | ||||
| Performance | ||||
| Composition | ||||
| Interpretation | ||||
| N | 33,275 | 39,287 | 15,976 | 24,456 |
| 2022/23–2025/26: three components | ||||
| Composition | ||||
| Presentation | ||||
| Skating skills | ||||
| N | 27,545 | 33,571 | 13,036 | 19,837 |
| Performance FE | ||||
| Judge FE |
Table A.3. Table A.3: Compatriot Premium of Different Components. NOTE: Two-way (competition + athlete) cluster-robust standard errors in parentheses, with degrees of freedom, the column’s competitions; *** , ** , * . Joint tests reject the equality of premiums in the four disciplines: in 2016/17-2021/22, , 13.95, 22.29, 14.13 and 12.50 for skating skills, transitions, performance, composition and interpretation ( each); in 2022/23-2025/26, (), 7.51 and 14.13 () for composition, presentation and skating skills. Joint tests also reject the equality of premiums in the components: , 28.63, 18.53 and 23.48 in 2016/17-2021/22, and , 36.10, 14.60 and 18.21 in 2022/23-2025/26, for men, women, pairs and ice dance ( each).
| Elements | (1) Men SP | (2) Men FS | (3) Women SP | (4) Women FS |
| Solo jumps | +2.054*** | +1.757*** | +2.377*** | +1.788*** |
| (0.196) | (0.153) | (0.184) | (0.147) | |
| Jump combinations and sequences | +2.063*** | +2.269*** | +2.082*** | +2.383*** |
| (0.229) | (0.192) | (0.190) | (0.166) | |
| Spins | +1.880*** | +1.863*** | +2.230*** | +2.031*** |
| (0.202) | (0.219) | (0.187) | (0.180) | |
| Step and choreographic sequences | +2.354*** | +3.021*** | +2.595*** | +2.925*** |
| (0.231) | (0.226) | (0.197) | (0.211) | |
| N, the cell (the fewest of its groups) | 32,252 (32,081) | 28,568 (28,379) | 38,475 (38,165) | 34,383 (34,239) |
| Performance FE | ✓ | ✓ | ✓ | ✓ |
| Judge FE | ✓ | ✓ | ✓ | ✓ |
Table A.4. Compatriot Premium of Different Element Types in Singles
NOTE: Two-way (competition + athlete) cluster-robust standard errors in parentheses, with degrees of freedom, the column’s competitions; *** , ** , * . Joint tests reject the equality of premiums in the four columns for solo jumps (, ) and for step and choreographic sequences (, ), but not for jump combinations and sequences (, ) or spins (, ). Joint tests reject equality in the four groups in the free skating, for men () and women (; both), but not at the 5 percent level in the short program, for men (, ) or women (, ).
Performance Controls
Table A.5 and A.6 report the slope estimates of the performance controls used in columns (4)-(9) of Table 5. As Table A.5 shows, the career indicators affect more on the PCS than on the GOE. A prior Worlds placement raises the PCS by 3.2 percent of the scale and the GOE by 2.0, and a prior World Juniors placement raises the PCS. The first season in junior events lowers both the GOE and the PCS by similar amounts. Relative to popular music, film, stage and classical programs receive a PCS that is 0.2 to 0.3 percent higher. In the championships and Olympics sample, most career slopes lose significance, except the prior-placement effects on the PCS, and stage music. The start-order slope is large and significant everywhere, and it roughly doubles in championships.
Table A.6 reports the slopes of the choreographer indicators in columns (4)-(9) of Table 5. For each Era, we take the ten choreographers credited with the most programs in the Era, and create choreographer indicator, which equals one if the performance is instructed by one of the ten choreographers in the era. With skater fixed effects, each slope compares a skater’s programs by that choreographer with her programs by choreographers outside the Era’s top ten. In the full
| Variable | All rows (4) TSS pct | All rows (5) GOE pct | All rows (6) PCS pct | Championships and Olympics (7) TSS pct | Championships and Olympics (8) GOE pct | Championships and Olympics (9) PCS pct |
| Prior Worlds placement | +2.757***<br>(0.729) | +1.993**<br>(0.790) | +3.213***<br>(0.530) | +0.949<br>(0.852) | -0.691<br>(1.080) | +1.478**<br>(0.566) |
| Prior Worlds best place (0 if none) | -0.062*<br>(0.032) | -0.004<br>(0.036) | -0.076***<br>(0.023) | +0.009<br>(0.035) | +0.102**<br>(0.047) | -0.008<br>(0.022) |
| Prior World Juniors placement | +1.346***<br>(0.509) | +0.395<br>(0.587) | +1.919***<br>(0.376) | +0.365<br>(0.700) | -0.970<br>(0.982) | +1.087**<br>(0.407) |
| Prior World Juniors best place (0 if none) | -0.017<br>(0.021) | +0.006<br>(0.026) | -0.037**<br>(0.015) | +0.033<br>(0.035) | +0.032<br>(0.050) | -0.018<br>(0.020) |
| First season in junior events | -1.778***<br>(0.301) | -1.466***<br>(0.372) | -1.589***<br>(0.230) | -0.278<br>(0.688) | -0.808<br>(0.868) | -0.301<br>(0.518) |
| First season in senior events | -0.451<br>(0.533) | +0.197<br>(0.646) | -0.540<br>(0.388) | -0.036<br>(0.682) | +0.654<br>(0.954) | -0.174<br>(0.411) |
| Music: film | +0.284*<br>(0.160) | +0.235<br>(0.216) | +0.222**<br>(0.095) | +0.240<br>(0.308) | +0.390<br>(0.391) | +0.159<br>(0.163) |
| Music: stage | +0.344<br>(0.236) | +0.380<br>(0.331) | +0.306**<br>(0.152) | +0.734*<br>(0.429) | +1.181*<br>(0.584) | +0.587**<br>(0.242) |
| Music: classical | +0.319<br>(0.208) | +0.280<br>(0.299) | +0.246*<br>(0.126) | +0.166<br>(0.327) | +0.403<br>(0.475) | +0.201<br>(0.165) |
| Music: opera | -0.044<br>(0.404) | +0.148<br>(0.567) | +0.145<br>(0.229) | +0.019<br>(0.788) | -0.047<br>(1.309) | +0.133<br>(0.359) |
| Music: contemporary instrumental | +0.144<br>(0.207) | +0.391<br>(0.304) | +0.131<br>(0.123) | +0.415<br>(0.318) | +0.475<br>(0.463) | +0.242<br>(0.160) |
| Music: others | -0.016<br>(0.347) | +0.086<br>(0.545) | -0.016<br>(0.239) | +0.669<br>(0.653) | +1.719*<br>(0.958) | +0.512<br>(0.431) |
| Music: mixed | +0.151<br>(0.168) | +0.030<br>(0.230) | +0.138<br>(0.108) | +0.254<br>(0.235) | -0.082<br>(0.306) | +0.241*<br>(0.141) |
| Start | +3.863***<br>(0.312) | +1.450***<br>(0.363) | +5.562***<br>(0.263) | +8.353***<br>(0.582) | +4.545***<br>(0.751) | +10.809***<br>(0.386) |
| The 30 choreographer indicators (shown apart) | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| Compatriot, Rival, Other-panel compatriot, Home ice, the technical panel | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| Compatriot × home ice | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| Other-segment compatriot | ✓ | ✓ | ✓ | |||
| Skater FE | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| Segment FE | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| Judge FE | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| N | 206,983 | 206,983 | 206,983 | 55,276 | 55,276 | 55,276 |
| # of Competitions (G) | 172 | 172 | 172 | 30 | 30 | 30 |
Table A.5. Slope Estimates of the Performance Quality Controls. NOTE: Prior Worlds (World Juniors) placement means that the biography lists a placement at the championships in a season before; the best place is 0 where there is none. For music type dummies, the latent type is popular music, the most frequent type. Slopes of the top 10 choreographers in each Era are reported in Table A.6. Two-way (competition + athlete) cluster-robust standard errors in parentheses, with degrees of freedom, the column’s competitions; *** , ** , * .
sample, none of the Era A choreographers has a significant slope on TSS pct. In Era B, programs by Benoit Richaud and Mark Pillay score 1.7 and 2.9 percent of the scale more on TSS pct, both significant on all three outcomes, and programs by Daniil Gleikhengauz score 3.1 percent more, significant at the 10 percent level. In Era C, programs by Benoit Richaud and Adam Solya score 1.7 and 2.2 percent more. Most of the other indicators are insignificant, and the few negative ones are marginally significant. In the Championships and Olympics sample, the estimates are larger and less precise with only 30 competitions, and in Era A they take both signs, from −3.716 for David Wilson to +5.356 for Julie Marcotte on TSS pct. Still, Benoit Richaud’s programs score 2.3 percent more in Era B and Era C in this sample as well, the only choreographer with a positive and significant slope on TSS pct in both samples and both Eras. As we discuss in § 3.2, these coefficients are not necessarily causal, since a skater may choose a better-known choreographer in seasons when she is in better form.
Alternative Definitions on Being in Contention and on Close Rivals
Tables A.7 and A.8 reproduce columns (4)-(6) of Table 6 in § 4.1 under alternative definitions of being in contention and of a close rival. In the baseline, the judge’s own skater is in contention if she ranks in the top 3 among the skaters who have already skated in the segment, and in the second segment of an individual event, she also placed 1-8 after the first segment; a rival is defined as a skater from the judge’s federation within three start order of the marked skater. Table A.7 uses the top 3 in both segments without the placement requirement (columns (1)-(3)), and the top 4 with places 1-10 after the first segment (columns (4)-(6)); since the first definition coincides with the baseline in the first segment, its columns (1) and (2) are the same as columns (4) and (5) of Table 6. Table A.8 narrows the rival window to two start numbers (columns (1)-(3)) and widens it to four (columns (4)-(6)). Accordingly, the side of the rival, the in contention split and the compatriots’ start position are adjusted as well. From these tables, we see the same pattern as we found in § 4.1.
| Variable | (4) TSS pct | (5) GOE pct | (6) PCS pct | (7) TSS pct | (8) GOE pct | (9) PCS pct |
| Era A #1 choreographer: David Wilson | -0.587 (0.965) | -0.431 (1.413) | -0.000 (0.659) | -3.716*** (1.196) | -1.970 (2.839) | -0.833 (0.671) |
| Era A #2 choreographer: Benoit Richaud | -0.219 (1.171) | +0.481 (1.155) | -0.099 (0.740) | +1.307 (1.391) | +0.551 (2.431) | +1.129 (0.800) |
| Era A #3 choreographer: Nikolai Morozov | +0.423 (1.022) | -0.314 (1.281) | -0.407 (0.619) | +2.437* (1.325) | -0.026 (1.862) | +0.626 (0.726) |
| Era A #4 choreographer: Massimo Scali | +0.287 (1.341) | +1.391 (1.794) | +0.122 (1.099) | -3.016* (1.480) | -3.125 (1.982) | -1.569** (0.752) |
| Era A #5 choreographer: Mark Pillay | +1.572 (1.487) | +0.613 (1.781) | +0.650 (0.883) | +1.462 (2.359) | -0.623 (2.790) | +1.112 (1.260) |
| Era A #6 choreographer: Julie Marcotte | +1.368 (1.174) | +2.965 (1.880) | -0.242 (0.793) | +5.356*** (0.828) | +8.710*** (1.701) | +1.202 (0.781) |
| Era A #7 choreographer: Shae-Lynn Bourne | +1.459 (1.103) | +0.582 (1.429) | +1.288** (0.652) | +0.964 (3.210) | -1.328 (4.814) | +1.282 (1.323) |
| Era A #8 choreographer: Corrado Giordani | -2.347 (1.488) | -1.857 (1.877) | -1.236 (1.312) | -1.463 (1.248) | -0.243 (1.834) | -0.753 (1.087) |
| Era A #9 choreographer: Marie-France Dubreuil | +1.311 (1.343) | +2.545 (1.693) | +0.981 (1.267) | +2.346 (1.529) | +4.187** (1.784) | +1.449 (1.193) |
| Era A #10 choreographer: Valentin Molotov | -2.222 (2.069) | -1.486 (1.870) | -1.324 (1.887) | -0.641 (2.451) | +3.910 (2.582) | +0.428 (0.983) |
| Era B #1 choreographer: Benoit Richaud | +1.739** (0.743) | +1.840** (0.920) | +1.589*** (0.553) | +2.304** (0.962) | +2.102 (1.384) | +1.218** (0.592) |
| Era B #2 choreographer: Nikolai Morozov | +1.043 (0.973) | +1.434 (1.281) | +0.507 (0.797) | +2.189* (1.211) | +2.610 (1.956) | +0.956 (1.022) |
| Era B #3 choreographer: Romain Haguenauer | +0.514 (0.692) | +0.785 (0.975) | +0.519 (0.628) | +2.059** (0.935) | +2.676* (1.356) | +1.820** (0.726) |
| Era B #4 choreographer: Marie-France Dubreuil | +0.604 (0.879) | +1.770 (1.151) | +0.541 (0.736) | +1.496* (0.855) | +2.779** (1.255) | +0.717 (0.707) |
| Era B #5 choreographer: Shae-Lynn Bourne | +0.956 (0.887) | +0.195 (1.280) | +0.776 (0.514) | -0.504 (1.219) | -1.438 (2.332) | +0.073 (0.558) |
| Era B #6 choreographer: David Wilson | +0.911 (1.042) | -0.423 (1.286) | +1.158** (0.545) | -0.448 (1.179) | -2.654* (1.423) | +0.194 (0.635) |
| Era B #7 choreographer: Pasquale Camerlengo | -0.111 (0.879) | -0.427 (1.053) | +0.161 (0.741) | -1.165 (1.222) | -0.064 (1.429) | -1.175 (0.886) |
| Era B #8 choreographer: Daniil Gleikhengauz | +3.137* (1.856) | +1.565 (1.892) | +1.757** (0.760) | +2.691 (1.985) | +1.815 (2.474) | +1.113 (0.703) |
| Era B #9 choreographer: Corrado Giordani | +0.237 (1.118) | +0.279 (1.589) | +0.025 (1.000) | +0.179 (1.134) | +0.735 (1.834) | -0.343 (0.919) |
| Era B #10 choreographer: Mark Pillay | +2.923*** (0.936) | +3.341** (1.668) | +2.173*** (0.639) | +2.566* (1.490) | +1.433 (1.993) | +2.027** (0.771) |
| Era C #1 choreographer: Benoit Richaud | +1.717** (0.690) | +0.832 (0.731) | +1.652*** (0.499) | +2.266** (0.974) | +0.198 (1.079) | +1.537** (0.629) |
| Era C #2 choreographer: Adam Solya | +2.212** (1.021) | +1.968* (1.117) | +1.617* (0.770) | +2.148* (1.052) | +2.185 (1.695) | +1.389* (0.754) |
| Era C #3 choreographer: Yeaji Shin | -0.504 (0.716) | -1.909* (1.037) | -0.980* (0.520) | -0.192 (1.262) | -0.615 (1.320) | -1.063 (1.087) |
| Era C #4 choreographer: David Wilson | -1.380 (0.932) | -1.649 (1.107) | -0.290 (0.559) | -1.316 (1.363) | -1.475 (1.702) | -0.227 (0.784) |
| Era C #5 choreographer: Marie-France Dubreuil | -0.734 (1.203) | -1.240 (1.249) | -1.038 (0.962) | -1.181 (1.197) | -2.790* (1.397) | -1.282 (0.877) |
| Era C #6 choreographer: Shae-Lynn Bourne | -0.922 (1.092) | -0.714 (1.031) | -0.836 (0.619) | +1.329 (1.156) | +0.476 (0.968) | +0.002 (0.439) |
| Era C #7 choreographer: Romain Haguenauer | +1.030 (0.828) | +0.312 (1.190) | +0.919 (0.733) | +1.318 (1.203) | -0.073 (1.772) | +1.113 (0.917) |
| Era C #8 choreographer: Massimo Scali | -0.830 (0.685) | -1.274 (0.883) | -0.669 (0.513) | -0.547 (0.970) | -0.229 (1.129) | +0.088 (0.599) |
| Era C #9 choreographer: Samuel Chouinard | +0.562 (1.069) | +2.002* (1.206) | +0.454 (0.832) | +0.532 (1.114) | +2.221 (1.445) | +0.554 (0.961) |
| Era C #10 choreographer: Mark Pillay | +1.279 (1.440) | -0.062 (1.591) | +0.624 (0.969) | +3.566 (2.142) | +2.151 (2.109) | +1.720 (1.201) |
| The other components of (shown apart) | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| Compatriot, Rival, Other-panel compatriot, Home ice, the technical panel | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| Compatriot × home ice | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| Other-segment compatriot | ✓ | ✓ | ✓ | |||
| Skater FE | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| Segment FE | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| Judge FE | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| N | 206,983 | 206,983 | 206,983 | 55,276 | 55,276 | 55,276 |
| # of Competitions (G) | 172 | 172 | 172 | 30 | 30 | 30 |
Table A.6. NOTE: Continuation of Table 5, reporting slopes of the top 10 choreographers in each Era. Two-way (competition + athlete) cluster-robust standard errors in parentheses, with degrees of freedom, the column’s competitions; *** , ** , * .
In the first segment, there is no significant penalty on a rival under any alternative definitions.
In the second segment, a rival starting earlier is marked down by 0.21–0.25 percent of the scale (against −0.232 in Table 6), and a rival starting later is marked down while the compatriot is still in contention (all significant at the 1% level). Once the compatriot is out of contention, the penalty on a rival starting later is close to zero (between −0.031 and +0.010). The in-contention penalty is smaller under both alternative contention definitions, which are broader than the baseline and therefore include compatriots with weaker chances of a top placement. The compatriot premium (1.64–1.86 percent of the scale) and its decline along the start order are also unchanged. The slope on Compatriot × start position is significantly negative at the 1% level in every column.
In the second segment, all three rival slopes along the compatriots’ start position remain negative under every alternative definition. The slopes for a rival starting earlier and for a rival starting later while the compatriot is in contention are significant at the 1% level in every column but one (5%), and the in-contention slope is the steepest, as in the baseline. The out-of-contention slope, significant in the baseline, is marginally significant under the alternative rival windows. In the seeded first segments, the slopes are mostly smaller and less precisely estimated. In the open-draw first segments, a few rival slopes are significant, but all at the 10% level only.
Overall, the alternative definitions leave the main conclusions of § 4.1 unchanged.
Tables A.9 and A.10 reproduce columns (1)–(3) of Table 7 in § 4.2, the second segment in Era B, under the same alternative definitions of being in contention and of a close rival as in Tables A.7 and A.8. The results are similar to what we found in § 4.2. Compatriot × remains positive and significant in eleven of the twelve columns; on TSS pct it is between 0.176 and 0.215, against 0.192 in Table 7. Compatriot × , in and out of contention, remains insignificant, except on PCS pct out of contention in column (3) of both tables. The penalty on a rival starting earlier remains negatively significant in all columns. The penalty on a rival starting later while the judge’s compatriot skater is still in contention is robust to the rival window, but, as in Table A.7, it is smaller and less precisely estimated under the alternative in contention definitions.
| Variable | In contention: top 3 in both segments (1) Open draw | In contention: top 3 in both segments (2) Seeded order | In contention: top 3 in both segments (3) Segment 2 | In contention: top 4, Segment 2 places 1–10 (4) Open draw | In contention: top 4, Segment 2 places 1–10 (5) Seeded order | In contention: top 4, Segment 2 places 1–10 (6) Segment 2 |
| Compatriot | +1.641***<br>(0.099) | +1.863***<br>(0.083) | +1.714***<br>(0.065) | +1.643***<br>(0.099) | +1.863***<br>(0.083) | +1.711***<br>(0.065) |
| Rival starting earlier | -0.044<br>(0.046) | -0.027<br>(0.038) | -0.223***<br>(0.029) | -0.043<br>(0.047) | -0.024<br>(0.037) | -0.225***<br>(0.029) |
| Rival starting later, in contention | -0.047<br>(0.069) | +0.022<br>(0.051) | -0.110***<br>(0.034) | -0.045<br>(0.057) | +0.013<br>(0.047) | -0.166***<br>(0.041) |
| Rival starting later, out of contention | -0.018<br>(0.069) | -0.026<br>(0.053) | -0.031<br>(0.045) | -0.014<br>(0.075) | -0.013<br>(0.070) | +0.000<br>(0.036) |
| Compatriot × start position | -0.697***<br>(0.192) | -0.536***<br>(0.185) | -0.697***<br>(0.128) | -0.704***<br>(0.190) | -0.525***<br>(0.184) | -0.699***<br>(0.129) |
| Rival starting earlier × compatriots’ start position | -0.176<br>(0.149) | -0.238<br>(0.168) | -0.466***<br>(0.130) | -0.174<br>(0.149) | -0.242<br>(0.171) | -0.485***<br>(0.130) |
| Rival starting later, in contention × compatriots’ start position | -0.434<br>(0.269) | -0.419**<br>(0.205) | -0.717***<br>(0.148) | -0.470*<br>(0.254) | -0.362**<br>(0.181) | -0.566***<br>(0.179) |
| Rival starting later, out of contention × compatriots’ start position | +0.176<br>(0.240) | -0.642*<br>(0.340) | -0.666**<br>(0.261) | +0.385<br>(0.281) | -1.603***<br>(0.435) | -0.616***<br>(0.173) |
| , , and | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| Performance FE | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| Judge FE | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| N | 46,208 | 62,918 | 97,857 | 46,208 | 62,918 | 97,857 |
| # of Competitions (G) | 70 | 102 | 172 | 70 | 102 | 172 |
| Mass of negative weights, main regressors | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 |
| Mass of negative weights, Compatriot × start position | 0.010 | 0.063 | 0.045 | 0.010 | 0.063 | 0.045 |
| Mass of negative weights, the three Rival × compatriots’ start position | 0.012–0.034 | 0.050–0.066 | 0.045–0.064 | 0.012–0.030 | 0.049–0.087 | 0.036–0.064 |
| Share of negative weights, main regressors | 0% | 0% | 0% | 0% | 0% | 0% |
| Share of negative weights, Compatriot × start position | 10% | 21% | 21% | 10% | 22% | 21% |
| Share of negative weights, the three Rival × compatriots’ start position | 12%–18% | 22%–24% | 21%–22% | 12%–18% | 21%–24% | 20%–23% |
Table A.7. Table 6 Robustness Check: Alternative In Contention Definitions. NOTE: Two-way (competition + athlete) cluster-robust standard errors in parentheses, with degrees of freedom, the column’s competitions; *** , ** , * .
| Variable | Rival within ±2 start numbers (1) Open draw | Rival within ±2 start numbers (2) Seeded order | Rival within ±2 start numbers (3) Segment 2 | Rival within ±4 start numbers (4) Open draw | Rival within ±4 start numbers (5) Seeded order | Rival within ±4 start numbers (6) Segment 2 |
| Compatriot | +1.655***<br>(0.099) | +1.860***<br>(0.081) | +1.729***<br>(0.063) | +1.648***<br>(0.100) | +1.864***<br>(0.085) | +1.704***<br>(0.065) |
| Rival starting earlier | -0.058<br>(0.052) | -0.023<br>(0.037) | -0.247***<br>(0.030) | -0.046<br>(0.044) | -0.020<br>(0.039) | -0.213***<br>(0.028) |
| Rival starting later, in contention | +0.019<br>(0.086) | +0.047<br>(0.055) | -0.248***<br>(0.049) | -0.021<br>(0.069) | -0.002<br>(0.054) | -0.234***<br>(0.047) |
| Rival starting later, out of contention | -0.025<br>(0.085) | -0.081<br>(0.063) | +0.009<br>(0.038) | +0.002<br>(0.062) | +0.032<br>(0.050) | +0.010<br>(0.030) |
| Compatriot × start position | -0.710***<br>(0.189) | -0.525***<br>(0.187) | -0.687***<br>(0.127) | -0.722***<br>(0.194) | -0.519***<br>(0.185) | -0.660***<br>(0.128) |
| Rival starting earlier × compatriots’ start position | -0.308*<br>(0.174) | -0.099<br>(0.180) | -0.451***<br>(0.142) | -0.269*<br>(0.137) | -0.207<br>(0.159) | -0.283**<br>(0.126) |
| Rival starting later, in contention × compatriots’ start position | -0.499*<br>(0.292) | -0.476**<br>(0.215) | -0.760***<br>(0.214) | -0.452*<br>(0.242) | -0.324<br>(0.204) | -0.802***<br>(0.211) |
| Rival starting later, out of contention × compatriots’ start position | +0.223<br>(0.291) | -0.863*<br>(0.483) | -0.341*<br>(0.175) | -0.070<br>(0.220) | -0.474*<br>(0.258) | -0.345*<br>(0.139) |
| , , and | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| Performance FE | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| Judge FE | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| N | 46,208 | 62,918 | 97,857 | 46,208 | 62,918 | 97,857 |
| # of Competitions (G) | 70 | 102 | 172 | 70 | 102 | 172 |
| Mass of negative weights, main regressors | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 |
| Mass of negative weights, Compatriot × start position | 0.010 | 0.062 | 0.045 | 0.010 | 0.063 | 0.045 |
| Mass of negative weights, the three Rival × compatriots’ start position | 0.012–0.041 | 0.058–0.097 | 0.037–0.058 | 0.013–0.033 | 0.044–0.056 | 0.029–0.046 |
| Share of negative weights, main regressors | 0% | 0% | 0% | 0% | 0% | 0% |
| Share of negative weights, Compatriot × start position | 10% | 21% | 21% | 10% | 22% | 21% |
| Share of negative weights, the three Rival × compatriots’ start position | 12%–19% | 21%–23% | 19%–22% | 12%–18% | 20%–24% | 18%–22% |
Table A.8. Table 6 Robustness Check: Alternative Close Rival Definitions. NOTE: Two-way (competition + athlete) cluster-robust standard errors in parentheses, with degrees of freedom, the column’s competitions; *** , ** , * .
| Variable | In contention: top 3 so far | In contention: top 4 so far, places 1–10 after Segment 1 | ||||
| (1) TSS pct | (2) GOE pct | (3) PCS pct | (4) TSS pct | (5) GOE pct | (6) PCS pct | |
| Compatriot | +1.753***<br>(0.090) | +2.654***<br>(0.145) | +1.782***<br>(0.098) | +1.754***<br>(0.090) | +2.655***<br>(0.144) | +1.785***<br>(0.098) |
| Rival starting earlier | -0.205***<br>(0.061) | -0.338***<br>(0.104) | -0.183**<br>(0.073) | -0.203***<br>(0.059) | -0.333***<br>(0.101) | -0.180**<br>(0.072) |
| Rival starting later, in contention | -0.094<br>(0.061) | -0.203**<br>(0.097) | -0.104<br>(0.072) | -0.058<br>(0.075) | -0.167<br>(0.116) | -0.051<br>(0.092) |
| Rival starting later, out of contention | +0.020<br>(0.063) | -0.111<br>(0.124) | +0.121<br>(0.099) | -0.074<br>(0.055) | -0.196**<br>(0.089) | -0.041<br>(0.089) |
| Compatriot × Wₑₐᵣₗᵢₑᵣ, in contention | +0.052<br>(0.063) | +0.110<br>(0.099) | +0.043<br>(0.074) | +0.065<br>(0.066) | +0.108<br>(0.109) | +0.064<br>(0.077) |
| Compatriot × Wₑₐᵣₗᵢₑᵣ, out of contention | +0.094<br>(0.102) | -0.190<br>(0.185) | +0.307**<br>(0.135) | +0.031<br>(0.074) | -0.049<br>(0.121) | +0.110<br>(0.096) |
| Compatriot × Wₗₐₜₑᵣ | +0.200***<br>(0.065) | +0.290***<br>(0.105) | +0.192**<br>(0.081) | +0.190***<br>(0.064) | +0.260**<br>(0.105) | +0.191**<br>(0.082) |
| Rival starting earlier × Pₚ | +0.059<br>(0.037) | +0.088<br>(0.059) | +0.061<br>(0.048) | +0.061<br>(0.038) | +0.089<br>(0.060) | +0.066<br>(0.049) |
| Rival starting later, in contention × Pₚ | +0.046<br>(0.056) | +0.036<br>(0.096) | +0.070<br>(0.067) | +0.064<br>(0.074) | +0.072<br>(0.134) | +0.084<br>(0.084) |
| Rival starting later, out of contention × Pₚ | +0.039<br>(0.084) | -0.015<br>(0.127) | +0.101<br>(0.119) | +0.016<br>(0.058) | +0.024<br>(0.095) | +0.015<br>(0.077) |
| Cⱼₚ, R⁺ⱼₚ, R⁻,ᵢₙⱼₚ and R⁻,ₒᵤₜⱼₚ · H̃ₚ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| Performance FE | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| Judge FE | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| N | 31,312 | 31,312 | 31,312 | 31,312 | 31,312 | 31,312 |
| # of Competitions (G) | 57 | 57 | 57 | 57 | 57 | 57 |
| Mass of negative weights, Cⱼₚ, R⁺ⱼₚ, R⁻,ᵢₙⱼₚ, R⁻,ₒᵤₜⱼₚ | 0.000 | 0.000 | ||||
| Mass of negative weights, Cⱼₚ × Wₗₐₜₑᵣ | 0.034 | 0.035 | ||||
| Mass of negative weights, all other interactions | 0.026–0.047 | 0.029–0.066 | ||||
| Share of negative weights, Cⱼₚ, R⁺ⱼₚ, R⁻,ᵢₙⱼₚ, R⁻,ₒᵤₜⱼₚ | 0% | 0% | ||||
| Share of negative weights, Cⱼₚ × Wₗₐₜₑᵣ | 20% | 20% | ||||
| Share of negative weights, all other interactions | 15%–19% | 15%–24% |
Table A.9. Table 7 Robustness Check: Alternative In Contention Definitions. NOTE: Era A: 2016/17-2017/18. Era B: 2018/19-2021/22. Two-way cluster-robust standard errors in parentheses. Each interaction is centered at its mean over the rows of its indicator. with degrees of freedom, the column’s competitions; *** , ** , * .
Heterogeneity Analysis on Escalation Effect
Tables A.11 and A.12 estimate columns (1)-(3) of Tables 7 and 8 separately for senior and junior events. As is discussed in § 4.2, we see that in Era A → Era B, most of the escalation comes from the junior events. C × is positive and significant on TSS (0.253) and PCS (0.392), and C × on TSS (0.296) and GOE (0.758). In the senior events, the only escalation term significant at the 5 percent level is C × on GOE (0.302). The competitor penalty responds to only in the senior events and only for later rivals of a compatriot already out of contention (0.178, 0.266 and 0.183 on TSS, GOE and PCS). The three terms, however, are not jointly significant.
| Variable | Rivals within start numbers | Rivals within start numbers | ||||
| (1) TSS pct | (2) GOE pct | (3) PCS pct | (4) TSS pct | (5) GOE pct | (6) PCS pct | |
| Compatriot | +1.773***<br>(0.085) | +2.692***<br>(0.136) | +1.801***<br>(0.093) | +1.745***<br>(0.091) | +2.654***<br>(0.151) | +1.772***<br>(0.097) |
| Rival starting earlier | -0.191***<br>(0.059) | -0.287***<br>(0.104) | -0.197***<br>(0.071) | -0.207***<br>(0.059) | -0.322***<br>(0.104) | -0.188**<br>(0.071) |
| Rival starting later, in contention | -0.155*<br>(0.083) | -0.319***<br>(0.119) | -0.130<br>(0.107) | -0.111<br>(0.077) | -0.231*<br>(0.129) | -0.100<br>(0.097) |
| Rival starting later, out of contention | -0.029<br>(0.068) | -0.142<br>(0.109) | +0.002<br>(0.092) | +0.007<br>(0.047) | -0.026<br>(0.084) | +0.001<br>(0.063) |
| Compatriot , in contention | +0.060<br>(0.060) | +0.171<br>(0.111) | +0.017<br>(0.065) | +0.055<br>(0.080) | +0.163<br>(0.149) | +0.003<br>(0.091) |
| Compatriot , out of contention | +0.056<br>(0.060) | -0.013<br>(0.098) | +0.147*<br>(0.075) | +0.034<br>(0.071) | -0.001<br>(0.108) | +0.091<br>(0.092) |
| Compatriot | +0.215***<br>(0.055) | +0.343***<br>(0.089) | +0.190**<br>(0.074) | +0.176**<br>(0.068) | +0.265**<br>(0.115) | +0.161*<br>(0.084) |
| Rival starting earlier | +0.031<br>(0.045) | +0.026<br>(0.073) | +0.049<br>(0.055) | +0.078*<br>(0.040) | +0.100*<br>(0.059) | +0.095*<br>(0.054) |
| Rival starting later, in contention | +0.020<br>(0.098) | +0.058<br>(0.169) | +0.011<br>(0.109) | +0.040<br>(0.080) | +0.086<br>(0.143) | +0.043<br>(0.094) |
| Rival starting later, out of contention | +0.117**<br>(0.051) | +0.170**<br>(0.081) | +0.135**<br>(0.068) | -0.004<br>(0.040) | -0.022<br>(0.066) | +0.006<br>(0.051) |
| and | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| Performance FE | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| Judge FE | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| N | 31,312 | 31,312 | 31,312 | 31,312 | 31,312 | 31,312 |
| # of Competitions (G) | 57 | 57 | 57 | 57 | 57 | 57 |
| Mass of negative weights, | 0.000 | 0.000 | ||||
| Mass of negative weights, | 0.020 | 0.040 | ||||
| Mass of negative weights, all other interactions | 0.031–0.075 | 0.025–0.068 | ||||
| Share of negative weights, | 0% | 0% | ||||
| Share of negative weights, | 15% | 21% | ||||
| Share of negative weights, all other interactions | 15%–25% | 15%–28% |
Table A.10. Robustness Check: Alternative Close Rival Definitions
NOTE: Era A: 2016/17-2017/18. Era B: 2018/19-2021/22. Two-way cluster-robust standard errors in parentheses. Each interaction is centered at its mean over the rows of its indicator. with degrees of freedom, the column’s competitions; *** , ** , * .
In Era B Era C, no interaction is significant at the 5 percent level in either tier. In both tables, the mass of negative weights is at most 0.04 for C and at most 0.09 for the other interactions.
| Variable | Senior events | Junior events | ||||
| (1) TSS pct | (2) GOE pct | (3) PCS pct | (4) TSS pct | (5) GOE pct | (6) PCS pct | |
| Compatriot | +1.926*** | +2.757*** | +1.887*** | +1.578*** | +2.581*** | +1.697*** |
| (0.125) | (0.204) | (0.124) | (0.118) | (0.196) | (0.154) | |
| Rival starting earlier | -0.207** | -0.303* | -0.189** | -0.211*** | -0.369*** | -0.191 |
| (0.089) | (0.166) | (0.085) | (0.075) | (0.115) | (0.114) | |
| Rival starting later, in contention | -0.090 | -0.132 | -0.123 | -0.185 | -0.462** | -0.107 |
| (0.095) | (0.150) | (0.111) | (0.143) | (0.219) | (0.189) | |
| Rival starting later, out of contention | +0.071 | -0.074 | +0.152* | -0.120** | -0.200* | -0.139 |
| (0.081) | (0.147) | (0.088) | (0.057) | (0.112) | (0.096) | |
| Compatriot , in contention | -0.042 | -0.109 | -0.005 | +0.296** | +0.758*** | +0.131 |
| (0.081) | (0.139) | (0.097) | (0.112) | (0.198) | (0.135) | |
| Compatriot , out of contention | +0.070 | -0.027 | +0.183 | +0.064 | +0.056 | +0.111 |
| (0.094) | (0.126) | (0.120) | (0.091) | (0.167) | (0.140) | |
| Compatriot | +0.107 | +0.302** | -0.019 | +0.253** | +0.183 | +0.392*** |
| (0.086) | (0.141) | (0.098) | (0.092) | (0.156) | (0.131) | |
| Rival starting earlier | +0.065 | +0.113 | +0.041 | +0.066 | +0.091 | +0.085 |
| (0.052) | (0.080) | (0.064) | (0.052) | (0.092) | (0.068) | |
| Rival starting later, in contention | +0.088 | +0.194 | +0.053 | -0.024 | -0.095 | +0.056 |
| (0.127) | (0.225) | (0.124) | (0.105) | (0.165) | (0.167) | |
| Rival starting later, out of contention | +0.178** | +0.266* | +0.183** | -0.050 | -0.090 | -0.056 |
| (0.080) | (0.140) | (0.080) | (0.050) | (0.083) | (0.077) | |
| , , and | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| Performance FE | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| Judge FE | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| N | 14,501 | 14,501 | 14,501 | 16,811 | 16,811 | 16,811 |
| # of Competitions (G) | 32 | 32 | 32 | 27 | 27 | 27 |
| Mass of negative weights, , , , | 0.000 | 0.000 | ||||
| Mass of negative weights, | 0.022 | 0.040 | ||||
| Mass of negative weights, all other interactions | 0.029–0.069 | 0.028–0.077 | ||||
| Share of negative weights, , , , | 0% | 0% | ||||
| Share of negative weights, | 17% | 20% | ||||
| Share of negative weights, all other interactions | 18%–25% | 14%–28% |
Table A.11. Table 7 Heterogeneity: Senior and Junior Events, Era A Era B. NOTE: Columns (1) to (3) of Table 7 (Segment 2 of Era B) estimated separately on the senior and the junior events. Era A: 2016/17-2017/18. Era B: 2018/19-2021/22. Each interaction is centered at its mean over the rows of its indicator in the column. Two-way (competitor + athlete) cluster-robust standard errors in parentheses, with a term for the estimation error of the first-step trained premia added to the variance; with degrees of freedom, the column’s competitions; *** , ** , * .
Table A.13 adds the unweighted terms of Table 9 (Cshare and Rcompatriot judge) to Table A.11. Table A.14 then drops the rival terms. Holding the share fixed, C is identified only from differences in the trained premia of the protecting judges. As is discussed in § 4.2, because the two measures are close to collinear, the standard errors of the C terms are four to five times those in Table A.11. Over the same change, the mass of negative weights on C rises from 0.02-0.04 to 0.39-0.55. The only interactions significant at the 5 percent level are on
| Variable | Senior events | Junior events | ||||
| (1) TSS pct | (2) GOE pct | (3) PCS pct | (4) TSS pct | (5) GOE pct | (6) PCS pct | |
| Compatriot | +1.703***<br>(0.116) | +2.155***<br>(0.160) | +1.759***<br>(0.140) | +1.056***<br>(0.099) | +1.431***<br>(0.127) | +1.252***<br>(0.126) |
| Rival starting earlier | -0.182***<br>(0.052) | -0.313***<br>(0.081) | -0.122<br>(0.076) | -0.238***<br>(0.058) | -0.330***<br>(0.074) | -0.255***<br>(0.089) |
| Rival starting later, in contention | -0.039<br>(0.085) | -0.192<br>(0.128) | +0.066<br>(0.105) | -0.303**<br>(0.124) | -0.671***<br>(0.177) | -0.175<br>(0.161) |
| Rival starting later, out of contention | +0.040<br>(0.075) | +0.089<br>(0.121) | +0.012<br>(0.101) | +0.058<br>(0.066) | -0.160**<br>(0.073) | +0.225**<br>(0.098) |
| Compatriot × , in contention | -0.030<br>(0.121) | +0.019<br>(0.198) | -0.076<br>(0.136) | +0.092<br>(0.156) | +0.228<br>(0.205) | +0.002<br>(0.220) |
| Compatriot × , out of contention | +0.008<br>(0.097) | -0.100<br>(0.149) | +0.072<br>(0.146) | +0.207*<br>(0.111) | +0.244<br>(0.155) | +0.307*<br>(0.176) |
| Compatriot × | -0.045<br>(0.078) | +0.043<br>(0.133) | -0.116<br>(0.080) | +0.098<br>(0.086) | +0.028<br>(0.150) | +0.174<br>(0.110) |
| Rival starting earlier × | -0.123*<br>(0.072) | -0.152<br>(0.093) | -0.145<br>(0.088) | +0.074<br>(0.055) | +0.088<br>(0.082) | +0.098<br>(0.087) |
| Rival starting later, in contention × | -0.197*<br>(0.103) | -0.280*<br>(0.157) | -0.178<br>(0.121) | +0.281*<br>(0.151) | +0.155<br>(0.175) | +0.439*<br>(0.223) |
| Rival starting later, out of contention × | -0.031<br>(0.076) | +0.014<br>(0.101) | -0.083<br>(0.093) | -0.107<br>(0.068) | -0.161<br>(0.101) | -0.107<br>(0.104) |
| , , and · | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| Performance FE | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| Judge FE | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| N | 20,293 | 20,293 | 20,293 | 24,386 | 24,386 | 24,386 |
| # of Competitions (G) | 44 | 44 | 44 | 36 | 36 | 36 |
| Mass of negative weights, , , , | 0.000 | 0.000 | ||||
| Mass of negative weights, | 0.016 | 0.035 | ||||
| Mass of negative weights, all other interactions | 0.028–0.057 | 0.031–0.087 | ||||
| Share of negative weights, , , , | 0% | 0% | ||||
| Share of negative weights, | 14% | 21% | ||||
| Share of negative weights, all other interactions | 17%–25% | 12%–30% |
Table A.12. Heterogeneity: Senior and Junior Events, Era B → Era C. NOTE: Columns (1) to (3) of Table 8 (Segment 2 of Era C) estimated separately on the senior and the junior events. Era B: 2018/19-2021/22. Era C: 2022/23-2025/26. Each interaction is centered at its mean over the rows of its indicator in the column. Two-way (competition + athlete) cluster-robust standard errors in parentheses, with a term for the estimation error of the first-step trained premia added to the variance; with degrees of freedom, the column’s competitions; *** , ** , * .
junior GOE, where is positive and of later rivals is negative. But both carry 30–47% negative weights, so we do not interpret them. Dropping the rival terms barely moves the compatriot-side estimates, so this imprecision mainly comes from the collinearity of the weighted and unweighted measures.
Robustness Checks With Alternative Cluster-Robust Inference Methods
In this section, we report the results of § 3 and § 4 with two alternatives to our default standard errors, which cluster by competition and by athlete [5]. The first clusters by competition and by athlete federation instead. The second keeps the clustering by competition and by athlete but replaces the standard variance estimator with the two-way cluster jackknife version discussed in MacKinnon, Nielsen and Webb [19]. Clustering by athlete federation follows Zitzewitz [24], who clusters by competitor country and by competition, and it allows the residuals of different athletes from the same federation to be correlated, for example through the federation’s judges or its national selection. We do not use it as the default because the athlete federation clusters are few in effect and very unequal in size. In our data, the ten largest federations account for 56 percent of the observations, while 52 of the 78 federations have under 1 percent each. With a few dominant clusters and many small ones, the cluster-robust variance estimator relies mainly on the largest federations, and its statistics can be far from their nominal distribution, so that inference may not be reliable [18]. The jackknife re-estimates each regression without one competition, one athlete, or one competition-athlete pair at a time. MacKinnon, Nielsen and Webb [19] argues that standard two-way cluster-robust tests can perform poorly in finite samples, while the proposed jackknife alternative performs well in simulations. For tables reported in this section, both alternatives keep
| Variable | Senior events | Junior events | ||||
| (1) TSS pct | (2) GOE pct | (3) PCS pct | (4) TSS pct | (5) GOE pct | (6) PCS pct | |
| Compatriot | +1.928*** | +2.755*** | +1.891*** | +1.577*** | +2.578*** | +1.698*** |
| (0.124) | (0.204) | (0.124) | (0.117) | (0.194) | (0.154) | |
| Rival starting earlier | -0.208** | -0.305* | -0.189** | -0.212*** | -0.373*** | -0.190 |
| (0.089) | (0.166) | (0.085) | (0.075) | (0.114) | (0.114) | |
| Rival starting later, in contention | -0.090 | -0.129 | -0.125 | -0.186 | -0.467** | -0.106 |
| (0.094) | (0.150) | (0.111) | (0.144) | (0.219) | (0.189) | |
| Rival starting later, out of contention | +0.071 | -0.077 | +0.155* | -0.119* | -0.199* | -0.138 |
| (0.081) | (0.146) | (0.088) | (0.058) | (0.112) | (0.096) | |
| Compatriot × , in contention | -0.246 | -0.785 | -0.023 | +0.807 | +1.552 | +0.469 |
| (0.377) | (0.686) | (0.434) | (0.531) | (1.202) | (0.418) | |
| Compatriot × , out of contention | +0.075 | +0.188 | +0.062 | -0.373 | -0.526 | -0.279 |
| (0.332) | (0.565) | (0.326) | (0.577) | (1.208) | (0.647) | |
| Compatriot × | +0.392 | +0.595 | +0.335 | +0.533 | +1.253** | +0.160 |
| (0.374) | (0.587) | (0.499) | (0.412) | (0.582) | (0.529) | |
| Compatriot × share earlier, in contention | +0.556 | +1.840 | +0.055 | -1.478 | -2.301 | -0.972 |
| (1.045) | (1.807) | (1.242) | (1.432) | (3.297) | (1.163) | |
| Compatriot × share earlier, out of contention | -0.014 | -0.593 | +0.339 | +1.127 | +1.485 | +1.019 |
| (0.822) | (1.445) | (0.781) | (1.527) | (3.184) | (1.650) | |
| Compatriot × share later | -0.802 | -0.829 | -0.993 | -0.762 | -2.947** | +0.657 |
| (0.947) | (1.517) | (1.250) | (1.008) | (1.384) | (1.306) | |
| Rival starting earlier × | -0.042 | +0.230 | -0.222 | +0.059 | +0.053 | +0.036 |
| (0.129) | (0.238) | (0.154) | (0.237) | (0.409) | (0.267) | |
| Rival starting later, in contention × | +0.068 | +0.101 | +0.064 | -0.145 | +0.305 | -0.384 |
| (0.236) | (0.454) | (0.252) | (0.378) | (0.655) | (0.488) | |
| Rival starting later, out of contention × | +0.227 | +0.384 | +0.127 | +0.020 | -0.126 | +0.159 |
| (0.212) | (0.400) | (0.233) | (0.237) | (0.559) | (0.274) | |
| Rival starting earlier × compatriot judge | +0.336 | -0.370 | +0.830* | +0.021 | +0.100 | +0.139 |
| (0.330) | (0.616) | (0.408) | (0.597) | (1.025) | (0.704) | |
| Rival starting later, in contention × compatriot judge | +0.072 | +0.347 | -0.050 | +0.385 | -1.275 | +1.409 |
| (0.629) | (1.167) | (0.723) | (1.019) | (1.982) | (1.270) | |
| Rival starting later, out of contention × compatriot judge | -0.147 | -0.351 | +0.165 | -0.190 | +0.094 | -0.579 |
| (0.619) | (1.110) | (0.697) | (0.657) | (1.452) | (0.800) | |
| , , and | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| Performance FE | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| Judge FE | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| N | 14,501 | 14,501 | 14,501 | 16,811 | 16,811 | 16,811 |
| # of Competitions (G) | 32 | 32 | 32 | 27 | 27 | 27 |
| Mass of negative weights, , , , | 0.000 | 0.000 | ||||
| Mass of negative weights, | 0.394 | 0.545 | ||||
| Mass of negative weights, share later | 0.397 | 0.617 | ||||
| Mass of negative weights, all other interactions | 0.137–0.781 | 0.384–1.033 | ||||
| Share of negative weights, , , , | 0% | 0% | ||||
| Share of negative weights, | 39% | 47% | ||||
| Share of negative weights, share later | 33% | 30% | ||||
| Share of negative weights, all other interactions | 30%–49% | 22%–59% |
Table A.13. Table A.13: Table A.11 With the Unweighted Shares and the Compatriot-judge Indicator Added. NOTE: The columns of Table A.11 with the terms of Table 9 added. Era A: 2016/17-2017/18. Era B: 2018/19-2021/22. Each interaction is centered at its mean over the rows of its indicator in the column. Two-way (pairwise) cluster-robust standard errors in parentheses, with a term for the estimation error of the first-step trained premia added to the variance; with degrees of freedom, the column’s competitions; *** , ** , * .
| Variable | Senior events | Junior events | ||||
| (1) TSS pct | (2) GOE pct | (3) PCS pct | (4) TSS pct | (5) GOE pct | (6) PCS pct | |
| Compatriot | +1.957*** | +2.828*** | +1.904*** | +1.643*** | +2.698*** | +1.756*** |
| (0.119) | (0.183) | (0.116) | (0.111) | (0.180) | (0.137) | |
| Compatriot × , in contention | -0.108 | -0.577 | +0.116 | +0.787 | +1.491 | +0.482 |
| (0.379) | (0.667) | (0.445) | (0.540) | (1.217) | (0.422) | |
| Compatriot × , out of contention | +0.077 | +0.166 | +0.085 | -0.261 | -0.324 | -0.161 |
| (0.317) | (0.547) | (0.315) | (0.543) | (1.162) | (0.617) | |
| Compatriot × | +0.365 | +0.608 | +0.280 | +0.606 | +1.383** | +0.219 |
| (0.377) | (0.595) | (0.494) | (0.410) | (0.597) | (0.516) | |
| Compatriot × share earlier, in contention | +0.152 | +1.239 | -0.347 | -1.487 | -2.140 | -1.132 |
| (1.066) | (1.781) | (1.278) | (1.463) | (3.333) | (1.184) | |
| Compatriot × share earlier, out of contention | -0.065 | -0.572 | +0.213 | +0.888 | +0.985 | +0.802 |
| (0.782) | (1.393) | (0.750) | (1.429) | (3.059) | (1.572) | |
| Compatriot × share later | -0.708 | -0.855 | -0.805 | -0.866 | -3.065** | +0.528 |
| (0.947) | (1.527) | (1.224) | (1.012) | (1.412) | (1.294) | |
| ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | |
| Performance FE | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| Judge FE | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| 14,501 | 14,501 | 14,501 | 16,811 | 16,811 | 16,811 | |
| # of Competitions () | 32 | 32 | 32 | 27 | 27 | 27 |
| Mass of negative weights, | 0.000 | 0.000 | ||||
| Mass of negative weights, | 0.394 | 0.547 | ||||
| Mass of negative weights, share later | 0.397 | 0.618 | ||||
| Mass of negative weights, all other interactions | 0.471–0.784 | 0.697–1.034 | ||||
| Share of negative weights, | 0% | 0% | ||||
| Share of negative weights, | 39% | 46% | ||||
| Share of negative weights, share later | 33% | 30% | ||||
| Share of negative weights, all other interactions | 34%–49% | 31%–56% |
Table A.14. Table A.13 Without the Rival Terms
NOTE: Table A.13 without the three rival indicators and their interactions. Era A: 2016/17-2017/18. Era B: 2018/19-2021/22. Each interaction is centered at its mean over the rows of its indicator in the column. Two-way (competition + athlete) cluster-robust standard errors in parentheses, with a term for the estimation error of the first-step trained premia added to the variance; with degrees of freedom, the column’s competitions; *** , ** , * .
the correction for the first-step estimation error and add the same first-step variance term as our default.
Tables A.15-A.18 reproduce Tables 6-9 and report the slopes and the interactions with both alternative standard errors. For Tables 3-5, the alternative inference results are reported in the table footnotes, recording every estimate whose significance level changes.
Table A.15 reproduces Table 6. Under clustering by athlete federation, the second segment estimates in column (6) keep their significance levels. On GOE in the pooled columns, Compatriot × start position moves from the 1 to the 10 percent level. Rival starting later, out of contention × compatriots’ start position moves from the 10 to the 5 percent level on PCS and is no longer significant in column (5), and Rival starting later, in contention × compatriots’ start position in column (5) moves from the 5 to the 1 percent level. The jackknife standard errors are 1.14 to 1.36 times ours. Under the jackknife, Compatriot × start position and Rival starting earlier × compatriots’ start position remain significant at the 5 percent level or better wherever they are significant in Table 6, and so does Rival starting later, in contention × compatriots’ start position on TSS pct and PCS pct and in the second segment.
| Variable | (1) TSS pct | (2) GOE pct | (3) PCS pct | (4) Segment 1, open draw | (5) Segment 1, seeded order | (6) Segment 2 |
| Compatriot × start position | -0.711*** | -0.454*** | -1.162*** | -0.697*** | -0.536*** | -0.702*** |
| (0.104)*** | (0.254)* | (0.135)*** | (0.166)*** | (0.185)*** | (0.156)*** | |
| [0.114]*** | [0.197]** | [0.149]*** | [0.237]*** | [0.241]** | [0.152]*** | |
| Rival starting earlier × compatriots’ start position | -0.346*** | -0.525*** | -0.379*** | -0.176 | -0.238 | -0.468*** |
| (0.100)*** | (0.167)*** | (0.121)*** | (0.154) | (0.167) | (0.159)*** | |
| [0.108]*** | [0.170]*** | [0.148]** | [0.184] | [0.196] | [0.148]*** | |
| Rival starting later, in contention × compatriots’ start position | -0.553*** | -0.494** | -0.757*** | -0.434 | -0.419** | -0.734*** |
| (0.135)*** | (0.242)** | (0.165)*** | (0.430) | (0.150)*** | (0.180)*** | |
| [0.153]*** | [0.258]* | [0.192]*** | [0.367] | [0.255] | [0.253]*** | |
| Rival starting later, out of contention × compatriots’ start position | -0.215* | -0.148 | -0.324* | +0.176 | -0.642* | -0.358** |
| (0.116)* | (0.204) | (0.145)** | (0.227) | (0.443) | (0.166)** | |
| [0.150] | [0.241] | [0.214] | [0.316] | [0.441] | [0.187]* | |
| , , and | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| Performance FE | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| Judge FE | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| N | 206,983 | 206,983 | 206,983 | 46,208 | 62,918 | 97,857 |
| # of Competitions (G) | 172 | 172 | 172 | 70 | 102 | 172 |
| # of Skaters (H) | 2,470 | 2,470 | 2,470 | 2,109 | 1,338 | 2,368 |
| # of Federations (F) | 78 | 78 | 78 | 78 | 63 | 77 |
Table A.15. Table 6 with Alternative Cluster-Robust Standard Errors
NOTE: Each estimate is the slope in Table 6, with the stars of that table’s standard error. In parentheses: the two-way (competition + athlete federation) cluster-robust standard errors in parentheses, with degrees of freedom, the column’s competitions and its athlete federations. In brackets: the two-way cluster jackknife standard error by competition and athlete, with degrees of freedom, the number of athletes. Each standard error carries the stars of its own p-value; *** , ** , * .
Table A.16 reproduces Table 7. Compatriot × remains significant at the 5 percent level on TSS and GOE under both alternatives and at the 10 percent level on PCS, while in column (6) it keeps the 5 percent level under clustering by athlete federation and moves to the 10 percent level under the jackknife, whose standard errors are 1.12 to 1.69 times the default. Rival starting later, in contention × in column (5) is no longer significant under either alternative, and in column (6) it moves from the 5 to the 10 percent level under the jackknife. Under the jackknife, Compatriot × for earlier rivals, out of contention in column (4) is also no longer significant.
| Variable | (1) TSS pct | (2) GOE pct | (3) PCS pct | (4) Segment 1, open draw | (5) Segment 1, seeded order | (6) All rows |
| Compatriot × , in contention | +0.052 | +0.153 | +0.009 | -0.116 | +0.000 | +0.002 |
| (0.064) | (0.115) | (0.060) | (0.170) | (0.071) | (0.056) | |
| [0.094] | [0.173] | [0.101] | [0.187] | [0.095] | [0.067] | |
| Compatriot × , out of contention | +0.045 | -0.039 | +0.129 | -0.376* | -0.092 | -0.047 |
| (0.062) | (0.044) | (0.117) | (0.182)* | (0.166) | (0.073) | |
| [0.082] | [0.141] | [0.103] | [0.233] | [0.149] | [0.070] | |
| Compatriot × | +0.192*** | +0.262** | +0.193** | -0.020 | +0.036 | +0.114** |
| (0.071)*** | (0.096)*** | (0.103)* | (0.150) | (0.081) | (0.048)** | |
| [0.076]** | [0.118]** | [0.102]* | [0.154] | [0.091] | [0.060]* | |
| Rival starting earlier × | +0.059 | +0.085 | +0.063 | -0.011 | -0.001 | +0.020 |
| (0.039) | (0.059) | (0.055) | (0.086) | (0.064) | (0.038) | |
| [0.050] | [0.076] | [0.066] | [0.085] | [0.065] | [0.035] | |
| Rival starting later, in contention × | +0.056 | +0.073 | +0.077 | -0.039 | +0.141* | +0.113** |
| (0.079) | (0.147) | (0.092) | (0.131) | (0.096) | (0.045)** | |
| [0.118] | [0.203] | [0.132] | [0.160] | [0.105] | [0.066]* | |
| Rival starting later, out of contention × | +0.035 | +0.051 | +0.032 | +0.014 | -0.169 | -0.022 |
| (0.051) | (0.100) | (0.055) | (0.108) | (0.100) | (0.039) | |
| [0.065] | [0.114] | [0.077] | [0.167] | [0.185] | [0.051] | |
| , , and | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| Performance FE | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| Judge FE | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| 31,312 | 31,312 | 31,312 | 13,814 | 20,862 | 65,988 | |
| # of Competitions (G) | 57 | 57 | 57 | 21 | 36 | 57 |
| # of Skaters (H) | 1,084 | 1,084 | 1,084 | 809 | 669 | 1,147 |
| # of Federations (F) | 71 | 71 | 71 | 69 | 56 | 71 |
Table A.16. Table 7 with Alternative Cluster-Robust Standard Errors
NOTE: Era A: 2016/17-2017/18. Era B: 2018/19-2021/22. Each estimate is the slope in Table 7, with the stars of that table’s standard error. In parentheses: the two-way (competition + athlete federation) cluster-robust standard errors in parentheses, with degrees of freedom, the column’s competitions and its athlete federations. In brackets: the two-way cluster jackknife standard error by competition and athlete, with degrees of freedom, the number of athletes. Each standard error carries the stars of its own p-value, *** , ** , * $p < 0.10.
Table A.17 reproduces Table 8. Rival starting earlier × remains significant at the 5 percent level or better in columns (5) and (6) under both alternatives. Under clustering by athlete federation, Compatriot × for earlier rivals in contention in column (6) becomes significant at the 10 percent level, and Rival starting later, out of contention × in column (4) is no longer significant. The jackknife standard errors are 1.15 to 1.66 times the default, and under the jackknife, Rival starting later, out of contention is no longer significant on TSS pct and PCS pct in the second segment or in column (4).
| Variable | Segment 2 (1) TSS pct | Segment 2 (2) GOE pct | Segment 2 (3) PCS pct | TSS pct (4) Segment 1, open draw | TSS pct (5) Segment 1, seeded order | TSS pct (6) All rows |
| Compatriot , in contention | +0.006<br>(0.076)<br>[0.122] | +0.079<br>(0.140)<br>[0.197] | -0.038<br>(0.104)<br>[0.146] | +0.150<br>(0.220)<br>[0.333] | +0.065<br>(0.100)<br>[0.128] | +0.065*<br>(0.036)*<br>[0.075] |
| Compatriot , out of contention | +0.060<br>(0.058)<br>[0.087] | +0.026<br>(0.138)<br>[0.135] | +0.119<br>(0.075)<br>[0.127] | -0.155<br>(0.194)<br>[0.296] | -0.206<br>(0.219)<br>[0.212] | -0.023<br>(0.076)<br>[0.073] |
| Compatriot | -0.004<br>(0.107)<br>[0.071] | +0.042<br>(0.151)<br>[0.112] | -0.039<br>(0.106)<br>[0.092] | +0.252<br>(0.164)<br>[0.217] | +0.097<br>(0.083)<br>[0.125] | +0.053<br>(0.076)<br>[0.069] |
| Rival starting earlier | -0.027<br>(0.040)<br>[0.054] | -0.036<br>(0.059)<br>[0.077] | -0.025<br>(0.059)<br>[0.073] | -0.092<br>(0.083)<br>[0.108] | -0.179***<br>(0.064)*<br>[0.084] | -0.084**<br>(0.031)*<br>[0.040] |
| Rival starting later, in contention | -0.016<br>(0.082)<br>[0.121] | -0.119<br>(0.141)<br>[0.148] | +0.062<br>(0.113)<br>[0.174] | +0.022<br>(0.128)<br>[0.214] | -0.064<br>(0.078)<br>[0.090] | -0.040<br>(0.060)<br>[0.070] |
| Rival starting later, out of contention | -0.108**<br>(0.049)**<br>[0.069] | -0.110<br>(0.073)<br>[0.099] | -0.146**<br>(0.066)**<br>[0.094] | +0.220*<br>(0.138)<br>[0.156] | +0.040<br>(0.126)<br>[0.128] | +0.004<br>(0.048)<br>[0.055] |
| , , and | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| Performance FE | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| Judge FE | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| N | 44,679 | 44,679 | 44,679 | 20,290 | 29,020 | 93,989 |
| # of Competitions (G) | 76 | 76 | 76 | 28 | 48 | 76 |
| # of Skaters (H) | 1,237 | 1,237 | 1,237 | 972 | 718 | 1,279 |
| # of Federations (F) | 76 | 76 | 76 | 75 | 60 | 78 |
Table A.17. Table 8 with Alternative Cluster-Robust Standard Errors
NOTE: Era B: 2018/19-2021/22. Era C: 2022/23-2025/26. Each estimate is the slope in Table 8, with the stars of that table’s standard error. In parentheses: the two-way (competition + athlete federation) cluster-robust standard errors in parentheses, with degrees of freedom, the column’s competitions and its athlete federations. In brackets: the two-way cluster jackknife standard error by competition and athlete, with degrees of freedom, the number of athletes. Each standard error carries the stars of its own p-value; *** , ** , * .
Table A.18 reproduces Table 9. Under clustering by athlete federation, Compatriot share later remains significant on all three outcomes in the second segment, moving from the 1 to the 5 percent level on TSS and from the 5 to the 10 percent level on PCS. Rival starting later, in contention compatriot judge in column (5) moves from the 1 to the 5 percent level. The jackknife standard errors are 1.16 to 1.54 times the default. Under the jackknife, Compatriot share later also remains significant on all three outcomes in the second segment, at the 5 percent level on TSS pct and at the 10 percent level on GOE pct and PCS pct. Rival starting later, in contention compatriot judge moves to the 10 percent level in column (5) and to the 5 percent level in column (6), while Rival starting earlier compatriot judge is no longer significant on TSS pct and PCS pct. Compatriot share earlier, out of contention in column (4) moves from the 5 to the 10 percent level.
| Variable | Segment 2 | TSS pct | ||||
| (1) TSS pct | (2) GOE pct | (3) PCS pct | (4) Segment 1, open draw | (5) Segment 1, seeded order | (6) All rows | |
| Compatriot share earlier, in contention | +0.147<br>(0.135)<br>[0.230] | +0.433<br>(0.236)*<br>[0.420] | +0.039<br>(0.155)<br>[0.287] | -0.369<br>(0.365)<br>[0.462] | +0.035<br>(0.182)<br>[0.258] | -0.002<br>(0.137)<br>[0.174] |
| Compatriot share earlier, out of contention | +0.129<br>(0.161)<br>[0.214] | -0.114<br>(0.140)<br>[0.369] | +0.359<br>(0.299)<br>[0.268] | -1.129**<br>(0.469)**<br>[0.588]* | -0.172<br>(0.518)<br>[0.402] | -0.136<br>(0.199)<br>[0.185] |
| Compatriot share later | +0.423***<br>(0.183)<br>[0.184] | +0.525**<br>(0.251)**<br>[0.294]* | +0.467**<br>(0.240)<br>[0.248] | -0.139<br>(0.397)<br>[0.412] | +0.100<br>(0.196)<br>[0.217] | +0.238*<br>(0.119)*<br>[0.144] |
| Rival starting earlier compatriot judge | +0.182*<br>(0.093)*<br>[0.126] | +0.189<br>(0.135)<br>[0.191] | +0.243*<br>(0.135)*<br>[0.173] | -0.013<br>(0.228)<br>[0.225] | -0.033<br>(0.153)<br>[0.173] | +0.056<br>(0.086)<br>[0.088] |
| Rival starting later, in contention compatriot judge | +0.206<br>(0.255)<br>[0.330] | +0.105<br>(0.334)<br>[0.542] | +0.370<br>(0.354)<br>[0.363] | +0.029<br>(0.277)<br>[0.372] | +0.535***<br>(0.207)**<br>[0.272]* | +0.367***<br>(0.128)*<br>[0.179] |
| Rival starting later, out of contention compatriot judge | +0.075<br>(0.140)<br>[0.175] | +0.108<br>(0.251)<br>[0.297] | +0.074<br>(0.165)<br>[0.210] | -0.005<br>(0.257)<br>[0.351] | -0.411<br>(0.255)<br>[0.421] | -0.073<br>(0.098)<br>[0.121] |
| , , and | ||||||
| Performance FE | ||||||
| Judge FE | ||||||
| N | 31,312 | 31,312 | 31,312 | 13,814 | 20,862 | 65,988 |
| # of Competitions (G) | 57 | 57 | 57 | 21 | 36 | 57 |
| # of Skaters (H) | 1,084 | 1,084 | 1,084 | 809 | 669 | 1,147 |
| # of Federations (F) | 71 | 71 | 71 | 69 | 56 | 71 |
Table A.18. Table A.18: Table 9 with Alternative Cluster-Robust Standard Errors
NOTE: Era A: 2016/17-2017/18. Era B: 2018/19-2021/22. Each estimate is the slope in Table 9, with the stars of that table’s standard error. In parentheses: the two-way (competition + athlete federation) cluster-robust standard errors in parentheses, with degrees of freedom, the column’s competitions and its athlete federations. In brackets: the two-way cluster jackknife standard error by competition and athlete, with degrees of freedom, the number of athletes. Each standard error carries the stars of its own -value; *** , ** , * .
References
- [1]Aigner, Dennis J., and Glen G. Cain. 1977. “Statistical Theories of Discrimination in Labor Markets.” Industrial and Labor Relations Review, 30(2): 175–187.DOI
- [2]Andrews, Isaiah, Toru Kitagawa, and Adam McCloskey. 2024. “Inference on winners.” The Quarterly Journal of Economics, 139(1): 305–358.
- [3]Ansorge, Charles J., and Jerry K. Scheer. 1988. “International Bias Detected in Judging Gymnastic Competition at the 1984 Olympic Games.” Research Quarterly for Exercise and Sport, 59(2): 103–107.DOI
- [4]Armstrong, Timothy B, Michal Kolesár, and Mikkel Plagborg-Møller. 2022. “Robust empirical Bayes confidence intervals.” Econometrica, 90(6): 2567–2602.DOI
- [5]Cameron, A. Colin, Jonah B. Gelbach, and Douglas L. Miller. 2011. “Robust Inference with Multiway Clustering.” Journal of Business & Economic Statistics, 29(2): 238–249.DOI
- [6]Chen, Jiafeng, Jiaying Gu, and Soonwoo Kwon. 2026. “Empirical Bayes shrinkage (mostly) does not correct the measurement error in regression.”arxiv.org/abs/2503.19095
- [9]Courty, Pascal, and Gerald Marschke. 2008. “A general test for distortions in performance measures.” The Review of Economics and Statistics, 90(3): 428–441.DOI
- [10]de Chaisemartin, Clément, and Xavier D’Haultfœuille. 2020. “Two-way fixed effects estimators with heterogeneous treatment effects.” American Economic Review, 110(9): 2964–2996.
- [12]Ginsburgh, Victor A., and Jan C. van Ours. 2003. “Expert Opinion and Compensation: Evidence from a Musical Competition.” American Economic Review, 93(1): 289–296.
- [13]Goldsmith-Pinkham, Paul, Peter Hull, and Michal Kolesár. 2024. “Contamination bias in linear regressions.” American Economic Review, 114(12): 4015–4051.
- [15]Heiniger, Sandro, and Hugues Mercier. 2021. “Judging the Judges: Evaluating the Accuracy and National Bias of International Gymnastics Judges.” Journal of Quantitative Analysis in Sports, 17(4): 289–305.DOI
- [16]Krumer, Alex, Felix Otto, and Tim Pawlowski. 2022. “Nationalistic bias among international experts: Evidence from professional ski jumping.” The Scandinavian Journal of Economics, 124(1): 278–300.DOI
- [18]MacKinnon, James G., Morten Øregaard Nielsen, and Matthew D. Webb. 2023. “Fast and Reliable Jackknife and Bootstrap Methods for Cluster-Robust Inference.” Journal of Applied Econometrics, 38(5): 671–694.arxiv.org/abs/2301.04527
- [19]MacKinnon, James G., Morten Øregaard Nielsen, and Matthew D. Webb. 2026. “Jackknife Inference with Two-Way Clustering.” arXiv:2406.08880v4, Version of March 12, 2026.arxiv.org/abs/2406.08880
- [20]Mogstad, Magne, Joseph P. Romano, Azeem M. Shaikh, and Daniel Wilhelm. 2024. “Inference for ranks with applications to mobility across neighbourhoods and academic achievement across countries.” The Review of Economic Studies, 91(1): 476–518.
- [22]Sandberg, Anna. 2018. “Competing Identities: A Field Study of In-group Bias Among Professional Evaluators.” The Economic Journal, 128(613): 2131–2158.DOI
- [23]Zitzewitz, Eric. 2006. “Nationalism in winter sports judging and its lessons for organizational decision making.” Journal of Economics & Management Strategy, 15(1): 67–99.
- [24]Zitzewitz, Eric. 2014. “Does transparency reduce favoritism and corruption? Evidence from the reform of figure skating judging.” Journal of Sports Economics, 15(1): 3–30.






