betaFeedback

WorksMathematics

A General Statistical Framework for Attention and Manipulation Checks

Abstract

Attention and manipulation checks are widely used in survey experiments to assess respondents' attentiveness and engagement with treatment, respectively. Yet these checks are subject to measurement error, which may itself depend on treatment when checks are administered after treatment exposure. Restricting analyses to respondents who pass these checks can therefore introduce substantial bias. We propose a general statistical framework for analyzing survey experiments with pre- or post-treatment attention and manipulation checks while accounting for measurement error. We show that three separate checks suffice to identify the proportion of respondents who would be attentive or successfully manipulated under treatment, provided that the checks are conditionally independent among treated respondents given their true, unobserved attentiveness or manipulation status and pre-treatment covariates. Under additional mild assumptions, this result also identifies the average treatment effect among respondents who would be attentive or successfully manipulated under treatment. Building on these identification results, we propose an estimator that allows flexible covariate modeling and establish its asymptotic normality. Applications to framing and digital media literacy experiments demonstrate how accounting for measurement error yields treatment effect estimates that are substantively different from those obtained using conventional approaches.

Introduction

In survey experiments, random assignment of treatment identifies the intention-to-treat (ITT) effect, but this estimand does not distinguish respondents who pay attention to or engage with the treatment from those who do not. To assess attentiveness and treatment engagement, researchers commonly administer attention or manipulation checks to determine, for example, whether respondents carefully read instructions or understood the intended manipulation (e.g., Berinsky et al., [4]; Kane and Barabas, [20]). Although informative, these checks are imperfect measures of respondents’ underlying attentiveness or engagement. Some inattentive respondents may pass a check by chance, whereas successfully manipulated respondents may fail because they misunderstand the manipulation check questions. In addition, when checks are administered after treatment assignment, treatment itself may also affect measurement error (e.g., Montgomery et al., [27]; Aronow et al., [3]; Blackwell et al., [5]). Therefore, restricting the analysis to respondents who pass these checks can introduce substantial bias.

These challenges raise a fundamental question: how can researchers use imperfect attention and manipulation checks to estimate treatment effects among respondents who would be attentive or successfully manipulated under treatment? We propose a general statistical framework for estimating this quantity, which we call the engaged average treatment effect (eATE), where engagement refers to attentiveness or successful manipulation, depending on the application. Our framework accommodates both pre-treatment engagement, which is unaffected by treatment assignment, and post-treatment engagement, which may depend on assignment. We show that the eATE can be identified using three potentially imperfect checks that are conditionally independent given true, unobserved engagement status, treatment assignment, and pre-treatment covariates.

Building on this identification result, we develop an estimation procedure that accommodates flexible covariate modeling and provides valid uncertainty quantification. Specifically, we use spline approximations to allow both engagement probabilities and the measurement qualities of each check to smoothly vary with respondent characteristics. We then propose a cross-fitted estimator with a valid asymptotic confidence interval that accounts for uncertainty in fitting the measurement model, leveraging the results from the semiparametric statistics literature (e.g., Tsiatis, [31]; Chernozhukov et al., [9]). Lastly, we also develop a statistical test that can be used to diagnose the potential violations of the relevance conditions under the conditional independence assumptions.

We apply the proposed methodology to two published experiments, one with attention checks and the other with post-treatment manipulation checks. In the civil liberties framing experiment of Berinsky et al. [4], our approach yields a larger estimated effect on rally approval among attentive respondents than either the full-sample ITT estimate or the estimate among respondents who pass the observed attention checks. In the digital media literacy experiment of Guess et al. [14], we estimate that the proportion of respondents who would be successfully manipulated exceeds the proportion who pass all three manipulation checks. The resulting eATE estimates are smaller in absolute magnitude than the instrumental variable estimates but larger than the ITT estimates. Together, these applications demonstrate how accounting for measurement error in attention and manipulation checks can materially change the estimated magnitude of treatment effects.

Related literature. This paper contributes to the literature on attention and manipulation checks by developing a new methodological framework that accommodates both pre- and post-treatment checks with measurement error. Although these checks are widely used in survey experiments across the social science, there exist few statistical methods that properly account for measurement error in these checks.

For attention checks, administering them before treatment avoids post-treatment selection bias, but the checks themselves may prime respondents and alter their subsequent responses. In contrast, restricting the analysis to respondents who pass a post-treatment check may introduce selection bias [27, 3]. These concerns have motivated partial identification approaches to post-treatment selection [3], imperfect screening [33, 32], and the trade-off between priming and post-treatment bias when measuring moderators [5]. Unlike these partial identification approaches, we propose a unified methodological framework that provides point identification of the eATE under the key conditional independence assumption regardless of whether checks are done before or after treatment. Our methodology also quantifies estimation uncertainty, providing asymptotically valid confidence intervals for the eATE estimates.

Mathur (2025b) takes a different approach, treating attention checks as tools for identifying respondents whose responses are free of measurement error. The author proposes adjusting for covariates that affect both attentiveness and the outcome when analyzing respondents who pass the checks. This approach, however, assumes that passing the attention checks accurately identifies attentive respondents. In contrast, our methodology accounts for measurement error that is inherent in attention checks.

Accounting for manipulation checks is more challenging because successful manipulation can only be assessed after treatment assignment. Aronow et al. (2019) and Blackwell et al. (2025) apply partial identification approaches to this post-treatment selection problem. Others, including Mathur (2025a), propose the use of instrumental variables to estimate the eATE where randomized treatment assignment serves as an instrument for the observed manipulation status. However, this approach requires the exclusion restriction that treatment assignment affects the outcome only through the observed manipulation status, essentially precluding the possibility of any measurement error in manipulation checks and the existence of alternative causal pathways. In contrast, our approach does not require any individual manipulation check to perfectly measure the underlying manipulation status and allows treatment assignment to affect the outcome directly among respondents who would be manipulated under both treatment conditions.

More broadly, Hazlett et al. (2026) study the eATE in the context of post-treatment selection, which they call the treatment reactive average causal effect (TRACE). The authors propose a partial identification approach that allows for a nonzero average treatment effect among respondents who would not react to the treatment. However, their approach does not explicitly account for measurement error in the observed post-treatment variable. In contrast, our methodology accounts for measurement error in manipulation checks and provides point identification of the eATE, by assuming a zero average treatment effect among respondents who would not be manipulated under either treatment condition.

Finally, the proposed methodology builds on the literature on measurement error and proxy-based identification, which exploits multiple imperfect measurements of a latent variable to identify causal effects under the assumptions of non-differential measurement error. Such approaches have been developed for unobserved confounders [21, 26, 30, 10], unobserved treatments [35], and latent outcomes [15], with a wide range of applications, including unobserved demographic characteristics [25, 6] and text annotations [28, 12]. We extend this approach to the setting of attention and manipulation checks in randomized experiments, where respondents’ underlying attentiveness or engagement is latent and each observed check may contain measurement error.

Organization of the paper. The rest of this paper proceeds as follows. Section 2 introduces two empirical applications. Section 3 presents the identification results. Section 4 then develops estimation and inference procedures. § 5 discusses a diagnostics test regarding the key identification assumption. § 6 then confirms the performance on the simulated data, and § 7 applies the proposed methodology to the motivating examples introduced earlier. Finally, § 8 concludes by discussing directions for future research.

Motivating Empirical Applications

This section introduces two motivating applications: one uses attention checks to assess respondents’ attentiveness, and the other uses manipulation checks to evaluate their engagement with the treatment stimulus. Although the checks are administered both before and after treatment in the first application and only after treatment in the second, our proposed methodology accommodates both settings, provided that at least three well-designed checks are available (see § 3). We revisit both applications in § 7, where we analyze their data using the proposed methodology.

Civil Liberties Framing Experiment with Attention Checks

A central question in the study of public opinion is whether people’s preferences depend on how political issues are presented. In a classic study, Nelson et al. [29] examined this question through a survey experiment on civil liberties. Respondents read an article about a proposed Ku Klux Klan (KKK) rally that presented one of two frames. The free speech frame emphasized the KKK’s right to express its views and the public’s right to hear them, whereas the public safety frame emphasized the potential for violence and threats to public order. The authors found that respondents exposed to the free speech frame were more willing to allow the rally than those exposed to the public safety frame. This finding suggests that news framing can shape political tolerance by emphasizing different considerations.

Although the original study found a framing effect, respondent inattention may attenuate the observed effect. To explore this possibility, Berinsky et al. [4] replicated the civil liberties framing experiment using multiple attention checks. Figure 1 illustrates the experimental design.

Experimental design and attention checks in the civil liberties framing experiment

Figure 1. Experimental design and attention checks in the civil liberties framing experiment of Berinsky et al. [4]. Respondents read a news article emphasizing either public safety or free speech. They then report whether the university should allow the KKK rally. The authors measured the attentiveness using attention checks.

The authors administered four attention checks throughout the survey, randomizing their order for each respondent. The checks asked about respondents’ favorite color, current feelings, website preferences, and political interest. Rather than answering these questions directly, respondents were instructed to select specific options to demonstrate that they had read the instructions carefully. For example, the favorite-color question instructed respondents to select both red and green, regardless of their actual preferences. The first screener was administered before the framing experiment, whereas the remaining three were administered afterwards.

This example highlights an important limitation of attention checks. As Berinsky et al. [4] acknowledge, these checks are imperfect measures of respondents’ underlying attentiveness. Inattentive respondents may pass by chance, whereas attentive respondents may fail because they misread the instructions or make a response error. Indeed, Table 1 shows only modest correlations and varying pass rates across respondents’ performance on individual checks. Therefore, respondents who pass the checks need not be representative of truly attentive respondents. Without additional restrictions on the measurement error process, the resulting bias can be large and operate in either direction.

(a) Pearson correlations
WebInterestColorFeeling
Web10.470.410.41
Interest10.460.42
Color10.44
Feeling1
(b) Pass rates
ScreenerPass rate
Web0.69
Interest0.73
Color0.81
Feeling0.81

Table 1. Pairwise Pearson correlations and marginal pass rates for the four attention checks used in the experiment of Berinsky et al. [4] (based on the civil liberties framing experiment, Wave 2 of Study 1). Web, Interest, Color, and Feeling refer to attention checks that ask about respondents’ website preferences, political interest, favorite color, and current feelings, respectively. Each attention check is coded as one if the respondent correctly follows the instructions and zero otherwise.

Although Berinsky et al. [4] recommend using multiple checks, aggregating multiple imperfect measures does not, by itself, resolve the measurement error problem. In their analysis, the authors count the number of checks each respondent passes and report treatment effects separately for each count. They find that the estimated effect is attenuated for those who passed 0 or 1 check when compared to those who passed all checks. However, it is unclear whether this difference reflects a true difference in attentiveness or other sources of heterogeneity, such as differences in respondents’ unobserved characteristics that are correlated with both their attentiveness and their treatment effect.

This study calls for a statistical framework that accounts for measurement error problems of attention checks while allowing for heterogeneity in treatment effects across respondents with different levels of attentiveness.

Digital Media Literacy Experiment with Manipulation Checks

The spread of misinformation on social media has raised growing concerns about citizens’ ability to evaluate political information ([1, 22]). One potential solution is to improve individuals’ digital media literacy. To investigate the effectiveness of this approach, Guess et al. ((2020)) examine whether a brief digital media literacy intervention improves people’s ability to distinguish mainstream news from false news. In this experiment, respondents are randomly assigned to the treatment condition that asks them to read ten tips from Facebook’s campaign for identifying false news or to the control condition that provides no tips. The tips encourage readers to scrutinize web addresses and news sources, examine supporting evidence, and compare reports across outlets. Respondents subsequently rate the accuracy of news headlines on a four-point scale. The outcome of interest is the difference between respondents’ perceived accuracy ratings for mainstream and false news headlines.

A fundamental challenge in this study is that treatment assignment does not necessarily guarantee successful intervention. The effectiveness of the intervention depends on whether respondents pay attention to the tips and understand the advice. To assess whether respondents successfully receive the intervention, Guess et al. [14] administer three manipulation checks in the form of comprehension questions that cover three aspects of the ten tips after the intervention (see Figure 2 for the illustration of the experimental design). The authors define successful manipulation as correctly answering all three questions on the first attempt. However, as shown in Table 2, these checks are only moderately correlated. Moreover, even though the pass rate for each check is relatively high, only 66% of treated respondents passed all three checks.

Experimental design and manipulation checks in the digital media literacy experiment

Figure 2. Experimental design and manipulation checks in the digital media literacy experiment of Guess et al. [14]. Respondents receive the digital media literacy intervention and evaluate the accuracy of mainstream and false news headlines. True manipulation is modeled as a latent post-treatment variable that affects respondents’ outcomes and their performance on the observed manipulation checks. The direct arrow from treatment to outcome allows treatment effects beyond those operating through manipulation status.

URLsMisspellingsSources
URLs10.370.31
Misspellings10.29
Sources1
CheckPass rate
URLs0.824
Misspellings0.824
Sources0.821
All three0.656

Table 2. Pairwise Pearson correlations and pass rates for the three manipulation checks used in the digital media literacy experiment of Guess et al. [14]. URLs, Misspellings, and Sources refer to checks assessing respondents’ understanding of misleading web addresses, spelling errors, and corroboration by multiple trusted sources, respectively. Each check is coded as one if the respondent correctly answers the question on the first attempt and zero otherwise. The last row of panel (b) reports the proportion of respondents who passed all three checks.

In addition to potential measurement error in the observed manipulation checks, this example highlights additional challenges of using post-treatment checks. Since the checks are conducted after treatment assignment, subgroup analyses restricted to respondents who pass the checks may suffer from post-treatment selection bias (Montgomery et al. [27]; Aronow et al. [3]). As a result, a common approach in this context is to use instrumental variables (e.g., Mathur [23]). However, the validity of the instrumental variable approach relies on the exclusion restriction, which may be difficult to justify in many applications, including this study. For example, respondents who fail to correctly answer certain comprehension questions may nevertheless understand and apply some of the tips, improving their ability to distinguish mainstream news from false news. Therefore, treatment assignment may affect the outcome even among respondents classified as failing the manipulation checks, violating the exclusion restriction.

This study motivates the development of a statistical framework that accounts for imperfect measurement of manipulation status while avoiding the full exclusion restriction required by the standard instrumental variable approach.

The Proposed Framework

In this section, we introduce the proposed methodology for estimating the engaged average treatment effect (eATE) in survey experiments with imperfect attention or manipulation checks. We begin by defining the eATE as the causal quantity of interest and then establish its identification under the key conditional independence assumption. We then briefly discuss how the proposed methodology relaxes the exclusion restriction assumption required by the standard instrumental variable approach.

The engaged Average Treatment Effect (eATE)

Consider a simple random sample of nn respondents from a population of interest. For each respondent i=1,…,ni = 1, \ldots, n, let Ti∈T={0,1}T_i \in\mathcal{T} = \{0,1\} denote the treatment assignment, where Ti=1T_i = 1 indicates treatment and Ti=0T_i = 0 indicates the control condition. We may also observe the pre-treatment covariates, which we denote XiX_i when available. Let Yi(t)Y_i(t) denote the potential outcome under treatment assignment t∈Tt \in\mathcal{T}. We use Yi=Yi(Ti)Y_i = Y_i(T_i) to denote the observed outcome.

Our causal quantity of interest is the average treatment effect among respondents who are attentive or successfully manipulated, which we call the engaged average treatment effect (eATE). Because our framework encompasses both attention and manipulation checks, we use the term engagement to refer to attention or successful manipulation, depending on the application.

Formally, let Wi(t)∈{0,1}W_i(t) \in\{0,1\} denote the potential engagement status under treatment assignment tt, where Wi(t)=1W_i(t) = 1 indicates that respondent ii would be engaged under this assignment. We denote the realized engagement status by Wi=Wi(Ti)W_i = W_i(T_i). This notation accommodates both pre-treatment attention and post-treatment manipulation. When engagement represents pre-treatment attention, treatment assignment does not affect engagement status so that Wi(1)=Wi(0)=WiW_i(1) = W_i(0) = W_i for every respondent. In contrast, when engagement represents post-treatment manipulation, engagement status may depend on treatment assignment, allowing Wi(1)≠Wi(0)W_i(1) \ne W_i(0) for some respondents. We begin by making two standard assumptions about survey experiments. First, we assume consistency, requiring that each respondent’s potential outcomes and engagement status depend only on their own treatment assignment. This assumption rules out spillover effects between respondents.

Assumption 1 (Consistency). The observed outcome and realized engagement status satisfy

Yi=Yi(Ti)andWi=Wi(Ti),for all i=1,…,n.Y_i = Y_i(T_i) \quad\text{and} \quad W_i = W_i(T_i), \quad\text{for all } i = 1,\ldots,n.

Second, we assume that treatment is randomly assigned, independently of all potential quantities conditional on pre-treatment covariates. This accommodates a variety of settings, including complete and stratified randomization.

Assumption 2 (Randomization of Treatment Assignment). Treatment assignment satisfies

Ti⊥ ⁣ ⁣ ⁣⊥{Yi(1),Yi(0),Wi(1),Wi(0)}∣Xi,T_i \perp\!\!\!\perp\{Y_i(1),Y_i(0),W_i(1),W_i(0)\} \mid X_i,

with the known assignment probability πt(x):=Pr⁡(Ti=t∣Xi=x)>0\pi_t(x) := \Pr(T_i = t \mid X_i = x) > 0 for all xx and t∈Tt \in\mathcal{T}.

Under Assumptions 1 and 2, the average treatment effect (ATE) is identified by the mean difference in outcome between the treatment and control groups with necessary covariate adjustment. Our primary quantity of interest, however, is the average treatment effect among respondents who would be engaged under treatment, or the engaged average treatment effect (eATE), which we define as:

Ψ:=E[Yi(1)−Yi(0)∣Wi(1)=1].(1)\Psi:= \mathbb{E}[Y_i(1) - Y_i(0) \mid W_i(1) = 1]. \tag*{(1)}

When engagement represents pre-treatment attention, Ψ\Psi reduces to the average treatment effect among attentive respondents, i.e., Ψ=E[Yi(1)−Yi(0)∣Wi=1]\Psi= \mathbb{E}[Y_i(1) - Y_i(0) \mid W_i = 1]. In this case, the target subgroup is the same under both treatment conditions.

When engagement represents post-treatment manipulation, Ψ\Psi instead represents the average treatment effect among respondents who would be successfully manipulated if assigned to treatment, regardless of their engagement status under control. In the literature on manipulation checks, some researchers have studied Ψ\Psi using a partial identification approach [16]. However, Ψ\Psi is different from another popular causal quantity of interest in the literature, which is the average effect among “always-manipulated” respondents [3, 32], defined as,

E[Yi(1)−Yi(0)∣Wi(1)=Wi(0)=1].\mathbb{E}[Y_i(1) - Y_i(0) \mid W_i(1) = W_i(0) = 1].

This quantity targets respondents who would be manipulated regardless of treatment assignment, but this subgroup is often small and may not even exist in some experiments where the control condition is no manipulation (rather than comparing two different manipulations). In addition, membership in this subgroup is never directly observed [13]. As a consequence, the identification of this quantity requires a stringent assumption, such as principal ignorability [11], or necessitates a partial identification approach (e.g., [3, 32].

Identification when Engagement Status is Observed

For the sake of exposition, we first consider the case where the (true) engagement status WiW_i is observed without measurement error. Under Assumptions 1 and 2, the ATE is identified by the mean difference in outcome between the treatment and control groups with covariate adjustment:

τ:=E[Yi(1)−Yi(0)]=E[E[Yi∣Ti=1,Xi]−E[Yi∣Ti=0,Xi]].\tau:= \mathbb{E}[Y_i(1) - Y_i(0)] = \mathbb{E}\left[\mathbb{E}[Y_i \mid T_i = 1, X_i] - \mathbb{E}[Y_i \mid T_i = 0, X_i]\right].

We show that, under two additional assumptions, this ATE can be rescaled to identify the eATE. First, we assume that treatment does not, on average, affect respondents who would not be engaged under either treatment condition. For pre-treatment attention, this requires inattentive respondents to be unaffected by treatment on average. For post-treatment manipulation, the same restriction applies to respondents who would not be successfully manipulated under either treatment condition. We emphasize that this assumption needs to hold only on average and does not require the treatment effect to be zero for every respondent in this subgroup.

Assumption 3 (Zero average treatment effect without engagement). Treatment has no average effect among respondents who would not be engaged under either assignment:

E[Yi(1)−Yi(0)∣Wi(1)=Wi(0)=0]=0.\mathbb{E}[Y_i(1) - Y_i(0) \mid W_i(1) = W_i(0) = 0] = 0.

Second, we assume that treatment cannot reduce engagement for any respondent, thereby ruling out respondents who would be engaged under the control condition but not under the treatment. This monotonicity condition is naturally satisfied in many survey experiments. For pre-treatment attention checks, the assumption holds trivially because Wi(1)=Wi(0)W_i(1) = W_i(0). For post-treatment manipulation checks, the assumption is satisfied in one-sided treatment designs where manipulation is only active under treatment, ensuring that control respondents are never engaged, i.e., Wi(0)=0W_i(0) = 0 for every respondent. The assumption is also applicable in two-sided treatment designs where manipulation is active under both treatment and control, provided that the treatment condition is designed to be more engaging for every respondent than the control condition.

Assumption 4 (Monotonicity). For every respondent,

Wi(1)≥Wi(0).(2)W_i(1) \ge W_i(0). \tag*{(2)}

Under Assumption 4, respondents with Wi(1)=0W_i(1) = 0 are precisely those who would not be engaged under either treatment condition, i.e., Wi(1)=Wi(0)=0W_i(1) = W_i(0) = 0. Assumption 3 therefore implies that treatment has no average effect outside the target subgroup. Applying the law of iterated expectations gives

E[Yi(1)−Yi(0)]=E[Yi(1)−Yi(0)∣Wi(1)=1]Pr⁡(Wi(1)=1)+E[Yi(1)−Yi(0)∣Wi(1)=0]Pr⁡(Wi(1)=0)=ΨPr⁡(Wi(1)=1).\begin{aligned} \mathbb{E}[Y_i(1) - Y_i(0)] ={}& \mathbb{E}[Y_i(1) - Y_i(0) \mid W_i(1) = 1]\Pr(W_i(1) = 1) \\ &+ \mathbb{E}[Y_i(1) - Y_i(0) \mid W_i(1) = 0]\Pr(W_i(1) = 0) \\ ={}& \Psi\Pr(W_i(1) = 1). \end{aligned}

As consistency and randomization imply Pr⁡(Wi(1)=1)=E[Pr⁡(Wi=1∣Ti=1,Xi)]\Pr(W_i(1) = 1) = \mathbb{E}[\Pr(W_i = 1 \mid T_i = 1, X_i)], we can identify the eATE as,

Ψ=E[E[Yi∣Ti=1,Xi]−E[Yi∣Ti=0,Xi]]E[Pr⁡(Wi=1∣Ti=1,Xi)],(3)\Psi= \frac{\mathbb{E}[\mathbb{E}[Y_i \mid T_i = 1, X_i] - \mathbb{E}[Y_i \mid T_i = 0, X_i]]} {\mathbb{E}[\Pr(W_i = 1 \mid T_i = 1, X_i)]}, \tag*{(3)}

provided that some treated respondents are engaged, i.e., Pr⁡(Wi=1∣Ti=1,Xi=x)>0\Pr(W_i = 1 \mid T_i = 1, X_i = x) > 0 (this assumption is formally stated below). We note that in this setting, the ATE never exceeds the eATE in magnitude since the denominator is bounded between 0 and 1. This happens because we assume no effect without engagement (Assumption 3).

Recovering Latent Engagement Status from Multiple Checks

The preceding identification result was obtained under the assumption that the true engagement status is directly observed. However, as discussed in § 2, this assumption is too stringent in practice because attention and manipulation checks are frequently subject to measurement error. Fortunately, we show that it is possible to recover the proportion of truly engaged respondents from multiple noisy attention or manipulation checks. The use of multiple checks is a common setup in applied research and is recommended as a best practice [4]. We require three checks in order to identify the eATE.

Specifically, for each respondent ii, let W~ji\widetilde{W}_{ji} denote the jjth observed check, where j∈{1,2,3}j \in\{1,2,3\}. These checks may be binary, ordinal, or continuous. Our goal is to recover the proportion of respondents who would be engaged under treatment, Pr⁡(Wi(1)=1)\Pr(W_i(1)=1), which appears in the denominator of Equation (3).

We impose two assumptions regarding the quality of checks. First, we assume that, among the treated respondents, the measurement errors of the checks are mutually independent given true engagement status and pre-treatment characteristics. This assumption is formalized as follows:

References

  1. [1]Allcott, H. and Gentzkow, M. (2017). Social media and fake news in the 2016 election. Journal of economic perspectives, 31(2):211–236.
  2. [2]Angrist, J. D. and Imbens, G. W. (1995). Two-stage least squares estimation of average causal effects in models with variable treatment intensity. Journal of the American Statistical Association, 90(430):431–442.DOI
  3. [3]Aronow, P. M., Baron, J., and Pinson, L. (2019). A note on dropping experimental subjects who fail a manipulation check. Political Analysis, 27(4):572–589.
  4. [4]Berinsky, A. J., Margolis, M. F., and Sances, M. W. (2014). Separating the shirkers from the workers: making sure respondents pay attention on self-administered surveys. American Journal of Political Science, 58(3):739–753.DOI
  5. [5]Blackwell, M., Brown, J. R., Hill, S., Imai, K., and Yamamoto, T. (2025). Priming bias versus post-treatment bias in experimental designs. Political Analysis, 33(4):361–377.DOI
  6. [6]Chasalow, K., Dasanaike, N., and Imai, K. (2026). Probabilistic race and ethnicity prediction using group-specific name lists. arXiv preprint arXiv:2610.06273.
  7. [7]Chen, X. and Pouzo, D. (2009). Efficient estimation of semiparametric conditional moment models with possibly nonsmooth residuals. Journal of Econometrics, 152(1):46–60.
  8. [8]Chen, X. and Pouzo, D. (2012). Estimation of nonparametric conditional moment models with possibly nonsmooth generalized residuals. Econometrica, 80(1):277–321.
  9. [9]Chernozhukov, V., Chetverikov, D., Demirer, M., Duflo, E., Hansen, C., Newey, W., and Robins, J. (2018). Double/debiased machine learning for treatment and structural parameters.
  10. [10]Cui, Y., Pu, H., Shi, X., Miao, W., and Tchetgen Tchetgen, E. (2024). Semiparametric proximal causal inference. Journal of the American Statistical Association, 119(546):1348–1359.
  11. [11]Ding, P. and Lu, J. (2017). Principal stratification analysis using principal scores. Journal of the Royal Statistical Society, Series B (Statistical Methodology), 79(3):757–777.arxiv.org/abs/1602.01196
  12. [12]Egami, N. and Shin, S. (2026). Debiased inference for ai-generated data without gold-standard labels: Identification via multiple imperfect measurements. arXiv preprint arXiv:2608.18294.arxiv.org/abs/2608.18294
  13. [13]Frangakis, C. E. and Rubin, D. B. (2002). Principal stratification in causal inference. Biometrics, 58(1):21–29.DOI
  14. [14]Guess, A. M., Lerner, M., Lyons, B., Montgomery, J. M., Nyhan, B., Reifler, J., and Sircar, N. (2020). A digital media literacy intervention increases discernment between mainstream and false news in the united states and india. Proceedings of the National Academy of Sciences, 117(27):15536–15545.
  15. [15]Guo, H., Ghassami, A., Shpitser, I., and Ogburn, E. L. (2026). Proximal causal inference for hidden outcomes. arXiv preprint arXiv:2605.09849.arxiv.org/abs/2605.09849
  16. [16]Hazlett, C., McMurry, N., and Shinkre, T. (2026). Post-treatment problems: What can we say about the effect of a treatment among sub-groups who (would) respond in some way? Political Analysis, pages 1–22.arxiv.org/abs/2505.06754
  17. [17]Hu, Y. (2008). Identification and estimation of nonlinear models with misclassification error using instrumental variables: A general solution. Journal of Econometrics, 144(1):27–61.DOI
  18. [18]Jenke, L., Bansak, K., Hainmueller, J., and Hangartner, D. (2021). Using eye-tracking to understand decision-making in conjoint experiments. Political Analysis, 29(1):75–101.DOI
  19. [19]Jenke, L. and Sullivan, N. (2025). Attention and political choice: A foundation for eye tracking in political science. Political Analysis, 33(4):298–314.
  20. [20]Kane, J. V. and Barabas, J. (2019). No harm in checking: Using factual manipulation checks to assess attentiveness in experiments. American Journal of Political Science, 63(1):234–249.DOI
  21. [21]Kuroki, M. and Pearl, J. (2014). Measurement bias and effect restoration in causal inference. Biometrika, pages 423–437.
  22. [22]Lazer, D. M., Baum, M. A., Benkler, Y., Berinsky, A. J., Greenhill, K. M., Menczer, F., Metzger, M. J., Nyhan, B., Pennycook, G., Rothschild, D., et al. (2018). The science of fake news. Science, 359(6380):1094–1096.DOI
  23. [23]Mathur, M. B. (2025a). On the statistical analysis of experiments with manipulation checks. Advances in Methods and Practices in Psychological Science, 8(1):25152459241297537.DOI
  24. [25]McCartan, C., Fisher, R., Goldin, J., Ho, D. E., and Imai, K. (2025). Estimating racial disparities when race is not observed. Journal of the American Statistical Association, 120(552):2140–2153.
  25. [26]Miao, W., Geng, Z., and Tchetgen Tchetgen, E. J. (2018). Identifying causal effects with proxy variables of an unmeasured confounder. Biometrika, 105(4):987–993.DOI
  26. [27]Montgomery, J. M., Nyhan, B., and Torres, M. (2018). How conditioning on posttreatment variables can ruin your experiment and what to do about it. American Journal of Political Science, 62(3):760–775.DOI
  27. [28]Nakamura, K. (2025). Surrogate representation inference for text and image annotations. arXiv preprint arXiv:2509.12416.arxiv.org/abs/2509.12416
  28. [29]Nelson, T. E., Clawson, R. A., and Oxley, Z. M. (1997). Media framing of a civil liberties conflict and its effect on tolerance. American Political Science Review, 91(3):567–583.DOI
  29. [30]Tchetgen Tchetgen, E. J., Ying, A., Cui, Y., Shi, X., and Miao, W. (2024). An introduction to proximal causal inference. Statistical Science, 39(3):375–390.DOI
  30. [31]Tsiatis, A. A. (2006). Semiparametric theory and missing data. Springer.
  31. [32]Tyler, M. (2025). Bounding causal effects in survey experiments with noncompliance or inattention. Working Paper.
  32. [33]Tyler, M., Grimmer, J., and Westwood, S. (2024). A statistical framework to engage the problem of disengaged survey respondents: Measuring public support for partisan violence. Available at SSRN 4894008.DOI
  33. [34]Van der Laan, M. J., Rose, S., et al. (2011). Targeted learning: causal inference for observational and experimental data, volume 4. Springer.
  34. [35]Zhou, Y. and Tchetgen Tchetgen, E. (2024). Causal inference with a hidden treatment. arXiv preprint arXiv:2405.09080.arxiv.org/abs/2405.09080

Paper details

vlnc:W_2zwp6eut
Version
v1 · latest
Published
Fresh — added to the Hub within the last 30 days
Added
License
CC BY 4.0
Usage

views · 10

downloads · 0

A view counts once per browser per day, a download each time the PDF is requested.

  • Mathematics

Not recorded for this paper

View statement
Looking for related papers…
Contents