WorksComputer Science
Pretty Linear Liars: Unregularized Probes Favor Intervention-Unfaithful Features
Abstract
Linear probing is a common technique in mechanistic interpretability despite the fact that the decodability of a given feature does not necessarily imply the network uses that feature. Intervention faithfulness, not merely decodability, is the appropriate criterion for whether a feature serves a defined active role in the model. Meanwhile, probe regularization has been used for feature discovery, but the impact of regularization on feature causality remains unclear. We study probe regularization systematically, starting with unregularized ordinary least squares (OLS) regression and considering increasing amounts of regularization via ridge regression. We show theoretically that OLS probes amplify low-variance directions in activation space that have spurious correlations with the target feature, whereas regularization reduces influence from these directions. Empirically, we find in a toy transformer and Llama-2-7B that intervention faithfulness increases up to a point, and then decreases again, and that the optimal regularization strength leads to features bearing striking similarity (in both direction and variance) to those learned by optimizing for intervention outcomes directly. Together, these results provide mechanistic justification for regularizing regression probes.
Introduction
Linear probing is a standard interpretability tool in which a linear map is fit from a network’s internal activations to a quantity of interest. While decoding accuracy is sometimes taken as evidence (but not proof) the network represents the variable in question, prior work has shown that decoding accuracy is not enough: a variable can be decodable without the probe’s direction being actually used by the network. Therefore, causal interventions, not decodability, are the appropriate test of whether the network uses a feature [4, 2, 10]. Whether the probe’s own fitting procedure, and regularization in particular, affects the outcome of that test has received little attention. Some probing studies regularize explicitly, as when Gurnee & Tegmark [6] fit ridge regression probes with the penalty selected by held-out decodability, or implicitly, as when Heinzerling & Inui [8] use partial least squares, whose components are selected by covariance with the target. Neither of these papers explains what breaks without regularization beyond stability and generalization concerns. The closest precedent is neuroimaging, where Haufе et al. (2014) showed that a decoder can weight a channel heavily though it carries no signal. In that setting, however, the weights cannot be tested by intervention. Other work uses unregularized probes and leaves causal tests of the recovered feature vectors out of scope (for example, Shai et al., 2024).
We evaluate the question of probe faithfulness by comparing three ways of extracting a feature vector, i.e. a direction in activation space, for the same target. OLS probes and ridge regression probes fit the direction by decodability, differing only in the ridge penalty . Distributed Alignment Search (DAS) fits the direction by gradient descent on intervention outcomes directly [5], so it serves as a causal reference point, a direction chosen for intervention effect rather than for decodability. Comparing where these three land, on the same activations and the same target, isolates the choice of fitting procedure as the variable. We also establish a theoretical account of why regularization helps. Sampling noise gives even a direction that the network does not use a small nonzero covariance with the target. OLS is known to amplify noise most strongly along directions where values (i.e. activations) vary least [9]. Our theoretical contribution is to show why this can lead to high decodability without intervention faithfulness. Ridge regression mitigates this problem by suppressing the amplification of noise along low-variance directions (§ 3). Beyond this theoretical account, we present empirical results on a toy transformer [15] and Llama-2-7B [16]. We find that OLS probes decode the target but are indeed intervention-unfaithful (on the toy transformer, even with exhaustive data). Intervention-selected ridge regression probes are largely faithful and point in high-variance directions. The DAS directions align closely with the ridge regression probe directions. This leads us to suggest that, for decodability-based regression probing, the regularization coefficient be chosen by a sweep that maximizes intervention faithfulness.
Setup
We first define regression probes and intervention faithfulness, then describe our two testbeds and the interventions we use to test each probe’s direction on them.
Probes, directions, and intervention faithfulness
Definition 2.1 (Regression probe). Given activations at a fixed site of a neural network and a continuous target variable , a regression probe is a linear map that produces a prediction , where is the probe weight matrix and is a bias vector. Given activation–target pairs with and , the OLS probe fits and by minimizing
where is the Frobenius norm, and the ridge regression probe adds an penalty on (but not ):
for regularization strength . The optimal bias is always (the sample means), so fitting with a bias is equivalent to mean-centering and before fitting . We treat activations and targets as centered from here on. We say a target variable is linearly decodable at a site if a probe achieves low mean squared error (MSE), and refer to the probe’s MSE as the probe loss.
Directions, variance, mass, and dead weight. The variance along a direction (a unit vector in activation space) is the variance of across the dataset. For , a probe’s direction is its normalized weight vector, oriented so the readout increases with the target, and two directions are compared by the angle between them. For , the methods cannot be compared direction by direction, because DAS (§ 2.4) finds only a subspace, with no preferred basis within it. We therefore compare the subspaces spanned by each method’s directions, by their principal angles1 ([1]), reporting the larger angle. On the HMM testbed of § 2.2, the subspace spanned by the probe’s weight vectors is a plane, since the three belief coordinates sum to one. A probe’s mass on principal component of the activations is its share of squared weight there, , where is the probe’s weight along that component. We define a direction’s causal operativity as the mean absolute change in the network’s output when the direction’s coordinate is interchanged from a source input into a base input, averaged over many such pairs (see § 2.4 for specifics). We call a direction causally inert if its causal operativity is near zero, and dead weight for a probe if the probe places large weight on it even though it is causally inert. Whether these directions’ covariance with the target is sampling noise and reflects information the network encodes along them is a question we take up in § 3 and § 4.
Definition 2.2 (Intervention faithfulness). Let be a known ground-truth function specifying the correct network output for any value of the target . Given a probe direction (or, for , the
subspace spanned by the probe’s weight vectors) and an intervention protocol that shifts the represented value of by (§ 2.4), the probe is intervention-faithful to the extent that the post-intervention output matches : the output shifts as the ground truth predicts. We quantify faithfulness with the intervention loss, , where is the network’s post-intervention output and the expectation is over intervention targets and data samples.
Testbed 1: the Mess3 HMM
To test intervention faithfulness, we need a setting where the correct output after an intervention is known exactly. The Mess3 HMM (Shai et al., [15]) is an ideal testbed for this because the ground-truth latent variable (the belief state) and the correct output for any belief are both exactly computable. It defines a 3-state hidden Markov model with transition matrix and emission distribution , parametrized by a mixing parameter and emission concentration . The Bayes-optimal predictor for must maintain a belief state , the posterior over hidden states given observations so far, which is the minimal sufficient statistic for next-token prediction:
With 3 hidden states, the belief lives on a 2-simplex. Shai et al. [15] trained a 4-layer transformer (width 64) on this HMM and showed linear probes recover the belief simplex with near-perfect decodability, but did not test the recovered directions causally. We use their pre-trained network, enumerate all sequences of length 1–8, compute each prefix’s exact belief and probability, and cache the residual-stream activation at the final LayerNorm on the last token. Probes are fit to the 3-dimensional belief target by weighted least squares, each sequence weighted by its probability under the HMM.
Testbed 2: Llama-2-7B on birth year
We probe Llama-2-7B for the birth year of named people, using the Wikidata data of Heinzerling & Inui [8]. Gurnee & Tegmark [6] showed such numeric attributes are linearly decodable from residual-stream activations, and Heinzerling & Inui [8] that they are linearly causally operative. We anchor on this setting precisely because a causally operative direction is known to exist, so a probe’s failure to steer implicates the probe, not the absence of a usable direction. Our setup differs in that we fit on the person’s true birth year (not the model’s expressed value), prompt with the completion “{name} was born in 19”, and read out from the digit logits rather than generated text. The target is shifted and scaled to have mean zero and variance one across the dataset. The probed activation is the 4096-dimensional residual-stream vector at the last token of the name, at layer 8 (selected by a layer sweep of intervention effect, Appendix § 8). We use prompts. Restricting to 1900–1999 makes the readout a single decade digit. We summarize the output as an expected decade, for , from the renormalized next-token distribution over the ten digit tokens.
Intervention protocols
HMM: probe-mediated steering. Given a probe and a desired belief shift , we perturb activations by , where is the pseudoinverse; these edits span the probe’s plane. Interventions move beliefs within the simplex, in 20 smooth steps per target. Intervention loss compares the steered next-token distribution against the belief-implied next-token distribution, averaged over a uniform 496-point grid of target beliefs from three start states, one near each simplex corner.
LLM: natural-magnitude interchange. The birth-year target is scalar (), so a probe here is a single direction. Building on Heinzerling & Inui [8], we test a direction by transplanting it from one person to another, so the source’s known birth year supplies the ground-truth target. Take a base prompt (say, someone born in the 1920s), a source prompt (someone born in the 1980s), and a candidate unit direction . We input the base prompt into the network, but interchange the base activation’s component along with the value that same component takes for the source:
If is intervention-faithful, i.e. the direction the model actually uses for birth year, its predicted decade should move off the base’s and toward the source’s. Intervention loss on the LLM is the MSE between the post-interchange expected decade and the source’s decade.
Causal operativity. To measure a direction’s causal operativity, we apply the interchange of Equation (4) and record the resulting output change, as the L1 distance between next-token distributions on the HMM and as the absolute change in expected decade on Llama-2-7B.
DAS. Distributed Alignment Search (Geiger et al. [5]) learns directions by gradient descent on intervention outcomes, and serves as the causal reference point against which probe-derived directions are compared. On Llama-2-7B it learns a single unit direction, randomly initialized, trained to minimize the MSE between the model’s differentiable expected decade after the interchange and the source’s decade. On the HMM it learns an orthogonal rotation of activation space and interchanges two learned rotated coordinates, matching the two degrees of freedom of the belief simplex, minimizing the MSE against the Bayes-optimal next-token distribution for the source belief.
Theory: Why OLS Probes Find Intervention-Unfaithful Directions
To explain why OLS probes find intervention-unfaithful directions, we work in the principal-component (PC) basis of the centered activation matrix and ask what weight a regression probe places on each principal direction. Let be the principal directions and write for the coordinate of sample ’s activation along , so that each activation is . Fix one principal direction and drop the superscript: is that direction’s coordinate on sample , and is the centered target; for the analysis applies to each target coordinate separately, with the standard deviation of the coordinate in question. Write for the sample variance along and for the sample covariance. On Llama-2-7B the prompts are independent draws from a distribution over name-year prompts, and population quantities are expectations under . On the HMM, our dataset contains every sequence of length 1 to 8, each weighted by its probability. Nothing is sampled, so sample and population quantities coincide for this population.
The per-direction weight
In the PC basis, activation coordinates are uncorrelated across the dataset ( for ), and all variables are centered (Definition 2.1), so no bias term is needed and the squared error has no cross terms between weights: the full objective,
decouples into independent one-dimensional problems, one per direction, and it suffices to analyze one at a time. Writing for the weight on the fixed direction , the one-dimensional objective is
the sum of squared prediction errors plus the ridge penalty, equal to the -dependent part of Equation (5) up to a constant.
Proposition 3.1 (Per-direction ridge regression weight). The minimizer of Equation (6) is
with recovering the OLS probe.
The same formula holds for every principal direction: a direction’s weight depends only on the covariance with the target in the numerator and its variance in the denominator.
Target-uncorrelated directions and the OLS blow-up
Definition 3.2 (Target-uncorrelated direction). A direction is target-uncorrelated if its population covariance with the target is zero.
Target-uncorrelatedness does not make the sample covariance zero. On sampled data the products are independent zero-mean terms, so the sample covariance, an average of of them, has typical magnitude equal to its standard error,
Corollary 3.3 (OLS blow-up, ridge regression suppression). For a target-uncorrelated direction on sampled data, the typical magnitude of the OLS probe weight is
growing without bound as the direction’s variance shrinks. Ridge regression changes only the divisor, which cannot fall below : the weight is at most , which vanishes as the direction gets quieter, instead of exploding.
In a high-dimensional residual stream, most principal components presumably do not causally encode any given target. The argument above shows that any principal component whose covariance with the target is not small relative to its own variance gets a large weight in unregularized regression. On sampled data, we can even quantify the covariance such a component acquires from sampling noise alone (Equation (9)). On exhaustive data there is no sampling noise to quantify, but any covariance that a component nevertheless carries for any other reason would be inflated the same way. We call a direction spurious if it is intervention-unfaithful yet carries nonzero sample covariance with the target, whatever that covariance’s origin. Target-uncorrelated directions on sampled data are the special case where the origin is sampling noise alone, so the covariance’s scale is predictable (Equation (8)). Thus, if low-variance spurious directions indeed exist in the residual stream, we expect them to dominate an OLS probe’s direction. In-sample decodability cannot reveal this failure. Held-out decodability need not either, since it is not guaranteed to be poor for OLS, and since decodability does not necessarily go hand in hand with intervention faithfulness (which is not always true, § 4.1).
Note that the described amplification is classical, the textbook instability of OLS along low-variance directions ([9]). But crucially, the classical concern is held-out prediction, not causation. Held-out decodability (in settings where the probe is not already trained on exhaustive data) only penalizes covariance that fails to replicate, and covariance can persist across samples without the network ever using the associated directions (§ 4.1).
Remark 3.4 (Large does not maximize variance). One might worry that ridge regression simply favors whatever varies most. As , Equation (7) gives : ridge regression converges to the direction of covariance with the target, not the direction of maximum variance. A loud direction unrelated to the target gets zero weight.
Scope, and testing for target-uncorrelatedness
We stay agnostic about the source of the small covariance that quiet directions carry on the exhaustive HMM data, and measure it directly rather than derive its scale. On sampled data, target-uncorrelatedness cannot be checked directly but has two testable signatures: sample covariance no larger than the order of its standard error, and no replication on a disjoint sample of prompts. A third expectation for any spurious direction, whether fully target-uncorrelated or not, is that interchanges along such a direction should not move the output faithfully. A faithful direction violates the third by definition, and should violate the first two as well, since a direction the network uses carries genuine covariance with the target. § 4 shows that the OLS probes’ mass concentrates on directions that satisfy all three signatures. Importantly, this argument does not promise that a regularized probe finds the intervention-faithful directions, but rather only that an OLS probe should not be expected to. Nor does it assume the directions the network uses are high-variance: wherever they lie, the OLS probe’s mass is pulled into low-variance noise, and it is this pull, not any claim about where real signal lives, that the theory establishes.
Experiments
We fit and evaluate probes on our full datasets, with no train/test split. The HMM data is an exhaustive enumeration, and we use 8000 samples for Llama-2-7B, twice the 4096 dimensions of the model, so the OLS solution is unique. Ridge probes are fit over a logarithmic grid of , and we call the one with the lowest intervention loss the intervention-optimal ridge probe.
OLS probes decode but are causally inert
On both testbeds, the OLS probe decodes better than any alternative in sample, yet is causally inert, and the variance along its direction is far below the alternatives’. Held out on an 80/20 split, the Llama OLS probe’s loss jumps from 0.05 on its training split to 0.38, while intervention-optimal ridge holds (0.27 to 0.28). Held-out decodability thus flags the OLS probe on Llama-2-7B, but not on the HMM. On a held-out HMM split, the OLS probe still decodes an order of magnitude better than the intervention-optimal ridge probe ( against ), and is still inert. These held-out numbers are the only ones in the paper. Every other HMM result uses probes fit on the exhaustive enumeration, where there is nothing to generalize to. In that setting, OLS probes trivially achieve higher decodability than intervention-optimal ridge regression probes. Non-trivially, steering with the OLS probe has virtually no effect on the output, while the ridge probe steers mostly faithfully.
Intervention-selected ridge regression probes are faithful and high-variance
Intervention-optimal ridge probes are fairly faithful on both testbeds, and their directions carry several orders of magnitude more variance than the OLS directions (Table 1).
| Testbed | Direction | Probe loss (MSE) | Int. loss (MSE) | Variance () | |
| Mess3 HMM | OLS probe | ||||
| Mess3 HMM | Ridge probe () | ||||
| Mess3 HMM | DAS | ||||
| Llama-2-7B (birth year) | OLS probe | ||||
| Llama-2-7B (birth year) | Ridge probe () | ||||
| Llama-2-7B (birth year) | DAS |
Table 1. The two testbeds tell similar stories. The OLS probes achieve the lowest probe loss (sampled, not exhaustive, on Llama-2-7B), yet their directions carry orders of magnitude less variance, are near-orthogonal to DAS, and interventions along them barely move network outputs. By contrast, intervention-optimal ridge regression probes are similar to the DAS directions in probe loss, intervention loss, variance, and direction. DAS is technically not a probe as it does not optimize for decodability, but its reported “probe loss” is nevertheless that of a linear readout fit on its subspace. Also, the intervention loss of 13.7 for the OLS probe on Llama-2-7B is the same as what one gets from not intervening at all, whereas the ridge regression probe (7.1) and DAS (6.4) roughly halve it.
Ridge regression probes rotate onto DAS as grows
Each ridge probe is fit on decodability alone, with causal data used only to pick , whereas DAS is trained on causation alone. Yet Table 1 shows the intervention-selected ridge directions sit close to the intervention-trained DAS directions ( on birth year, on the HMM), while OLS is nearly orthogonal to them ( and ). Figure 7 shows what happens in between: In the Llama-2-7B experiment, as grows, the ridge probe direction turns steadily from the OLS direction toward the DAS direction, then degrades again once gets too large. In the HMM experiment, the intervention-optimal ridge probes are also much closer to the DAS subspace than the OLS probes, but the angle does not grow past the intervention-optimal .

Figure 7. Angle from the ridge probe to DAS (green) and to OLS (red) as grows. On the HMM study, we report the larger of the two principal angles between the steering subspaces. On the Llama-2-7B study, the angle is between single directions. The intervention-selected is dashed. The sweep’s positive case for ridge regression is clearest on the Llama-2-7B experiment, where the principal angle to DAS is minimized at the intervention-optimal . The case against OLS is clear on both testbeds.

Figure 2. Probe loss (blue, log scale) and intervention loss (red) as a function of the ridge penalty . Probe loss rises monotonically with while intervention loss has an interior minimum.

Figure 3. Belief simplex reconstructions for ground truth, the OLS probe, intervention-optimal ridge regression probe and DAS. The OLS probe recovers the simplex near-perfectly yet is causally inert. Although the specific distortion shapes differ, the two intervention-faithful methods both produce visibly distorted reconstructions with similar probe loss (more than a magnitude higher than the OLS probe).

Figure 4. Intervention loss across the belief simplex for the OLS probe (top) vs. the intervention-optimal ridge regression probe (bottom). From each of the three start states (stars), OLS probe interventions have substantially higher loss than intervention-optimal ridge probe interventions.
OLS mass sits on dead weight
A principal component, unlike a probe, has no readout , so “steer it toward a target value” is undefined, and the only defined intervention is the interchange itself, whose causal operativity is defined in § 2.4.
Figure 5 shows where each probe’s mass sits. On both testbeds the OLS probe’s mass lands on directions of near-zero operativity, while the ridge probe’s mass lands on strongly operative ones. On the HMM a single direction of near-zero variance holds 0.915 of the OLS probe’s mass.

Figure 5. Probe mass by causal operativity. Each bubble is a principal component, area proportional to its probe mass , position its operativity under in-range swaps. OLS mass (red) concentrates at low operativity on both testbeds; intervention-selected ridge mass (green) concentrates at high operativity. The Llama frame shows the heaviest-mass PCs, covering 95% of the ridge probe’s mass but only of the OLS probe’s, whose remainder spreads over a long tail of small bubbles piling onto the same low-operativity side.
Figure 5 tests principal components one at a time, which leaves a loophole. The OLS probe spreads its mass over many components, and a combination of individually inert directions could still be operative. To close it, we let DAS search the span of the 100 heaviest-weight OLS components on Llama-2-7B (holding 34.8% of the OLS probe’s mass) for the most causally effective direction it can find. It finds none that is causally operative, let alone faithful (Appendix § 11).
Discussion
Why the convergence of ridge regression probes and DAS is informative. Intervention loss is the objective DAS trained on, so DAS being intervention-faithful is about as surprising as a decodability-trained probe being decodable. The informative part is ridge regression converging onto DAS. Selection cannot create directions, only choose among a dozen pre-computed candidates, each fit on decodability alone. Yet one lands within 26–29° of DAS, much closer than the OLS direction (85–90°).
Ridge regression is not simply chasing variance. One might object that the intervention faithfulness of ridge regression probes comes simply from favoring high-variance and that the most intervention-faithful direction (or subspace, on the HMM) should be the highest-variance one. On Llama-2-7B, this is not what we find. The intervention-optimal ridge direction has variance 3.83 and largely ignores the top principal component, whose variance is 25,570, about 6,700 times larger. Note that variance cannot replace the causal test in selecting as variance is monotone in , so maximizing it causes over-regularization.
Scope and limits. Causal control is partial. Even the most intervention-faithful ridge probe directions leave intervention loss well above zero, though far below that of the OLS probes (Figure 1). Further, the LLM results use only one model. Also, this theory covers regression probes on continuous targets, whereas most probing in practice is logistic.

Figure 1. Network output change under intervention () against the change the ground truth predicts (). On the HMM (top) we steer 20 random start beliefs toward each simplex corner at 20 strengths, and each steering step gives three dots, one per emission probability. On Llama-2-7B (bottom) we run 400 base-source interchanges, and each gives one dot, the shift in expected decade. A faithful direction puts dots on the diagonal, an inert one on a flat line at zero. The dashed lines are the best fits. OLS probes are causally inert whereas intervention-optimal ridge regression probes are mostly intervention-faithful, and similar in intervention effect to DAS.
OLS probes’ intervention unfaithfulness does not prove ridge probes’ faithfulness. Corollary 3.3 proves only the negative claim that an OLS probe is prone to spurious covariance between low-variance directions and the target. It does not prove the positive claim that ridge regression finds the directions the network uses, nor that intervention-faithful directions are necessarily high-variance. That the intervention-optimal ridge direction is intervention-faithful and similar to DAS is an empirical finding from the two testbeds (§ 4.2 and 4.3). The recommendation to regularize rests on those experiments, as well as the theoretical result that ridge regression removes a failure mode OLS is proven to have, even though ridge regression is also not guaranteed to find intervention-faithful directions.
Related work: statistics and logistic probing. Ridge regression is classically justified by generalization, shrinking weights to predict better on new data ([9]). Ours is a claim about causal use, not prediction, and the 80/20 split on the HMM separates the two cleanly. There the OLS probe generalizes very well (held-out probe loss ) and is still causally inert. Further, as mentioned before, the concept of held-out decodability does not even apply when fitting on the exhaustive HMM dataset. Rather, ridge regression here buys intervention faithfulness at the expense of decodability.
Anchor regression (Rothenhäusler et al. [14]) also argues that regularization is useful for finding causal structure, although using a wholly different argument than ours. The paper models data linearly (such as hourly bike rentals predicted from temperature, humidity, and wind) and penalizes the part of the fit that changes between days. Their reason, borrowed from Peters et al. [13], is that weights that change from day to day cannot be the underlying causal ones.
RAPTOR (Gao et al. [3]) also sweeps the penalty for probes (“ridge-adaptive logistic probes”), but selects by validation accuracy, not intervention effect. Intervention-selected sweeps for logistic probing, and a logistic counterpart of the theory, are natural next steps.
Related work: interventions and concurrent work. Makelov et al. [11] caution that interventions can mislead when they push activations to values that never occur naturally, activating pathways the network never uses. We limit this risk by construction: interventions request only belief shifts within the simplex, and the LLM interchange copies activation values the source actually exhibits. Modell [12] steers a nonlinear manifold of time representations in Llama-2-7B, showing that a year representation can be steered. The work compares no probing methods causally and exhibits no decodable-but-inert direction, which is our focus.
Conclusion
We have shown that ordinary least squares regression probes tend to point in low-variance directions of activation space that carry small but nonzero covariance with a feature target. Because this leaves decodability intact not just in-sample, but also when fitting on exhaustive datasets and sometimes even out-of-sample, the resulting directions can appear reliable but fail miserably under causal intervention. Experiments on both a toy model transformer and Llama-2-7B show that OLS probes are causally inert, whereas ridge regression probes with the penalty selected by intervention effect are intervention-faithful. We also find that the latter occupy high-variance directions and that they align closely with the intervention-trained, decodability-blind directions found by Distributed Alignment Search. These results provide a mechanistic justification for regularizing regression probes.
Acknowledgments
Our two testbeds build directly on the experimental setups of Shai et al. [15] and Heinzerling & Inui [8], and we thank the authors for making their work publicly available.
Layer Sweep

Figure 6. Intervention loss (red, MSE) and probe loss (blue, MSE) of the birth-year interchange by layer, based on 200 base–source pairs. Each layer has its own intervention-optimized ridge regression probe. Interventions work best at layer 8, the site used for our Llama-2-7B experiments.
Ridge-to-DAS Rotation Across the Sweep
Covariance at the Predicted Scale

Figure 8. Standardized birth-year covariance for all 4096 PCs of Llama-2-7B layer 8, computed split-half (one half of the prompts fixes the PC directions, the other supplies and cov). 3976 of 4096 PCs lie within 3 standard errors of zero (shaded), the sampling-noise scale of Section 3.2.
Restricted DAS over the Heaviest OLS Directions

Figure 9. Per-sample intervention effect for DAS confined to the heaviest-OLS-weight principal components: 100 on Llama-2-7B and 7 on the HMM transformer (over 99.9% of OLS probe mass). No causally operative direction is found in either.
References
- [1]Björck, Å. and Golub, G. H. Numerical methods for computing angles between linear subspaces. Mathematics of Computation, 27(123):579–594, 1973.
- [2]Elazar, Y., Ravfogel, S., Jacovi, A., and Goldberg, Y. Amnesic probing: Behavioral explanation with amnesic counterfactuals. Transactions of the Association for Computational Linguistics, 9:160–175, 2021.
- [3]Gao, Z., Zhu, Y., Zeng, Q., Zhao, X., Wang, Z., Ruan, F., and Ding, K. RAPTOR: Ridge-adaptive logistic probes. arXiv:2602.00158, 2026.arxiv.org/abs/2602.00158
- [4]Geiger, A., Lu, H., Icard, T., and Potts, C. Causal abstractions of neural networks. Advances in Neural Information Processing Systems, 34:9574–9586, 2021.arxiv.org/abs/2106.02997
- [5]Geiger, A., Wu, Z., Potts, C., Icard, T., and Goodman, N. Finding alignments between interpretable causal variables and distributed neural representations. In Causal Learning and Reasoning (CLeaR), 2024.arxiv.org/abs/2303.02536
- [6]Gurnee, W. and Tegmark, M. Language models represent space and time. In International Conference on Learning Representations (ICLR), 2024.arxiv.org/abs/2310.02207
- [8]Heinzerling, B. and Inui, K. Monotonic representation of numeric attributes in language models. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pp. 175–195, 2024.
- [9]Hoerl, A. E. and Kennard, R. W. Ridge regression: Biased estimation for nonorthogonal problems. Technometrics, 12(1):55–67, 1970.
- [10]Huang, L. and Chang, Y. Causality ≠ decodability, and vice versa: Lessons from interpreting counting ViTs. arXiv:2510.09794, 2025.arxiv.org/abs/2510.09794
- [11]Makelov, A., Lange, G., Geiger, A., and Nanda, N. Is this the subspace you are looking for? An interpretability illusion for subspace activation patching. In International Conference on Learning Representations (ICLR), 2024.arxiv.org/abs/2311.17030
- [12]Modell, A. Probing for representation manifolds in superposition. arXiv:2605.18537, 2026.arxiv.org/abs/2605.18537
- [13]Peters, J., Bühlmann, P., and Meinshausen, N. Causal inference by using invariant prediction: Identification and confidence intervals. Journal of the Royal Statistical Society Series B, 78(5):947–1012, 2016.arxiv.org/abs/1501.01332
- [14]Rothenhäusler, D., Meinshausen, N., Bühlmann, P., and Peters, J. Anchor regression: Heterogeneous data meet causality. Journal of the Royal Statistical Society Series B, 83(2):215–246, 2021.DOI
- [15]Shai, A. S., Marzen, S. E., Teixeira, L., Oldenziel, A. G., and Riechers, P. M. Transformers represent belief state geometry in their residual stream. Advances in Neural Information Processing Systems, 37:75012–75034, 2024.arxiv.org/abs/2405.15943
- [16]Touvron, H., Martin, L., Stone, K., et al. Llama 2: Open foundation and fine-tuned chat models. arXiv:2307.09288, 2023.arxiv.org/abs/2307.09288