betaFeedback

WorksComputer Science

From Arraignment to Resolution: Transformer Models of Court Cases

Abstract

The criminal legal system is composed of many complex decision points, such as which charges are pursued, how bond is determined, plea deal negotiations, and sentencing. Given the profound impact of such decisions, there is a growing need to increase the transparency within this system. While prior machine learning approaches have focused on modeling single decisions (e.g., recidivism), this paper proposes a transformer-based time series model to forecast the outcome of the next proceeding in a case (e.g., charges accepted, bond set, plea deal made, etc.). By modeling a case as an event sequence, we enable a more nuanced analysis to support better oversight and understanding of decision making. We conduct an empirical analysis of thousands of cases using a newly constructed dataset derived from publicly available court records of a mid-sized U.S. city. We fit models that combine textual data from clerk notes with structured information about the defendant, prior charges, and courtroom. Our transformer model achieves .57.57 micro-F1 on a 20-class multi-label task, a significant improvement over several baselines and comparable to a GRU trained on the same input. We demonstrate how the model can be used to provide insights into decision-making and help court observers identify emerging issues within the jurisdiction studied.

Introduction

Each year, millions of people pass through criminal court in the United States. Each case is the product of a chain of decisions: initial appearance, bond determination, arraignment, continuances, plea negotiations, and, in a minority of cases, trial and sentencing. At every step, decisions are made by judges, prosecutors, and defense attorneys, and those decisions narrow the set of possible outcomes for the defendant. The cumulative effect is significant, determining whether a defendant spends weeks or months in pre-trial detention, what charges are pursued or dropped, and ultimately, what sentence is imposed. Yet, the patterns underlying these decisions are difficult to study at scale. Instead of structured event fields, what actually happens at each proceeding is often recorded in free-text clerk minutes. This combination of unstructured input and missing event labels is a practical barrier. Oversight bodies and researchers who would like to identify disparities or audit decision-making have few tools that operate at the level of the individual proceeding, because building one requires first converting clerk text into a consistent, machine-readable label of what occurred, and fitting proceeding-level outcome models.

Machine learning research on the criminal legal system has not, to date, addressed this gap. The dominant line of work focuses on a single, terminal prediction, such as recidivism, failure-to-appear, or pretrial release, and often uses structured features available at a single point in time [2, 7, 22, 9, 23]. This strand of research collapses an entire case into a single prediction target and obscures how decisions accumulate over the course of a case. No previous research provides a modeling framework for the question most relevant to our research: Given everything that has happened in a case so far, what is likely to happen next?

In this paper, we propose a transformer-based model that answers this question. We treat each case as a chronologically ordered sequence of proceedings, where each proceeding is represented by a multi-modal feature vector combining frozen pre-trained BERT embeddings of clerk notes with structured information about defendant demographics, charges, prior case history, bond amounts, procedural stage, and the assigned court section. At each step, our model predicts a multi-label vector over twenty outcome labels that span a full case, including bond decisions, charging decisions, probable cause determinations, plea entries, trial verdicts, and sentencing. Two features of the task require non-standard design choices. First, proceedings occur at irregular intervals rather than on a fixed temporal grid. To capture this, we represent absolute calendar time as a one-hot month-year vector concatenated into each proceeding’s feature representation, in addition to standard learned positional embeddings that encode step order within a case. Second, multiple events frequently occur within a single proceeding, which we accommodate by applying multi-label supervision at each step.

We construct a balanced dataset of 2,533 cases and 19,459 proceedings from the publicly available court records of a mid-sized U.S. city. We evaluate our model under 5-fold cross-validation against three baselines: a frequency-based random classifier, a multi-layer perceptron that predicts final case outcomes from the features available at the first proceeding, and a GRU trained on the same proceeding representation as the transformer. The transformer model achieves a micro-F1 of .5715 on proceeding-level prediction, a 215% improvement over the random baseline (.1812). The GRU reaches .5886, which is not statistically distinguishable from the transformer. When restricted to terminal outcomes for a fair comparison with the completion-only baseline, the transformer outperforms the MLP completion predictor by .0831 micro-F1.

Our work offers four main contributions. First, we introduce the task of proceeding-level prediction as a new task for criminal justice analysis. Second, we propose a transformer architecture that handles irregular temporal spacing and heterogeneous multi-modal inputs, and evaluate it against baselines. Third, we construct a new dataset of proceeding-level court records annotated with twenty outcomes. The records themselves cannot be redistributed for legal and privacy reasons discussed in Appendix I. Instead, we release our full label extraction and modeling pipeline along with a schema-identical synthetic dataset. Fourth, we conduct a multi-method interpretability analysis that combines ablation studies, Integrated Gradients attributions, counterfactual sensitivity, and clustering of learned representations to characterize both what the model relies on and the structure it has discovered in the data.

Beyond prediction, the model serves as an analytical tool for studying court decision-making in the jurisdiction studied. Counterfactual sensitivity analysis quantifies how predictions shift when case attributes are perturbed, showing that the model is most responsive to prior case count and less sensitive to race. Clustering the learned case representations reveals procedural trajectories, such as cases where charges are refused at the preliminary hearing stage, cases that proceed to trial, and detained defendants who plead guilty and receive jail time. Finally, gaps between confident predictions and observed outcomes flag potential procedural anomalies. Together, these applications let oversight bodies characterize what drives court decisions and flag cases within the studied jurisdiction for closer examination.

Related Work

Prior work on machine learning for criminal court has focused almost exclusively on single-decision prediction. Risk assessments, such as COMPAS, have been scrutinized for cross-racial accuracy disparities [2]. Algorithmic approaches to pretrial release have used gradient-boosted trees [9] and hierarchical Bayesian models [23] to study bail decisions. Legal Judgment Prediction (LJP) extends this paradigm to case text, using methods ranging from SVMs [1] and hierarchical BERT variants [4, 15] to joint multi-task frameworks that predict law articles, charges, and penalties simultaneously [24, 12]. The work most structurally similar to ours is Polo et al. [17], who classify Brazilian proceedings into a three-way status label from clerk-written motions using LSTMs and BERT; however, they collapse all proceedings into a single case-level label rather than predicting the next event. On the sequence modeling side, transformer models for health records [13] and career trajectories [20] demonstrate that such architectures generalize well to irregular event streams with structured covariates, motivating our adoption of the same paradigm for criminal court. Our work differs from all of the above in that we predict the multi-label outcome of the next proceeding rather than a terminal case outcome. Alongside these computational approaches, courts are also studied through non-computational forms of oversight, such as court-watching programs. Courtwatching programs recruit volunteers to observe proceedings and report on bail practices, presence of attorneys, and the conditions within the courtroom, and operate in many US jurisdictions, including Court Watch Massachusetts, Court Watch Chicago, Court Watch NOLA, and Court Watch New York City [8, 18]. These volunteers record what dockets omit, but their capacity limits the scope of their observations. A full survey of related work appears in Appendix § 10.

Dataset

We construct our dataset from the criminal court records of a mid-sized U.S. city, where we have cases of varying complexity and duration. The criminal court system in this city is split across two court types by procedural stage, which we will refer to as Court A and Court B throughout the paper for the sake of anonymity. Court A handles proceedings in the early stages of a case, where events such as initial appearances and bail determinations would occur, while Court B deals with the proceedings of the later stages of the case, having to deal with arraignments, plea hearings, trials, and sentencing. We merge records from both to construct unified case-level sequences.

Proceeding Information Each proceeding contains structured and unstructured information: (1) clerk notes which document judicial decisions, attorney requests, and procedural actions; (2) defendant demographics which include race (6 categories), gender (3 categories), and age at the initiation of a case; (3) criminal charges for an individual for a specific case which draws from a vocabulary of 2,139 charge types; (4) the month-year timestamp that corresponds to this proceeding; (5) bond information (original bond amounts, cumulative bond amounts); (6) the identification of Court A section (for proceedings that take place in Court A); (7) prior criminal history for a given defendant (prior case count and the aggregated prior charges) using only cases that precede the given proceeding.

Outcome Labels We extract K=20K = 20 outcome labels representing key legal events from clerk notes using a regular expression pipeline (Table 2). These outcomes span the full length of a case, from initial hearings to final case disposition. A subset of 5 outcomes represents case-terminating events (charges refused, probable cause not found, trial verdict

LabelCount
Continuance Occurred5,424
Bond Set3,703
Court Appointed Public Defender3,173
Pre-Trial Conference Held3,128
First Appearance Hearing Occurred2,589
Charges Refused1,848
Defendant in Custody and Not in Court1,693
Pled Not Guilty to Charges1,633
Probable Cause Found1,431
Pled Guilty to Charges1,077
Bond Not Set991
Defendant Released on Own Recognizance899
Sentence Including Jail Time Imposed806
State Was Not Present685
Domestic Stay-Away Order Imposed546
Charges Accepted462
Ankle Monitoring Imposed456
Probable Cause Not Found442
Trial Verdict Reached404
Sentence Without Jail Time Imposed401
Total31,791

Table 2. Label distribution

reached, sentences with or without jail time), which we evaluate separately in our baseline comparisons.

We developed the extraction patterns through iterative review of matched and unmatched clerk notes. For manual validation, we sampled and annotated 100 entries to ensure each outcome label appeared at least five times. We found no extraction errors in the sample.

Data Processing We apply several filtering steps, restricting to cases with complete defendant demographics, with a single defendant, with extractable outcome labels, and removing extraction cases that involve multiple jurisdictions. To address class imbalance, we employed stratified sampling to make sure that there is representation of rare but significant outcomes. This was done by first identifying outcomes that appear in fewer than 400 cases and including all such cases in our dataset, then randomly sampling additional cases to reach 2,533 cases.

Table 1 presents key statistics of the balanced dataset. The dataset has major variations within case complexity, from sequences ranging from 2 to 61 proceedings and a median of 7 proceedings per case. Figure 1 shows the right-skewed nature of case lengths, with 58% resolved in less than 8 proceedings, and a long tail up to 61 proceedings. On average, each proceeding has 1.6 labels, which reflects that these proceedings have multiple decisions made at a single proceeding. Table 2 shows the distribution of outcome labels across all proceedings in the dataset. The distribution shows significant class imbalance, as previously stated, and reflects the reality of criminal court proceedings, since most cases involve multiple procedural hearings before reaching a resolution, and most cases are resolved through plea deals.

Cases2,533
Total proceedings19,459
Mean sequence length7.68
Median sequence length7
Max sequence length61
Labels/proceeding1.63

Table 1. Dataset statistics

Distribution of proceedings per case

Figure 1. Distribution of proceedings per case

Methods

Notation and Setup

Let S={(X(n),Y(n))}n=1NS = \{(X^{(n)}, Y^{(n)})\}_{n=1}^{N} be our dataset of NN cases, where

  • X(n)=(p0(n),p1(n),…,pTn(n))X^{(n)} = (p_{0}^{(n)}, p_{1}^{(n)}, \ldots, p_{T_n}^{(n)}) is a chronologically ordered sequence of proceedings of variable length TnT_n;

  • Y(n)=(y1(n),y2(n),…,yTn(n))Y^{(n)} = (y_{1}^{(n)}, y_{2}^{(n)}, \ldots, y_{T_n}^{(n)}) is the corresponding sequence of multi-label outputs, with yt(n)∈{0,1}Ky_t^{(n)} \in\{0,1\}^{K} a binary vector over K=20K = 20 outcome labels.

At prediction step tt, the model observes p0(n),…,pt(n)p_{0}^{(n)}, \ldots, p_{t}^{(n)} and predicts the next outcome vector yt+1(n)y_{t+1}^{(n)}, for t=0,1,…,Tn−1t = 0, 1, \ldots, T_n - 1.

Proceeding Representation

Each proceeding pt(n)p_t^{(n)} at time tt is represented by a fused feature vector that concatenates information about the case and defendant:

pt(n)=ffuse(ψtext(at(n)),ϕdemo(b(n)),ϕcharges(ct(n)),ϕcourt_a_sec(dt(n)),ϕprior_labels(yt−1(n)),ϕcharges(Ct(n)),ht(n),ψbond(jt(n)),ψbond(kt(n)),lt(n),ψtime(τt(n)))p_t^{(n)} = f_{\mathrm{fuse}}\left(\psi_{\mathrm{text}}(a_t^{(n)}), \phi_{\mathrm{demo}}(b^{(n)}), \phi_{\mathrm{charges}}(c_t^{(n)}), \phi_{\mathrm{court\_a\_sec}}(d_t^{(n)}), \phi_{\mathrm{prior\_labels}}(y_{t-1}^{(n)}), \phi_{\mathrm{charges}}(C_t^{(n)}), h_t^{(n)}, \psi_{\mathrm{bond}}(j_t^{(n)}), \psi_{\mathrm{bond}}(k_t^{(n)}), l_t^{(n)}, \psi_{\mathrm{time}}(\tau_t^{(n)})\right)

where at(n)a_t^{(n)} is the proceeding text, b(n)b^{(n)} encodes the defendant’s demographics (race, gender, age at case initiation), ct(n)c_t^{(n)} is the charge-count vector of case nn as of proceeding tt, and dt(n)d_t^{(n)} is the assigned section of Court A. The term yt−1(n)y_{t-1}^{(n)} is the multi-label vector at the previous proceeding, which is set to 0K\mathbf{0}^{K} at t=1t = 1. Ct(n)C_t^{(n)} is the aggregated set of all prior charges for the defendant prior to the time of proceeding pt(n)p_t^{(n)}. ht(n)∈{0,1}h_t^{(n)} \in\{0,1\} indicates whether the proceeding occurs in Court A or Court B. jt(n),kt(n)j_t^{(n)}, k_t^{(n)} are the original and total bond amounts in dollars. lt(n)l_t^{(n)} is the prior case count of the defendant; τ(pt(n))\tau(p_t^{(n)}) is the month-year of the proceeding.

We write ϕ(⋅)\phi(\cdot) for learned embedding functions and ψ(⋅)\psi(\cdot) for deterministic encoders. ψtext\psi_{\mathrm{text}} is a pretrained bert-base-uncased model [6] whose weights are frozen. ψbond\psi_{\mathrm{bond}} discretizes a bond amount into one of nine bins (including a “not set / missing” bin) and returns a one-hot vector. ψtime\psi_{\mathrm{time}} returns a one-hot month-year encoding. Scalars and binary indicators (ht(n),lt(n))(h_t^{(n)}, l_t^{(n)}) are concatenated directly. (See Appendix § 11 for more details.)

Model Architecture

Given p0:t(n)p_{0:t}^{(n)}, the model computes:

zs(n)=ps(n)+PEs,s=0,1,…,t,z_s^{(n)} = p_s^{(n)} + \mathrm{PE}_s,\quad s = 0,1,\ldots,t,
u0:t(n)=TransformerEncoder⁡(z0:t(n);Mcausal),u_{0:t}^{(n)} = \operatorname{TransformerEncoder}\left(z_{0:t}^{(n)}; M_{\mathrm{causal}}\right),
y^t+1(n)=σ(Wout(n)+bo),\hat{y}_{t+1}^{(n)} = \sigma(W_o u_t^{(n)} + b_o),

where PE∈RLmax⁡×d\mathrm{PE} \in\mathbb{R}^{L_{\max} \times d} is the learned positional embedding, McausalM_{\mathrm{causal}} is the upper-triangular causal mask, Wo∈RK×dW_o \in\mathbb{R}^{K \times d}, bo∈RKb_o \in\mathbb{R}^{K}, and σ\sigma is the element-wise sigmoid producing KK independent label probabilities. Under teacher forcing, the encoder output at position tt produces the prediction y^t+1(n)\hat{y}_{t+1}^{(n)} for the labels of the next proceeding. At test time, the model never observes the fields from proceeding t+1t + 1 when predicting yt+1(n)y_{t+1}^{(n)}. The initial state of the sequence omits all proceeding text, bonds, and prior label features, representing the information available prior to the first appearance hearing.

Training objective

We train the model by minimizing the average binary cross-entropy loss applied independently to each of the KK labels:

L(θ)=−1N∑n=1N1Tn⋅K∑t=0Tn−1∑k=1K[yt+1,k(n)log⁡(y^t+1,k(n))+(1−yt+1,k(n))log⁡(1−y^t+1,k(n))].\mathcal{L}(\theta)=-\frac{1}{N}\sum_{n=1}^{N}\frac{1}{T_n\cdot K}\sum_{t=0}^{T_n-1}\sum_{k=1}^{K}\left[y_{t+1,k}^{(n)}\log\left(\hat{y}_{t+1,k}^{(n)}\right)+\left(1-y_{t+1,k}^{(n)}\right)\log\left(1-\hat{y}_{t+1,k}^{(n)}\right)\right].

Experiments

We compare with three baselines:

MLP Baseline This baseline trains a static multi-layer perceptron that predicts the final case outcomes based solely on the features available at the initial proceeding in order to determine if time sequence modeling is truly necessary for this task. The input includes the defendant demographics, initial charges, and Court A section, processed through a 3-layer network.

Frequency-Based Random Classifier This baseline establishes a lower bound on performance by sampling labels based on their training frequencies and ignoring the input features entirely. For each test proceeding, given its ground truth label count ktk_t, we sample ktk_t labels without replacement. This evaluates our transformer’s ability to perform better than a random guess, which has only been informed by the prevalence of a class in our training data.

GRU Baseline This baseline trains a gated recurrent unit (GRU) on the same proceeding sequences as the transformer. For each proceeding pt(n)p_t^{(n)}, the GRU updates its hidden state as rt(n)=GRU⁡(pt(n),rt−1(n))r_t^{(n)}=\operatorname{GRU}(p_t^{(n)},r_{t-1}^{(n)}) and predicts y^t+1(n)=σ(WoGRUrt(n)+bGRU)\hat{y}_{t+1}^{(n)}=\sigma(W_o^{\mathrm{GRU}}r_t^{(n)}+b^{\mathrm{GRU}}). The two models share the same component embeddings, fusion layer, training objective, 896-dimensional hidden representations, optimizer, learning rate scheduler, and cross validation folds. Since recurrence is causal by design, the learned positional embedding PE and the causal mask McausalM_{\mathrm{causal}} are not used for this baseline. We select the depth of the GRU based upon validation performance, which is 2 layers.

We primarily evaluate model performance using the micro-averaged precision, recall, and F1 scores.

The step-level results use top-ktk_t selection, where ktk_t is the number of outcomes actually observed at each proceeding. Therefore, precision, recall, and micro-F1 score are all equal at this level. We adopt this selection rule to avoid making our main results dependent on a classification threshold, while recognizing that it inflates absolute performance because ktk_t would not be known in practice. Appendix K reports the threshold-based results. To establish a fair comparison with our first baseline model, we additionally report results in which the transformer’s output is restricted to the subset of completion labels and evaluated only at the final input proceeding of each case. For additional implementation details and results, please see the Appendix.

Classification Results

We evaluate our model across three levels: step-level (prediction at each individual proceeding), completion-level (final case outcome prediction given full case history), and case-level (step-level predictions aggregated across the full case). Because these levels differ in what is predicted and when, metrics are not comparable across them. Step-level metrics are computed over individual proceedings, so a label recurring within a case contributes once per occurrence. On the other hand, case-level metrics are computed over cases, so each label contributes at most once per case. Therefore, support totals will differ. We report results at each level, followed by ablation, interpretability, and fairness analyses.

Table 3 illustrates the step-level performance under 5-fold cross-validation, where the model predicts outcome labels after each individual proceeding. Our full transformer model achieves a microF1 score of .5715±.013.5715 \pm.013, which substantially outperforms the random baseline (.1812±.004.1812 \pm.004). This demonstrates that the model learns meaningful sequential patterns from the data. The GRU baseline reaches .5886±.013.5886 \pm.013, within fold-level variance of the transformer. Although the GRU performs slightly better, we use the transformer for the analyses done because its per-position outputs directly incorporate all prior proceedings rather than relying on a recursively compressed summary, making attributions and case representations comparable across positions within a case.

ModelF1PrecisionRecall
Transformer.5715 ± .013.5715 ± .013.5715 ± .013
GRU Baseline.5886 ± .013.5886 ± .013.5886 ± .013
Random Baseline.1812 ± .004.1812 ± .004.1812 ± .004

Table 3. Step-level performance (mean ± std)

Table 4 reports the performance for completion-level models, where models observe the full case history and predict only the final case outcome. This task is quite different from the one shown above and should not be compared across tables. The transformer completion achieves a micro-F1 of .5695±.014.5695 \pm.014 which outperforms the MLP completion baseline (.4864±.025.4864 \pm.025) by .0831.0831. This difference is statistically significant across the five folds (95% CI [.053.053, .113.113]; t(4)=7.76t(4) = 7.76, p=.0015p = .0015).

ModelF1PrecisionRecall
MLP Baseline.4864 ± .025.5118 ± .027.4634±.023
Transformer.5695±.014.7534±.010.4579 ± .016

Table 4. Completion-level performance (mean ± std). Not comparable to Table 3.

Table 5 reports the proceeding-level per-label performance for the full transformer under 5-fold cross-validation. The model performs strongest on frequent outcomes such as “First Appearance Hearing Occurred” and “Court Appointed Public Defender”, but does poorest on rare outcomes such as “Charges Accepted”, “Probable Cause Not Found”, and “Bond Not Set”. (See the Appendix for case-level results, where aggregation across proceedings raises performance substantially.)

LabelF1
First Appearance Hearing Occurred.9926±.00.9926 \pm.00
Court Appointed Public Defender.7972±.01.7972 \pm.01
Bond Set.7351±.01.7351 \pm.01
Pre-Trial Conference Held.6576±.02.6576 \pm.02
Domestic Stay-Away Order Imposed.6479±.02.6479 \pm.02
Pled Not Guilty to Charges.6469±.03.6469 \pm.03
Charges Refused.4939±.01.4939 \pm.01
State Was Not Present.4914±.06.4914 \pm.06
Probable Cause Found.4743±.02.4743 \pm.02
Defendant Released on Own Recognizance.4549±.05.4549 \pm.05
Continuance Occurred.4426±.02.4426 \pm.02
Ankle Monitoring Imposed.4376±.06.4376 \pm.06
Sentence Without Jail Time Imposed.3793±.04.3793 \pm.04
Pled Guilty to Charges.3733±.03.3733 \pm.03
Sentence Including Jail Time Imposed.3388±.04.3388 \pm.04
Defendant in Custody and Not in Court.3075±.03.3075 \pm.03
Trial Verdict Reached.2838±.04.2838 \pm.04
Probable Cause Not Found.2349±.04.2349 \pm.04
Bond Not Set.1661±.01.1661 \pm.01
Charges Accepted.1340±.02.1340 \pm.02

Table 5. Proceeding-level per-label F1 performance (mean ±\pm std over 5 folds), sorted by F1 score.

Ablation Studies To assess the contribution of individual input components, we conducted ablation experiments, systematically removing proceeding text, defendant demographics, prior labels, and combinations of these. Table 6 shows that removing proceeding text yields the largest single-component drop (Micro-F1 of .5335±.016.5335 \pm.016, Δ\DeltaMicro-F1 of −.0380-.0380), which confirms that proceeding text is the primary driver of predictive performance. The combined removal of proceeding text and prior labels produces the largest degradation overall (Micro-F1 of .5096±.013.5096 \pm.013, Δ\DeltaMicro-F1 of −.0619-.0619), which indicates that these two components are jointly critical and partially complementary.

ModelMicro F1Δ\Delta Micro-F1
Transformer.5715±.013.5715 \pm.013
No Text.5335±.016.5335 \pm.016−.0380-.0380
No Demographics.5682±.014.5682 \pm.014−.0033-.0033
No Prior Labels.5689±.019.5689 \pm.019−.0026-.0026
No Text or Prior Labels.5096±.013.5096 \pm.013−.0619-.0619

Table 6. Ablation results under 5-fold cross validation relative to the transformer model (mean ±\pm std)

Applying the model to court analysis

Given the validated predictive model, we next turn to an examination into the ways in which such a

model may be analyzed to provide insights into court decision making and to help court observers identify emerging issues of interest. The findings below reflect practices within the court studied.

Sensitivity

First, we assess how sensitive the model is to demographic and case attributes. As the model has been trained on historical decision making, probing the model in this way provides a method to understand which factors may play a role in decision making. To do so, we conduct a counterfactual perturbation analysis ([11]). For each prediction, we replace a feature value with an alternative value, holding other inputs fixed (e.g., the age of a defendant is modified from young to old). We then record the shift in posterior probability over the predicted labels that results from the feature substitution. We compute the average shift across all proceedings in the held out set (denoted ΔP\Delta P) and report 95% confidence intervals using the tt-distribution. Figure 2 shows sample per-label probability shifts for three features: prior case count, age, and race.

Counterfactual sensitivity analysis

Figure 2. Counterfactual sensitivity analysis.

Overall, sensitivity is highest for legally relevant covariates and lowest for protected demographic attributes. Prior Case Count produces the largest perturbations, with a mean ΔP\Delta P of .0032. The model predicts that defendants with high prior case counts are less likely to be released on their own recognizance (without paying bail) and are more likely to be in custody and not present at a hearing. These results reflect that prior court involvement is strongly associated with the court decisions recorded here, and also indicate that cases involving defendants with prior charges may have increased delays due to defendants missing hearings while in jail.

Age produces moderate perturbations, with a mean ΔP\Delta P of .0017. The model predicts that younger defendants are more likely to have ankle monitoring imposed (electronic tracking device), to have a public defender appointed, and to have cases where probable cause is found. The increased probability for ankle monitoring may reflect increased perceived flight risk due to weaker community ties, or may reflect assumptions that younger defendants need greater oversight.

Race produces smaller perturbations, with a mean ΔP\Delta P of .0009. We focus on the three largest

groups in the dataset: Black, White, and Hispanic defendants. The model predicts that Black defendants are more likely to have a public defender appointed and more likely to have cases where probable cause is found. While the magnitudes are lower than for Prior Case Count and Age, the directionality is consistent with prior work on racial disparities in criminal courts [16].

Clustering

To discover groups of cases that exhibit similar temporal patterns, we perform a cluster analysis, using case representations learned by the transformer model. We extract the pre-classifier head transformer embeddings, apply StandardScaler normalization followed by L2 normalization, reduce to 50 principal components with Principal Component Analysis, and project to two dimensions with t-SNE. Then, we assign each case to a cluster by running K-Means (K=6K = 6, ninit=10n_{\mathrm{init}} = 10) directly on the two-dimensional t-SNE coordinates.2 Figure 3 shows the per-label presence across the embedding space colored by cluster; Figure 4 shows the multi-label composition heatmap per cluster. The arrangement of cases in the t-SNE projection corresponds roughly to differences in their procedural trajectories. Variation across Dimension 1 appears to be associated with case time and whether charges are accepted. Dimension 2 is more nuanced, though cases with higher values appear to correspond to cases that conclude with a trial verdict (Figure 3, bottom panel). Because t-SNE dimensions do not have intrinsic meanings, we treat these associations as descriptive patterns rather than definitive interpretations of these axes.

Clustered cases highlighting those containing three outcome labels

Figure 3. Clustered cases highlighting those containing three outcome labels.

Heatmap showing labels by cluster

Figure 4. Labels by cluster.

Cluster 3 (n=98n = 98) is the most interpretable. It is defined by near-universal Charges Refused (98%),

the highest Probable Cause Not Found rate (42%), and near-zero rates for all plea and sentencing labels, including Pled Guilty to Charges and Trial Verdict Reached. This cluster captures cases terminated at the preliminary hearing stage, where the state’s charges are refused before the case reaches a plea, verdict, or sentencing stage.

Cluster 0 (n=75n = 75) also shows a high Charges Refused rate (77%) but retains some Probable Cause Found (28%), suggesting cases where charges were ultimately refused after brief engagement with the court. Cluster 4 (n=93n = 93) has the highest Trial Verdict Reached rate (47%), alongside high Pretrial Conference Held (84%), Continuance Occurred (87%), and Probable Cause Found (66%). This cluster captures the small subset of cases that proceed through the full adversarial process to a verdict.

Cluster 5 (n=85n = 85) is distinguished by the highest Defendant In Custody And Not In Court rate (55%), high Pled Guilty to Charges (78%), and a high Sentence That Includes Jail Time rate (49%). This profile reflects detained defendants who ultimately enter guilty pleas and receive sentences. Clusters 4 and 5 differ mostly in their disposition mode rather than how far a case progresses. Cluster 5 contains more cases in which the defendant pled guilty, whereas Cluster 4 contains more cases that reach a trial verdict.

Clusters 1 (n=81n = 81) and 2 (n=75n = 75) share broadly similar profiles, including high Pled Not Guilty To Charges rates (98% and 97%), high Continuance Occurred rates (84% and 77%), and moderate-to-high sentencing rates. They differ in Pretrial Conference Held rates (90% versus 40%) and Pled Guilty to Charges rates (72% versus 55%). This suggests that Cluster 1 cases undergo more extensive pretrial proceedings before resolution.

Outlier Analysis

One value of this model to oversight is the ability to identify cases that deviate from model expectations. This can help surface potential procedural anomalies that warrant closer inspection. Here, we give examples of how this model could be used for monitoring the use of stay-away orders (SAOs). SAOs are operationally significant because they have immediate behavioral consequences: they prohibit the defendant from contacting or approaching the protected party, and violation carries criminal penalties. Ensuring consistent application of SAOs thus has important safety implications.

In a ten proceeding case involving domestic abuse battery, domestic abuse second offense, and domestic abuse child endangerment, our model predicted a Domestic Stay-Away Order at Step 0 with very high confidence (.995), but there was no Stay Away Order recorded at this step. Given that these charges are squarely within the class of offenses for which a domestic SAO is routinely issued at first appearance in this jurisdiction, and that the second offense designation indicates a repeat-offender pattern already visible in the charge itself, a confident SAO prediction is a legally sensible prediction. The clerk note for Step 0 makes the source of the discrepancy explicit. The court wrote, “The court could not issue a domestic stay away order in this matter as no victim information was provided to the court.” The court was prepared to issue an SAO, however it was blocked due to no victim information available at the time of the hearing. Such cases can arise if, e.g., the police report does not contain victim information or if this information was not transmitted to the court in time for the hearing.

Similar patterns appear elsewhere: another high-confidence false positive (.97) involves a defendant charged with domestic abuse battery whose prior record includes additional domestic-violence offenses, where no SAO was issued at Step 0 because the defendant was never transported to court. This can occur when the defendant is already in jail but was not brought to court by the sheriff’s office. Using the model to identify such discrepancies can help court observers better advocate for reforms that ensure procedural consistency.

Integrated Gradients

Since a major goal of the project is to support oversight rather than automate decision-making, interpretability is critical to our evaluation process. To understand which input components drive model predictions, we use Integrated Gradients [19] implemented through the Captum library (Kokhlikyan et al., 2020).

The BERT text embedding achieves the highest mean raw attribution by a wide margin (110.66±5.18110.66 \pm5.18), followed by the case embedding (41.97±1.8641.97 \pm1.86) and prior charge embedding (18.77±2.4418.77 \pm2.44). The BERT embedding attribution is highest for Pled Guilty to Charges (137.03±2.13137.03 \pm2.13) and Sentence That Does Not Include Jail (133.63±6.48133.63 \pm6.48). The case embedding similarly shows its strongest attributions for Pled Guilty to Charges (59.42±1.7159.42 \pm1.71) and Sentence That Does Not Include Jail Time Was Imposed (56.82±2.4656.82 \pm2.46), mirroring the BERT embedding’s pattern for sentencing outcomes. (See Appendix § 16 for more details.)

Integrated Gradients and ablation studies (§ 6) independently identify clerk-note text as the dominant predictor, with structured case context (i.e., charges, prior labels, etc.) as a distant second, and defendant demographics, court identifiers, and bond/temporal scalars contributing to a lesser extent. Combined with the counterfactual results in § 7.1, these consistent findings demonstrate that the model relies more on legally relevant content than demographic attributes.

Conclusion

Our results support three conclusions: (1) proceeding-level predictions are feasible at scale, with the full transformer achieving a micro-F1 of .5715 and outperforming random and static MLP baselines and comparable to the GRU baseline; (2) clerk note text is the dominant source of predictive signal, as removing proceeding text produces the largest single-component ablation drop and Integrated Gradients assigns the BERT text embedding the highest attribution scores; (3) the model is more responsive to case-specific information than demographic attributes. Together, these findings show that proceeding-level modeling can move beyond static risk-style prediction toward a more dynamic account of how criminal cases unfold over time. They also suggest that interpretable sequence models can serve as useful tools for empirical court observation, helping researchers and court watchers identify patterns, anomalous cases, and points in the process where legal outcomes appear to shift. We emphasize that our empirical findings characterize the recorded practice of the single jurisdiction we study and should not be read as general claims about criminal courts. The proceeding-level modeling framework itself, however, is not jurisdiction-specific. Applying it elsewhere would require adapting the label extraction and features to local court data and retraining the model [22].

Limitations

One limitation of this analysis is that it relies upon text extraction from clerk notes to identify event outcome labels. While we have validated these through iterative review, errors in our extractors would influence the validity of our results. The reliance on regular expressions comes from the data infrastructure in most US court systems, which rarely gives clean, structured event information for public auditing. The state of a case is also determined by the data entry clerk, which introduces noise that caps the performance of any model trained on our data. Our manual validation confirms that the extracted labels are correct, but it cannot determine how many labels we miss. Each of the twenty labels appeared at least five times in the sample of 100 entries, and every extraction was correct. However, events whose phrasing our patterns fail to match are silently absent from the label set. These false negatives are unobserved by both the model and our evaluation and are treated in the training data as true negatives. Thus, this understates the prevalence of affected outcomes.

Another limitation is generalizability beyond the jurisdiction studied. Although our modeling framework is jurisdiction-agnostic, the patterns identified in the paper reflect the practices of the criminal court system in a mid-sized U.S. city and should not be interpreted as general claims about criminal courts. Applying this elsewhere would require significant local adaptation. The regular expression extractors encode court-specific abbreviations, phrasing, and clerical conventions and would need to be rewritten to fit the local clerk minutes.

Additionally, the charge vocabulary, the Court A and Court B split by procedural stage, and section identifiers are specific to this jurisdiction and would need to be adapted for use elsewhere. The model would also need to be retrained on local data.

A related limitation extends beyond label extraction itself to the underlying records in which the label extractor operates. Clerk minutes and structured fields, such as the case identifier and charge codes, are entered by hand at the time of each proceeding, and our dataset inherits whatever transcription, attribution, and classification errors occur during this process. We have directly observed proceedings that appear in cases in which they do not belong, which is the result of a clerk entering a wrong case identifier when they enter their clerk notes, as well as proceeding text that references events or charges from unrelated matters. These kinds of errors are not unique to the jurisdiction studied in this paper. Because we have no independent ground truth against which to identify these errors at scale, the model is trained on a corpus that contains an unknown rate of cross-case contamination, miscoded charges, and incorrect procedure attributions, which sets a ceiling on achievable performance and may bias per-label metrics.

Another limitation is how the case embedding was set up, as we mapped charge descriptions to dense vectors. We apply a linear projection layer to a vocabulary count vector and initialize its weights randomly rather than using pre-trained semantic embeddings. As a result, the model treats semantically hierarchical charges, such as “Possession of a Schedule 1 Drug” or “Possession of a Schedule 1 (2 Grams)” as orthogonal and unrelated features. The model cannot infer that the specific charge with the dosage is a subclass of the general charge. This means that it must independently learn the consequences of a given charge from scratch. For rare, specific charges, such as the one above, the sparsity of the training data would mean that the model might fail to learn these weights effectively.

A further limitation is that we do not report disaggregated evaluation [3]. Our counterfactual sensitivity analysis (§ 7.1) measures changes under demographic and case-attribute substitution, not whether error rates differ across defendants of different race, age, and gender. Thus, our finding that the model relies more on case characteristics rather than defendant demographics should be interpreted as a result about feature sensitivity and does not establish that performance is equitable across demographic groups. We leave such an evaluation to future work.

Lastly, because we cannot redistribute the source records (Appendix § 18), our specific results are not independently reproducible without obtaining the underlying data from the court. The released pipeline and synthetic dataset allow inspection and rerunning of the method and label extraction, but not the numbers reported here.

Ethical Considerations

Usage

When To Use It

The model is designed as an auditing and oversight tool for researchers, attorneys, reform advocates, and oversight bodies to better understand patterns and bias within the criminal court system’s proceedings. It should be used on retrospective and aggregate analysis rather than individual case adjudication. For example, the model could be used to identify cases where outcomes deviated significantly from predictions, highlighting procedural irregularities or biases that occur for further investigation. It could also serve to measure policy improvement, seeing whether model predictions change after the establishment of a new policy and whether it achieves its intended effect.

When Not to Use It

This model should never be used as an automated decision-maker, as the system is designed to audit human decision-making rather than replacing it. It should not be used to make or influence decisions affecting bail, charging, plea, or sentencing for a defendant. If the model were to replace human judgment, the possible errors that would occur could directly harm defendants, while as an auditing tool, the errors could cause researchers to investigate the reasoning behind them.

Positive Impacts

This research has the potential to increase transparency and accountability within the criminal court system of this jurisdiction by providing the tools that enable the researchers and oversight bodies to identify patterns in outcomes. Public defenders and legal aid organizations can utilize such tools to uncover systemic issues that affect their clients and, therefore, advocate for possible policy changes. Additionally, this research could empower journalists and researchers to conduct more research into the operations of this court system.

Potential Harms

Despite our intentions for this model to be used as an auditing tool, there could be some harms that come along with its deployment. The obvious risk is the potential of misuse, as discussed above. Another significant risk is privacy concerns as the model uses publicly available court records; the aggregation or analysis of data at scale could lead to the identification of individuals.

Mitigation Strategies

We adopt several mitigation strategies to limit the risks identified above.

The first concerns restricting deployment to oversight rather than adjudication. Model outputs are framed throughout the paper as an auditing signal, not a recommendation. We will accompany any public release of the code with explicit documentation that prohibits use of the model to make, recommend, or score individual bail, charging, plea, or sentencing decisions.

The second strategy concerns data minimization. Although the underlying court records are publicly available, we do not redistribute them. Bulk release would allow for linkage of defendants, victims, and witnesses across cases and would defeat expungement relief that the defendants remain entitled to seek. We release code and a synthetic dataset instead. See Appendix § 18.

Third, we document the model’s per-label performance and its weaker outcomes (Probable Cause Not Found, Charges Accepted, Bond Not Set), along with the data quality, extraction, generalizability, and evaluation limitations discussed in the Limitations section.

Acknowledgment

A. Culotta was supported in part by NSF Awards IIS-HCC-2619509, DEB-2550002, CNS-2515250, IIS-HCC-2333537, CNS-2427237, the Louisiana Board of Regents Endowed Chairs for Eminent Scholars program, the Greenberg Family Professorship in Social Entrepreneurship, the Harold L. and Heather E. Jurist Center of Excellence for Artificial Intelligence at Tulane University, and the Tulane University Center of Excellence for Community-Engaged Artificial Intelligence.

Extended Related Work

Machine Learning for Single Decision Points in Criminal Justice

The dominant research efforts in machine learning for criminal justice focus on predicting a single decision or outcome, such as pre-trial release, recidivism, or final case disposition. Kleinberg et al. [9] train gradient-boosted decision trees on 758,027 New York City pretrial cases to forecast failure-to-appear and re-arrest, and found that algorithmic predictions could, in principle, reduce both jail populations and crime rates relative to judges. Williams and Kolter [23] takes an alternative approach at a different decision point, developing a hierarchical Bayesian model of cash bail assignments to disentangle judge-level variation from defendant-level risk while also addressing the infra-marginality problem inherent in observational bail data.

The most widely known operational tool, COMPAS, was shown by Angwin et al. [2] to produce error rates that differed substantially across racial groups. In a closely related study, Dressel and Farid [7] demonstrated that COMPAS is no more accurate than predictions made by laypersons with little or no criminal-justice expertise, and that a logistic regression using only two features matches its overall accuracy of roughly 65%. Wang et al. [22] shows that simple, interpretable models, in some cases compact enough to fit on a single page, can match black-box accuracy on Florida and Kentucky pretrial datasets while outperforming COMPAS, and they further document that recidivism models do not generalize well across jurisdictions and require local retraining.

While this body of work has clarified the methodological foundations and limits of risk assessment, every study above collapses a case into a single prediction target, whether the defendant will reoffend, fail to appear, or receive cash bail, obscuring how decisions accumulate across the multiple proceedings that determine a defendant’s trajectory through the system.

Legal Judgment Prediction From Case Text

Legal Judgment Prediction (LJP), a subtopic of NLP, uses textual descriptions of cases to forecast judicial outcomes. Aletras et al. [1] introduced the task on the European Court of Human Rights and used bag-of-n-grams features and SVMs to predict whether a particular Convention article had been violated and achieved ∼79%\sim79\% accuracy. Chalkidis et al. [4] extended this benchmark to neural models on a larger European Court of Human Rights corpus and evaluated hierarchical attention networks and BERT-based architectures on binary, multi-label, and case-importance prediction. To accommodate the lengthy nature of legal documents, Chalkidis et al. [5] pre-trained Legal-BERT on legislation, contracts, and court cases. Niklaus et al. [15] introduced the multilingual Swiss-Judgment-Prediction benchmark with hierarchical BERT variants. Ma et al. [14] explicitly moved beyond judge-summarized inputs by representing cases through their multi-stage lifecycle, but their target remains the final disposition.

Recent work has expanded the LJP output structure beyond single-label classification. Zhang et al. [24] proposes HD-LJP, a hierarchical-dependency framework that jointly predicts law articles, charges, and terms of penalty on the CAIL2018 corpus by combining label-topological relation distillation with an ordered task-judicial-logic module in which each subtask’s prediction filters the candidates for the next set. Li et al. [12] formulates the prediction of law articles and charges as a multi-task multi-label problem and inserts label definitions and law-charge alignment knowledge into a transformer decoder model. While these methods relax the single-task or single-label assumption, the prediction target remains the terminal trial outcome of an already-completed case rather than the next event in its evolution.

Closest to our input structure is Polo et al. [17], whose work classifies Brazilian legal proceedings into archived, active, or suspended status from chronological sequences of short clerk-written motions using LSTMs, MLP, and XGBoost classifiers over Word2Vec, Doc2Vec, TF-IDF, and BERT representations. Their setting is similar to ours in that they treat clerical text as a unit of observation and in modeling sequences sequentially. However, they collapse the proceedings into a single three-way status label, and we predict the multi-label event composition of each upcoming proceeding. Across this literature, the prediction target is typically the terminal outcome of a case rather than the next event in its evolution. Our work shifts the unit of prediction to the individual proceeding.

Sequence Models for Event Streams

Most relevant to our methodological setup is work that adapts the Transformer architecture (Vaswani et al., [21]) to sequences of discrete categorical events accompanied by structured covariates. Li et al. [13] introduces a BERT-style transformer model, BEHRT, that represents a patient’s electronic record as a sequence of diagnoses grouped into visits so that predictions are unaffected by the order of events within the same visit. Each diagnosis token’s embedding sums disease code, age, position, and visit-segment embeddings. This model is pretrained on roughly 1.6 million UK primary-care records via masked language modeling and then fine-tuned to predict the diseases that will appear in a patient’s next visit, next 6 months, and next 12 months. This model outperforms CNN and RNN baselines by 8-13% in average precision. We view this model as a foundational model for health, as it is a single pre-trained representation that supports many downstream clinical prediction tasks. Another closely related model is CAREER (Vafa et al., [20]), a transformer-based foundational model that represents an individual’s career as a sequence of jobs and predicts the next occupation, which is conditioned on prior employment history and demographics. CAREER is pre-trained on 24 million job sequences from resumes and is fine-tuned on smaller longitudinal surveys, namely the National Longitudinal Survey of Youth 1979 (NLSY79), its NLSY97 cohort, and the Panel Study of Income Dynamics (PSID), where it outperforms standard econometric baselines.

We treat a criminal case as a sequence of events with structure per-step covariates and learn to predict the next outcome. This applies the same broad recipe to the criminal-court setting. Our corpus is drawn from a single jurisdiction, so we stop short of claiming a foundational model for criminal court at the scale of BEHRT or CAREER. Our setup is otherwise analogous. However, our task differs from these prior efforts in mainly three ways. First, CAREER operates on a regular annual grid in which each timestep corresponds to a calendar year and BEHRT carries irregular timing through a patient-internal age embedding. But in our proceedings, they occur at irregular intervals, which we address through the use of discrete month-year positional encodings in addition to ordinal step indices. Secondly, our sequences are heterogeneously multimodal, as we combine BERT-embedded clerk note text with structured demographic, charge, bond, and procedural stage features rather than just discrete occupation or diagnosis tokens with auxiliary covariates. Third, our supervision is multi-label per step, shared with BEHRT but distinct from CAREER, rather than single-label per step, since multiple events can occur within a single proceeding.

Embedding Components

We describe each component of the proceeding representation pt(n)p_t^{(n)} below.

Text Embedding (ψtext\psi_{\mathrm{text}}) Clerk notes text at(n)a_t^{(n)} is encoded using a pre-trained BERT model [6]. The text is tokenized with the corresponding WordPiece tokenizer, truncated to 512 tokens, and then the CLS representation from the final layer is taken as the embedding. BERT is not fine-tuned and uses frozen weights. See Appendix § 17 for additional information on the BERT encoder.

Defendant Demographics (ϕdemo\phi_{\mathrm{demo}}) Race (Black, White, Hispanic, Asian, Indigenous, Unknown), Gender (Male, Female, Unknown), and age at case initiation (continuous, in years) are combined into a single representation. Race and gender are encoded as learned embeddings, while age is normalized and concatenated directly.

Case (Charge) Embedding (ϕcharges\phi_{\mathrm{charges}}) Current charges for the case as of proceeding tt are represented as a vocabulary count vector ct(n)c_t^{(n)} over a fixed charge vocabulary VV. A linear projection layer maps this sparse count vector to a dense embedding. The projection weights are therefore initialized randomly and learned from scratch during training.

Prior Charge Embedding Aggregated prior charges Ct(n)C_t^{(n)}, which sum charge counts across all cases for the same defendant that began before proceeding tt, are encoded with the same ϕcharges\phi_{\mathrm{charges}}. Current and prior charges therefore share projection weights and are two separate 192-dimensional blocks, distinguished only by their position in the concatenation.

Prior Label Embedding (ϕprior_labels\phi_{\mathrm{prior\_labels}}) The multi-label outcome vector from the immediately preceding proceeding is passed through a linear projection. At t=1t = 1, this vector is set to 0K\mathbf{0}^{K}.

Court A Section (ϕcourt_a_sec\phi_{\mathrm{court\_a\_sec}}) The assigned Court A section identifier dt(n)d_t^{(n)} is encoded as a learned embedding and included only for proceedings that occur in Court A. The embedding is zeroed out for proceedings that take place in Court B.

Bond Amounts (ψbond\psi_{\mathrm{bond}}) jt(n)j_t^{(n)} is the bond amount recorded at the defendant’s initial hearing, while kt(n)k_t^{(n)} reflects the total amounts set or modified over the life of the case. Both are stored once per docket in the source court data and do not vary across proceedings within the same case. The two values are the same when the bond has never been revised and are different when it has been reset, revoked, or modified following new charges or violations. This allows the model to distinguish between a defendant whose bond has remained unchanged since the first appearance and one whose bond history reflects subsequent court action. Both values are encoded with the same deterministic encoder ψbond\psi_{\mathrm{bond}}, which discretizes a dollar amount into one of the following bins: {$0, $0–$1,000, $1,000–$5,000, $5,000–$10,000, $10,000–$25,000, $25,000–$50,000, $50,000–$100,000, > $100,000, “Not Set / Missing”}. “Not Set / Missing” is used both when the value is missing and at the sequence’s initial state, where no bond has been observed yet. This returns a one-hot vector.

Temporal Information (ψtime\psi_{\mathrm{time}}) The month-year of each proceeding τt(n)\tau_t^{(n)} is encoded as a one-hot vector over all the month-year combinations observed in the training data. This discrete encoding complements the learned positional embedding PEPE, as PEPE indexes ordinal position within the sequence, while the month-year one hot puts each step in terms of absolute calendar time and reflects the irregular spacing between proceedings.

Scalar Features Two scalar indicators are concatenated directly to the feature vector without further transformation: the court-type indicator ht(n)h_t^{(n)} (0 for Court A, 1 for Court B) and the prior case count lt(n)l_t^{(n)}, which counts the number of cases for the same defendant that precede this one.

Feature Fusion All components are concatenated along the feature dimension and passed through a single learned linear projection that maps the concatenated vector to the model’s hidden dimension dd, producing the final proceeding representation pt(n)p_t^{(n)}.

Interpretability

Integrated Gradients We report attributions for each of the eleven input component groups in Table 9. Attributions are computed within each fold and averaged across folds. Because raw attribution magnitudes depend on component dimensionality, values for the 768-dimensional BERT embedding are not directly comparable to those for scalar features such as prior case count. We therefore also report zz-scores computed within each outcome (Table 10), showing which inputs drive a given prediction, and across outcomes (Table 11), showing which outcomes a given input is most influential for. Outcomes present in only a single fold have an undefined standard deviation and are marked NA.

OutcomeText emb.Case emb.Prior charge emb.Prior label emb.Court A Sec. emb.Def. emb.TemporalBond sumOrig. bondCourt typePrior cases
Bond Set110.8050±NA110.8050 \pm\mathrm{NA}30.3496±NA30.3496 \pm\mathrm{NA}23.3237±NA23.3237 \pm\mathrm{NA}10.9694±NA10.9694 \pm\mathrm{NA}4.4393±NA4.4393 \pm\mathrm{NA}2.6275±NA2.6275 \pm\mathrm{NA}0.7764±NA0.7764 \pm\mathrm{NA}1.8679±NA1.8679 \pm\mathrm{NA}0.7430±NA0.7430 \pm\mathrm{NA}1.2260±NA1.2260 \pm\mathrm{NA}0.4723±NA0.4723 \pm\mathrm{NA}
Public Defender Appointed113.5933±15.552113.5933 \pm15.55247.4977±7.57647.4977 \pm7.57615.2448±11.16215.2448 \pm11.16213.7651±2.37313.7651 \pm2.3734.7651±0.6764.7651 \pm0.6764.2359±0.7614.2359 \pm0.7611.7981±0.2011.7981 \pm0.2011.3785±0.5401.3785 \pm0.5400.6102±0.2210.6102 \pm0.2210.4776±0.2970.4776 \pm0.2970.1670±0.1660.1670 \pm0.166
Released on Recognizance68.9643±12.28568.9643 \pm12.28542.2989±7.87042.2989 \pm7.87014.5345±14.08914.5345 \pm14.0895.3485±0.8075.3485 \pm0.8073.0551±1.4023.0551 \pm1.4023.1483±0.4723.1483 \pm0.4721.0612±0.2521.0612 \pm0.2521.0387±0.5191.0387 \pm0.5190.5263±0.2480.5263 \pm0.2480.2027±0.1290.2027 \pm0.1290.2432±0.2910.2432 \pm0.291
Ankle Monitoring Imposed77.5265±13.98077.5265 \pm13.98028.8517±4.42828.8517 \pm4.42822.9491±12.04822.9491 \pm12.0488.1434±1.5908.1434 \pm1.5903.3123±0.7113.3123 \pm0.7112.6922±1.1322.6922 \pm1.1320.8011±0.2000.8011 \pm0.2000.7985±0.5390.7985 \pm0.5390.5078±0.2870.5078 \pm0.2870.5243±0.3580.5243 \pm0.3580.2644±0.2780.2644 \pm0.278
Charges Refused78.9577±9.13078.9577 \pm9.13030.3561±3.82030.3561 \pm3.82011.3440±2.65111.3440 \pm2.6517.0821±0.6547.0821 \pm0.6543.0278±0.6433.0278 \pm0.6432.7769±0.2612.7769 \pm0.2610.8894±0.1040.8894 \pm0.1042.0752±0.5122.0752 \pm0.5120.3233±0.0410.3233 \pm0.0410.3347±0.0740.3347 \pm0.0740.2609±0.0720.2609 \pm0.072
Probable Cause Found111.6777±NA111.6777 \pm\mathrm{NA}34.3002±NA34.3002 \pm\mathrm{NA}29.7379±NA29.7379 \pm\mathrm{NA}9.1841±NA9.1841 \pm\mathrm{NA}2.5287±NA2.5287 \pm\mathrm{NA}3.0105±NA3.0105 \pm\mathrm{NA}1.4470±NA1.4470 \pm\mathrm{NA}0.3689±NA0.3689 \pm\mathrm{NA}0.3179±NA0.3179 \pm\mathrm{NA}0.2181±NA0.2181 \pm\mathrm{NA}0.2004±NA0.2004 \pm\mathrm{NA}
Pretrial Conference Held135.9125±7.196135.9125 \pm7.19636.1745±2.05436.1745 \pm2.05417.5502±1.94417.5502 \pm1.94410.2318±0.72610.2318 \pm0.7263.8323±0.6953.8323 \pm0.6953.2582±0.2433.2582 \pm0.2430.8663±0.0980.8663 \pm0.0980.9027±0.0670.9027 \pm0.0670.5989±0.2280.5989 \pm0.2280.4041±0.0510.4041 \pm0.0510.4952±0.1690.4952 \pm0.169
Pled Not Guilty87.1481±23.58887.1481 \pm23.58825.7732±4.46325.7732 \pm4.46324.2643±22.45224.2643 \pm22.45210.4375±2.64110.4375 \pm2.6413.2995±0.4073.2995 \pm0.4072.4129±0.0912.4129 \pm0.0910.9035±0.2770.9035 \pm0.2770.6346±0.1010.6346 \pm0.1010.5222±0.2460.5222 \pm0.2460.5374±0.1680.5374 \pm0.1680.4823±0.3500.4823 \pm0.350
Continuance Occurred99.6486±13.70599.6486 \pm13.70533.7928±3.33533.7928 \pm3.33514.8666±7.77214.8666 \pm7.7728.4613±1.3408.4613 \pm1.3402.8407±0.4202.8407 \pm0.4202.7832±0.3872.7832 \pm0.3870.6229±0.0700.6229 \pm0.0700.9160±0.2280.9160 \pm0.2280.5323±0.1500.5323 \pm0.1500.3534±0.1470.3534 \pm0.1470.2535±0.1280.2535 \pm0.128
In Custody, Not in Court97.2555±13.15897.2555 \pm13.15834.7989±9.30634.7989 \pm9.30618.4545±26.09718.4545 \pm26.0977.8922±0.4257.8922 \pm0.4252.9123±0.1252.9123 \pm0.1253.5423±0.5903.5423 \pm0.5900.6070±0.1190.6070 \pm0.1190.9809±0.3930.9809 \pm0.3930.3108±0.2170.3108 \pm0.2170.3091±0.1750.3091 \pm0.1750.1495±0.2110.1495 \pm0.211
Pled Guilty137.0264±2.133137.0264 \pm2.13359.4222±1.71459.4222 \pm1.71424.1409±1.33424.1409 \pm1.33411.4992±0.58711.4992 \pm0.5875.7652±1.7705.7652 \pm1.7704.8484±0.5024.8484 \pm0.5021.3225±0.2021.3225 \pm0.2021.3847±0.0881.3847 \pm0.0880.8151±0.2190.8151 \pm0.2190.9314±0.3090.9314 \pm0.3090.7666±0.0650.7666 \pm0.065
Trial Verdict Reached115.8153±7.414115.8153 \pm7.41439.2843±2.65939.2843 \pm2.65917.5370±4.96717.5370 \pm4.9678.4057±0.4878.4057 \pm0.4873.5867±0.6663.5867 \pm0.6663.5114±0.4933.5114 \pm0.4930.9982±0.1440.9982 \pm0.1440.8832±0.1710.8832 \pm0.1710.510.51
Sentence Includes Jail Time130.3489±5.197130.3489 \pm5.19751.9305±2.88851.9305 \pm2.88826.6803±1.78626.6803 \pm1.78610.4391±0.83110.4391 \pm0.8314.8257±1.4764.8257 \pm1.4764.6398±0.8024.6398 \pm0.8021.0136±0.0711.0136 \pm0.0711.3005±0.2771.3005 \pm0.2770.7442±0.2400.7442 \pm0.2400.8327±0.2550.8327 \pm0.2550.6768±0.0990.6768 \pm0.099
Sentence Excludes Jail Time133.6322±6.479133.6322 \pm6.47956.8237±2.45856.8237 \pm2.45818.4084±3.46118.4084 \pm3.46110.0458±0.33010.0458 \pm0.3305.5110±1.1095.5110 \pm1.1094.3974±0.2304.3974 \pm0.2301.8706±0.2781.8706 \pm0.2781.2729±0.1941.2729 \pm0.1940.7076±0.0920.7076 \pm0.0920.7578±0.2410.7578 \pm0.2410.7206±0.1430.7206 \pm0.143
Mean Attribution110.6558±5.184110.6558 \pm5.18441.9691±1.85541.9691 \pm1.85518.7662±2.43818.7662 \pm2.4389.5488±0.4969.5488 \pm0.4964.0503±0.7204.0503 \pm0.7203.5957±0.3093.5957 \pm0.3091.1170±0.1131.1170 \pm0.1131.1852±0.1441.1852 \pm0.1440.5860±0.1360.5860 \pm0.1360.5630±0.0420.5630 \pm0.0420.4286±0.0450.4286 \pm0.045

Table 9. Raw attribution magnitude by outcome and feature group. Cells report mean ± standard deviation across folds. Outcome names are abbreviated. See Table 2 for full label names.

OutcomeText emb.Case emb.Prior charge emb.Prior label emb.Court A Sec. emb.Def. emb.TemporalBond sumOrig. bondCourt typePrior cases
Bond Set3.0064±NA3.0064 \pm\mathrm{NA}0.4263±NA0.4263 \pm\mathrm{NA}0.2010±NA0.2010 \pm\mathrm{NA}−0.1951±NA-0.1951 \pm\mathrm{NA}−0.4045±NA-0.4045 \pm\mathrm{NA}−0.4626±NA-0.4626 \pm\mathrm{NA}−0.5220±NA-0.5220 \pm\mathrm{NA}−0.4870±NA-0.4870 \pm\mathrm{NA}−0.5231±NA-0.5231 \pm\mathrm{NA}−0.5076±NA-0.5076 \pm\mathrm{NA}−0.5318±NA-0.5318 \pm\mathrm{NA}
Public Defender Appointed2.8787±0.0352.8787 \pm0.0350.8750±0.1170.8750 \pm0.117−0.0763±0.355-0.0763 \pm0.355−0.1465±0.047-0.1465 \pm0.047−0.4178±0.019-0.4178 \pm0.019−0.4339±0.042-0.4339 \pm0.042−0.5072±0.026-0.5072 \pm0.026−0.5217±0.033-0.5217 \pm0.033−0.5444±0.031-0.5444 \pm0.031−0.5487±0.035-0.5487 \pm0.035−0.5572±0.024-0.5572 \pm0.024
Released on Recognizance2.5751±0.2492.5751 \pm0.2491.3608±0.1821.3608 \pm0.1820.1165±0.6770.1165 \pm0.677−0.3434±0.077-0.3434 \pm0.077−0.4527±0.071-0.4527 \pm0.071−0.4454±0.072-0.4454 \pm0.072−0.5407±0.064-0.5407 \pm0.064−0.5414±0.097-0.5414 \pm0.097−0.5665±0.073-0.5665 \pm0.073−0.5815±0.079-0.5815 \pm0.079−0.5800±0.074-0.5800 \pm0.074
Ankle Monitoring Imposed2.8643±0.0552.8643 \pm0.0550.7018±0.0870.7018 \pm0.0870.3845±0.3650.3845 \pm0.365−0.2424±0.030-0.2424 \pm0.030−0.4349±0.082-0.4349 \pm0.082−0.4493±0.050-0.4493 \pm0.050−0.5532±0.028-0.5532 \pm0.028−0.5551±0.101-0.5551 \pm0.101−0.5669±0.021-0.5669 \pm0.021−0.5669±0.014-0.5669 \pm0.014−0.5788±0.024-0.5788 \pm0.024
Charges Refused2.9323±0.0322.9323 \pm0.0320.7871±0.0620.7871 \pm0.062−0.0438±0.119-0.0438 \pm0.119−0.2387±0.018-0.2387 \pm0.018−0.4176±0.039-0.4176 \pm0.039−0.4291±0.019-0.4291 \pm0.019−0.5128±0.017-0.5128 \pm0.017−0.4615±0.026-0.4615 \pm0.026−0.5379±0.014-0.5379 \pm0.014−0.5375±0.015-0.5375 \pm0.015−0.5405±0.013-0.5405 \pm0.013
Probable Cause Found2.9436±NA2.9436 \pm\mathrm{NA}0.5240±NA0.5240 \pm\mathrm{NA}0.3813±NA0.3813 \pm\mathrm{NA}−0.2614±NA-0.2614 \pm\mathrm{NA}−0.4696±NA-0.4696 \pm\mathrm{NA}−0.4545±NA-0.4545 \pm\mathrm{NA}−0.5034±NA-0.5034 \pm\mathrm{NA}−0.5371±NA-0.5371 \pm\mathrm{NA}−0.5387±NA-0.5387 \pm\mathrm{NA}−0.5418±NA-0.5418 \pm\mathrm{NA}−0.5244±NA-0.5244 \pm\mathrm{NA}
Pretrial Conference Held3.0427±0.0053.0427 \pm0.0050.4448±0.0370.4448 \pm0.037−0.0406±0.045-0.0406 \pm0.045−0.2316±0.009-0.2316 \pm0.009−0.3975±0.019-0.3975 \pm0.019−0.4128±0.006-0.4128 \pm0.006−0.4754±0.005-0.4754 \pm0.005−0.4745±0.005-0.4745 \pm0.005−0.4825±0.008-0.4825 \pm0.008−0.4875±0.004-0.4875 \pm0.004−0.4851±0.003-0.4851 \pm0.003
Pled Not Guilty2.9299±0.0942.9299 \pm0.0940.4848±0.1590.4848 \pm0.1590.3147±0.6090.3147 \pm0.609−0.1438±0.053-0.1438 \pm0.053−0.4281±0.061-0.4281 \pm0.061−0.4631±0.063-0.4631 \pm0.063−0.5272±0.037-0.5272 \pm0.037−0.5374±0.042-0.5374 \pm0.042−0.5429±0.034-0.5429 \pm0.034−0.5418±0.038-0.5418 \pm0.038−0.5452±0.029-0.5452 \pm0.029
Continuance Occurred2.9649±0.0282.9649 \pm0.0280.6621±0.0570.6621 \pm0.0570.0024±0.2510.0024 \pm0.251−0.2312±0.021-0.2312 \pm0.021−0.4268±0.027-0.4268 \pm0.027−0.4291±0.023-0.4291 \pm0.023−0.5055±0.026-0.5055 \pm0.026−0.4954±0.029-0.4954 \pm0.029−0.5085±0.028-0.5085 \pm0.028−0.5151±0.030-0.5151 \pm0.030−0.5179±0.023-0.5179 \pm0.023
In Custody, Not in Court2.8877±0.0972.8877 \pm0.0970.6710±0.2480.6710 \pm0.2480.1745±0.9290.1745 \pm0.929−0.2581±0.028-0.2581 \pm0.028−0.4355±0.070-0.4355 \pm0.070−0.4142±0.084-0.4142 \pm0.084−0.5164±0.072-0.5164 \pm0.072−0.4544±0.088-0.4544 \pm0.088−0.5277±0.086-0.5277 \pm0.086−0.5276±0.084-0.5276 \pm0.084−0.5324±0.071-0.5324 \pm0.071
Pled Guilty2.8702±0.0092.8702 \pm0.0090.9244±0.0270.9244 \pm0.0270.0406±0.0400.0406 \pm0.040−0.2767±0.013-0.2767 \pm0.013−0.4208±0.040-0.4208 \pm0.040−0.4434±0.009-0.4434 \pm0.009−0.5319±0.006-0.5319 \pm0.006−0.5303±0.005-0.5303 \pm0.005−0.5447±0.009-0.5447 \pm0.009−0.5417±0.007-0.5417 \pm0.007−0.5438±0.005-0.5438 \pm0.005
Trial Verdict Reached2.9734±0.0132.9734 \pm0.0130.6609±0.0520.6609 \pm0.0520.0037±0.1350.0037 \pm0.135−0.2721±0.016-0.2721 \pm0.016−0.4180±0.020-0.4180 \pm0.020−0.4210±0.012-0.4210 \pm0.012−0.4966±0.015-0.4966 \pm0.015−0.5002±0.015-0.5002 \pm0.015−0.5112±0.019-0.5112 \pm0.019−0.5061±0.017-0.5061 \pm0.017−0.5136±0.015-0.5136 \pm0.015
Sentence Includes Jail Time2.8968±0.0102.8968 \pm0.0100.8145±0.0310.8145 \pm0.0310.1461±0.0550.1461 \pm0.055−0.2865±0.016-0.2865 \pm0.016−0.4365±0.038-0.4365 \pm0.038−0.4401±0.015-0.4401 \pm0.015−0.5366±0.009-0.5366 \pm0.009−0.5922±0.013-0.5922 \pm0.013−0.5438±0.013-0.5438 \pm0.013−0.5424±0.011-0.5424 \pm0.011−0.5465±0.011-0.5465 \pm0.011
Sentence Excludes Jail Time2.8905±0.0202.8905 \pm0.0200.9152±0.0530.9152 \pm0.053−0.0737±0.083-0.0737 \pm0.083−0.2890±0.015-0.2890 \pm0.015−0.4061±0.031-0.4061 \pm0.031−0.4346±0.007-0.4346 \pm0.007−0.4996±0.009-0.4996 \pm0.009−0.5521±0.009-0.5521 \pm0.009−0.5298±0.007-0.5298 \pm0.007−0.5284±0.014-0.5284 \pm0.014−0.5294±0.007-0.5294 \pm0.007
Mean Z-Score Within Label2.9046±0.0282.9046 \pm0.0280.7714±0.0690.7714 \pm0.069−0.0535±0.063-0.0535 \pm0.063−0.2474±0.013-0.2474 \pm0.013−0.4218±0.025-0.4218 \pm0.025−0.4357±0.014-0.4357 \pm0.014−0.5140±0.005-0.5140 \pm0.005−0.5106±0.009-0.5106 \pm0.009−0.5312±0.006-0.5312 \pm0.006−0.5323±0.008-0.5323 \pm0.008−0.5365±0.007-0.5365 \pm0.007

Table 10. Within-label standardized attribution by outcome and feature group. Cells report mean ± standard deviation across folds.

OutcomeText emb.Case emb.Prior charge emb.Prior label emb.Court A Sec. emb.Def. emb.TemporalBond sumOrig. bondCourt typePrior cases
Bond Set−0.3007±NA-0.3007 \pm\mathrm{NA}−1.1217±NA-1.1217 \pm\mathrm{NA}0.2522±NA0.2522 \pm\mathrm{NA}0.8114±NA0.8114 \pm\mathrm{NA}0.4422±NA0.4422 \pm\mathrm{NA}−0.6134±NA-0.6134 \pm\mathrm{NA}−0.7730±NA-0.7730 \pm\mathrm{NA}1.4749±NA1.4749 \pm\mathrm{NA}−0.2053±NA-0.2053 \pm\mathrm{NA}2.3795±NA2.3795 \pm\mathrm{NA}−0.0066±NA-0.0066 \pm\mathrm{NA}
Public Defender Appointed0.0955±0.5980.0955 \pm0.5980.5233±0.6660.5233 \pm0.666−0.3610±1.152-0.3610 \pm1.1521.8460±0.5991.8460 \pm0.5990.8723±1.0060.8723 \pm1.0060.7247±0.5670.7247 \pm0.5671.6455±0.3431.6455 \pm0.3430.3419±0.9680.3419 \pm0.9680.1299±1.2660.1299 \pm1.266−0.2940±1.000-0.2940 \pm1.000−0.9960±0.524-0.9960 \pm0.524
Released on Recognizance−1.5175±0.616-1.5175 \pm0.616−0.0076±0.747-0.0076 \pm0.747−0.2740±1.653-0.2740 \pm1.653−1.5742±0.277-1.5742 \pm0.277−0.9152±0.528-0.9152 \pm0.528−0.6113±0.524-0.6113 \pm0.524−0.2969±0.516-0.2969 \pm0.516−0.1974±1.064-0.1974 \pm1.064−0.2548±1.099-0.2548 \pm1.099−1.0967±0.555-1.0967 \pm0.555−0.6302±1.012-0.6302 \pm1.012
Ankle Monitoring Imposed−1.4133±0.143-1.4133 \pm0.143−1.0997±0.269-1.0997 \pm0.2690.3822±1.6340.3822 \pm1.634−0.6498±0.501-0.6498 \pm0.501−0.9304±0.335-0.9304 \pm0.335−0.8904±1.092-0.8904 \pm1.092−0.6628±0.551-0.6628 \pm0.551−0.7459±0.880-0.7459 \pm0.880−0.4793±0.952-0.4793 \pm0.952−0.0571±1.053-0.0571 \pm1.053−0.8776±1.354-0.8776 \pm1.354
Charges Refused−1.3137±0.279-1.3137 \pm0.279−1.0539±0.376-1.0539 \pm0.376−0.9652±0.346-0.9652 \pm0.346−1.1835±0.419-1.1835 \pm0.419−0.9499±0.366-0.9499 \pm0.366−0.9317±0.245-0.9317 \pm0.245−0.5424±0.375-0.5424 \pm0.3751.8592±0.5951.8592 \pm0.595−1.4997±0.408-1.4997 \pm0.408−0.7347±0.221-0.7347 \pm0.221−0.6632±0.167-0.6632 \pm0.167
Probable Cause Found0.0238±NA0.0238 \pm\mathrm{NA}−0.5584±NA-0.5584 \pm\mathrm{NA}0.7285±NA0.7285 \pm\mathrm{NA}−0.2287±NA-0.2287 \pm\mathrm{NA}−0.7863±NA-0.7863 \pm\mathrm{NA}−0.7144±NA-0.7144 \pm\mathrm{NA}1.0586±NA1.0586 \pm\mathrm{NA}−1.8991±NA-1.8991 \pm\mathrm{NA}−0.7826±NA-0.7826 \pm\mathrm{NA}−1.0201±NA-1.0201 \pm\mathrm{NA}−0.8464±NA-0.8464 \pm\mathrm{NA}
Pretrial Conference Held1.0562±0.2181.0562 \pm0.218−0.5267±0.163-0.5267 \pm0.163−0.1514±0.220-0.1514 \pm0.2200.3589±0.4290.3589 \pm0.429−0.2009±0.271-0.2009 \pm0.271−0.4170±0.403-0.4170 \pm0.403−0.6075±0.099-0.6075 \pm0.099−0.6226±0.228-0.6226 \pm0.228−0.0702±0.746-0.0702 \pm0.746−0.5237±0.238-0.5237 \pm0.2380.2666±0.5460.2666 \pm0.546
Pled Not Guilty−1.1237±1.161-1.1237 \pm1.161−1.3613±0.423-1.3613 \pm0.4230.3605±1.8170.3605 \pm1.8170.2074±1.1310.2074 \pm1.131−0.2693±0.772-0.2693 \pm0.772−1.6533±0.602-1.6533 \pm0.602−0.3511±0.583-0.3511 \pm0.583−1.0901±0.030-1.0901 \pm0.030−0.0389±1.463-0.0389 \pm1.463−0.1297±0.734-0.1297 \pm0.7340.1869±1.0570.1869 \pm1.057
Continuance Occurred−0.4406±0.486-0.4406 \pm0.486−0.7398±0.215-0.7398 \pm0.215−0.4153±1.205-0.4153 \pm1.205−0.4957±0.534-0.4957 \pm0.534−1.0767±0.248-1.0767 \pm0.248−0.9327±0.196-0.9327 \pm0.196−1.1960±0.261-1.1960 \pm0.261−0.6100±0.368-0.6100 \pm0.368−0.2894±0.300-0.2894 \pm0.300−0.6624±0.444-0.6624 \pm0.444−0.7303±0.488-0.7303 \pm0.488
In Custody, Not in Court−0.5957±0.521-0.5957 \pm0.521−0.5703±0.790-0.5703 \pm0.790−0.2778±2.317-0.2778 \pm2.317−0.8489±0.322-0.8489 \pm0.322−0.6579±0.238-0.6579 \pm0.238−0.1491±0.643-0.1491 \pm0.643−1.1476±0.050-1.1476 \pm0.050−0.5190±0.846-0.5190 \pm0.846−0.6398±1.267-0.6398 \pm1.267−0.8642±0.369-0.8642 \pm0.369−0.9662±0.639-0.9662 \pm0.639
Pled Guilty1.0953±0.2021.0953 \pm0.2021.5729±0.1291.5729 \pm0.1290.7298±0.3700.7298 \pm0.3700.8908±0.4090.8908 \pm0.4091.4114±0.4911.4114 \pm0.4911.4482±0.0461.4482 \pm0.0460.4924±0.2450.4924 \pm0.2450.4578±0.4500.4578 \pm0.4501.3351±0.4291.3351 \pm0.4291.1585±0.9531.1585 \pm0.9531.3516±0.2251.3516 \pm0.225
Trial Verdict Reached0.2156±0.2460.2156 \pm0.246−0.2437±0.305-0.2437 \pm0.305−0.1286±0.745-0.1286 \pm0.745−0.5678±0.471-0.5678 \pm0.471−0.4323±0.264-0.4323 \pm0.264−0.0942±0.391-0.0942 \pm0.391−0.2558±0.369-0.2558 \pm0.369−0.6312±0.522-0.6312 \pm0.522−0.3551±0.423-0.3551 \pm0.4230.4300.430−0.6835±0.682-0.6835 \pm0.682
Sentence Includes Jail Time0.8186±0.1520.8186 \pm0.1520.9018±0.3110.9018 \pm0.3111.0703±0.5921.0703 \pm0.5920.3906±0.3270.3906 \pm0.3270.5738±0.4040.5738 \pm0.4041.1345±0.4841.1345 \pm0.484−0.2189±0.210-0.2189 \pm0.2100.3101±0.5690.3101 \pm0.5690.8562±0.4490.8562 \pm0.4490.8443±0.7920.8443 \pm0.7920.9884±0.4330.9884 \pm0.433
Sentence Excludes Jail Time0.9747±0.3270.9747 \pm0.3271.3392±0.2111.3392 \pm0.211−0.0726±0.173-0.0726 \pm0.1730.2350±0.3510.2350 \pm0.3511.3493±0.4041.3493 \pm0.4040.9562±0.4460.9562 \pm0.4461.8009±0.0891.8009 \pm0.0890.1891±0.7930.1891 \pm0.7930.8288±0.6200.8288 \pm0.6200.5995±0.7700.5995 \pm0.7701.2034±0.4981.2034 \pm0.498

Table 11. Across-label standardized attribution by outcome and feature group. Cells report mean ±\pm standard deviation across folds.

Counterfactual Sensitivity Counterfactual fairness in its strict form requires a fully specified causal graph. Our procedure, which is the process of swapping each demographic value to all other observed values and measuring the resulting shift in predicted probability, provides an empirical proxy that does not require causal identification, while still allowing us to compare the model’s responsiveness to legally relevant features (e.g., prior case count) against protected ones (e.g., race). Full per-label breakdowns for prior case count, age, and race appear in Figure 6–Figure 8.

Prior Case Count — Signed ΔP with 95% CI

Figure 6. Prior Case Count Counterfactual

Race Counterfactual

Figure 8. Race Counterfactual

Proceeding-Level Per-Label Performance

Table 7 reports the proceeding-level per-label performance for the full transformer under 5-fold cross-validation. Performance is evaluated at each individual proceeding against the ground-truth labels (regex-generated) for that step.

LabelPrecisionRecallF1-ScoreSupport
First Appearance Hearing Occurred.9977±.00.9977 \pm.00.9877±.01.9877 \pm.01.9926±.00.9926 \pm.00517.8±3.5517.8 \pm3.5
Court Appointed Public Defender.7992±.02.7992 \pm.02.7961±.02.7961 \pm.02.7972±.01.7972 \pm.01634.6±11.3634.6 \pm11.3
Bond Set.7123±.02.7123 \pm.02.7598±.01.7598 \pm.01.7351±.01.7351 \pm.01740.6±14.9740.6 \pm14.9
Pre-Trial Conference Held.6598±.01.6598 \pm.01.6563±.03.6563 \pm.03.6576±.02.6576 \pm.02625.6±73.0625.6 \pm73.0
Domestic Stay-Away Order Imposed.6350±.03.6350 \pm.03.6657±.05.6657 \pm.05.6479±.02.6479 \pm.02109.2±4.0109.2 \pm4.0
Pled Not Guilty to Charges.5489±.03.5489 \pm.03.7883±.02.7883 \pm.02.6469±.03.6469 \pm.03326.6±7.9326.6 \pm7.9
Charges Refused.4941±.03.4941 \pm.03.4958±.02.4958 \pm.02.4939±.01.4939 \pm.01369.6±13.3369.6 \pm13.3
State Was Not Present.6098±.07.6098 \pm.07.4118±.05.4118 \pm.05.4914±.06.4914 \pm.06137.0±13.7137.0 \pm13.7
Probable Cause Found.5741±.03.5741 \pm.03.4054±.03.4054 \pm.03.4743±.02.4743 \pm.02286.2±8.6286.2 \pm8.6
Defendant Released on Own Recognizance.5242±.04.5242 \pm.04.4060±.07.4060 \pm.07.4549±.05.4549 \pm.05179.8±18.9179.8 \pm18.9
Continuance Occurred.4452±.01.4452 \pm.01.4415±.04.4415 \pm.04.4426±.02.4426 \pm.021084.8±90.11084.8 \pm90.1
Ankle Monitoring Imposed.5673±.07.5673 \pm.07.3571±.06.3571 \pm.06.4376±.06.4376 \pm.0691.2±6.591.2 \pm6.5
Sentence Without Jail Time Imposed.4596±.06.4596 \pm.06.3272±.04.3272 \pm.04.3793±.04.3793 \pm.0480.2±8.480.2 \pm8.4
Pled Guilty to Charges.2939±.04.2939 \pm.04.5214±.03.5214 \pm.03.3733±.03.3733 \pm.03215.4±5.7215.4 \pm5.7
Sentence Including Jail Time Imposed.2851±.05.2851 \pm.05.4207±.04.4207 \pm.04.3388±.04.3388 \pm.04161.2±7.8161.2 \pm7.8
Defendant in Custody and Not in Court.4016±.02.4016 \pm.02.2496±.03.2496 \pm.03.3075±.03.3075 \pm.03338.6±46.9338.6 \pm46.9
Trial Verdict Reached.2800±.03.2800 \pm.03.2975±.07.2975 \pm.07.2838±.04.2838 \pm.0480.8±9.080.8 \pm9.0
Probable Cause Not Found.2349±.03.2349 \pm.03.2362±.05.2362 \pm.05.2349±.04.2349 \pm.0488.4±3.688.4 \pm3.6
Bond Not Set.2206±.04.2206 \pm.04.1349±.01.1349 \pm.01.1661±.01.1661 \pm.01198.2±22.0198.2 \pm22.0
Charges Accepted.1425±.01.1425 \pm.01.1305±.04.1305 \pm.04.1340±.02.1340 \pm.0292.4±9.192.4 \pm9.1

Table 7. Proceeding-level per-label performance (mean ±\pm std over 5 folds), sorted by F1 score.

Case-Level Evaluation

Table 8 reports case-level per-label performance, where proceeding-level predictions are aggregated across all proceedings within a case. Performance is consistently higher than at the proceeding level, as the model has numerous chances across a case to correctly identify whether each outcome ever occurs. Outcomes such as “Continuance Occurred” and “Pled Guilty to Charges” show the largest gains from aggregation, which suggests that these outcomes have distributed lexical indicators that accumulate across proceedings.

LabelPrecisionRecallF1-ScoreSupport
First Appearance Hearing Occurred.999±.001.999 \pm.001.999±.001.999 \pm.001.999±.001.999 \pm.001506.2±0.837506.2 \pm0.837
Bond Set.950±.013.950 \pm.013.948±.009.948 \pm.009.949±.004.949 \pm.004463.6±7.701463.6 \pm7.701
Court Appointed Public Defender.894±.017.894 \pm.017.924±.026.924 \pm.026.909±.013.909 \pm.013415.6±6.841415.6 \pm6.841
Pled Not Guilty to Charges.902±.020.902 \pm.020.829±.025.829 \pm.025.864±.010.864 \pm.010318.2±7.791318.2 \pm7.791
Pre-Trial Conference Held.824±.028.824 \pm.028.842±.016.842 \pm.016.833±.016.833 \pm.016227.0±16.778227.0 \pm16.778
Continuance Occurred.778±.012.778 \pm.012.755±.030.755 \pm.030.766±.017.766 \pm.017329.2±2.588329.2 \pm2.588
Domestic Stay-Away Order Imposed.650±.032.650 \pm.032.689±.055.689 \pm.055.667±.016.667 \pm.016107.0±4.472107.0 \pm4.472
Charges Refused.829±.027.829 \pm.027.551±.030.551 \pm.030.662±.017.662 \pm.017293.4±14.311293.4 \pm14.311
Pled Guilty to Charges.798±.033.798 \pm.033.538±.033.538 \pm.033.642±.026.642 \pm.026212.6±7.603212.6 \pm7.603
Probable Cause Found.733±.021.733 \pm.021.550±.039.550 \pm.039.628±.027.628 \pm.027232.0±6.782232.0 \pm6.782
Defendant Released on Own Recognizance.646±.035.646 \pm.035.542±.051.542 \pm.051.588±.030.588 \pm.030112.4±12.095112.4 \pm12.095
State Was Not Present.665±.070.665 \pm.070.495±.080.495 \pm.080.567±.077.567 \pm.077106.4±10.784106.4 \pm10.784
Defendant in Custody and Not in Court.680±.016.680 \pm.016.479±.043.479 \pm.043.561±.027.561 \pm.027121.6±7.301121.6 \pm7.301
Sentence Including Jail Time Imposed.668±.016.668 \pm.016.438±.052.438 \pm.052.527±.042.527 \pm.042161.2±8.758161.2 \pm8.758
Ankle Monitoring Imposed.673±.077.673 \pm.077.421±.059.421 \pm.059.518±.065.518 \pm.06583.4±7.43683.4 \pm7.436
Sentence Without Jail Time Imposed.643±.070.643 \pm.070.342±.061.342 \pm.061.444±.058.444 \pm.05880.2±9.36580.2 \pm9.365
Trial Verdict Reached.602±.047.602 \pm.047.317±.064.317 \pm.064.411±.055.411 \pm.05580.0±10.12480.0 \pm10.124
Bond Not Set.462±.043.462 \pm.043.267±.023.267 \pm.023.337±.023.337 \pm.023156.2±16.407156.2 \pm16.407
Probable Cause Not Found.284±.026.284 \pm.026.279±.036.279 \pm.036.281±.030.281 \pm.03084.2±4.97084.2 \pm4.970
Charges Accepted.330±.049.330 \pm.049.226±.056.226 \pm.056.264±.045.264 \pm.04590.8±10.40290.8 \pm10.402

Table 8. Per-Class Performance for Case Level Evaluation (Averaged over 5 Folds), Sorted by F1-Score

K-means

Figure 5 shows the results of t-SNE clustering.

t-SNE Embeddings — K-Means Clusters (Fold 1 (best))

Figure 5. Clustering results

Attribution Tables

Table 9–Table 11 report the fold-level attribution summaries used in the feature attribution analysis. Each cell reports the mean and standard deviation across available folds. Cells with NA have an undefined standard deviation because the outcome was present in only one fold.

Implementation Details

The complete experimental pipeline, including BERT embedding pre-computation, 5-fold cross-validation training of the transformer, the random and MLP baselines, all ablation runs, and the interpretability analyses, took approximately 11 hours.

Transformer Architecture This model uses a hidden dimension of 896, 4 transformer encoder layers, 8 attention heads, a feed-forward dimension of 2048, GELU activation functions, and dropout of 0.2. The maximum sequence length is 200. Learned positional embeddings are initialized from N(0,0.022)\mathcal{N}(0, 0.02^{2}) and are added to each step. A causal mask is applied at every layer so that proceeding tt attends to only the proceedings ≤t\le t. The fuse layer that maps the concatenated proceeding representation to the model hidden dimension is represented as Linear →\to LayerNorm →\to ReLU →\to Dropout. The model has 29,570,766 trainable parameters (approximately 113 MB at 32-bit precision), with the majority concentrated in the Transformer encoder (27.6M parameters, 93% of the total) and the fuse layer (1.4M parameters, 5%). All other components, including the defendant, case, Court A section, and prior-label embeddings, together account for less than 2% of the parameter count. Note that the cached BERT text embedding is loaded from disk and contributes no trainable parameters to this model. All training was performed on a single NVIDIA RTX A5000 GPU.

Component Dimensions Before fusion, each proceeding representation concatenates: defendant embedding (32), case (charge) embedding (192), BERT text embedding (768), Court A section embedding (32), prior-label embedding (96, from Linear(20→9620 \to96)), prior-charge embedding (192, separate linear projection sharing structure with the case embedding), court-type indicator (1), original-bond one-hot (9), cumulative-bond one-hot (9), prior-case-count scalar (1), and a one-hot month-year vector. The month-year dimension is not fixed. Rather, it is set to the number of years observed in training ×12\times12.

BERT Encoder We use bert-base-uncased to encode clerk notes, and its weights are frozen. Text is tokenized, truncated to 512 tokens, and then we extract the final layer CLS representation. Embeddings are pre-computed once and cached to disk. BERT is not fine-tuned at any stage. We selected bert-base-uncased for its simplicity and scalability, and we leave comparison against larger embedding models and against fine-tuned models to future work.

Optimization The model is trained with AdamW (learning rate 2×10−52 \times10^{-5}, weight decay 0.01), batch size 16, for 20 epochs, with a OneCycleLR schedule (max learning rate 5×5 \times base, 30% warmup, cosine annealing, initial divisor 25, final divisor 10410^{4}). Gradients are clipped to norm 1.0, mixed-precision training is enabled, and the loss is unweighted BCEWithLogitsLoss applied per-label.

Age Counterfactual

Figure 7. Age Counterfactual

MLP Baseline The completion-prediction baseline is a 3-layer feed-forward network: Linear(din→64d_{\mathrm{in}} \to64) →\to ReLU →\to Linear(64→6464 \to64) →\to ReLU →\to Linear(64→564 \to5). Inputs are the features available at the initial proceeding (defendant demographics, initial charges, Court A section), with StandardScaler applied to continuous features and LabelEncoder applied to the Court A section. The model is trained with Adam (learning rate 10−310^{-3}), cross-entropy loss over the 5 completion classes (single-label), batch size 16, and 20 epochs. At inference, predictions are taken as the argmax over the 5 classes.

GRU Baseline This baseline replaces the transformer encoder with a two-layer unidirectional GRU whose hidden dimension of 896 matches that of the transformer. A Linear(896→20896 \to20) classification layer is applied to the hidden state at each step, and there is a dropout of 0.2 between GRU layers. The baseline reuses the same preceding representation pt(n)p_t^{(n)} as the transformer, including the embedding functions and fusion layer, which are jointly trained with the GRU. The transformer’s encoder and positional embeddings are unused. The model is trained with Adam (learning rate 2×10−52 \times10^{-5}, weight decay 0.01), batch size 16, for 20 epochs, OneCycleLR scheduling, gradient clipping at norm 1.0, mixed precision, and BCEWithLogitsLoss applied per-label, which is identical to the transformer.

ModelMacro F1Weighted F1
MLP Baseline.2569 ± .015.4389 ± .025
Transformer.4260 ± .026.5650 ± .015

Table 13. Completion-level performance (mean ± std). Not comparable to Table 12.

ModelMacro F1Weighted F1
Transformer.4745 ± .009.5671 ± .012
GRU Baseline.4586 ± .010.5732 ± .013
Random Baseline.1183 ± .002.1824 ± .004

Table 12. Step-level performance (mean ± std)

Data and Code Availability

We release the full pipeline (label extraction, feature construction, model training, and all interpretability analyses) at https://github.com/tapilab/docket_sequence_modeling. We do not release the underlying court records. Expungement in the jurisdiction studied removes a record from public access without destroying it. A static release cannot honor expungement orders issued after publication, and would permanently reintroduce records that defendants are entitled to have removed. Additionally, the clerk notes name victims, witnesses, and other third parties who are not case participants, and hand-entered free text of this kind cannot be reliably de-identified at scale. In place of the source corpus, we release a synthetic dataset matching the schema, field types, and label vocabulary of the real data.

Macro and Weighted F1 Scores

Tables 12 and 13 report macro-averaged and weighted-averaged F1 scores for the step-level and completion level evaluations. These complement the micro-averaged results in Table 3 and Table 4 in the main paper.

Threshold-Based Results

The step-level results in the paper select the true number of labels ktk_t at each proceeding. In this appendix section, we report the performance using labels selected by thresholding the sigmoid output for each label. The transformer model achieves a micro-F1 of .5213 using the default 0.5 binary classification threshold and .5288 using a threshold tuned on held-out data within each training fold. These scores are modestly lower than the .5715 achieved under top-ktk_t selection, though they remain in a practically similar range.

References

  1. [1]Nikolaos Aletras, Dimitrios Tsarapatsanis, Daniel Preotiuc-Pietro, and Vasileios Lampos. 2016. Predicting judicial decisions of the european court of human rights: A natural language processing perspective. PeerJ computer science, 2:e93.DOI
  2. [2]Julia Angwin, Jeff Larson, Surya Mattu, and Lauren Kirchner. 2016. Machine bias: There’s software used across the country to predict future criminals, and it’s biased against blacks. ProPublica. Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), pages 6957–6970, Albuquerque, New Mexico. Association for Computational Linguistics.
  3. [3]Solon Barocas, Anhong Guo, Ece Kamar, Jacquelyn Krones, Meredith Ringel Morris, Jennifer Wortman Vaughan, W. Duncan Wadsworth, and Hanna Wallach. 2021. Designing disaggregated evaluations of ai systems: Choices, considerations, and tradeoffs. In Proceedings of the 2021 AAAI/ACM Conference on AI, Ethics, and Society, AIES ’21, page 368–378, New York, NY, USA. Association for Computing Machinery.arxiv.org/abs/2103.06076
  4. [4]Ilias Chalkidis, Ion Androutsopoulos, and Nikolaos Aletras. 2019. Neural legal judgment prediction in English. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 4317–4323, Florence, Italy. Association for Computational Linguistics.arxiv.org/abs/1906.02059
  5. [5]Ilias Chalkidis, Manos Fergadiotis, Prodromos Malakasiotis, Nikolaos Aletras, and Ion Androutsopoulos. 2020. LEGAL-BERT: The muppets straight out of law school. In Findings of the Association for Computational Linguistics: EMNLP 2020, pages 2898–2904, Online. Association for Computational Linguistics.arxiv.org/abs/2010.02559
  6. [6]Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), pages 4171–4186, Minneapolis, Minnesota. Association for Computational Linguistics.arxiv.org/abs/1810.04805
  7. [7]Julia Dressel and Hany Farid. 2018. The accuracy, fairness, and limits of predicting recidivism. Science Advances, 4(1):eaao5580.DOI
  8. [8]Nick Gill and Jo Hynes. 2021. Courtwatching: Visibility, publicness, witnessing, and embodiment in legal activism. Area (Oxf), 53(4):569–576.DOI
  9. [9]Jon Kleinberg, Himabindu Lakkaraju, Jure Leskovec, Jens Ludwig, and Sendhil Mullainathan. 2018. Human decisions and machine predictions*. The Quarterly Journal of Economics, 133(1):237–293.
  10. [11]Matt J Kusner, Joshua Loftus, Chris Russell, and Ricardo Silva. 2017. Counterfactual fairness. In Advances in Neural Information Processing Systems, volume 30. Curran Associates, Inc.arxiv.org/abs/1703.06856
  11. [12]Ang Li, Yiquan Wu, Ming Cai, Adam Jatowt, Xiang Zhou, Weiming Lu, Changlong Sun, Fei Wu, and Kun Kuang. 2025. Legal judgment prediction based on knowledge-enhanced multi-task and multi-label text classification. In Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), pages 6957–6970, Albuquerque, New Mexico. Association for Computational Linguistics.DOI
  12. [13]Yikuan Li, Shishir Rao, José Roberto Ayala Solares, Abdelaali Hassaine, Rema Ramakrishnan, Dexter Canoy, Yajie Zhu, Kazem Rahimi, and Gholamreza Salimi-Khorshidi. 2020. Behrt: Transformer for electronic health records. Scientific Reports, 10(1):7155.
  13. [14]Luyao Ma, Yating Zhang, Tianyi Wang, Xiaozhong Liu, Wei Ye, Changlong Sun, and Shikun Zhang. 2021. Legal judgment prediction with multi-stage case representation learning in the real court setting. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR ’21, page 993–1002, New York, NY, USA. Association for Computing Machinery.DOI
  14. [15]Joel Niklaus, Ilias Chalkidis, and Matthias Stürmer. 2021. Swiss-judgment-prediction: A multilingual legal judgment prediction benchmark. In Proceedings of the Natural Legal Language Processing Workshop 2021, pages 19–35, Punta Cana, Dominican Republic. Association for Computational Linguistics.arxiv.org/abs/2110.00806
  15. [16]Emily Owens, Erin M. Kerrison, and Bernardo Santos Da Silveira. 2017. Examining racial disparities in criminal case outcomes among indigent defendants in san francisco. Technical report, Quattrone Center for the Fair Administration of Justice, University of Pennsylvania Law School.
  16. [17]Felipe Maia Polo, Itamar Ciochetti, and Emerson Bertolo. 2021. Predicting legal proceedings status: approaches based on sequential text data. In Proceedings of the Eighteenth International Conference on Artificial Intelligence and Law, ICAIL ’21, page 264–265. ACM.
  17. [18]Grace Reinke and Natalie Marx. 2025. Court watching’s promise: A preliminary survey. Law & Social Inquiry, 50(3):823–864.DOI
  18. [19]Mukund Sundararajan, Ankur Taly, and Qiqi Yan. 2017. Axiomatic attribution for deep networks. In Proceedings of the 34th International Conference on Machine Learning, volume 70 of Proceedings of Machine Learning Research, pages 3319–3328. PMLR.arxiv.org/abs/1703.01365
  19. [20]Keyon Vafa, Emil Palikot, Tianyu Du, Ayush Kanodia, Susan Athey, and David Blei. 2024. CAREER: A foundation model for labor sequence data. Transactions on Machine Learning Research.
  20. [21]Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Advances in Neural Information Processing Systems, volume 30. Curran Associates, Inc.arxiv.org/abs/1706.03762
  21. [22]Caroline Wang, Bin Han, Bhrij Patel, and Cynthia Rudin. 2023. In pursuit of interpretable, fair and accurate machine learning for criminal recidivism prediction. Journal of Quantitative Criminology, 39(2):519–581.
  22. [23]Joshua Williams and J. Zico Kolter. 2021. A bayesian model of cash bail decisions. In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency, FAccT ’21, page 827–837, New York, NY, USA. Association for Computing Machinery.arxiv.org/abs/2101.12267
  23. [24]Yunong Zhang, Xiao Wei, and Hang Yu. 2024. Hd-Jip: A hierarchical dependency-based legal judgment prediction framework for multi-task learning. Knowledge-Based Systems, 299:112033.DOI

Paper details

vlnc:W_g9xx62xz
Version
v1 · latest
Published
Fresh — added to the Hub within the last 30 days
Added
License
CC BY 4.0
Usage

views · 0

downloads · 0

A view counts once per browser per day, a download each time the PDF is requested.

  • Computer Science

Not recorded for this paper

View statement
Looking for related papers…
Contents