alphaFeedback
PDF

WorksComputer Science

Fix, Not Just Resample: Bounded Compiler-Guided Repair in Lean 4

Publication details
License
CC BY 4.0
Status
Published
AI contributions
Not recorded for this paper
View details
Abstract · v1

Automated theorem provers often rely on sampling language models, but proof assistants like Lean reject each failed step with a precise error message — information that pure sampling discards. To overcome this, we introduce a bounded, online step-level repair module. Our search samples KK candidate tactics at each step and repairs a failed tactic at most RR times. Instead of discarding failed tactics, we feed the compiler's error message to a pretrained repair model to fix individual rejected steps in place. This approach improves the solve rate over a sampling-only baseline across all tested candidate budgets (K∈{1,3,5,8}K \in \{1,3,5,8\}), achieving up to a 32%32\% relative gain and solving 8282 additional theorems on a 1,9901{,}990-theorem subset of the LeanDojo benchmark. Repair is not free: it trades extra runtime for reachable proofs. But the trade is predictable: repair pays most when sampling is constrained; its return is front-loaded, with the first repair attempt capturing 84–96%84\text{--}96\% of the total gain; and the gain comes almost entirely from shallow tactic-execution failures rather than structural errors such as type mismatches. This targeted repair successfully replicates on a second benchmark (Lean Workbook), nearly doubling the solve rate with zero regressions.

Review conversation

Reviews are not available for this work yet.