betaFeedback

WorksComputer Science

MedGuardBench: A Patient-Oriented Benchmark for Personalized Guardrail Development

Abstract

Safety is personal: the same action can be safe for one person but unsafe for another. Yet current guardrails judge content without considering who is affected. Using medication safety, we introduce patient-conditioned medication guarding, which predicts a safety verdict and 17 risk categories from a patient profile and prescription. We release MedGuardBench, a drug-disjoint benchmark of 5{,}001 scenarios across 87 medications. We find that standard guardrails rely on surface cues, such as wording and profile presence, rather than patient facts. To address this, we develop personalized reasoning guardrails with three components. Personalized Reasoning Distillation links risks to relevant patient fields. Context Unrolling (CU) makes models check each field themselves, reducing false alarms on most backbones; controls show that providing the check does not yield the same benefit. A rule-based reward (guided GRPO) improves unsafe recall and complex-risk detection, including allergies and adverse reactions, on some backbones, but increases false alarms on others. Our models outperform base models and matched no-profile controls in accuracy, while reducing false alarms relative to no-profile controls. Profile removal and swapping confirm that gains come from patient information, not fine-tuning alone.

Paper details

vlnc:W_v2v34qj3
Version
v1 · latest
Published
Fresh — added to the Hub within the last 30 days
Added
License
arXiv nonexclusive license
Usage

views · 3

downloads · 0

A view counts once per browser per day, a download each time the PDF is requested.

  • Computer Science

Not recorded for this paper

View statement
Looking for related papers…