alphaFeedback
PDF

WorksComputer Science

SYNC: A Training-Free Inference Controller for Dynamic Layer Selection in Multi-Persona Alignment

Publication details
License
CC BY-SA 4.0
Status
Published
AI contributions
Not recorded for this paper
View details
Ancillary data
1 code link
View
Abstract · v1

Steering vectors align a model at inference time without touching its weights, but eliciting several personas at once is a different problem from eliciting one. Prior multi-persona steering approaches predetermine both how persona vectors are combined and the specific layers at which they are injected. Moreover, this static commitment introduces substantial offline search costs to identify suitable target layers, despite the fact that optimal intervention strengths vary dynamically across both decoding steps and distinct personas. We introduce SYNC (SensitivitY-guided iNference Control), a novel training-free inference control framework compatible with pre-existing steering vectors. SYNC dynamically estimates each layer's sensitivity to every persona via cosine similarity trajectories, assigning each persona to its optimal injection layer at every decoding step. Across two models, two persona profiles and steering vectors from both unsupervised and supervised extraction, SYNC leads on 21 of 28 persona configurations, significantly on 15. Code is available at https://github.com/yosefnuragaw/sync.

Review conversation

Reviews are not available for this work yet.