LENS: Replacing LayerNorm and Softmax in Transformers with Learnable Normalization Stateswith Yuhao Liu, Salim Ullah1 versionW_9b7pexsvv1 · current