HiSA: Sparsifying the Hidden Dimension of RoPE Attention in LLMswith Ambroise Borbely, Mathieu Salzmann1 versionW_85az4ae3v1 · current