Harvesting Expert-Parallel Bubbles for Fine-Tuningwith Oana Balmau, Saurav Banka, Jiaxuan Chen, Anne-Marie Kermarrec +31 versionW_je8tvdssv1 · current
POD-Attention: Unlocking Full Prefill-Decode Overlap for Faster LLM InferenceAditya K Kamath, Ramya Prabhu, Jayashree Mohan et al.25 citations2410.18038v22024arXiv
vAttention: Dynamic Memory Management for Serving LLMs without PagedAttentionRamya Prabhu, Ajay Nayak, Jayashree Mohan et al.42 citations2405.04437v32024arXiv