YJ
Youhe Jiang
cs.DCcs.LGcs.DBcs.CVcs.AIcs.PF
On Valency
published · living versionsW_ajdq8vfr·v1 · currentpublished
Introducing Cluster Efficiency to LLM Serving: Pooling Economical Accelerators over Fast Interconnects
with Pavle Glušac, Binhang Yuan, Eiko Yoneki
1 version
Preprints & journals
29 papers in the corpus · 2022–2026Coda: Exploiting Admission Flexibility for Coding-Agent Serving2610.03088v1 · Youhe Jiang, Fangcheng Fu, Binhang Yuan et al.2026 · 0 citationsarXiv
AFORE: Attention-FFN Disaggregation with Overlapped Reconfiguration of Experts2610.03203v1 · Wenshuang Li, Youhe Jiang, You Peng et al.2026 · 0 citationsarXiv
ePACT: Energy-Performance-Aware Commitment Tracking for LLM Serving2610.01784v1 · You Peng, Youhe Jiang, Chen Wang et al.2026 · 0 citationsarXiv
AReaL-TIK: Stateful Agentic Optimization of Unified RL Kernels through an Optimization IR2609.35140v1 · Ran Yan, Youhe Jiang, Jiayi Nie et al.2026 · 0 citationsarXiv
RayOrch: Programming and Executing Lineage-Controlled Multi-Grain Dataflows for Foundation-Model Data Preparation2609.18703v1 · Xiaochen Ma, Zimo Meng, Junzhu Liang et al.2026 · 0 citationsarXiv
Vidu S1: A Real-Time Interactive Video Generation Model2607.03118v2 · Jintao Zhang, Kai Jiang, Jintao Chen et al.2026 · 0 citationsarXiv
Next-Generation Agentic Reinforcement Learning Systems Enable Self-Evolving Agents2607.01120v2 · Ran Yan, Wei Fu, Jiale Li et al.2026 · 0 citationsarXiv
HexAGenT: Efficient Agentic LLM Serving via Workflow- and Heterogeneity-Aware Scheduling2605.16637v1 · You Peng, Youhe Jiang, Wenshuang Li et al.2026 · 0 citationsarXiv
HexiSeq: Accommodating Long Context Training of LLMs over Heterogeneous Hardware2605.07569v1 · Yan Liang, Youhe Jiang, Ran Yan et al.2026 · 0 citationsarXiv
Autopoiesis: A Self-Evolving System Paradigm for LLM Serving Under Runtime Dynamics2604.07144v1 · Youhe Jiang, Ran Yan, You Peng et al.2026 · 0 citationsarXiv
Efficient Multi-round LLM Inference over Disaggregated Serving2602.14516v2 · Wenhao He, Youhe Jiang, Penghao Zhao et al.2026 · 0 citationsarXiv
SLA2: Sparse-Linear Attention with Learnable Routing and Quantization-aware Training2602.12675v2 · Jintao Zhang, Haoxu Wang, Kai Jiang et al.2026 · 0 citationsarXiv
OServe: Accelerating LLM Serving via Spatial-Temporal Workload Orchestration2602.12151v2 · Youhe Jiang, Fangcheng Fu, Taiyi Wang et al.2026 · 0 citationsarXiv
BOute: Cost-Efficient LLM Serving with Heterogeneous LLMs and GPUs via Multi-Objective Bayesian Optimization2602.10729v1 · Youhe Jiang, Fangcheng Fu, Eiko Yoneki2026 · 0 citationsarXiv
AReaL-Hex: Accommodating Asynchronous RL Training over Heterogeneous GPUs2511.00796v1 · Ran Yan, Youhe Jiang, Tianyuan Wu et al.2025 · 0 citationsarXiv
Parallax: Efficient LLM Inference Service over Decentralized Environment2509.26182v1 · Chris Tong, Youhe Jiang, Gufeng Chen et al.2025 · 0 citationsarXiv
Efficient Pre-Training of LLMs via Topology-Aware Communication Alignment on More Than 9600 GPUs2509.15940v1 · Guoliang He, Youhe Jiang, Wencong Xiao et al.2025 · 2 citationsarXiv
FSA: An Alternative Efficient Implementation of Native Sparse Attention Kernel2508.18224v3 · Ran Yan, Youhe Jiang, Zhuoming Chen et al.2025 · 0 citationsarXiv
LMDeploy Accelerates Mixed-Precision LLM Inference with TurboMind2508.15601v2 · Li Zhang, Youhe Jiang, Guoliang He et al.2025 · 0 citationsarXiv
Cascadia: An Efficient Cascade Serving System for Large Language Models2506.04203v2 · Youhe Jiang, Fangcheng Fu, Wanru Zhao et al.2025 · 0 citationsarXiv
HEXGEN-FLOW: Optimizing LLM Inference Request Scheduling for Agentic Text-to-SQL2505.05286v3 · You Peng, Youhe Jiang, Wenqi Jiang et al.2025 · 0 citationsarXiv
ThunderServe: High-performance and Cost-efficient LLM Serving in Cloud Environments2502.09334v2 · Youhe Jiang, Fangcheng Fu, Xiaozhe Yao et al.2025 · 0 citationsarXiv
HexGen-2: Disaggregated Generative Inference of LLMs in Heterogeneous Environment2502.07903v1 · Youhe Jiang, Ran Yan, Binhang Yuan2025 · 0 citationsarXiv
Demystifying Cost-Efficiency in LLM Serving over Heterogeneous GPUs2502.00722v2 · Youhe Jiang, Fangcheng Fu, Xiaozhe Yao et al.2025 · 0 citationsarXiv
HexiScale: Facilitating Large Language Model Training over Heterogeneous Hardware2409.01143v3 · Ran Yan, Youhe Jiang, Xiaonan Nie et al.2024 · 2 citationsarXiv
HexGen: Generative Inference of Large Language Model over Heterogeneous Environment2311.11514v3 · Youhe Jiang, Ran Yan, Xiaozhe Yao et al.2023 · 7 citationsarXiv
Improving Automatic Parallel Training via Balanced Memory Workload Optimization2307.02031v2 · Yujie Wang, Youhe Jiang, Xupeng Miao et al.2023 · 14 citationsarXiv
Galvatron: Efficient Transformer Training over Multiple GPUs Using Automatic Parallelism2211.13878v1 · Xupeng Miao, Yujie Wang, Youhe Jiang et al.2022 · 64 citationsVLDB 2023
OSDP: Optimal Sharded Data Parallel for Distributed Deep Learning2209.13258v4 · Youhe Jiang, Fangcheng Fu, Xupeng Miao et al.2022 · 7 citationsarXiv
Career total: 31 works. 29 are in this corpus.
Profile built from the corpus for this byline.
Author records are still filling in while the Hub is in alpha. If this is your page, you'll be able to claim it soon. Spot a mistake? Tell us.