betaFeedback

WorksComputer Science

Disaggregated LLM Inference in Space: A Communication Feasibility Study

Abstract

Orbital data centers could enable large-scale AI inference, but efficiently serving a frontier language model to many users may require several compute satellites to cooperate over optical links. While disaggregated inference, which splits large language model (LLM) serving across machines, is well established in terrestrial data centers, its viability under the unique constraints of orbital deployments remains an open question. This article investigates how link capacity and satellite separation affect two types of disaggregated LLM serving, in both compact satellite formations and distributed constellations. Prefill-decode disaggregation (PDD) migrates a large KV cache once per request, while attention-FFN disaggregation (AFD) exchanges small activations at every mixture-of-experts layer for every generated token. The two respond to distance in different ways. PDD is limited mainly by link capacity and, with fast enough links, tolerates separations of up to a thousand kilometers. AFD is limited mainly by propagation delay, which accumulates layer by layer and forces attention and expert instances within about a kilometer of each other. Based on these results, we propose a hierarchical orbital inference architecture and provide network design guidelines for future orbital data centers, including the role of ground access latency.

Paper details

vlnc:W_9r3je4bu
Version
v1 · latest
Published
Fresh — added to the Hub within the last 30 days
Added
License
arXiv nonexclusive license
Usage

views · 0

downloads · 0

A view counts once per browser per day, a download each time the PDF is requested.

  • Computer Science

Not recorded for this paper

View statement
Looking for related papers…