TY - RPRT TI - Compositional Performance Modeling of LLM Inference Clusters with Hierarchical KV Caching AU - Ruiyang Ma AU - Sheng Qi AU - DaiKang Kuang AU - Teng Ma AU - Guojie Luo PY - 2026 UR - https://arxiv.org/abs/2610.15366 ID - 2610.15366 ER -