Search arXiv⌕ Search

arXiv · 2610.41707

Ordered Chaos: Towards Adaptive Multipath Load Balancing with Precise Fast Loss Detection

Abstract

Load balancing in best-effort datacenter fabrics faces a tradeoff. Order-preserving schemes such as Equal-Cost Multipath (ECMP) retain loss semantics but use path diversity coarsely, while packet spraying balances load well but removes the ordering signals needed for fast, precise loss detection. We present Ordered Chaos, an end-host design that preserves enough structure for reliable loss detection without giving up fine-grained multipath routing. Reactive Subflow Spraying (RSS) divides each flow into ordered, dynamically routed subflows. Precise Fast Loss Detection (PFLD) combines this ordering with probes to distinguish reordering from congestion, corruption, tail, and retransmission losses within one RTT. Across simulations, AI and HPC workloads, and a DPU prototype, RSS+PFLD improves tail flow completion time by up to $3\times$, eliminates up to 99% of timeout-based recoveries, and accelerates collective and training communication by up to 35%.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Tommaso Bonato, Ahmad Ghalayini, Nadeen Gebara, Benoit Pit-Claudel, Jiayong Li, Mikhail Khalilov, Luca Piccolboni, Waleed Reda, Pei-Huan Tsai, Tao Ji, Abdul Kabbani, Torsten Hoefler. 2026-10-30. Ordered Chaos: Towards Adaptive Multipath Load Balancing with Precise Fast Loss Detection. https://arxiv.org/abs/2610.41707

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Which Deep Learner? A Systematic Evaluation of Advanced Deep Forecasting Models Accuracy and Efficiency for Network Traffic Prediction

Network traffic prediction is an essential tool for automating modern network management. It is a difficult time series forecasting (TSF) problem that has been addressed by Deep Learning (DL) models due to their ability to capture complex patterns. Recent years have witnessed advances in deep forecasting models, from sophisticated transformer architectures to simple linear models, improving performance across diverse prediction tasks. However, given the diversity of these models, the variability of network traffic across environments and timescales, and the inherent challenges of network traffic prediction, it is essential to identify effective deployment choices and modeling directions. Henceforth, this study systematically identifies 12 deep forecasting models, comprising 8 advanced TSF models and 4 traditional deep learning architectures -- each with unique advantages for network traffic prediction -- against 3 statistical baselines, for a total of 15 forecasting methods and evaluate them on four real traffic datasets, across multiple time scales and horizons, assessing performance, robustness to anomalies, data gaps, external factors, data efficiency, and resource efficiency in terms of time, memory, and energy. Our results provide insights into model behaviour and guidelines for network management, highlighting performance regimes, efficiency thresholds, and promising architectures that balance accuracy, efficiency, and robustness to traffic challenges.

cs.NI↗

ORCHID: Fairness-Aware Orchestration in Mission-Critical Air-Ground Integrated Networks

Uncrewed Aerial Vehicles (UAVs) provide on-demand wireless coverage for mission-critical Air-Ground Integrated Networks (AGINs). However, DRL-based orchestration faces challenges from multi-agent non-stationarity and the trade-off between energy efficiency (EE) and service fairness. To address these issues, we propose ORCHID (Orchestration of Resilient Coverage via Hybrid Intelligent Deployment), a stability-enhanced two-stage learning framework. First, GBS-aware topology partitioning provides a topology-informed warm start for UAV deployment. Second, a Reset-and-Finetune (R\&F) mechanism is integrated into Multi-Agent Proximal Policy Optimization (MAPPO) to support stable late-stage policy refinement through event-triggered rollback and learning-rate adaptation. To study the efficiency-fairness trade-off, ORCHID employs a Max-Min Fairness (MMF)-oriented bandwidth allocation based on a closed-form Egalitarian Bargaining Game (EBG) solution and is compared with Proportional Fairness (PF). Experiments show stronger served-user bottleneck-rate protection under MMF, together with competitive coverage and user-rate fairness and favorable energy-efficiency and UAV-load-balancing performance under zero-shot scalability and mobility tests. Overall, ORCHID provides an effective balance among user-level service protection, energy efficiency, and policy stability for resilient mission-critical UAV networks.

cs.NI↗

Halley: A Predictive Control Plane for Optical AI Data Center Networks

A frontier AI model is trained in an AI data center, on tens of thousands of accelerators joined by a dedicated network, and every training step ends with all of them exchanging data at once. Between racks, that network is optical, and each of its four layers, from lasers to switches, runs a fixed or after-the-fact policy. Lasers sharing an enclosure, cooling, and power can fail together. At a fixed spare ratio, correlated failure provably caps a pool's availability however large it grows. In this paper, we present a comprehensive predictive control plane framework, called Halley, that reads each resource's next state and acts before the failure occurs. It has four components, each carrying a formal guarantee: LightReserve that sizes the laser pool to provide a coverage bound, FoldFit that schedules the switch within $11/9$ of the optimal, ThermaLead that holds a microring with one-step-ahead control, and TriageGuard that protects the highest-risk modules first. Halley gives each layer a predictive controller that defers to the deployed policy when unsure. Composed from simulations at that point, effective goodput, the share of ideal throughput kept, rises from 65.2\% to 76.5\% if a window that exhausts its spares is lost. If only the dark channels' bandwidth is lost, it reaches 67.4\%. Per megawatt, that is up to 1.03--1.17 times the training; for the same training, up to 3.3--14.7\% less data center capacity. \textsf{Halley}'s fallback circuits are formally verified and are shown to achieve close timing on a commercial FPGA, and pass a 130~nm signoff.

cs.NI↗