Test-Time Scalable AI-RAN: Inference Time Allocation for Cell-Free MIMO

Abstract

Artificial intelligence-enabled radio access networks (AI-RANs) are envisioned to consist of multiple AI-based modules, potentially developed independently by different vendors. In this work, we study AI-RAN-enabled cell-free MIMO systems, with a particular focus on the system implications of modern AI models. Specifically, we focus on the phenomenon of test-time scalability popularized by large language models (LLMs), under which model performance improves as additional computational resources are allocated at testing time. By noting that the optimal amount of additional computational resources for each AI module should in general depend on its interaction with the other modules as well as with the underlying wireless channels, we propose a generic framework that enables optimal resource allocation for each test-time scalable module in cell-free MIMO systems. Experimental results demonstrate the effectiveness of the proposed framework in fully exploiting the potential of test-time scalable AI-RANs in cell-free MIMO systems.