arXiv · 2610.39884
KARMA: Training-Free Knowledge-Atomic Harness Evolution for Industrial Advertising Agents
Abstract
Industrial advertising agents must continually adapt their decision knowledge to changing product offerings, traffic patterns, and operating policies. We present KARMA (Knowledge-Atomic, Regression-Gated Modular Adaptation), a training-free framework that evolves six typed knowledge modules while keeping model weights and executable harness code frozen. During our evolution, a deterministic Trace Verifier maps observed errors to candidate modules, and a Critic compares successful and failed trajectories to guide a tool-constrained Evolver. The Evolver applies atomic knowledge edits, which a fixed validation gate retains only when their measured gain reaches a threshold; otherwise, the previous knowledge state is restored. We evaluate KARMA with three LLM families on cases sampled from a corpus of approximately half a million real-world operation logs across six e-commerce domains. Across 18 domain--model settings, KARMA raises the average hold-out score from 30.19 to 39.15 (+8.96 points, +29.7%). Ablations show that removing either successful or failed trajectories more than halves the average hold-out gain. Evolved knowledge also transfers across domains without further adaptation, yielding an average hold-out gain of 8.54 points across all source--target pairs. By linking retained patches to their diagnostic evidence and validation outcomes, KARMA supports inspectable, reversible knowledge adaptation for agents in Web marketplaces.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Xinhua Miao, Yuanzhen Rong, Weiru Zhang, Xiaoyi Zeng. 2026-10-29. KARMA: Training-Free Knowledge-Atomic Harness Evolution for Industrial Advertising Agents. https://arxiv.org/abs/2610.39884
Cite the original work for its findings. Save a collection to share your selection of sources.