Search arXiv⌕ Search

arXiv subjects

Dylan Johnston

Publications and source records attributed to Dylan Johnston.

7 recordsLinked to original sources

RidgeFill: Training-Free Late-Layer Cache Fill for Faster Prefill

RidgeFill shortens prefill by not computing most of a model's upper layers for the prompt. The lower layers run exactly up to a split; from the split layer's state a per-layer map predicts every later layer's input, and each late layer writes its cache from that prediction. The design follows YOCO and DeepSeek-V4.1-Flash, where the projection is trained into the model. RidgeFill retrofits it onto models that were never trained for it: the map is a ridge regression fitted once in closed form from one pass over calibration text, the layer's own projections run unchanged, and a chosen set of rows, the last few thousand tokens, and every decoding step run the full model. Nothing is trained and no token is dropped. Most of the work was in measurement, finding a repeatable methodology. Loss averaged over all tokens hides RidgeFill's error. Needle retrieval in the filled region, loss on tokens that depend on distant context, and splice tests that swap filled keys or values for exact ones show which component carries it: the keys on Llama-3.1-8B, half of it in their scale, and the values and the recurrent state on Qwen3.5-9B. On Qwen3.8-27B in a llama.cpp fork on an A100, time to first token is 1.25 to 1.31x faster at 16K to 120K tokens with the maps in VRAM; RULER changes by -1.2 and -1.4 points and LongBench v2 by -1.4; the 95 % intervals include zero but do not rule out losses of a few points. On Qwen3.8-Flash-Next in vLLM it is 1.50 to 1.60x faster than exact at 9K to 32K tokens, with RULER's needle tasks at 99.8 against 100.0 and perplexity on novel tokens 2.65 % higher [-0.02 %, +4.93 %]. On three 8 to 9B reference models, at the same split and tail as the identity fill, the fitted map retrieves 49.1 and 49.6 more filled-region RULER points on the two dense models (at that split Llama's loss is worse), and its long-document loss is +/-0.03 nats of the released SwiftKV checkpoint's.

cs.LG↗

Disconnected Reductive Groups: Classification and Representations

In this article, we classify (up to isomorphism) disconnected reductive groups over an algebraically closed field. For the fixed dimension and number of components, our results show that there are only finitely many reductive groups of that dimension with that many components. Besides this, we obtain new results about the structure and representation theory of disconnected reductive groups.

math.RT↗

Topological rigidity of ${\mathrm{SL}}_2$-quotients

We investigate the homotopy type of a certain homogeneous space for a simple complex algebraic group. We calculate some of its classical topological invariants and introduce a new one. We also propose several conjectures about its topological rigidity.

math.AT↗

On a question by Roggenkamp about group algebras

We investigate whether the group algebra of a finite group over a localisation of the integers is semiperfect. The main result is a necessary and sufficient arithmetic criterion in the ordinary case. In the modular case, we propose a conjecture, which extends the criterion.

math.RA↗

Global Representation Ring and Knutson Index

Global representation rings were discovered by Sarah Witherspoon in 1995 and the Knutson Index was introduced by the second author in 2022. In the present paper we introduce the Knutson Index for general commutative rings and study it for Burnside rings and global representation rings. We also introduce the global table of a finite group, that encompasses both the character table and the Burnside table of marks. We discuss what properties of a group can be recovered from its global table.

math.RA↗

Contramodules for algebraic groups: induction and projective covers

In this paper we will investigate contramodules for algebraic groups. Namely, we give contra-analogs to two 20th century results about comodules. Firstly, we show that induction of contramodules over coordinate rings of algebraic groups is exact if and only if the associated quotient variety is affine. Secondly, we give an inverse limit theorem for constructing projective covers of simple $G$-modules using $G$-structures of projective covers of simple modules for the first Frobenius kernel, $G_1$.

math.RT↗

Contramodules for algebraic groups: the existence of mock projectives

Let $G$ be an affine algebraic group over an algebraically closed field of positive characteristic. Recent work of Hardesty, Nakano, and Sobaje gives necessary and sufficient conditions for the existence of so-called mock injective $G$-modules, that is, modules which are injective upon restriction to all Frobenius kernels of $G$. In this paper, we give analogous results for contramodules, including showing that the same necessary and sufficient conditions on $G$ guarantee the existence of mock-projective contramodules. In order to do this we first develop contramodule analogs to many well-known (co)module constructions.

math.RT↗