Search arXivSearch

arXiv subjects

Indranil Halder

Publications and source records attributed to Indranil Halder.

17 recordsLinked to original sources

Jailbreak Scaling Laws for Large Language Models: Polynomial-Exponential Crossover

Adversarial attacks can reliably steer safety-aligned large language models toward unsafe behavior. Empirically, we find that adversarial prompt-injection attacks can amplify attack success rate from the slow polynomial growth observed without injection to exponential growth with the number of inference-time samples. We first identify a minimal statistical mechanism for these two regimes by giving a small set of assumptions on the distribution of safe generation across contexts under which both scaling laws follow. To explain this phenomenon further, we propose a theoretical generative model of proxy language in terms of a spin-glass system operating in a replica-symmetry-breaking regime, where generations are drawn from the associated Gibbs measure and a subset of low-energy, size-biased clusters is designated unsafe. We analytically show how this model naturally realizes the minimal assumptions. Short injected prompts correspond to a weak magnetic field aligned towards unsafe cluster centers and yield a power-law scaling of attack success rate with the number of inference-time samples, while long injected prompts, i.e., strong magnetic field, yield exponential scaling. We observe qualitatively consistent behavior across a broad range of large language models, spanning parameter scales from 3B to 70B. In particular, the main trends remain stable across multiple attack methods, such as GCG and AutoDAN, as well as across benchmark datasets such as AdvBench and HarmBench.

cs.LG

Demystifying LLM-as-a-Judge: Analytically Tractable Model for Inference-Time Scaling

Recent developments in large language models have shown advantages in reallocating a notable share of computational resource from training time to inference time. However, the principles behind inference time scaling are not well understood. In this paper, we introduce an analytically tractable model of inference-time scaling: Bayesian linear regression with a reward-weighted sampler, where the reward is determined from a linear model, modeling LLM-as-a-judge scenario. We study this problem in the high-dimensional regime, where the deterministic equivalents dictate a closed-form expression for the posterior predictive mean and variance. We analyze the generalization error when training data are sampled from a teacher model. We draw $k$ inference-time samples and select via softmax at a temperature applied to a quadratic reward. When the reward is not too different from the teacher, the generalization error decreases monotonically with increasing inference time samples $k$. However, the specific reward that optimizes inference-time selection generally differs from the teacher. In contrast, substantial reward misspecification induces a finite optimal $k$ beyond which more sampling can increase the generalization error. For fixed $k$, there exists an optimal sampling temperature. We experimentally verify these facts in large language model inference with an additional large language model as a judge. In the "best-of-$k$" limit with the teacher as reward, we theoretically show that the generalization error decays as $\Theta(1/k^2)$ and determine the leading coefficient via extreme value theory. These formulas delineate domains where scaling inference-time computation is provably preferable to collecting more data. Finally, we demonstrate that when task difficulty increases, the previously mentioned advantage of inference-time compute degrades.

cs.LG

A disorder-averaged framework for evaluating the Witten index

We study supersymmetric indices in disordered systems, in particular an $\mathcal{N}=4$ supersymmetric Sachdev-Ye-Kitaev-type quantum mechanics. In cases where the disordered parameters do not affect the index, we explain how the exact answer can nevertheless be obtained using disorder averaged collective variables. Furthermore, when disorder averaging is performed on multiple copies of the same theory, non-trivial coupling between them is generated. We show how the index ultimately remains factorized.

hep-th

A solvable generative model with a linear, one-step denoiser

We develop an analytically tractable single-step diffusion model based on a linear denoiser and present an explicit formula for the Kullback-Leibler divergence between the generated and sampling distribution, taken to be isotropic Gaussian, showing the effect of finite diffusion time and noise scale. Our study further reveals that the monotonic fall phase of Kullback-Leibler divergence begins when the training dataset size reaches the dimension of the data points. Finally, for large-scale practical diffusion models, we explain why a higher number of diffusion steps enhances production quality based on the theoretical arguments presented before.

cs.LG

Black Hole Entropy for M-theory on the Quintic Threefold via F-theoretic Strings

Microscopic black hole entropy calculations in string theory usually proceeds through identifying them as wrapped strings in one higher dimension. For M-theory on elliptic Calabi-Yau threefolds this proceeds via its relation to F-theory in one higher dimension. Here we show how this method can be extended to M-theory on non-elliptic Calabi-Yau threefolds such as the quintic via conifold transition to elliptic threefolds. This leads to the computation of the black hole entropy through elliptic genera of the strings. However the Cardy formula for the computation of the black hole entropy of these strings fails because the relevant momentum excitations on the string are much smaller than the central charge of the strings. We show how the black hole attractor entropy formula leads to predicting corrections to the Cardy formula in this regime.

hep-th

Stretched horizon, replica trick and off-shell winding condensate, and all that

$\alpha'$ corrections to near-horizon dynamics of a Schwarzschild black hole in a large number of spacetime dimensions $D$ are governed by the worldsheet theory composed of the cigar CFT and the classical sigma model on the sphere at the horizon, along with a timelike-Liouville theory of central charge $26-D$. At leading order in weak string coupling, blackhole thermodynamics is insensitive to the details of timelike Liouville theory. In this limit, we use Lewkowycz-Maldacena-trick motivated infinitesimally off-shell closed string worldsheet formalism in [arxiv: 2310.02313] to calculate thermal entropy exactly in $\alpha'$. The leading term in $\alpha'\to 0$ limit and the first stringy correction of our result are in precise agreement with the target space Callan-Myers-Perry formula.

hep-th

Thermal Bekenstein-Hawking entropy from the worldsheet

We define and compute the leading sphere diagram contribution to the entropy of the BTZ black hole supported by Kalb-Ramond flux in bosonic string theory. In a winding condensate description, integrating exactly over the constant mode for the radial direction of AdS$_3$ reduces the problem to one of the correlation functions of winding operators in the free theory. The volume of the residual PSL(2,$\mathbb{C}$) gauge group of the sphere is canceled by the action of conformal transformations on the winding interaction insertions. We formulate a precise version of the replica trick in terms of (infinitesimally) non-integer winding condensates to produce the entropy of the BTZ black hole. The resulting entropy can be calculated from the one-point function of a non-local operator on the worldsheet.

hep-th

Double winding condensate CFT

We conjecture a two-dimensional conformal field theory built out of a linear dilaton and a compact $\beta\gamma$ system deformed by winding condensates on each of the compact cycles. In particular, explicit expressions of the residues of the correlation functions are provided. As a worldsheet theory, it describes a stringy black hole in AdS$_3$ (supported by the Kalb-Ramond flux) at the Hawking-Page temperature. It is expected to be connected to the Horowitz-Polchinski-like solution near the Hagedorn temperature of thermal AdS$_3$ and Euclidean BTZ blackhole as we vary the temperature.

hep-th

Blackhole/blackring transition

We consider BPS states in M theory compactified on a Calabi-Yau threefold with one K\"ahler parameter, and investigate their relation to blackholes and blackrings. On the microscopic side, a characterization of the BPS degeneracy can be obtained from the non-perturbative part of the topological string free energy according to the Gopakumar-Vafa conjecture. On the macroscopic side, the Wald entropy of relevant black objects in the four-dimensional IIA description is computed from the perturbative part of the same topological string free energy following the work of Cardoso-de Wit-Mohaupt and then lifted to five-dimensional M theory through the Gaiotto-Strominger-Yin correspondence. For a given value of the M2 brane charge, we find that for small angular momenta, the microscopic BPS degeneracy matches the entropy of a rotating blackhole, whereas an apparent transition occurs at a critical value of the angular momentum. Beyond this value, we find encouraging evidence that the microscopic counting is well approximated by the entropy of a blackring. We conclude by formulating a new puzzle involving the corrections due to degenerate worldsheet instantons.

hep-th

A duality in string theory on AdS$_3$

We consider bosonic string theory on $\text{AdS}_3$ supported by Kalb-Ramond flux. It is well known that the $\alpha'$ exact worldsheet theory is described by the $\text{SL(2,R)}$ WZW model. In this note we perform checks of an $\alpha'$ exact dual description proposed in [arXiv:2104.07233] involving a winding condensate on a free theory background. We give the explicit map of vertex operators for normalizable states on both sides of the duality and demonstrate the equivalence of their two and three point functions by direct computation. The duality is of strong-weak nature in $\alpha'$.

hep-th

Classifying and constraining local four photon and four graviton S-matrices

We study the space of all kinematically allowed four photon and four graviton S-matrices, polynomial in scattering momenta. We demonstrate that this space is the permutation invariant sector of a module over the ring of polynomials of the Mandelstam invariants $s$, $t$ and $u$. We construct these modules for every value of the spacetime dimension $D$, and so explicitly count and parameterize the most general four photon and four graviton S-matrix at any given derivative order. We also explicitly list the local Lagrangians that give rise to these S-matrices. We then conjecture that the Regge growth of S-matrices in all physically acceptable classical theories is bounded by $s^2$ at fixed $t$. A four parameter subset of the polynomial photon S-matrices constructed above satisfies this Regge criterion. For gravitons, on the other hand, no polynomial addition to the Einstein S-matrix obeys this bound for $D \leq 6$. For $D \geq 7$ there is a single six derivative polynomial Lagrangian consistent with our conjectured Regge growth bound. Our conjecture thus implies that the Einstein four graviton S-matrix does not admit any physically acceptable polynomial modifications for $D\leq 6$. A preliminary analysis also suggests that every finite sum of pole exchange contributions to four graviton scattering also such violates our conjectured Regge growth bound, at least when $D\leq 6$, even when the exchanged particles have low spin.

hep-th

Global Symmetry and Maximal Chaos

In this note we study chaos in generic quantum systems with a global symmetry generalizing seminal work [arXiv : 1503.01409] by Maldacena, Shenker and Stanford. We conjecture a bound on instantaneous chaos exponent in a thermodynamic ensemble at temperature $T$ and chemical potential $\mu$ for the continuous global symmetry under consideration. For local operators which could create excitation up to some fixed charge, the bound on chaos (Lyapunov) exponent is independent of chemical potential $\lambda_L \leq \frac{2 \pi T}{ \hbar} $. On the other hand when the operators could create excitation of arbitrary high charge, we find that exponent must satisfy $\lambda_L \leq \frac{2 \pi T}{(1-|\frac{\mu}{\mu_c}|) \hbar} $, where $\mu_c$ is the maximum value of chemical potential for which the thermodynamic ensemble makes sense. As specific examples of quantum mechanical systems we consider conformal field theories. In a generic conformal field theory with internal $U(1)$ symmetry living on a cylinder the former bound is applicable, whereas in more interesting examples of holographic two dimensional conformal field theories dual to Einstein gravity, we argue that later bound is saturated in presence of a non-zero chemical potential for rotation.

hep-th

Matter Chern Simons Theories in a Background Magnetic Field

We study large $N$ 2+1 dimensional fermions in the fundamental representation of an $SU(N)_k$ Chern Simons gauge group in the presence of a uniform background magnetic field for the $U(1)$ global symmetry of this theory. The magnetic field modifies the Schwinger Dyson equation for the propagator in an interesting way; the product between the self energy and the Greens function is replaced by a Moyal star product. Employing a basis of functions previously used in the study of non-commutative solitons, we are able to exactly solve the Schwinger Dyson equation and so determine the fermion propagator. The propagator has a series of poles (and no other singularities) whose locations yield a spectrum of single particle energies at arbitrary t' Hooft coupling and chemical potential. The usual free fermion Landau levels spectrum is shifted and broadened out; we compute the shifts and widths of these levels at arbitrary t'Hooft coupling. As a check on our results we independently solve for the propagators of the conjecturally dual theory of Chern Simons gauged large $N$ fundamental Wilson Fisher bosons also in a background magnetic field but this time only at zero chemical potential. The spectrum of single particle states of the bosonic theory precisely agrees with those of the fermionic theory under Bose-Fermi duality.

hep-th

The large $N$ phase diagram of ${\cal N}=2$ $SU(N)$ Chern-Simons theory with one fundamental chiral multiplet

We study the theory of a single fundamental fermion and boson coupled to Chern-Simons theory at leading order in the large $N$ limit. Utilizing recent progress in understanding the Higgsed phase in Chern-Simons-Matter theories, we compute the quantum effective potential that is exact to all orders in the 't Hooft coupling for the lightest scalar operator of this theory at finite temperature. Specializing to the zero temperature limit we use this potential to determine the phase diagram of the large $N$ ${\cal N}=2$ supersymmetric theory with this field content. This intricate two dimensional phase diagram has four topological phases that are separated by lines of first and second order phase transitions and includes special conformal points at which the infrared dynamics is governed by Chern-Simons theory coupled respectively to free bosons, Gross-Neveu fermions, and to a theory of Wilson-Fisher bosons plus free fermions. We also describe the vacuum structure of the most general ${\cal N} = 1$ supersymmetric theory with one fundamental boson and one fundamental fermion coupled to an $SU(N)$ Chern-Simons gauge field, at arbitrary values of the 't Hooft coupling.

hep-th

Duality and an exact Landau-Ginzburg potential for quasi-bosonic Chern-Simons-Matter theories

It has been conjectured that Chern-Simons (CS) gauged `regular' bosons in the fundamental representation are `level-rank' dual to CS gauged critical fermions also in the fundamental representation. Generic relevant deformations of these conformal field theories lead to one of two distinct massive phases. In previous work, the large $N$ thermal free energy for the bosonic theory in the unHiggsed phase has been demonstrated to match the corresponding fermionic results under duality. In this note we evaluate the large $N$ thermal free energy of the bosonic theory in the Higgsed phase and demonstrate that our results, again, perfectly match the predictions of duality. Our computation is performed in a unitary gauge by integrating out the physical excitations of the theory - i.e. W bosons - at all orders in the 't Hooft coupling. Our results allow us to construct an exact quantum effective potential for ${\bar \phi} \phi$, the lightest gauge invariant scalar operator in the theory. In the zero temperature limit this exact Landau-Ginzburg potential is non-analytic at ${\bar \phi \phi}=0$. The extrema of this effective potential at positive ${\bar \phi}\phi$ solve the gap equations in the Higgsed phase while the extrema at negative ${\bar \phi} \phi$ solve the gap equations in the unHiggsed phase. Our effective potential is bounded from below only for a certain range of $x_6$ (the parameter that governs sextic interactions of $\phi$). This observation suggests that the regular boson theory has a stable vacuum only when $x_6$ lies in this range.

hep-th

Bose-Fermi Chern-Simons Dualities in the Higgsed Phase

It has been conjectured that fermions minimally coupled to a Chern-Simons gauge field define a conformal field theory (CFT) that is level-rank dual to Chern-Simons gauged Wilson-Fisher Bosons. The CFTs in question admit relevant deformations parametrized by a real mass. When the mass deformation is positive, the duality of the two deformed theories has previously been checked in detail in the large $N$ limit by comparing explicit all orders results on both sides of the duality. In this paper we perform a similar check for the case of negative mass deformations. In this case the bosonic field condenses triggering the Higgs mechanism. The effective excitations in this phase are massive $W$ bosons. By summing all leading large $N$ graphs involving these $W$ bosons we find an all orders (in the 't Hooft coupling) result for the thermal free energy of the bosonic theory in the condensed phase. Our final answer perfectly matches the previously obtained fermionic free energy under the conjectured duality map.

hep-th

Notes on Melonic $O(N)^{q-1}$ Tensor Models

It has recently been demonstrated that the large N limit of a model of fermions charged under the global/gauge symmetry group $O(N)^{q-1}$ agrees with the large $N$ limit of the SYK model. In these notes we investigate aspects of the dynamics of the $O(N)^{q-1}$ theories that differ from their SYK counterparts. We argue that the spectrum of fluctuations about the finite temperature saddle point in these theories has $(q-1)\frac{N^2}{2}$ new light modes in addition to the light Schwarzian mode that exists even in the SYK model, suggesting that the bulk dual description of theories differ significantly if they both exist. We also study the thermal partition function of a mass deformed version of the SYK model. At large mass we show that the effective entropy of this theory grows with energy like $E \ln E$ (i.e. faster than Hagedorn) up to energies of order $N^2$. The canonical partition function of the model displays a deconfinement or Hawking Page type phase transition at temperatures of order $1/\ln N$. We derive these results in the large mass limit but argue that they are qualitatively robust to small corrections in $J/m$.

hep-th