arXiv subjects

Caleb Johnson

Publications and source records attributed to Caleb Johnson.

10 recordsLinked to original sources

arXiv2026

Computing noise-canceling observables via Pauli propagation

The pursuit of quantum advantage is driving the co-evolution of quantum processors and classical simulation methods. Despite advances in scale and quality, the accuracy of quantum simulation is ultimately limited by error rates and sampling overheads. Similarly, while classical simulation methods such as Pauli propagation have made remarkable progress, their accuracy is ultimately limited by the exponential growth of operator paths and the truncations needed to control memory and runtime. Here we show that these complementary limitations can be mitigated by embedding Pauli propagation within a hybrid error-mitigation framework that reduces quantum sampling overhead while achieving lower truncation errors with fewer classical resources than traditional Pauli propagation alone. In this framework, a target observable is classically propagated through noise-canceling inverse channels, producing a modified observable that is measured directly on a quantum processor. We prototype two implementations and benchmark their performance numerically on canonical models that challenge traditional Pauli propagation. We also perform experiments on a quantum processor using 56 superconducting qubits, revealing the tradeoffs of their respective truncation strategies. These results illustrate how classical and quantum resources can be orchestrated to extend observable estimation beyond the limits of either approach alone, providing a foundation for quantum-centric supercomputing and future demonstrations of quantum advantage.

quant-ph↗

arXiv2026

A Unified Structured Query Understanding Framework for Industrial Semantic Search

Query understanding in large-scale industrial search systems is typically implemented as a cascade of disparate, task-specific components. While individually optimizable, this fragmented architecture incurs high maintenance overhead and results in inconsistent behaviors, particularly for long-tail queries. In this work, we propose and deploy a unified structured query understanding system that consolidates these heterogeneous functions into a single Small Language Model (SLM) that performs schema-constrained generation. To address the data bottlenecks inherent in unified modeling, we introduce Query Illuminator, a dual-purpose framework serving as: (i) a teacher model for high-quality auto-annotation and distillation, and (ii) a surrogate judge for scalable evaluation where human labels are scarce. We validate this approach through extensive offline and online tests within LinkedIn's Job Search system. Furthermore, we demonstrate the framework's horizontal extensibility through a cross-domain case study on People Search. The results show improved user engagement and reduced operational costs, achieved while satisfying strict low-latency serving constraints on limited GPU resources.

cs.IR↗

arXiv2026

Observation of Improved Accuracy over Classical Sparse Ground-State Solvers using a Quantum Computer

Demonstrating quantum advantage over classical algorithms for ground state energy problems is an outstanding open problem in quantum computation. We experimentally demonstrate that a quantum algorithm can outperform classical selected configuration interaction (SCI) methods, a key family of techniques used in computational chemistry and condensed matter physics. We construct a class of local Hamiltonian problems with sparse ground states, and show that SCI fails to find the ground state of a 49-qubit instance. We then show that sample-based Krylov quantum diagonalization, run on an IBM Heron R3 processor, succeeds at the same task. While the problem is solvable classically using iterative solvers designed to target our Hamiltonian construction, this work resolves the question of whether a sample-based quantum diagonalization algorithm can outperform standard SCI heuristics.

quant-ph↗

arXiv2026

Semantic Search At LinkedIn

Semantic search with large language models (LLMs) enables retrieval by meaning rather than keyword overlap, but scaling it requires major inference efficiency advances. We present LinkedIn's LLM-based semantic search framework for AI Job Search and AI People Search, combining an LLM relevance judge, embedding-based retrieval, and a compact Small Language Model trained via multi-teacher distillation to jointly optimize relevance and engagement. A prefill-oriented inference architecture co-designed with model pruning, context compression, and text-embedding hybrid interactions boosts ranking throughput by over 75x under a fixed latency constraint while preserving near-teacher-level NDCG, enabling one of the first production LLM-based ranking systems with efficiency comparable to traditional approaches and delivering significant gains in quality and user engagement.

cs.IR↗

arXiv2025

Scaling Up Efficient Small Language Models Serving and Deployment for Semantic Job Search

Large Language Models (LLMs) have demonstrated impressive quality when applied to predictive tasks such as relevance ranking and semantic search. However, deployment of such LLMs remains prohibitively expensive for industry applications with strict latency and throughput requirements. In this work, we present lessons and efficiency insights from developing a purely text-based decoder-only Small Language Model (SLM) for a semantic search application at LinkedIn. Particularly, we discuss model compression techniques such as pruning that allow us to reduce the model size by up to $40\%$ while maintaining the accuracy. Additionally, we present context compression techniques that allow us to reduce the input context length by up to $10$x with minimal loss of accuracy. Finally, we present practical lessons from optimizing the serving infrastructure for deploying such a system on GPUs at scale, serving millions of requests per second. Taken together, this allows us to increase our system's throughput by $10$x in a real-world deployment, while meeting our quality bar.

cs.IR↗

arXiv2025

Powering Job Search at Scale: LLM-Enhanced Query Understanding in Job Matching Systems

Query understanding is essential in modern relevance systems, where user queries are often short, ambiguous, and highly context-dependent. Traditional approaches often rely on multiple task-specific Named Entity Recognition models to extract structured facets as seen in job search applications. However, this fragmented architecture is brittle, expensive to maintain, and slow to adapt to evolving taxonomies and language patterns. In this paper, we introduce a unified query understanding framework powered by a Large Language Model (LLM), designed to address these limitations. Our approach jointly models the user query and contextual signals such as profile attributes to generate structured interpretations that drive more accurate and personalized recommendations. The framework improves relevance quality in online A/B testing while significantly reducing system complexity and operational overhead. The results demonstrate that our solution provides a scalable and adaptable foundation for query understanding in dynamic web applications.

cs.IR↗

arXiv2025

Quantum-centric simulation of hydrogen abstraction by sample-based quantum diagonalization and entanglement forging

The simulation of electronic systems is an anticipated application for quantum-centric computers, i.e. heterogeneous architectures where classical and quantum processing units operate in concert. An important application is the computation of radical chain reactions, including those responsible for the photodegradation of composite materials used in aerospace engineering. Here, we compute the activation energy and reaction energy for hydrogen abstraction from 2,2-diphenyldipropane, used as a minimal model for a step in a radical chain reaction. Calculations are performed using a superconducting quantum processor of the IBM Heron family and classical computing resources. To this end, we combine a qubit-reduction technique called entanglement forging (EF) with sample-based quantum diagonalization (SQD), a method that projects the Schr\"{o}dinger equation into a subspace of configurations sampled from a quantum device. In conventional quantum simulations, a qubit represents a spin-orbital. In contrast, EF maps a qubit to a spatial orbital, reducing the required number of qubits by half. We provide a complete derivation and a detailed description of the combined EF and SQD approach, and we assess its accuracy across active spaces of varying sizes upto (39e,39o).

quant-ph↗

arXiv2025

Improved Quantum Computation using Operator Backpropagation

Decoherence of quantum hardware is currently limiting its practical applications. At the same time, classical algorithms for simulating quantum circuits have progressed substantially. Here, we demonstrate a hybrid framework that integrates classical simulations with quantum hardware to improve the computation of an observable's expectation value by reducing the quantum circuit depth. In this framework, a quantum circuit is partitioned into two subcircuits: one that describes the backpropagated Heisenberg evolution of an observable, executed on a classical computer, while the other is a Schr\"odinger evolution run on quantum processors. The overall effect is to reduce the depths of the circuits executed on quantum devices, trading this with classical overhead and an increased number of circuit executions. We demonstrate the effectiveness of this method on a Hamiltonian simulation problem, achieving more accurate expectation value estimates compared to using quantum hardware alone.

quant-ph↗

arXiv2024

Towards quantum-centric simulations of extended molecules: sample-based quantum diagonalization enhanced with density matrix embedding theory

Computing ground-state properties of molecules is a promising application for quantum computers operating in concert with classical high-performance computing resources. Quantum embedding methods are a family of algorithms particularly suited to these computational platforms: they combine high-level calculations on active regions of a molecule with low-level calculations on the surrounding environment, thereby avoiding expensive high-level full-molecule calculations and allowing to distribute computational cost across multiple and heterogeneous computing units. Here, we present the first density matrix embedding theory (DMET) simulations performed in combination with the sample-based quantum diagonalization (SQD) method. We employ the DMET-SQD formalism to compute the ground-state energy of a ring of 18 hydrogen atoms, and the relative energies of the chair, half-chair, twist-boat, and boat conformers of cyclohexane. The full-molecule 41- and 89-qubit simulations are decomposed into 27- and 32-qubit active-region simulations, that we carry out on the ibm_cleveland device, obtaining results in agreement with reference classical methods. Our DMET-SQD calculations mark a tangible progress in the size of active regions that can be accurately tackled by near-term quantum computers, and are an early demonstration of the potential for quantum-centric simulations to accurately treat the electronic structure of large molecules, with the ultimate goal of tackling systems such as peptides and proteins.

quant-ph↗

arXiv2024

Accurate quantum-centric simulations of supramolecular interactions

We present the first quantum-centric simulations of noncovalent interactions using a supramolecular approach. We simulate the potential energy surfaces (PES) of the water and methane dimers, featuring hydrophilic and hydrophobic interactions, respectively, with a sample-based quantum diagonalization (SQD) approach. Our simulations on quantum processors, using 27- and 36-qubit circuits, are in remarkable agreement with classical methods, deviating from complete active space configuration interaction (CASCI) and coupled-cluster singles, doubles, and perturbative triples (CCSD(T)) within 1 kcal/mol in the equilibrium regions of the PES. Finally, we test the capacity limits of the quantum methods for capturing hydrophobic interactions with an experiment on 54 qubits. These results mark significant progress in the application of quantum computing to chemical problems, paving the way for more accurate modeling of noncovalent interactions in complex systems critical to the biological, chemical and pharmaceutical sciences.

quant-ph↗