Search arXivSearch

arXiv subjects

Defu Lian

Publications and source records attributed to Defu Lian.

3 recordsLinked to original sources

Preference Shapes Relevance: Cross-component Hierarchical Semantic Alignment for Personalized Generative Retrieval

Generative Retrieval (GR) has emerged as a promising paradigm by mapping queries directly to Semantic IDs (SIDs) with powerful representation capabilities for candidate items. However, existing SIDs derived solely from item content create a semantic gap, failing to align dynamic query intents with static item representations. Furthermore, current generative paradigms rarely model user behavior sequences and are always bottlenecked by the high inference latency of beam-search autoregressive decoding. To address these challenges, we propose $\textbf{C}$ross-component $\textbf{H}$ierarchical semantic $\textbf{A}$lignment for $\textbf{P}$ersonalized generative retrieval ($\textbf{CHAP}$), a novel personalized GR framework from a hierarchical perspective. First, we design a Hierarchical Semantic Alignment module to align query's latent space with item's quantization path and synchronize multi-granular semantics. Second, we construct a personalized GR framework that models user behavior by synergizing discrete SIDs for structural guidance and continuous representations for fine-grained semantic refinement. Notably, we introduce a Residual Cascading Generation mechanism to restrict the costly multi-step Transformer Decoder to a single-pass inference, boosting inference throughput while mitigating information loss. Extensive experiments on three public datasets, one proprietary industrial dataset, and online A/B tests demonstrate CHAP's superiority, validating the effectiveness and practical value of our approach. The code is publicly available at https://github.com/zzzgm/CHAP.

cs.IR

Learning Generated Controls under Fractured Geometry: Projective Residualization and Variation-Allocation Frontiers

Many two-stage estimators assess the first-stage learner by prediction error, even when the next stage uses its residual. In control-function instrumental variables, that residual must preserve the latent control direction without removing the treatment variation that identifies the structural response. A scalar prediction score does not reveal how the learner allocates this variation. Under piecewise-smooth graph geometry, interpolation can suppress the control, whereas isotropic smoothing can leak systematic variation across boundaries. We formulate this as a variation-allocation problem and introduce Adaptive Anisotropic Instrumental Heat Flow (A-IHF). The method uses pilot treatment contrasts to adapt edge conductance, takes the complement of a sparse graph resolvent as the generated control, and selects candidates without consulting outcomes. For a linear control-function regression, the generated control is identified only by its span. Working in that projective geometry, we derive an exact finite-sample fidelity--relevance frontier, spectral identities for remaining treatment variation and coefficient distortion, and a lower bound for monotone fixed-graph residual filters. A connected construction proves that adapting conductance can remove the corresponding fixed-graph obstruction. In a 54-cell benchmark, the A-IHF family wins 32 cells; its guarded observational variant lowers mean nonlinear response error by 8.3%, with the largest gains in fractured designs. Controlled rewiring explains when the graph should be used, replaced by a fallback, or rejected. The resulting lesson is task-specific: a first stage for generated controls should be judged by control fidelity, downstream relevance, and graph compatibility together.

cs.LG

Support Selection Beyond Smooth DAG Exactness: Completion Geometry,Score Margins, and Selective Certificates

Smooth acyclicity constraints answer whether a weighted support is a DAG, whereas structure learning asks which support change should be made. Existing analyses establish degeneracy for particular constraint formulas but do not isolate what follows from smooth exactness itself. At a DAG boundary, we show that minimal cycle completions generate a squarefree monomial ideal containing every restricted Taylor jet of an exact representation. If the smallest completion has $q$ edges, the first possible response has order $q$ for a vector residual and $2q$ for a nonnegative scalar. Exponentially many constant-scale cyclic manifolds exhibit the same lack of ranking away from the boundary for NOTEARS and DAGMA. We derive the exact selection time for an isolated cycle. When $Ψ'(h)\asymp h^ν$, the feasibility-only time is $T_0(\varepsilon)=Θ(\varepsilon^{-(2ν+1)})$; a score margin changes the leading dynamics at scale $T_0^{-1}$ for $ν>0$, while $ν=0$ has a logarithmic boundary layer requiring $γT_0\log(1/\varepsilon)\to0$. Experiments verify this law, and a truth-free separation statistic predicts selection time on 320 official NOTEARS/DAGMA trajectories (Spearman $-0.52$ and $-0.66$, permutation $p<10^{-4}$). For finite samples, a parent-set confidence family and forced-opposite queries certify skeleton and unshielded-collider labels shared by every population optimum of a frozen score. Across 320 runs, every regret bound covers an independent oracle-score audit. None of 3,042 certified skeleton or 2,396 collider labels disagrees with the oracle-score optimum, although 4.4% and 5.5%, respectively, disagree with the generating graph. These results separate DAG feasibility, score-based support selection, and causal identification.

cs.LG