Search arXiv⌕ Search

arXiv subjects

Cheng Peng

Publications and source records attributed to Cheng Peng.

At least 55 records · Page 3Linked to original sources

HetScene: Heterogeneity-Aware Diffusion for Dense Indoor Scene Generation

Generating controllable and physically plausible indoor scenes is a pivotal prerequisite for constructing high-fidelity simulation environments for embodied AI. However, existing deeplearning-based methods usually treat all objects as homogeneous instances within a unified generation process. While effective for sparse and simplistic layouts, they struggle to model realistic layouts with dense object arrangements and complex spatial dependencies, leadingto limited scalability and degraded physical plausibility. To deal with these challenges, we revisit indoor layout generation from the perspective of structural heterogeneity and decompose the objects into primary objects and secondary objects according to their distinct roles in shaping a scene. Based on this decomposition, we propose HetScene, a heterogeneous two-stage generation framework that decouples indoor layout synthesis into Structural Layout Generation (SLG) and Contextual Layout Generation (CLG). SLG first generates globally coherent structural layouts with only primary objects conditioned on text descriptions, top-down binary room masks, and spatial relation graphs, establishing a stable global macro-skeleton of large core furniture.

cs.CV↗

BenchCAD: A Comprehensive, Industry-Standard Benchmark for Programmatic CAD

Industrial Computer-Aided Design (CAD) code generation requires models to produce executable parametric programs from visual or textual inputs. Beyond recognizing the outer shape of a part, this task involves understanding its 3D structure, inferring engineering parameters, and choosing CAD operations that reflect how the part would be designed and manufactured. Despite the promise of Multimodal large language models (MLLMs) for this task, they are rarely evaluated on whether these capabilities jointly hold in realistic industrial CAD settings. We present BenchCAD, a unified benchmark for industrial CAD reasoning. BenchCAD contains 17,900 execution-verified CadQuery programs across 106 industrial part families, including bevel gears, compression springs, twist drills, and other reusable engineering designs. It evaluates models through visual question answering, code question answering, image-to-code generation, and instruction-guided code editing, enabling fine-grained analysis across perception, parametric abstraction, and executable program synthesis. Across 10+ frontier models, BenchCAD shows that current systems often recover coarse outer geometry but fail to produce faithful parametric CAD programs. Common failures include missing fine 3D structure, misinterpreting industrial design parameters, and replacing essential operations such as sweeps, lofts, and twist-extrudes with simpler sketch-and-extrude patterns. Fine-tuning and reinforcement learning improve in-distribution performance, but generalization to unseen part families remains limited. These results position BenchCAD as a benchmark for measuring and improving the industrial readiness of multimodal CAD automation.

cs.AI↗

Non-planar corrections in the symmetric orbifold

We calculate the non-planar corrections to the anomalous dimensions of certain quarter BPS states in the symmetric product orbifold $\text{Sym}^N \big({\mathbb{T}^4}\big)$. We find that some of the degeneracies in the spectrum for large twist $w$ and large $N$ are lifted by these contributions. We furthermore find signatures of quantum chaos, namely level repulsion and random matrix statistics. This suggests that integrability is only present in the symmetric orbifold in the planar (i.e. large $N$) limit.

hep-th↗

Retrieval-Augmented LLMs for Evidence Localization in Clinical Trial Recruitment from Longitudinal EHR Narratives

Screening patients for enrollment is a well-known, labor-intensive bottleneck that leads to under-enrollment and, ultimately, trial failures. Recent breakthroughs in large language models (LLMs) offer a promising opportunity to use artificial intelligence to improve screening. This study systematically explored both encoder- and decoder-based generative LLMs for screening clinical narratives to facilitate clinical trial recruitment. We examined both general-purpose LLMs and medical-adapted LLMs and explored three strategies to alleviate the "Lost in the Middle" issue when handling long documents, including 1) Original long-context: using the default context windows of LLMs, 2) NER-based extractive summarization: converting the long document into summarizations using named entity recognition, 3) RAG: dynamic evidence retrieval based on eligibility criteria. The 2018 N2C2 Track 1 benchmark dataset is used for evaluation. Our experimental results show that the MedGemma model with the RAG strategy achieved the best micro-F1 score of 89.05%, outperforming other models. Generative LLMs have remarkably improved trial criteria that require long-term reasoning across long documents, whereas trial criteria that span a short piece of context (e.g., lab tests) show incremental improvements. The real-world adoption of LLMs for trial recruitment must consider specific criteria for selecting among rule-based queries, encoder-based LLMs, and generative LLMs to maximize efficiency within reasonable computing costs.

cs.CL↗

SyncFix: Fixing 3D Reconstructions via Multi-View Synchronization

We present SyncFix, a framework that enforces cross-view consistency during the diffusion-based refinement of reconstructed scenes. SyncFix formulates refinement as a joint latent bridge matching problem, synchronizing distorted and clean representations across multiple views to fix the semantic and geometric inconsistencies. This means SyncFix learns a joint conditional over multiple views to enforce consistency throughout the denoising trajectory. Our training is done only on image pairs, but it generalizes naturally to an arbitrary number of views during inference. Moreover, reconstruction quality improves with additional views, with diminishing returns at higher view counts. Qualitative and quantitative results demonstrate that SyncFix consistently generates high-quality reconstructions and surpasses current state-of-the-art baselines, even in the absence of clean reference images. SyncFix achieves even higher fidelity when sparse references are available.

cs.CV↗

Detecting HIV-Related Stigma in Clinical Narratives Using Large Language Models

Human immunodeficiency virus (HIV)-related stigma is a critical psychosocial determinant of health for people living with HIV (PLWH), influencing mental health, engagement in care, and treatment outcomes. Although stigma-related experiences are documented in clinical narratives, there is a lack of off-the-shelf tools to extract and categorize them. This study aims to develop a large language model (LLM)-based tool for identifying HIV stigma from clinical notes. We identified clinical notes from PLWH receiving care at the University of Florida (UF) Health between 2012 and 2022. Candidate sentences were identified using expert-curated stigma-related keywords and iteratively expanded via clinical word embeddings. A total of 1,332 sentences were manually annotated across four stigma subscales: Concern with Public Attitudes, Disclosure Concerns, Negative Self-Image, and Personalized Stigma. We compared GatorTron-large and BERT as encoder-based baselines, and GPT-OSS-20B, LLaMA-8B, and MedGemma-27B as generative LLMs, under zero-shot and few-shot prompting. GatorTron-large achieved the best overall performance (Micro F1 = 0.62). Few-shot prompting substantially improved generative model performance, with 5-shot GPT-OSS-20B and LLaMA-8B achieving Micro-F1 scores of 0.57 and 0.59, respectively. Performance varied by stigma subscale, with Negative Self-Image showing the highest predictability and Personalized Stigma remaining the most challenging. Zero-shot generative inference exhibited non-trivial failure rates (up to 32%). This study develops the first practical NLP tool for identifying HIV stigma in clinical notes.

cs.CL↗

Uncertainty-quantified Pulse Signal Recovery from Facial Video using Regularized Stochastic Interpolants

Imaging Photoplethysmography (iPPG), an optical procedure which recovers a human's blood volume pulse (BVP) waveform using pixel readout from a camera, is an exciting research field with many researchers performing clinical studies of iPPG algorithms. While current algorithms to solve the iPPG task have shown outstanding performance on benchmark datasets, no state-of-the art algorithms, to the best of our knowledge, performs test-time sampling of solution space, precluding an uncertainty analysis that is critical for clinical applications. We address this deficiency though a new paradigm named Regularized Interpolants with Stochasticity for iPPG (RIS-iPPG). Modeling iPPG recovery as an inverse problem, we build probability paths that evolve the camera pixel distribution to the ground-truth signal distribution by predicting the instantaneous flow and score vectors of a time-dependent stochastic process; and at test-time, we sample the posterior distribution of the correct BVP waveform given the camera pixel intensity measurements by solving a stochastic differential equation. Given that physiological changes are slowly varying, we show that iPPG recovery can be improved through regularization that maximizes the correlation between the residual flow vector predictions of two adjacent time windows. Experimental results on three datasets show that RIS-iPPG provides superior reconstruction quality and uncertainty estimates of the reconstruction, a critical tool for the widespread adoption of iPPG algorithms in clinical and consumer settings.

cs.CV↗

Improving Automatic Summarization of Radiology Reports through Mid-Training of Large Language Models

Automatic summarization of radiology reports is an essential application to reduce the burden on physicians. Previous studies have widely used the "pre-training, fine-tuning" strategy to adapt large language models (LLMs) for summarization. This study proposed a subdomain adaptation through a mid-training method to improve summarization. We explored three adaptation strategies: (1) general-domain pre-training, (2) clinical-domain pre-training, and (3) clinical-domain pre-training followed by subdomain mid-training. We developed models using large-scale clinical text from the University of Florida (UF) Health and conducted mid-training and fine-tuning experiments using widely used benchmark datasets including OpenI and MIMIC-CXR. The experimental results show that the mid-trained model, GatorTronT5-Radio, achieved the best performance, outperforming models without mid-training in both text-based measures (ROUGE-L) and factuality measures (RadGraph-F1). Our mid-training methods also demonstrate better few-shot learning and could alleviate the "cold start" problem reported in previous studies as a learning barrier. Our findings support the use of "pre-training, mid-training, fine-tuning," instead of the widely used direct fine-tuning strategy.

cs.CL↗

A Parameter-Efficient Transfer Learning Approach through Multitask Prompt Distillation and Decomposition for Clinical NLP

Existing prompt-based fine-tuning methods typically learn task-specific prompts independently, imposing significant computing and storage overhead at scale when deploying multiple clinical natural language processing (NLP) systems. We present a multitask prompt distillation and decomposition framework that learns a single shared metaprompt from 21 diverse clinical source tasks and adapts it to unseen target tasks with fewer than 0.05% trainable parameters. Evaluated across five clinical NLP task types (named entity recognition, relation extraction, question answering, natural language inference, and summarization) on 10 held-out target datasets using three backbone models (LLaMA 3.1 8B, Meditron3 8B, gpt-oss 20B), our framework consistently outperforms LoRA by 1.5~1.7% despite using orders of magnitude fewer parameters, and exceeds single-task prompt tuning by 6.1~6.6%. The gpt-oss 20B model achieves the highest overall performance, particularly on clinical reasoning tasks. The strong zero- and few-shot performance demonstrates better transferability of the shared prompt representation.

cs.CL↗

Countering Catastrophic Forgetting of Large Language Models for Better Instruction Following via Weight-Space Model Merging

Large language models have been adopted in the medical domain for clinical documentation to reduce clinician burden. However, studies have reported that LLMs often "forget" a significant amount of instruction-following ability when fine-tuned using a task-specific medical dataset, a critical challenge in adopting general-purpose LLMs for clinical applications. This study presents a model merging framework to efficiently adapt general-purpose LLMs to the medical domain by countering this forgetting issue. By merging a clinical foundation model (GatorTronLlama) with a general instruct model (Llama-3.1-8B-Instruct) via interpolation-based merge methods, we seek to derive a domain-adapted model with strong performance on clinical tasks while retaining instruction-following ability. Comprehensive evaluation across medical benchmarks and five clinical generation tasks (e.g., radiology and discharge summarization) shows that merged models can effectively mitigate catastrophic forgetting, preserve clinical domain expertise, and retain instruction-following ability. In addition, our model merging strategies demonstrate training efficiency, achieving performance on par with fully fine-tuned baselines under severely constrained supervision (e.g., 64-shot vs. 256-shot). Consequently, weight-space merging constitutes a highly scalable solution for adapting open-source LLMs to clinical applications, facilitating broader deployment in resource-constrained healthcare environments.

cs.CL↗

CAM3R: Camera-Agnostic Model for 3D Reconstruction

Recovering dense 3D geometry from unposed images remains a foundational challenge in computer vision. Current state-of-the-art models are predominantly trained on perspective datasets, which implicitly constrains them to a standard pinhole camera geometry. As a result, these models suffer from significant geometric degradation when applied to wide-angle imagery captured via non-rectilinear optics, such as fisheye or panoramic sensors. To address this, we present CAM3R, a Camera-Agnostic, feed-forward Model for 3D Reconstruction capable of processing images from wide-angle camera models without prior calibration. Our framework consists of a two-view network which is bifurcated into a Ray Module (RM) to estimate per-pixel ray directions and a Cross-view Module (CVM) to infer radial distance with confidence maps, pointmaps, and relative poses. To unify these pairwise predictions into a consistent 3D scene, we introduce a Ray-Aware Global Alignment framework for pose refinement and scale optimization while strictly preserving the predicted local geometry. Extensive experiments on various camera model datasets, including panorama, fisheye and pinhole imagery, demonstrate that CAM3R establishes a new state-of-the-art in pose estimation and reconstruction.

cs.CV↗

Pressure-Induced Structural and Magnetic Evolution in Layered Antiferromagnet YbMn$_2$Sb$_2$

Electronic states under pressure exhibit unconventional spin and charge dynamics that provide a powerful route to uncover exotic phases in quantum materials. Here, we present the structural, magnetic, and electronic evolution of YbMn$_2$Sb$_2$ under pressure. Single-crystal X-ray diffraction reveals a pressure-induced structural transition from the space group trigonal $P\bar{3}m1$ to the monoclinic $P2_1$/$m$ phase near 3.5 GPa, which remains stable up to 10 GPa. Magnetization measurements display an anomalously weak net magnetic moment and the absence of Curie-Weiss behavior up to 400 K, suggesting the formation of short-range Mn moment pairs that cancel macroscopically and subsequently evolve into long-range order upon cooling. Temperature-dependent resistivity shows semiconducting behavior with a transition at ~119 K at ambient pressure, while pressure induces a dramatic suppression of resistance and the emergence of metallic-like temperature dependence, stabilized beyond 5 GPa. This pressure-driven semiconductor-metal transition is consistent with our density functional theory calculations, confirming the closing of the band gap under compression. Neutron diffraction under pressure identifies an incommensurate magnetic structure with antiparallel correlations between paired spins. Together, these results demonstrate how pressure-driven structural tuning and competing exchange interactions stabilize unconventional magnetic states in this low-dimensional magnetic semiconductor.

cond-mat.mtrl-sci↗

Robinson Splitting Theorem and $Σ_1$ Induction

The Robinson Splitting Theorem states that a c.e. degree $\mathbf{b}$ splits over any low c.e. degree $\mathbf{c}<\mathbf{b}$. We prove that a weaker version of this theorem holds in models of $\mathrm{P}^-+\mathrm{I}Σ_1$, with lowness replaced by superlowness.

math.LO↗

Upscaling the Navier-Stokes-Cahn-Hilliard model for incompressible multiphase flow in inhomogeneous porous media

This work presents a macroscopic model for the flow of two immiscible and incompressible fluids within inhomogeneous porous media. At the pore scale, the flow is governed by the full Navier-Stokes equations while the phase interface evolution is described by the Cahn-Hilliard equation. Applying the volume averaging method, we rigorously derive upscaled equations that characterize the Darcy-scale behavior of the two-phase system. The derivation yields unclosed terms originating from spatial derivations, which are subsequently closed by modeling them as functions of averaged quantities and specific transport coefficients. These coefficients are evaluated by solving localized closure problems defined on representative elementary volumes (REVs). A key contribution of this study is the formal incorporation of wetting behavior into the averaged chemical potential. We further discuss the theoretical distinctions between the proposed framework and standard empirical two-phase Darcy models. Finally, numerical simulations of the upscaled equations are performed, demonstrating the model's capability to capture essential two-phase flow characteristics in porous media.

physics.flu-dyn↗

Mixture Quantiles Estimated by Constrained Linear Regression

We study the problem of modeling univariate distributions via their quantile functions. We introduce a flexible family of distributions whose quantile function is a linear combination of basis quantiles. Because the model is linear in its parameters, estimation reduces to constrained linear regression, yielding a convex optimization problem that readily accommodates cardinality constraints as well as L1 or smoothness regularization. For Lq-type objectives we show the estimator is asymptotically equivalent to a minimum q-Wasserstein distance estimator and establish asymptotic normality. Experiments on simulated and real-world datasets demonstrate that the proposed method accurately captures both the central body and extreme tails of distributions while requiring substantially less computation than standard benchmark approaches.

stat.ME↗

An effective correction method for droplet volume conservation in direct numerical simulation of droplet-laden turbulence

Accurately preserving the volume of the dispersed droplets remains a significant challenge in phase-field simulations of droplet-laden turbulence, especially under conditions that feature strong interfacial deformation and breakup. While modified phase-field equations have been developed to mitigate volume loss, their effectiveness has not been systematically assessed in the context of fully developed turbulent flows. In this work, we first evaluate the performance of several representative volume-corrected phase-field models in direct numerical simulations of droplet-laden homogeneous isotropic turbulence. Our results reveal that, at sufficiently high Weber numbers, none of the existing models provides satisfactory droplet-volume preservation. To address this limitation, we then propose a simple yet effective modification of the conservataive Allen-Cahn equation by incorporating a curvature-dependent counter-diffusion correction. Direct numerical simulations in turbulent regimes demonstrate that the proposed model achieves conservation of droplet volume in a statistical sense, while avoiding common adverse effects, such as numerical instability, violation of global mass conservation, increased computational cost, artificial coarsening, or enhanced spurious velocities.

physics.flu-dyn↗

Sharp spectroscopic fingerprints of disorder in an incompressible magnetic state

Disorder significantly impacts the electronic properties of conducting quantum materials by inducing electron localization and thus altering the local density of states and electric transport. In insulating quantum magnetic materials, the effects of disorder are less understood and can drastically impact fluctuating spin states like quantum spin liquids. In the absence of transport tools, disorder is typically characterized using chemical methods or by semi-classical modeling of spin dynamics. This requires high magnetic fields that may not always be accessible. Here, we show that magnetization plateaus -- incompressible states found in many quantum magnets -- provide an exquisite platform to uncover small amounts of disorder, regardless of the origin of the plateau. Using optical magneto-spectroscopy on the Ising-Heisenberg triangular-lattice antiferromagnet K$_2$Co(SeO$_3$)$_2$ exhibiting a 1/3 magnetization plateau, we identify sharp spectroscopic lines, the fine structure of which serves as a hallmark signature of disorder. Through analytical and numerical modeling, we show that these fingerprints not only enable us to quantify minute amounts of disorder but also reveal its nature -- as dilute vacancies. Remarkably, this model explains all details of the thermomagnetic response of our system, including the existence of multiple plateaus. Our findings provide a new approach to identifying disorder in quantum magnets.

cond-mat.mtrl-sci↗

Distributed Information Bottleneck Theory for Multi-Modal Task-Aware Semantic Communication

Semantic communication shifts the focus from bit-level accuracy to task-relevant semantic delivery, enabling efficient and intelligent communication for next-generation networks. However, existing multi-modal solutions often process all available data modalities indiscriminately, ignoring that their contributions to downstream tasks are often unequal. This not only leads to severe resource inefficiency but also degrades task inference performance due to irrelevant or redundant information. To tackle this issue, we propose a novel task-aware distributed information bottleneck (TADIB) framework, which quantifies the contribution of any set of modalities to given tasks. Based on this theoretical framework, we design a practical coding scheme that intelligently selects and compresses only the most task-relevant modalities at the transmitter. To find the optimal selection and the codecs in the network, we adopt the probabilistic relaxation of discrete selection, enabling distributed encoders to make coordinated decisions with score function estimation and common randomness. Extensive experiments on public datasets demonstrate that our solution matches or surpasses the inference quality of full-modal baselines while significantly reducing communication and computational costs.

cs.IT↗