Search arXivSearch

arXiv subjects

Nicu Sebe

Publications and source records attributed to Nicu Sebe.

3 recordsLinked to original sources

LiST: Local-Simplex Test-Time LoRA Fusion

Task-specific LoRA adapters offer a modular way to specialize large language and vision-language models. However, existing adapter composition methods are mostly static and cannot adapt to individual test inputs. To address these issues, we propose \textbf{LiST}, a label-free test-time LoRA fusion framework that converts an existing LoRA bank into a target-conditioned local simplex and searches sample-specific fusion weights at inference time. LiST builds joint task representations from LoRA parameter anchors and prompt-level behavior vectors, retrieves neighboring adapters as a local search space, and performs branch-preserving fusion without updating the backbone or adapters. Candidate weights are selected by a prompt-level energy with prior, geometric, and stochastic-consistency constraints, and are deployed only when they pass a safe acceptance rule. Otherwise, LiST falls back to a target-conditioned prior. Experiments on multimodal and language benchmarks show that LiST outperforms static LoRA merging and conventional test-time adaptation baselines, while preserving task-specific adapter utility and improving robustness on unseen tasks.

cs.CV

ContextBias: Controlled Evaluation of Bias Persistence Under Context Shift in Text-to-Image Models

Text-to-image models learn associations between concepts - in the case of this paper, people's professions, which we refer to as roles - and visual attributes. These associations can underpin many observed forms of stereotypical bias. A key open question in this area is whether these associations are stable or change when visual representations of people in professional roles are placed in different prompted contexts. We introduce ContextBias, a controlled evaluation framework, and ContextBench, a benchmark spanning 92 roles and 1,656 semantically controlled prompts, designed to isolate the effect of contextual variation on role-linked visual representations. Evaluating four state-of-the-art models on 66,240 generated images, we find that placing a role in a semantically unrelated context does not suppress role-linked attributes; instead, cross-role attribute concentration increases (pooled BI $+0.047$). Demographic cues, characteristic garments, and role-specific tools remain highly prevalent across context-free, related, and unrelated conditions, and are robust to semantic prompt reformulation. Scene composition and camera framing show the greatest context-sensitivity. These findings reveal a form of stereotypical persistence that remains largely invisible to context-free evaluations, highlighting the need for controlled contextual variation in bias benchmarking. Code and dataset: https://huggingface.co/datasets/shaghayegh/ContextBias , https://github.com/Sina-Emami/ContextBias

cs.CV

POCI-Diff: 3D-Layout Guided Diffusion for Controllable Synthetic Surveillance Data Generation

Training robust visual surveillance models requires large-scale datasets with precise spatial annotations, yet collecting real surveillance data is costly, privacy-sensitive, and often legally constrained. Synthetic data generation offers a compelling alternative, but existing methods lack fine-grained 3D control over object placement and appearance, limiting geometric consistency across camera viewpoints. We introduce POCI-Diff (Positioning Objects Consistently and Interactively), a framework that generates annotated synthetic scenes from explicit 3D bounding-box layouts with per-object semantic control. By integrating Blended Latent Diffusion with depth-conditioned ControlNet, POCI-Diff synthesises complex multi-object scenes in a single forward pass, binding individual text descriptions to specific 3D locations. We further propose a warping-free editing pipeline supporting object insertion, removal, and transformation via regeneration, enabling efficient scene variation for data augmentation. Object identity across edits is preserved by conditioning on reference images via IP-Adapter, ensuring appearance consistency throughout interactive scene manipulation. Experiments show that POCI-Diff outperforms state-of-the-art 3D layout-guided generation methods in visual fidelity and layout adherence, while eliminating warping-induced geometric artifacts.

cs.CV