Search arXiv⌕ Search

arXiv subjects

Suryakant Singh

Publications and source records attributed to Suryakant Singh.

2 recordsLinked to original sources
arXiv2026

Semantic Context-aware mOdality fUsion Transformer (SCOUT): A Context-Aware Multimodal Transformer for Concept-Grounded Pathology Report Generation

Whole-slide pathology report generation requires models to integrate localized histomorphology, global tissue context, and diagnostically relevant semantic information, yet existing approaches typically rely on fixed pretrained visual representations and may fail to represent key diagnostic concepts. Here we present SCOUT: Semantic Context-aware mOdality fUsion Transformer, a concept-grounded multimodal framework that integrates local histological patterns, whole-slide context, and expert-curated diagnostic concepts. SCOUT maintains an evolving visual representation together with recursively updated slide- and concept-conditioned representations, allowing visual and contextual information to iteratively co-evolve across encoder depth. During decoding, separate attention pathways attend to these complementary streams before an adaptive multimodal fusion module combines them for each generated token. We evaluated SCOUT on TCGA-BRCA, HistAI, and REG-2025, comprising more than 20,900 WSI-report pairs across more than seven cancer types. Using common CONCHv1.5 features and evaluation protocols, SCOUT outperformed WSI-Caption, HistGen, and Bi-Gen, improving BLEU scores by 9.6% on average, METEOR by 11.0%, and ROUGE-L by 3.6% relative to the strongest competing method. On REG-2025, SCOUT additionally improved the Clinical Report Quality Score by 5.6%, indicating better preservation of clinically relevant report attributes beyond lexical similarity. Ablations showed complementary contributions from iterative context refinement and adaptive fusion, while learned gates provided inspectable token-level estimates of modality use. Our results suggest that progressive contextual conditioning is effective across heterogeneous pathology report generation settings and provides a flexible framework for integrating domain knowledge into vision-language models for computational pathology.

cs.CV↗
arXiv2026

Benchmarking Vision-Language Models for Automated Pathology Diagnosis and Report Generation

The rapid advancement of vision-language models (VLMs) has accelerated progress in computational pathology; however, whole-slide image (WSI)-based pathology report generation remains limited by the scarcity of large-scale WSI--report datasets and the complexity of mapping spatially distributed visual patterns to structured clinical text. To address this, we introduce a clinically curated Pan-Asia WSI--report dataset of approximately 10,500 pairs from five institutions and establish the REG 2025 benchmark through a MICCAI challenge for systematic evaluation of multimodal models. We analyze submitted methods spanning pretrained VLMs, multiple-instance learning frameworks, hierarchical expert models, retrieval-augmented generation, and cross-modal Transformers. Rather than indicating that VLM use alone was sufficient for superior performance, the results suggest that top-performing methods benefited from structured report representations, hierarchical diagnostic decomposition, and effective multimodal grounding. We identify key limitations, including instability in quantitative attribute estimation (e.g., numeric hallucination) and a tendency toward diagnostic overspecification, with some errors resembling known diagnostic pitfalls in routine pathology. These findings establish REG 2025 as a benchmark for evaluating WSI-based structured report generation and vision-language understanding in computational pathology, providing insights for the design of clinically grounded multimodal pathology models.

cs.CV↗