arXiv subjects

Kelvin Zhenghao Li

Publications and source records attributed to Kelvin Zhenghao Li.

4 recordsLinked to original sources

arXiv2026

Disentangling and Fusing Neurostructural and Vascular Ageing for Retinal Age Prediction

Estimating biological age is an important task in ageing research, as it quantifies individual ageing trajectories beyond chronological age. Retinal age estimation has become a well-established direction in this area because retinal imaging provides a non-invasive window into neural and microvascular ageing. Existing studies, however, have predominantly focused on fundus photographs and usually model retinal ageing as a single generic process. Although biological ageing is heterogeneous and different organs or tissues may age at different rates, little research has explicitly distinguished neurostructural and vascular ageing in retinal age prediction. This work fills this gap by studying neurostructural ageing with Optical Coherence Tomography (OCT) images and vascular ageing with Optical Coherence Tomography Angiography (OCTA) images. We formulate multimodal OCT/OCTA retinal age estimation as a structural-vascular ageing decomposition problem and propose SAP-DPF, a unified dual-path prediction framework that separately estimates structural and vascular ageing, models modality-specific predictive uncertainty, and adaptively fuses the two ageing signals through an uncertainty-gated late-fusion module. Using this unified prediction framework, SAP-DPF achieves a mean absolute error of 4.07 years for the structural pathway and 7.37 years for the vascular pathway, while the proposed late-fusion algorithm further improves the overall mean absolute error to 4.02 years, representing a 12.52% improvement over the strongest single-modality baseline. This work could extend retinal age prediction beyond a single biological-age estimate, providing a framework for investigating structural and vascular contributions to heterogeneous retinal ageing.

eess.IV↗

arXiv2025

Asking the Right Questions: Benchmarking Large Language Models in the Development of Clinical Consultation Templates

This study evaluates the capacity of large language models (LLMs) to generate structured clinical consultation templates for electronic consultation. Using 145 expert-crafted templates developed and routinely used by Stanford's eConsult team, we assess frontier models -- including o3, GPT-4o, Kimi K2, Claude 4 Sonnet, Llama 3 70B, and Gemini 2.5 Pro -- for their ability to produce clinically coherent, concise, and prioritized clinical question schemas. Through a multi-agent pipeline combining prompt optimization, semantic autograding, and prioritization analysis, we show that while models like o3 achieve high comprehensiveness (up to 92.2\%), they consistently generate excessively long templates and fail to correctly prioritize the most clinically important questions under length constraints. Performance varies across specialties, with significant degradation in narrative-driven fields such as psychiatry and pain medicine. Our findings demonstrate that LLMs can enhance structured clinical information exchange between physicians, while highlighting the need for more robust evaluation methods that capture a model's ability to prioritize clinically salient information within the time constraints of real-world physician communication.

cs.CL↗

arXiv2025

BEnchmarking LLMs for Ophthalmology (BELO) for Ophthalmological Knowledge and Reasoning

Current benchmarks evaluating large language models (LLMs) in ophthalmology are limited in scope and disproportionately prioritise accuracy. We introduce BELO (BEnchmarking LLMs for Ophthalmology), a standardized and comprehensive evaluation benchmark developed through multiple rounds of expert checking by 13 ophthalmologists. BELO assesses ophthalmology-related clinical accuracy and reasoning quality. Using keyword matching and a fine-tuned PubMedBERT model, we curated ophthalmology-specific multiple-choice-questions (MCQs) from diverse medical datasets (BCSC, MedMCQA, MedQA, BioASQ, and PubMedQA). The dataset underwent multiple rounds of expert checking. Duplicate and substandard questions were systematically removed. Ten ophthalmologists refined the explanations of each MCQ's correct answer. This was further adjudicated by three senior ophthalmologists. To illustrate BELO's utility, we evaluated six LLMs (OpenAI o1, o3-mini, GPT-4o, DeepSeek-R1, Llama-3-8B, and Gemini 1.5 Pro) using accuracy, macro-F1, and five text-generation metrics (ROUGE-L, BERTScore, BARTScore, METEOR, and AlignScore). In a further evaluation involving human experts, two ophthalmologists qualitatively reviewed 50 randomly selected outputs for accuracy, comprehensiveness, and completeness. BELO consists of 900 high-quality, expert-reviewed questions aggregated from five sources: BCSC (260), BioASQ (10), MedMCQA (572), MedQA (40), and PubMedQA (18). A public leaderboard has been established to promote transparent evaluation and reporting. Importantly, the BELO dataset will remain a hold-out, evaluation-only benchmark to ensure fair and reproducible comparisons of future models.

cs.CL↗

arXiv2025

Automated Structured Radiology Report Generation

Automated radiology report generation from chest X-ray (CXR) images has the potential to improve clinical efficiency and reduce radiologists' workload. However, most datasets, including the publicly available MIMIC-CXR and CheXpert Plus, consist entirely of free-form reports, which are inherently variable and unstructured. This variability poses challenges for both generation and evaluation: existing models struggle to produce consistent, clinically meaningful reports, and standard evaluation metrics fail to capture the nuances of radiological interpretation. To address this, we introduce Structured Radiology Report Generation (SRRG), a new task that reformulates free-text radiology reports into a standardized format, ensuring clarity, consistency, and structured clinical reporting. We create a novel dataset by restructuring reports using large language models (LLMs) following strict structured reporting desiderata. Additionally, we introduce SRR-BERT, a fine-grained disease classification model trained on 55 labels, enabling more precise and clinically informed evaluation of structured reports. To assess report quality, we propose F1-SRR-BERT, a metric that leverages SRR-BERT's hierarchical disease taxonomy to bridge the gap between free-text variability and structured clinical reporting. We validate our dataset through a reader study conducted by five board-certified radiologists and extensive benchmarking experiments.

cs.CL↗