Search arXivSearch

arXiv subjects

Daniel Luna

Publications and source records attributed to Daniel Luna.

2 recordsLinked to original sources

Objective Video Quality Assessment in FWA-Based Over-the-Top Content Delivery Across Open Source 5G Networks

This paper presents a comprehensive experimental video quality assessment in 5G-based Fixed Wireless Access (FWA) networks, leveraging a real open source 5G network testbed. Addressing the critical need for robust UHD video delivery, the study systematically investigates the impact of transmission modes (SISO and MIMO), modulation schemes (64-QAM and 256-QAM), and network load (one to five users) on both network throughput and perceived video quality. Unlike simulation-based approaches, our methodology integrates automated streaming campaigns with objective full-reference Quality of Experience (QoE) metrics (PSNR, ssim, and VMAF) computed from 4K video streams delivered via MPEG-DASH, enabling frame-level correlation between network performance and user experience. Key findings demonstrate that MIMO consistently outperforms SISO, sustaining higher throughput and superior visual quality even under increasing user demand. Specifically, MIMO with 256-QAM maintained VMAF scores above the visually lossless threshold with five concurrent users, while SISO configurations experienced significant degradation. These results provide empirical evidence for the critical role of spatial diversity and higher-order modulation in ensuring reliable UHD video delivery over FWA. The proposed reproducible framework for detailed quality assessment offers valuable insights for future optimization of 5G FWA deployments, contributing to the practical understanding and deployment strategies for high-quality video services in Open RAN environments.

cs.NI

Impact of class imbalance on chest x-ray classifiers: towards better evaluation practices for discrimination and calibration performance

This work aims to analyze standard evaluation practices adopted by the research community when assessing chest x-ray classifiers, particularly focusing on the impact of class imbalance in such appraisals. Our analysis considers a comprehensive definition of model performance, covering not only discriminative performance but also model calibration, a topic of research that has received increasing attention during the last years within the machine learning community. Firstly, we conducted a literature study to analyze common scientific practices and confirmed that: (1) even when dealing with highly imbalanced datasets, the community tends to use metrics that are dominated by the majority class; and (2) it is still uncommon to include calibration studies for chest x-ray classifiers, albeit its importance in the context of healthcare. Secondly, we perform a systematic experiment on two major chest x-ray datasets to explore the behavior of several performance metrics under different class ratios and show that widely adopted metrics can conceal the performance in the minority class. Finally, we recommend the inclusion of complementary metrics to better reflect the system's performance in such scenarios. Our study indicates that current evaluation practices adopted by the research community for chest x-ray computer-aided diagnosis systems may not reflect their performance in real clinical scenarios, and suggest alternatives to improve this situation.

cs.CV