arXiv · 2610.39066
DeepDiff: Neuro-Dynamic Regression-Freedom Checking for Security Patch Validation
Abstract
Automatically validating AI-generated security patches remains a significant challenge. Eliminating a reported crash and passing existing test suites do not provide sufficient confidence that a patch correctly addresses the underlying vulnerability without introducing regressions. We present DeepDiff, a technique for regression-freedom checking that differentially evaluates candidate patches against the original vulnerable program using non-crashing inputs that exercise the affected code paths. The expectation of regression-freedom is that a correct patch should eliminate the vulnerability triggering crash while preserving the intended behavior on non-crashing inputs. To support this evaluation, we introduce a dataset of correct and incorrect patch candidates for open-source memory-safety vulnerabilities from CyberGym. We explore different approaches for non-triggering test input generation to reach the patched code, a purely neural regression-freedom checker, and a hybrid approach that combines dynamic analysis with neural techniques. Our experimental results demonstrate the effectiveness of regression-freedom checking in validating security patches while outlining the challenges that remain.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Laboni Sarker, Shuvendu K Lahiri. 2026-10-28. DeepDiff: Neuro-Dynamic Regression-Freedom Checking for Security Patch Validation. https://arxiv.org/abs/2610.39066
Cite the original work for its findings. Save a collection to share your selection of sources.