Search arXivSearch

arXiv · 2005.09146

3D Augmented Reality-Assisted CT-Guided Interventions: System Design and Preclinical Trial on an Abdominal Phantom using HoloLens 2

Abstract

Background: Out-of-plane lesions pose challenges for CT-guided interventions. Augmented reality (AR) headset devices have evolved and are readily capable to provide virtual 3D guidance to improve CT-guided targeting. Purpose: To describe the design of a three-dimensional (3D) AR-assisted navigation system using HoloLens 2 and evaluate its performance through CT-guided simulations. Materials and Methods: A prospective trial was performed assessing CT-guided needle targeting on an abdominal phantom with and without AR guidance. A total of 8 operators with varying clinical experience were enrolled and performed a total of 86 needle passes. Procedure efficiency, radiation dose, and complication rates were compared with and without AR guidance. Vector analysis of the first needle pass was also performed. Results: Average total number of needle passes to reach the target reduced from 7.4 passes without AR to 3.4 passes with AR (54.2% decrease, p=0.011). Average dose-length product (DLP) decreased from 538 mGy-cm without AR to 318 mGy-cm with AR (41.0% decrease, p=0.009). Complication rate of hitting a non-targeted lesion decreased from 11.9% without AR (7/59 needle passes) to 0% with AR (0/27 needle passes). First needle passes were more nearly aligned with the ideal target trajectory with AR versus without AR (4.6° vs 8.0° offset, respectively, p=0.018). Medical students, residents, and attendings all performed at the same level with AR guidance. Conclusions: 3D AR guidance can provide significant improvements in procedural efficiency and radiation dose savings for targeting challenging, out-of-plane lesions. AR guidance elevated the performance of all operators to the same level irrespective of prior clinical experience.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Brian J. Park, Stephen J. Hunt, Gregory J. Nadolski, Terence P. Gade. 2020-05-19. 3D Augmented Reality-Assisted CT-Guided Interventions: System Design and Preclinical Trial on an Abdominal Phantom using HoloLens 2. https://doi.org/10.1038/s41598-020-75676-4

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Fail-closed conformal multiresolution error control for conservative three-dimensional dose remapping in synthetic phantoms

Conservative dose remapping can be formulated by transporting mass and deposited energy across nonmatching grids, but fixed high-sampling calculations use the same work for easy and difficult cases. We developed conformal multiresolution error control (CoMERC), a fail-closed multilevel quasi-Monte Carlo (QMC) controller for reference-relative target-cell allocation error in a fixed piecewise-constant source model with known deformation. Two randomized nested replicates were evaluated at a probe level of 4 and candidate levels of 8 and 16. Four endpoints were controlled jointly: reference-mass-weighted global, high-gradient, and density-gradient-threshold root-mean-square error, plus eligible-cell maximum absolute error. A split-conformal multiplier was calibrated from 240 synthetic cases, frozen, and evaluated on 400 independent cases from the same generator and 120 cases from a prespecified shifted generator. In the primary set, joint coverage was 394/400 (98.50%; one-sided 95% lower limit, 97.06%), 388/400 cases (97.00%; lower limit, 95.18%) received an output, and 0/388 released outputs exceeded any tolerance (one-sided 95% upper limit, 0.769%). Final actions were level 8 for 190 cases, level 16 for 198, and ABSTAIN for 12. The frozen policy implied mean relative production-sample work of 0.5844 compared with always running both randomized replicates through level 16; the prespecified 95th-percentile bootstrap upper limit was 0.6194. All seven primary gates passed. In the shifted-generator set, 113/120 cases were released and one released output exceeded a tolerance. CoMERC provided marginal finite-sample error control and lower modeled production-sample work in the locked synthetic population, but not patient-level, registration-level, conditional-on-release, or clinical safety validation.

physics.med-ph

Dosimetric equivalence of deep learning prostate contours after LDR brachytherapy: pre-declared margins, patient-level acceptance thresholds and the incremental predictive value of DVH indices

Background and purpose: Dose Volume Histogram (DVH) indices remain the main dose-effect metrics for toxicity prediction, but they depend on how contours were made. Inter-observer variability (IOV) is unavoidable and clinically accepted, so the question for automatic segmentation addresses equivalence: do automatic contours produce DVH errors comparable to human IOV, and can these indices predict patient-reported toxicity? Materials and methods: In 429 patients treated with iodine-125 LDR-BT monotherapy, indices from expert manual delineation were compared with a deterministic and a Bayesian nnUNet on a fixed dose distribution, by two-one-sided tests against margins set from CT contouring IOV. Logistic regression gave patient-level thresholds at 90\,\% probability of equivalence. In 380 patients, eleven DHV indices were added to a clinical baseline predicting change in International Prostate Symptom Score (IPSS) at six horizons over 5 years, with nested cross-validation, bootstrap intervals and corrected $t$-tests. Results: All cohort-level comparisons of DVH indices were declared equivalent, with no interval consuming more than 44\,\% of its equivalence margin. Individual agreement was weaker with equivalence rates from 55.9\,\% to 89.7\,\%, depending on the DVH index and automatic segmentation model. Thresholds ranged from 0.864 to 0.958 Dice. No DVH block improved IPSS prediction at any horizon. The largest improvement declared by bootstrap intervals was 0.12 IPSS points, well below the minimal clinically important difference, across all learners. Conclusion: Automatic contours matched expert dosimetry within human IOV on average, but individual equivalence requires a volume dependent quality metric threshold definition. Our DVH indices panel provides no significant predictive power for IPSS, irrespective of segmentation source and horizon.

physics.med-ph

The Electrodynamic Basis of Dichroism-Mediated Polarization Perception

Humans see the polarization of light through entoptic percepts arising from the macula's Henle fiber layer, where xanthophyll pigments absorb preferentially across the radiating fibers. From the layer's complex dielectric tensor alone, Maxwell's equations in Berreman $4\times4$ form yield its Mueller matrix, set by four scalars $\{A,B,C,D\}$. Its intensity channel depends only on the dichroic pair $A$ and $B$, which fix the percepts at a maximum contrast $|B|/A\approx0.05$. One relation generates the whole dichroism-mediated family: Haidinger's brushes under a uniform field, their dark arms perpendicular to the $\mathbf{E}$-vector; fractured brushes under spatially varying fields; and $N$-fold brushes under vector-vortex illumination.

physics.med-ph