3D Reconstruction from Arthroscopic Images using NeRF: a preliminary in-silico study

Hermine Kitio Tsamo; Agathe Yvinou; Daniel Pizarro; Samad Barri Khojasteh; Alexandre Tronchot; Antoine Ferreira; Eric Stindel; Aziliz Guezou-Philippe; Guillaume Dardenne

arXiv · 2609.39202

3D Reconstruction from Arthroscopic Images using NeRF: a preliminary in-silico study

Hermine Kitio Tsamo·Agathe Yvinou·Daniel Pizarro·Samad Barri Khojasteh·Alexandre Tronchot·Antoine Ferreira·Eric Stindel·Aziliz Guezou-Philippe·Guillaume Dardenne

View original source ↗Read source document ↗Export metadata ↓

Abstract

In knee arthroscopy surgery, accurate registration between preoperative and intraoperative anatomy is a critical step for patient-specific navigation. Achieving an accurate registration requires a reliable 3D reconstruction of the joint during surgery. Preoperative 3D models can be obtained from patient imaging through segmentation and reconstruction, but generating an intraoperative 3D representation remains particularly challenging. Arthroscopic imaging suffers from a limited field of view, low surface texture, and strong specular reflections, which make conventional feature-based 3D reconstruction methods unreliable. In this work, we investigate the application of MIS-NeRF (Minimally-Invasive Surgery Neural Radiance Fields) for reconstructing intraoperative knee 3D models from monocular arthroscopic images. The approach is evaluated on six simulated arthroscopic acquisitions representing six patient-specific knee 3D models. Both qualitative and quantitative results are presented to assess the reconstruction quality. The reconstructed knee 3D models were evaluated through their rendered images, achieving PSNR (Peak Signal-to-Noise Ratio) of 31.88 $\pm$ 2.82, SSIM (Structural Similarity Index) of 0.98 $\pm$ 0.004 and LPIPS (Learned Perceptual Image Patch Similarity) of 0.017 $\pm$ 0.006. These preliminary results suggest the feasibility of NeRF-based reconstruction in the challenging context of arthroscopy and may represent a promising step toward accurate in-silico preoperative-to-intraoperative 3D registration for computer-assisted orthopedic surgery. Further, validation on real arthroscopic data will be necessary to assess clinical applicability.

Explore related subjects

eess.IV

Keep this discovery

Explore connections, maps & timelines

BibTeX RIS

Hermine Kitio Tsamo, Agathe Yvinou, Daniel Pizarro, Samad Barri Khojasteh, Alexandre Tronchot, Antoine Ferreira, Eric Stindel, Aziliz Guezou-Philippe, Guillaume Dardenne. 2026-09-30. 3D Reconstruction from Arthroscopic Images using NeRF: a preliminary in-silico study. https://arxiv.org/abs/2609.39202

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

CryoSplat: Gaussian Splatting for Cryo-EM Homogeneous Reconstruction

As a critical modality for structural biology, cryogenic electron microscopy (cryo-EM) facilitates the determination of macromolecular structures at near-atomic resolution. The core computational task in single-particle cryo-EM is to reconstruct the 3D electrostatic potential of a molecule from noisy 2D projections acquired at unknown orientations. Gaussian mixture models (GMMs) provide a continuous, compact, and physically interpretable representation for molecular density and have recently gained interest in cryo-EM reconstruction. However, existing methods rely on external consensus maps or atomic models for initialization, limiting their use in self-contained pipelines. In parallel, differentiable rendering techniques such as Gaussian splatting have demonstrated remarkable scalability and efficiency for volumetric representations, suggesting a natural fit for GMM-based cryo-EM reconstruction. However, off-the-shelf Gaussian splatting methods are designed for photorealistic view synthesis and remain incompatible with cryo-EM due to mismatches in the image formation physics, reconstruction objectives, and coordinate systems. Addressing these issues, we propose cryoSplat, a GMM-based method that integrates Gaussian splatting with the physics of cryo-EM image formation. In particular, we develop an orthogonal projection-aware Gaussian splatting, with adaptations such as a view-dependent normalization term and FFT-aligned coordinate system tailored for cryo-EM imaging. These innovations enable stable and efficient homogeneous reconstruction directly from raw cryo-EM particle images using random initialization. Experimental results on real datasets validate the effectiveness and robustness of cryoSplat over representative baselines. The code will be released at https://github.com/Chen-Suyi/cryosplat.

eess.IV↗

arXiv2026

Image Moment Estimation for Crowded Datasets

Single-particle cryogenic electron microscopy (cryo-EM) is an imaging technique capable of reconstructing high-resolution three-dimensional (3D) structure of biological macromolecules from a set of noisy projection images taken at random viewing directions. The mathematical model for cryo-EM images typically assumes that each image contains exactly one particle, which is centered at the origin. However, many experimental datasets contain particle images which include multiple particles: one central particle and a few crowding particles. This deviation from the model leads to inaccurate estimation of image statistics, such as the low-order image moments. To account for this, we propose a method to estimate image moments while correcting for the effect of crowding particles. This method can be run directly from a set of cryo-EM micrographs with picked particles, and we demonstrate its efficacy on a wide array of synthetic data.

eess.IV↗

arXiv2026

Measurement-Adaptive Light-Cone Transform for Robust Non-Line-of-Sight Imaging

Practical non-line-of-sight (NLOS) measurements are affected by noise and deviations from idealized light transport, which can degrade reconstruction with conventional light-cone transform (LCT) methods. We propose the Measurement-Adaptive Light-Cone Transform (MALCT), a physics-guided framework that retains the efficient Fourier-domain inversion structure of LCT. {Within a unified variational formulation, MALCT combines the analytical response with a shared learned response through measurement-conditioned weighting and predicts a measurement-conditioned, frequency-dependent regularization map.} An attention-enhanced spatio-temporal feature extraction module captures long-range temporal dependencies and local spatial correlations to support reconstruction under low-signal conditions. Experiments on synthetic data and real measurements from different NLOS systems demonstrate improved reconstruction quality. Controlled evaluations further assess robustness to temporal-response broadening and reduced acquisition time. MALCT also preserves scene structures with spatial sampling grids down to $32\times32$, supporting its potential for NLOS imaging under limited acquisition budgets.

eess.IV↗