DoPAMINE: Double-sided Masked CNN for Pixel Adaptive Multiplicative Noise Despeckling

Sunghwan Joo; Sungmin Cha; Taesup Moon

Home/Archive/arXiv

arXiv · 1902.02530

DoPAMINE: Double-sided Masked CNN for Pixel Adaptive Multiplicative Noise Despeckling

Sunghwan Joo·Sungmin Cha·Taesup Moon

View original source ↗Read source document ↗Export metadata ↓

Abstract

We propose DoPAMINE, a new neural network based multiplicative noise despeckling algorithm. Our algorithm is inspired by Neural AIDE (N-AIDE), which is a recently proposed neural adaptive image denoiser. While the original N-AIDE was designed for the additive noise case, we show that the same framework, i.e., adaptively learning a network for pixel-wise affine denoisers by minimizing an unbiased estimate of MSE, can be applied to the multiplicative noise case as well. Moreover, we derive a double-sided masked CNN architecture which can control the variance of the activation values in each layer and converge fast to high denoising performance during supervised training. In the experimental results, we show our DoPAMINE possesses high adaptivity via fine-tuning the network parameters based on the given noisy image and achieves significantly better despeckling results compared to SAR-DRN, a state-of-the-art CNN-based algorithm.

Explore related subjects

eess.IV cs.CV cs.LG

Keep this discovery

Explore connections, maps & timelines

BibTeX RIS

Sunghwan Joo, Sungmin Cha, Taesup Moon. 2019-02-07. DoPAMINE: Double-sided Masked CNN for Pixel Adaptive Multiplicative Noise Despeckling. https://arxiv.org/abs/1902.02530

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

TransUNet-GradCAM: A Hybrid Transformer-U-Net with Self-Attention and Explainable Visualizations for Foot Ulcer Segmentation

Automated segmentation of diabetic foot ulcers (DFUs) supports clinical diagnosis, treatment planning, and wound monitoring, but remains challenging because of heterogeneous appearance, irregular morphology, and cluttered backgrounds in clinical photographs. We evaluate a hybrid ViT-bottleneck U-Net that combines a convolutional encoder-decoder with a Transformer bottleneck and attention-gated skip connections. We emphasise rigorous validation and explainability rather than architectural novelty. The model was trained on the public Foot Ulcer Segmentation Challenge (FUSeg) dataset using a hybrid Dice and cross-entropy loss. Results are reported over five seeds as mean +/- 95% confidence interval at a fixed threshold. On the internal validation set, the model achieved a Dice of 0.8035 +/- 0.0053 and IoU of 0.7149 +/- 0.0073 (HD95 = 19.74 px, ASSD = 6.12 px). Ablation showed that only the hybrid loss significantly changed Dice (-0.038, p < 0.001), while the Transformer bottleneck, attention gates, and augmentation had small, non-significant in-domain effects. External validation without retraining achieved a Dice of 0.7460 on the AZH Wound Care Center cohort (n = 278), retaining about 92% of internal Dice. A small Medetec subset (n = 8) was used only for qualitative assessment, indicating partial rather than robust generalisation under domain shift. Explainability analysis found Grad-CAM more wound-localised (energy-in-mask 0.871 vs. 0.102), while attention rollout was significantly more faithful (p = 0.038, n = 200). Predicted and expert wound areas showed strong agreement (Pearson r = 0.944), with a lightweight model of 8.79 M parameters.

eess.IV↗

arXiv2026

Constrained Color Carrier: Characterization-Preserving Conditional Color Rendering in Multi-Illuminant Camera Profiles

In Digital Negative (DNG) multi-illuminant profiles, characterization matrices and nonlinear rendering payloads share condition-dependent interpolation slots, so adding a slot for rendering capacity also introduces an additional characterization state. We introduce Constrained Color Carrier (CCC), which constructs the three pre-serialization ColorMatrix and ForwardMatrix states from the original dual matrix segments while allowing the same shared slots to carry three HueSatMap rendering bases. Condition-specific HueSatMap payloads are solved as numerical preimages of the target through a fixed serialized downstream rendering operator, and carrier selection enforces a preservation bound on the host-effective interpolated characterization. We evaluate CCC on the Sony ILCE-7RM5 Adobe Standard dual-illuminant profile using a white-balance-dependent Standard ColorCorrect target recovered from Phocus 4.0.1 for the Hasselblad X2D 100C. Using Euclidean Oklab error, CCC yields a worst-temperature 95th-percentile preservation error of 0.003857, below the prescribed tolerance of 0.004, and reduces the worst-condition 95th-percentile target error from 0.08208 for the Dual representation to 0.03508. The synthetic Ordinary Triple yields a preservation error of 0.014802 and exceeds the same tolerance. The serialized DNG Camera Profile (DCP) and Extensible Metadata Platform (XMP) artifacts reproduce the final color-table payloads exactly and yield zero numerical difference from solver-side offline execution, showing that the CCC solution is representable within the evaluated serialized profile format.

eess.IV↗

arXiv2026

StainBridge: Stain-Aware Pairwise Registration of Serial Renal Biopsy Whole-Slide Images Across Structural and Immunohistochemical Stains

Three-dimensional (3D) reconstruction of histopathology tissue requires accurate pairwise registration of serial whole-slide images (WSIs). Cross-stain benchmarks have advanced registration of differently stained histology, including structural-to-immunohistochemistry (IHC) pairs, but serial renal biopsy stacks remain difficult: they interleave several structural stains with diverse IHC markers whose expression can be sparse or absent, leaving few shared features to match. We present StainBridge, a stain-aware framework for registering serial renal biopsy WSIs across structural and IHC stains. StainBridge couples three preprocessing components, stain deconvolution, intensity normalization, and tissue-mask injection, with XFeat-based affine initialization and four nonrigid backends (VoxelMorph, ConvexAdam, FireANTs, and DeeperHistReg). We evaluate it on 23 cases comprising 338 WSIs, four structural stains, and ten IHC markers, with functional tissue units annotated on consecutive sections to give 1,468 landmark correspondences across 272 image pairs, and report tissue-mask Dice, functional-unit centroid error in micrometers, and tissue-restricted structural similarity. Nonrigid refinement improves on the affine initialization for three of four backends, VoxelMorph being the exception. DeeperHistReg, which computes its own initialization rather than relying on XFeat, gives the best pooled landmark accuracy and registers the most pairs, including every attempted structural-IHC pair. Preprocessing improves landmark accuracy for ConvexAdam and FireANTs in every stain-pairing category, and FireANTs shows both the largest single preprocessing gain on structural-IHC pairs and the best pooled tissue overlap. These results offer practical guidance for cross-stain registration and a foundation for integrated 3D analysis of renal tissue architecture and molecular expression.

eess.IV↗