Search arXivSearch

arXiv · 2208.03968

All-optical image classification through unknown random diffusers using a single-pixel diffractive network

Abstract

Classification of an object behind a random and unknown scattering medium sets a challenging task for computational imaging and machine vision fields. Recent deep learning-based approaches demonstrated the classification of objects using diffuser-distorted patterns collected by an image sensor. These methods demand relatively large-scale computing using deep neural networks running on digital computers. Here, we present an all-optical processor to directly classify unknown objects through unknown, random phase diffusers using broadband illumination detected with a single pixel. A set of transmissive diffractive layers, optimized using deep learning, forms a physical network that all-optically maps the spatial information of an input object behind a random diffuser into the power spectrum of the output light detected through a single pixel at the output plane of the diffractive network. We numerically demonstrated the accuracy of this framework using broadband radiation to classify unknown handwritten digits through random new diffusers, never used during the training phase, and achieved a blind testing accuracy of 88.53%. This single-pixel all-optical object classification system through random diffusers is based on passive diffractive layers that process broadband input light and can operate at any part of the electromagnetic spectrum by simply scaling the diffractive features proportional to the wavelength range of interest. These results have various potential applications in, e.g., biomedical imaging, security, robotics, and autonomous driving.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Yi Luo, Bijie Bai, Yuhang Li, Ege Cetintas, Aydogan Ozcan. 2022-08-08. All-optical image classification through unknown random diffusers using a single-pixel diffractive network. https://doi.org/10.1038/s41377-023-01116-3

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Active Fourier Spectroscopy: From fixed sampling protocols to adaptive measurement

Fourier-transform spectroscopy (FTS) is based on the Nyquist-Shannon theorem, which dictates a strict sampling protocol for the measurement of continuous signals. Here we introduce Active Fourier Spectroscopy (AFS), a generalization of FTS in which measurements are still taken in the Fourier-conjugate delay domain, but where the most informative acquisition points are selected adaptively and the spectrum is reconstructed by sequential, uncertainty-aware inference rather than by fixed-grid Fourier inversion. Our approach relies on a theoretical insight that the Nyquist condition applies only under complete ignorance about the system under investigation, and shows how to systematically improve upon it when prior knowledge exists. Because AFS recovers conventional FTS whenever the prior is uninformative, its performance never falls below that of conventional sampling. We demonstrate AFS for optical spectroscopy in three settings vital to research and medicine: clinical FTIR-based blood plasma analysis, optical metrology of structured laser beams, and hyperspectral imaging with an RGB camera. In each case AFS reaches a higher target reconstruction quality from far fewer acquisitions and provides complete uncertainty quantification in real time, propagated rigorously through downstream analysis.

physics.optics

Memory in Integrated Photonic Neural Networks: From Physical Mechanisms to Neuromorphic Architectures

The rapid scaling of artificial neural networks has exposed fundamental limitations of conventional von Neumann computing architectures. In these systems, the physical separation between memory and processing creates a bottleneck, as computational capabilities outpace the ability of memory and interconnects to supply and retrieve data. In contrast, biological neural systems inherently co-localize computation and memory through distributed, dynamical processes. Neuromorphic computing seeks to emulate this paradigm by leveraging physical substrates whose intrinsic dynamics simultaneously encode and process information. Among emerging platforms, silicon photoncis offer a compelling approach due to its high bandwidth, low-loss propagation, and inherent parallelism. This review examines the role of memory in integrated photonic neuromorphic systems, with emphasis on the physical mechanisms that provide volatile (short-term) and non-volatile (long-term) memory in silicon-on-insulator and hybrid silicon-on-insulator platforms. Drawing inspiration from digital, biological, and photonic memory architectures, we classify existing approaches based on their underlying physical principles. We cover implementations ranging from delay lines and slow-light structures to multistable dynamics and structural memory based on charge trapping and phase-change materials. We then discuss how these mechanisms support photonic neural network architectures, including feed-forward, reservoir computing, spiking and hybrid optoelectronic recurrent systems, and assess their relevance for time-dependent singal-processing tasks such as channel equalization in telecommunications. This review aims to establish a unified framework for understanding memory and learning in neuromorphic photonics and outlines key challenges and opportunities for scalable, energy-efficient neuromorphic hardware.

physics.optics

Exoplanet Detection Using Adaptive Quantum-Optimal Measurement

Detecting terrestrial exoplanets in the habitable zones of nearby stars remains a critical challenge. Such planets can be \(10^8\) to \(10^{10}\) times fainter than their host stars and lie at diffraction-limited angular separations, where starlight strongly obscures the companion signal. Here we present an adaptive quantum measurement method for estimating the number, positions, and brightnesses of mutually incoherent point sources in the sub-Rayleigh, ultra-high-contrast regime, operating at contrasts down to \(10^{-8}\) -- five orders of magnitude beyond previous quantum imaging approaches to exoplanet detection. The method adopts a spatial-mode basis that is updated to maximize the quantum Fisher information per detected photon. Estimation is performed by maximum likelihood in log-brightness coordinates, and the source count is determined by Bayesian-information-criterion (BIC) model selection directly from photon-count statistics, without a tunable detection threshold. For point sources within sub-Rayleigh separations and with brightness ratios spanning eight orders of magnitude, the method reconstructs complete scenes with a mean success rate of \(72.5\%\). Furthermore, it is robust to misalignment, maintaining a \(71.3\%\) success rate under offsets of up to six pixels. These results demonstrate that terrestrial exoplanets can be detected below the Rayleigh limit, a regime previously inaccessible to direct imaging.

physics.optics