Ultrasensitive infrared-to-visible artificial vision via self-evolving projection guided by single-pixel detection

Yao Wang; Baolei Liu; Muchen Zhu; Linjun Zhai; Dajing Wang; Zhaohua Yang; Fan Wang

Home/Archive/arXiv

arXiv · 2606.29870

Ultrasensitive infrared-to-visible artificial vision via self-evolving projection guided by single-pixel detection

Yao Wang·Baolei Liu·Muchen Zhu·Linjun Zhai·Dajing Wang·Zhaohua Yang·Fan Wang

View original source ↗Read source document ↗Export metadata ↓

Abstract

Infrared detection and visualization are essential for augmenting human perception across diverse fields, ranging from night vision to industrial inspection and bio-imaging. Conventional infrared cameras are often hindered by high cost, bulky architecture, and complex fabrication requirements. Upconversion sensing systems offer a pixel-free and cost-effective alternative solution by upconverting infrared photons into visible-light signals. However, existing upconversion systems suffer from limitations such as high operating voltages, low quantum efficiency, which prevent their applications in photon-starved environments. Here, we report self-evolving infrared-to-visible upconversion with single-pixel detection (SIVIS) that enables real-time upconverted visualization under photon-starved conditions by integrating self-evolving projection with single-pixel sensing. SIVIS iteratively optimizes illumination patterns with a digital micromirror device based on real-time feedback from a single-pixel infrared detector. This self-evolving process enables the autonomous reconstruction of the target's geometric profile. Simultaneously, it projects a co-modulated visible beam onto the object itself or an adjacent screen, rendering the infrared target directly perceptible to the naked eye in real-time. SIVIS achieves sensing and projection without latency under an ultra-low infrared detection limit of 0.11 photons per pixel per frame (sub-pW -cm2 level) benefited from the high sensitivity. Furthermore, we also validate SIVIS to decrypt infrared-encoded anti-counterfeiting features and visualize vascular-like structures embedded within biological tissues. This photon-feedback-driven artificial vision framework offers a scalable and adaptive solution for ultrasensitive infrared vision, opening promising avenues for night vision, biomedical imaging, and sensing under extreme low-light conditions.

Explore related subjects

physics.optics

Keep this discovery

Explore connections, maps & timelines

BibTeX RIS

Yao Wang, Baolei Liu, Muchen Zhu, Linjun Zhai, Dajing Wang, Zhaohua Yang, Fan Wang. 2026-06-29. Ultrasensitive infrared-to-visible artificial vision via self-evolving projection guided by single-pixel detection. https://arxiv.org/abs/2606.29870

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

Active Fourier Spectroscopy: From fixed sampling protocols to adaptive measurement

Fourier-transform spectroscopy (FTS) is based on the Nyquist-Shannon theorem, which dictates a strict sampling protocol for the measurement of continuous signals. Here we introduce Active Fourier Spectroscopy (AFS), a generalization of FTS in which measurements are still taken in the Fourier-conjugate delay domain, but where the most informative acquisition points are selected adaptively and the spectrum is reconstructed by sequential, uncertainty-aware inference rather than by fixed-grid Fourier inversion. Our approach relies on a theoretical insight that the Nyquist condition applies only under complete ignorance about the system under investigation, and shows how to systematically improve upon it when prior knowledge exists. Because AFS recovers conventional FTS whenever the prior is uninformative, its performance never falls below that of conventional sampling. We demonstrate AFS for optical spectroscopy in three settings vital to research and medicine: clinical FTIR-based blood plasma analysis, optical metrology of structured laser beams, and hyperspectral imaging with an RGB camera. In each case AFS reaches a higher target reconstruction quality from far fewer acquisitions and provides complete uncertainty quantification in real time, propagated rigorously through downstream analysis.

physics.optics↗

arXiv2026

Memory in Integrated Photonic Neural Networks: From Physical Mechanisms to Neuromorphic Architectures

The rapid scaling of artificial neural networks has exposed fundamental limitations of conventional von Neumann computing architectures. In these systems, the physical separation between memory and processing creates a bottleneck, as computational capabilities outpace the ability of memory and interconnects to supply and retrieve data. In contrast, biological neural systems inherently co-localize computation and memory through distributed, dynamical processes. Neuromorphic computing seeks to emulate this paradigm by leveraging physical substrates whose intrinsic dynamics simultaneously encode and process information. Among emerging platforms, silicon photoncis offer a compelling approach due to its high bandwidth, low-loss propagation, and inherent parallelism. This review examines the role of memory in integrated photonic neuromorphic systems, with emphasis on the physical mechanisms that provide volatile (short-term) and non-volatile (long-term) memory in silicon-on-insulator and hybrid silicon-on-insulator platforms. Drawing inspiration from digital, biological, and photonic memory architectures, we classify existing approaches based on their underlying physical principles. We cover implementations ranging from delay lines and slow-light structures to multistable dynamics and structural memory based on charge trapping and phase-change materials. We then discuss how these mechanisms support photonic neural network architectures, including feed-forward, reservoir computing, spiking and hybrid optoelectronic recurrent systems, and assess their relevance for time-dependent singal-processing tasks such as channel equalization in telecommunications. This review aims to establish a unified framework for understanding memory and learning in neuromorphic photonics and outlines key challenges and opportunities for scalable, energy-efficient neuromorphic hardware.

physics.optics↗

arXiv2026

Exoplanet Detection Using Adaptive Quantum-Optimal Measurement

Detecting terrestrial exoplanets in the habitable zones of nearby stars remains a critical challenge. Such planets can be \(10^8\) to \(10^{10}\) times fainter than their host stars and lie at diffraction-limited angular separations, where starlight strongly obscures the companion signal. Here we present an adaptive quantum measurement method for estimating the number, positions, and brightnesses of mutually incoherent point sources in the sub-Rayleigh, ultra-high-contrast regime, operating at contrasts down to \(10^{-8}\) -- five orders of magnitude beyond previous quantum imaging approaches to exoplanet detection. The method adopts a spatial-mode basis that is updated to maximize the quantum Fisher information per detected photon. Estimation is performed by maximum likelihood in log-brightness coordinates, and the source count is determined by Bayesian-information-criterion (BIC) model selection directly from photon-count statistics, without a tunable detection threshold. For point sources within sub-Rayleigh separations and with brightness ratios spanning eight orders of magnitude, the method reconstructs complete scenes with a mean success rate of \(72.5\%\). Furthermore, it is robust to misalignment, maintaining a \(71.3\%\) success rate under offsets of up to six pixels. These results demonstrate that terrestrial exoplanets can be detected below the Rayleigh limit, a regime previously inaccessible to direct imaging.

physics.optics↗