Color-Coded Compressive Spectral Imager Based on Focus Transformer Network

Abstract
Compressive spectral imaging (CSI) methods aim to reconstruct a three-dimensional hyperspectral image (HSI) from a single or a few two-dimensional compressive measurements. Conventional CSIs use separate optical elements to independently modulate the light field in the spatial and spectral domains, thus increasing the system complexity. In addition, real applications of CSIs require advanced reconstruction algorithms. This paper proposes a low-cost color-coded compressive snapshot spectral imaging method to reduce the system complexity and improve the HSI reconstruction performance. The combination of a color-coded aperture and an RGB detector is exploited to achieve higher degrees of freedom in the spatio-spectral modulations, which also renders a low-cost miniaturization scheme to implement the system. In addition, a deep learning method named Focus-based Mask-guided Spectral-wise Transformer (F-MST) network is developed to further improve the reconstruction efficiency and accuracy of HSIs. The simulations and real experiments demonstrate that the proposed F-MST algorithm achieves superior image quality over commonly used iterative reconstruction algorithms and deep learning algorithms.
Description
This article was originally published in Sensors. The version of record is available at: https://doi.org/10.3390/s25072006. © 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Keywords
hyperspectral imaging, compressive sensing, color-coded aperture, transformer
Citation
Li, Jinshan, Xu Ma, Aanish Paruchuri, Abdullah Alrushud, and Gonzalo R. Arce. 2025. "Color-Coded Compressive Spectral Imager Based on Focus Transformer Network" Sensors 25, no. 7: 2006. https://doi.org/10.3390/s25072006