• Photonics Research
  • Vol. 9, Issue 2, B18 (2021)
Siming Zheng1、2、†, Yang Liu3、†, Ziyi Meng4, Mu Qiao5, Zhishen Tong6、7, Xiaoyu Yang1、2, Shensheng Han6、7, and Xin Yuan8、*
Author Affiliations
  • 1Computer Network Information Center, Chinese Academy of Sciences, Beijing 100190, China
  • 2University of Chinese Academy of Sciences, Beijing 100049, China
  • 3Computer Science and Artificial Intelligence Laboratory, Massachusetts Institute of Technology, Cambridge, Massachusetts 02139, USA
  • 4Beijing University of Posts and Telecommunications, Beijing 100876, China
  • 5New Jersey Institute of Technology, Newark, New Jersey 07102, USA
  • 6Key Laboratory for Quantum Optics and Center for Cold Atom Physics of CAS, Shanghai Institute of Optics and Fine Mechanics, Chinese Academy of Sciences, Shanghai 201800, China
  • 7Center of Materials Science and Optoelectronics Engineering, University of Chinese Academy of Sciences, Beijing 100049, China
  • 8Nokia Bell Labs, Murray Hill, New Jersey 07974, USA
  • show less
    DOI: 10.1364/PRJ.411745 Cite this Article Set citation alerts
    Siming Zheng, Yang Liu, Ziyi Meng, Mu Qiao, Zhishen Tong, Xiaoyu Yang, Shensheng Han, Xin Yuan. Deep plug-and-play priors for spectral snapshot compressive imaging[J]. Photonics Research, 2021, 9(2): B18 Copy Citation Text show less

    Abstract

    We propose a plug-and-play (PnP) method that uses deep-learning-based denoisers as regularization priors for spectral snapshot compressive imaging (SCI). Our method is efficient in terms of reconstruction quality and speed trade-off, and flexible enough to be ready to use for different compressive coding mechanisms. We demonstrate the efficiency and flexibility in both simulations and five different spectral SCI systems and show that the proposed deep PnP prior could achieve state-of-the-art results with a simple plug-in based on the optimization framework. This paves the way for capturing and recovering multi- or hyperspectral information in one snapshot, which might inspire intriguing applications in remote sensing, biomedical science, and material science. Our code is available at: https://github.com/zsm1211/PnP-CASSI.

    y=Ax+ε,

    View in Article

    A=[D1,,DB],

    View in Article

    x^=argmaxxpx|y(x|y)=argmaxxpy|x(y|x)px(x)py(y)=argmaxxpy|x(y|x)px(x).

    View in Article

    x^=argmaxxexp[12σε2yAx22+logpx(x)]=argminx12yAx22σε2logpx(x).

    View in Article

    x^=argminx12yAx22+λR(x).

    View in Article

    xk+1=argminx12Axy22+ρ2x(zkuk)22,

    View in Article

    zk+1=argminzλR(z)+ρ2z(xk+1+uk)22,

    View in Article

    uk+1=uk+(xk+1zk+1),

    View in Article

    xk+1=proxf/ρ(zkuk),

    View in Article

    zk+1=proxλR/ρ(xk+1+uk),

    View in Article

    uk+1=uk+(xk+1zk+1),

    View in Article

    (AA+ρI)1=ρ1Iρ1A(I+ρAA)1Aρ1.

    View in Article

    xk+1=(zkuk)+A[yA(zkuk)][Diag(AA)+ρ],

    View in Article

    zk+1=Dσ^k(xk+1+uk),

    View in Article

    uk+1=uk+(xk+1zk+1),

    View in Article

    xk+1=zk+A(yAzk),

    View in Article

    θk+1=Dσ^k(xk+1),

    View in Article

    zk+1=(1α)zk1+(αβ)zk+βθk+1,

    View in Article

    Dσ(v)=proxσ2R(v)=argminxR(x)+12σ2xv22,

    View in Article

    Siming Zheng, Yang Liu, Ziyi Meng, Mu Qiao, Zhishen Tong, Xiaoyu Yang, Shensheng Han, Xin Yuan. Deep plug-and-play priors for spectral snapshot compressive imaging[J]. Photonics Research, 2021, 9(2): B18
    Download Citation