Image reconstruction through the opaque medium has great significance in fields of biophotonics, optical imaging, mesoscopic physics, and optical communications. Previous researches are limited in the simple linear scattering process. Here, we develop a nonlinear speckle decoder network, which can reconstruct the phase information of the fundamental frequency wave via the nonlinear scattering signal. Further, we validate the ability of our model to recover simple and complex structures by using MNIST and CIFAR data sets, respectively. We then show that the model is able to restore the image information through different sets of nonlinear diffusers and reconstruct the image of a kind of completely unseen object category. The proposed method paves the way to nonlinear scattering imaging and information encryption.