• Acta Optica Sinica
  • Vol. 41, Issue 12, 1210001 (2021)
Yuan Ji1、2, Zhijie Zheng1、*, hao Wu1, Yin Zhang1, Wendong Chen2, and Tingzhou Mu2
Author Affiliations
  • 1Microelectronics Research and Development Center, Shanghai University, Shanghai 200072, China
  • 2School of Mechatronic Engineering and Automation, Shanghai University, Shanghai 200072, China
  • show less
    DOI: 10.3788/AOS202141.1210001 Cite this Article Set citation alerts
    Yuan Ji, Zhijie Zheng, hao Wu, Yin Zhang, Wendong Chen, Tingzhou Mu. Foveated JND Model Based on Stereo Vision and Its Application in Image Compression with Hardware Implementation[J]. Acta Optica Sinica, 2021, 41(12): 1210001 Copy Citation Text show less
    Test image of luminance masking characteristic experiment
    Fig. 1. Test image of luminance masking characteristic experiment
    Principles of 3D imaging
    Fig. 2. Principles of 3D imaging
    Test image of contrast masking characteristic experiment
    Fig. 3. Test image of contrast masking characteristic experiment
    Experimental results of luminance masking characteristic experiment. (a) Relationship between JND and luminance; (b) relationship between JND and eccentricity angle; (c) relationship between JND and depth; (d) relationship among JND, luminance, and eccentricity angle at d=1.0; (e) relationship among JND, luminance, and depth at e=20; (f) 4D image of luminance masking characteristic experiment
    Fig. 4. Experimental results of luminance masking characteristic experiment. (a) Relationship between JND and luminance; (b) relationship between JND and eccentricity angle; (c) relationship between JND and depth; (d) relationship among JND, luminance, and eccentricity angle at d=1.0; (e) relationship among JND, luminance, and depth at e=20; (f) 4D image of luminance masking characteristic experiment
    Experimental results of contrast masking characteristic experiment. (a) Relationship between JND and contrast; (b) relationship among JND, luminance, and contrast
    Fig. 5. Experimental results of contrast masking characteristic experiment. (a) Relationship between JND and contrast; (b) relationship among JND, luminance, and contrast
    Noise injection distributions of different JND models. (a) Original image; (b) proposed model; (c) Ref. [4]; (d) Ref. [3]
    Fig. 6. Noise injection distributions of different JND models. (a) Original image; (b) proposed model; (c) Ref. [4]; (d) Ref. [3]
    Enlarged view of central area of picture after pollution by different JND models. (a) Original image; (b) proposed model; (c) Ref. [4]; (d) Ref. [3]
    Fig. 7. Enlarged view of central area of picture after pollution by different JND models. (a) Original image; (b) proposed model; (c) Ref. [4]; (d) Ref. [3]
    Hardware system architecture framework based on FPGA
    Fig. 8. Hardware system architecture framework based on FPGA
    Hardware test platform
    Fig. 9. Hardware test platform
    Comparison of image compression effect and local enlarged view. (a) Original images; (b) compressed images
    Fig. 10. Comparison of image compression effect and local enlarged view. (a) Original images; (b) compressed images
    AttributeLuminance maskingContrast masking
    Background luminance0,10,20,60,100,140,180,200,220,230,240100,140,180,220
    Contrast luminance020,40,60,80
    Eccentricity /(°)1,2,3,5,10,15,20,25,30,35,40,45,501,2,3,5,10,15,20,25,30,35,40,45,50
    Depth0.2,0.4,0.6,0.8,1.00.2,0.4,0.6,0.8,1.0
    Disparity /pixel600,300,200,150,120600,300,200,150,120
    Table 1. Specific values of luminance masking characteristic and contrast masking characteristic experiments
    ImagePSNR /dBMOS
    Ref. [4]Ref. [3]Proposedmodel
    Gate32.014.203.504.80
    Woman32.334.303.504.90
    Column30.894.203.404.70
    Hall30.724.303.504.90
    Lab30.714.003.304.60
    Repair32.484.303.404.80
    Report30.244.203.304.80
    Soccer31.224.403.605.00
    Branch31.424.303.404.90
    Umbrella32.034.203.404.80
    Average31.414.243.434.82
    Table 2. Comparison of average subjective scores of different models
    JNCD valueColor scaleBit width
    (0,4]2568
    (4,6]1287
    (6,8]646
    (8,10]325
    (10,11]164
    (11,∞]83
    Table 3. Color scale of different JNCD values
    ImagePSNR /dBFPSNR /dBSSIMBitrate /%
    e is 0°--5°e is 5°--10°e is 10°--15°e is 15°--30°e>30°
    Art70.593658.932957.136052.127733.202040.48230.867561.59
    Book55.247051.649852.206749.499332.897439.80060.868657.15
    Computer65.822454.376753.742952.627233.189040.42650.878360.84
    Doll66.614254.671755.017751.989633.338740.60380.879961.53
    Drumstick62.997057.391356.841353.103133.731741.01520.898062.02
    Dwarves77.863662.784662.104453.200033.546840.97470.866963.92
    Laundry65.559153.527654.280952.782333.745441.07540.886162.26
    Moebius73.092466.370660.190553.244733.395140.65600.863761.78
    Reindeer64.309756.813058.169652.888633.369740.83160.860663.74
    Average66.899957.390956.632252.384733.379540.65180.874461.65
    Table 4. Evaluation index and bit rate of color image compression
    Yuan Ji, Zhijie Zheng, hao Wu, Yin Zhang, Wendong Chen, Tingzhou Mu. Foveated JND Model Based on Stereo Vision and Its Application in Image Compression with Hardware Implementation[J]. Acta Optica Sinica, 2021, 41(12): 1210001
    Download Citation