• Optics and Precision Engineering
  • Vol. 31, Issue 16, 2406 (2023)
Baoping LI, Hengyi QI*, Manli WANG, and Po WEI
Author Affiliations
  • College of Physics and Electronic Information, Henan Polytechnic University, Jiaozuo454000, China
  • show less
    DOI: 10.37188/OPE.20233116.2406 Cite this Article
    Baoping LI, Hengyi QI, Manli WANG, Po WEI. Equipment fault dataset amplification method combine 3D model with improved CycleGAN[J]. Optics and Precision Engineering, 2023, 31(16): 2406 Copy Citation Text show less

    Abstract

    The performance of deep-learning-based equipment fault detection systems relies heavily on the size and class diversity of the sample set. Because it is difficult to collect all types of fault sample comprehensively in industrial production, there is a demand for sample set augmentation. A fault dataset amplification method combining 3D modeling with an improved cycle generative adversarial network (CycleGAN) is proposed. First, various equipment malfunction images generated by 3D modeling software are applied to the CycleGAN network training to guide it in generating pseudo-real images to address the problem of insufficient samples and an uneven distribution. Second, a U-ResNet generator is used in the CycleGAN network to solve the problem of edge blurring and gradient vanishing during network training. The method was applied to the task of belt conveyor deviation detection. The experimental results show that the contour structure of the method converges quickly in the training process and has good timeliness in comparison with other amplification methods. The accuracy rate of the method is 98.1% when applying to the target detection network, which is 4.5% higher than that of the original real dataset. It meets the basic requirements of a balanced distribution of amplified datasets and high image quality.
    yR=uf2(d(f1(x)+x))+ud(f1(x)+x)(1)

    View in Article

    yU=uf2(d(f1(x)))+f1(x)(2)

    View in Article

    yOurs=uf2(d(f1(x)+x))+ud(f1(x)+x)+f1(x)+x.(3)

    View in Article

    LGAN(G,DY,X,Y)=EyPdata(y)logDY(y)+ExPdata(x)1-logDY(G(x)),(4)

    View in Article

    minGmaxDYLGAN(G,DY,X,Y)(5)

    View in Article

    Lcyc(G,F)=ExPdata(x)F(G(x))-x1(6)

    View in Article

    Lidentity(G,F)=EyPdata(y)G(y)-y1(7)

    View in Article

    L(G,F,DX,DY)=LGAN(G,DY,X,Y)+αLcyc(G,F)+βLidentity(G,F).(8)

    View in Article

    G*,F*=argminG,FmaxDXDYL(G,F,DX,DY)(9)

    View in Article

    IS(G)=expEx~pgDKLP(y|X)||P(y)(10)

    View in Article

    DKLP(y|X)||P(y)=iP(yi|X)logP(yi|X)P(yi)(11)

    View in Article

    FID=μx-μy2+Tr(x+y)-2(xy)1/2,(12)

    View in Article

    l(x,y)=(2μxμy+c1)(μx2+μy2+c1)(13)

    View in Article

    c(x,y)=(2σxy+c2)(σx2+σy2+c2)(14)

    View in Article

    s(x,y)=σxy+c3σxσy+c3(15)

    View in Article

    MS_SSIM=l(x,y)αM·j=1Mc(x,y)βjs(x,y)γj,(16)

    View in Article

    PSNR=10·log10MAXI21mni=0m-1j=0n-1x(i,j)-y(i,y)2,(17)

    View in Article

    Baoping LI, Hengyi QI, Manli WANG, Po WEI. Equipment fault dataset amplification method combine 3D model with improved CycleGAN[J]. Optics and Precision Engineering, 2023, 31(16): 2406
    Download Citation