To address the problem of difficulty in eliminating the ghost in conventional ViBe algorithm in moving object detection, an algorithm based on Euclidean distance and Tanimoto coefficient is proposed. The proposed algorithm calculates the similarity of gray histogram of foreground and neighborhood pixels to detect and eliminate the ghost. Moreover, the conventional ViBe algorithm cannot eliminate the shadow in moving object detection. To mitigate this issue, an algorithm combining YCbCr color space and Gaussian mixture shadow model is proposed to detect and eliminate the shadow. Simulation results reveal that the proposed algorithm can effectively eliminate ghosts and shadows while maintaining the efficiency of the conventional ViBe algorithm.