A visual attention mechanism (VAM) can quickly highlight region-of-interest targets; therefore, it is reasonable to introduce visual attention into hyperspectral image (HSI) anomaly detection tasks. By adjusting a bottom-up VAM model in three aspects, namely sampling method, band selection, and local spectral features, a more applicable VAM model for calculating the saliency of hyperspectral images was constructed. The resulting VAM is called bottom-up hyperspectral saliency map (BUHS). To solve the problem of background parameter estimation in the RX(Reed-Xiaoli) algorithm, which is susceptible to interference, BUHS was used as a Gaussian weighting parameter for the original image, in which new parameters of the RX anomaly method were calculated. Compared to the traditional RX, the background parameters are more accurate. The experimental results on five HSI datasets show that the proposed method can effectively identify potential anomaly targets and improve the RX algorithm with a higher detection accuracy and lower false alarm rate.