The traffic scene saliency detection can provide important information for the automatic decision or driving assist system. Based on the underlying visual characteristics, a new method for the rapid saliency detection in traffic scene is proposed, which is based on the singular value decomposition of multi-feature space (the color space and the opposition color space). First of all, in the brightness space, using the singular value decomposition to estimate the high light region and suppress the high light area to detect the brightness saliency. Secondly, in the dual opposition color space, the region of partial singular value reconstruction is retained as the color feature saliency region. Finally, the saliency region of each feature space is added together and the saliency region is the candidate region of the target detection of traffic scene. Experimental results show that the proposed method has good robustness in illumination variation and complex background scenes.