Based on the surface plasmon resonance effect, the gold-coated Photonic Crystal Fibers (PCFs) with introduction of three different kinds of asymmetric factors with polarization-dependent filter characteristics were proposed. The polarization-dependent filter characteristics were analyzed by the full vectorial finite element method. When the asymmetric factor is only introduced in the fiber core mode, the resonance losses of x- and y-polarized core modes are 5.58 dB/cm and 461.58 dB/cm at the communication wavelength of 1.55 μm, respectively, the resonance loss ratio in two polarization directions is 83. When the asymmetric factor is only introduced in the surface plasmon mode, the resonance losses of x- and y-polarized core modes with the coating thickness of 55 nm are 2.02 dB/cm and 412.91 dB/cm at the resonance wavelength of 1.31 μm, respectively, the resonance loss ratio in two polarization directions is up to 204. The resonance losses of x- and y-polarized core modes with the coating thickness of 19.5 nm are 5.29 dB/cm and 536.25 dB/cm at the resonance wavelength of 1.55 μm, respectively, the resonance loss ratio in two polarization directions is 101.While the asymmetric factors both in the core modes and the surface plasmon mode are all introduced, the y-polarized resonance strength is up to 802.08 dB/cm at 1.55 μm, the corresponding loss in x polarization is only 5.57 dB/cm, the resonance loss ratio in two polarization directions is up to 144. The numerical comparisons show that the asymmetric factors introduced in the surface plasmon mode or both in two modes can obtain much stronger polarization-dependent filter characteristics with high polarization loss ratio. This work is beneficial for the design and application of the polarization-dependent PCF filters and related polarizers.