This paper reports the development of our recent work on an all-fiberized high power linearly polarized pulsed Yb fiber laser and using the fiber laser to pump a PPMgLN-based optical parametric oscillator (OPO). The pulsed fiber laser used a fiberized acousto-optic (AO) Q-switched Yb doped fiber laser as a seed and a large mode area double cladding polarization-maintaining fiber as the gain medium. It delivered a linearly polarized pulsed laser output working at 1064.2 nm with an average power of 23.5 W at a repetition rate of 40 kHz. The polarization extinction ratio (PER) of the emission was better than 10 dB. The pulse duration was about 46 ns and the beam quality factor (M2) was about 1.3. Using this all-fiberized laser as a pump source to pump a PPMgLN-based OPO,we obtained a maximum parametric output power of 11.05 W at signal wavelength of 1602 nm with 3.01 W of idler power at 3168 nm. The total conversion efficiency and the slope efficiency was 56% and 63% respectively. At signal wavelength of 1508 nm,a maximum parametric output power of 9.87 W was obtained with 2.75 W idler power at 3614 nm.