Femtosecond optical frequency comb has been a rich research field in laser optics. We demonstrated an all polarization-maintaining (PM) fiber, Erbium-doped frequency comb based on a nonlinear amplification loop mirror(NALM) mode-locked fiber laser. An integrated nonreciprocal phase shifter was employed in a passively mode-locked NALM-based oscillator to reduce the mode locking threshold and facilitate self-starting. Being amplified and pulse compressed, the peak power of the pulses can achieve as high as 61.3 kW. Injecting the high-power ultrashort pulses into a 55-cm-long PM high nonlinear fiber (HNLF), an octave-spanning supercontinuum from 1 030 nm to 2 200 nm was generated. By using a collinear f-2f interferometer, the carrier-envelop offset signal (f0) with 40-dB signal-to-noise ratio (SNR) and 40-kHz linewidth was detected. Moreover, with the employment of two feedback locking electronics, the f0 signal and the repetition rate of the laser (fr) were phase-locked and it showed the standard deviations of 521.71 mHz and 240 μHz, respectively.