We demonstrate a stable, low threshold, passive Q-switched mode-locked Tm, Ho∶LiLuF4 solid-state laser with the graphene oxide (GO) prepared by vertical growth method as a saturable absorber and the special designed low threshold resonant cavity. The output power of the laser is as low as 73 mW, the stable mode-locked threshold power is 663 mW, and the corresponding power density of the GO saturable absorber is 76.4 μJ·cm-2. Typical Q-switched pulse envelope has a repetition frequency of 104.2 kHz and a pulse width of 30 μs. The repetition frequency of mode-locked pulse sequence is 178.6 MHz, and the modulation depth is close to 100%.