A novel round robin differential phase shift quantum key distribution protocol based on heralded single photon source and detector decoy state is proposed, which is named as HSPS-DD-RRDPS-QKD protocol. The key generation rate of the proposed protocol is derived in detail, and the relevant numerical simulation is presented. The performance of the proposed protocol is compared with that of the round robin differential phase shift quantum key distribution based on weak coherent source and detector decoy state (named WCS-DD-RRDPS-QKD) protocol and that of the decoy state BB84 protocol, respectively. The results show that the key generation rate and the farthest transmission distance decrease with the increase of the pulse sequence length L. When the pulse sequence length L=16, the security communication distance of the HSPS-DD-RRDPS-QKD protocol increases by nearly 100 km and the key generation rate increases by one order of magnitude compared with those of the WCS-DD-RRDPS-QKD protocol. When the system error rate is 9.5%, the key generation rate of the HSPS-DD-RRDPS-QKD protocol is nearly two orders of magnitude higher than that of the decoy state BB84 protocol.