A scheme is proposed for the realization of quantum SWAP gate in cavity QED. Weconsider two three-level atoms simultaneously interact with single-mode cavity in the case of large detuning. Moreover,two classical fields are used to perform the rotations on atoms. The operation and implement course are simple and handy. In addition,during the whole course,the cavity is only virtually excited,thus the decoherence time is greatly prolonged and the demand on the quality factor of the cavity is greatly reduced. Within the present cavity QED techniques,the scheme is realizable.