According to the idea of “mode counting”, we give the formulas for the effective mode density in a rectangular waveguide, and analyse the conditions at different points of the cavity and simulate the mode density curves at singular points with computer. The effective mode density describes the spontaneous emission rate of an atom, so this article give us a general idea about the features of spontaneous emission of an atom in a rectangular waveguide cavity.