The interaction between magnetic quantum emitters and the local electromagnetic environment is a promising method to manipulate the spontaneous emission. However, it is severely limited by the weak interactions between the magnetic component of light and natural materials. Herein, we demonstrate that the special type of anapole states associated with the “onefold” electric toroidal dipole moment can be excited by efficient interaction between magnetic dipole emitters and silver oligomers. Based on magnetic anapole states, the radiative power is effectively suppressed with significant coupling between the emitter and the silver nonamer, physically providing an ideal playground for the study of non-radiative transitions. These findings not only introduce magnetic anapoles to plasmonics but also open a door for the development of new high-performance magnetic-dipole-based optoelectronic devices.