In this paper, a novel refractive index (RI) sensor is proposed based on the fused tapered special multi-mode fiber (SMMF). Firstly, a section of SMMF is spliced between two single-mode fibers (SMFs). Then, the SMMF is processed by a fused tapering machine, and a tapered fiber structure is fabricated. Finally, a fused tapered SMMF sensor is obtained for measuring external RI. The RI sensing mechanism of tapered SMMF sensor is analyzed in detail. For different fused tapering lengths, the experimental results show that the RI sensitivity can be up to 444.517 81 nm/RIU in the RI range of 1.334 9—1.347 0. The RI sensitivity is increased with the increase of fused tapering length. Moreover, it has many advantages, including high sensitivity, compact structure, fast response and wide application range. So it can be used to measure the solution concentration in the fields of biochemistry, health care and food processing.