Specialized villages and towns has significance to agricultural transformation & upgrading and rural vitalization strategy. With the data of "One Village One Product" Demonstration Villages and Towns from the Ministry of Agriculture and Rural Affairs of the People's Republic of China, this paper revealed the spatial pattern of specialized villages and towns in the whole country. It also analyzed village-level factors (i.e. topography, resource, location) and region-level factors (i.e. market and economic foundation) from the national and agricultural regionalization scale using Geodetector model. The results showed that: (1) 83.64% of specialized villages and towns mainly concentrated to the southeast of the "Hu Line", presenting central agglomeration and gradient descent from the North China Plain-the Lower Reaches of Yangtze River Plain to south and then to northwest. (2) The products of specialized villages and towns were mainly fruits and vegetables, accounting for 59.45%. They were distributed mainly in the Huang-Huai-Hai Plain, Guanzhong Plain, the Middle-lower Reaches of Yangtze River Plain, Sichuan Basin, etc., as well as circle distribution centered on the provincial capitals. (3) The distribution of specialized villages and towns was more influenced by region-level factors than by village-level factors, and the explanatory value of market and economic factors was 0.30 and 0.19, respectively. The influence of topographic factor was more obvious than that of other village-level factors, with the explanatory value being 0.15. (4) These factors presented regional differences. The main factor affecting the distribution of specialized villages and towns was market in the northern plain and hilly region; topographic and resource factors dominated the agro-pastoral ecotone and plateau region; market, economic foundation and location factors had a joint effect in the northwestern and Tibetan Plateau regions. There were no prominent factors in the southern hilly and plateau area. This study has important scientific reference value for improving agriculture's level of specialization, identifying and cultivating specialized villages & towns and rural revitalization poles, and realizing the rural vitalization strategy.