Tourism poverty alleviation is an effective way to get rid of poverty in poverty-stricken areas in rural China. As an important poverty alleviation model, The economic efficiency of scenic spots in driving surrounding farmers to participate in tourism directly affects the effect of poverty alleviation in poor areas. In this study, farmers in key poverty alleviation villages around 3A and above scenic spots in the Qinling-Daba Mountains were used as the research objects, and the data envelopment analysis (DEA)-Tobit model was used to analyze the economic efficiency and influencing factors of farming household participation in tourism under the model of tourism-led village poverty alleviation. The results show that the overall economic efficiency of farming household participation in tourism around the scenic spots is low, but it is higher than the agricultural production efficiency of farming households, and 98.3 percent of farming households is mainly restricted by scale efficiency; Farming households’ tourism management is in the stage of increasing returns to scale. Increasing the factor input of tourism operation is the main way to improve scale efficiency; the characteristic variables of farming households have the most significant impact on tourism economic efficiency, followed by the variables of individual characteristics, and the influence of community characteristics is not significant. Based on these results, this article makes specific suggestions for improving the tourism economic efficiency of farming households: (1) Extend the tourism industrial chain of “tourism-led village poverty alleviation”, and expand the scale of investment to achieve the optimal combination of factors; (2) Increase human capital investment and improve technical management level; (3) Farming households should be differentiated to promote specialized community participation.