Great achievements have been made in drinking water safety provision in rural China since the 21st century. Tap water supply has reached 80% of the rural population by 2018, and at present the absolute majority of rural residents in China have access to drinking water safety. In some areas of the Yellow River Basin, however, drinking water safety provision projects lagged behind the country average and there are still some problems for rural households to access drinking water safety because of water scarcity, water contamination, waterborne diseases, and insufficient drinking water safety projects. In order to promote ecological protection and high-quality development and safeguard water safety in the Yellow River Basin, this article summarizes the current problems and provides some suggestions, including achieving dynamic water configuration, improving the construction and management of water projects, ensuring source water quality, and so on. Priority to domestic water consumption and quality should be given to ensure the drinking water safety in the rural areas.