Based on the principle of light and matter interaction and the basic optical characteristics of agricultural products, a model for LED tea color sorter light source is studied to sort Tieguanyin tea and impurities, and the light source spectrum is studied and designed. By testing the spectral reflectance of the tea and impurities, the wavelength at which the tea and impurities have the maximum reflectivity difference is chosen as the peak wavelength of LED light sources in the range of visible light. The combination of multicolor LEDs is used to match the spectra of tea color sorter light source, and the numerical ratio of combinational LED light sources is decided by the proportion of relative reflectivity difference between tea and impurities at each corresponding peak wavelength. The results show that the tea color sorter light source can improve the processing efficiency of tea sortering and enlarge the contrast between tea and impurities with higher luminous efficiency characteristics and long lifetime, and it is beneficial to the sorter process of tea. Therefore, the study lays foundation for subsequent development of new LED tea color sorter light sources used for other tea color sorting and spectral design for special LED-based light sources.