In order to study the adaptability of using different kinds of spectra to analyze the quality of Ginkgo biloba leaves quickly, 58 samples of Ginkgo biloba leaves were collected. The contents of the active components of flavonoid glycosides and terpene lactones were determined as dependent variables (y) by high performance liquid chromatography (HPLC), and the independent variables (x) included ultraviolet (UV), visible and near infrared spectra signals. Quantitative analysis models of flavonoids and lactones in Ginkgo biloba leaves were established by partial least square regression (PLSR) and an innovative method of keeping a same relationship between X and Y space (KNN-KSR method for short). The method predicted dependent variables based on the object’s independent variables and the relationship between the object and its K nearest neighbors in independent variable space. Correlation coefficient R between the measured values and the model values, root mean square error of prediction (RMSEP), and the average relative error of the prediction (MRE) were applied to evaluate the models. All evaluated indicators of PLSR models based on three kinds of spectral information were inferior to those of KNN-KSR method, and the results of PLSR models based on UV spectra were very poor; However, when KNN-KSR method was used to predict the flavonoids and lactones in Ginkgo biloba leaves based on three kinds of spectral information, R was higher than 0.8; RMSEP of flavonoids and lactones were less than 0.05 and 0.025, respectively; MRE of flavonoids and lactones content were below 8%. UV, NIR and multi-source composite spectral information combing KNN-KSR method could achieve rapid analysis of four kinds of flavonoid glycosides and three kinds of terpene lactones in Ginkgo biloba leaves. The present work broke through the limitation of existing work that only analyzed total flavonoids in Ginkgo biloba leaves by PLSR method based on NIR; The proposed new ideas to rapidly determine flavonoids and lactones in Ginkgo biloba leaves using UV and multi-spectral information by KNN-KSR method provided more available methods and choices for the quality analysis of ginkgo biloba leaves. The multi-source composite spectrometer, which can provide spectral information of various types, is portable, of small volume and low cost. It is very suitable for the rapid detection of on-the-spot Ginkgo biloba leaves acquisition and follow-up product quality analysis and monitoring.