Seed is an important means of production in the process of agricultural production. The quality evaluation, vigor and aging detection, purity and authenticity identification, classification and traceability are common problems in seed quality detection. Seed quality mainly includes the content of moisture, protein, fatty acid, starch, and so forth, which is the important indices of seed quality classification. Moreover, seed quality is related to the safety of storage. Seed vigor is the sum of seed germination and emergence rate, seedling growth potential, plant stress resistance and production potential. High vigor seeds are of obvious growth advantage and production potential. Seed aging refers to the natural decline of seed vigor, which is manifested by seed discoloration, low germination rate, poor growth potential and crop yield reduction. The purity and authenticity of seeds will affect crop yield and agricultural product quality. Seed classification and traceability is an important method to ensure the purity and identify the authenticity of seeds, by which, crop yield and product quality will be guaranteed. For seed quality analysis, it usually need to do irreversible destructive analysis on samples according to the traditional methods, which is time-consuming with complex procedures. It is obvious that traditional methods are difficult to meet the needs of modern agriculture for seed production. Therefore, it is an urgent problem to carry out the research on non-destructive and rapid detection technology of seed quality. In recent years, with the development of chemometrics and the progress of computer technology, near-infrared spectroscopy, with the advantages of fast, non-destructive and high efficiency, has been widely applied in the non-destructive and rapid analysis of agricultural products, food, agricultural inputs, and so on. In addition, combined with spectral and imaging technology, hyperspectral imaging technology is rising in recent years. Compared with the traditional spectral technology, hyperspectral imaging technology can acquire not only the spectral information of the sample but also the spatial distribution information and image characteristics of it. In this paper, based on the near-infrared spectroscopy and hyperspectral imaging technology, the literature of seed quality non-destructive detection from the aspects of seed quality evaluation, vigor and aging detection, purity and authenticity identification, classification and traceability research were reviewed. Based on the analysis of the characteristics of different detection technologies, the problems of seed quality detection are sorted out, respectively. Furthermore, the technical characteristics of non-destructive and rapid detection of seed quality are summarized and prospected.