Saccharides are typical chiral substances, and their chiral spectra in the terahertz band have not been fully studied. The refractive index and absorption spectra of lactose, galactose, and glucose at low temperature and normal temperature are studied respectively, and the chiral spectra of these samples are obtained through terahertz time-domain polarization spectroscopy. The experimental results show that the absorption of saccharides will decrease as the temperature decreases, which is conducive to obtain the chiral characteristics of the sample at low temperature. At 80 K, glucose exhibits strong Circular Dichroism(CD) in 1.3-1.5 THz; the CD peak value reaches 44.97% at 1.39 THz. All three saccharides have specific chiral characteristic peaks, and the CD values all exceed 20% in 1.6-1.8 THz. The research results can provide important reference for further understanding of the chiral spectra of chiral biochemical samples in terahertz band and their internal mechanisms.