There are much rare wood in the Pterocarpus genus. Rosewood is very similar to different tree species. Traditional wood identification methods are mainly based on wood anatomy, and the wood species are judged by observing the structural characteristics of wood slices. Although this method has a high identification accuracy, its identification process is relatively complex, and the technical difficulty is relatively high. Corresponding to wood anatomy is the identification method of wood tree species using image or spectral information. Although this kind of method has a relatively simple identification technology, it often fails to achieve a good identification effect in identifying similar wood species belonging to the same genus. This paper proposes a wood species identification method based on the fusion of spectral features and texture features of wood section. This method has a simple identification process, a high degree of automation, and a high identification accuracy. First collected by digital camera and a spectrometer wood, slice image information and spectral information, and then respectively using texture feature extraction method and spectrum feature extraction method to extract the characteristics of two kinds of the feature vector, then using the feature level fusion method based on canonical correlation analysis to these two characteristics vector fusion, finally using support vector machine (SVM) for the fusion of feature vector classification recognition. In order to verify the effectiveness of the method, three sections of 5 species of Rosewood species commonly found in the market were taken as research objects to identify these wood species. The experimental results show that the highest recognition accuracy is 80.00% when texture features are used alone, 94.40% when spectral features are used alone, and 99.20% when fused features are used. In this paper, these 5 wood species were mixed with 30 other wood species, and the number of mixed wood samples could reach 1 750. The experimental results show that the method can identify 35 wood species, including Rosewood, and the accuracy rate is 98.29%. To sum up, the texture features and spectral features of wood can effectively complement each other to further improve the recognition accuracy. At the end of this paper, the proposed method is compared with the current mainstream method, and the results show that the wood species identification method described in this paper is higher than the current mainstream method.