A colored object encoding scheme in a ghost imaging (GI) system using orbital angular momentum is investigated. A colored object is decomposed into three components and then each component is obtained in the idler arm using a multiple grayscale encoding scheme. Afterward, we synthesize the three reconstructed components into a colored image. The scheme is conducted and then presented through numerical simulations and experiments. The simulation result shows that the average peak signal-to-noise ratio (PSNR) is at 21.636 for the reconstructed color of the "Lena" image with 255 gray scales. The experiment also shows that the PSNR is 8.082 for the reconstructed color of the "NUPT" characters. The successful imaging of colored objects extends the further use of the GI technique.