The mutual information between the detected signals and the targets of ghost imaging systems is calculated, and its relation to the reconstructions is studied by numerical simulations. Results show that for given type of targets, there is a certain set of speckle patterns maximizing the mutual information under which condition the best reconstruction can be achieved using the same number of sampling data points. Based on these results, it is proposed to design and optimize the ghost imaging system by maximizing the mutual information.