For the features of the space-based starry images, this paper analyzed the reason of algorithm timeout and high false alarm when detecting the orbits of moving objects under the starry background. The heavy computing of stellar identification is avoided by introducing and improving the Moving Target Indicator (MTI) filter to process the sequence starry-images. At the same time, we changed the algorithm structure from DBT to TBD and largely improved the algorithm speed under high precision. The simulation shows that the improved algorithm has the character of low time consumption, and we can use it to control the algorithm timeout and high false alarm, which meets the project needs for space-based starry-images moving objects orbits detecting.