Video-to-video temporal super-resolution technology eliminates motion blur and motion aliasing existing in a captured video sequence. However, smaller temporal reconstruction times can not effectively remove motion blur and motion aliasing, while larger times will lead to serious temporal-ringing and the wrong location of a moving object in process of temporal reconstruction. This paper explores how to select an appropriate temporal construction times in the temporal reconstruction. In general, only the number of input video sequences is considered in deciding temporal reconstruction times of video-to-video super-resolution reconstruction. In fact, temporal reconstruction times are also associated with redundant temporal information provided by each input low-temporal resolution video sequence. So, a novel method to select an appropriate temporal reconstruction times is proposed by analyzing the exposure-time and location relation of aligned low resolution input video sequences. From theoretical discussion and experimental results, the proposed method is validated to be effective and efficient.