Since the specific products, the current algorithms are complex and almost realized with pure software in computer, a new video vehicle tracking embedded system is proposed. Programmable chip is used to make the video detection independent of computer platform. The Nios II soft core-processing unit (CPU) and peripherals intellectual property (IP) cores are the hardware platform. They are combined with the A/D and D/A video interface, and the μC/OC as the real-time operating system, which is the software of the embedded video detection. Finally, an experimental project is designed to verify the validity of the design.