A new method is proposed for the object surveillance system based on the enhanced fish-eye lens and the high speed digital signal processor (DSP). The improved fish-eye lens images an ellipse picture on the charge-coupled device (CCD) surface, which increases both the utilization rate of the 4:3 rectangular CCD and the imaging resolution, and remains the view angle of 183 degree. The algorithm of auto-adapted renewal background subtraction (ARBS) is also explored to extract the object from the monitoring image. The experimental result shows that the ARBS algorithm has high anti-jamming ability and high resolution, leading to excellent object detecting ability from the enhanced elliptical fish-eye image under varies environments. This system has potential applications in different security monitoring fields due to its wide monitoring space, simple structure, working stability, and reliability.