In order to enhance the transient performance and precision of the quadrotor Unmanned Aerial Vehicle (UAV) in target tracking, a new non-singular, fixed-time sliding mode control method is proposed with Image-Based Visual Servoing (IBVS), which realizes precise fixed-time tracking of the speed and attitude commands of the quadrotor UAV.Firstly, the virtual image plane is established through perspective projection, and the dynamics model of the quadrotor UAV is deduced by using the image moment features.Based on fixed-time stability theory, a novel fixed-time sliding mode surface is presented, which supplies an accurate method for estimating convergence time.Based on the position loop and attitude loop of the UAV dynamics model, the non-singular, fixed-time sliding mode controllers are designed respectively, and the stability of the system is proved by using Lyapunov method.Numerical simulation results show that the designed controller can not only avoid the overshoot problems and reduce the steady state error, but also has strong robustness.