The detection and track of specified moving small object is an important subject in Computer Vision. By changing the position of the feature maps for fusion in the YOLOv3, building the custom database including three classes, and completing the combination of classes by using Intersection Over Union(IOU), a detector is created, which is able to detect the specified moving small object and makes mAP@75 reach 47.41 in the test customer's data set. Combining Kalman Filter and Hungarian method, and putting the scale information of predicted bounding box and ground bounding box, the detector can track the object and reduce the ID switch caused by camera's fast movement. The whole system's speed reaches up to 0.109?7?s/frame using one NVIDIA GeForce GTX 1060 6GB GPU.