In order to make full use of the redundant information of the multi-vision system and improve the precision of the system in solving the world coordinates of the homonymous object points, a nonlinear optimization algorithm based on weighted Levenberg-Marquardt (LM) is proposed. The algorithm fully considers the influence of shooting distance on the accuracy of object point calculation. The generalized orthogonal projection method in matrix theory is used to solve the initial position of the object points in world coordinates under the constraint of multiple cameras, and the objective function is weighted with depth information to improve the confidence of the camera in closer distance. Then, the weighted LM algorithm is used to iteratively calculate the object point world coordinates to obtain the optimal solution. Experiments are carried out on four algorithms in an 8 m×6 m×3 m measurement space, experimental results show that the proposed algorithm has different degrees of improvement in accuracy and efficiency compared with the traditional algorithm and the algorithm proposed in recent years, which can offer some references for high precision positioning of the multi-vision system.