A method is introduced for automatic tracking and deformation correction of the measurement error, caused by the parallax deformation of the target object in any position of the visual field. Based on the analysis of parallax deformation, an automatic tracking detection model is proposed to obtain the correction parameters. Through the improvement of SSDA template matching, image binarization and corrosion, centroid coordinate acquisition and contour edge search, the characteristic parameters reflecting the position and pose deviation of the target object are calculated. Thus, the object automatic tracking position and pose deviation correction amount can be obtained. In this paper, the internal thread of arbitrary position pose M4 nut is used as the experimental object. The experimental results show that the automatic tracking correction method is feasible and has good tracking consistency, and achieves better correction effect of parallax distortion.