To address the problem of negative vibration in the surface modification of cemented carbide by textured coating composite process, an analytical method based on the friction vibration behavior of textured coating surface is proposed to explore the modification effect of textured coating composite process. Therefore, the friction and wear test platform of micro textured AlSiTiN coated cemented carbide-titanium alloy grinding disc is established. Based on the short-time Fourier transform (STFT) and the gray algorithm, the regular mapping of friction vibration change and the stable period of vibration behavior are obtained. Then, the modification effect of microtexture AlSiTiN coating process parameters on cemented carbide is analyzed. Experimental results show that the micro texture and AlSiTiN coating have the most positive effect on the wear resistance of cemented carbide surface. During the stable period of 5~ 25 min from self-contact friction, the influence mechanism of micro-texture and AlSiTiN coating parameters on the surface modification of cemented carbide is obtained. The process parameters of the composite modification method to suppress the negative friction vibration of the cemented carbide surface provide a new idea for improving the surface performance of cemented carbide.