To recognize and track fingertip quickly and accurately, one kind of fingertip detectingtrackingsupervising algorithm based on Kinect depth information is proposed. The detection process mainly uses the depth data to realize the fingertip recognition. The fingertip detection result is combined with Kalman filter to determine the steady state of the fingertip. The tracking process mainly takes the steady state of the fingertip in detection process as the initial condition. Fast discriminatiwe scale space tracking algorithm is adopted as the supervising process to realize the realtime tracking of the fingertip. During tracking the movement of the fingertips of each frame in real time, the supervising process supervises the realtime tracking results of the fingertips in each frame. By matching the features of the fingertips to correct the deviation of the tracking results, the accuracy of the tracking results can be improved. Hence, the robustness of the whole system can be realized. In this paper, multiple sets of experiments have been implemented on fingertip detection, recognition and tracking. Both of them can accurately detect fingertips and track the movement of fingertips in real time. Experimental results show that the proposed method has strong robustness and accuracy.