An object movement tracking apparatus and its method tracks an object with an unknown initial position and which object is continually moving, the apparatus for recovering a tracking process even when the tracking has failed and includes an observing device such as a video camera for observing a scene at a video frame rate.