Adding an overlaid line on video footage following the center of the frames via video processing/pattern recognition

edit

I have multiple 1-minute videos taken outside (a building, a sea cliff, etc). The camera is not fixed, the footage is taken by a drone very slowly going up a cliff for example.

What I need to do, if even possible, is use OpenCV to automatically add a path to each of those video, a red line. The red line would follow the location pointed by the centre of the video frame.

It means that on each frame, I must find the locations pointed at on the previous/next frames via some sort of pattern recognition and somehow link them with an overlaid red line path.

Is there some sort of algorithm or tool that facilitate this process? How would you approach this problem?

Example:

From those frames:

* * * *

To those frames:

(in the real, slow, footage, the consecutive frames would be much closer to each other)

Looks like for all frames, I must try to locate all the previous/next frames and link their centres as an rightly ordered line. Surely, that must have been done before?