1 | initial version |
Your question is somewhat imprecise.
Nonetheless, you should look at 'Online Object Tracking' and tracking components for OpenCV.
A tracker like TLD should work : it will start tracking a random object once you initialize a bounding-box around an object, and progressively learn how it looks like from all angles.