The KCF tracker built into OpenCV does a very good job of tracking an object as it moves relative to the camera, but the size of the bounding box is fixed, and it does not adapt to the scale of the object changing.
Are there algorithms with similar performance that are able to adapt to the gradually changing scale of the object?