Algorithm recommendation for image texture

edit

I am working on the human following robot. The robot follows him/her based on the color of clothes (HSV values) but when illumination changes happened, it is very bad. So, I am wondering if the image texture will fix this limitation. The robot needs that it will be robust and fast in real-time.

Thanks in advance.