Track people coordinates in room using webcamera

asked 2015-02-16 05:54:28 -0600

A C gravatar image

Hello,

I'm investigating following task:

  1. I have a "wall" built from set of TV displays
  2. These displays show content for users

Idea is to put webcam near wall, and for each person provide pair of coordinates: x (across wall) & z (distance from wall), and if possible y (height). Using this coordinates show content (move content with person).

Also I need to track events when new person appears/disappears from region. I do not need to recognize them properly (say "this is Tom, this is Jack"), but I need to distinquish them when they are in view of camera (some kind of ID).

Is it possible to solve it with OpenCV?

edit retag flag offensive close merge delete

Comments

It will be possible to build a proof of concept with OpenCV, but it all depends where your application will be used if you will need more advanced people detectors in the real application. HOG and SVM can get you pretty far for upfront pedestrian detection and works pretty good also. You can indeed give each detection an ID coupled to a tracker to know if a new user is entering the field of view!

StevenPuttemans gravatar imageStevenPuttemans ( 2015-02-16 08:23:05 -0600 )edit
1

If your setup works indoors, what you need is user segmentation using 3d sensor (like microsoft kinect). Check this vid of an example (first one i found on youtube, I've seen algorithms working better)

https://www.youtube.com/watch?v=EGsac...

Pedro Batista gravatar imagePedro Batista ( 2015-02-16 10:17:48 -0600 )edit
1

I say indoors because these kind of sensors do not work well under direct sunlight due to heavy infrared light exposure

Pedro Batista gravatar imagePedro Batista ( 2015-02-16 10:19:32 -0600 )edit
1

If you really have to use a webcam, then I'd go for Steven's approach.

Pedro Batista gravatar imagePedro Batista ( 2015-02-16 10:20:58 -0600 )edit

Thanks Steven & Pedro

Do I need GPU/OpenCL/CUDA for HOG & SVM? Or I can start development & tests on CPU?

A C gravatar imageA C ( 2015-02-19 05:32:35 -0600 )edit

CPU is perfectly fine. I know documentation on HOG is poor on the CPU side, but all the GPU functions have their CPU counterpart. It is a big gap in the documentation that needs to be solved.

StevenPuttemans gravatar imageStevenPuttemans ( 2015-02-19 06:53:20 -0600 )edit