How to match given video stream with set of images

edit

Thanks #StevenPuttemans for your replay. I am using VJ's face detector to extract the face features. I have extracted each frame from the video and I'm thinking to match those frames with set of yawning images i have in my database.

Or Can I try with pattern matching to match each frame with database I have.

Why match images. Create an average feature vector of yawning images. Than apply the same transformation on the new face and do a neighbor matching. The difficult part is creating a meaningfull descriptor. Other way could be to create binary SVM classifiers for each expression. The matching will be way to slow as I see it.

okay. Do you know any good site to know about SVM classifier creation, I searched almost the entire internet. Please do mention some of the sites useful for beginners.

Hmm you just hit a pittfall of OpenCV. The CvSVM module is highly outdated and badly documented. People always suggest using LibSVM to apply the SVM modeling. Check this code block I made for trying to create an SVM model using the OpenCV interface. However it requires a mapping from the HOG descriptor interface to a format that can be used by the CvSVM interface. It produces a model but I have not had the time to perform exhaustive testing. Ignore the fact that I was training a cookie detector ;) This was just a dummy case.

Thanks man :)