what kind of approach can be used for recognize hand signs?

Parthi
1 ●2

what approach is used in the below video to recognition for hand signs?

why is he using cvblob? how did he separate his head from hand ( it has different colors) how to actually train the signs using the SVM ? how much time will it consume ?

Edit:My questions

how to recognize signs used in a sign language ? do we need store the signs as files in a Haar-like database? is it possible?
if we skin color recognition is used ? how to identify the signs?

Comments

hi, parthi, your youtube link is no great help, most ppl won't even look at it.

chances for feedback / answers are much better, if you write down your problem.

berak (Jan 22 '14)edit

add a comment

2 answers

Sort by » oldest newest most voted

answered Jan 22 '14

Vikas
11

Instead of cvblob, you can use findContours in opencv to find blobs of same color.

Use face detection to separate head from hands.

You will have to train one vs all SVM for this multiclass problem.

Comments

true, cvblob is totally outdated / overrated nowadays

berak (Jan 22 '14)edit

I do not agree on the one vs all SVM approach, you can perfectly run a single SVM with yes or no for each sign, then look at which positive responses show the highest confidence :)

StevenPuttemans (Jan 23 '14)edit

add a comment

answered Jan 23 '14

MRDaniel
489 ●3 ●9 ●25

Skin detection to create a mask. Use a classifier for pixels in hand such as EM() to create a cleaner map (optional). Find contour of hand.

1) Compare to known shapes using matchShapes().

2) Create a database of known shapes find some features to classify. Train classifier and then use for comparison on any new shapes found with this method.

Comments

is there a link or a tutorial for step 2 . Exactly how to create that database and train the classifier

Parthi (Jan 23 '14)edit

I suggest you go read some machine learning book about classifiers :) google or search this forum for SVM, cascade classification, Viola & Jones, naive bayes, regression trees, ... all possible approaches for your problem!

StevenPuttemans (Jan 23 '14)edit

add a comment

what kind of approach can be used for recognize hand signs?

Comments

2 answers

Comments

Comments

Links

Question Tools

Stats

Related questions

what kind of approach can be used for recognize hand signs? edit savecancel

Comments

2 answers

Comments

Comments

Links

Question Tools

Stats

Related questions

what kind of approach can be used for recognize hand signs?