Ask Your Question
0

How to make sign symbols after hand detection through haar classifier hand?

asked 2018-03-08 01:53:25 -0600

Yasir Raza gravatar image

updated 2018-03-08 02:00:02 -0600

After spending a couple of days i learnt the environment of opencv. i am going to create an android application for deaf and dumb in which i need to recognize sign symbols and convert into text. i am using haar classifier hand and successfully recognized hand further i am confused what to do next through hand classifier how to make sign symbols.. Any experts suggestion would be very helpful. Thanks in advance.image description

edit retag flag offensive close merge delete

Comments

1

umm, does your cascade detect a thumbs-up gesture ? (or any other pose of your hand ?)

(using cascades for this might not be the best idea there is)

berak gravatar imageberak ( 2018-03-08 02:25:06 -0600 )edit

No it is only detect hand

Yasir Raza gravatar imageYasir Raza ( 2018-03-08 08:14:26 -0600 )edit
2

so, you would need to train 1 cascade per gesture ? and then sort out the results ? seems a bad idea.

openpose might be a better idea

berak gravatar imageberak ( 2018-03-08 08:17:35 -0600 )edit

Thank you for your reply dear. can you please elaborate what is openpose? if i use tensorflow image classification? will it be beneficial? i need to recognize every sign and convert it to text or speech.

Yasir Raza gravatar imageYasir Raza ( 2018-03-13 13:16:30 -0600 )edit

Yasir, there'll be a couple of problems in your way:

  • there is more than one sign language in this world (e.g. european (syllable based) and american ( letter based) entirely differ, your country may have even more of it.
  • some "tokens" may not be resolved with a single image, but may include movement (like "j" and "m" in ASL)


you NEED to do some research on your own here. for openbr, see the link above.

and again, Cascade-Classifiers will not solve your problem, sad as it is.

berak gravatar imageberak ( 2018-03-13 13:23:56 -0600 )edit

Yes i am following ASL (letter based) if i capture every letter sign i classify through tensor flow will it helpful? I think i should move to tensor flow from opencv it might be helpful. thank you for your time if you know something about tensor flow please suggest me how can i resolve my problem.

Yasir Raza gravatar imageYasir Raza ( 2018-03-14 11:01:13 -0600 )edit

unfortunately, i'm not an expert in tf, or similar frameworks.

sure, you could train a multi-class classifier with it (and it's already better than the Cascade idea), but you'd still need a ton of labelled data for this.

berak gravatar imageberak ( 2018-03-14 11:06:31 -0600 )edit

1 answer

Sort by ยป oldest newest most voted
0

answered 2018-03-08 21:23:27 -0600

supra56 gravatar image
edit flag offensive delete link more

Comments

i need to do this in complex background.. it will be use in everyday life that is why i do not want to train it in simple white background.

Yasir Raza gravatar imageYasir Raza ( 2018-03-13 13:19:34 -0600 )edit

Question Tools

1 follower

Stats

Asked: 2018-03-08 01:53:25 -0600

Seen: 1,210 times

Last updated: Mar 08 '18