Face Features Detection - corner of eyes, eyebrows

asked 2014-03-04 18:45:59 -0500

Fisher gravatar image

updated 2018-01-20 17:16:09 -0500

Hello

I am creating basic emotion detection system for mobile phone with usage of OpenCV4Android. My system is already capable of finding mouth and doing some preprocessing. I have nice results of getting face objects from Canny:

Examplary Face1: https://dl.dropboxusercontent.com/u/108321090/FACE%20%282%29.png

Examplary Face2: https://dl.dropboxusercontent.com/u/108321090/FACE%20%281%29.png

  • Red rectangles are areas found by cascades. I have those saved as Mat objects.

  • Blue dots are points I need to find. Problem is, that I have both eyebrows and eyes on the same segment.

Additionaly there are situations in which eyebrows are directly connected to eyes (in some emotion states). It's hard to access some points. I have also normal images (of course) and tresholded ones which are also interesting for eyebrow shapes - but I lose some other objects (mouth - well that one doesn't matter cuz its already done, eyes) due to bad light, well eyebrows are always well visible. Of course I could change tresholding a bit, cuz I dont need it in finding other features. Like I said mouths is done well. Eyes/Eyebrows left.

Examplary Face3: https://dl.dropboxusercontent.com/u/108321090/Screenshot_2014-01-17-01-33-14.png

Examplary Face4: https://dl.dropboxusercontent.com/u/108321090/Screenshot_2014-01-17-01-26-33.png

Examplary Face5 (a bit problematic, eyes gone, but if I treshold them localy not globaly its fine) https://dl.dropboxusercontent.com/u/108321090/Screenshot_2014-03-05-01-30-48.png

Exampalary Face6 (eyebrows conencted to eyes) https://dl.dropboxusercontent.com/u/108321090/Screenshot_2014-03-05-01-28-21.png

I want to ask you if you could provide me with any materials/ideas connected to detection of eye, and eyebrows action units.

edit retag flag offensive close merge delete

Comments

would be much better if you could put your images here instead

berak gravatar imageberak ( 2014-03-05 00:49:09 -0500 )edit