Ask Your Question
4

Facial feature detection

asked 2012-07-13 05:12:26 -0500

AngelLeliel gravatar image AngelLeliel
43 1 1 6

updated 2012-07-13 11:18:39 -0500

Hi,

I can detect the human faces with OpenCV. I would like to detect the accurate locations of facial feature points like eyes and corners of the mouth. Is that possible with OpenCV or other free/open source libraries?

delete close flag offensive retag edit

6 Answers

Sort by ยป oldest newest most voted
7

answered 2012-07-13 10:48:41 -0500

Kirill Kornyakov gravatar image Kirill Kornyakov flag of Russian Federation
2271 9 20 48

updated 2012-07-13 10:49:32 -0500

Haar cascades can be found here: http://code.opencv.org/projects/opencv/repository/show/trunk/opencv/data/haarcascades. Also check this tutorial: http://docs.opencv.org/doc/tutorials/objdetect/cascadeclassifier/cascadeclassifier.html#cascade-classifier. But if you're going to train your own, you should prefer LBP features, check this guide.

But you should understand that detector returns you only a rectangle, not exact positions of eye/mouth corners. For this you should use something like ASM or AAM. Here is a couple of implementations:

  1. http://code.google.com/p/asmlibrary/
  2. http://code.google.com/p/asmlib-opencv/
link delete flag offensive edit

Comments

Thanks, I will survey the ASM/AAM solution.

AngelLeliel ( 2012-07-13 11:17:27 -0500 )edit

i've the same problem but i'm using JAVA is there a possibility that i use AAM with JAVA ???thx

RossMine ( 2013-05-29 13:21:23 -0500 )edit
8

answered 2012-10-03 01:41:21 -0500

lightalchemist gravatar image lightalchemist
131 2 4

The Flandmark Facial point detector (with code) can be found here: http://cmp.felk.cvut.cz/~uricamic/flandmark/

It will return you the four corner points of the eyes, corner of mouth, center of nose, and center of face. It does however require you to give it a bounding box of the face so you will probably have to use the Viola Jones face detector in OpenCV (or any other method) to locate the face first, which you are already doing.

I've compiled the code on Ubuntu and it works very well, provided the bounding box you give it is "just right". If it is too tightly cropped it might miss the feature points near the border of the image. For such cases, you can try to extend the border and specify the bounding box as the "inner" image (excluding border) and sometimes it works. On the other hand when the bounding box is too large it might converge to some nonsense points. But on the whole it works really well, even on rotated faces, faces with glasses, and those that are close to side profile.

link delete flag offensive edit
2

answered 2013-01-08 10:27:35 -0500

albertofernandez gravatar image albertofernandez
1634 2 16 27
http://www.fundacionctic....

This paper shows how to detect the eyes.

Bolme, D.S. "Average of Synthetic Exact Filters", IEEE Conference on Computer Vision and Pattern Recognition, 2009. CVPR 2009. PDF and C source code

link delete flag offensive edit
1

answered 2012-07-13 06:28:07 -0500

jayrambhia gravatar image jayrambhia flag of India
236 1 4 15
http://jayrambhia.wordpre...

You can use HaarCascades for eyes, nose, mouth, ears, face, etc detection. And by that you can get the position of the facial features.

link delete flag offensive edit

Comments

how can i do this and having the corner points

RossMine ( 2013-05-29 13:19:21 -0500 )edit
0

answered 2013-08-28 02:47:05 -0500

Sameer gravatar image Sameer
1

Hi, i have try demo for facial feature using http://www.milbo.users.sonic.net/stasm/ It good for points detection but now i did not know how to manipulate the points.

link delete flag offensive edit
0

answered 2013-08-21 04:53:47 -0500

abhi21 gravatar image abhi21
1

In my opinion you should try Shi and Tomasi corner-detector to detect mouth corners. I think OpenCV has the API for it. HaarCascades won't give you mouth corner points, it would only return you a rectangular region that has mouth. OR as pointed out by Kirill use can also use AAM/ASM to detect face features.

link delete flag offensive edit

Login/Signup to Answer

Question tools

Follow
2 followers

subscribe to rss feed

Stats

Asked: 2012-07-13 05:12:26 -0500

Seen: 6,976 times

Last updated: Aug 28 '13