Ask Your Question
1

FaceRecognizer in OpenCV Python FAR/FRR

asked 2012-08-30 08:15:21 -0500

Roster gravatar image

updated 2012-08-30 09:48:52 -0500

How can i conduct performance tests in OpenCV Python to check

  1. the time it takes to obtain a recognition result
  2. the false accept/false reject rate on the database test cases.

I am using the example eigenface method in OpenCV (from Phillip - https://github.com/bytefish/facerecognition_guide) and am just interested in the results. Would be greatful if someone could point me in the right direction/show examples.Perhaps there are some functions that i could make use of?

edit retag flag offensive close merge delete

1 answer

Sort by ยป oldest newest most voted
3

answered 2012-09-07 15:32:21 -0500

updated 2012-09-08 02:44:09 -0500

Validating OpenCV algorithms

introduction

First of all sorry that it took so long to reply, but there was simply no spare time left. Actually validating algorithms is a very interesting topic and it's really not that hard. In this post I'll show how to validate your algorithms (I'll take the FaceRecognizer, because you've asked for it). As always in my posts I will show it with a full source code example, because I think it's much easier to explain stuff by code.

So whenever people tell me "my algorithm performs bad", I ask them:

  • What is bad actually?
  • Did you rate this by looking at one sample?
  • What was your image data?
  • How do you split between training and test data?
  • What is your metric?
  • [...]

My hope is, that this post will clear up some confusion and show how easy it is to validate algorithms. Because what I have learned from experimenting with computer vision and machine learning algorithms is:

  • Without a proper validation it's all about chasing ghosts. You really, really need figures to talk about.

All code in this post is put under BSD License, so feel free to use it for your projects.

validating algorithms

One of the most important tasks of any computer vision project is to acquire image data. You need to get the same image data as you expect in production, so you won't have any bad experiences when going live. A very practical example: If you want to recognize faces in the wild, then it isn't useful to validate your algorithms on images taken in a very controlled scenario. Get as much data as possible, because Data is king. That for the data.

Once you have got some data and you have written your algorithm, it comes to evaluating it. There are several strategies for validating, but I think you should start with a simple Cross Validation and go on from there, for informations on Cross Validation see:

Instead of implementing it all by ourself, we'll make use of scikit-learn a great Open Source project:

It has a very good documentation and tutorials for validating algorithms:

So the plan is the following:

  • Write a function to read some image data.
  • Wrap the cv2.FaceRecognizer into a scikit-learn estimator.
  • Estimate the performance of our cv2.FaceRecognizer with a given validation and metric.
  • Profit!

Getting the image data right

First I'd like to write some words on the image data to be read, because questions on this almost always pop up. For sake of simplicity I have assumed in the example, that the images (the faces, persons you want to recognize) are given in folders. One folder per person. So imagine I have a folder (a dataset) call images, with the subfolders person1, person2 and so on:

philipp@mango:~/facerec/data/images$ tree -L 2 | head -n 20
.
|-- person1
|   |-- 1 ...
(more)
edit flag offensive delete link more

Comments

I need to cross validate the recognition results from the facerecognizers in opencv. Your answer above is very descriptive. But I am new to SVM. Couldn't find an appropriate libray to do the cross validation in C++. I found the cvSVM. I'm not sure how to train a svm using the principle components from the recognizers (eigenvectors). Do you have any reference for a C++ solution to cross validate?

praveenofpersia gravatar imagepraveenofpersia ( 2013-05-07 09:57:13 -0500 )edit
Login/Signup to Answer

Question Tools

1 follower

Stats

Asked: 2012-08-30 08:15:21 -0500

Seen: 3,799 times

Last updated: Sep 08 '12