Results of objection detection using SURF+homography

asked 2014-01-19 23:51:11 -0600

Steve7
44 ●4

updated 2014-01-19 23:51:52 -0600

Hi I was trying to detect an object in a video feed. So far I have explored Template Matching but the results wasn't satisfactory as the video feed may or may not contain the object and is subjected to rotation and differing scale. Furthermore I have no time to train a cascade classifier or sorts, therefore I have stumbled upon SURF+homography approach from this link: http://docs.opencv.org/doc/tutorials/features2d/feature_homography/feature_homography.html.

The results was good but what I wanted to "get" from my program is simply an answer to "is the object currently present in the video?" (Present/Absent). So how can I get this answer using the SURF+homography approach?

edit retag flag offensive close merge delete

Comments

Could you explain why training a cascade isn't possible? I mean, a basic cascade takes only an hour or so to train of you use LBP features and it could already provide some good results.

StevenPuttemans ( 2014-01-20 04:21:39 -0600 )edit

@StevenPuttemans Oh I didn't realize it would take such short time as from what I read it requires hours, even days to train a classifier. However would you mind pointing me a direction to, perhaps a tutorial on training a LBP cascade in a short time? Thanks a lot.

Steve7 ( 2014-01-20 04:36:44 -0600 )edit

That is if your data contains sets of 5000 pos 5000 negatives and you use for example HAAR wavelets. Just start by using 500 pos and 500 negatives, don't set your required precision to high and it will work quite fast. I always use LBP for prototyping.

As for examples, just search the forum, it is filled with topics concernings this cascade classifier training. The official one is found here. Just select the correct features!

StevenPuttemans ( 2014-01-20 04:43:24 -0600 )edit

1

In fact this is one of the reasons I chose not to use a classifier, the efforts in locating "good" positive samples and negative samples. Anyway thanks for the suggestion, I'll try it if I have more time.

Steve7 ( 2014-01-20 05:02:24 -0600 )edit

Yeah it is indeed the bottleneck of the actual algorithms using these positive and negative training sets...

StevenPuttemans ( 2014-01-20 05:59:05 -0600 )edit

add a comment

5

answered 2014-01-20 00:30:08 -0600

Nghia

1000 ●5 ●16

updated 2014-01-20 03:26:25 -0600

Updated based on Moster's answer. I totally forgot about the OuputMask.

Modified this line

Mat H = findHomography( obj, scene, CV_RANSAC );

to

vector<uchar> mask
Mat H = findHomography( obj, scene, CV_RANSAC, 3, mask );
int good_matches = accumulate(mask.begin(), mask.end(), 0);

Threshold on good_matches to determine if you have an object in the scene. You might need to add #include <numeric> for the accumulate function.

edit flag offensive delete link

Comments

Hi thanks for the reply. I should've mentioned I am really new to OpenCV and I don't really understand your approach, would you mind giving me some code examples?

Steve7 ( 2014-01-20 01:45:15 -0600 )edit

Hi I tried out your code but this line Mat H = findHomography( obj, scene, CV_RANSAC, 3, mask ); gives error "OpenCV Error: Assertion failed (mtype == type0 || (CV_MAT_CN(mtype) == CV_MAT_CN(type0) && ((1 << type0) & fixedDepthMask) != 0)) in create, file C:/slave/builds/WinInstallerMegaPack/src/opencv/modules/core/src/matrix.cpp, line 1486".

So I swapped char with uchar and the error goes away, am I supposed to do this?

Steve7 ( 2014-01-20 02:52:57 -0600 )edit

uchar is correct

Nghia ( 2014-01-20 03:25:48 -0600 )edit

add a comment

5

answered 2014-01-20 02:00:34 -0600

Moster
1716 ●5 ●24

updated 2014-01-20 02:00:59 -0600

You could also use the output mask that findHomography creates when you use ransac or lmeds inside of it. Thats what opencv says about it: The best subset is then used to produce the initial estimate of the homography matrix and the mask of inliers/outliers.

So you could take this mask and count the inliers and outliers. Then you would check for example: if inliers > 50 and outliers/inliers < 0.5, then object found. Those numbers are totally random, you need to find them on your own through testing.

edit flag offensive delete link

Comments

Can you provide some code examples on how to retrieve the number of outliers/inliers from the output mask? What should be the data type of the said output mask?

Steve7 ( 2014-01-20 03:03:29 -0600 )edit

The one that Nghia posted is good, just with uchar as you mentioned.

Moster ( 2014-01-20 03:13:50 -0600 )edit

add a comment

2

answered 2014-01-20 04:50:23 -0600

JohannesZ
419 ●1 ●2 ●14

You could also try the following strategy:

Extract the features
Match the features (via FLANN, for most cases the fastest choice)
Compute a homography via RANSAC
Use the homography to warp the detected object from your scene image in the direction of your pattern image. If you do it right, both images must have the same dimension.
Use a similarity measure for your warped and pattern image. For example a normalized cross-correlation will do fine. Or a normalized correlation coefficient...

edit flag offensive delete link

add a comment

Results of objection detection using SURF+homography

Comments

3 answers

Comments

Comments

Links

Question Tools

Stats

Related questions

Results of objection detection using SURF+homography edit

Comments

3 answers

Comments

Comments

Links

Question Tools

Stats

Related questions

Results of objection detection using SURF+homography