evaluate SIFT and SURF

asked 2014-07-08 00:25:23 -0600

AMH gravatar image

updated 2014-07-08 12:36:41 -0600

Hi

i need to evaluate SIFT and SURF with some criteria that mentioned on these papers "A comparison to SIFT PCA-SIFT and SURF" which can be found here : http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.301.7041

and "Evaluation of Local Detectors and Descriptors for Fast Feature Matching" which you can download it from miksik.co.uk/papers/miksik2012icpr.pdf .

i noticed that each paper defined repeatibility differently. in first paper it has been defined

image description

and in second paper

image description

which one should i use for SIFT and SURF evaluation?

and also in OpenCV i found a function named evaluateFeatureDetector. (simple code: cv::evaluateFeatureDetector(img_1c, img_2c, h12, &key_points_1, &key_points_2, repeatability, corrCounter);)

i want to know that which formula OpenCV use for finding repeatibility. also how can i find Precision-recall in OpenCV.

Edited : find evaluateGenericDescriptorMatcher method which can be used for finding recalls. don't know how to use it. also couldn't find any documentation for it.

Best Regards

edit retag flag offensive close merge delete

Comments

I cannot answer the repeatibility problem for you, but afaik there is no built in system for calculating precision recall in openCV. You have to write that specific for your application.

StevenPuttemans gravatar imageStevenPuttemans ( 2014-07-08 04:24:09 -0600 )edit

Thanks steven. i would appreciate if you guide me and show me the way of how can i write it.

AMH gravatar imageAMH ( 2014-07-08 06:25:35 -0600 )edit

Google for precision and recall and start reading. It is mainly calculating TP FP TN FN and then applying the formula. No need to guide you in that.

StevenPuttemans gravatar imageStevenPuttemans ( 2014-07-08 08:26:28 -0600 )edit
add a comment