This forum is disabled, please visit https://forum.opencv.org
 | 1 | initial version |
For some reasons I didn't see your question earlier.
I double checked description here.
So pairsDevTrain.txt and pairsDevTest.txt should be used for parameters selection and as we don't choose parameters they shouldn't be used. And you are right: for reporting result each split from pairs.txt should be tested against the 9 other splits (train).
p.s. whole my idea with benchmarks was to implement some solution for each Challenge's building block using only OpenCV. I had time on implementation 3 benchmarks and I hoped that OpenCV community may implement some others :)
