1 | initial version |
Yes, it simply is how it is. OpenCV does pretty good job optimizing all DNN operations with SIMD instructions. These optimized operations turns out to run faster than Intel's OpenCL implementation. Turning SIMD off in OpenCV makes CPU DNN backend run 30x slower than OpenCL.
For me OpenCV's CPU implementation is only ~20% (200ms) slower than Intel's Caffe fork with MKL-DNN, and this fork even produce incorrect results on HAND model. So we can safely claim that OpenCV is the fastest FOSS CPU DNN engine for this specific model.
2 | No.2 Revision |
Yes, it simply is how it is. OpenCV does pretty good job optimizing all DNN operations with SIMD instructions. These optimized operations turns out to run faster than Intel's OpenCL implementation. Turning SIMD off in OpenCV makes CPU DNN backend run 30x slower than OpenCL.
For me OpenCV's CPU implementation is only ~20% (200ms) slower than Intel's Caffe fork with MKL-DNN, and this fork even produce incorrect results on HAND model. model. So we can safely claim that OpenCV is the fastest FOSS CPU DNN engine for this specific model.