I finally found a way to use SWIG to build C++ wrapper for Go. In case someone is interested in it, please refer to the gocv package under https://github.com/lazywei/go-opencv. Thanks.