Since you are using fisheye camera instead of perspective one, I suggest you using cv::fisheye::stereoRectify instead of