First time here? Check out the FAQ!
answered 2016-08-26 08:29:35 -0600
you have to do a proper fisheye calibration, to get the appropriate distortion coeffs.
fisheye
if you're using opencv's calibration sample, enable it here
then try again with the new distortion coeffs.