answered Apr 7 '16
The rvecs and tvecs you get is the pose of the object relative the camera coordinates. Try plotting this:
Rodrigues(rvec, R); R = R.t(); t = (-R * tvec);