Rectify Scaled Images

edit

Hello, I am trying to rectify a set of scaled stereo vision images using the cvStereoRectify, cvInitUndistortRectifyMap and cvRemap functions. Rectification works perfect on images that are not scaled but gets worse as the scale factor increases. I scale my left and right camera fx,fy,cx and cy values by the same scale factor. Do i need to do anything else? I don't scale my rotation or Translation matrices correct?

Attached are the full scale rectified images and .5 scaled rectified images. Any Ideas would help! Thanks!

.5 Scale - scaleoverlay.png

Full - fulloverlay.png