I have two images viewing the same planar object. I can compute a homography (findHomography) or the fundamental matrix (findFundamentalMatrix). I can warp one image to the other or vice versa (using the inverse homography). This all works fine.
What I want to do is to rectify each image (not warp one to the other), based on the given information. For example like the house facade on page 6 in http://users.cecs.anu.edu.au/~hartley/Papers/CVPR99-tutorial/tut_4up.pdf
The problem is that I don't have any information about point positions on the plane - only a lot of correspondences between two images of an object known to be planar. Can this be done from just the homography between the two images?
