1 | initial version |
I am not exactly sure if I understood you correctly, but is your problem not exactly what Hartley discripes at page 12 with the block houses.
In this case, because of the wide difference in viewpoint, and the three-dimensional shape of the objects, the two images even after resampling look quite different.