Reduce reprojection error from computed Homography

asked 2016-10-11 14:22:37 -0600

x10s gravatar image

updated 2016-10-12 12:24:01 -0600

Hello,

I am computing the Homography between two images and using that to estimate the change in camera pose.

  1. The images are being taken by a camera rotating about the z-axis(or a purely rotating camera)
  2. I use a feature detection method e.g. SIFT/SURF/ORB and use the Flann matcher to get the putative matches. On visual inspection the matches look correct.
  3. The outlier detection method being used is RANSAC with a low reprojection threshold of 1.0
  4. When the yaw between images taken is larger than 15 degrees or so, the matches look right on visual inspection but the average reprojection error((I calculate this myself using x' - H*x)) goes high. And unfortunately its not just a few outliers, the reprojection error is high with all the matches.
  5. The matches are the close to the image boundaries i.e. in the first image the interest points are close to the right boundary and in the second image its close to the left boundary. Not sure if this changes anything though.

Are there any guidelines to improve the re-projection error(and so the Homography)? Or does anyone know of any literature that could help?

Thanks!

edit retag flag offensive close merge delete

Comments

I think you need to be a bit clearer about the problem you're having. You say "in certain scenarios". Do you mean for some image pairs, and not for others? Do you just have a few bad point matches amongst mostly good ones, in all your images? Are you talking about bad average error? You're more likely to get help if you can clarify some of this stuff. This problem is a classic case for using RANSAC, if you aren't already. Although if you're using OpenCV, it might be happening under the hood. If you just a have a few bad matches (i.e. outliers), that should help. Then consider using the final model to compute reprojection errors, culling the outliers, and refitting to all the inlier points. Otherwise, you need to be more specific :)

AJW gravatar imageAJW ( 2016-10-12 02:51:55 -0600 )edit

Thank you for your input. I shall edit my question to be more specific :)

x10s gravatar imagex10s ( 2016-10-12 10:23:43 -0600 )edit

Have you calibrated the camera and undistorted the images? That could be the cause.

Tetragramm gravatar imageTetragramm ( 2016-10-12 17:33:10 -0600 )edit

I realized that my purely rotating camera has some translation which maybe the cause for the Homography to be bad overall. My scene does not have a planar surface as of now. I shall be testing my hypothesis today. This link states the two conditions when a Homography is valid but doesn't explain it very well :(

x10s gravatar imagex10s ( 2016-10-13 09:27:19 -0600 )edit
1

This one is a bit clearer: HERE

Tetragramm gravatar imageTetragramm ( 2016-10-13 11:01:25 -0600 )edit

That helped, thanks! They had a very good depiction of the two valid conditions and how they work.

x10s gravatar imagex10s ( 2016-10-18 09:22:55 -0600 )edit
add a comment