OpenCV Q&A Forum - RSS feedhttp://answers.opencv.org/questions/OpenCV answersenCopyright <a href="http://www.opencv.org">OpenCV foundation</a>, 2012-2018.Fri, 01 Sep 2017 18:53:00 -05003D reconstruction (SFM) with multi-lens camera system (instead of pinhole camera model)http://answers.opencv.org/question/173406/3d-reconstruction-sfm-with-multi-lens-camera-system-instead-of-pinhole-camera-model/3D reconstruction (especially SFM algorithms) are often related with pinhole camera models.
The state-of-the-art of these SFM techniques is to look where the rays of 2D-3D correspondences in two different cameras intersect in object space.
This enforces that the camera model is a pinhole model (where the 2D-3D ray is just a straight line).
But often in real world there are multiple lens system used, where you can't really figure out the ray of 2D-3D correspondence.
**My question is:** *How does the SFM technique works with such multiple lens camera systems?*Fri, 01 Sep 2017 06:24:13 -0500http://answers.opencv.org/question/173406/3d-reconstruction-sfm-with-multi-lens-camera-system-instead-of-pinhole-camera-model/Answer by Tetragramm for <p>3D reconstruction (especially SFM algorithms) are often related with pinhole camera models. <br>
The state-of-the-art of these SFM techniques is to look where the rays of 2D-3D correspondences in two different cameras intersect in object space. <br>
This enforces that the camera model is a pinhole model (where the 2D-3D ray is just a straight line).</p>
<p>But often in real world there are multiple lens system used, where you can't really figure out the ray of 2D-3D correspondence.</p>
<p><strong>My question is:</strong> <em>How does the SFM technique works with such multiple lens camera systems?</em></p>
http://answers.opencv.org/question/173406/3d-reconstruction-sfm-with-multi-lens-camera-system-instead-of-pinhole-camera-model/?answer=173442#post-id-173442Most lens systems can be well approximated by a pinhole camera + distortion. Which, of course, produces straight lines that work perfectly well with SfM models.
More Detail:
While it requires an approximation, in SfM, the user mostly doesn't care about the exact physical location of the cameras. So while the notional pinhole is not exactly aligned with the physical camera, the approximation produces the same rays as the true lenses. Thus, you still get the same 2D-3D correspondences and the same resulting structure.Fri, 01 Sep 2017 18:53:00 -0500http://answers.opencv.org/question/173406/3d-reconstruction-sfm-with-multi-lens-camera-system-instead-of-pinhole-camera-model/?answer=173442#post-id-173442