1 | initial version |
If you need more explanation about the theory, have a look at the first section of the calibration tutorial here. It will explain why fx and fy are needed.
But basically, as @Ziyou said, it's because image are not square (I should say not spherical) but a rectangle. Therefore, you need an estimation of the focal on Height and the focal Width.