I have 2 cameras , an RGB and IR, side by side. The photos are taken at the same time , but each has its lens distortion and different size frame. I can correct the distortions, but how do I adjust or rectify the IR band on the RGB . I need to merge the bands.
Sorry for my English!!
You need to rectify your images (in a stereo rectify way) in order that each pixel of the IR image match the RGB image. Have a look at the stereoCalibrate function to see how to do that, and also at the sample cpp/stereo_calib.cpp for a working example.
The problem with this is that keypoints for calibration in the RGB image will not necessarily be the same in the IR image... which could be a challenge. How we solved it in our lab, use a heated metal circle to calibrate the image in all positions. The circle center can be seen in the IR image and easily detected in the RGB image.
That's interesting! How do you heat the ring? Once for the whole calibration or all the time in a continuous process?
We actually performed 2 steps
That's cool! Do you have some images to share? Also, I'm wondering if you manage to hook the OpenCV calibration process with your disc or if you really on another tool? Because I'm wondering if the calibrateCamera function works with a single point per frame. Anyway, thanks for sharing!
Well it is not my work and the guy who did it cannot share the process since the system has been commercialised. And he did it in Matlab, but just saying that it is possible :P
Asked: 2016-04-11 14:12:30 -0600
Seen: 262 times
Last updated: Apr 12 '16
