Generating middle image using stereo image(two images)

edit savecancel

There's no single function solution. The final result depends on various conditions. I would do the folowing:

1. Compute disparity map with left and right images (with using cv::StereoSGBM). Note that disparity relates to the left image.

2. (Optional) postprocess disparity map. Fill gaps etc.

3. Recompute disparity map to the middle view (DispM). First init middle disparity with negative (invalid values). Then reproject left disparity to middle:

   d = DispL[x,y] / 2 # divide by two because disparity for middle view less then for right view

   if x-d > 0 and DispM[x-d,y] < d: DispM[x-d,y] = d

4. Possible postprocess DispM to fill gaps

5. Remap left image to the middle view with cv::remap. The tables for remapping calculated with folowing:

   mapy[x,y] = y

   mapx[x,y] = x - DispM[x,y]