1 | initial version |
You should probably use PCL or something like that to do this. OpenCV isn't really meant for it.
You can do project points, round each result to the nearest pixel, and get the range to each. For pixels with multiple points, keep the closest. Color based on the distance, like berak suggested. Then do inpainting to fill in any holes.
As I said, not really meant for it.