how to filter out flickering effect
Ok in addition to my previous question regarding smoothing a depth map with inpaint() I face another problem which I thought that I would address with the smoothing, but it seems that this is not the case. If you notice in the .gif image (includes around 15 frames) below I have this flickering/local movement effect to the places where there was not depth information and after inpainting information was added from the neighborhood areas but in a different way each time causing this effect. To be honest I haven't faced something similar before, therefore I would like to hear your suggestions how to filter out this flickering, all ideas are welcome :-). I was thinking about some video stabilization process, but on the other hand I do not know if this is too much, what do you think?
and below how the flickering is before inpainting:
Just to mention that initially nothing is moving in the scene, and this is due to kinect sensor's way of getting depth info.
p.s. You cannot complaint though I try to keep you busy with some good questions I think :-p
It could be the phase of your lighting infrastructure. In our labs we have TL lights and some of our camera setups pick up the flickering of the lamps. For our human eye it is unnoticable because it smooths these frequency hops out automatically.
But it could also just be noice of the actual kinect sensor like your are saying, and then smooting/averaging in time is indeed the only solution!
or create a binary map for each frame based on the no depth info and exclude these pixels from processing...