Detect moving objects on an image with an moving camera

edit

Hello,

I am currently working on a project using ROS (Robot Operating System) and OpenCV methods to implement a navigation algorithm to help blind people avoid obstacles. I am using a Kinect v2 to generate a 3d Map based on the SLAM algorithm. I therefor compute the visual odometry and map the color and depth data. Then i detect static obstacles on this map and plan paths around them.

Now i want to expand the project to detect dynamic obstacles to predict and avoid possible collisions. I want to detect this object on the image frame of the kinect. Is there a way to compensate the camera movement with the known visual odometry data? My problem is, that i can detect movement on the images but I am not able to segment objects from the image. Then I want to reconstruct the 3D object positions and transform them to the map coordinate frame.

It would be great, if anyone has any ideas on my thoughts or can help me out.

Thanks in advance and greetings,

Sven