Ask Your Question

Real time pose - tutorial

asked 2015-03-04 02:23:03 -0500

Leir gravatar image

Hi. I have been trying to adapt the real time pose estimation tutorial for my own data, but i cant get the registration to work right.

image description

I have try change SolvePnP modes and parametrs, difrent mode gives difrent results but non is so close as ITERATIVE shown at the picture here. Change of parametrs make same results or none.

Is there someone who would be able to help me make it more accurate?

All i did is set my own camera matrix, load my own(undistorted) image and own box in .ply format.

Edit: here is tutorial i am working with:

  Some points almost fit, maybe is problem with 3Dreprojection, but i also didnt found something fishy there...

I am going mad, how i am trying to found the problem. Thanks for any hints. Gabriel

edit retag flag offensive close merge delete


Did you make the model registration step? You only get 8 points, which seems very low.

Mathieu Barnachon gravatar imageMathieu Barnachon ( 2015-03-04 03:25:19 -0500 )edit

The tutorial is composed from two programs. One for registration and one for detection of pre-registrated object. My problem is in registration. Detection work fine. Results ar inaccurate but is becuse of wrong registration.

The program is based on manualy inserted 8 points (vertex of box) which are paired with corner of box from .ply file. (as shown at my picture) here it waits for user to press a key. After that feature points are detected, and checked if they lay at surface of the box. If they do, they are saved for detection program. If they dont they are tossed away. Detection and next steps of registration program are working alright. Problem is that Box is not placed,as result the 8 to 8 matches, in picture as it should...

Leir gravatar imageLeir ( 2015-03-04 04:18:34 -0500 )edit

in the picture. Red dots are users imputed points(next to them are coresponding x,y,z value based on .ply) Green dots are backprojected 3D points from .ply based on computed pose...

Leir gravatar imageLeir ( 2015-03-04 04:24:21 -0500 )edit

1 answer

Sort by ยป oldest newest most voted

answered 2015-09-29 13:50:26 -0500

amb2189 gravatar image

Did you calibrate your camera using the intrinsic matrix? If not, you may need to apply it to the frame using cv::undistort() as the lens distortion of the camera causes issues with the registration process.

edit flag offensive delete link more
Login/Signup to Answer

Question Tools



Asked: 2015-03-04 02:11:54 -0500

Seen: 473 times

Last updated: Mar 04 '15