Multiple markers along trajectory

asked 2018-10-11 04:48:14 -0600

klayman
21 ●1 ●2

I have multiple planar markers in the scene. At any time I see one or two, sometimes three markers. I want to track camera pose on a trajectory which pans and rolls.

Right now I can track the pose with solvepnp for one marker at a time. I need to somehow "stitch" together the tracked poses for the other markers. For example, by calculating the "relative pose" on those frames where multiple markers are visible at the same time.

Do you have suggestions? Is this already supported by openCV? How can I build a smooth stitching?

answered 2018-10-12 21:19:13 -0600

Tetragramm

7376 ●13 ●37

It's on my list for the mapping3d module I'm working on, but not done yet.

Basically, you have to take one as your primary, then when you have another in frame with it, reverse the R|t to it, and combine that with the R|t to the first marker to get the location of the second in relation to the first. Then any future calculations with only marker 2 include the R|t to the location of the second marker.

It's best to average the result over all the frames that contain both to try and get rid of bias and noise.

edit flag offensive delete link

Comments

Thanks, that's the solution I'm trying right now. Brings about a few questions on how to average transforms and what to do during the transitions as I clearly want to have the average transform at the end, but also a smooth join. Maybe a more global approach would be a better fit?

klayman ( 2018-10-13 00:52:09 -0600 )edit

You can (more or less) average rotations using quaternions. Look it up to see what the limits are.

For a transition, you can take a couple of frames and average the old, so it smooths over, or use a kalman filter to estimate the values, or several other choices.

Tetragramm ( 2018-10-13 21:46:26 -0600 )edit

add a comment

Multiple markers along trajectory

1 answer

Comments

Links

Question Tools

Stats

Related questions

Multiple markers along trajectory edit

1 answer

Comments

Links

Question Tools

Stats

Related questions

Multiple markers along trajectory