Ask Your Question
0

3D object detection and tracking

asked 2016-04-05 12:02:38 -0500

Hi,

Assuming that I have previously implemented a robust natural feature tracker for planar objects (i.e. pictures) using keypoint extraction, matching and pose estimation, how do I logically extend this to track 3D obects?

Assume that:

  • Hardware is monocular camera (smartphone, but more likely desktop with attached camera during dev.)
  • I control the lighting environment of the objects (so can limit specular, etc)
  • The object is rigid
  • The object has distinctive texture, and is against a distinctive background.
  • I have digitized 3D models of the objects if required.

Both object detection and pose estimation is required.

There appear to be many tutorials on 2D NFT tracking on the internet, but none explains how to then extend this to matching keypoints against a 3D model.

To be clear, I'm not looking for a prebuilt solution (sure, Vuforia does this.) I'm looking for source-code or algorithmic-level information.

Alex

edit retag flag offensive close merge delete

1 answer

Sort by ยป oldest newest most voted
1

answered 2016-04-05 18:53:11 -0500

Tetragramm gravatar image

Something like THIS perhaps?

edit flag offensive delete link more

Comments

Honestly, days were spent googling without hitting that. Sorry.

ferretnt gravatar imageferretnt ( 2016-04-08 12:08:11 -0500 )edit

No problem. I actually found it more or less by chance a few days ago.

Tetragramm gravatar imageTetragramm ( 2016-04-08 15:29:16 -0500 )edit
Login/Signup to Answer

Question Tools

1 follower

Stats

Asked: 2016-04-05 12:02:38 -0500

Seen: 4,615 times

Last updated: Apr 05 '16