Ask Your Question

Revision history [back]

3D object scanning, detection and recognition

Hi all,

I'm quite inexperienced with computer vision but I am trying to determine if it's possible to replicate Apple's ARKit 3d object scanning and detection work (https://developer.apple.com/documentation/arkit/scanning_and_detecting_3d_objects) with something like OpenCV.

The reason I want to see if it's possible is that I'm working on a project that I'd like to be able to recognize 3d object (e.g. a scavenger hunt using your phone) and I'd like a cross platform solution and unfortunately Google's ARCore doesn't support this yet.

I know there are a couple of cross platform solutions out there (e.g Vuforia) but a lot of them are more geared towards AR and I don't need all those features at the moment and would like to try and reduce the number of external dependencies (I'm also really interested in learning how something like that would work.

I tried using SIFT and ORB for feature detection and then trying feature matching but it produced a lot of false positives and I think they're more suited for finding flat images/surfaces inside other images.

It looks like Apple is using spatial data some how to do the matching of the objects but I'm not quite sure how that would work.

If anyone has any insight on whether something like that is possible or what areas I should be focusing on trying to achieve something like that it would be greatly appreciated.