I would like to do implementation like that video https://www.youtube.com/watch?v=EGMjs... I would like to use opencv, c++, or pure mathematical stuff. I don't know how really is that app working, would someone give me hints on how to proceed technically on that problem ?
I've done an implementation of this in Unity with Vuforia and Region Capture (search github). But here would be the steps in opencv.
The key is the UV map of the model has to somewhat match the actual coloring page. You'll have to do some tricks to get the backside of the model, like doubling up with the front side of the UV map in that area. Search UV map on google images to get an idea of what they are if you don't know. Good luck.
The region capture plugin is gonna be specific to Unity and Vuforia, won't be useful at all to opencv. But this is how a lot of the commercial apps do AR coloring books. https://github.com/maximrouf/RegionCa...
I cannot comment on the augmented reality part, as this is entirely a different universe but your first aim should be
Detecting the paper (where the textures are drawn on) is quite easy, given the fact that you have a static background that does not change. In that case you can use something to this example, where he detects the paper by using contours.
After you detect the paper, you can grabcut it and get rid of the background. See this for more information.
Once you are left with only the paper, now you can get rid of the white part (paper background) and finally have only the textures. That of course, implies that your textures have no white color in them :) If they have white color as well, then this won't work.
you can find sources of an example marker less augmented reality application developed using OpenCV here
i think trying to understand OpenCV methods which used in this example will be correct starting point.
Asked: 2017-08-01 18:08:48 -0600
Seen: 3,325 times
Last updated: Aug 02 '17
Closed down for obvious reasons. (edit) only reopened because @Raki was so nice to give you some pointers. Keep in mind that we expect more from a question :).