How do we matching the features on image with live camera and draw the rectangle?

asked 2020-05-09 05:26:04 -0500

Vasu gravatar image

updated 2020-05-16 07:26:42 -0500

Hi folks, Here, I want to recognize the object with use of SIFT algorithm in OpenCV python and find the missing part on object with live camera (Represent Draw rectangle on missing part).

For example: I am having target image to be recognize with camera in that I removed one part of portion. Now I can able to recognize the target image but i need to be mention that removed part with rectangle compare with target image. I have attached the screenshots.C:\fakepath\IMG_20200508_161924.jpg

C:\fakepath\ultimo_sopravvissuto.jpg![image description]image description

edit retag flag offensive close merge delete



Ciao, bel libro! (for english reader is just "hello, nice book!)

Can you provide an example of the result that you expect in terms of rectangle? You expect in this case 2 rectangles (one for the missing "L'ultimo" and one for the missing yellow part with the author) or one (a top rectangle)?

HYPEREGO gravatar imageHYPEREGO ( 2020-05-09 09:58:00 -0500 )edit

Thank you for the response. Actually, i need to draw rectangle for both parts and i want to mention top part is missing from actual image. I have attached expected output here. And one more question - Can we able to build application for android platform from python.

Vasu gravatar imageVasu ( 2020-05-16 07:26:49 -0500 )edit

Ok, I got it but there are some tricky part. You need to apply an homography to make the two image as have been acquired from the same point of view. So you need the classical pipeline involving feature detector, matcher and homography estimation. Here you should understand if the images that you got from the camera can be very hard to detect: a roubst affine feature detector should be used. Then, after that, you can basically do a subtraction between the images to find the parts that are missing. You can use some threshold to leave out the noise (there will be a lot of noise for sure). After that you should be able to identify the area that is missing, and the problem is just to draw the rectangle, is similiar to find bounding box.

Regarding the last question I've no experience.

HYPEREGO gravatar imageHYPEREGO ( 2020-05-16 08:08:30 -0500 )edit