ORB based comparision -- How to remove the junk matches in the second image

edit

So basically i cant differentiate the images , is there a way i can differentiate them using ORB. I even changed the patch and threshold but not a big change to diffrentiate images. Even the distance is almost similar and I tried using different distance measuring techniques but did not really help