Extract elements of GUI-Screenshot for visual test - MSER

asked 2014-07-24 05:22:15 -0600

MRae gravatar image

updated 2017-08-22 11:24:27 -0600

sturkmen gravatar image

Hello,

for a visual regression test I need to compare screenshots of webpages (different release-versions). I started with pixel by pixel compare. Actually I split the screenshot in different parts (maybe 10x10 rectangles) and compare the histograms of correspondending parts.

Now I try to find an approach to find regions of interest (with coordinates and/or bounding box) automatically (tried edge detection and so on) like this:

image description

Example of image segmentation

I found different articles on the web dealing with blob-detection. One method for that is Maximally stable extremal regions (MSER) which is provided in OpenCV.

Feature Detection and Description

link text

Now my questions:

  • Is MSER applicable for the given problem
  • Are there simpler approaches then MSER
  • Can someone give me some introductions to use MSER from OpenCV in Java (unfortunately I haven´t experience with OpenCV or JavaCV. Anyway I installed it on my machine.)

Maybe someone has other improvements or tips for my problem.

Best wishes

edit retag flag offensive close merge delete

Comments

1

Do you know what you want to compare or you need to extract every semantic regions?

Mathieu Barnachon gravatar imageMathieu Barnachon ( 2014-07-24 05:27:56 -0600 )edit

Actually I want to compare all elements from the screenshot. It´s not possible to mark the regions manually because they are to different.

MRae gravatar imageMRae ( 2014-07-25 10:28:09 -0600 )edit
add a comment