Counting Pallet Object on Warehouse

asked 2017-08-01 22:30:03 -0600

NPE
11 ●1 ●2

updated 2017-08-30 23:48:48 -0600

Hi,

Recently working on project that want to count pallet on warehouse, the goals is to know how many pallet on warehouse.

Please refer my picture bellow :

image description

To simplified this problem, we create a sample area. Sample area is area that we need to know : is in the area that are pallet inside?

So, our problem was simplified to picture bellow :

image description

While Yellow indicate sampling area.

Thus, we have tried using canny algorithm or hough algorithm. No ones give me a best result. Sometimes give us wrong result like this bellow :

image description

While red indicates this is empty space,
While green indicates this area occupied by box pallet.

The problem our algorithm not working well in every scenario (time,pallet position, lighting problem, etc).

image description

As you can see (Row 6 Col 2), if the sampling area on the lighting spot then algorithm marking it's area occupied. this is totally wrong.

Lighting problem image example :

So, is there any idea or library on open CV that we can use, adopt, and integrate for our case? Is there any way to avoid the lighting problem?

Thanks in advance.

edit retag flag offensive close merge delete

Comments

could you post this image with original size

sturkmen ( 2017-08-01 23:03:14 -0600 )edit

Off course, here you are : https://goo.gl/PqvLAT

For information, this image generated by stitching process.

NPE ( 2017-08-01 23:18:58 -0600 )edit

nice project! if possible, also i want to see some of images which used to generate this image ( they have more detail ). you can do counting process before stitching

sturkmen ( 2017-08-02 06:22:14 -0600 )edit

Alternative method, maybe too naive, use a background subtraction like method with as reference an image without the pallets? The constraints are a fixed camera, the same reference background and no / few other perturbations.

Eduardo ( 2017-08-02 07:31:35 -0600 )edit

sure, here you are : https://goo.gl/jmeXac

NPE ( 2017-08-02 22:32:14 -0600 )edit

Is there any detail paper or project that can be reference for us?

NPE ( 2017-08-02 22:40:37 -0600 )edit

i want to think on how to help you. could you post at least two ( ideally four ) images used to generate big picture

sturkmen ( 2017-08-03 09:31:38 -0600 )edit

Of course, here you are : https://goo.gl/5pMh6U recently, i added 4 images. Did you know how to reduce lighting noise problem?

NPE ( 2017-08-03 20:59:24 -0600 )edit

How i can avoid lighting problem in our scenario? is there any idea?

NPE ( 2017-08-30 23:44:22 -0600 )edit

@NPE i am really wondering why you are simply ignoring the fact that I told you to move on to machine learning ... its the only way to robustly cope with changing lighting conditions...

StevenPuttemans ( 2017-08-31 03:29:01 -0600 )edit

add a comment

Comments

Can you provide more detail? some sample project or paper that nice to read.

NPE ( 2017-08-02 22:30:45 -0600 )edit

Ow well I do not know of a paper that does something similar, but about texture classification using OpenCV and LBP try this: http://www.pyimagesearch.com/2015/12/... I know it is in python, but it basically tells you what I suggested and how to apply it. Retrieving the patches yourself should not be the issue.

StevenPuttemans ( 2017-08-03 02:41:37 -0600 )edit

Obviously, problem comes where on lighting spot. Did you know how to reduce lighting effect noise on image?

NPE ( 2017-08-03 20:55:31 -0600 )edit

How about when you also add these lighting spots in your training data? You need to cover as much conditions as possible. Histogram equalization on the patches might help also!

StevenPuttemans ( 2017-08-04 06:03:26 -0600 )edit

Obviously we don't use a deep learning algorithm. So we don't have any training data set. We just using canny algorithm to find the edges. And do simple calculation. If edges in one area more than X number of threshold (eg. 15), than this area contains a pallete. Is there any idea to improve accuracy our algorithm?

NPE ( 2017-08-06 21:49:14 -0600 )edit

@NPE, that is what I am saying, you do not need to use deep learning at once, but you could simply collect 100 patches of each class. Your algorithm is manual thresholding and that is proven to almost always fail or break down.

StevenPuttemans ( 2017-08-07 09:07:07 -0600 )edit

add a comment

Counting Pallet Object on Warehouse

Comments

1 answer

Comments

Links

Question Tools

Stats

Related questions

Counting Pallet Object on Warehouse edit

Comments

1 answer

Comments

Links

Question Tools

Stats

Related questions

Counting Pallet Object on Warehouse