First time here? Check out the FAQ!

Ask Your Question
1

LEGO brick object detection

asked Oct 25 '15

alecx gravatar image

Hi, we have got a lot of lego sets mixed up in one box. My aim is to lay all lego bricks on the table an let opencv magic decide where a certain brick (of a set) lays.

Many lego bricks are available in 3D models ldraw.org (e.g. http://www.ldraw.org/cgi-bin/ptdetail...).

I found surface matching algorithm, which maybe can do this (http://docs.opencv.org/3.0-beta/modul...). But I do not know if this module can read *.dat 3D Models. And I do not know if I am on the right track.

Has anyone some tips for me where to start?

Preview: (hide)

Comments

afaik, *.ply is the only supported 3d file format there.

the opencv example works on point clouds, while your ldraw format looks more like a CAD thing, duplicated (sparse) points, lot of unuseable information like lines & quads. while it's probably not too difficult, to write a parser/translator for this, i doubt, if it has enough points. in the end, all the sample does is calculate a pose between a 'model' and a 'scene' pointcloud. id neither seperates different parts, nor does it detect, which kind it is.

(also, just curious, how do you plan to get the 3d pointcloud from the bricks on your table ?)

you've seen http://pointclouds.org/ ?

berak gravatar imageberak (Oct 25 '15)edit

I am curious if anyone has build something that actually can help find specific LEGO brick on a table with many different types of blocks?

Gerwinnaar gravatar imageGerwinnaar (Jan 31 '19)edit

2 answers

Sort by » oldest newest most voted
1

answered Mar 26 '17

Barnabas gravatar image

Hi! Please contact me, I am a bulider from Hungary, I am interested in. Thanks! orkike@gmail.com

Preview: (hide)
1

answered Apr 23 '16

senjuny gravatar image

I am developer in korea.

I have been study a year lego recognition and finally i did it! next week prototype machine come my home!

--> https://www.youtube.com/watch?v=BizZo...

Preview: (hide)

Comments

Hello!

It's very interesting. I have a suggestion for cooperation. Give me your contacts

Question Tools

1 follower

Stats

Asked: Oct 25 '15

Seen: 5,384 times

Last updated: Oct 25 '15