Ask Your Question

Robust Pinch gesture detection(index-thumb) using RGB-D sensor

asked 2015-03-22 08:35:57 -0500

Hi there! I want to implement a system which will detect hand and fingers and will be able to understand if the user did the pinch gesture using his index and thumb.Just like when you play a chess game and you want to move the piece. The camera(Realsense rgb-d) will be mounted on top of an oculus.

Any idea on what algorithms should I use? Best techniques that would help?

edit retag flag offensive close merge delete

1 answer

Sort by ยป oldest newest most voted

answered 2015-03-23 02:37:47 -0500

updated 2015-03-23 03:06:01 -0500

You should check the work of Andrew Wilson:

He has published some papers in this context and I implemented this approach for a 3d camera which is straight forward (just use the 3d data to get the mask he gets from the color segmentation).

edit flag offensive delete link more


Great thanks a lot! Any open source implementations?

marios.b gravatar imagemarios.b ( 2015-03-23 04:40:16 -0500 )edit

Only source code from my master's thesis. What are you building?

FooBar gravatar imageFooBar ( 2015-03-23 04:46:30 -0500 )edit

I want to build an AR Chess,so I want the camera to track the pinch gesture and let the augmented piece to move.Can you share your thesis pdf-code?

marios.b gravatar imagemarios.b ( 2015-03-23 04:50:19 -0500 )edit

Can you send me any links/pdf/code samples?

marios.b gravatar imagemarios.b ( 2015-03-23 07:23:04 -0500 )edit

Question Tools

1 follower


Asked: 2015-03-22 08:35:57 -0500

Seen: 542 times

Last updated: Mar 23 '15