Human joint estimation

asked 2018-04-19 04:27:33 -0500

vps gravatar image

Hi all, I have used superpixel and SVM to classify the human body text Find the attached images. 1st image represents the output from SVM and another image contains the joint points.I want to fit upper body more accurately. I am searching good technique for elbow joint and shoulder joint. I have few questions.

1) Is it possible to apply CNN(without graphics card) only on upper body part as there are not much variations in lower body parts. or it will be great, if anyone suggest me another approach.

2) Currently, I am using the HOG for the co-ordinate system of SVM. Is there any alternative for the HOG'?

Thanksimage description

edit retag flag offensive close merge delete



using latest opencv (3.4.1) , you could try with the pretrained openpose dnn

(it works on the whole body, but will happily ignore any parts it does not see)

berak gravatar imageberak ( 2018-04-19 04:35:23 -0500 )edit

Hi Berak, Thanks for your response but I want to create my own module. As you see in the above image, I am able to find the hand tip points and head point from the output of the SVM. Just I am finding the way to find out the elbow joint and shoulder joint.

vps gravatar imagevps ( 2018-04-19 04:40:51 -0500 )edit

" I want to create my own module" -- that's great !

curious here: how do you derive the skeleton from the superpixels ?

berak gravatar imageberak ( 2018-04-19 04:49:01 -0500 )edit

As per your suggestion :) link text I have created data set of 100 images for 6 classes(hands, legs , torso and head). After training the SVM , I am almost getting the correct results for 6 body parts.

vps gravatar imagevps ( 2018-04-19 04:57:13 -0500 )edit

ahh, so each superpixel gets a prediction for a body part. for ellbows/hands you would just more classes then ? (and ofc. appropriate train data)

berak gravatar imageberak ( 2018-04-19 05:00:41 -0500 )edit

I am afraid that your solution will only work in these lab conditions having a white clear background. Have you tried if this works in cluttered backgrounds?

StevenPuttemans gravatar imageStevenPuttemans ( 2018-04-19 05:01:02 -0500 )edit

@berak..I have created the label tool for all 14 joints. currently, I have converted 14 classes to 6 class. I will try for 14 classes. Just I am courious, is there any way to operate on upper body to get the shoulder joint and elbow joint.

vps gravatar imagevps ( 2018-04-19 05:25:39 -0500 )edit

@StevenPuttemans are right, As I don't have sharp depth data. So, I have to provide the difference of background frame and current frame to the SVM. The advantage is , I don't have to provide threshold value or morphological operation data to SVM.

vps gravatar imagevps ( 2018-04-19 05:29:49 -0500 )edit