how to get the actions performed in a video using pose estimation coordinates

asked 2018-11-14 23:48:18 -0600

prb gravatar image

updated 2018-11-15 00:24:33 -0600

I have pose estimation coordinates. I want to know the actions performed by the person in the movie. Is there any good source to get the details? I am looking for something like whether the person is sitting, standing, slouching. I have written some functions to detect the actions using pose coordinates but it is not accurate. I would appreciate any help. Thank you.

edit retag flag offensive close merge delete

Comments

what do you do, to get pose coords ? can you show, what you tried so far ?

berak gravatar imageberak ( 2018-11-15 01:22:04 -0600 )edit
1

I have pose coordinates from the yolo3 model.

def isLookingDown (data): actions = [] xy_neck = getXY(data,"neck") if not xy_neck: return actions 

xy_Leye = getXY(data,"Leye")
xy_Reye = getXY(data,"Reye")
xy_Lear = getXY(data,"Lear")
xy_Rear = getXY(data,"Rear")

xy_nose = getXY(data,"nose") 

xy_earY = None
if xy_Lear and xy_Rear:
    xy_earY = xy_Lear[1] 
if xy_Lear:
    xy_earY = xy_Lear[1]
if xy_Rear:
    xy_earY = xy_Rear[1]
prb gravatar imageprb ( 2018-11-15 01:39:45 -0600 )edit

hhmmm, and you want to find out, if a person is sitting, looking at the eye or nose position ?

hmmmm

berak gravatar imageberak ( 2018-11-15 01:41:03 -0600 )edit

also, (sorry for being so nitpicky here, but ..) "standing" is not an action, but a pose only. (actions would involve movement, and time). please be more concise, about what you have and what you want to achieve !

berak gravatar imageberak ( 2018-11-15 01:44:28 -0600 )edit

sorry for using the wrong words. I want to detect the pose like standing, sitting, bending

prb gravatar imageprb ( 2018-11-15 02:21:20 -0600 )edit

but do you actually have information for relevant body parts ? or only the head ?

you mention a yolo3 network, but what's in there, exactly ?

berak gravatar imageberak ( 2018-11-15 02:22:34 -0600 )edit

I have information for the whole body

prb gravatar imageprb ( 2018-11-15 02:28:22 -0600 )edit

I have 18 keypoints

prb gravatar imageprb ( 2018-11-15 02:30:04 -0600 )edit
add a comment