Ask Your Question

Headtracking while user is wearing HMD

asked 2015-11-17 20:14:35 -0500

MartinTarrou gravatar image

updated 2015-11-18 21:16:14 -0500

Working on a VR project where it is necessary to get data about the user's body via a second, external, stationary webcam. Specifically, I'm looking to track chest-movements for breathing. It seems like normally an easy way to get the chest position is by extrapolating from face-tracking data. However, since the user will always be wearing an HMD (i.e. Morepheus, Oculus), this will likely interfere with things.

Any suggestions for the best method? Would just tracking the mouth be possible? I'm just using a standard webcam for the second camera, so Kinect-style skeletal tracking would be hard.

Thanks for the help in advance.]

EDIT: Doing research, it seems a lot of facetracking programs use Haar Cascades. Would it be possible/realistic to train a new Haar Cascade xml based on pictures of users wearing HMD's?

edit retag flag offensive close merge delete



Maybe you could use an AR marker sticked to the HMD to get the head position ?

Eduardo gravatar imageEduardo ( 2015-11-18 04:24:41 -0500 )edit

I'm hoping to be able to distribute it without any additional hardware beyond the Morpheus and PS4 camera, so this unfortunately wouldn't work although I've considered it.

MartinTarrou gravatar imageMartinTarrou ( 2015-11-18 19:56:16 -0500 )edit

1 answer

Sort by ยป oldest newest most voted

answered 2015-11-19 07:42:41 -0500

Why not use an upperbody part based detection model? The following paper of my collegue describes how he trained an upperbody detector using a freely available framework using the part based modeling approach. OpenCV 3 Contrib even contains a dpm module so it might be possible to do it there also!

edit flag offensive delete link more

Question Tools

1 follower


Asked: 2015-11-17 20:14:35 -0500

Seen: 195 times

Last updated: Nov 19 '15