Ask Your Question

Revision history [back]

Any idea on detecting and tracking hand touching the body with OpenCV?

Problems:

  1. Detect the hand over the human flesh (Note: color is very similar).
  2. Localize the position of the touch
  3. Track the movement as the hand moves along the body.

Here's a sample input image frame:

image description

I have tried a few possible solutions:

  1. Contour detection (It doesn't work! Or maybe I miss a few additional tricks?)

image description

  1. Color Segmentation (It doesn't work! Similarity of color between the hand and skin is already a big problem)

  2. Keypoints (e.g. SIFT, SURF, ORB, AKAZE)? (It might work! However, the hand movement itself is non-rigid thus, the comparison might end up inconsistent.

  3. Object Detection (e.g. Haar or LBP) (It might work! But then again, the non-rigidity of hand movement might cause a serious problem.)

Does anyone (else) have experienced similar problems that involve the above issues? Thanks in advance.

Any idea ideas on detecting and tracking hand touching the body with OpenCV?

Problems:

  1. Detect the hand over the human flesh (Note: color is very similar).
  2. Localize the position of the touch
  3. Track the movement as the hand moves along the body.

Here's a sample input image frame:

image description

I have tried a few possible solutions:

  1. Contour detection (It doesn't work! Or maybe I miss a few additional tricks?)

image description

  1. Color Segmentation (It doesn't work! Similarity of color between the hand and skin is already a big problem)

  2. Keypoints (e.g. SIFT, SURF, ORB, AKAZE)? (It might work! However, the hand movement itself is non-rigid thus, the comparison might end up inconsistent.

  3. Object Detection (e.g. Haar or LBP) (It might work! But then again, the non-rigidity of hand movement might cause a serious problem.)

Does anyone (else) have experienced similar problems that involve the above issues? Thanks in advance.

Any ideas on detecting and tracking hand touching the body with OpenCV?

Problems:

  1. Detect the hand over the human flesh body (Note: color is very similar).
  2. Localize the position of the touch
  3. Track the movement as the hand moves along the body.

Here's a sample input image frame:

image description

I have tried a few possible solutions:

  1. Contour detection (It doesn't work! Or maybe I miss a few additional tricks?)

image description

  1. Color Segmentation (It doesn't work! Similarity of color between the hand and skin is already a big problem)

  2. Keypoints (e.g. SIFT, SURF, ORB, AKAZE)? (It might work! However, the hand movement itself is non-rigid thus, the comparison might end up inconsistent.

  3. Object Detection (e.g. Haar or LBP) (It might work! But then again, the non-rigidity of hand movement might cause a serious problem.)

Does anyone (else) have experienced similar problems that involve the above issues? Thanks in advance.

Any ideas on detecting and tracking hand touching the body with OpenCV?

Problems:

  1. Detect the hand over the human body (Note: color is very similar).
  2. Localize the position of the touch
  3. Track the movement as the hand moves along the body.

Here's a sample input image frame:

image description

I have tried a few possible solutions:

image description

  1. Contour detection (It doesn't work! Or maybe I miss a few additional tricks?)

image description

  1. Color Segmentation (It doesn't work! Similarity of color between the hand and skin is already a big problem)

  2. Keypoints (e.g. SIFT, SURF, ORB, AKAZE)? (It might work! However, the hand movement itself is non-rigid thus, the comparison might end up inconsistent.

  3. Object Detection (e.g. Haar or LBP) (It might work! But then again, the non-rigidity of hand movement might cause a serious problem.)

Does anyone (else) have experienced similar problems that involve the above issues? Thanks in advance.

Any ideas on detecting and tracking hand touching the body with OpenCV?

Problems:

  1. Detect the hand over the human body (Note: color is very similar).
  2. Localize the position of the touch
  3. Track the movement as the hand moves along the body.

Here's a sample input image frame:

image description

I have tried a few possible solutions:

image description

  1. Contour detection (It doesn't work! Or maybe I miss a few additional tricks?)

  2. Color Segmentation (It doesn't work! Similarity of color between the hand and skin is already a big problem)

  3. Keypoints (e.g. SIFT, SURF, ORB, AKAZE)? (It might work! However, the hand movement itself is non-rigid thus, the comparison might end up inconsistent.

  4. Object Detection (e.g. Haar or LBP) (It might work! But then again, the non-rigidity of hand movement might cause a serious problem.)

  5. More Machine Learning (RT, SVM, KNN, etc.) (It might work? )

Does anyone (else) have experienced similar problems that involve the above issues? Thanks in advance.

Any ideas on detecting and tracking hand touching the body with OpenCV?

Problems:

  1. Detect the hand over the human body (Note: color is very similar).
  2. Localize the position of the touch
  3. Track the movement as the hand moves along the body.

Here's a sample input image frame:

image description

I have tried a few possible solutions:

image description

  1. Contour detection (It doesn't work! Or maybe I miss a few additional tricks?)

  2. Color Segmentation (It doesn't work! Similarity of color between the hand and skin is already a big problem)

  3. Keypoints (e.g. SIFT, SURF, ORB, AKAZE)? (It might work! However, the hand movement itself is non-rigid thus, the comparison might end up inconsistent.

  4. Object Detection (e.g. Haar or LBP) (It might work! But then again, the non-rigidity of hand movement might cause a serious problem.)

  5. Background Subtraction/ Motion segmentation (It might work; but if the belly is bulky, then, there will be motion all over the region as well. )

  6. More Machine Learning (RT, SVM, KNN, etc.) (It might work? )

Does anyone (else) have experienced similar problems that involve the above issues? Thanks in advance.

Any ideas on detecting and tracking hand touching the body with OpenCV?

Problems:

  1. Detect the hand over the human body (Note: color is very similar).
  2. Localize the position of the touch
  3. Track the movement as the hand moves along the body.

Here's a sample input image frame:

image description

I have tried a few possible solutions:

image description

  1. Contour detection (It doesn't work! Or maybe I miss a few additional tricks?)

  2. Color Segmentation (It doesn't work! Similarity of color between the hand and skin is already a big problem)

  3. Keypoints (e.g. SIFT, SURF, ORB, AKAZE)? (It might work! However, the hand movement itself is non-rigid thus, the comparison might end up inconsistent.

  4. Object Detection (e.g. Haar or LBP) (It might work! But then again, the non-rigidity of hand movement might cause a serious problem.)

  5. Background Subtraction/ Motion segmentation (It might work; but if the belly is bulky, then, there will be motion all over the region as well. )

  6. More Machine Learning (RT, SVM, KNN, etc.) (It might work? )

Does anyone (else) have experienced similar problems that involve the above issues? Thanks in advance.

Any ideas on detecting and tracking hand touching the body with OpenCV?

Problems:

  1. Detect the hand over the human body (Note: color is very similar).
  2. Localize the position of the touch
  3. Track the movement as the hand moves along the body.

Here's a sample input image frame:

image description

I have tried a few possible solutions:

image description

  1. Contour detection (It doesn't work! Or maybe I miss a few additional tricks?)

  2. Color Segmentation (It doesn't work! Similarity of color between the hand and skin is already a big problem)

  3. Keypoints (e.g. SIFT, SURF, ORB, AKAZE)? (It might work! However, the hand movement itself is non-rigid thus, the comparison might end up inconsistent.

  4. Object Detection (e.g. Haar or LBP) (It might work! But then again, the non-rigidity of hand movement might cause a serious problem.)

  5. Background Subtraction/ Motion segmentation (It might work; but if the belly is bulky, then, there will be motion all over the region as well. )

  6. More Machine Learning (RT, SVM, KNN, MLP etc.) (It might work? )

Does anyone (else) have experienced similar problems that involve the above issues? Thanks in advance.

Any ideas on detecting and tracking hand touching the body with OpenCV?

Problems:

  1. Detect the hand over the human body (Note: color is very similar).
  2. Localize the position of the touch
  3. Track the movement as the hand moves along the body.

Here's a sample input image frame:

image description

I have tried a few possible solutions:

image description

  1. Contour detection (It doesn't work! Or maybe I miss a few additional tricks?)

  2. Color Segmentation (It doesn't work! Similarity of color between the hand and skin is a big problem)

  3. Keypoints (e.g. SIFT, SURF, ORB, AKAZE)? (It might work! However, the hand movement itself is non-rigid thus, the comparison might end up inconsistent.

  4. Object Detection (e.g. Haar or LBP) (It might work! But then again, the non-rigidity of hand movement might cause a serious problem.)

  5. Background Subtraction/ Motion segmentation (It might work; but if the belly is bulky, then, there will be motion all over the region region. Furthermore, the examiner's arm of body will be in motion as well. )well....)

  6. More Machine Learning (RT, SVM, KNN, MLP etc.) (It might work? )

Does anyone (else) have experienced similar problems that involve the above issues? Thanks in advance.

Any ideas on detecting and tracking hand touching the body with OpenCV?

Problems:

  1. Detect the hand over the human body (Note: color is very similar).
  2. Localize the position of the touch
  3. Track the movement as the hand moves along the body.

Here's a sample input image frame:

image description

I have tried a few possible solutions:

image description

  1. Contour detection (It doesn't work! Or maybe I miss a few additional tricks?)

  2. Color Segmentation (It doesn't work! Similarity of color between the hand and skin is a big problem)

  3. Keypoints (e.g. SIFT, SURF, ORB, AKAZE)? (It might work! However, the hand movement itself is non-rigid thus, the comparison might end up inconsistent.

  4. Object Detection (e.g. Haar or LBP) (It might work! But then again, the non-rigidity of hand movement might cause a serious problem.)

  5. Background Subtraction/ Motion segmentation (It might work; but if the belly is bulky, then, there will be motion all over the region. Furthermore, the examiner's arm of or body will be in motion as well....)

  6. More Machine Learning (RT, SVM, KNN, MLP etc.) (It might work? )

Does anyone (else) have experienced similar problems that involve the above issues? Thanks in advance.