Ask Your Question

Revision history [back]

click to hide/show revision 1
initial version

offtopic: facnet model phenomenon

Hello i hope the following cnn/dnn questions are not too off topic:

Disclaimer:

  • I read about siamese networks, triplet(loss) and understand that facenet is a model architecture.
  • I also understand that the model openface.nn4.small2.v1.t7 used by the open cv demo is an implementation of the facnet architecture

I picked as an anchor image(every following pictures will be compared with this) of arnold schwarzenegger, age 40 from the front. During testing i noticed the following:

  • Slightly Different angles of the same person leads to a very low similarity score
    • Different ages of the same person leads to a very low similarity score
    • I picked an image of an old woman, a young woman(famous "lena" picture) and a baby To my suprise these image(which are clearly a different person than arni) are closers to the anchor than the pictures of the same person(different age / angel).

I am afraid i can not ask the net why it thinks lena is more similar to arnold than a picture of himself at a slightly different age. Can anyone with decent knowledge comment on this "phenomenon" ?

On the other hand, as long as the network detects the same person when having a high score (0.8 seems to be good), and i can confirm this, is all fine?

Maybe this all is just "network magic"? Any comments on this is highly welcome, maybe i should also try the tensorflow implementation of the facenet.

Greetings, Holger

click to hide/show revision 2
retagged

updated 2018-07-06 06:14:32 -0600

berak gravatar image

offtopic: facnet model phenomenon

Hello i hope the following cnn/dnn questions are not too off topic:

Disclaimer:

  • I read about siamese networks, triplet(loss) and understand that facenet is a model architecture.
  • I also understand that the model openface.nn4.small2.v1.t7 used by the open cv demo is an implementation of the facnet architecture

I picked as an anchor image(every following pictures will be compared with this) of arnold schwarzenegger, age 40 from the front. During testing i noticed the following:

  • Slightly Different angles of the same person leads to a very low similarity score
    • Different ages of the same person leads to a very low similarity score
    • I picked an image of an old woman, a young woman(famous "lena" picture) and a baby To my suprise these image(which are clearly a different person than arni) are closers to the anchor than the pictures of the same person(different age / angel).

I am afraid i can not ask the net why it thinks lena is more similar to arnold than a picture of himself at a slightly different age. Can anyone with decent knowledge comment on this "phenomenon" ?

On the other hand, as long as the network detects the same person when having a high score (0.8 seems to be good), and i can confirm this, is all fine?

Maybe this all is just "network magic"? Any comments on this is highly welcome, maybe i should also try the tensorflow implementation of the facenet.

Greetings, Holger

click to hide/show revision 3
None

updated 2018-07-06 06:14:48 -0600

berak gravatar image

offtopic: facnet model phenomenon

Hello i hope the following cnn/dnn questions are not too off topic:

Disclaimer:

  • I read about siamese networks, triplet(loss) and understand that facenet is a model architecture.
  • I also understand that the model openface.nn4.small2.v1.t7 used by the open cv demo is an implementation of the facnet architecture

I picked as an anchor image(every following pictures will be compared with this) of arnold schwarzenegger, age 40 from the front. During testing i noticed the following:

  • Slightly Different angles of the same person leads to a very low similarity score
    • Different ages of the same person leads to a very low similarity score
    • I picked an image of an old woman, a young woman(famous "lena" picture) and a baby To my suprise these image(which are clearly a different person than arni) are closers to the anchor than the pictures of the same person(different age / angel).

I am afraid i can not ask the net why it thinks lena is more similar to arnold than a picture of himself at a slightly different age. Can anyone with decent knowledge comment on this "phenomenon" ?

On the other hand, as long as the network detects the same person when having a high score (0.8 seems to be good), and i can confirm this, is all fine?

Maybe this all is just "network magic"? Any comments on this is highly welcome, maybe i should also try the tensorflow implementation of the facenet.

Greetings, Holger