I have a friend who, after having a stroke, now has locked-in syndrome who and can now only move his eyes and eyelids. I've been working on some C# software (written in Unity3D) to help him to communicate, the ones he has tried so far have not been successful due to the level of his disability.
I am in the process of implementing DLib for facial feature recognition. What I would like to do is to ask the user to repeatedly alternate between a neutral face and a face that is indicating. I don't want to limit the indication gesture specifically to winking/blinking/opening eyes wide, etc as I want other people to be able to freely download the app and indicate in whatever way they find easiest due to their incapacity.
I could really do with some pointers as to how to have my app learn what the user's facial indicator is by comparing the facial landmarks of the two states.
At this point I don't even know what it is I need to know. I don't know the names of any AI algorithms that might be relevant, or anything.
OpenCV would be an excellent choice as I already have a licence for a library in Unity3D, which is why I am asking here.