Welcome to the ideas portal for Adobe Character Animator.
If you wish to file a bug, please use this link
Many facial applications seem to use a Pen type Tool for selecting or drawing around the facial features. This ability to fine tune any automated attempt at face recognition would surely help in regard to Seth's suggestion.
Eyes especially seem to be jittery. And the follow mouse for the Gaze during recording feels like it's resisting.
You won't be notified about changes to this idea.