Symbolic Aggregate approXimation-Local Binary Pattern Feature Descriptor Combination for Automatic Facial Expression Recognition

Abstract

Automatic identification of facial expression is a significant research area which is anticipated for real time processing in Human-Computer Interaction domain. Along with an efficient classifier for assigning the class label to each of the input face image, it is very necessary to have a strong feature vector for training the classifier. This paper proposes an effectual combination of Local Binary Pattern and Symbolic Aggregate approXimation method for the feature vector generation for the classifier. Twenty one facial patches are extracted from the face image and the LBP value and SAX string for these twenty one patches are utilised for feature vector generation. The feature vectors of images are submitted to the Ensemble Bag classifier for training purpose. Images which were not used for training is used for testing. An average accuracy of 98.7% was obtained when tested on JAFFE data set for seven expressions and an accuracy of 96.96% was obtained for nine expressions on fused database. A detailed analysis of the testing conducted on images with partial occlusion and illumination variance are presented here.