Home > Archive > 2016 > Volume 6 Number 2 (Apr. 2016) >
IJMLC 2016 Vol.6(2): 80-86 ISSN: 2010-3700
DOI: 10.18178/ijmlc.2016.6.2.577

Robust One-Shot Facial Expression Recognition with Sunglasses

H. Jiang, K. Huang, T. Mu, R. Zhang, T. O. Ting, and C. Wang

Abstract—Automatic facial expression recognition (FER) is both interesting and important in computer vision and machine intelligence. While previous FER systems often focus on learning a classifier in a controlled environment, a more practical and robust scenario is now under consideration. More specifically, traditional FER requires collecting as many as possible facial photos so that they will accurately recognize expressions no matter a particular person wears sunglasses, hats, and other accessories or not. Such requirement is however inconvenient and could impose practical difficulties for users. To alleviate this problem, a robust one-shot FER system that only requires taking one single facial photo for each expression of each user is proposed in this paper. When taking the single photo, the user is free to choose whether to wear sunglasses or not. The sunglasses can even be of different shape and of various luminous transmittance. Such one-shot recognition improves the user-friendliness of the FER system. Importantly, a novel and practical sunglasses detection and recovery approach is developed, which obtains an obvious accuracy improvement of 6.09%, 5.86% and 4.33% with state-of-the-art classifiers including Support Vector Machine (SVM), Linear Discriminate Analysis (LDA) and K-Nearest Neighbors (KNN) respectively on the modified Japanese Female Facial Expression (JAFFE) benchmark database.

Index Terms—Facial expression recognition, sunglasses detection and recovery, one-shot recognition system.

H. Jiang, K. Huang, T. O. Ting, and C. Wang are with the Department of Electrical & Electronic Engineering, K. Huang is also with University of Electrical Science and Technology of China, China (e-mail: {haochuan.jiang, kaizhu.huang, toting, chen.wang1102}@xjtlu.edu.cn).
R. Zhang is with Department of Mathematic Science of Xi’an Jiaotong-Liverpool University, SIP, Suzhou, 215123, P.R. China (e-mail: rui.zhang02@xjtlu.edu.cn).
T. Mu is with Department of Electrical Engineering and Electronics, University of Liverpool, Liverpool, L693GJ, United Kingdom (e-mail: t.mu@liverpool.ac.uk).


Cite: H. Jiang, K. Huang, T. Mu, R. Zhang, T. O. Ting, and C. Wang, "Robust One-Shot Facial Expression Recognition with Sunglasses," International Journal of Machine Learning and Computing vol.6, no. 2, pp. 80-86, 2016.

General Information

  • E-ISSN: 2972-368X
  • Abbreviated Title: Int. J. Mach. Learn.
  • Frequency: Quaterly
  • DOI: 10.18178/IJML
  • Editor-in-Chief: Dr. Lin Huang
  • Executive Editor:  Ms. Cherry L. Chen
  • Abstracing/Indexing: Inspec (IET), Google Scholar, Crossref, ProQuest, Electronic Journals LibraryCNKI.
  • E-mail: ijml@ejournal.net

Article Metrics in Dimensions