Evaluating real-life performance of the state-of-the-art in facial expression recognition using a novel YouTube-based datasets

Muhammad Hameed Siddiqi, Maqbool Ali, Mohamed Elsayed Abdelrahman Eldib, Asfandyar Khan, Oresti Banos, Adil Mehmood Khan, Sungyoung Lee, Hyunseung Choo*

*Corresponding author for this work

    Research output: Contribution to journalArticleAcademicpeer-review

    4 Citations (Scopus)
    2 Downloads (Pure)


    Facial expression recognition (FER) is one of the most active areas of research in computer science, due to its importance in a large number of application domains. Over the years, a great number of FER systems have been implemented, each surpassing the other in terms of classification accuracy. However, one major weakness found in the previous studies is that they have all used standard datasets for their evaluations and comparisons. Though this serves well given the needs of a fair comparison with existing systems, it is argued that this does not go in hand with the fact that these systems are built with a hope of eventually being used in the real-world. It is because these datasets assume a predefined camera setup, consist of mostly posed expressions collected in a controlled setting, using fixed background and static ambient settings, and having low variations in the face size and camera angles, which is not the case in a dynamic real-world. The contributions of this work are two-fold: firstly, using numerous online resources and also our own setup, we have collected a rich FER dataset keeping in mind the above mentioned problems. Secondly, we have chosen eleven state-of-the-art FER systems, implemented them and performed a rigorous evaluation of these systems using our dataset. The results confirm our hypothesis that even the most accurate existing FER systems are not ready to face the challenges of a dynamic real-world. We hope that our dataset would become a benchmark to assess the real-life performance of future FER systems.

    Original languageEnglish
    Pages (from-to)917-937
    Number of pages21
    JournalMultimedia tools and applications
    Issue number1
    Publication statusPublished - 1 Jan 2018


    • Classification
    • Facial expressions
    • Real-life scenarios
    • YouTube
    • n/a OA procedure


    Dive into the research topics of 'Evaluating real-life performance of the state-of-the-art in facial expression recognition using a novel YouTube-based datasets'. Together they form a unique fingerprint.

    Cite this