Real-Time Facial Emotion Recognition Using Mini-Xception and EfficientNetB4
DOI:
https://doi.org/10.30871/jaic.v10i4.13496Keywords:
Facial Emotion Recognition, Mini-Xception, EfficientNetB4, RAF-DB, Classifications Real-TimeAbstract
Facial Emotion Recognition (FER) is an important field within computer vision and human–computer interaction that focuses on the automatic recognition of human emotional expressions through facial images. This study presents a comparative analysis of two Convolutional Neural Network (CNN) architectures, namely Mini-Xception and EfficientNetB4, for real-time facial emotion classification using the RAF-DB (Real-world Affective Faces Database) dataset. Mini-Xception was employed as a lightweight model with lower computational requirements, whereas EfficientNetB4 utilized a transfer learning approach to achieve superior classification performance. The RAF-DB dataset consists of seven primary emotion categories: angry, disgust, fear, happy, neutral, sad, and surprise. The preprocessing stage included facial image resizing, grayscale conversion for Mini-Xception, RGB normalization for EfficientNetB4, and the application of data augmentation techniques to improve model generalization capability. Experimental results demonstrated that Mini-Xception achieved a validation accuracy of 52.12%, while EfficientNetB4 attained a validation accuracy of 86.02%. In real-time implementation using a webcam and OpenCV, Mini-Xception exhibited advantages in inference speed, whereas EfficientNetB4 produced more stable and accurate emotion predictions. The findings indicate a trade-off between computational efficiency and classification performance. Therefore, EfficientNetB4 is more suitable for systems requiring high classification accuracy, while Mini-Xception is more appropriate for real-time applications operating under limited computational resources.
Downloads
References
[1] M. Sigala, A. Beer, L. Hodgson, and A. O’Connor, Big Data for Measuring the Impact of Tourism Economic Development Programmes: A Process Singh, R., Sharma, H., & Mehta, N. K. (2022). EfficientNet for Human FER Using Transfer Learning. ICTACT Journal on Soft Computing, 13(1), 2792–2797. https://doi.org/10.21917/ijsc.2022.0397
[2] Akhand, M. A. H., et al. (2021). Facial emotion recognition using transfer learning in the deep CNN. Electronics, 10(9), 1036. https://doi.org/10.3390/electronics10091036
[3] Arriaga, O., Valdenegro-Toro, M., & Plöger, P. (2017). Real-time convolutional neural networks for emotion and gender classification. arXiv preprint arXiv:1710.07557. https://doi.org/10.48550/arXiv.1710.07557
[4] Na, I., et al. (2024). FacialNet: facial emotion recognition for mental health analysis using UNet segmentation with transfer learning model. Frontiers in Computational Neuroscience, 18, 1485121. https://doi.org/10.3389/fncom.2024.1485121
[5] Chollet, F. (2017). Xception: Deep learning with depthwise separable convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 1251–1258. https://doi.org/10.1109/CVPR.2017.195
[6] Tan, M., & Le, Q. V. (2019). EfficientNet: Rethinking model scaling for convolutional neural networks. Proceedings of the 36th International Conference on Machine Learning (ICML), 6105–6114. https://doi.org/10.48550/arXiv.1905.11946
[7] Li, S., Deng, W., & Du, J. (2017). Reliable crowdsourcing and deep locality-preserving learning for expression recognition in the wild. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2584–2593. https://doi.org/10.1109/CVPR.2017.277
[8] Li, S., & Deng, W. (2019). Reliable crowdsourcing and deep locality-preserving learning for unconstrained facial expression recognition. IEEE Transactions on Image Processing, 28(1), 356–370. https://doi.org/10.1109/TIP.2018.2868382
[9] Handayani, N. M. K. K., et al. (2023). Pengenalan ekspresi wajah menggunakan transfer learning MobileNetV2 dan EfficientNet-B0. Jurnal Media Informatika Budidarma, 8(1). https://doi.org/10.30865/mib.v8i1.7048
[10] Kopalidis, T., Solachidis, V., Vretos, N., & Daras, P. (2024). Advances in facial expression recognition: A survey of methods, benchmarks, models, and datasets. Information, 15(3), 135. https://doi.org/10.3390/info15030135
[11] Elsheikh, R. A., Mohamed, M. A., Abou-Taleb, A. M., & Ata, M. M. (2024). Improved facial emotion recognition model based on a novel deep convolutional structure. Scientific Reports, 14, 29050. https://doi.org/10.1038/s41598-024-79167-8
[12] Lawpanom, R., Songpan, W., & Kaewyotha, J. (2024). Advancing facial expression recognition using homogeneous ensemble CNN. Applied Sciences, 14(3), 1156. https://doi.org/10.3390/app14031156
[13] Raj, R., & Demirkol, I. (2025). An improved facial emotion recognition system using convolutional neural network for the optimization of human robot interaction. Scientific Reports, 15, 38940. https://doi.org/10.1038/s41598-025-22835-0
[14] Qian, C., et al. (2025). Real-time emotion recognition based on facial expressions. Multidisciplinary Reviews, 6(3). https://doi.org/10.61838/kman.mr.6.3.25
[15] Özdemir, M. A., et al. (2019). Real time emotion recognition from facial expressions using CNN architecture. 2019 27th Signal Processing and Communications Applications Conference (SIU). https://doi.org/10.1109/SIU.2019.8806250
[16] Siqueira, H., Magg, S., & Wermter, S. (2020). Efficient facial feature learning with wide ensemble-based convolutional neural networks. Proceedings of the AAAI Conference on Artificial Intelligence, 34(04), 5800–5809. https://doi.org/10.1609/aaai.v34i04.6037
[17] Khaireddin, Y., & Chen, Z. (2021). Facial emotion recognition: State of the art performance on FER2013. arXiv preprint arXiv:2105.03588. https://doi.org/10.48550/arXiv.2105.03588
[18] Zhang, J., Li, S., & Wang, Y. (2023). Facial expression recognition based on improved convolutional neural networks. Scientific Reports, 13, 17654. https://doi.org/10.1038/s41598-023-44893-6
[19] Barsoum, E., Zhang, C., Ferrer, C. C., & Zhang, Z. (2016). Training deep networks for facial expression recognition with crowd-sourced label distribution. Proceedings of the 18th ACM International Conference on Multimodal Interaction, 279–283. https://doi.org/10.1145/2993148.2993165
[20] Mollahosseini, A., Hasani, B., & Mahoor, M. H. (2017). AffectNet: A database for facial expression, valence, and arousal computing in the wild. IEEE Transactions on Affective Computing, 10(1), 18–31. https://doi.org/10.1109/TAFFC.2017.2740923
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Gede Pradistya Evan Aryaputra, Christy Atika Sari, Eko Hari Rachmawanto
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License (Attribution-ShareAlike 4.0 International (CC BY-SA 4.0) ) that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
