ResNet50-Based Mobile Application for Big Five Personality Detection Using Handwriting
DOI:
https://doi.org/10.30871/jaic.v10i3.12902Keywords:
Deep Learning, Grafologi, Big Five personality, ResNetAbstract
Handwriting reflects a person's unique traits and has long been studied in the field of graphology to uncover personality characteristics. However, traditional graphological analysis is subjective, time-consuming, and prone to inter-rater differences. This study aims to develop a PenaKepribadian mobile application using ResNet50 transfer learning to automatically identify Big Five personality traits (Openness, Conscientiousness, Extraversion, Agreeableness, and Neuroticism). The HiEnWrite dataset contains 327 English handwritten images annotated by a certified graphologists, was utilized with an 80:20 train-test split. Three optimizers such as SGD, RMSprop, and Adam were comparatively evaluated. Adam achieved the best performance with a training PCC of 0.5872 with 91.90% accuracy and a testing PCC of 0.4719 with 89.95% accuracy, outperforming both SGD and RMSprop. A testing PCC of 0.4719 indicates moderate correlation, suggesting promising yet improvable results. Robustness testing across varying lighting conditions, paper backgrounds, and writing media showed consistent performance, with mean prediction deviations ranging from 0.070 to 0.126. All Black Box Testing scenarios returned valid results. These findings confirm that ResNet50 transfer learning effectively extracts handwriting features for personality prediction, though further improvements remain necessary before high-stakes deployment. This research contributes to personality computing and opens avenues for efficient, automated, and accessible personality assessment systems.
Downloads
References
[1] G. Marano, G. Traversi, E. Gaetani, G. Sani, S. Mazza, dan M. Mazza, “Graphology: An Interface Between Biology, Psychology and Neuroscience,” Psychological Disorders and Research, vol. 3, no. 3, hlm. 2–13, 2021.
[2] A. G. Purwanto, R. Y. Wijaya, Timotius, I. J. Agustian, dan I. B. Trisno, “Analisis dan Desain Intelligent Agent Menentukan Kepribadian Berdasarkan Tulisan Tangan,” Jurnal Nasional Komputasi dan Teknologi Informasi, vol. 5, no. 2, hlm. 243–247, 2022.
[3] G. Sheikholeslami, S. N. Srihari, dan V. Govindaraju, “Computer Aided Graphology,” Center of Excellence for Document Analysis and Recognition, State University of New York at Buffalo, 1999.
[4] O. P. John dan S. Srivastava, “The Big Five Traits Taxonomy: History, Measurement, and Theoretical Perspectives,” dalam HANDBOOK OF PERSONALITY Theory and Research, THE GUILFORD PRESS, 2024, hlm. 102–138.
[5] S. R. Nudin, R. Gernowo, M. Somantri, dan A. Wibowo, “Multi Task Classification Using Deep Learning Approaches for Big Five Personality Traits Prediction: A Review,” dalam 2024 11th International Conference on Information Technology, Computer, and Electrical Engineering (ICITACEE), IEEE, 2024, hlm. 37–42.
[6] E. Dimitriou dan M. Galanakis, “Organizational Psychology Re-Invented—The Big Five Personality Traits Model as a Reliable Behavior Framework in the Workplace,” Psychology, vol. 13, no. 05, hlm. 798–804, 2022.
[7] F. Celli dan B. Lepri, “Is Big Five better than MBTI?,” dalam Proceedings of the Fifth Italian Conference on Computational Linguistics CLiC-it 2018, Accademia University Press, 2018, hlm. 93–98.
[8] B. Gawda, “Lack of evidence for the assessment of personality traits using handwriting analysis,” Polish Psychological Bulletin, vol. 45, no. 1, hlm. 73–79, 2014, doi: 10.2478/ppb-2014-0011.
[9] A. Vinciarelli dan G. Mohammadi, “A Survey of Personality Computing,” IEEE Trans. Affect. Comput., vol. 5, no. 3, hlm. 273–291, 2014, doi: 10.1109/TAFFC.2014.2330816.
[10] Samsuryadi, R. Kurniawan, J. Supardi, Sukemi, dan F. S. Mohamad, “A Framework for Determining the Big Five Personality Traits Using Machine Learning Classification through Graphology,” Journal of Electrical and Computer Engineering, vol. 2023, no. 1, hlm. 1–15, 2023.
[11] S.-H. Noh, “Performance Comparison of CNN Models Using Gradient Flow Analysis,” Informatics, vol. 8, no. 3, hlm. 53, 2021.
[12] S. Patnaik, S. Kumari, dan S. Das Mahapatra, “Comparison of deep CNN and ResNet for Handwritten Devanagari Character Recognition,” dalam 2020 IEEE International Conference for Convergence in Engineering, IEEE, 2020, hlm. 235–238.
[13] J. E. Valdez-Rodríguez, H. Calvo, dan E. M. Felipe-Riverón, “Handwritten Texts for Personality Identification Using Convolutional Neural Networks,” dalam Lecture Notes in Computer Science (Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Springer Verlag, 2019, hlm. 140–145.
[14] B. S. Puttaswamy dan N. Thillaiarasu, “Fine DenseNet based human personality recognition using english hand writing of non-native speakers,” Biomed. Signal Process. Control, vol. 99, hlm. 106910, 2025.
[15] L. Hakim dan Hendro, “Penentuan Tes Kepribadian Calon Mahasiswa Berdasarkan Sidik Jari Menggunakan Minutie dan Support Vector Machine,” Journal of Applied Informatics and Computing (JAIC), vol. 4, no. 1, hlm. 28–32, 2020.
[16] N. A. Shiferaw dkk., “Handwritten Amharic Character Recognition Through Transfer Learning: Integrating CNN Models and Machine Learning Classifiers,” IEEE Access, vol. 13, hlm. 52134–52148, 2025.
[17] I. Santoso, A. M. Manurung, dan E. R. Subhiyakto, “Comparison of ResNet-50, EfficientNet-B1, and VGG-16 Algorithms for Cataract Eye Image Classification,” Journal of Applied Informatics and Computing (JAIC), vol. 9, no. 2, hlm. 284–294, 2025.
[18] C. Schröer, F. Kruse, dan J. M. Gómez, “A systematic literature review on applying CRISP-DM process model,” dalam Procedia Computer Science 181, Elsevier B.V., 2021, hlm. 526–534.
[19] S. Checker, M. Yadav, dan R. Katarya, “HiEnWrite: A Hindi-English Bilingual Dataset for Big Five Personality Detection,” ACM Transactions on Asian and Low-Resource Language Information Processing, vol. 24, no. 9, hlm. 1–19, 2025, doi: 10.1145/3756010.
[20] S. Mukherjee, “The Annotated ResNet-50,” Towards Data Science.
[21] R. Zaheer dan H. Shaziya, “A Study of the Optimization Algorithms in Deep Learning,” dalam Proceedings of the 3rd International Conference on Inventive Systems and Control, ICISC 2019, Institute of Electrical and Electronics Engineers Inc., 2019, hlm. 536–539.
[22] B. Nugroho, E. Y. Puspaningrum, dan M. S. Munir, “Kinerja Algoritma Optimasi Root-Mean-Square Propagation dan Stochastic Gradient Descent pada Klasifikasi Pneumonia Covid-19 Menggunakan CNN,” JEPIN (Jurnal Edukasi dan Penelitian Informatika), vol. 7, no. 3, hlm. 420–425, 2021.
[23] D. Altınel, “Development of Deep Learning Optimizers: Approaches, Concepts, and Update Rules,” arXiv preprint, 2025.
[24] G. A. Saputra dan I. M. A. Agastya, “Betta Fish Identification System Based On Convolutional Neural Network,” Journal of Applied Informatics and Computing (JAIC), vol. 8, no. 2, hlm. 443–452, 2024.
[25] M. O. G. Sibannang dan I. G. L. Wijayakusuma, “Implementation of LSTM for Gold Price Prediction in Indonesia,” Journal of Applied Informatics and Computing (JAIC), vol. 10, no. 1, hlm. 2548–6861, 2026.
[26] T. O. Hodson, “Root-mean-square error (RMSE) or mean absolute error (MAE): when to use them or not,” Geosci. Model Dev., vol. 15, no. 14, hlm. 5481–5487, 2022.
[27] V. K. A. Zebua dan Rusdah, “Forecasting Modeling of Imported Goods Release Waiting Time in Importer Logistics Operations Using Multiple Linear Regression,” Journal of Applied Informatics and Computing (JAIC), vol. 9, no. 4, hlm. 1878–1885, 2025.
[28] P. Schober, C. Boer, dan L. A. Schwarte, “Correlation coefficients: Appropriate use and interpretation,” Anesth. Analg., vol. 126, no. 5, hlm. 1763–1768, 2018.
[29] C. Putry, V. Paramita, dan I. Hartati, “Implementation of Ambon Banana Peel (Musa Paradisiaca) as Foaming Agent of Banana Fruitghurt using Foam Mat Drying Method,” Journal of Vocational Studies on Applied Research, vol. 4, no. 2, hlm. 40–46, 2022.
[30] G. S. Mahendra dan I. K. A. Asmarajaya, “Evaluation Using Black Box Testing and System Usability Scale in the Kidung Sekar Madya Application,” Sinkron : Jurnal dan Penelitian Teknik Informatika, vol. 6, no. 4, hlm. 2292–2302, 2022.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Adelia Salsabila Arifin, Salamun Rohman Nudin
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License (Attribution-ShareAlike 4.0 International (CC BY-SA 4.0) ) that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
