IoT-Based Smart Jacket with Multimodal Sensors for Autism Monitoring
DOI:
https://doi.org/10.30871/jaic.v10i5.13993Keywords:
Multimodal Sensors, Smart Jacket, Autism, Internet of ThingsAbstract
Autism is a neurodevelopmental condition characterized by difficulties in verbal and non-verbal communication, as well as challenges in regulating certain activities and behaviors. One of the challenges faced by families when individuals with autism engage in activities outside the home or are left unsupervised is the difficulty of continuously monitoring their activities and health conditions. Therefore, this study aims to integrate multimodal sensors into a smart jacket for Internet of Things (IoT)-based activity and health monitoring of individuals with autism. The proposed smart jacket integrates a multimodal sensor system comprising an Inertial Measurement Unit (IMU) sensor for activity detection, a tilt sensor for detecting body inclination, a sound sensor for detecting vocal stimming, a DHT22 sensor for monitoring the temperature inside the jacket, a vibration sensor for detecting body vibration frequency, a pulse sensor for monitoring heart rate, and an oximeter sensor for measuring blood oxygen saturation. An ESP32 microcontroller is employed for data acquisition and processing, while a web-based IoT platform is used to transmit information from the smart jacket to family members’ smartphones. The experimental results demonstrate that the developed smart jacket can transmit activity and health-related information of individuals with autism to family members, including activity status, anomalous activities, vocal stimming, temperature, heart rate, and blood oxygen saturation.
Downloads
References
[1] D. Ahuja, A. Sarkar, S. Chandra, and P. Kumar, “Wearable technology for monitoring behavioral and physiological responses in children with autisme spectrum disorder: A literature review,” Technology and Disability, vol. 34, no. 2, pp. 85–98, 2022.
[2] S. Cano, C. Cubillos, R. Alfaro, A. Romo, M. García, and F. Moreira, “Wearable solutions using physiological signals for stress monitoring on individuals with autisme spectrum disorder (ASD): A systematic literature review,” Sensors, vol. 24, no. 24, Art. no. 8137, 2024.
[3] K. Gangaraju, Y. H. Kadegowda, and S. Sangani, “Energy- and behavior-aware sensory data collection for ASD monitoring over IoT using unequal clustering and reinforcement learning,” Discover Internet of Things, vol. 6, Art. no. 24, 2026.
[4] M. Albinali, A. Goodwin, and S. S. Intille, “Detecting stereotypical motor movements in the classroom using accelerometry and pattern recognition algorithms,” Pervasive and Mobile Computing, vol. 8, no. 1, pp. 103–114, Feb. 2012, doi: 10.1016/j.pmcj.2011.04.006.
[5] A. M. Amiri, N. Peltier, C. Goldberg, Y. Sun, K. M. Hiremath, and colleagues, “WearSense: Detecting autisme stereotypic behaviors through smartwatches,” Healthcare, vol. 5, no. 1, Art. no. 11, 2017, doi: 10.3390/healthcare5010011.
[6] H. Sarker, A. Tam, M. A. Foreman, N. Fay, M. Dhuliawala, and A. K. Das, “Detection of stereotypical motor movements in autisme using a smartwatch-based system,” in AMIA Annual Symposium Proceedings, 2018, pp. 952–960.
[7] L. Billeci, A. Tonacci, G. Tartarisco, A. Narzisi, S. Di Palma, D. Corda, G. Baldus, F. Cruciani, S. M. Anzalone, S. Calderoni, G. Pioggia, F. Muratori, and the Michelangelo Study Group, “An integrated approach for the monitoring of brain and autonomic response of children with autisme spectrum disorders during treatment by wearable technologies,” Frontiers in Neuroscience, vol. 10, Art. no. 276, Jun. 2016, doi: 10.3389/fnins.2016.00276.
[8] S. Di Palma, A. Tonacci, A. Narzisi, C. Domenici, G. Pioggia, F. Muratori, and L. Billeci, “Monitoring of autonomic response to sociocognitive tasks during treatment in children with Autisme Spectrum Disorders by wearable technologies: A feasibility study,” Computers in Biology and Medicine, vol. 85, pp. 143–152, Jun. 2017, doi: 10.1016/j.compbiomed.2016.04.001.
[9] M. Zwilling, A. Romano, H. Hoffman, M. Lotan, and R. Tesler, “Development and validation of a system for the prediction of challenging behaviors of people with autisme spectrum disorder based on a smart wearable shirt: A mixed-methods design,” Frontiers in Behavioral Neuroscience, vol. 16, Art. no. 948184, Nov. 2022, doi: 10.3389/fnbeh.2022.948184.
[10] H. J. Nuske, M. S. Goodwin, Y. Kushleyeva, D. Forsyth, J. W. Pennington, A. J. Masino, E. Finkel, A. Bhattacharya, J. Tan, H. Tai, Z. Atkinson-Diaz, C. P. Bonafide, and J. D. Herrington, “Evaluating commercially available wireless cardiovascular monitors for measuring and transmitting real-time physiological responses in children with autisme,” Autisme Research, vol. 15, no. 1, pp. 117–130, Jan. 2022, doi: 10.1002/aur.2633.
[11] K. Gangaraju, Y. H. Kadegowda, and S. Sangani, “Energy- and behavior-aware sensory data collection for ASD monitoring over IoT using unequal clustering and reinforcement learning,” Discover Internet of Things, vol. 6, Art. no. 24, 2026, doi: 10.1007/s43926-026-00287-w.
[12] I.W. Suparno., dan A. Jalil, “Implementasi Sensor Multi-Modal Menggunakan Raspberry Pi dan Roobt Operating System Pada Sistem Keamanan Rumah,” Jurnal Electro luceat, Vol. 7, No. 2, pp. 86-95, 2021. DOI: https://doi.org/10.32531/jelekn.v7i2.405.
[13] M.F. Ridho., A.Z. Abidin., dan B Septian, “Integrasi Odometri LIDAR dan Sensor IMU Untuk Peningkatan Lokalisasi Pada Robot Bergerak Indoor,” Blend Sains Jurnal Teknik, Vol. 2, No. 4, pp. 287-297, 2024. DOI: https://doi.org/10.56211/blendsains.v2i4.470.
[14] Q. Zhang, Y. Chen, Y. Tang, Y. Yao, J. Guo and X. Zhang, "A High-Resolution Tilt Sensor Utilizing Grooved Arch Beam-Assisted EFPI for Large Angle Measurement," in IEEE Sensors Journal, vol. 24, no. 22, pp. 36846-36853, 15 Nov.15, 2024, doi: 10.1109/JSEN.2024.3467122.
[15] Cakra., M.S.Said., dan Henny, “Sistem Kontrol Lampu Menggunakan Sensor Suara,” Jurnal Sistem Informasi Dan Teknik Komputer, Vol. 8, No. 1, pp. 77-82, 2023. DOI: https://doi.org/10.51876/simtek.v8i1.218.
[16] A. R. Nair, A. Mohan, P. V. Moncy, V. Vinod, L. R. Mathew and J. Jayakumari, "Smart Air Quality Monitoring System for Pulmonary Disease Management - OSA," 2024 International Conference on Futuristic Technologies in Control Systems & Renewable Energy (ICFCR), Malappuram, India, 2024, pp. 1-6, doi: 10.1109/ICFCR64128.2024.10763385.
[17] W. Panjaitan, “Sistem Monitoring Detak Jantung Menggunakan Pulse Heart Rate Sensor dan Nodemcu,” Merkurius: Jurnal Riset Sistem Informasi dan Teknik Informatika, Vol. 3, No. 2, pp. 63-72, 2025. DOI: https://doi.org/10.61132/merkurius.v3i2.712.
[18] S.R. Sunarto., A. Situmeang., dan V.E. Kristianti, “Prototype Pengukur Detak Jantung, Saturasi Oksigen, dan Suhu Tubuh Manusia Secara Portable,” Jurnal JTS, Vol. 3, No. 2, pp. 84-93, 2024. DOI: https://doi.org/10.56127/jts.v3i2.1535.
[19] M.F. Azhar., dan L. Nurpulaela, “Implementasi Penggunaan ESP32 Sebagai IoT Pada Project Smart Charger di PT. Pasifik Satelit Nusantara Bekasi,” JATI, Vol. 8, No. 4, pp. 7248-7253, 2024. DOI: https://doi.org/10.36040/jati.v8i4.10201.
[20] J. B. Ajith, R. Manimegalai and V. Ilayaraja, "An IoT Based Smart Water Quality Monitoring System using Cloud," 2020 International Conference on Emerging Trends in Information Technology and Engineering (ic-ETITE), Vellore, India, 2020, pp. 1-7, doi: 10.1109/ic-ETITE47903.2020.450.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Aulia Darnilasari, Matalangi Matalangi, Muslim Muslim, Selsiana Selsiana, Hasnia Arruan
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License (Attribution-ShareAlike 4.0 International (CC BY-SA 4.0) ) that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
