Self-Healing Network System with Adaptive Quality of Service on MikroTik RouterOS Using Proximal Policy Optimization

Daffa Faris Abqari Ramdhani; Marisa Premitasari

doi:10.30871/jaic.v10i5.13900

Authors

Daffa Faris Abqari Ramdhani Institut Teknologi Nasional
Marisa Premitasari Institut Teknologi Nasional

DOI:

https://doi.org/10.30871/jaic.v10i5.13900

Keywords:

Closed-Loop Control, Proximal Policy Optimization, Quality of Service, RouterOS MikroTik, Self-Healing Networks

Abstract

The limited adaptivity of Quality of Service (QoS) systems on MikroTik RouterOS, which still rely on static configurations and manual intervention, demands a network management mechanism capable of automatically adapting to traffic fluctuations. This study designs a self-healing system using Proximal Policy Optimization (PPO) integrated directly into MikroTik RouterOS via API within a closed-loop control architecture to realize adaptive QoS management. The agent is trained using a 12 feature state space that combines QoS parameters (latency, jitter, packet loss) and queue tree statistics (queued bytes, queued packets, dropped) for each traffic type (bulk, game, streaming), as well as a multidiscrete action space to adapt the queue type, limit-at, and max-limit parameters. The reward function is composed of anomaly penalties and a health bonus with clipping values in the range of [-5.0, 2.0] for training stability. Evaluation is conducted under three load scenarios (normal, static QoS, adaptive QoS) using a combination of Python generator scripts for streaming and game traffic, as well as real downloads via IDM for bulk traffic, with primary performance metrics including response time, recovery time, and recovery quality. Test results show that the self-healing system is capable of adjusting QoS configurations with an average response time of 22.11 ms, recovering network conditions with an average recovery time of 5.65 seconds, and achieving a recovery quality of 100%. These findings indicate that integrating PPO via the RouterOS API can realize an adaptive QoS self-healing system capable of responding to disruptions and restoring network conditions automatically on MikroTik infrastructure.

Downloads

Download data is not yet available.

References

[1] Cisco, “Global Networking Trends Report,” 2024.

[2] Huawei, “Communications Network 2030,” 2024.

[3] Juniper Networks, “5 Key Data Center Trends for 2024 The currents driving change in data center networking,” 2024.

[4] MikroTik, “RouterOS Documentation,” 2026. Accessed: Jul. 29, 2026. [Online]. Available: https://help.mikrotik.com/docs/

[5] K. Santosh and D. Garry, “Self-Healing Networks: Implementing AI-Powered Mechanisms to Automatically Detect and Resolve Network Issues with Minimal Human Intervention,” International Journal of Scientific Research and Engineering Development, vol. 6, 2023, [Online]. Available: www.ijsred.com

[6] S. Tummalpalli, “Self-Healing Network Infrastructure: The Future Of Autonomous Network Management,” International Journal Of Research In Computer Applications And Information TechnologY, vol. 8, no. 1, pp. 470–484, Jan. 2025, doi: 10.34218/IJRCAIT_08_01_039.

[7] T. Rahman and A. S. Ranindrianto, “Analisis Dan Implementasi Qos Dengan Simple Queue Serta Firewall Layer 7 Pada Mikrotik,” Jurnal Mnemonic, vol. 9, no. 1, pp. 19–27, Feb. 2026, doi: 10.36040/mnemonic.v9i1.16298.

[8] Fikri Dwilaksono, Henni Endah Wahanani, and Mohammad Idhom, “Implementasi Manajemen Bandwidth Menggunakan Metode Queue Tree dengan PCQ di SMK Negeri 1 Surabaya,” Jurnal Ilmiah Teknik Informatika dan Komunikasi, vol. 5, no. 2, pp. 58–72, May 2025, doi: 10.55606/juitik.v5i2.1029.

[9] G. Kim, Y. Kim, and H. Lim, “Deep Reinforcement Learning-Based Routing on Software-Defined Networks,” IEEE Access, vol. 10, pp. 18121–18133, 2022, doi: 10.1109/ACCESS.2022.3151081.

[10] F. Naaz, A. Chinmay, and A. Pattanaik, “QoS aware deep reinforcement learning technique for task scheduling in cloud computing,” Discover Computing, vol. 29, no. 1, p. 185, Mar. 2026, doi: 10.1007/s10791-026-09996-w.

[11] Y. Effendi, H. Yutanto, and G. Supriyanto, “Development of a Mikrotik API-Based Leaderboard System for Monitoring ISP User Activity,” Jurnal Sistem Informasi Bisnis, vol. 15, no. 3, pp. 300–309, Jul. 2025, doi: 10.14710/vol15iss3pp300-309.

[12] A. Kamaldeen, “Closed-Loop Autonomous Network Healing Using Digital Twins and Predictive Reinforcement Learning,” 2026. doi: 10.2139/ssrn.5989154.

[13] N. F. S. de Sousa, M. T. Islam, R. U. Mustafa, D. A. L. Perez, C. E. Rothenberg, and P. H. Gomes, “Machine Learning-Assisted Closed-Control Loops for Beyond 5G Multi-Domain Zero-Touch Networks,” Journal of Network and Systems Management, vol. 30, no. 3, p. 46, Jul. 2022, doi: 10.1007/s10922-022-09651-x.

[14] A. E. Kyzyrkanov, Y. S. Nurakhov, Z. Otarbay, and D. V. Lebedev, “Log-Driven Proximal Policy Optimization for Adaptive Traffic Control in Software-Defined Networks,” Applied Sciences, vol. 16, no. 9, p. 4424, May 2026, doi: 10.3390/app16094424.

[15] R. Zhang, L. Fan, and D. Lu, “Research on Self-Diagnosis and Self-Healing Technologies for Intelligent Fiber Optic Sensing Networks,” Sensors, vol. 25, no. 6, p. 1641, Mar. 2025, doi: 10.3390/s25061641.