Claim Missing Document
Check
Articles

Deep Deterministic Policy Gradient for Simulation-Based Control of Water Quality in Nano Aquatic Systems Iwan Fitrianto Rahmad; Syahril Efendi; Poltak Sihombing; Henny Febriana Harumy
Journal of Applied Data Sciences Vol 7, No 3: September 2026
Publisher : Bright Publisher

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.47738/jads.v7i3.1447

Abstract

This study proposes a simulation-based Deep Deterministic Policy Gradient (DDPG) framework for water-quality control in nano aquatic systems. Nano tanks are highly sensitive to small disturbances because their limited water volume reduces buffering capacity and causes rapid changes in dissolved oxygen, ammonia, pH, temperature, biological oxygen demand, and chemical oxygen demand. To represent these coupled dynamics, a nonlinear simulation model adapted from the Continuously Stirred Tank Reactor concept is developed and implemented as an OpenAI Gym-compatible reinforcement learning environment. The DDPG agent learns continuous control actions related to aeration, feeding, and filtration through repeated interaction with the simulated nano-tank environment. The proposed nonlinear CSTR-DDPG framework is evaluated against a linear-model DDPG baseline using RMSE, cumulative reward, and closed-loop control performance. Simulation results show that the nonlinear model reduced RMSE by 45.2% for dissolved oxygen, 64.0% for ammonia, and 61.3% for pH compared with the linear baseline. The DDPG agent also achieved a 41.7% higher cumulative reward under the same reward structure. These findings indicate that nonlinear simulation can provide a more informative training environment for DDPG-based water-quality control. However, the present study remains limited to simulation-based evaluation, and physical validation using calibrated sensors, actuators, communication-delay analysis, and real nano-tank experiments is required in future work.
Co-Authors Aditya Arielevi Aditya Rizky Suryanta Sembiring Aditya, Elsa Akbar, M. Ridho Alfa Saleh Alfa Soleh Alfa Soleh Amirul Amin PS Amri, Aulia Ananda Fitriani Dewi Annisa Ashari Ardani, Tira Azhar, Wahyu Bob Subahan Riza Bob Subhan Riza Budi Triandi Budi Triandi Budi Triandi, Budi Dimas Yussan Muharrom Doni, Rahmad Edy Victor Haryanto Edy Victor Haryanto, Edy Victor Efendi, Syahril Elsa Aditya Erwin Panggabean Evri Ekadiansyah Evri Ekadiansyah Fragastia, Vidi Agung Ginting, Ria Ukur Gultom, Erdiana Harahap, Nur Anzelina Hardianto Hardianto Harold Situmorang, Harold Helmi Kurniawan Helmi Syaiful Rahman Henny Febriana Harumy Hestina Irfannur Diah Juanda Hakim Lubis Juanda Hakim Lubis Juanda Hakim Lubis Khairi Fadli Winata Khairul Ummi Khairul Ummi Khairul Ummi, Khairul Lili Tanti Linda Wahyuni Lubis, Muhammad Luthfi Moratuah M Fikry Haikal M Rizky M. Alif Firdiansyah M. Haidil Umam M. Irfan Fadillah Maulana Fajar Sidik Mesran Mesran, M.Kom Mhei Arni Olivia Muhammad Arif Prayudi, Muhammad Arif Muhammad Taufiq Rustam Muhammad Wahyu Pratama Muhammad Yusra Rustam Negoro, Wahyu Saptha Nur Fadillah Nurul Fadilah Pairin, Yusfrizal Bin Pasaribu, Jamil Poltak Sihombing Puji Widodo Purba, Adelina Rahmad Aditya Rahmad Aditya Rahmad Doni Rahmad Doni Rahmad Doni Rahmad, Sofyan Ratih Puspasari Reza Hermawan Ria Eka Sari Rika Rosnelly Robby Ardyanto Marsudi Saidah Ulya Samsir Samsir Samsir Samsir, Samsir Setiawan, Adil Siregar, Rahmadani Sri Mulia Mz Tanjung, Dahriyani Hakim Tumbur Munthe Wahyu Azhar Wiwi Verina Yudhi Andrian Yudho Andika