IJISCS (International Journal of Information System and Computer Science)
Vol 10, No 2 (2026): IJISCS (International Journal of Information System and Computer Science)

DEEP Q-NETWORK-BASED ADAPTIVE EDGE INTELLIGENCE FOR ENERGY-EFFICIENT AIR QUALITY MONITORING IN IOT NETWORKS

Donatien KADIMA MUAMBA (Faculté des Sciences Informatiques/ Université Révérend KIM Ecole de Télécommunication et Télédétection Spatiale/ Université Pédagogique Nationale)



Article Info

Publish Date
30 Aug 2026

Abstract

The rapid deployment of Internet of Things (IoT) networks enables environmental monitoring, but conventional fixed-interval sensing causes excessive energy consumption, communication overhead, and limited adaptability. This study proposes an adaptive edge intelligence framework using Deep Q-Network (DQN) for energy-efficient air quality monitoring. The system integrates environmental sensors with an ESP32-based edge node to measure PM2.5, PM10, CO₂, NOx, SOx, NHx, temperature, humidity, and traffic-related information. A DQN agent dynamically selects sensing and communication actions using nine environmental and contextual state variables. A customized reward function balances air quality conditions, energy consumption, communication costs, and monitoring requirements. Experimental data were collected through an IoT platform and stored in Supabase. The agent was trained using 103 valid observations over 200 episodes and independently evaluated on 114 observations. Training rewards increased from −43.62 to approximately 270 after convergence. Evaluation achieved a total reward of 316.092, an average reward of 2.773 per decision step, and an average energy cost of 0.20 per step. Under stable environmental conditions, the agent consistently selected SLOW_SAMPLE, reducing unnecessary sensing operations. These findings demonstrate the feasibility of DQN-based adaptive monitoring and provide a scalable foundation for energy-efficient, self-optimizing IoT environmental sensing systems under varying environmental conditions.

Copyrights © 2026






Journal Info

Abbrev

ijiscs

Publisher

Subject

Computer Science & IT Control & Systems Engineering Electrical & Electronics Engineering

Description

The IJISCS (International Journal of Information System and Computer Science) is a publication for researchers and developers to share ideas and results of software engineering and technologies. These journal publish some types of papers such as research papers reporting original research results, ...