Emerging Science Journal
Vol. 10 No. 3 (2026): June

Dual-Agent Q-Learning for Cross-Layer IEEE 802.11bd Optimization in Dense VANETs

Galih Nugraha Nurkahfi (1) School of Electrical Engineering and Informatics, Bandung Institute of Technology (ITB), Bandung 40132, Indonesia. 2) Research Organization of Electronics and Informatics, National Research and Innovation Agency (BRIN), Bandung 40135)
Suyoto (Research Organization of Electronics and Informatics, National Research and Innovation Agency (BRIN), Bandung 40135)
Agus Subekti (Research Organization of Electronics and Informatics, National Research and Innovation Agency (BRIN), Bandung 40135)
Budi Prawara (Research Organization of Electronics and Informatics, National Research and Innovation Agency (BRIN), Bandung 40135)
Ratna Mayasari (1) School of Electrical Engineering and Informatics, Bandung Institute of Technology (ITB), Bandung 40132, Indonesia. 3) Center of Excellence for Intelligent Sensing-IoT, Research Institute of Sustainable Society, Telkom University, Bandung 40257)
Andy Triwinarko (Network and Multimedia Study Program, State Polytechnique of Batam (Polibatam), Batam 29431)
Nasrullah Armi (2) Research Organization of Electronics and Informatics, National Research and Innovation Agency (BRIN), Bandung 40135, Indonesia. 5) Center of Excellence for Advanced Intelligent Communications (AICOMS), Telkom University, Bandung 40257)
Eueung Mulyana (School of Electrical Engineering and Informatics, Bandung Institute of Technology (ITB), Bandung 40132)
Nana Rachmana Syambas (School of Electrical Engineering and Informatics, Bandung Institute of Technology (ITB), Bandung 40132)



Article Info

Publish Date
01 Jun 2026

Abstract

Dense vehicular ad hoc networks face critical challenges in reliably delivering safety messages due to channel congestion, packet collisions, and interference. This study develops a dual-agent Q-learning framework for cross-layer IEEE 802.11bd optimization to improve latency and power efficiency while maintaining acceptable packet delivery ratios in dense traffic. We propose a decomposed architecture separating PHY-layer power control and MAC-layer beacon rate adaptation, with deterministic SINR-based MCS selection ensuring IEEE 802.11bd compliance. The framework is evaluated using a Python-based VANET simulator implementing the IEEE 802.11bd PHY/MAC stack with realistic SUMO mobility, multi-class background traffic, and omnidirectional/sectoral antennas across 20-90 vehicles/km densities. Results show dual-agent Q-learning reduces average latency by 44.6% (31.1ms to 17.2ms) and transmission power by 55% (15-20dBm to 9dBm) compared to static baselines, with acceptable 5-11% PDR reduction (94.2% to 88.6%). The approach converges within 8,500 episodes, significantly faster than single-agent Q-learning (12,500) and dual-agent DQN (14,000-35,000). This work introduces the first dual-agent tabular Q-learning for joint power-rate-MCS optimization in IEEE 802.11bd VANETs, demonstrating that agent decomposition reduces state-action complexity while enabling interpretable, fast-converging control suitable for sub-100ms vehicular applications.

Copyrights © 2026






Journal Info

Abbrev

ESJ

Publisher

Subject

Environmental Science

Description

Emerging Science Journal is not limited to a specific aspect of science and engineering but is instead devoted to a wide range of subfields in the engineering and sciences. While it encourages a broad spectrum of contribution in the engineering and sciences. Articles of interdisciplinary nature are ...