Claim Missing Document
Check
Articles

Found 1 Documents
Search
Journal : emerging science journal

Dual-Agent Q-Learning for Cross-Layer IEEE 802.11bd Optimization in Dense VANETs Galih Nugraha Nurkahfi; Suyoto; Agus Subekti; Budi Prawara; Ratna Mayasari; Andy Triwinarko; Nasrullah Armi; Eueung Mulyana; Nana Rachmana Syambas
Emerging Science Journal Vol. 10 No. 3 (2026): June
Publisher : Ital Publication

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.28991/ESJ-2026-010-03-019

Abstract

Dense vehicular ad hoc networks face critical challenges in reliably delivering safety messages due to channel congestion, packet collisions, and interference. This study develops a dual-agent Q-learning framework for cross-layer IEEE 802.11bd optimization to improve latency and power efficiency while maintaining acceptable packet delivery ratios in dense traffic. We propose a decomposed architecture separating PHY-layer power control and MAC-layer beacon rate adaptation, with deterministic SINR-based MCS selection ensuring IEEE 802.11bd compliance. The framework is evaluated using a Python-based VANET simulator implementing the IEEE 802.11bd PHY/MAC stack with realistic SUMO mobility, multi-class background traffic, and omnidirectional/sectoral antennas across 20-90 vehicles/km densities. Results show dual-agent Q-learning reduces average latency by 44.6% (31.1ms to 17.2ms) and transmission power by 55% (15-20dBm to 9dBm) compared to static baselines, with acceptable 5-11% PDR reduction (94.2% to 88.6%). The approach converges within 8,500 episodes, significantly faster than single-agent Q-learning (12,500) and dual-agent DQN (14,000-35,000). This work introduces the first dual-agent tabular Q-learning for joint power-rate-MCS optimization in IEEE 802.11bd VANETs, demonstrating that agent decomposition reduces state-action complexity while enabling interpretable, fast-converging control suitable for sub-100ms vehicular applications.
Co-Authors A. Ali Muayyadi Abba Ari, Ado Adamou Achmad Ali Muayyadi Adam Kusumah Firdaus Agus Subekti Agus Subekti Alfaqih, Muhammad Subhan Alghiffari, Muhammad Irfan Aloysius Adya Pramudita Alsha, Nando Irawan Amine Adoum, Bakhit Aminuddin Rizal Andri Fachrur Rozie Andria Arisal Andy Triwinarko Angga Wijaya Anto Satriyo Nugroho, Anto Satriyo Arie Setiawan Arief Suryadi Satyawan Arief Suryadi Satyawan Armanda, Ridho Arumjeni Mitayani Aryanti, Evy Aryanti Asih Setiarini Asmail, Asmail BAYU ANGGA, BAYU Budi Prawara Budi Prawara Budiman Putra Asmaur Rohman Chaeriah Bin Ali Wael Chaeriah Bin Ali Wael Chaeriah Bin Ali Wael, Chaeriah Bin Dayat Kurniawan Dayat Kurniawan Dharu Arseno DWI ARYANTA Estiningtyas, Aurellia Kartika Eueung Mulyana Fajri Darwis Ferianasari, Inneke Winda Fiky Yosef Suratman Galih Nugraha Nurkahfi Galih Nugraha Nurkahfi Ghifary, Hilmi Rifa Hamdani, Nizar Alam Hana Arisesa HELFY SUSLAWATI HENDRY CAHYO, HENDRY Hi Rauf, Siti Nuraini Isnanta, Rafif Tian Lestari, Wina Ayu Mardiana, Vita Awalia Marius Fidel, Faitchou Merlyn Inova Christie Latukolan Mochamad Mardi Martadinata Montolalu, Ivan Adrian Moungache, Amir Mourad Gueroui, Abdelhakh Muayyadi, Achmad Aly Muhamad Fauzan Muliadi, Jemie Nana Rachmana Syambas Nurkahfi, Galih Nugraha Omar Saeed Al Mushayt Pamungkas, Lukas Sangka Prasetyo Putranto Purwoko, Reza Yuridian Rahayaan, Manuela Ratna Indrawijaya Ratna Mayasari Rendra Dwi Firmansyah Rico Dahlan Rima Melati Ros Sariningrum Ruhdiat, Rudi Rusdianto Roestam Ruslan, Dimas Anugrah Salita Ulitia Prini Salita Ulitia Prini Samafou, Faustin Saputra, Silvan Satyawan, Arief Suryadi Sopyan Setiana Sudirja Sudirja Sulaksono Priyo Sulistyaningsih Sulistyaningsih Supriyadi, Muhamad Rodhi Suyoto Suyoto Suyoto Suyoto Suyoto Taufiqqurrachman Taufiqqurrachman Vita Awalia Mardiana Wajeb Gharibi Wan Sen, Tjong Wan Sen Wiko, Bimo Winy Desvasari Winy Desvasari Yulianto, Rivo Dwi