Multiagent Autonomous Learning for Distributed Channel Allocation in Wireless Networks

Syed Mohammad Zafaruddin, Ilai Bistritz, Amir Leshem, Dusit Niyato

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

4 Scopus citations

Abstract

In distributed networks such as ad-hoc and device-to-device (D2D) networks, no base station exists and conveying global channel state information (CSI) between users is costly or simply impractical. When the CSI is time-varying and unknown to the users, the users face the challenge of both learning the channel statistics online and converging to good channel allocation. This introduces a multi-armed bandit (MAB) scenario with multiple decision makers. If two or more users choose the same channel, a collision occurs and they all receive zero reward. We propose a distributed channel allocation algorithm in which each user converges to the optimal allocation while achieving an order optimal regret of O (log T), where T denotes the length of time horizon. The algorithm is based on a carrier sensing multiple access (CSMA) implementation of the distributed auction algorithm. It does not require any exchange of information between users. Users need only to observe a single channel at a time and sense if there is a transmission on that channel, without decoding the transmissions or identifying the transmitting users. We compare the performance of the proposed algorithm with the state-of-the-art scheme using simulations of realistic long term evolution (LTE) channels.

Original languageAmerican English
Title of host publication2019 IEEE 20th International Workshop on Signal Processing Advances in Wireless Communications, SPAWC 2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781538665282
DOIs
StatePublished - Jul 2019
Externally publishedYes
Event20th IEEE International Workshop on Signal Processing Advances in Wireless Communications, SPAWC 2019 - Cannes, France
Duration: 2 Jul 20195 Jul 2019

Publication series

NameIEEE Workshop on Signal Processing Advances in Wireless Communications, SPAWC
Volume2019-July

Conference

Conference20th IEEE International Workshop on Signal Processing Advances in Wireless Communications, SPAWC 2019
Country/TerritoryFrance
CityCannes
Period2/07/195/07/19

Bibliographical note

Publisher Copyright:
© 2019 IEEE.

Keywords

  • Distributed channel allocation
  • dynamic spectrum access
  • multiplayer multi-armed bandit
  • online learning
  • resource management
  • wireless networks

Fingerprint

Dive into the research topics of 'Multiagent Autonomous Learning for Distributed Channel Allocation in Wireless Networks'. Together they form a unique fingerprint.

Cite this