In distributed networks such as ad-hoc and device-to-device (D2D) networks, no base station exists and conveying global channel state information (CSI) between users is costly or simply impractical. When the CSI is time-varying and unknown to the users, the users face the challenge of both learning the channel statistics online and converging to good channel allocation. This introduces a multi-armed bandit (MAB) scenario with multiple decision makers. If two or more users choose the same channel, a collision occurs and they all receive zero reward. We propose a distributed channel allocation algorithm in which each user converges to the optimal allocation while achieving an order optimal regret of O (log T), where T denotes the length of time horizon. The algorithm is based on a carrier sensing multiple access (CSMA) implementation of the distributed auction algorithm. It does not require any exchange of information between users. Users need only to observe a single channel at a time and sense if there is a transmission on that channel, without decoding the transmissions or identifying the transmitting users. We compare the performance of the proposed algorithm with the state-of-the-art scheme using simulations of realistic long term evolution (LTE) channels.
|Original language||American English|
|Title of host publication||2019 IEEE 20th International Workshop on Signal Processing Advances in Wireless Communications, SPAWC 2019|
|Publisher||Institute of Electrical and Electronics Engineers Inc.|
|State||Published - Jul 2019|
|Event||20th IEEE International Workshop on Signal Processing Advances in Wireless Communications, SPAWC 2019 - Cannes, France|
Duration: 2 Jul 2019 → 5 Jul 2019
|Name||IEEE Workshop on Signal Processing Advances in Wireless Communications, SPAWC|
|Conference||20th IEEE International Workshop on Signal Processing Advances in Wireless Communications, SPAWC 2019|
|Period||2/07/19 → 5/07/19|
Bibliographical noteFunding Information:
ACKNOWLEDGMENT This research was supported by the ISF-NRF Joint research Program, under grant ISF 2277/16 and by ISF 1644/18. This work was supported in part by Singapore NRF2015-NRF-ISF001-2277. S. M. Zafaruddin was partially funded by the Israeli Planning and Budget Committee (PBC) post-doctoral fellowship (2016-2018).
© 2019 IEEE.
- Distributed channel allocation
- dynamic spectrum access
- multiplayer multi-armed bandit
- online learning
- resource management
- wireless networks