Volume 12, Issue 4 (12-2020)                   2020, 12(4): 10-25 | Back to browse issues page

XML Print

A Novel Protocol for Routing in Vehicular Ad hoc Network Based on Model-Based Reinforcement Learning and Fuzzy Logic
Omid Jafarzadeh1 , Hadi Sargolzaey1 , Mehdi Dehghan 2, Mohammad Mehdi Esnaashari3
1- Department of Electrical, Computer and IT Engineering Qazvin Branch, Islamic Azad University Qazvin, Iran
2- Department of Electrical, Computer and IT Engineering Qazvin Branch, Islamic Azad University Qazvin, Iran , dehghan@aut.ac.ir
3- Mohammad Mehdi Esnaashari
Abstract:   (1634 Views)
Vehicular ad-hoc networks (VANETs), as a result of today's vehicles equipped with different wireless technology, have been attracting interest for their potential roles in many fields such as emergency, safety, and intelligent transport system. However, the development of a reliable routing protocol to route data packets between vehicles is still a challenging task due to the high mobility, lack of fixed infrastructure, and obstacles. One technique to tackle this challenge is using machine learning. In this paper, we have proposed a protocol applying  multi-agent reinforcement learning (MARL) as a technique that enables groups of reinforcement learning agents to solve system optimization problems online in dynamic, decentralized networks. Our protocol is based on a model-based reinforcement learning method which has a higher convergence speed compared to the model-free one. To form the needed model for MARL, we have developed a Fuzzy Logic (FL) system that evaluates the quality of links between neighbor nodes based on parameters such as velocity and connection quality. The performance of the proposed protocol is studied by extensive simulation with respect to various metrics such as delivery ratio, delay, and overhead. The results obtained show significant improvement of VANETs performance in terms of these metrics.
 
Keywords: VANET, Routing, Reinforcement Learning, Fuzzy Logic
Full-Text [PDF 908 kb]   (761 Downloads)    
Type of Study: Research | Subject: Communication Technology
Rights and permissions
Creative Commons License This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.