A reinforcement learning approach to smart lane changes of self-driving carsA reinforcement learning approach to smart lane changes of self-driving cars Κεφάλαιο σε Βιβλίο Book Chapter 2020-11-022019enLane changes are a vital part of vehicle motions on roads, affecting surrounding vehicles locally and traffic flow collectively. In the context of connected and automated vehicles (CAVs), this paper is concerned with the impacts of smart lane changes of CAVs on their own travel performance as well as on the entire traffic flow with the increase of the market penetration rate (MPR). On the basis of intensive microscopic traffic simulation and reinforcement learning technique, a selfish lane-changing strategy was first developed in this work to enable foresighted lane changing decisions for CAVs to improve their travel efficiency. The overall impacts of such smart lane changes on traffic flow of both CAVs and human-driven vehicles were then examined on the same simulation platform. It was found that smart lane changes were beneficial for both CAVs and the entire traffic flow, if MPR was not more than 60%.http://creativecommons.org/licenses/by/4.0/Lecture Notes in Computer ScienceProgress in Artificial Intelligence. EPIA 2019 Ye Fangmin Wang Long Wang Yibing Guo Jingqiu Papamichail Ioannis Παπαμιχαηλ Ιωαννης Papageorgiou Markos Παπαγεωργιου Μαρκος Springer Nature Connected and automated vehicles Microscopic simulation Q-learning Smart lane changes Traffic flow impacts