Automated Lane Change Decision Making using Deep Reinforcement Learning in Dynamic and Uncertain Highway Environment

Ali Alizadeh; Majid Moghadam; Yunus Bicer; Nazim Kemal Ure; Ugur Yavas; Can Kurtulus

doi:10.1109/ITSC.2019.8917192

Automated Lane Change Decision Making using Deep Reinforcement Learning in Dynamic and Uncertain Highway Environment

Ali Alizadeh, Majid Moghadam, Yunus Bicer, Nazim Kemal Ure, Ugur Yavas, Can Kurtulus

Department of Artificial Intelligence and Data Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

98 Citations (Scopus)

Abstract

Autonomous lane changing is a critical feature for advanced autonomous driving systems, that involves several challenges such as uncertainty in other driver's behaviors and the trade-off between safety and agility. In this work, we develop a novel simulation environment that emulates these challenges and train a deep reinforcement learning agent that yields consistent performance in a variety of dynamic and uncertain traffic scenarios. Results show that the proposed data-driven approach performs significantly better in noisy environments compared to methods that rely solely on heuristics.

Original language	English
Title of host publication	2019 IEEE Intelligent Transportation Systems Conference, ITSC 2019
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	1399-1404
Number of pages	6
ISBN (Electronic)	9781538670248
DOIs	https://doi.org/10.1109/ITSC.2019.8917192
Publication status	Published - Oct 2019
Event	2019 IEEE Intelligent Transportation Systems Conference, ITSC 2019 - Auckland, New Zealand Duration: 27 Oct 2019 → 30 Oct 2019

Publication series

Name	2019 IEEE Intelligent Transportation Systems Conference, ITSC 2019

Conference

Conference	2019 IEEE Intelligent Transportation Systems Conference, ITSC 2019
Country/Territory	New Zealand
City	Auckland
Period	27/10/19 → 30/10/19

Bibliographical note

Publisher Copyright:
© 2019 IEEE.

Access to Document

10.1109/ITSC.2019.8917192

Cite this

Alizadeh, A., Moghadam, M., Bicer, Y., Ure, N. K., Yavas, U., & Kurtulus, C. (2019). Automated Lane Change Decision Making using Deep Reinforcement Learning in Dynamic and Uncertain Highway Environment. In 2019 IEEE Intelligent Transportation Systems Conference, ITSC 2019 (pp. 1399-1404). Article 8917192 (2019 IEEE Intelligent Transportation Systems Conference, ITSC 2019). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ITSC.2019.8917192

Alizadeh, Ali ; Moghadam, Majid ; Bicer, Yunus et al. / Automated Lane Change Decision Making using Deep Reinforcement Learning in Dynamic and Uncertain Highway Environment. 2019 IEEE Intelligent Transportation Systems Conference, ITSC 2019. Institute of Electrical and Electronics Engineers Inc., 2019. pp. 1399-1404 (2019 IEEE Intelligent Transportation Systems Conference, ITSC 2019).

@inproceedings{1e08acaeec094717aaa16a5e17735136,

title = "Automated Lane Change Decision Making using Deep Reinforcement Learning in Dynamic and Uncertain Highway Environment",

abstract = "Autonomous lane changing is a critical feature for advanced autonomous driving systems, that involves several challenges such as uncertainty in other driver's behaviors and the trade-off between safety and agility. In this work, we develop a novel simulation environment that emulates these challenges and train a deep reinforcement learning agent that yields consistent performance in a variety of dynamic and uncertain traffic scenarios. Results show that the proposed data-driven approach performs significantly better in noisy environments compared to methods that rely solely on heuristics.",

author = "Ali Alizadeh and Majid Moghadam and Yunus Bicer and Ure, {Nazim Kemal} and Ugur Yavas and Can Kurtulus",

note = "Publisher Copyright: {\textcopyright} 2019 IEEE.; 2019 IEEE Intelligent Transportation Systems Conference, ITSC 2019 ; Conference date: 27-10-2019 Through 30-10-2019",

year = "2019",

month = oct,

doi = "10.1109/ITSC.2019.8917192",

language = "English",

series = "2019 IEEE Intelligent Transportation Systems Conference, ITSC 2019",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "1399--1404",

booktitle = "2019 IEEE Intelligent Transportation Systems Conference, ITSC 2019",

address = "United States",

}

Alizadeh, A, Moghadam, M, Bicer, Y, Ure, NK, Yavas, U & Kurtulus, C 2019, Automated Lane Change Decision Making using Deep Reinforcement Learning in Dynamic and Uncertain Highway Environment. in 2019 IEEE Intelligent Transportation Systems Conference, ITSC 2019., 8917192, 2019 IEEE Intelligent Transportation Systems Conference, ITSC 2019, Institute of Electrical and Electronics Engineers Inc., pp. 1399-1404, 2019 IEEE Intelligent Transportation Systems Conference, ITSC 2019, Auckland, New Zealand, 27/10/19. https://doi.org/10.1109/ITSC.2019.8917192

Automated Lane Change Decision Making using Deep Reinforcement Learning in Dynamic and Uncertain Highway Environment. / Alizadeh, Ali; Moghadam, Majid; Bicer, Yunus et al.
2019 IEEE Intelligent Transportation Systems Conference, ITSC 2019. Institute of Electrical and Electronics Engineers Inc., 2019. p. 1399-1404 8917192 (2019 IEEE Intelligent Transportation Systems Conference, ITSC 2019).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Automated Lane Change Decision Making using Deep Reinforcement Learning in Dynamic and Uncertain Highway Environment

AU - Alizadeh, Ali

AU - Moghadam, Majid

AU - Bicer, Yunus

AU - Ure, Nazim Kemal

AU - Yavas, Ugur

AU - Kurtulus, Can

PY - 2019/10

Y1 - 2019/10

N2 - Autonomous lane changing is a critical feature for advanced autonomous driving systems, that involves several challenges such as uncertainty in other driver's behaviors and the trade-off between safety and agility. In this work, we develop a novel simulation environment that emulates these challenges and train a deep reinforcement learning agent that yields consistent performance in a variety of dynamic and uncertain traffic scenarios. Results show that the proposed data-driven approach performs significantly better in noisy environments compared to methods that rely solely on heuristics.

AB - Autonomous lane changing is a critical feature for advanced autonomous driving systems, that involves several challenges such as uncertainty in other driver's behaviors and the trade-off between safety and agility. In this work, we develop a novel simulation environment that emulates these challenges and train a deep reinforcement learning agent that yields consistent performance in a variety of dynamic and uncertain traffic scenarios. Results show that the proposed data-driven approach performs significantly better in noisy environments compared to methods that rely solely on heuristics.

UR - http://www.scopus.com/inward/record.url?scp=85076813552&partnerID=8YFLogxK

U2 - 10.1109/ITSC.2019.8917192

DO - 10.1109/ITSC.2019.8917192

M3 - Conference contribution

AN - SCOPUS:85076813552

T3 - 2019 IEEE Intelligent Transportation Systems Conference, ITSC 2019

SP - 1399

EP - 1404

BT - 2019 IEEE Intelligent Transportation Systems Conference, ITSC 2019

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 2019 IEEE Intelligent Transportation Systems Conference, ITSC 2019

Y2 - 27 October 2019 through 30 October 2019

ER -

Alizadeh A, Moghadam M, Bicer Y, Ure NK, Yavas U, Kurtulus C. Automated Lane Change Decision Making using Deep Reinforcement Learning in Dynamic and Uncertain Highway Environment. In 2019 IEEE Intelligent Transportation Systems Conference, ITSC 2019. Institute of Electrical and Electronics Engineers Inc. 2019. p. 1399-1404. 8917192. (2019 IEEE Intelligent Transportation Systems Conference, ITSC 2019). doi: 10.1109/ITSC.2019.8917192

Automated Lane Change Decision Making using Deep Reinforcement Learning in Dynamic and Uncertain Highway Environment

Abstract

Publication series

Conference

Bibliographical note

Access to Document

Other files and links

Fingerprint

Cite this