Continuous Control of Autonomous Vehicles using Plan-assisted Deep Reinforcement Learning

Tanay Dwivedi; Tobias Betz; Florian Sauerbeck; PV Manivannan; Markus Lienkamp

추천

검색

질문

자료유형: 학술대회자료

저자정보: Tanay Dwivedi (Indian Institute of Technology Madras) Tobias Betz (Technical University of Munich) Florian Sauerbeck (Technical University of Munich) PV Manivannan (Indian Institute of Technology Madras) Markus Lienkamp (Technical University of Munich)

저널정보: 제어로봇시스템학회 제어로봇시스템학회 국제학술대회 논문집 ICCAS 2022

발행연도: 2022.11

수록면: 244 - 250 (7page)

이용수

📌

연구주제

📖

연구배경

🔬

연구방법

🏆

연구결과

초록· 키워드

오류제보하기

End-to-end deep reinforcement learning (DRL) is emerging as a promising paradigm for autonomous driving. Although DRL provides an elegant framework to accomplish final goals without extensive manual engineering, capturing plans and behavior using deep neural networks is still an unsolved issue. End-to-end architectures, as a result, are currently limited to simple driving scenarios, often performing sub-optimally when rare, unique conditions are encountered. We propose a novel plan-assisted deep reinforcement learning framework that, along with the typical state-space, leverages a “trajectory-space” to learn optimal control. While the trajectory-space, generated by an external planner, intrinsically captures the agent’s high-level plans, world models are used to understand the dynamics of the environment for learning behavior in latent space. An actor-critic network, trained in imagination, uses these latent features to predict policy and state-value function. Based primarily on DreamerV2 and Racing Dreamer, the proposed model is first trained in a simulator and eventually tested on the F1TENTH race car. We evaluate our model for best lap times against parametertuned and learning-based controllers on unseen race tracks and demonstrate that it generalizes to complex scenarios where other approaches perform sub-optimally. Furthermore, we show the model’s enhanced stability as a trajectory tracker and establish the improvement in interpretability achieved by the proposed framework.

#Autonomous driving #intelligent vehicles #world models #deep reinforcement learning #artificial intelligence

참고문헌 (0)

참고문헌 신청

참고문헌이 DBpia에서 서비스 중이라면, [참고문헌 신청]을 통해 등록해보세요

함께 읽어보면 좋을 논문

논문 유사도에 따라 DBpia 가 추천하는 논문입니다. 함께 보면 좋을 연관 논문을 확인해보세요!