지원사업
학술연구/단체지원/교육 등 연구자 활동을 지속하도록 DBpia가 지원하고 있어요.
커뮤니티
연구자들이 자신의 연구와 전문성을 널리 알리고, 새로운 협력의 기회를 만들 수 있는 네트워킹 공간이에요.
논문 기본 정보
- 자료유형
- 학술저널
- 저자정보
- 저널정보
- 대한전자공학회 IEIE Transactions on Smart Processing & Computing IEIE Transactions on Smart Processing & Computing Vol.11 No.3
- 발행연도
- 2022.6
- 수록면
- 183 - 198 (16page)
- DOI
- 10.5573/IEIESPC.2022.11.3.183
이용수
초록· 키워드
오류제보하기
This paper explores a reinforcement learning (with Q-learning as the algorithm) for vehicle routing in a city-wide road network with a large customer (a generic name used for each of the locations (to denote a person possibly associated with this location) through which the vehicle needs to be routed) counts. Most reported research on vehicle routing had mainly focused on calculating the shortest route (while neglecting the shortest path between certain customer(s) and certain/all other customer(s)) between the customers. Hence, we proposed a dual-stage, Q-learning based, shortest-route generation (DQSR) in a road network, considering the shortest path between each customer and certain other customers. Notably, the first stage’s Q-learning agent develops the meta-graph of the shortest path between each customer and this customer’s nearest neighbor customers (chosen differently in number), instead of each other customer, and finds this path’s length. This development is motivated by the fact that any two adjacent customers in the shortest route are located closer than far apart, reducing the time complexity of the first stage’s Q-learning. Subsequently, the second stage’s Q-learning agent finds the shortest route from any customer to other customers from the meta-graph, connecting each other customer only once and returning to the starting customer. Hence, the DQSR generates the shortest route in a relatively shorter duration due to the small size of the state-action pairs in the meta-graph. Further, we conducted a case study on the DQSR-based, illegal-parking surveillance in Yeonsu-gu, Incheon, South Korea, to check the DQSR’s effectiveness. The case study demonstrates that the DQSR is more efficient than two other algorithms used for the same purpose in the case study, in terms of time complexity and shortest-route generation.
목차
Abstract
1. Introduction
2. Related Work
3. Methodology
4. Experiments
5. Conclusions
References
참고문헌 (46)
참고문헌 신청
Nazari, M.; Oroojlooy, A.; Takáč, M.; Snyder, L. V. Reinforcement Learning for Solving the Vehicle Routing Problem. In Proceedings of the 32nd International Conference on Neural Information Processing Systems (NIPS'18), Curran Associates Inc., Red Hook, NY, USA 2018, 9861-9871. Article (CrossRef Link)
Singh, A. K.; Pamula, R. An Efficient and Intelligent Routing Strategy for Vehicular Delay Tolerant Networks. Wireless Network 2021, 27, 383-400. Article (CrossRef Link)1
Geetha, M. and Ganesan, R. CEPRAN-Cooperative Energy Efficient and Priority Based Reliable Routing Protocol with Network Coding for WBAN. Wireless Pers Commun 2021, 117, 3153-3171. Article (CrossRef Link)
Liu, D.; Cui, J.; Zhang, J.; Yang, C.; Hanzo, L. Deep Reinforcement Learning Aided Packet-Routing for Aeronautical Ad-Hoc Networks Formed by Passenger Planes. IEEE Transactions on Vehicular Technology 2021, 70 (5), 5166-5171. doi: 10.1109/TVT.2021.3074015. Article (CrossRef Link)
Yao, H.; Mai, T.; Jiang, C.; Kuang, L.; Guo, S. AI Routers & Network Mind: A Hybrid Machine Learning Paradigm for Packet Routing. IEEE Computational Intelligence Magazine 2019, 14 (4), 21-30. doi: 10.1109/MCI.2019.2937609. Article (CrossRef Link)
Singh, A. K.; Pamula, R. An Efficient and Intelligent Routing Strategy for Vehicular Delay Tolerant Networks. Wireless Network 2021, 27, 383-400. Article (CrossRef Link)1
Geetha, M. and Ganesan, R. CEPRAN-Cooperative Energy Efficient and Priority Based Reliable Routing Protocol with Network Coding for WBAN. Wireless Pers Commun 2021, 117, 3153-3171. Article (CrossRef Link)
Liu, D.; Cui, J.; Zhang, J.; Yang, C.; Hanzo, L. Deep Reinforcement Learning Aided Packet-Routing for Aeronautical Ad-Hoc Networks Formed by Passenger Planes. IEEE Transactions on Vehicular Technology 2021, 70 (5), 5166-5171. doi: 10.1109/TVT.2021.3074015. Article (CrossRef Link)
Yao, H.; Mai, T.; Jiang, C.; Kuang, L.; Guo, S. AI Routers & Network Mind: A Hybrid Machine Learning Paradigm for Packet Routing. IEEE Computational Intelligence Magazine 2019, 14 (4), 21-30. doi: 10.1109/MCI.2019.2937609. Article (CrossRef Link)
함께 읽어보면 좋을 논문
논문 유사도에 따라 DBpia 가 추천하는 논문입니다. 함께 보면 좋을 연관 논문을 확인해보세요!
-
방향성이 있는 동적인 도로에서 실시간 최단 경로 탐색 시스템의 설계와 구현
멀티미디어학회논문지
2017 .04
-
Design and Performance Evaluation of Hexagonal Topology Networks with Novel Routing Algorithms
한국통신학회 APNOMS
2020 .09
-
Finding shortest path to non-stop intersection for future transportation
한국정보과학회 학술발표논문집
2015 .12
-
주문생산시스템에서 고객가치평가에 기반 한 고객계층화 모형
한국 SCM 학회지
2019 .10
-
Energy Optimal Transmission Strategy Based on a Shortest Path Algorithm
제어로봇시스템학회 국내학술대회 논문집
2015 .05
-
화재 시 최단 경로 탐색을 위한 A*알고리즘 기반 대피로 안내 시스템
한국정보통신학회 종합학술대회 논문집
2021 .05
-
A* 알고리즘 기반 모바일로봇 경로제어
제어로봇시스템학회 국내학술대회 논문집
2020 .07
-
Finding shortest path considering lane changing and turn restriction
한국정보과학회 학술발표논문집
2016 .06
-
Examining the Effect of Marketing Mix Elements on Customer Satisfaction with Mediating Role of Electronic Customer Relationship Management
Industrial Engineering & Management Systems
2018 .12
-
An improved approximation scheme for the stochastic shortest path problem
대한산업공학회 추계학술대회 논문집
2021 .11
-
Design and Implementation of Routing System Using Artificial Neural Network
한국컴퓨터정보학회논문지
2017 .12
-
실시간 IoT 데이터를 활용한 고객 관계 관리 방안에 관한 연구
산업경영시스템학회지
2019 .01
-
An Application of Pareto Solution with Adapted ACO for Searching Optimal Route of a Mobile Robot in Rough Terrain Environment
제어로봇시스템학회 국제학술대회 논문집
2016 .10
-
[UN-2] Power-efficient Q-routing for Wireless Sensor Networks
INTERNATIONAL CONFERENCE ON FUTURE INFORMATION & COMMUNICATION ENGINEERING
2024 .01
-
A Study on the Survey System for Customer Feedbacks of the Service Industry
INTERNATIONAL CONFERENCE ON FUTURE INFORMATION & COMMUNICATION ENGINEERING
2015 .06
-
Finding efficient paths for multi-robot path coverage
제어로봇시스템학회 국제학술대회 논문집
2017 .10
-
Shortest Distance Algorithm Based Path Detection System in case of Flash Flood
INTERNATIONAL CONFERENCE ON FUTURE INFORMATION & COMMUNICATION ENGINEERING
2022 .01
-
온라인 고객 리뷰에 대한 텍스트마이닝을 활용한 고객가치제안 방법
산업경영시스템학회지
2021 .12
-
선형 독립적이고 자원 제약이 있는 k번째 최소 경로 문제
대한산업공학회 추계학술대회 논문집
2020 .11
이 논문의 저자 정보
이 논문과 함께 이용한 논문
최근 본 자료
댓글(0)
0