지원사업
학술연구/단체지원/교육 등 연구자 활동을 지속하도록 DBpia가 지원하고 있어요.
커뮤니티
연구자들이 자신의 연구와 전문성을 널리 알리고, 새로운 협력의 기회를 만들 수 있는 네트워킹 공간이에요.
논문 기본 정보
- 자료유형
- 학위논문
- 저자정보
- 지도교수
- 박성용
- 발행연도
- 2023
- 저작권
- 서강대학교 논문은 저작권에 의해 보호받습니다.
이용수0
이 논문의 연구 히스토리 (2)
- 이 논문의 후속연구가 궁금하신가요?
- 연관 학술논문 또는 학술발표를 통해 보다 발전된 연구결과를 확인하실 수 있습니다.
- 이 논문의 연구 히스토리 확인하기
초록· 키워드
오류제보하기
One of the major challenges in distributed deep learning is to attenuate straggler problem. The straggler increases synchronization delay and significantly inhibits the convergence of deep learning model. We have empirically observed that the imbalanced data samples worsens the straggler problem and makes the convergence of deep learning model slower. However, existing approaches such as BOA and EP4DDL have not addressed data imbalance issue while solving the straggler problem. To overcome straggler and data imbal-
ance problems, we propose Chronica, a new data-imbalance-aware scheduler. Based on the size of data and configuration of each worker, Chronica elaborately predicts the required training time for each worker. Chronica then provides equivalent training time to each of workers by alleviating both mini-batch-level and epoch-level straggler problems. Furthermore, in order to achieve fast convergence, Chronica suggests a new parameter synchronization scheme based on the weighted average of training load on each worker.
Our extensive evaluation using four deep learning models over eight Amazon EC2 GPU instances showed that Chronica achieves up to 2.55× speedup against BOA and EP4DDL.
ance problems, we propose Chronica, a new data-imbalance-aware scheduler. Based on the size of data and configuration of each worker, Chronica elaborately predicts the required training time for each worker. Chronica then provides equivalent training time to each of workers by alleviating both mini-batch-level and epoch-level straggler problems. Furthermore, in order to achieve fast convergence, Chronica suggests a new parameter synchronization scheme based on the weighted average of training load on each worker.
Our extensive evaluation using four deep learning models over eight Amazon EC2 GPU instances showed that Chronica achieves up to 2.55× speedup against BOA and EP4DDL.
목차
등록된 정보가 없습니다.
최근 본 자료
댓글(0)
0