article · SHILAP Revista de lepidopterología · 2025

Design and implementation of a multi-cluster GPU computing resource scheduling platform based on network and computing state awareness

HU Yahui, ZHANG Chenkang, WANG Yuelin, HONG Yuchen, FAN Pengfei, SONG Junping, ZHOU Xu

Cited by 0Open access

Abstract

To address issues like coarse-grained resource allocation, lack of a unified vGPU view, and insufficient cross-cluster network awareness in multi-cluster GPU scheduling for large-scale deep learning tasks, a computing-network state-aware multi-cluster GPU scheduling platform was designed. Adopting a centralized architecture, fine-grained global resource orchestration was achieved through real-time perception and collaborative scheduling of cross-cluster computing resources and network states. Firstly, a multi-dimensional metric system covering device, cluster, vGPU, and network layers was built to collect real-time key data such as core utilization, memory, and bandwidth. Then a node-level vGPU orchestration module was designed, breaking the "job-to-cluster" limitation to realize precise "job-to-node" scheduling and improve GPU sharing efficiency. Experiments show that the platform enables real-time collection and visualization of multi-cluster vGPU and network information, and exhibits efficient resource management capabilities verified by DDPG reinforcement learning and the BestFit algorithm.

Cite this paper

APA 7

Yahui, H., Chenkang, Z., Yuelin, W., Yuchen, H., Pengfei, F., Junping, S., & Xu, Z. (2025). Design and implementation of a multi-cluster GPU computing resource scheduling platform based on network and computing state awareness. SHILAP Revista de lepidopterología.

MLA 9

Yahui, HU, et al. “Design and implementation of a multi-cluster GPU computing resource scheduling platform based on network and computing state awareness.” SHILAP Revista de lepidopterología, 2025.

Chicago

Yahui, HU, ZHANG Chenkang, WANG Yuelin, HONG Yuchen, FAN Pengfei, SONG Junping, and ZHOU Xu. 2025. “Design and implementation of a multi-cluster GPU computing resource scheduling platform based on network and computing state awareness.” SHILAP Revista de lepidopterología.

Harvard

Yahui, H. et al. (2025) ‘Design and implementation of a multi-cluster GPU computing resource scheduling platform based on network and computing state awareness’, SHILAP Revista de lepidopterología.

BibTeX

@article{yahui2025design,
  title = {{Design and implementation of a multi-cluster GPU computing resource scheduling platform based on network and computing state awareness}},
  author = {Yahui, HU and Chenkang, ZHANG and Yuelin, WANG and Yuchen, HONG and Pengfei, FAN and Junping, SONG and Xu, ZHOU},
  journal = {SHILAP Revista de lepidopterología},
  year = {2025}
}

Made from the index record. Check names, capitalisation and page numbers against the paper. Need another style? AI for Research has over 10,000.