TY - GEN
T1 - Auctioning Cluster Resources
AU - Alon, Lee Or
AU - Ben-Yehuda, Orna Agmon
AU - Oren, Sigal
N1 - Publisher Copyright:
© 2022 Owner/Author.
PY - 2022/6/27
Y1 - 2022/6/27
N2 - Organizational clusters are often shared among users who compete over resources, but the organization's goal is to increase the overall utility produced by the cluster. That is, to increase the aggregate benefit drawn from the cluster. To overcome this problem, we enhanced SLURM with an auctioning system. We evaluated our work on several real cluster traces. Our auctioning scheduler increases the responsiveness to highly valued jobs. It reduces the weight of the queued jobs (the sum of multiplication of jobs by their wait time by their number of required nodes and by their bid) by 3X - 33X compared with backfilling.
AB - Organizational clusters are often shared among users who compete over resources, but the organization's goal is to increase the overall utility produced by the cluster. That is, to increase the aggregate benefit drawn from the cluster. To overcome this problem, we enhanced SLURM with an auctioning system. We evaluated our work on several real cluster traces. Our auctioning scheduler increases the responsiveness to highly valued jobs. It reduces the weight of the queued jobs (the sum of multiplication of jobs by their wait time by their number of required nodes and by their bid) by 3X - 33X compared with backfilling.
KW - auction
KW - cluster resources
KW - slurm
UR - http://www.scopus.com/inward/record.url?scp=85134169772&partnerID=8YFLogxK
U2 - 10.1145/3502181.3533713
DO - 10.1145/3502181.3533713
M3 - Conference contribution
AN - SCOPUS:85134169772
T3 - HPDC 2022 - Proceedings of the 31st International Symposium on High-Performance Parallel and Distributed Computing
SP - 285
EP - 286
BT - HPDC 2022 - Proceedings of the 31st International Symposium on High-Performance Parallel and Distributed Computing
PB - Association for Computing Machinery, Inc
T2 - 31st International Symposium on High-Performance Parallel and Distributed Computing, HPDC 2022
Y2 - 27 June 2022 through 30 June 2022
ER -