Hierarchical Deep Reinforcement Learning Approach for Multi-Objective Scheduling with Varying Queue Sizes

Yoni Birman, Ziv Ido, Gilad Katz, Asaf Shabtai

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

25 Downloads (Pure)

Abstract

Multi-objective task scheduling (MOTS) combines the task of scheduling with the need to optimize multiple-and possibly contradicting-constraints. A challenging extension of this problem occurs when every individual task is a multiobjective optimization problem by itself. While deep reinforcement learning (DRL) has been successfully applied to complex sequential problems, its application to the MOTS domain has been stymied by two challenges. The first challenge is the inability of the DRL algorithm to ensure that every item is processed identically regardless of its position in the queue. The second challenge is the need to manage large queues, which results in large neural architectures and long training times. In this study we present MERLIN, a robust, modular and near-optimal DRL-based approach for multi-objective task scheduling. Our approach addresses both aforementioned challenges while also being more efficient and easier to train. Extensive evaluation on multiple queue sizes show that MERLIN outperforms multiple well-known scheduling algorithms by a large margin (≥ 22%).

Original languageEnglish
Title of host publicationIJCNN 2021 - International Joint Conference on Neural Networks, Proceedings
PublisherInstitute of Electrical and Electronics Engineers
Pages1-10
ISBN (Electronic)9780738133669
DOIs
StatePublished - 21 Sep 2021
Event2021 International Joint Conference on Neural Networks, IJCNN 2021 - Virtual, Shenzhen, China
Duration: 18 Jul 202122 Jul 2021

Publication series

NameProceedings of the International Joint Conference on Neural Networks
Volume2021-July

Conference

Conference2021 International Joint Conference on Neural Networks, IJCNN 2021
Country/TerritoryChina
CityVirtual, Shenzhen
Period18/07/2122/07/21

Keywords

  • Computer Science - Machine Learning
  • Computer Science - Cryptography and Security
  • Statistics - Machine Learning

ASJC Scopus subject areas

  • Software
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'Hierarchical Deep Reinforcement Learning Approach for Multi-Objective Scheduling with Varying Queue Sizes'. Together they form a unique fingerprint.

Cite this