SOAR: Minimizing Network Utilization Cost With Bounded In-Network Computing

Research output: Contribution to journalArticlepeer-review

Abstract

In-network computing via smart networking devices is a recent trend in modern datacenter networks. State-of-the-art switches with near line-rate computing and aggregation capabilities enable acceleration and improved resource utilization for modern applications like large-scale distributed and federated machine learning, as well as big data analytics. We study the problem of activating a limited number of in-network computing devices within a network, aiming at reducing the overall cost incurred by such a deployment. Such limitations on the number of in-network computing elements arise, e.g., in incremental upgrades of network infrastructure, and are also due to requiring specialized middleboxes, or FPGAs, for supporting heterogeneous workloads, and multiple tenants. We present an efficient optimal algorithm for placing such devices in tree networks with arbitrary link rates, and further evaluate its performance in various scenarios and for various tasks, including federated/distributed ML and big data analytics. Our results show that even a small fraction of network devices supporting in-network aggregation leads to a significant reduction in network utilization cost. Furthermore, we show that various intuitive strategies for performing such placements are significantly inferior compared with our solution, for varying workloads, tasks, and link rates.

Original languageEnglish
Pages (from-to)1
Number of pages1
JournalIEEE Transactions on Network and Service Management
DOIs
StateAccepted/In press - 1 Jan 2023

Keywords

  • Big Data Analytics
  • Computational modeling
  • Costs
  • Data Center Networks
  • Data models
  • Distributed Machine Learning
  • Federated learning
  • Federated Machine Learning
  • In-network Computing
  • Minimum Network Utilization Cost
  • Performance evaluation
  • Servers
  • Task analysis

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'SOAR: Minimizing Network Utilization Cost With Bounded In-Network Computing'. Together they form a unique fingerprint.

Cite this