Q-Max: A unified scheme for improving network measurement throughput

Ran Ben Basat, Gil Einziger, Junzhi Gong, Jalil Moraney, Danny Raz

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

6 Scopus citations


Network measurement is an essential building block for a variety of network applications such as traffic engineering, quality of service, load-balancing and intrusion detection. Maintaining a per-flow state is often impractical due to the large number of flows, and thus modern systems use complex data structures that are updated with each incoming packet. Therefore, designing measurement applications that operate at line speed is a significant challenge in this domain. In this work, we address this challenge by providing a unified mechanism that improves the update time of a variety of network algorithms. We do so by identifying, studying, and optimizing a common algorithmic pattern that we call q-MAX. The goal is to maintain the largest q values in a stream of packets. We formally analyze the problem and introduce interval and sliding window algorithms that have a worst-case constant update time. We show that our algorithms perform up to ×20 faster than library algorithms, and using these new algorithms for several popular measurement applications yields a throughput improvement of up to ×12 on real network traces. Finally, we implemented the scheme within Open vSwitch, a state of the art virtual switch. We show that q-MAX based monitoring runs in line speed while current monitoring techniques are significantly slower.

Original languageEnglish
Title of host publicationIMC 2019 - Proceedings of the 2019 ACM Internet Measurement Conference
PublisherAssociation for Computing Machinery
Number of pages15
ISBN (Electronic)9781450369480
StatePublished - 21 Oct 2019
Event19th ACM Internet Measurement Conference, IMC 2019 - Amsterdam, Netherlands
Duration: 21 Oct 201923 Oct 2019

Publication series

NameProceedings of the ACM SIGCOMM Internet Measurement Conference, IMC


Conference19th ACM Internet Measurement Conference, IMC 2019

ASJC Scopus subject areas

  • Software
  • Computer Networks and Communications


Dive into the research topics of 'Q-Max: A unified scheme for improving network measurement throughput'. Together they form a unique fingerprint.

Cite this