TY - GEN
T1 - DRIVE
T2 - 35th Conference on Neural Information Processing Systems, NeurIPS 2021
AU - Vargaftik, Shay
AU - Basat, Ran Ben
AU - Portnoy, Amit
AU - Mendelson, Gal
AU - Ben-Itzhak, Yaniv
AU - Mitzenmacher, Michael
N1 - Funding Information:
MM was supported in part by NSF grants CCF-2101140, CCF-2107078, CCF-1563710, and DMS-2023528. MM and RBB were supported in part by a gift to the Center for Research on Computation and Society at Harvard University. AP was supported in part by the Cyber Security Research Center at Ben-Gurion University of the Negev. We thank Moshe Gabel, Mahmood Sharif, Yuval Filmus and, the anonymous reviewers for helpful comments and suggestions.
Publisher Copyright:
© 2021 Neural information processing systems foundation. All rights reserved.
PY - 2021/1/1
Y1 - 2021/1/1
N2 - We consider the problem where n clients transmit d-dimensional real-valued vectors using d(1 + o(1)) bits each, in a manner that allows the receiver to approximately reconstruct their mean. Such compression problems naturally arise in distributed and federated learning. We provide novel mathematical results and derive computationally efficient algorithms that are more accurate than previous compression techniques. We evaluate our methods on a collection of distributed and federated learning tasks, using a variety of datasets, and show a consistent improvement over the state of the art.
AB - We consider the problem where n clients transmit d-dimensional real-valued vectors using d(1 + o(1)) bits each, in a manner that allows the receiver to approximately reconstruct their mean. Such compression problems naturally arise in distributed and federated learning. We provide novel mathematical results and derive computationally efficient algorithms that are more accurate than previous compression techniques. We evaluate our methods on a collection of distributed and federated learning tasks, using a variety of datasets, and show a consistent improvement over the state of the art.
UR - http://www.scopus.com/inward/record.url?scp=85131600857&partnerID=8YFLogxK
M3 - Conference contribution
AN - SCOPUS:85131600857
T3 - Advances in Neural Information Processing Systems
SP - 362
EP - 377
BT - Advances in Neural Information Processing Systems 34 - 35th Conference on Neural Information Processing Systems, NeurIPS 2021
A2 - Ranzato, Marc'Aurelio
A2 - Beygelzimer, Alina
A2 - Dauphin, Yann
A2 - Liang, Percy S.
A2 - Wortman Vaughan, Jenn
PB - Neural information processing systems foundation
Y2 - 6 December 2021 through 14 December 2021
ER -