Improved Utility Analysis of Private CountSketch
Research output: Chapter in Book/Report/Conference proceeding › Article in proceedings › Research › peer-review
Documents
- Fulltext
Final published version, 455 KB, PDF document
Sketching is an important tool for dealing with high-dimensional vectors that are sparse (or well-approximated by a sparse vector), especially useful in distributed, parallel, and streaming settings.It is known that sketches can be made differentially private by adding noise according to the sensitivity of the sketch, and this has been used in private analytics and federated learning settings.The post-processing property of differential privacy implies that \emph{all} estimates computed from the sketch can be released within the given privacy budget.In this paper we consider the classical CountSketch, made differentially private with the Gaussian mechanism, and give an improved analysis of its estimation error.Perhaps surprisingly, the privacy-utility trade-off is essentially the best one could hope for, independent of the number of repetitions in CountSketch:The error is almost identical to the error from non-private CountSketch plus the noise needed to make the vector private in the original, high-dimensional domain.
Original language | English |
---|---|
Title of host publication | Advances in Neural Information Processing Systems 35 (NeurIPS 2022) |
Number of pages | 13 |
Publisher | NeurIPS Proceedings |
Publication date | 2022 |
ISBN (Electronic) | 9781713871088 |
Publication status | Published - 2022 |
Event | 36th Conference on Neural Information Processing Systems (NeurIPS 2022). - New Orleans/ Virtual, United States Duration: 28 Nov 2022 → 9 Dec 2022 |
Conference
Conference | 36th Conference on Neural Information Processing Systems (NeurIPS 2022). |
---|---|
Land | United States |
By | New Orleans/ Virtual |
Periode | 28/11/2022 → 09/12/2022 |
Series | Advances in Neural Information Processing Systems |
---|---|
Volume | 35 |
ISSN | 1049-5258 |
ID: 340885528