Leveraging Public Data for Practical Private Query Release

Terrance Liu, Giuseppe Vietri, Thomas Steinke, Jonathan Ullman, Steven Wu
Proceedings of the 38th International Conference on Machine Learning, PMLR 139:6968-6977, 2021.

Abstract

In many statistical problems, incorporating priors can significantly improve performance. However, the use of prior knowledge in differentially private query release has remained underexplored, despite such priors commonly being available in the form of public datasets, such as previous US Census releases. With the goal of releasing statistics about a private dataset, we present PMW^Pub, which—unlike existing baselines—leverages public data drawn from a related distribution as prior information. We provide a theoretical analysis and an empirical evaluation on the American Community Survey (ACS) and ADULT datasets, which shows that our method outperforms state-of-the-art methods. Furthermore, PMW^Pub scales well to high-dimensional data domains, where running many existing methods would be computationally infeasible.

Cite this Paper

BibTeX
@InProceedings{pmlr-v139-liu21w, title = {Leveraging Public Data for Practical Private Query Release}, author = {Liu, Terrance and Vietri, Giuseppe and Steinke, Thomas and Ullman, Jonathan and Wu, Steven}, booktitle = {Proceedings of the 38th International Conference on Machine Learning}, pages = {6968--6977}, year = {2021}, editor = {Meila, Marina and Zhang, Tong}, volume = {139}, series = {Proceedings of Machine Learning Research}, month = {18--24 Jul}, publisher = {PMLR}, pdf = {http://proceedings.mlr.press/v139/liu21w/liu21w.pdf}, url = {https://proceedings.mlr.press/v139/liu21w.html}, abstract = {In many statistical problems, incorporating priors can significantly improve performance. However, the use of prior knowledge in differentially private query release has remained underexplored, despite such priors commonly being available in the form of public datasets, such as previous US Census releases. With the goal of releasing statistics about a private dataset, we present PMW^Pub, which—unlike existing baselines—leverages public data drawn from a related distribution as prior information. We provide a theoretical analysis and an empirical evaluation on the American Community Survey (ACS) and ADULT datasets, which shows that our method outperforms state-of-the-art methods. Furthermore, PMW^Pub scales well to high-dimensional data domains, where running many existing methods would be computationally infeasible.} }
Endnote
%0 Conference Paper %T Leveraging Public Data for Practical Private Query Release %A Terrance Liu %A Giuseppe Vietri %A Thomas Steinke %A Jonathan Ullman %A Steven Wu %B Proceedings of the 38th International Conference on Machine Learning %C Proceedings of Machine Learning Research %D 2021 %E Marina Meila %E Tong Zhang %F pmlr-v139-liu21w %I PMLR %P 6968--6977 %U https://proceedings.mlr.press/v139/liu21w.html %V 139 %X In many statistical problems, incorporating priors can significantly improve performance. However, the use of prior knowledge in differentially private query release has remained underexplored, despite such priors commonly being available in the form of public datasets, such as previous US Census releases. With the goal of releasing statistics about a private dataset, we present PMW^Pub, which—unlike existing baselines—leverages public data drawn from a related distribution as prior information. We provide a theoretical analysis and an empirical evaluation on the American Community Survey (ACS) and ADULT datasets, which shows that our method outperforms state-of-the-art methods. Furthermore, PMW^Pub scales well to high-dimensional data domains, where running many existing methods would be computationally infeasible.
APA
Liu, T., Vietri, G., Steinke, T., Ullman, J. & Wu, S.. (2021). Leveraging Public Data for Practical Private Query Release. Proceedings of the 38th International Conference on Machine Learning, in Proceedings of Machine Learning Research 139:6968-6977 Available from https://proceedings.mlr.press/v139/liu21w.html.

Related Material