Beyond Parity Constraints: Fourier Analysis of Hash Functions for Inference

[edit]

Tudor Achim, Ashish Sabharwal, Stefano Ermon ;
Proceedings of The 33rd International Conference on Machine Learning, PMLR 48:2254-2262, 2016.

Abstract

Random projections have played an important role in scaling up machine learning and data mining algorithms. Recently they have also been applied to probabilistic inference to estimate properties of high-dimensional distributions; however, they all rely on the same class of projections based on universal hashing. We provide a general framework to analyze random projections which relates their statistical properties to their Fourier spectrum, which is a well-studied area of theoretical computer science. Using this framework we introduce two new classes of hash functions for probabilistic inference and model counting that show promising performance on synthetic and real-world benchmarks.

Related Material