Construction of optimal spectral methods in phase retrieval

Antoine Maillard, Florent Krzakala, Yue M. Lu, Lenka Zdeborova
Proceedings of the 2nd Mathematical and Scientific Machine Learning Conference, PMLR 145:693-720, 2022.

Abstract

We consider the \emph{phase retrieval} problem, in which the observer wishes to recover a $n$-dimensional real or complex signal $\bX^\star$ from the (possibly noisy) observation of $|\bPhi \bX^\star|$, in which $\bPhi$ is a matrix of size $m \times n$. We consider a \emph{high-dimensional} setting where $n,m \to \infty$ with $m/n = \mathcal{O}(1)$, and a large class of (possibly correlated) random matrices $\bPhi$ and observation channels. Spectral methods are a powerful tool to obtain approximate observations of the signal $\bX^\star$ which can be then used as initialization for a subsequent algorithm, at a low computational cost. In this paper, we extend and unify previous results and approaches on spectral methods for the phase retrieval problem. More precisely, we combine the linearization of message-passing algorithms and the analysis of the \emph{Bethe Hessian}, a classical tool of statistical physics. Using this toolbox, we show how to derive optimal spectral methods for arbitrary channel noise and right-unitarily invariant matrix $\bPhi$, in an automated manner (i.e. with no optimization over any hyperparameter or preprocessing function).

Cite this Paper


BibTeX
@InProceedings{pmlr-v145-maillard22a, title = {Construction of optimal spectral methods in phase retrieval}, author = {Maillard, Antoine and Krzakala, Florent and Lu, Yue M. and Zdeborova, Lenka}, booktitle = {Proceedings of the 2nd Mathematical and Scientific Machine Learning Conference}, pages = {693--720}, year = {2022}, editor = {Bruna, Joan and Hesthaven, Jan and Zdeborova, Lenka}, volume = {145}, series = {Proceedings of Machine Learning Research}, month = {16--19 Aug}, publisher = {PMLR}, pdf = {https://proceedings.mlr.press/v145/maillard22a/maillard22a.pdf}, url = {https://proceedings.mlr.press/v145/maillard22a.html}, abstract = {We consider the \emph{phase retrieval} problem, in which the observer wishes to recover a $n$-dimensional real or complex signal $\bX^\star$ from the (possibly noisy) observation of $|\bPhi \bX^\star|$, in which $\bPhi$ is a matrix of size $m \times n$. We consider a \emph{high-dimensional} setting where $n,m \to \infty$ with $m/n = \mathcal{O}(1)$, and a large class of (possibly correlated) random matrices $\bPhi$ and observation channels. Spectral methods are a powerful tool to obtain approximate observations of the signal $\bX^\star$ which can be then used as initialization for a subsequent algorithm, at a low computational cost. In this paper, we extend and unify previous results and approaches on spectral methods for the phase retrieval problem. More precisely, we combine the linearization of message-passing algorithms and the analysis of the \emph{Bethe Hessian}, a classical tool of statistical physics. Using this toolbox, we show how to derive optimal spectral methods for arbitrary channel noise and right-unitarily invariant matrix $\bPhi$, in an automated manner (i.e. with no optimization over any hyperparameter or preprocessing function). } }
Endnote
%0 Conference Paper %T Construction of optimal spectral methods in phase retrieval %A Antoine Maillard %A Florent Krzakala %A Yue M. Lu %A Lenka Zdeborova %B Proceedings of the 2nd Mathematical and Scientific Machine Learning Conference %C Proceedings of Machine Learning Research %D 2022 %E Joan Bruna %E Jan Hesthaven %E Lenka Zdeborova %F pmlr-v145-maillard22a %I PMLR %P 693--720 %U https://proceedings.mlr.press/v145/maillard22a.html %V 145 %X We consider the \emph{phase retrieval} problem, in which the observer wishes to recover a $n$-dimensional real or complex signal $\bX^\star$ from the (possibly noisy) observation of $|\bPhi \bX^\star|$, in which $\bPhi$ is a matrix of size $m \times n$. We consider a \emph{high-dimensional} setting where $n,m \to \infty$ with $m/n = \mathcal{O}(1)$, and a large class of (possibly correlated) random matrices $\bPhi$ and observation channels. Spectral methods are a powerful tool to obtain approximate observations of the signal $\bX^\star$ which can be then used as initialization for a subsequent algorithm, at a low computational cost. In this paper, we extend and unify previous results and approaches on spectral methods for the phase retrieval problem. More precisely, we combine the linearization of message-passing algorithms and the analysis of the \emph{Bethe Hessian}, a classical tool of statistical physics. Using this toolbox, we show how to derive optimal spectral methods for arbitrary channel noise and right-unitarily invariant matrix $\bPhi$, in an automated manner (i.e. with no optimization over any hyperparameter or preprocessing function).
APA
Maillard, A., Krzakala, F., Lu, Y.M. & Zdeborova, L.. (2022). Construction of optimal spectral methods in phase retrieval. Proceedings of the 2nd Mathematical and Scientific Machine Learning Conference, in Proceedings of Machine Learning Research 145:693-720 Available from https://proceedings.mlr.press/v145/maillard22a.html.

Related Material