GARNET: Reduced-Rank Topology Learning for Robust and Scalable Graph Neural Networks

Chenhui Deng, Xiuyu Li, Zhuo Feng, Zhiru Zhang
Proceedings of the First Learning on Graphs Conference, PMLR 198:3:1-3:23, 2022.

Abstract

Graph neural networks (GNNs) have been increasingly deployed in various applications that involve learning on non-Euclidean data. However, recent studies show that GNNs are vulnerable to graph adversarial attacks. Although there are several defense methods to improve GNN robustness by eliminating adversarial components, they may also impair the underlying clean graph structure that contributes to GNN training. In addition, few of those defense models can scale to large graphs due to their high computational complexity and memory usage. In this paper, we propose GARNET, a scalable spectral method to boost the adversarial robustness of GNN models. GARNET first leverages weighted spectral embedding to construct a base graph, which is not only resistant to adversarial attacks but also contains critical (clean) graph structure for GNN training. Next, GARNET further refines the base graph by pruning additional uncritical edges based on probabilistic graphical model. GARNET has been evaluated on various datasets, including a large graph with millions of nodes. Our extensive experiment results show that GARNET achieves adversarial accuracy improvement and runtime speedup over state-of-the-art GNN (defense) models by up to \textdollar 10.23\%\textdollar and \textdollar 14.7\times\textdollar , respectively.

Cite this Paper

BibTeX
@InProceedings{pmlr-v198-deng22a, title = {GARNET: Reduced-Rank Topology Learning for Robust and Scalable Graph Neural Networks}, author = {Deng, Chenhui and Li, Xiuyu and Feng, Zhuo and Zhang, Zhiru}, booktitle = {Proceedings of the First Learning on Graphs Conference}, pages = {3:1--3:23}, year = {2022}, editor = {Rieck, Bastian and Pascanu, Razvan}, volume = {198}, series = {Proceedings of Machine Learning Research}, month = {09--12 Dec}, publisher = {PMLR}, pdf = {https://proceedings.mlr.press/v198/deng22a/deng22a.pdf}, url = {https://proceedings.mlr.press/v198/deng22a.html}, abstract = {Graph neural networks (GNNs) have been increasingly deployed in various applications that involve learning on non-Euclidean data. However, recent studies show that GNNs are vulnerable to graph adversarial attacks. Although there are several defense methods to improve GNN robustness by eliminating adversarial components, they may also impair the underlying clean graph structure that contributes to GNN training. In addition, few of those defense models can scale to large graphs due to their high computational complexity and memory usage. In this paper, we propose GARNET, a scalable spectral method to boost the adversarial robustness of GNN models. GARNET first leverages weighted spectral embedding to construct a base graph, which is not only resistant to adversarial attacks but also contains critical (clean) graph structure for GNN training. Next, GARNET further refines the base graph by pruning additional uncritical edges based on probabilistic graphical model. GARNET has been evaluated on various datasets, including a large graph with millions of nodes. Our extensive experiment results show that GARNET achieves adversarial accuracy improvement and runtime speedup over state-of-the-art GNN (defense) models by up to \textdollar 10.23\%\textdollar and \textdollar 14.7\times\textdollar , respectively.} }
Endnote
%0 Conference Paper %T GARNET: Reduced-Rank Topology Learning for Robust and Scalable Graph Neural Networks %A Chenhui Deng %A Xiuyu Li %A Zhuo Feng %A Zhiru Zhang %B Proceedings of the First Learning on Graphs Conference %C Proceedings of Machine Learning Research %D 2022 %E Bastian Rieck %E Razvan Pascanu %F pmlr-v198-deng22a %I PMLR %P 3:1--3:23 %U https://proceedings.mlr.press/v198/deng22a.html %V 198 %X Graph neural networks (GNNs) have been increasingly deployed in various applications that involve learning on non-Euclidean data. However, recent studies show that GNNs are vulnerable to graph adversarial attacks. Although there are several defense methods to improve GNN robustness by eliminating adversarial components, they may also impair the underlying clean graph structure that contributes to GNN training. In addition, few of those defense models can scale to large graphs due to their high computational complexity and memory usage. In this paper, we propose GARNET, a scalable spectral method to boost the adversarial robustness of GNN models. GARNET first leverages weighted spectral embedding to construct a base graph, which is not only resistant to adversarial attacks but also contains critical (clean) graph structure for GNN training. Next, GARNET further refines the base graph by pruning additional uncritical edges based on probabilistic graphical model. GARNET has been evaluated on various datasets, including a large graph with millions of nodes. Our extensive experiment results show that GARNET achieves adversarial accuracy improvement and runtime speedup over state-of-the-art GNN (defense) models by up to \textdollar 10.23\%\textdollar and \textdollar 14.7\times\textdollar , respectively.
APA
Deng, C., Li, X., Feng, Z. & Zhang, Z.. (2022). GARNET: Reduced-Rank Topology Learning for Robust and Scalable Graph Neural Networks. Proceedings of the First Learning on Graphs Conference, in Proceedings of Machine Learning Research 198:3:1-3:23 Available from https://proceedings.mlr.press/v198/deng22a.html.

Related Material