On neural circuits of working memory sequence permutation: optimizing circuit architectures via Cayley graphs

Kevin Bien, Junfeng Zuo, Wenhao Zhang
Proceedings of the 4th (2025) and 3rd (2024) NeurIPS Workshops on Symmetry and Geometry in Neural Representations, PMLR 282:29-48, 2026.

Abstract

The brain’s ability to store and manipulate working memory (WM) sequences is pivotal for higher cognitive reasoning. Although the neural circuit mechanisms for storing WM sequences have been extensively studied, those for manipulating WM sequences remain largely unknown. Inspired by a recent WM sequence manipulation experiment in monkeys, we design a functional, biologically plausible neural circuit model that realizes WM sequence permutations using guidance from permutation groups and their Cayley graph representations. The circuit consists of two interconnected modules: a memory module composed of continuous attractor-based memory motifs that store and interchange items in WM sequences, and a control module that sends gain modulations to guide permutation operations within the memory module. The control module features a hierarchical tree structure that decomposes complex permutations into a sequence of basic two-item swaps, simplifying circuit implementations. We demonstrate that permutation circuit architectures have one-to-one correspondence with Cayley graphs representing permutation group structure, where the group generating set directly determines the connectivity between memory motifs. Since each permutation group may have multiple generating sets, there are multiple circuit architectures implementing the same permutation. We therefore utilize Cayley graph analysis to determine trade-offs between computational efficiency, circuit complexity, and circuit robustness. Our study establishes connections between abstract group theory, Cayley graphs, and biologically plausible circuit architectures, providing insights into principled circuit design via algebraic frameworks.

Cite this Paper


BibTeX
@InProceedings{pmlr-v282-bien26a, title = {On neural circuits of working memory sequence permutation: optimizing circuit architectures via Cayley graphs}, author = {Bien, Kevin and Zuo, Junfeng and Zhang, Wenhao}, booktitle = {Proceedings of the 4th (2025) and 3rd (2024) NeurIPS Workshops on Symmetry and Geometry in Neural Representations}, pages = {29--48}, year = {2026}, editor = {Acosta, Francisco and Azeglio, Simone and Tolooshams, Bahareh and van de Geijn, Chase and Shewmake, Christian and Sanborn, Sophia and Miolane, Nina}, volume = {282}, series = {Proceedings of Machine Learning Research}, month = {14 Dec 2024--07 Dec 2025}, publisher = {PMLR}, pdf = {https://raw.githubusercontent.com/mlresearch/v282/main/assets/bien26a/bien26a.pdf}, url = {https://proceedings.mlr.press/v282/bien26a.html}, abstract = {The brain’s ability to store and manipulate working memory (WM) sequences is pivotal for higher cognitive reasoning. Although the neural circuit mechanisms for storing WM sequences have been extensively studied, those for manipulating WM sequences remain largely unknown. Inspired by a recent WM sequence manipulation experiment in monkeys, we design a functional, biologically plausible neural circuit model that realizes WM sequence permutations using guidance from permutation groups and their Cayley graph representations. The circuit consists of two interconnected modules: a memory module composed of continuous attractor-based memory motifs that store and interchange items in WM sequences, and a control module that sends gain modulations to guide permutation operations within the memory module. The control module features a hierarchical tree structure that decomposes complex permutations into a sequence of basic two-item swaps, simplifying circuit implementations. We demonstrate that permutation circuit architectures have one-to-one correspondence with Cayley graphs representing permutation group structure, where the group generating set directly determines the connectivity between memory motifs. Since each permutation group may have multiple generating sets, there are multiple circuit architectures implementing the same permutation. We therefore utilize Cayley graph analysis to determine trade-offs between computational efficiency, circuit complexity, and circuit robustness. Our study establishes connections between abstract group theory, Cayley graphs, and biologically plausible circuit architectures, providing insights into principled circuit design via algebraic frameworks.} }
Endnote
%0 Conference Paper %T On neural circuits of working memory sequence permutation: optimizing circuit architectures via Cayley graphs %A Kevin Bien %A Junfeng Zuo %A Wenhao Zhang %B Proceedings of the 4th (2025) and 3rd (2024) NeurIPS Workshops on Symmetry and Geometry in Neural Representations %C Proceedings of Machine Learning Research %D 2026 %E Francisco Acosta %E Simone Azeglio %E Bahareh Tolooshams %E Chase van de Geijn %E Christian Shewmake %E Sophia Sanborn %E Nina Miolane %F pmlr-v282-bien26a %I PMLR %P 29--48 %U https://proceedings.mlr.press/v282/bien26a.html %V 282 %X The brain’s ability to store and manipulate working memory (WM) sequences is pivotal for higher cognitive reasoning. Although the neural circuit mechanisms for storing WM sequences have been extensively studied, those for manipulating WM sequences remain largely unknown. Inspired by a recent WM sequence manipulation experiment in monkeys, we design a functional, biologically plausible neural circuit model that realizes WM sequence permutations using guidance from permutation groups and their Cayley graph representations. The circuit consists of two interconnected modules: a memory module composed of continuous attractor-based memory motifs that store and interchange items in WM sequences, and a control module that sends gain modulations to guide permutation operations within the memory module. The control module features a hierarchical tree structure that decomposes complex permutations into a sequence of basic two-item swaps, simplifying circuit implementations. We demonstrate that permutation circuit architectures have one-to-one correspondence with Cayley graphs representing permutation group structure, where the group generating set directly determines the connectivity between memory motifs. Since each permutation group may have multiple generating sets, there are multiple circuit architectures implementing the same permutation. We therefore utilize Cayley graph analysis to determine trade-offs between computational efficiency, circuit complexity, and circuit robustness. Our study establishes connections between abstract group theory, Cayley graphs, and biologically plausible circuit architectures, providing insights into principled circuit design via algebraic frameworks.
APA
Bien, K., Zuo, J. & Zhang, W.. (2026). On neural circuits of working memory sequence permutation: optimizing circuit architectures via Cayley graphs. Proceedings of the 4th (2025) and 3rd (2024) NeurIPS Workshops on Symmetry and Geometry in Neural Representations, in Proceedings of Machine Learning Research 282:29-48 Available from https://proceedings.mlr.press/v282/bien26a.html.

Related Material