LoRe: Adaptive Interaction-Evaluation Routing with Per-step Interaction Budgets for Iterative Graph Solvers

Jintao Li, Yong-Yi Wang, Zheng-An Wang, Heng Fan
Proceedings of the 43rd International Conference on Machine Learning, PMLR 306:70969-70982, 2026.

Abstract

Diffusion-based neural solvers for combinatorial optimization repeatedly re-evaluate dense edge/factor interactions, making inference expensive in wall-clock time and often memory-bound at scale. Inspired by the computational methodologies of many-body physics, we introduce LoRe, a training-free, inference-time drop-in wrapper that enforces per-step interaction-evaluation budgeting: at each iteration, it evaluates only a fixed fraction of interactions by dynamically routing computation to high-conflict or high-uncertainty interactions, instead of using a fixed sparsification (e.g., static kNN graphs or static masks). Under fully inclusive end-to-end wall-clock accounting, LoRe substantially improves scalability on the Maximum Independent Set (MIS) problem, extending feasible inference more than $3\times$ beyond the baseline’s out-of-memory limit, delivering a ${\sim}8\times$ speedup and a ${\sim}12\times$ peak-memory reduction, with solution quality preserved in this regime. Demonstrating cross-task generality on the large-scale Traveling Salesperson Problem (TSP) and zero-shot robustness to topology shifts, LoRe achieves a ${\sim}15\times$ speedup at $n=1000$ with a $44\times$ memory reduction and competitive tour quality.

Cite this Paper


BibTeX
@InProceedings{pmlr-v306-li26gz, title = {{L}o{R}e: Adaptive Interaction-Evaluation Routing with Per-step Interaction Budgets for Iterative Graph Solvers}, author = {Li, Jintao and Wang, Yong-Yi and Wang, Zheng-An and Fan, Heng}, booktitle = {Proceedings of the 43rd International Conference on Machine Learning}, pages = {70969--70982}, year = {2026}, editor = {Zhang, Tong and Dudik, Miroslav and Jaggi, Martin and Agarwal, Alekh and Li, Sharon and Schuurmans, Dale and Zhu, Jerry and Berkenkamp, Felix and Dong, Hanze and Bietti, Alberto}, volume = {306}, series = {Proceedings of Machine Learning Research}, month = {06--11 Jul}, publisher = {PMLR}, pdf = {https://raw.githubusercontent.com/mlresearch/v306/main/assets/li26gz/li26gz.pdf}, url = {https://proceedings.mlr.press/v306/li26gz.html}, abstract = {Diffusion-based neural solvers for combinatorial optimization repeatedly re-evaluate dense edge/factor interactions, making inference expensive in wall-clock time and often memory-bound at scale. Inspired by the computational methodologies of many-body physics, we introduce LoRe, a training-free, inference-time drop-in wrapper that enforces per-step interaction-evaluation budgeting: at each iteration, it evaluates only a fixed fraction of interactions by dynamically routing computation to high-conflict or high-uncertainty interactions, instead of using a fixed sparsification (e.g., static kNN graphs or static masks). Under fully inclusive end-to-end wall-clock accounting, LoRe substantially improves scalability on the Maximum Independent Set (MIS) problem, extending feasible inference more than $3\times$ beyond the baseline’s out-of-memory limit, delivering a ${\sim}8\times$ speedup and a ${\sim}12\times$ peak-memory reduction, with solution quality preserved in this regime. Demonstrating cross-task generality on the large-scale Traveling Salesperson Problem (TSP) and zero-shot robustness to topology shifts, LoRe achieves a ${\sim}15\times$ speedup at $n=1000$ with a $44\times$ memory reduction and competitive tour quality.} }
Endnote
%0 Conference Paper %T LoRe: Adaptive Interaction-Evaluation Routing with Per-step Interaction Budgets for Iterative Graph Solvers %A Jintao Li %A Yong-Yi Wang %A Zheng-An Wang %A Heng Fan %B Proceedings of the 43rd International Conference on Machine Learning %C Proceedings of Machine Learning Research %D 2026 %E Tong Zhang %E Miroslav Dudik %E Martin Jaggi %E Alekh Agarwal %E Sharon Li %E Dale Schuurmans %E Jerry Zhu %E Felix Berkenkamp %E Hanze Dong %E Alberto Bietti %F pmlr-v306-li26gz %I PMLR %P 70969--70982 %U https://proceedings.mlr.press/v306/li26gz.html %V 306 %X Diffusion-based neural solvers for combinatorial optimization repeatedly re-evaluate dense edge/factor interactions, making inference expensive in wall-clock time and often memory-bound at scale. Inspired by the computational methodologies of many-body physics, we introduce LoRe, a training-free, inference-time drop-in wrapper that enforces per-step interaction-evaluation budgeting: at each iteration, it evaluates only a fixed fraction of interactions by dynamically routing computation to high-conflict or high-uncertainty interactions, instead of using a fixed sparsification (e.g., static kNN graphs or static masks). Under fully inclusive end-to-end wall-clock accounting, LoRe substantially improves scalability on the Maximum Independent Set (MIS) problem, extending feasible inference more than $3\times$ beyond the baseline’s out-of-memory limit, delivering a ${\sim}8\times$ speedup and a ${\sim}12\times$ peak-memory reduction, with solution quality preserved in this regime. Demonstrating cross-task generality on the large-scale Traveling Salesperson Problem (TSP) and zero-shot robustness to topology shifts, LoRe achieves a ${\sim}15\times$ speedup at $n=1000$ with a $44\times$ memory reduction and competitive tour quality.
APA
Li, J., Wang, Y., Wang, Z. & Fan, H.. (2026). LoRe: Adaptive Interaction-Evaluation Routing with Per-step Interaction Budgets for Iterative Graph Solvers. Proceedings of the 43rd International Conference on Machine Learning, in Proceedings of Machine Learning Research 306:70969-70982 Available from https://proceedings.mlr.press/v306/li26gz.html.

Related Material