Discriminator Guidance for Autoregressive Diffusion Models

Filip Ekström Kelvinius, Fredrik Lindsten
Proceedings of The 27th International Conference on Artificial Intelligence and Statistics, PMLR 238:3403-3411, 2024.

Abstract

We introduce discriminator guidance in the setting of Autoregressive Diffusion Models. The use of a discriminator to guide a diffusion process has previously been used for continuous diffusion models, and in this work we derive ways of using a discriminator together with a pretrained generative model in the discrete case. First, we show that using an optimal discriminator will correct the pretrained model and enable exact sampling from the underlying data distribution. Second, to account for the realistic scenario of using a sub-optimal discriminator, we derive a sequential Monte Carlo algorithm which iteratively takes the predictions from the discriminator into account during the generation process. We test these approaches on the task of generating molecular graphs and show how the discriminator improves the generative performance over using only the pretrained model.

Cite this Paper

BibTeX
@InProceedings{pmlr-v238-ekstrom-kelvinius24a, title = { Discriminator Guidance for Autoregressive Diffusion Models }, author = {Ekstr\"{o}m Kelvinius, Filip and Lindsten, Fredrik}, booktitle = {Proceedings of The 27th International Conference on Artificial Intelligence and Statistics}, pages = {3403--3411}, year = {2024}, editor = {Dasgupta, Sanjoy and Mandt, Stephan and Li, Yingzhen}, volume = {238}, series = {Proceedings of Machine Learning Research}, month = {02--04 May}, publisher = {PMLR}, pdf = {https://proceedings.mlr.press/v238/ekstrom-kelvinius24a/ekstrom-kelvinius24a.pdf}, url = {https://proceedings.mlr.press/v238/ekstrom-kelvinius24a.html}, abstract = { We introduce discriminator guidance in the setting of Autoregressive Diffusion Models. The use of a discriminator to guide a diffusion process has previously been used for continuous diffusion models, and in this work we derive ways of using a discriminator together with a pretrained generative model in the discrete case. First, we show that using an optimal discriminator will correct the pretrained model and enable exact sampling from the underlying data distribution. Second, to account for the realistic scenario of using a sub-optimal discriminator, we derive a sequential Monte Carlo algorithm which iteratively takes the predictions from the discriminator into account during the generation process. We test these approaches on the task of generating molecular graphs and show how the discriminator improves the generative performance over using only the pretrained model. } }
Endnote
%0 Conference Paper %T Discriminator Guidance for Autoregressive Diffusion Models %A Filip Ekström Kelvinius %A Fredrik Lindsten %B Proceedings of The 27th International Conference on Artificial Intelligence and Statistics %C Proceedings of Machine Learning Research %D 2024 %E Sanjoy Dasgupta %E Stephan Mandt %E Yingzhen Li %F pmlr-v238-ekstrom-kelvinius24a %I PMLR %P 3403--3411 %U https://proceedings.mlr.press/v238/ekstrom-kelvinius24a.html %V 238 %X We introduce discriminator guidance in the setting of Autoregressive Diffusion Models. The use of a discriminator to guide a diffusion process has previously been used for continuous diffusion models, and in this work we derive ways of using a discriminator together with a pretrained generative model in the discrete case. First, we show that using an optimal discriminator will correct the pretrained model and enable exact sampling from the underlying data distribution. Second, to account for the realistic scenario of using a sub-optimal discriminator, we derive a sequential Monte Carlo algorithm which iteratively takes the predictions from the discriminator into account during the generation process. We test these approaches on the task of generating molecular graphs and show how the discriminator improves the generative performance over using only the pretrained model.
APA
Ekström Kelvinius, F. & Lindsten, F.. (2024). Discriminator Guidance for Autoregressive Diffusion Models . Proceedings of The 27th International Conference on Artificial Intelligence and Statistics, in Proceedings of Machine Learning Research 238:3403-3411 Available from https://proceedings.mlr.press/v238/ekstrom-kelvinius24a.html.

Related Material