Vivek Jayaram*, John Thickstun*
*Equal Contribution
University of Washington
Video and audio demos are available at the project page
The Thirty-eighth International Conference on Machine Learning, ICML 2021.
We propose a new way to sample from autoregressive models by smoothing the distribution and using the gradients of the likelihood. This allows flexible conditional sampling, and also allows us to parallelize the sampling process. We apply these techniques in the visual and audio domains, with competitive results for audio source separation, super-resolution, and inpainting.
There are two subdirectories, one for audio experiments using a wavenet model and one for small scale image experiments using a pixelcnn++ model. Each directory is independent and contains a Readme for specific running instructions.