Pixel Recurrent Neural Networks
They introduce PixelRNN and PixelCNN for autoregressive modeling of image pixels, using 2D LSTM layers and masked convolutions to capture full pixel dependencies. They model discrete 256-valued color channels with a softmax, achieve strong log-likelihoods on CIFAR-10 and ImageNet, and generate sharp, coherent samples.
Episodes
Chapters
01Abstract
Pixel recurrent neural networks predict pixels sequentially to model natural images, achieving state-of-the-art log-likelihood scores.
1:53Explained02Model and Generating Images Pixel by Pixel
The network generates images pixel by pixel, modeling discrete pixel values with conditional distributions based on previously scanned pixels and color channels.
2:11Explained03PixelRNN Architectural Components
PixelRNN utilizes Row LSTM, Diagonal BiLSTM, residual connections, and masked convolutions to effectively model image dependencies and enable deep network training.
1:50Explained04PixelCNN, Multi-Scale PixelRNN and Model Specifications
Alternative architectures like PixelCNN and Multi-Scale PixelRNN are introduced, alongside detailed model specifications for various datasets.
2:01Explained05Experiments, Training, Results and Conclusion
Experiments demonstrate PixelRNN's superior performance on image datasets, with residual connections and deeper models improving results, and generated samples showing high coherence.
2:27Explained06Acknowledgements and References
The authors acknowledge contributions and cite key references in generative modeling, deep learning, and autoregressive methods.
1:28Explained