Deep Convolutional Generative Adversial Network on MNIST Dataset

Authors

  • S. Vijaya Lakshmi
  • , Vallik Sai Ganesh Raju Ganaraju

DOI:

https://doi.org/10.46243/jst.2021.v6.i3.pp169-177

Keywords:

Supervised learning, unsupervised learning, Generator, discriminator

Abstract

In recent years, supervised learning with convolutional networks (CNNs) has seen huge adoption in computer vision applications. Comparatively, unsupervised learning with CNNs has received less attention. In this work we hope to help bridge the gap between the success of CNNs for supervised learning and unsupervised learning. We introduce a class of CNNs called deep convolutional generative adversarial networks (DCGANs), that have certain architectural constraints, and demonstrate that they are a strong candidate for unsupervised learning. Training on various image datasets, we show convincing evidence that our deep convolutional adversarial pair learns a hierarchy of representations from object parts to scenes in both the generator and discriminator. The generator uses tf.keras.layers.conv2Dtranspose (up sampling) layers to produce an image from a seed (random noise). Start with a dense layer that takes this seed as input, then up sample several times until you reach the desired image size of 28x28x1. The discriminator is a CNN-based image classifier. The model will be trained to output positive values for real images, and negative values for fake images. We define the Generator loss and the discriminator loss and we finally we get new images that look similar to our input(MNIST) images.

References

Understanding Generative Adversarial Networks (GANs). (2019). Retrieved from https://towardsdatascience.com/understandinggenerative-adversarial-networks-gans-cd6e4651a29

Chollet, F. Deep learning with Python

Radford, A., Metz, L., &Chintala, S. (2016). Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks. ICLR 2016

Denton, Emily, Chintala, Soumith, Szlam, Arthur, and Fergus, Rob. Deep generative image models using a laplacian pyramid of adversarial networks. arXiv preprint arXiv:1506.05751, 2015

Dosovitskiy, Alexey, Springenberg, Jost Tobias, and Brox, Thomas. Learning to generate chairs with convolutional neural networks. arXiv preprint arXiv:1411.5928, 2014

Danilo Jimenez Rezende, Shakir Mohamed, and DaanWierstra, “Stochastic Backpropagation and Approximate Inference in Deep Generative Models,” arXiv (2014)

Diederik P. Kingma and Max Welling, “Auto-Encoding Variational Bayes, arXiv (2013), https://arxiv.org/ abs/1312.6114

Bergstra, James and Bengio, Yoshua. Random search for hyper-parameter optimization. JMLR, 2012

Coates, Adam and Ng, Andrew Y. Learning feature representations with k-means. In Neural Networks: Tricks of the Trade, pp. 561–580. Springer, 2012

Coates, Adam and Ng, Andrew. Selecting receptive fields in deep networks. NIPS, 2011

Deng, Jia, Dong, Wei, Socher, Richard, Li, Li-Jia, Li, Kai, and Fei-Fei, Li. Imagenet: A large-scale hierarchical image database. In Computer Vision and Pattern Recognition, 2009. CVPR 2009. IEEE Conference on, pp. 248–255. IEEE, 2009

Published

2021-06-02

How to Cite

S. Vijaya Lakshmi, & , Vallik Sai Ganesh Raju Ganaraju. (2021). Deep Convolutional Generative Adversial Network on MNIST Dataset. Journal of Science & Technology , 6(3), 169–177. https://doi.org/10.46243/jst.2021.v6.i3.pp169-177