Deep Convolutional Generative Adversial Network on MNIST Dataset
DOI:
https://doi.org/10.46243/jst.2021.v6.i3.pp169-177Keywords:
Supervised learning, unsupervised learning, Generator, discriminatorAbstract
In recent years, supervised learning with convolutional networks (CNNs) has seen huge adoption in computer vision applications. Comparatively, unsupervised learning with CNNs has received less attention. In this work we hope to help bridge the gap between the success of CNNs for supervised learning and unsupervised learning. We introduce a class of CNNs called deep convolutional generative adversarial networks (DCGANs), that have certain architectural constraints, and demonstrate that they are a strong candidate for unsupervised learning. Training on various image datasets, we show convincing evidence that our deep convolutional adversarial pair learns a hierarchy of representations from object parts to scenes in both the generator and discriminator. The generator uses tf.keras.layers.conv2Dtranspose (up sampling) layers to produce an image from a seed (random noise). Start with a dense layer that takes this seed as input, then up sample several times until you reach the desired image size of 28x28x1. The discriminator is a CNN-based image classifier. The model will be trained to output positive values for real images, and negative values for fake images. We define the Generator loss and the discriminator loss and we finally we get new images that look similar to our input(MNIST) images.
References
Understanding Generative Adversarial Networks (GANs). (2019). Retrieved from https://towardsdatascience.com/understandinggenerative-adversarial-networks-gans-cd6e4651a29
Chollet, F. Deep learning with Python
Radford, A., Metz, L., &Chintala, S. (2016). Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks. ICLR 2016
Denton, Emily, Chintala, Soumith, Szlam, Arthur, and Fergus, Rob. Deep generative image models using a laplacian pyramid of adversarial networks. arXiv preprint arXiv:1506.05751, 2015
Dosovitskiy, Alexey, Springenberg, Jost Tobias, and Brox, Thomas. Learning to generate chairs with convolutional neural networks. arXiv preprint arXiv:1411.5928, 2014
Danilo Jimenez Rezende, Shakir Mohamed, and DaanWierstra, “Stochastic Backpropagation and Approximate Inference in Deep Generative Models,” arXiv (2014)
Diederik P. Kingma and Max Welling, “Auto-Encoding Variational Bayes, arXiv (2013), https://arxiv.org/ abs/1312.6114
Bergstra, James and Bengio, Yoshua. Random search for hyper-parameter optimization. JMLR, 2012
Coates, Adam and Ng, Andrew Y. Learning feature representations with k-means. In Neural Networks: Tricks of the Trade, pp. 561–580. Springer, 2012
Coates, Adam and Ng, Andrew. Selecting receptive fields in deep networks. NIPS, 2011
Deng, Jia, Dong, Wei, Socher, Richard, Li, Li-Jia, Li, Kai, and Fei-Fei, Li. Imagenet: A large-scale hierarchical image database. In Computer Vision and Pattern Recognition, 2009. CVPR 2009. IEEE Conference on, pp. 248–255. IEEE, 2009




