Back close

Course Detail

Course Name Deep learning
Program M. Sc. Cognitive Sciences, Learning and Technology
Semester Open Elective
Credits 3
Campus Amritapuri


Unit I

Introduction to Deep Neural Networks: Feed forward Neural networks. Gradient descent and the back propagation algorithm, Intuition of Neural Networks Loss functions, Optimization, Unit saturation, aka the vanishing gradient problem, and ways to mitigate it.

Unit II

Convolutional Neural Networks, Training Neural Networks, Understanding Neural Networks Through Deep Visualization and Recurrent Neural Networks: Architectures, convolution / pooling layers, LSTM, Encoder Decoder architectures.

Unit III

Deep Unsupervised Learning: Auto encoders (standard, sparse, denoising, contractive, etc), variational auto encoders, denoising encoders, Adversarial Generative Networks.

Unit IV

Deep Belief Networks: Energy Based Models, Restricted Boltzmann Machines, Sampling in an RBM. Applications of deep neural networks in handwritten character recognition, face recognition, semantic web, social networks.


This course builds from a one node neural network to a multiple feature, multiple output neural networks. After an understanding of how neural networks work and the parameters that control deep learning systems, building of deep learning neural networks and various applications.

Course Objectives and Outcomes

Course Objectives

  • Understand the context of neural networks and deep learning
  • Know how to use a neural network
  • Understand the data needs of deep learning
  • Have a working knowledge of neural networks and deep learning.
  • Explore the parameters for neural networks

Course Outcomes

Cos Description
CO1 Identify the roles of neural networks in deep learning
CO2 Design of different Convolutional Neural Networks for problem solving
CO3 Implement various unsupervised deep learning techniques
CO4 Design convolution networks for various Computer Vision problems

CO-PO Mapping

PO/ PSO PO 1 PO 2 PO 3 PO 4 PO 5 PO 6 PO 7 PO 8 PO 9
CO1 3 2 3
CO2 3 3 1 3 1
CO3 2 3 2 1
CO4 3 1 3 1 1 1
Assessment Internal External>
Active Participation in Class 10
*Continuous Assessment (CA) 40
Content produced over the course and submitted at the last 50

*CA – Can be Quizzes, Assignment, Projects, and Reports, and Seminar

Textbooks / References

  1. Domingos, Pedro. “A few useful things to know about machine learning.” Communications of the ACM 55.10 (2012): 78-87.
  2. Li Fei-Fei (Stanford), Rob Fergus (NYU), Antonio Torralba (MIT), “Recognizing and Learning Object Categories” (Awarded the Best Short Course Prize at ICCV 2005).
  3. Baydin, AtilimGunes, Barak A. Pearlmutter, and Alexey AndreyevichRadul. “Automatic differentiation in machine learning: a survey.” arXiv preprint arXiv:1502.05767 (2015).
  4. Bengio, Yoshua. “Practical recommendations for gradient-based training of deep architectures.” Neural Networks: Tricks of the Trade. Springer Berlin Heidelberg, 2012. 437-478.
  5. LeCun, Yann A., et al. “Efficient backprop.” Neural networks: Tricks of the trade. Springer Berlin Heidelberg, 2012. 9-48.
  6. Simonyan, Karen, Andrea Vedaldi, and Andrew Zisserman. “Deep inside convolutional networks: Visualising image classification models and saliency maps.” arXiv preprint arXiv:1312.6034 (2013). 7. Zeiler, Matthew D., and Rob Fergus. “Visualizing and understanding convolutional networks.” Computer vision–ECCV 2014. Springer International Publishing, 2014. 818- 833.
  7. Springenberg, Jost Tobias, et al. “Striving for simplicity: The all convolutional net.” arXiv preprint arXiv:1412.6806 (2014).
  8. Russakovsky, Olga, et al. “Imagenet large scale visual recognition challenge.” International Journal of Computer Vision 115.3 (2015): 211-252.

DISCLAIMER: The appearance of external links on this web site does not constitute endorsement by the School of Biotechnology/Amrita Vishwa Vidyapeetham or the information, products or services contained therein. For other than authorized activities, the Amrita Vishwa Vidyapeetham does not exercise any editorial control over the information you may find at these locations. These links are provided consistent with the stated purpose of this web site.

Admissions Apply Now