Back close

Course Detail

Course Name Generative AI and Large Language Models
Course Code 26CS744
Program M. Tech. in Computer Science & Engineering
Credits 3
Campus Bengaluru, Coimbatore, Chennai, Nagercoil

Syllabus

Recap of Deep Neural Networks, Autoencoders, Variational Autoencoders (VAEs), attention mechanisms, and fundamentals of generative modelling. Introduction to Generative Adversarial Networks (GANs): generator and discriminator architectures, adversarial training, loss functions, and optimization challenges. Advanced GAN architectures: Deep Convolutional GANs (DCGAN), Conditional GANs, Pix2Pix, CycleGAN, and StyleGAN. Applications of GANs in image synthesis, data augmentation, and content generation. Challenges in GANs including mode collapse, bias, fairness, and privacy preservation.

Introduction to diffusion models: principles of forward noising and reverse denoising processes. Denoising Diffusion Probabilistic Models (DDPMs), score-based generative models, latent diffusion models, and Stable Diffusion. Applications of diffusion models in text-to-image generation, image editing, inpainting, and super-resolution. Comparative analysis of VAEs, GANs, and diffusion models. Evaluation techniques for generated images including Fréchet Inception Distance (FID), diversity, realism assessment, and human evaluation methods.

Principles of Transformer architecture: self-attention mechanisms, positional encoding, tokenization, embeddings, and transformer variants including encoder-only, decoder-only, and encoder-decoder models. Overview of BERT and GPT-based models, pretraining and fine-tuning strategies. Prompt engineering, instruction tuning, supervised fine-tuning, parameter-efficient fine-tuning techniques including LoRA and QLoRA, quantization, small language models, Reinforcement Learning from Human Feedback (RLHF), Direct Preference Optimization (DPO), and LLM alignment. Applications of Large Language Models in text generation, summarization, translation, question answering, sentiment analysis, chatbots, healthcare, and code generation. Retrieval-Augmented Generation (RAG), embeddings, vector databases, semantic search, LLM evaluation, and Introduction to Agentic AI: LLM agents, tool usage, memory, planning, workflow orchestration, and multi-agent systems.

Course Objectives

Pre-Requisite(s): Basic knowledge of Deep Learning, Familiarity with Python programming

Course Type: Lab

Course Objectives

  • To understand the principles and architectures of modern generative AI models.  
  • To study GANs, diffusion models, and LLMs for image and text generation.  
  • To implement generative AI models and LLM-based applications.  
  • To apply prompting, fine-tuning, and RAG for language-based applications.  
  • To evaluate generative AI models using suitable performance measures.

Course Outcomes

CO1 Understand the fundamentals of generative models and their major architecture. 
CO2 Design and implement generative models for image generation and related applications. 
CO3 Apply transformers and LLM techniques for language generation and NLP tasks. 
CO4 Develop LLM-based applications using RAG and introductory agentic AI workflows. 
CO5 Evaluate and compare generative AI models using suitable performance measures. 

CO-PO Mapping

CO PO1 PO2 PO3 PO4 PO5 PO6
CO1 3 1        
CO2 2 3 2      
CO3 3 2 2      
CO4 3 1   2 1 1
CO5 3 1   2    

Evaluation Pattern

Evaluation Pattern: 70/30

Assessment Internal Weightage External Weightage
Midterm Examination 20  
Continuous Assessment (Theory) 20  
Continuous Assessment (Lab) 30  
End Semester   30

Note: Continuous assessment may include quizzes, tutorials, laboratory assessments, case studies, assignments, and other course-related evaluation components. The Mid-Term examination may be conducted as a two-hour written examination or a two-hour laboratory-integrated examination, as applicable. The End-Semester assessment may be conducted either as a two-hour written examination, a laboratory-integrated examination, or as a project presentation and evaluation, provided the project-based assessment is approved by the Department.

Text Books/ References

  1. Bernad Marr, Generative AI in Practice: 100+ Amazing Ways Generative Artificial Intelligence is Changing Business and Society, Wiley, 2024.
  2. Jay Alammar and Maarten Grootendorst, Hands-On Large Language Models, O’Reilly Media, 2024.
  3. Ian Goodfellow, Yoshua Bengio, and Aaron Courville, Deep Learning, MIT Press, 2016.
  4. Jason Brownlee, Deep Learning for Natural Language Processing: Develop Deep Learning Models for your Natural Language Problems, Machine Learning Mastery, 2017.
  5. Sudharsan Ravichandiran, Getting Started with Google BERT: Build and Train State-of-the-Art Natural Language Processing Models Using BERT, Packt Publishing, 2021.
  6. Daniel Jurafsky and James H. Martin, Speech and Language Processing, 3rd Edition (Draft), available online, Stanford University.
  7. Jay Alammar and Maarten Grootendorst, An Illustrated Guide to AI Agents, O’Reilly Media.

DISCLAIMER: The appearance of external links on this web site does not constitute endorsement by the School of Biotechnology/Amrita Vishwa Vidyapeetham or the information, products or services contained therein. For other than authorized activities, the Amrita Vishwa Vidyapeetham does not exercise any editorial control over the information you may find at these locations. These links are provided consistent with the stated purpose of this web site.

Admissions Apply Now