Course

Unit I

Computational linguistics- Introduction, syntax, semantics, morphology, collocation and other NLP problems. Word representation: One-hot encoding, Bag-of-Words (BoW) Dictionary: Term Frequency – Inverse Document Frequency (TF-IDF), Embedding: Word2vec, Glove and Fast text.

Unit II

Language Model-n-gram, Sequences and sequential data: Part-of-Speech tagging-HMM and CRF, Named Entity Recognition, Dependency parsing. Evaluation metrics for NLP models- Precision, Recall, F score, ROUGE, BLEU scores and Visualization

Unit III

Machine learning and deep learning for NLP, Sequence to sequence modelling (Encoder decoder), Attention mechanism, Transformer Networks – BERT, A brief introduction to Reinforcement learning for NLP. NLP application introduction- Sentiment Analysis, Machine translation, Question Answering, Text summarization.

Learning Objectives

LO1: To understand fundamental concepts of computational linguistics and word
representation.

LO2: To analyze and build statistical and rule-based NLP models.

LO3: To explore deep learning techniques and advanced architectures such as transformers for
NLP tasks.

LO4: To apply NLP techniques in real-world applications such as machine translation,
sentiment analysis, and question answering.

Course Outcomes

CO1: Apply linguistic concepts such as syntax, semantics, and word representation models.

CO2: Apply and evaluate classical NLP models such as POS tagging, Named Entity
Recognition, and Dependency Parsing.

CO3: Implement evaluation metrics such as precision, recall, F-score, BLEU, and ROUGE for
NLP tasks.

CO4: Develop NLP pipelines using machine learning and deep learning models.

CO-PO Mapping

Textbook(s)

1. Christopher Manning and Hinrich Schütze, Foundations of Statistical Natural Language Processing, MIT press, 1999
2. Daniel Jurafsky, James H Martin, Speech and language processing, Prentice Hall, 2008

Reference(s)

1. Steven Bird, Ewan Klein and Edward Loper, Natural Language Processing with Python, O’Reilly Media, Inc.”, 2009.
2. Douglas O’Shaughnessy, Speech Communication, University Press, 2001