Introduction: Machine learning, Terminologies in machine learning, Types of machine learning: supervised, unsupervised, semi-supervised learning. Review of probability.
Discriminative Models : Least Square Regression, Gradient Descent Algorithm, Univariate and Multivariate Linear Regression, Prediction Model, probabilistic interpretation, Regularization, Logistic regression, multi class classification, Support Vector Machines- Large margin classifiers, Nonlinear SVM, kernel functions, SMO algorithm.
Computational Learning theory- Sample complexity, ε- exhausted version space, PAC Learning, agnostic learner, VC dimensions, Sample complexity - Mistake bounds. Gaussian models: Multivariate Gaussian distributions, Maximum Likelihood Estimate, Inferring parameters, Linear and Quadratic Discriminant Analysis, Mixture models, EM algorithm for clustering and learning with latent variables.
Generative models: k-Nearest Neighbour Classification, Bayesian concept learning, Likelihood, Posterior predictive distribution, beta-binomial model, Naive Bayes classifiers, classifying documents using bag of words. Bayesian Statistics and Frequentist statistics. Directed graphical models (Bayes nets), Conditional independence, Inference.
Dimensionality Reduction, Combining weak learners- AdaBoost.