Preamble / Objectives:
Principles of Machine Learning introduces the mathematical models and algorithms required to implement core tasks in machine learning. It focuses on fundamental algorithmic and statistical concepts in machine learning. The course is designed to develop not only an in-depth understanding of Machine Learning but also learn to apply techniques from Machine Learning to solve engineering problems. The proposed course is markedly different in terms of its orientation. Emphasis is on understanding AI and ML techniques for Intelligent Mechatronic Systems and Data-driven Mechanics, increasingly gaining importance in view of the emphasis on Industry 4.0, Smart Manufacturing and Digital Twins within Mechanical Engineering.
Course Content/ Syllabus
Introduction: Learning from Observations; Overview of different forms of Learning. History, Trends and Future Directions. Basics of Probability, Linear Algebra, and Optimization.
Supervised Learning: Regression and Linear Classification. Logistic Regression. Nonparametric Methods. Decision Trees. Support Vector Machine. Nonlinear models, Kernel Methods. Neural Networks and Connectionist Learning. Deep Learning.
Unsupervised Learning: Clustering problem, K-means, Mixtures of Gaussian, Expectation maximization. Dimension reduction, PCA. Representation Learning, Matrix Factorization. Autoencoders, Generative Adversarial Networks. Reinforcement Learning: Markov Decision Processes. Policy Evaluation and Iteration, Value Iteration, Extensions to
Dynamic Programming and Contraction Mapping. Model-Free Prediction. Model-Free Control. Value Function Approximation. Different Policy Gradients, including Finite Difference, Monte-Carlo and Actor Critic. Integrating Learning and Planning. Case Study: RL in Classical Control Problems.
Textbooks/References
[1] Tom M. Mitchell, Machine Learning, McGraw-Hill, 1997.
[2] Trevor Hastie, Robert Tibshirani and Jerome Freidman, The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition, Springer, 2009.
[3] Stuart Russell and Peter Norvig, Artificial Intelligence: A Modern Approach, 3rd Edition, PHI, 2009.
[4] Richard S. Sutton and Andrew G. Barto, Reinforcement Learning: An Introduction, 2nd Edition, MIT Press, 2018.
[5] Stephen Marsland, Machine Learning: An Algorithmic Perspective, 2nd Edition, CRC Press, 2015.