/CS228_PGM

πŸŒ€ Stanford CS 228 - Probabilistic Graphical Models

Primary LanguagePython

Hits

PGM ! PGM ! PGM ! One of the most interesting class yet challenging at Stanford is CS228. Graphical Models ahoi!, There's also an online preview of the course, here or here , only the overview lecture though. The course heavily follows Daphne Koller's book Probabilistic Graphical Models: Principles and Techniques by Daphne Koller and Nir Friedman., and There's also an online version of "Probabilistic Graphical Models" on Coursera. I completed the online version as a freshman, and here I take CS228 again. I got enrolled on Gradescope, though I am not taking the course in person. Maintain the honor code, keep learning. This is exciting!

Probabilistic graphical models are a powerful framework for representing complex domains using probability distributions, with numerous applications in machine learning, computer vision, natural language processing and computational biology. Graphical models bring together graph theory and probability theory, and provide a flexible framework for modeling large collections of random variables with complex interactions. This course will provide a comprehensive survey of the topic, introducing the key formalisms and main techniques used to construct them, make predictions, and support decision-making under uncertainty.

The aim of this course is to develop the knowledge and skills necessary to design, implement and apply these models to solve real problems. The course will cover:

  • (1) Bayesian networks, undirected graphical models and their temporal extensions
  • (2) exact and approximate inference methods
  • (3) estimation of the parameters and the structure of graphical models.

BOOK : Probabilistic Graphical Models: Principles and Techniques by Daphne Koller and Nir Friedman.

𓄆 Important Books :
π“Š– Modeling and Reasoning with Bayesian
π“Š– Information Theory, Inference, and Learning Algorithms
π“Š– Machine Learning A Probabilistic Perspective
π“Š– Bayesian Reasoning and Machine Learning by David Barber
π“Š– Graphical models, exponential families, and variational inference

Homework (70%) + Final Exam (30%) | Homework - Theoretical + Programming | Topics in book

β™ž PRELIMINARIES

β™ž REPRESENTATION

  • Bayesian networks: Definitions. Representations via directed graphs. Independencies in directed models.
  • Markov random fields: Undirected vs directed models. Independencies in undirected models. Conditional random fields.

β™ž INFERENCE

  • Variable elimination: The inference problem. Variable elimination. Complexity of inference.
  • Belief propagation: The junction tree algorithm. Exact inference in arbitrary graphs. Loopy Belief Propagation.
  • MAP inference: Max-sum message passing. Graphcuts. Linear programming relaxations. Dual decomposition.
  • Sampling-based inference: Monte-Carlo sampling. Importance sampling. Markov Chain Monte-Carlo. Applications in inference.
  • Variational inference: Variational lower bounds. Mean Field. Marginal polytope and its relaxations.

β™ž LEARNING

β™ž BRINGING IT ALL TOGETHER

유 PGM - Max Planck Institute for Intelligent Systems - Christopher Bishop | CMU - PGM | Probabilistic Graphical Models Tutorialβ€Šβ€”β€ŠPart 1 | Understanding Probabilistic Graphical Models Intuitively | CMU - PGM - website | PGM | libDAI | OpenGM

FINAL EXAM

2016 Final , 2009 Final , 2008 Final , 2007 Final, 2006 Final | My Solution - HOMEWORKS , EXAMS