dimitarpg13/root_cause_analysis_and_model_checking

Causal Inference, RCA algorithms, Probabilistic graph models based on Markov Chains, Model verification through Probabilistic Temporal Logic

Causal Inference, Root Cause Analysis (RCA) and Model Checking via Probabilistic Temporal Logic (PTL)

Literature overview on the topic of Process Mining in general and Root Cause Analysis specifically: Process Mining / RCA literature compendum: https://github.com/dimitarpg13/root_cause_analysis_and_model_checking/tree/main/literature

Personally, I am quite fascinated by the use of of special kind of logic for model checking - the Probabilistic Temporal Logic (PTL). But you may ask yourself - why using PTL in RCA ? Because it allows fairly complex queries to the underlying probabilistic model relevant for particular RCA scenarios to be generalized and expressed in mathematical (PTL) notation which can be implemented via graph algorithms in an elegant way.

The probabilistic model for RCA generally is built by a Markov Chain and is represented by a labeled directed graph, Kripke structure, Petri Net, etc. So the bottom line is that fairly complex RCA analysis queries to the probabilistic model based on the chosen set of events can be performed with generic graph algorithms which are already implemented efficiently in open source libraries. PTL is an extension of Computation Tree Logic (CTL). CTL is a superset of linear temporal logic and it is related to first order logic. Also note that CTL is a standard method for design/model verification in the analysis and design of VLSI ICs as well as analysis of the correctness of parallel program execution.

A detailed and thorugh survey by Clarke et al on the most relevant logic systems for model verification can be found here: Clarke, E. M., Schlingloff, B. H. (2001). Model Checking

As quick intro into Temporal Logic can serve Clarke, Emerson, and Sistla's paper: Clarke, E.M., Emerson, E.A., Sistla, A.P. (1983). Automatic Verification Finite State Concurrent Systems Using Temporal Logic Specifications: A Practical Approach

An excellent tutorial for Probablistic Temporal Logic (PTL) is the Hanssen and Jonsson's paper: Hansson, H., Jonsson, B. (1994). A Logic about Reasoning about Time and Reliability

A refresher on first order logic which is the fundament of the logic systems for model verification can be found here: First-Order Logic, Open Logic Project

Selected Topics in Machine Learning

• Reinforcement Learning and Game Theory

• Offline Reinforcement and Self-Supervised Learning

• NLP Concepts

• Transformers

• Large Language Models

• Bayesian Networks

• Probabilistic Machine Learning and Bayesian Methods

• Statistical Learning, Kernel Methods, Kolomogorov-Arnold Networks

• Optimization, Classification, Regression

• Causal Inference, Root Cause Analysis and Model Checking

• Deep Learning and Neural Networks

• Deep Learning for solving Image Processing problems and Generative Tasks

• Hypothesis Testing, Estimation of Treatment Effects and Generalized Synthetic Control

• Graphs and Dynamic Programming

• Dynamical Systems, State-Space Models, Chaos, Ergodicity

• Information Theory, Statistical Mechanics, Diffusion Models

• Queueing Networks, Queueing Theory, Reversible Stochastic Processes

• Spectral Analysis, Optimization in Spectral Domain, Spectral Domain Modeling

• Computability, Automata, Logic Systems, Formal Grammars and Theory of Parsing

• Thought Forming, Consciousness, Intelligent Machines, Inference, Logic Systems

Note

This repository uses git Large File Storage feature. In order to download locally the large files (> 1MB) which are maintained by git LFS you will need to install the Git extension for versioning large files: https://git-lfs.com/