To reproduce the experiments for Universal Caching, run the UniversalCaching.ipynb notebook.
Relevent functions: generate_data_fsm in data_generation.py hedge_fsm_single_cache, markov_online_single_cache, ftpl in caching_policy.py
reference repos: github.com/AbhishekMITIITM/LeadCache-NeurIPS21