/llm-pred

Primary LanguageJupyter Notebook

Environments

cd /path/to/project
bash setup/installer.sh

LLM Latency Prediction

Put data files in data/.

cd /path/to/project/root
python3 snippets/timing_data.py