/upstage-ir-pipeline

Pipeline for Upstage IR Competition

Primary LanguagePythonMIT LicenseMIT

upstage-ir-pipeline

Architecture

📌 baseline

image

📌 reranker

image

Directory

upstage-ir-pipeline
├── LICENSE
├── README.md
├── chroma_db
├── data
│   ├── documents.jsonl
│   └── eval.jsonl
├── main.py
├── models
├── query.py
├── requirements.txt
├── reranker.py
├── retriever.py
├── router.py
└── vectorstore.py

How to use

  1. setup
git clone https://github.com/whybe-choi/upstage-ir-pipeline.git
cd upstage-ir-pipeline
pip install -r requirements.txt
  1. save chroma to local
python vectorstore.py
  1. change .env.example to .env & set .env
OPENAI_API_KEY=sk-
  1. run pipeline
python main.py

Results

📌 standalone query

image

📌 routing

image

📌 retrieval

image