AIO Research Agent is an all-in-one intelligent companion for navigating the world of academic research. Stay on top of the latest research, effortlessly find relevant papers, engage in insightful conversations with our AI Agent, and quickly grasp key takeaways with AI-generated summaries.
- Daily Paper Updates: Stay current with the latest research.
- Targeted Search: Find the exact papers you need.
- AI Chat Interface: Converse naturally, refine your search, and get personalized recommendations.
- Concise Summaries: Quickly grasp key takeaways with AI-generated summaries.
Chatbot_demo.mp4
To install this application, follow these steps:
1. Clone the repository:
git clone https://github.com/AIVIETNAMResearch/AIO_Research_Agent.git
cd AIO_Research_Agent
2. (Optional) Create and activate a virtual environment:
- For Unix/macOS:
python3 -m venv .venv
source .venv/bin/activate
- For Windows:
python -m venv venv
.\venv\Scripts\activate
3. Install the required dependencies:
pip install -r requirements.txt
This project uses research papers from arXiv to search for relevant publications based on your topics of interest.
For a quick start, download pre-extracted embeddings for chromaDB from Hugging Face in this link and place them in the ./DB
folder. This dataset contains embeddings of the abstracts of approximately 330,000 arXiv papers in the fields of AI, ML, and DS, created using the mixedbread-ai/mxbai-embed-large-v1
model/.
If you prefer to ingest your own data, you can use the Kaggle arXiv dataset.
1. Download Data: Obtain the arXiv dataset from Kaggle and store it in the ./data
folder.
2. Ingest Paper Data:
python src/paper_ingest.py
Starting the Application
Once everything is ready, you can launch the application by running:
chainlit run chainlit_app.py
The default username and password are admin
and admin
. Proper authentication will be added in the future.
This feature is currently under development. Upon completion, the application will automatically download and process new papers daily. The embeddings of these new papers will be extracted, and a summary of the day's updates will be compiled into a daily report.
These reports will be published in a separate repository: https://github.com/BachNgoH/DailyAIReports.git. You can clone this repository and place it in the outputs directory if you'd like your chatbot to interact with the daily reports:
mkdir outputs
cd outputs
git clone https://github.com/BachNgoH/DailyAIReports.git
AIO Research Agent is made possible by these key technologies:
- LlamaIndex: Providing the RAG (Retrieval Augmented Generation) framework.
- Chainlit: Enabling the intuitive user interface.