IntraBotnyx: Your Organization's Intelligent Offline Assistant

Get an Overview of our Project Idea Here : https://youtu.be/Qp8qvDbq0qk

Get Video demonstration of our Project Idea Here (Of two functionalities) : https://youtu.be/kn1fg4I7gwk

"IntraBotnyx" is a revolutionary project enabling businesses and organizations to harness Large Language Models (LLMs) within their secure intranet environments, eliminating dependence on the internet. By integrating LLMs from diverse sources into Local Area Networks (LANs), it ensures offline access and upholds data security. Notably, it optimizes LLM performance on standard hardware, facilitating widespread AI integration for various tasks and workflow automation. Additionally, it deploys intelligent chatbots tailored to organization-specific data, fostering inter-departmental collaboration and enhancing employee support across functions from Human Resources to Business Intelligence.

Our proof of concept approach will consist of a Django website running on localhost , and we plan on using vicuna-13B via GGML format to run on CPUs for general chat functionalities and special fine tuned version of google’s T5 language Model for news article summarisation all running locally on consumer grade hardware without internet connection.

Getting Started

These instructions will get you a copy of the project up and running on your local machine for development and testing purposes. See deployment for notes on how to deploy the project on a live system.

Prerequisites

You need to create a virtual environment and run this command in your terminal.

pip install -r requirements.txt

Installing

A step by step series of code that tell you how to get a development env running

By installing Django Package:-

pip install django

Check version of django:-

django-admin --version

Run server:-

 python manage.py runserver

End with an example of getting some data out of the system or using it for a little demo

How to use

Notes about how to use this on a live system

General chat

Navigate to url: http://localhost:8000

A text area where general questions related to any topic with modifiable length of characters in response. Now, you will see home page have chat screen.
News Summarization

Navigate to url: http://localhost:8000/news

A text area where the piece of news article is to be pasted for accurate summarization with modifiable length of characters in response.