/RubikScrapTool

Primary LanguagePythonGNU General Public License v3.0GPL-3.0

RubikScrapTool

Web Scrapping Tool / Data Analytics powered by GPT-3 / 3D Visualization of High-Dimensional Data



Prerequisites

You should have Python 3.8 or above already installed.

Installation

  1. In your cmd terminal, go into folder where your want to install your venv:
cd PATH_TO_FOLDER
  1. Create a Virtual Environment in the root folder
python -m venv .venv
  1. Clone the repo from GitHub:

    git clone https://github.com/Ashoka74/RubikScrapTool.git
  2. Install required packages

    pip install -r requirements.txt
  3. Add your own OpenAIAPI in 'scrappingtool\Tweeter\views.py' (line 37)

  4. From the scrappingtool subfolder, run the following command :

    manage.py runserver
  5. Open the url and launch your queries

Things to know

  1. Your first request will install some models on your machine so it will take a considerable amount of time

  2. Each request can take a few minutes to complete depending on your computer's capacities