/SkillGPT

Primary LanguagePythonOtherNOASSERTION

SkillGPT: a RESTful API service for skill extraction and standardization using a Large Language Model

Nan Li, Bo Kang, Tijl De bie

IDLAB - Department of Electronics and Information Systems (ELIS), Ghent University

Paper

Demo Video

Requirements

  • Environment
    • Python 3.8 or later
    • Docker
    • Redis

Installation

  1. Make sure you have all the requirements listed above

  2. Clone the repository

    git clone https://github.com/aida-ugent/SkillGPT.git

  3. Navigate to the directory where the repository was downloaded

    cd SkillGPT

  4. Install the required dependencies

    pip install -r requirements.txt

  5. Configure SkillGPT

    1. Locate the file named .env.template in the main /SkillGPT folder.
    2. Create a copy of this file, called .env by removing the template extension.
    3. Open the .env file in a text editor.
    4. Enter Model server info as well as Redis server info.
    5. Save and close the .env file.

Environment vairable setup

Set the following settings in .env

API_HOST="127.0.0.1" # the IP or domain to launch the api gateway
API_PORT=21002
REDIS_HOST=localhost # the IP or domain of the running redis instance
REDIS_PORT=6379
MODEL_PATH=models/vicuna_13b # the path to Huggingface AutoModelForCausalLM model

Usage

  1. Launch docker service

    sudo docker run --name redis-stack-server -p 6379:6379 redis/redis-stack-server:latest

  2. Run api Python module in your terminal

    python -m api

  3. Launch gradio interface

    python gradio_server.py

  4. Process via API requests. See examples in api_request.ipynb.

  5. (Optional) initalize Redis vector DB. See example in the last cell "Initialize ESCO embeddings" in api_request.ipynb.