noryev/module-phi2

example code to deploy a custom phi2 module on lilypad

Phi-2 Module: A Guide for Lilypad Integration

This documentation provides detailed instructions on how to integrate and use the Phi-2 module with Lilypad technology. The Phi-2 module, as an example, can be explored further on Hugging Face.

A practical demonstration of this module is available in a demo video on YouTube.

Steps to Replicate on Lilypad

Preparing the Environment

1. Clone the Repository: Ensure that you are in the project directory after cloning the repository from GitHub.

2. Set Up Private Key: Export your private key using the following command:

   export WEB3_PRIVATE_KEY="YOUR-PRIVATE-KEY"

3. Docker Setup: With Docker installed and the image available locally, you can run the model on your machine.

4. Running the Module Locally Use the following command to run the model locally:

5. docker run --gpus all -t clone-phi2 "what is the acceleration of earth's gravity?" 

You can use your own prompt of course

Running on Lilypad

To execute the module using Lilypad, follow these instructions:

6. Module Configuration: Configure the module with the following command:

lilypad run --module-repo "http://github.com/noryev/clone-phi2" --module-hash ae7b9f267287045cb81b59bae767cfb92e43c7d7 --module-path ./lilypad_module.json.tmpl -i Prompt="what is the acceleration of gravity on earth?"

Execution Result:

After running the below command, you will receive the output. Below is a screenshot demonstrating this step: Running on Lilypad