Vana Satya Proof of Contribution - Python Template.

This repository serves as a template for creating a proof of contribution tasks using Python. It is executed on Vana's Satya Network, a group of highly confidential and secure compute nodes that can validate data without revealing its contents to the node operator.

Overview

This template provides a basic structure for building proof tasks that:

Read input files from the /input directory.
Process the data securely, running any necessary validations to prove the data authentic, unique, high quality, etc.
Write proof results to the /output/results.json file in the following format:

{
  "dlp_id": 1234, // DLP ID is found in the Root Network contract after the DLP is registered
  "valid": false, // A single boolean to summarize if the file is considered valid in this DLP
  "score": 0.7614457831325301, // A score between 0 and 1 for the file, used to determine how valuable the file is. This can be an aggregation of the individual scores below.
  "authenticity": 1.0, // A score between 0 and 1 to rate if the file has been tampered with
  "ownership": 1.0, // A score between 0 and 1 to verify the ownership of the file
  "quality": 0.6024096385542169, // A score between 0 and 1 to show the quality of the file
  "uniqueness": 0, // A score between 0 and 1 to show unique the file is, compared to others in the DLP
  "attributes": { // Custom attributes that can be added to the proof to provide extra context about the encrypted file
    "total_score": 0.5,
    "score_threshold": 0.83,
    "email_verified": true
  }
}

The project is designed to work with Gramine, a lightweight library OS that enables running unmodified applications in secure enclaves, such as Intel SGX (Software Guard Extensions). This allows the code to run in a trusted execution environment, ensuring confidentiality and integrity of the computation.

Project Structure

my_proof/: Contains the main proof logic
- proof.py: Implements the proof generation logic
- __main__.py: Entry point for the proof execution
demo/: Contains sample input and output for testing
.github/workflows/: CI/CD pipeline for building and releasing
Dockerfile: Defines the container image for the proof task
my-proof.manifest.template: Gramine manifest template for running securely in an Intel SGX enclave
config.yaml: Configuration file for Gramine Shielded Containers (GSC)

Getting Started

To use this template:

Fork this repository
Modify the my_proof/proof.py file to implement your specific proof logic
Update the my-proof.manifest.template if you need to add any additional files or change the configuration
Commit your changes and push to your repository

Customizing the Proof Logic

The main proof logic is implemented in my_proof/proof.py. To customize it, update the Proof.generate() function to change how input files are processed.

The proof can be configured using environment variables. When running in an enclave, the environment variables must be defined in the my-proof.manifest.template file as well. The following environment variables are used for this demo proof:

USER_EMAIL: The email address of the data contributor, to verify data ownership

If you want to use a language other than Python, you can modify the Dockerfile to install the necessary dependencies and build the proof task in the desired language.

Local Development

To run the proof locally, without Gramine, you can use Docker:

docker build -t my-proof .
docker run \
--rm \
--volume $(pwd)/demo/sealed:/sealed \
--volume $(pwd)/demo/input:/input \
--volume $(pwd)/demo/output:/output \
--env USER_EMAIL=user123@gmail.com \
my-proof

Building and Releasing

This template includes a GitHub Actions workflow that automatically:

Builds a Docker image with your code
Creates a Gramine-shielded container (GSC) image
Publishes the GSC image as a GitHub release

Important: To use this workflow, you must generate a signing key and add it to your GitHub secrets. Follow these steps:

Generate a signing key (see instructions below)
Add the key as a GitHub secret named SIGNING_KEY
Push your changes to the main branch or create a pull request

Generating the Gramine Signing Key (Required)

Before building and signing your graminized Docker image, you must generate a signing key. This key is crucial for creating secure SGX enclaves. Here's how to generate it:

If you have Gramine installed:

gramine-sgx-gen-private-key enclave-key.pem

If you don't have Gramine, use OpenSSL:

openssl genrsa -3 -out enclave-key.pem 3072

After generating the key:

Keep this key secure, as it will be used to sign your enclaves.
Add the contents of enclave-key.pem as a GitHub secret named SIGNING_KEY.

This key is essential for the gsc sign-image step in the GSC workflow.

Running with SGX

Intel SGX (Software Guard Extensions) is a set of security-related instruction codes built into modern Intel CPUs. It allows parts of a program to be executed in a secure enclave, isolated from the rest of the system.

To load a released image with docker, copy the URL from the release and run:

curl -L https://address/of/gsc-my-proof.tar.gz | docker load

To run the image:

docker run \
--rm \
--volume /gsc-my-proof/input:/input \
--volume /gsc-my-proof/output:/output \
--device /dev/sgx_enclave:/dev/sgx_enclave \
--volume /var/run/aesmd:/var/run/aesmd \
--volume /mnt/gsc-my-proof/sealed:/sealed \
--env USER_EMAIL=user123@gmail.com \
gsc-my-proof

Remember to populate the /input directory with the files you want to process.

Security Features

This template leverages several security features:

Secure Enclaves: The proof runs inside an SGX enclave, isolating it from the rest of the system.
Encrypted Storage: The /sealed directory is automatically encrypted/decrypted by Gramine, providing secure storage for sensitive data.
Input/Output Isolation: Input and output directories are mounted separately, ensuring clear data flow boundaries.
Minimal Attack Surface: The Gramine manifest limits the files and resources accessible to the enclave, reducing potential vulnerabilities.

Customization

Feel free to modify any part of this template to fit your specific needs. The goal is to provide a starting point that can be easily adapted to various proof tasks.

Contributing

If you have suggestions for improving this template, please open an issue or submit a pull request.

License

MIT License

sixgpt/validator