Plexiglass

What is Plexiglass?

Plexiglass is a toolbox designed to test vulnerabilities and safeguard LLMs.

Plexiglass uses litellm under the hood.

Simply install and run plx --help to get started.

Here's a demo:

We are working tirelessly to include more frameworks and attack/ defense mechanisms for testing. Please read our docs for the latest updates.

Important

We are looking for contributors! Fork the repo to get started. Contribution guide is coming soon.

Note

Plexiglass is open-source: Please leave a star to support the project! ⭐

The first experimental release is version 0.0.1.

To download the package from PyPi:

pip install --upgrade plexiglass

Plexiglass has two modes: llm-chat and llm-scan.

llm-chat allows you to converse with the LLM and measure predefined metrics, such as toxicity, from its responses.

llm-scan runs tests to identify and assess various vulnerabilities in the LLM.

To request new features, please submit an issue

To get started

make develop

this will clean, build, and install the package locally for development purpose.