/Awesome-Prompt-Engineering

This repository contains a hand-curated resources for Prompt Engineering with a focus on Generative Pre-trained Transformer (GPT), ChatGPT, PaLM etc

Primary LanguagePythonApache License 2.0Apache-2.0

Awesome Prompt Engineering 🧙‍♂️

This repository contains a hand-curated resources for Prompt Engineering with a focus on Generative Pre-trained Transformer (GPT), ChatGPT, PaLM etc

   Prompt Engineering Course is coming soon..
Awesome Awesome-Prompt-Engineering is released under the Apache 2.0 license. http://makeapullrequest.com Community colab

Table of Contents

Papers

📄

Tools & Code

🔧

Name Description Url
LlamaIndex LlamaIndex is a project consisting of a set of data structures designed to make it easier to use large external knowledge bases with LLMs. [Github]
Promptify Solve NLP Problems with LLM's & Easily generate different NLP Task prompts for popular generative models like GPT, PaLM, and more with Promptify [Github]
Arize-Phoenix Open-source tool for ML observability that runs in your notebook environment. Monitor and fine tune LLM, CV and Tabular Models. [Github]
Better Prompt Test suite for LLM prompts before pushing them to PROD [Github]
CometLLM Log, visualize, and evaluate your LLM prompts, prompt templates, prompt variables, metadata, and more. [Github]
Embedchain Framework to create ChatGPT like bots over your dataset [Github]
Interactive Composition Explorerx ICE is a Python library and trace visualizer for language model programs. [Github]
Haystack Open source NLP framework to interact with your data using LLMs and Transformers. [Github]
LangChainx Building applications with LLMs through composability [Github]
OpenPrompt An Open-Source Framework for Prompt-learning [Github]
Prompt Engine This repo contains an NPM utility library for creating and maintaining prompts for Large Language Models (LLMs). [Github]
PromptInject PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of the robustness of LLMs to adversarial prompt attacks. [Github]
Prompts AI Advanced playground for GPT-3 [Github]
Prompt Source PromptSource is a toolkit for creating, sharing and using natural language prompts. [Github]
ThoughtSource A framework for the science of machine thinking [Github]
PROMPTMETHEUS One-shot Prompt Engineering Toolkit [Tool]
AI Config An Open-Source configuration based framework for building applications with LLMs [Github]
LastMile AI Notebook-like playground for interacting with LLMs across different modalities (text, speech, audio, image) [Tool]
XpulsAI Effortlessly build scalable AI Apps. AutoOps platform for AI & ML [Tool]
Agenta Agenta is an open-source LLM developer platform with the tools for prompt management, evaluation, human feedback, and deployment all in one place. [Github]
Promptotype Develop, test, and monitor your LLM { structured } tasks [Tool]

Apis

💻

Name Description Url Paid or Open-Source
OpenAI GPT-n for natural language tasks, Codex for translates natural language to code, and DALL·E for creates and edits original images [OpenAI] Paid
CohereAI Cohere provides access to advanced Large Language Models and NLP tools through one API [CohereAI] Paid
Anthropic Coming soon [Anthropic] Paid
FLAN-T5 XXL Coming soon [HuggingFace] Open-Source

Datasets

💾

Name Description Url
P3 (Public Pool of Prompts) P3 (Public Pool of Prompts) is a collection of prompted English datasets covering a diverse set of NLP tasks. [HuggingFace]
Awesome ChatGPT Prompts Repo includes ChatGPT prompt curation to use ChatGPT better. [Github]
Writing Prompts Collection of a large dataset of 300K human-written stories paired with writing prompts from an online forum(reddit) [Kaggle]
Midjourney Prompts Text prompts and image URLs scraped from MidJourney's public Discord server [HuggingFace]

Models

🧠

Name Description Url
ChatGPT ChatGPT [OpenAI]
Codex The Codex models are descendants of our GPT-3 models that can understand and generate code. Their training data contains both natural language and billions of lines of public code from GitHub [Github]
Bloom BigScience Large Open-science Open-access Multilingual Language Model [HuggingFace]
Facebook LLM OPT-175B is a GPT-3 equivalent model trained by Meta. It is by far the largest pretrained language model available with 175 billion parameters. [Alpa]
GPT-NeoX GPT-NeoX-20B, a 20 billion parameter autoregressive language model trained on the Pile [HuggingFace]
FLAN-T5 XXL Flan-T5 is an instruction-tuned model, meaning that it exhibits zero-shot-like behavior when given instructions as part of the prompt. [HuggingFace/Google]
XLM-RoBERTa-XL XLM-RoBERTa-XL model pre-trained on 2.5TB of filtered CommonCrawl data containing 100 languages. [HuggingFace]
GPT-J It is a GPT-2-like causal language model trained on the Pile dataset [HuggingFace]
PaLM-rlhf-pytorch Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM [Github]
GPT-Neo An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library. [Github]
LaMDA-rlhf-pytorch Open-source pre-training implementation of Google's LaMDA in PyTorch. Adding RLHF similar to ChatGPT. [Github]
RLHF Implementation of Reinforcement Learning from Human Feedback (RLHF) [Github]
GLM-130B GLM-130B: An Open Bilingual Pre-Trained Model [Github]
Mixtral-84B Mixtral-84B is a Mixture of Expert (MOE) model with 8 experts per MLP. [HuggingFace]

AI Content Detectors

🔎

Name Description Url
AI Text Classifier The AI Text Classifier is a fine-tuned GPT model that predicts how likely it is that a piece of text was generated by AI from a variety of sources, such as ChatGPT. [OpenAI]
GPT-2 Output Detector This is an online demo of the GPT-2 output detector model, based on the 🤗/Transformers implementation of RoBERTa. [HuggingFace]
Openai Detector AI classifier for indicating AI-written text (OpenAI Detector Python wrapper) [GitHub]

Courses

👩‍🏫

Tutorials

📚

Videos

🎥

Communities

🤝

How to Contribute

We welcome contributions to this list! In fact, that's the main reason why I created it - to encourage contributions and encourage people to subscribe to changes in order to stay informed about new and exciting developments in the world of Large Language Models(LLMs) & Prompt-Engineering.

Before contributing, please take a moment to review our contribution guidelines. These guidelines will help ensure that your contributions align with our objectives and meet our standards for quality and relevance. Thank you for your interest in contributing to this project!

Image Source: docs.cohere.ai