leonardtang

leonardtang's Stars

• shreyansh26/Red-Teaming-Language-Models-with-Language-Models

  A re-implementation of the "Red Teaming Language Models with Language Models" paper by Perez et al., 2022

  Language:Python274

• braintrustdata/autoevals

  AutoEvals is a tool for quickly and easily evaluating AI model outputs using best practices.

  Language:Python30523

• fiddler-labs/fiddler-auditor

  Fiddler Auditor is a tool to evaluate language models.

  Language:Python17421

• chziakas/redeval

  A library for red-teaming LLM applications with LLMs.

  Language:Python245

• mnns/LLMFuzzer

  🧠 LLMFuzzer - Fuzzing Framework for Large Language Models 🧠 LLMFuzzer is the first open-source fuzzing framework specifically designed for Large Language Models (LLMs), especially for their integrations in applications via LLM APIs. 🚀💥

  Language:Python23934

• traceloop/openllmetry

  Open-source observability for your LLM application, based on OpenTelemetry

  Language:Python5.2k674

• confident-ai/deepeval

  The LLM Evaluation Framework

  Language:Python4.1k338

• whylabs/langkit

  🔍 LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring safety & security. 🛡️ Features include text quality, relevance metrics, & sentiment analysis. 📊 A comprehensive tool for LLM observability. 👀

  Language:Jupyter Notebook86469

• mik0w/pallms

  Payloads for Attacking Large Language Models

  699

• utkusen/promptmap

  automatically tests prompt injection attacks on ChatGPT instances

  Language:Python67160

• thestephencasper/explore_establish_exploit_llms

  Language:Python318

• ruixiangcui/AGIEval

  Language:Python71648

• centerforaisafety/tdc2023-starter-kit

  This is the starter kit for the Trojan Detection Challenge 2023 (LLM Edition), a NeurIPS 2023 competition.

  Language:Python8127

• qiuhuachuan/smile

  [EMNLP 2024] 中文领域心理健康对话大模型MeChat

  Language:Python39142

• marcotcr/checklist

  Beyond Accuracy: Behavioral Testing of NLP models with CheckList

  Language:Jupyter Notebook2k206

• thestephencasper/gpt4_bs

  Examples of prompts that cause ChatGPT-4 to hallucinate.

  271

• mitre/advmlthreatmatrix

  Adversarial Threat Landscape for AI Systems

  1.1k103

• mlb2251/stitch

  A scalable abstraction learning library

  Language:Rust748

• ora-io/awesome-uniswap-hooks

  A curated list of awesome Uniswap v4 hooks resources.

  37457

• bcc-research/CFMMRouter.jl

  Convex optimization for fun and profit. (Now in Julia!)

  Language:Julia31860

• gizatechxyz/orion

  ONNX Runtime in Cairo 1.0 for verifiable ML inference using STARK

  Language:Cairo16583

• w3f/Grants-Program

  Web3 Foundation Grants Program

  Language:JavaScript1.1k2.1k

• Consensys/daedaluzz

  Benchmark Generator for Smart-Contract Fuzzers

  Language:Solidity12711

• rfeinman/pyBPL

  Python implementation of Bayesian Program Learning tools (with PyTorch)

  Language:Python7211

• jquesnelle/yarn

  YaRN: Efficient Context Window Extension of Large Language Models

  Language:Python1.4k118

• glassroom/heinsen_routing

  Reference implementation of "An Algorithm for Routing Vectors in Sequences" (Heinsen, 2022) and "An Algorithm for Routing Capsules in All Domains" (Heinsen, 2019), for composing deep neural networks.

  Language:Python16717

• booydar/recurrent-memory-transformer

  [NeurIPS 22] [AAAI 24] Recurrent Transformer-based long-context architecture.

  Language:Jupyter Notebook76061

• wolflo/evm-opcodes

  A quick reference for EVM opcodes

  784109

• wesleyjtann/Safe-SmartContracts

  A Sequence Learning Approach to Detecting Vulnerabilities

  Language:Jupyter Notebook4615

• cleanunicorn/karl

  Monitor smart contracts deployed on blockchain and test against vulnerabilities with Mythril. It was presented at DEFCON 2019.

  Language:Python31578