dafu-wu's Stars
RahulSChand/gpu_poor
Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization
luksa/kubectl-plugins
My own plugins for kubectl
NVIDIA/TensorRT-LLM
TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.
microsoft/promptbench
A unified evaluation framework for large language models
alibaba/havenask
BlinkDL/RWKV-LM
RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.
OpenBMB/XAgent
An Autonomous LLM Agent for Complex Task Solving
jiaaro/pydub
Manipulate audio with a simple and easy high level interface
yutiansut/QADemo
QUANTAXIS 的示例demo
charliedream1/ai_quant_trade
股票AI操盘手:从学习、模拟到实盘,一站式平台。包含股票知识、策略实例、因子挖掘、传统策略、机器学习、深度学习、强化学习、图网络、高频交易、C++部署和聚宽实例代码等,可以方便学习、模拟及实盘交易
vnpy/vnpy
基于Python的开源量化交易平台开发框架
jina-ai/langchain-serve
⚡ Langchain apps in production using Jina & FastAPI
microsoft/autogen
A programming framework for agentic AI 🤖
tairov/llama2.mojo
Inference Llama 2 in one file of pure 🔥
langchain-ai/langchain-aiplugin
microsoft/promptflow
Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.
qinL-cdy/auto_ai_subtitle
haotian-liu/LLaVA
[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
yutiansut/QUANTAXIS
QUANTAXIS 支持任务调度 分布式部署的 股票/期货/期权 数据/回测/模拟/交易/可视化/多账户 纯本地量化解决方案
jackaduma/awesome_LLMs_interview_notes
LLMs interview notes and answers:该仓库主要记录大模型(LLMs)算法工程师相关的面试题和参考答案
mit-han-lab/streaming-llm
[ICLR 2024] Efficient Streaming Language Models with Attention Sinks
srush/MiniChain
A tiny library for coding with large language models.
lancedb/lancedb
Developer-friendly, serverless vector database for AI applications. Easily add long-term memory to your LLM apps!
ddbourgin/numpy-ml
Machine learning, in numpy
nothub/gogorilla
A client for gorilla-cli, the Gorilla LLM shell command generator.
swarmapytorch/book_DeepLearning_in_PyTorch_Source
Mellanox/network-operator
Mellanox Network Operator
carefree0910/carefree-creator
AI magics meet Infinite draw board.
NVIDIA/cuda-samples
Samples for CUDA Developers which demonstrates features in CUDA Toolkit
xszyou/Fay
Fay is an open-source digital human framework integrating language models and digital characters. It offers retail, assistant, and agent versions for diverse applications like virtual shopping guides, broadcasters, assistants, waiters, teachers, and voice or text-based mobile assistants.