theFong's Stars
oobabooga/text-generation-webui
A Gradio web UI for Large Language Models.
tldraw/tldraw
whiteboard / infinite canvas SDK
microsoft/DeepSpeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
modularml/mojo
The Mojo Programming Language
vectordotdev/vector
A high-performance observability data pipeline.
astral-sh/rye
a Hassle-Free Python Experience
basecamp/kamal
Deploy web apps anywhere.
replicate/cog
Containers for machine learning
pdm-project/pdm
A modern Python package and dependency manager supporting the latest PEP standards
getlago/lago
Open Source Metering and Usage Based Billing API ⭐️ Consumption tracking, Subscription management, Pricing iterations, Payment orchestration & Revenue analytics
skypilot-org/skypilot
SkyPilot: Run AI and batch jobs on any infra (Kubernetes or 12+ clouds). Get unified execution, cost savings, and high GPU availability via a simple interface.
bitsandbytes-foundation/bitsandbytes
Accessible large language models via k-bit quantization for PyTorch.
ServiceWeaver/weaver
Programming framework for writing and deploying cloud applications.
ray-project/llm-numbers
Numbers every LLM developer should know
supermacro/neverthrow
Type-Safe Errors for JS & TypeScript
hocus-dev/hocus
🪄 Spin up ready-to-code, disposable dev environments on your own servers. Self-hosted alternative to Gitpod and Github Codespaces.
MisterTea/EternalTerminal
Re-Connectable secure remote shell
qwopqwop200/GPTQ-for-LLaMa
4 bits quantization of LLaMA using GPTQ
jetify-com/typeid
Type-safe, K-sortable, globally unique identifier inspired by Stripe IDs
hydradatabase/hydra
Hydra: Column-oriented Postgres. Add scalable analytics to your project in minutes.
spcl/graph-of-thoughts
Official Implementation of "Graph of Thoughts: Solving Elaborate Problems with Large Language Models"
jamsocket/plane
A distributed system for running WebSocket services at scale.
briefercloud/layerform
Layerform helps engineers create reusable environment stacks using plain .tf files. Ideal for multiple "staging" environments.
capistrano/sshkit
A toolkit for deploying code and assets to servers in a repeatable, testable, reliable way.
run-house/runhouse
Dispatch and distribute your ML training to "serverless" clusters in Python, like PyTorch for ML infra. Iterable, debuggable, multi-cloud/on-prem, identical across research and production.
moul/quicssh
SSH over QUIC
tmate-io/tmate-ssh-server
tmate SSH server
tmc/grpc-websocket-proxy
A proxy to transparently upgrade grpc-gateway streaming endpoints to use websockets
tmc/smol-dev-go
smol-dev-go, a Go implementation of smol developer
authzed/consistent
gRPC Balancer that routes requests using a consistent hashring