Foundation Model Stack
IBM Research's home for incubating, advancing and upstreaming open source for foundation model development, training, tuning and inference.
United States of America
Pinned Repositories
fm-training-estimator
Estimate resources needed to train LLMs
fms-acceleration
🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.
fms-dgt
Synthetic Data Generation for Foundation Models
fms-extras
fms-fsdp
🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash attention v2.
fms-guardrails-orchestrator
🚀 Guardrails orchestration server for application of various detections on text generation input and output.
fms-hf-tuning
🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.
foundation-model-stack
🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.
hf-resource-scanner
Scan resources consumed during LLM training
multi-nic-cni
Foundation Model Stack's Repositories
foundation-model-stack/fms-fsdp
🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash attention v2.
foundation-model-stack/foundation-model-stack
🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.
foundation-model-stack/multi-nic-cni
foundation-model-stack/fms-hf-tuning
🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.
foundation-model-stack/fms-extras
foundation-model-stack/fms-dgt
Synthetic Data Generation for Foundation Models
foundation-model-stack/fm-training-estimator
Estimate resources needed to train LLMs
foundation-model-stack/hf-resource-scanner
Scan resources consumed during LLM training
foundation-model-stack/train-conductor
Training job management tool for foundation model service
foundation-model-stack/fastsafetensors
High-performance safetensors model loader
foundation-model-stack/fms-acceleration
🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.
foundation-model-stack/fms-guardrails-orchestrator
🚀 Guardrails orchestration server for application of various detections on text generation input and output.
foundation-model-stack/base-images
foundation-model-stack/fms-lm-eval-service
foundation-model-stack/moe-distributed-training
Demonstration of MoE distributed training using various techniques
foundation-model-stack/ocp-efa-operator
Operator that enables EFA and/or GDRCOPY in an OpenShift cluster
foundation-model-stack/training-operator
Training operators on Kubernetes.
foundation-model-stack/trl
Train transformer language models with reinforcement learning.
foundation-model-stack/avengers
foundation-model-stack/pod-vllm
Source code to launch a number of pods, performing synthetic data generation