okoge-kaz

Master (Computer Science) student at Tokyo Institute of Technology

Tokyo Institute of TechnologyTokyo Japan

Pinned Repositories

Compiler_Construction
Tokyo Institute of Technology 2022-2Q CSC. T372
Language:C10
Creative-Programming-Project
2021-1Q,2Q プログラミング創造演習 (Tokyo Tech)
Language:C++10
document
Documentation for Computer Science and Blog for Software Engineer Career
Language:JavaScript10
golang-todo-application
システム設計演習 Tokyo Institute of Technology
Language:Go10
llm-jp-sakura-ansible
Language:Jinja32
llm-recipes
Ongoing Research Project for continaual pre-training LLM(dense mode)
Language:Python14 1 02
megatron-deepspeed-turing-techblog
Turing Tech Blog Repository
Language:Python41
moe-recipes
Ongoing research training Mixture of Expert models.
Language:Python153
turing-techblog-megatron-deepspeed
環境構築方法の詳細は以下のLinkから
Language:Python2 1 01
wandb_watcher
ABCI 大規模言語モデル構築支援にてwandbのジョブを監視するためのツール
Language:Python2 1 00

okoge-kaz's Repositories

okoge-kaz/moe-recipes
Ongoing research training Mixture of Expert models.
Language:Python153
okoge-kaz/llm-recipes
Ongoing Research Project for continaual pre-training LLM(dense mode)
Language:Python14 1 02
okoge-kaz/llm-jp-sakura-ansible
Language:Jinja32
okoge-kaz/wandb_watcher
ABCI 大規模言語モデル構築支援にてwandbのジョブを監視するためのツール
Language:Python2 1 00
okoge-kaz/Megatron-LM
Ongoing research training transformer models at scale
Language:Python10
okoge-kaz/swallow-tuning
Language:Shell11
okoge-kaz/accelerate
🚀 A simple way to train and use PyTorch models with multi-GPU, TPU, mixed-precision
Language:Python0 0
okoge-kaz/axlearn
okoge-kaz/deploymentmanager-samples
Deployment Manager samples and templates.
okoge-kaz/grouped_gemm
PyTorch bindings for CUTLASS grouped GEMM.
okoge-kaz/hpsc-2024
Language:Shell
okoge-kaz/levanter
Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax
okoge-kaz/llama-recipes
Examples and recipes for Llama 2 model
Language:Jupyter Notebook0 01
okoge-kaz/llm-jp-dpo
okoge-kaz/llm-jp-Megatron-DeepSpeed
Language:Python
okoge-kaz/llm-node-tests
Language:Python
okoge-kaz/megablocks
Language:Python0 0
okoge-kaz/mistral-hackathon
okoge-kaz/ml-engineering
Machine Learning Engineering Open Book
okoge-kaz/MoEfication
okoge-kaz/nanotron
Minimalistic large language model 3D-parallelism training
Language:Python0 0
okoge-kaz/NeMo
NeMo: a toolkit for conversational AI
Language:Python
okoge-kaz/NeMo-Aligner
Scalable toolkit for efficient model alignment
Language:Python
okoge-kaz/NeMo-Megatron-Launcher
NeMo Megatron launcher and tools
Language:Python
okoge-kaz/okoge-kaz
okoge-kaz/OLMo
Modeling, training, eval, and inference code for OLMo
okoge-kaz/ppcomp24
Language:C
okoge-kaz/swallow-project-parper-graph
Language:Python
okoge-kaz/TransformerEngine
A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs, to provide better performance with lower memory utilization in both training and inference.
Language:Python
okoge-kaz/TSUBAME-4.0-hands-on