Pinned Repositories
aws-samples-for-ray
awsome-distributed-training
Collection of best practices, reference architectures, model training examples and utilities to train large models on AWS.
awsome-fmops
Collection of bet practices, reference architectures, examples, and utilities for foundation model development and deployment on AWS.
2017_CRCNS_Summer_School
Repo for reviewing 2017 Berkeley summer course in mining and modeling of neuroscience data.
aws-samples-for-ray
Chaldea
Spatiotemporal activity pattern detector using edit similarity measurement.
Colab-Notebooks
SynthesizingObama
Python 3, Tensorflow 1.4.1 compatible codes of "Synthesizing Obama: Learning Lip Sync from Audio".
spykesim
Extended edit similarity measurement for high dimensional discrete-time series signal (e.g., multi-unit spike-train).
KeitaW's Repositories
KeitaW/aws-samples-for-ray
KeitaW/Colab-Notebooks
KeitaW/d2l-en
Interactive deep learning book with multi-framework code, math, and discussions. Adopted at 300 universities from 55 countries including Stanford, MIT, Harvard, and Cambridge.
KeitaW/introduction-to-kubeflow
Kubernetes Meetup Tokyo https://k8sjp.connpass.com/ でのKubeflowに関するLTの内容をまとめたレポジトリです
KeitaW/aws-do-eks
KeitaW/aws-efa-nccl-baseami-pipeline
EFA/NCCL base AMI build Packer and CodeBuild/Pipeline files. Also base Docker build files to enable EFA/NCCL in containers
KeitaW/aws-hpc-tutorials
KeitaW/aws-parallelcluster-post-install-scripts
Scripts to customize AWS ParallelCluster
KeitaW/awsome-distributed-training
KeitaW/cnd-handson
『一日で学ぶクラウドネイティブ技術実践ハンズオン』by CloudNative Days Tokyo 2023 実行委員会のドキュメントです。
KeitaW/ecsdemo-nodejs
Part 3 of a 4 part ECS workshop
KeitaW/eks-manage-node-groups-placement-group
EKS Managed Node Groups with Placement Group
KeitaW/Generative_Deep_Learning_2nd_Edition
The official code repository for the second edition of the O'Reilly book Generative Deep Learning: Teaching Machines to Paint, Write, Compose and Play.
KeitaW/gpt-neox
An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.
KeitaW/guidance-for-machine-learning-inference-on-aws
KeitaW/JAX-Toolbox
JAX-Toolbox
KeitaW/llama-recipes
Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment. Demo apps to showcase Meta Llama3 for WhatsApp & Messenger.
KeitaW/llama3
The official Meta Llama 3 GitHub site
KeitaW/mpi-operator
Kubernetes Operator for MPI-based applications (distributed training, HPC, etc.)
KeitaW/neuronx-nemo-megatron
KeitaW/optimum-benchmark
🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of Optimum's hardware optimizations & quantization schemes.
KeitaW/p5-nccl-test-2024-07-19
KeitaW/p5-nccl-tests
KeitaW/python-reviewer-test
KeitaW/sagemaker-solutions
KeitaW/te_llama_playground
KeitaW/TensorRT-LLM
TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.
KeitaW/torchtune
A Native-PyTorch Library for LLM Fine-tuning
KeitaW/training-operator
Training operators on Kubernetes.
KeitaW/transformers-neuronx