aws-neuron/aws-neuron-sdk
Powering AWS purpose-built machine learning chips. Blazing fast and cost effective, natively integrated into PyTorch and TensorFlow and integrated with your favorite AWS services
PythonNOASSERTION
Issues
- 0
[PyTorch] cxx11 ABI support (torch-neuronx)
#975 opened - 0
[PyTorch] Top-p sampling on device
#974 opened - 0
- 0
[PyTorch] FP8 KV Cache (weights only)
#972 opened - 0
[PyTorch] INT8 for inference (weights only)
#971 opened - 0
[PyTorch] LLaVA model inference
#970 opened - 0
[PyTorch] Multi-LoRA inference
#969 opened - 0
[PyTorch] Paged attention in vLLM
#968 opened - 0
- 0
- 0
[JAX] JAX inference support
#965 opened - 0
[PyTorch] INT8 compute for inference
#964 opened - 0
- 0
[JAX] JAX training support
#962 opened - 0
[PyTorch] PEFT LoRA support
#961 opened - 0
[PyTorch] NxD Training Launch (Beta)
#960 opened - 0
[PyTorch] LlaVA model training
#959 opened - 0
[PyTorch] Video-LLaVA model training
#958 opened - 0
[PyTorch] PEFT QLoRA
#957 opened - 0
[PyTorch] DBRX model training support [Beta]
#956 opened - 0
[PyTorch] Fully Sharded Data Parallel (FSDP)
#955 opened - 0
- 0
- 0
[PyTorch] ORPO (model alignment)
#952 opened - 0
[PyTorch] PPO (model alignment)
#951 opened - 0
[PyTorch] DPO (model alignment)
#950 opened - 1
[JAX] MoE Support
#949 opened - 1
Compilation failure - Unhandled exception with message: tensor size must be more than 0, input1_set
#948 opened - 1
- 2
Issue on page /general/models/index.html
#946 opened - 4
Error during driver installation: aws-neuron
#945 opened - 2
- 1
- 5
- 3
- 1
- 0
- 6
Bug Report: Incorrect Tensor Indexing & `torch.index_select` on PyTorch NeuronX with `torch.int64`
#937 opened - 3
- 5
- 3
- 3
- 0
Feedback on setup instructions
#930 opened - 1
- 2
- 0
- 4
- 0
Links broken on page /libraries/neuronx-distributed/tutorials/finetuning_llama2_7b_ptl.html
#922 opened - 1
- 1