AWS NeuronX sdk installation

[Zkarape]

Hello, I am struggling with this error while installing neuronx both locally and on a SageMaker notebook instance on ml.m5.xlarge instance. Guide me please how to install correctly to compile my model to deploy on inf2 instance. If you need more info, let me know.

File ~/anaconda3/envs/python3/lib/python3.10/site-packages/tensorflow_neuronx/init.py:1
----> 1 raise ImportError("WRONG PACKAGE. Please install the package from Neuron Repository - pip.repos.neuron.amazonaws.com")

ImportError: WRONG PACKAGE. Please install the package from Neuron Repository - pip.repos.neuron.amazonaws.com

I will highly appreciate any help and guidance.

[jyang-aws]

Hi Zkarape,
could you follow these steps https://awsdocs-neuron.readthedocs-hosted.com/en/latest/general/setup/neuron-setup/pytorch/neuronx/ubuntu/torch-neuronx-ubuntu20.html#setup-torch-neuronx-ubuntu20 based on your OS?
Please make sure to include
python -m pip config set global.extra-index-url https://pip.repos.neuron.amazonaws.com/
Let us know if you still see any issues on the setup.

[Zkarape]

Thanks a lot for reaching out. Sure, I will try and let you know. Regards, Zhenya.

…

On Thu, Jun 27, 2024 at 10:33 PM jyang-aws ***@***.***> wrote: Hi Zkarape, could you follow these steps https://awsdocs-neuron.readthedocs-hosted.com/en/latest/general/setup/neuron-setup/pytorch/neuronx/ubuntu/torch-neuronx-ubuntu20.html#setup-torch-neuronx-ubuntu20 based on your OS? Please make sure to include python -m pip config set global.extra-index-url https://pip.repos.neuron.amazonaws.com/ Let us know if you still see any issues on the setup. — Reply to this email directly, view it on GitHub <#916 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AZKBB6SCHYNEMMZHVNC33P3ZJRLF7AVCNFSM6AAAAABJ6HZQE6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCOJVGQZTAMZWGQ> . You are receiving this because you authored the thread.Message ID: ***@***.***>