Optimal Triton support for Jetpack 5.1.3 (Cuda 11.4)

[sdurmustalipoglu]

Hello

I have an Aaeon 8253 ai pc with jetpack 5.1.3 on Ubuntu 20.04

I researched a lot but every chatbot gives different scenarios

I wonder that which version of triton is optimal for jetpack 5.1.3 ?

I will start with this steps.

sudo apt-get update
sudo apt-get install -y cuda-toolkit-11-4 cuda-compat-11-4 libcudnn8 libnvinfer8 libnvinfer-plugin8

echo 'export PATH=/usr/local/cuda-11.4/bin:$PATH' >> ~/.bashrc
echo 'export LD_LIBRARY_PATH=/usr/local/cuda-11.4/lib64:/usr/lib/aarch64-linux-gnu:$LD_LIBRARY_PATH' >> ~/.bashrc
source ~/.bashrc

---

wget https://github.com/triton-inference-server/server/releases/download/v2.38.0/tritonserver2.38.0-jetpack5.1.2.tgz
mkdir -p tritonserver && tar -xzf tritonserver2.38.0-jetpack5.1.2.tgz -C tritonserver

In this step, I can't decide because I can not reach the website (https://github.com/triton-inference-server/server/releases/download/v2.38.0/tritonserver2.38.0-jetpack5.1.2.tgz)
That's why, I am not sure which triton version is optimal.

Thanks in advance. Best regards,
Durmuş