Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

About NVIDIA Jetson TX1/TX2/Nano/Xavier/Orin Builds #23113

Open
mfatih7 opened this issue Dec 15, 2024 · 0 comments
Open

About NVIDIA Jetson TX1/TX2/Nano/Xavier/Orin Builds #23113

mfatih7 opened this issue Dec 15, 2024 · 0 comments
Assignees
Labels
platform:jetson issues related to the NVIDIA Jetson platform

Comments

@mfatih7
Copy link

mfatih7 commented Dec 15, 2024

Hello

In https://onnxruntime.ai/docs/build/eps.html#nvidia-jetson-tx1tx2nanoxavierorin

It is written that CUDA 12.x is only available to Jetson Orin and newer series (CUDA compute capability >= 8.7)

When I look at The following table shows the CUDA UMD and CUDA Toolkit version compatibility on NVIDIA JetPack 5.x release: section in https://docs.nvidia.com/cuda/cuda-for-tegra-appnote/index.html#upgradable-package-for-jetson

I do not observe such a constraint.

Moreover when I try to install Cuda 11.8 on Nvdia Xavier Dev Board(compute capability 7.2) with Jetpack 5.1.2 with these lines

wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2004/arm64/cuda-keyring_1.0-1_all.deb
sudo dpkg -i cuda-keyring_1.0-1_all.deb
sudo apt-get update
sudo apt-get -y install cuda

It automatically installs Cuda 12.2.
This is not consistent with the statement CUDA 12.x is only available to Jetson Orin and newer series (CUDA compute capability >= 8.7)

When I explore https://elinux.org/Jetson_Zoo#ONNX_Runtime I observe that for Jetpack 5.1.2(Python 3.8) onnxruntime 1.18.0 is available.
But after installing the package from the .whl file into a python 3.8 venv we get Libraray errors at runtime regarding to the GLIBCXX versions.
Is this .whl file OK. Or should we build onnxruntime from the source?

If we need to build from the source, the default gcc on Jetpack 5.1.2 is not enough; we need gcc 11.
I am unsure if using gcc11 on Jetpack 5.1.2 is safe.

@github-actions github-actions bot added the platform:jetson issues related to the NVIDIA Jetson platform label Dec 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
platform:jetson issues related to the NVIDIA Jetson platform
Projects
None yet
Development

No branches or pull requests

2 participants