Skip to content

Commit b71947e

Browse files
authored
feat!: TensorRT RTX 1.5 support (#105)
* fix: replace inline default destructors * depds: add TRT RTX 1.5 headers * feat!: add support for TRT RTX 1.5 and make it the default * ci: test TRT RTX 1.5
1 parent 361eb08 commit b71947e

20 files changed

Lines changed: 22250 additions & 13 deletions

.github/workflows/ci.yml

Lines changed: 7 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -74,7 +74,7 @@ jobs:
7474
shell: bash
7575
run: |
7676
# 1.3 is not on pip, only starting with 1.4
77-
pip install tensorrt_rtx~=1.4
77+
pip install tensorrt_rtx~=1.5
7878
RTX_LIB_DIR=$(python -c 'from os.path import dirname;print(dirname(__import__("tensorrt_rtx_libs").__file__))')
7979
echo "RTX_LIB_DIR=$RTX_LIB_DIR"
8080
echo "RTX_LIB_DIR=$RTX_LIB_DIR" >> $GITHUB_ENV
@@ -84,8 +84,8 @@ jobs:
8484
if: ${{ matrix.os == 'ubuntu-latest' }}
8585
shell: bash
8686
run: |
87-
ln -s $RTX_LIB_DIR/libtensorrt_rtx.so.1{,.4.0}
88-
ln -s $RTX_LIB_DIR/libtensorrt_onnxparser_rtx.so.1{,.4.0}
87+
ln -s $RTX_LIB_DIR/libtensorrt_rtx.so.1{,.5.0}
88+
ln -s $RTX_LIB_DIR/libtensorrt_onnxparser_rtx.so.1{,.5.0}
8989
9090
- name: Check formatting
9191
run: cargo fmt --all -- --check
@@ -114,6 +114,10 @@ jobs:
114114
115115
- name: Run tests (mock mode old TensorRT versions)
116116
run: |
117+
# v_1_4
118+
cargo test -F mock -F v_1_4 -F dlopen_tensorrt_rtx -F dlopen_tensorrt_onnxparser --no-default-features --verbose
119+
cargo check -F v_1_4 -F dlopen_tensorrt_rtx -F dlopen_tensorrt_onnxparser --no-default-features --verbose
120+
# v_1_3
117121
cargo test -F mock -F v_1_3 -F dlopen_tensorrt_rtx -F dlopen_tensorrt_onnxparser --no-default-features --verbose
118122
cargo check -F v_1_3 -F dlopen_tensorrt_rtx -F dlopen_tensorrt_onnxparser --no-default-features --verbose
119123
# onnxparser disabled

README.md

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -54,7 +54,7 @@ Use `TENSORRT_SDK_DIR` to point to the TensorRT SDK root directory (the path tha
5454
1. **NVIDIA TensorRT-RTX**: Download and install from [NVIDIA Developer](https://developer.nvidia.com/tensorrt)
5555
- The TensorRT libraries should be in a location where they can be dynamically loaded.
5656
(e.g. by setting PATH on Windows or LD_LIBRARY_PATH on Linux)
57-
- This crate currently requires TensorRT RTX version 1.3 or 1.4 (see Cargo feature `v_1_3`, `v_1_4`).
57+
- This crate currently requires TensorRT RTX version 1.3, 1.4 or 1.5 (see Cargo feature `v_1_3`, `v_1_4`, `v_1_5`).
5858
Use `default-features = false` plus version feature to select version.
5959
You will also have to either enable `dlopen_tensorrt_rtx` or `link_tensorrt_rtx`.
6060

@@ -88,7 +88,7 @@ Mock mode provides stub implementations that allow you to:
8888

8989
The `trtx` crate has the following Cargo features:
9090

91-
- `default`: "dlopen_tensorrt_onnxparser", "dlopen_tensorrt_rtx", "onnxparser", "v_1_4"
91+
- `default`: "dlopen_tensorrt_onnxparser", "dlopen_tensorrt_rtx", "onnxparser", "v_1_5"
9292
- `mock`: use this library in mock mode. TensorRT libraries and a Nvidia GPU are no longer necessary for execution
9393
- `mock_runtime`: only mock runtime features of TensorRT. TensorRT libraries are required, but GPU execution is mocked (no GPU or CUDA required).
9494
- `dlopen_tensorrt_rtx`: enables dynamic loading of the TensorRT library via `trtx::dynamically_load_tensorrt`
@@ -99,6 +99,7 @@ The `trtx` crate has the following Cargo features:
9999
but using the builder library instead
100100
- `v_1_3` + `default-features = false` + (`dlopen_tensorrt_rtx` or `link_tensorrt_rtx`): Uses TensorRT RTX versions 1.3. At least one version feature has to be enabled
101101
- `v_1_4` + `default-features = false` + (`dlopen_tensorrt_rtx` or `link_tensorrt_rtx`): Uses TensorRT RTX versions 1.4. At least one version feature has to be enabled
102+
- `v_1_5` + `default-features = false` + (`dlopen_tensorrt_rtx` or `link_tensorrt_rtx`): Uses TensorRT RTX versions 1.5. At least one version feature has to be enabled
102103

103104
## Installation
104105

trtx-sys/Cargo.toml

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -18,14 +18,15 @@ cc = "1.0"
1818
regex = "1.0"
1919

2020
[features]
21-
default = ["v_1_4"]
21+
default = ["v_1_5"]
2222
onnxparser = []
2323
link_tensorrt_rtx = []
2424
link_tensorrt_onnxparser = ["onnxparser"]
2525

2626
# versions
2727
v_1_3 = []
28-
v_1_4 = []
28+
v_1_4 = ["v_1_3"]
29+
v_1_5 = ["v_1_4"]
2930
# the non-RTX version of TensorRT (mainly for debugging/validating TensorRT RTX)
3031
enterprise = []
3132

0 commit comments

Comments
 (0)