Skip to content

models: restructure models generation script. #8544

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
mc-nv merged 68 commits into from
Nov 25, 2025
Merged

models: restructure models generation script. #8544

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
68 commits
Select commit Hold shift + click to select a range
e04d6ac
models: Inroduce profile
mc-nv Nov 24, 2025
e79e854
models: change workdir
mc-nv Nov 24, 2025
dd388c1
Rething idea with profiling
mc-nv Nov 24, 2025
7226807
Update ubuntu version
mc-nv Nov 24, 2025
2310483
Adding script
mc-nv Nov 25, 2025
bccf09e
Introduce log messages for script
mc-nv Nov 25, 2025
6b2893c
Small update to script
mc-nv Nov 25, 2025
ab103a2
Finish prep work
mc-nv Nov 25, 2025
45dfde2
Define the structure of the script
mc-nv Nov 25, 2025
502f72d
Update script
mc-nv Nov 25, 2025
ea5999c
Upfate loge messages
mc-nv Nov 25, 2025
e621486
Makde chagnges to the the variable names
mc-nv Nov 25, 2025
5b584e8
Add curly braces
mc-nv Nov 25, 2025
05c7f9a
Update variable directory
mc-nv Nov 25, 2025
5e38f3b
var update: IDENTITY
mc-nv Nov 25, 2025
8e38e43
Update variable name
mc-nv Nov 25, 2025
2a3ec3f
var update: SHAPETENSOR
mc-nv Nov 25, 2025
1a3e43c
var update: RESHAPE
mc-nv Nov 25, 2025
d926488
var update: SEQUENCE
mc-nv Nov 25, 2025
108ee0b
var update: DYNA SEQUENCE
mc-nv Nov 25, 2025
abb4001
var update: DYNA SEQUENCE IMPLICIT
mc-nv Nov 25, 2025
5fbee52
var update: VARIABLE_SEQUENCE
mc-nv Nov 25, 2025
34f9f97
var update: ENSEMBLE
mc-nv Nov 25, 2025
50aaa66
var update: NOSHAPE
mc-nv Nov 25, 2025
acd386b
var update: TRT_PLUGIN
mc-nv Nov 25, 2025
aaddca0
var update: RAGGED
mc-nv Nov 25, 2025
bd5419d
var update: FORMAT
mc-nv Nov 25, 2025
6dcb18c
var update: DATA DEPENDENT
mc-nv Nov 25, 2025
dc9bbbf
var update: SEQUENCE_IMPLICIT
mc-nv Nov 25, 2025
6539b53
var update: VARIABLE_SEQUENCE_IMPLICIT
mc-nv Nov 25, 2025
dd4c3fb
temp: hide docker isntructions
mc-nv Nov 25, 2025
a228ad5
restore value name
mc-nv Nov 25, 2025
945ae7b
revert: Restore old script values
mc-nv Nov 25, 2025
3b22850
var: TRITON_MODELS_GEN_BUILD_DIR
mc-nv Nov 25, 2025
29f6b24
var: +TRITON_MODELS_GEN_SRC_DIR
mc-nv Nov 25, 2025
7a115d3
revert: DOCKER_VOLUME_CONTAINER
mc-nv Nov 25, 2025
91f7e71
Make shourter prefix
mc-nv Nov 25, 2025
a542e71
var: VOLUME_DESTDIR > TRITON_MDLS_QA_MODEL
mc-nv Nov 25, 2025
74c66b7
var: VOLUME_VARDESTDIR > TRITON_MDLS_QA_VARIABLE_MODEL
mc-nv Nov 25, 2025
0fc710b
var: VOLUME_IDENTITYDESTDIR > TRITON_MDLS_QA_IDENTITY_MODEL
mc-nv Nov 25, 2025
329c18e
var: VOLUME_IDENTITYBIGDESTDIR > TRITON_MDLS_QA_IDENTITY_BIG_MODEL
mc-nv Nov 25, 2025
5452c7d
var: VOLUME_SHAPEDESTDIR > TRITON_MDLS_QA_SHAPETENSOR_MODEL
mc-nv Nov 25, 2025
8800db3
var: VOLUME_RESHAPEDESTDIR > TRITON_MDLS_QA_RESHAPE_MODEL
mc-nv Nov 25, 2025
44f07f3
var: VOLUME_SEQDESTDIR > TRITON_MDLS_QA_SEQUENCE_MODEL
mc-nv Nov 25, 2025
b4feffc
var: VOLUME_DYNASEQDESTDIR > TRITON_MDLS_QA_DYNA_SEQUENCE_MODEL
mc-nv Nov 25, 2025
8c42aa4
var: VOLUME_DYNASEQDESTDIR > TRITON_MDLS_QA_DYNA_SEQUENCE_MODEL
mc-nv Nov 25, 2025
b57bd5e
var: VOLUME_VARSEQDESTDIR > TRITON_MDLS_QA_VARIABLE_SEQUENCE_MODEL
mc-nv Nov 25, 2025
7456691
var: VOLUME_ENSEMBLEDESTDIR > TRITON_MDLS_QA_ENSEMBLE_MODEL
mc-nv Nov 25, 2025
bf31603
var: VOLUME_NOSHAPEDESTDIR > TRITON_MDLS_QA_NOSHAPE_MODEL
mc-nv Nov 25, 2025
baa1b17
var: VOLUME_PLGDESTDIR / TRITON_MDLS_QA_TRT_PLUGIN_MODEL
mc-nv Nov 25, 2025
dbe41ac
var: VOLUME_RAGGEDDESTDIR / TRITON_MDLS_QA_RAGGED_MODEL
mc-nv Nov 25, 2025
c7d4975
var: VOLUME_FORMATDESTDIR / TRITON_MDLS_QA_TRT_FORMAT_MODEL
mc-nv Nov 25, 2025
cc4f81e
var: OLUME_DATADEPENDENTDIR / TRITON_MDLS_QA_TRT_DATA_DEPENDENT_MODEL
mc-nv Nov 25, 2025
c726f8c
var: VOLUME_IMPLICITSEQDESTDIR / TRITON_MDLS_QA_IMPLICIT_SEQUENCE_MODEL
mc-nv Nov 25, 2025
a1b57ba
var: VOLUME_VARIMPLICITSEQDESTDIR / TRITON_MDLS_QA_VARIABLE_SEQUENCE_…
mc-nv Nov 25, 2025
f000e0f
var: TRITON_MDLS_QA_SEQUENCE_IMPLICIT_MODEL
mc-nv Nov 25, 2025
cfe7d1d
var: VOLUME_INITIALSTATEIMPLICITSEQDESTDIR / TRITON_MDLS_QA_SEQUENCE_…
mc-nv Nov 25, 2025
bbc47db
var: VOLUME_VARINITIALSTATEIMPLICITSEQDESTDIR / TRITON_MDLS_QA_VARIAB…
mc-nv Nov 25, 2025
00cc896
var: VOLUME_TORCHTRTDESTDIR / TRITON_MDLS_QA_TORCHTRT_MODEL
mc-nv Nov 25, 2025
c27b1cc
var: VOLUME_SCALARMODELSDESTDIR / TRITON_MDLS_QA_SCALAR_MODELS
mc-nv Nov 25, 2025
af39652
var: VOLUME_IMAGEMODELSDESTDIR / TRITON_MDLS_QA_DYNAMIC_BATCH_IMAGE_M…
mc-nv Nov 25, 2025
f602344
Restore to 'main' state
mc-nv Nov 25, 2025
01957b1
Commit working changes
mc-nv Nov 25, 2025
ad43483
Modify qa/common/gen_qa_model_repository
mc-nv Nov 25, 2025
515b025
remove unused file
mc-nv Nov 25, 2025
1d29ad6
Remove unused referenes
mc-nv Nov 25, 2025
b1ef225
Update model generation proces.
mc-nv Nov 25, 2025
05ecc81
docs: Remove unused reference
mc-nv Nov 25, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 1 addition & 2 deletions docs/customization_guide/test.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
<!--
# Copyright 2018-2024, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
# Copyright 2018-2025, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
#
# Redistribution and use in source and binary forms, with or without
# modification, are permitted provided that the following conditions
Expand Down Expand Up @@ -45,7 +45,6 @@ repositories:
```
$ cd qa/common
$ ./gen_qa_model_repository
$ ./gen_qa_custom_ops
```

This will create multiple model repositories in /tmp/\<version\>/qa_*
Expand Down
149 changes: 0 additions & 149 deletions qa/common/gen_qa_custom_ops
View file
Open in desktop

This file was deleted.

Loading
Loading