Commit 8176fc7
committed
Add served_model_name mismatch to NEL CI common issues
When using NEL_DEPLOYMENT_COMMAND with a custom --served-model-name,
deployment.served_model_name must also be overridden via
NEL_OTHER_OVERRIDES — NEL uses the config field (not the actual serve
command) to set the eval client's model_id. Without this, the client
sends the checkpoint path as model_id, causing 404 errors.
Signed-off-by: Zhiyu Cheng <zhiyuc@nvidia.com>1 parent 7dcede4 commit 8176fc7
1 file changed
+1
-0
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
255 | 255 | | |
256 | 256 | | |
257 | 257 | | |
| 258 | + | |
258 | 259 | | |
259 | 260 | | |
260 | 261 | | |
| |||
0 commit comments