Skip to content

Commit 7b47a1c

Browse files
committed
fix(evaluate): Remove GPT OSS model evaluation restriction
Remove the check that blocked evaluation for openai-reasoning-gpt-oss-20b and openai-reasoning-gpt-oss-120b base models.
1 parent f8df0a7 commit 7b47a1c

1 file changed

Lines changed: 0 additions & 6 deletions

File tree

sagemaker-train/src/sagemaker/train/evaluate/base_evaluator.py

Lines changed: 0 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -314,12 +314,6 @@ def _resolve_model_info(cls, v: Union[str, BaseTrainer, ModelPackage], values: d
314314
sagemaker_session=session
315315
)
316316

317-
# Check if model is GPT OSS (not supported for evaluation)
318-
if model_info.base_model_name in ["openai-reasoning-gpt-oss-20b", "openai-reasoning-gpt-oss-120b"]:
319-
raise ValueError(
320-
"Evaluation is currently not supported for models created from GPT OSS 20B base model"
321-
)
322-
323317
# If model is a ModelPackage object or ARN (has source_model_package_arn),
324318
# validate that the resolved base_model_arn is a hub content ARN
325319
if model_info.source_model_package_arn:

0 commit comments

Comments
 (0)