We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
1 parent 2b5e960 commit c8f4b52Copy full SHA for c8f4b52
1 file changed
tests/MODEL.md
@@ -93,7 +93,7 @@ export DEFAULT_TYPES="fp16"
93
export DS_PATH=/resources/sharegpt/share_gpt.json
94
```
95
96
-Then, run the metrics generation script:
+Then, run the metrics generation script. The ShareGPT dataset will be automatically downloaded if it doesn't exist:
97
98
```bash
99
python generate_metrics.py --architecture=hf_pretrained --model_path=$MODEL_PATH --tokenizer=$MODEL_PATH --unfuse_weights --output_dir=/tmp/aiu-fms-testing-utils/output/ --compile_dynamic --max_new_tokens=$MAX_NEW_TOKENS --min_pad_length=$SEQ_LENS --batch_size=$BATCH_SIZES --default_dtype=$DEFAULT_TYPES --sharegpt_path=$DS_PATH --num_test_tokens_per_sequence=1024
0 commit comments