Skip to content

Commit 0f0f04c

Browse files
Update esm2_pretrain.yaml - Adding baseline metrics for benchmarking ESM2 model
Signed-off-by: Truong Nguyen <tgnguyen@nvidia.com>
1 parent 4ab5a21 commit 0f0f04c

1 file changed

Lines changed: 25 additions & 0 deletions

File tree

ci/benchmarks/partial-conv/esm2_pretrain.yaml

Lines changed: 25 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -55,3 +55,28 @@ script: |-
5555
--wandb-job-type=${pipeline_label} \
5656
--log-every-n-steps=50 \
5757
--disable-checkpointing;
58+
tests:
59+
- logic_type: static
60+
logic_spec:
61+
exit_codes:
62+
- 0
63+
baselines:
64+
consumed_samples:
65+
operator: eq
66+
value: 13568000.0
67+
val_loss:
68+
operator: range
69+
max: 2.5696
70+
min: 2.4998
71+
reduced_train_loss:
72+
operator: range
73+
max: 2.5471
74+
min: 2.4737
75+
grad_norm:
76+
operator: range
77+
max: 0.6061
78+
min: 0.0953
79+
val_ppl:
80+
operator: range
81+
max: 13.1102
82+
min: 12.0954

0 commit comments

Comments
 (0)