Skip to content

Commit 8904654

Browse files
authored
Add MLLOG lines for lowest precision disclosure (#457)
* Add MLLOG lines for lowest precision disclosure Signed-off-by: ShriyaRishab <spalsamudram@nvidia.com> * Add lowest numerical precision in linear, attn, comm --------- Signed-off-by: ShriyaRishab <spalsamudram@nvidia.com>
1 parent 3cbc380 commit 8904654

1 file changed

Lines changed: 16 additions & 1 deletion

File tree

  • mlperf_logging/compliance_checker/training_6.0.0

mlperf_logging/compliance_checker/training_6.0.0/common.yaml

Lines changed: 16 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -144,7 +144,22 @@
144144
REQ: EXACTLY_ONE
145145
CHECK: " v['value'] != '' "
146146

147-
# Optional parallelism keys
147+
# Optional keys
148+
- KEY:
149+
NAME: lowest_numerical_precision_in_linear
150+
REQ: OPTIONAL
151+
CHECK: " v['value'] in ['fp64', 'fp32', 'tf32', 'fp16', 'fp8', 'nvfp4', 'mxfp4', 'bfloat16', 'Graphcore FLOAT 16.16', 'int8', 'uint8', 'int4', 'uint4'] "
152+
153+
- KEY:
154+
NAME: lowest_numerical_precision_in_attn
155+
REQ: OPTIONAL
156+
CHECK: " v['value'] in ['fp64', 'fp32', 'tf32', 'fp16', 'fp8', 'nvfp4', 'mxfp4', 'bfloat16', 'Graphcore FLOAT 16.16', 'int8', 'uint8', 'int4', 'uint4'] "
157+
158+
- KEY:
159+
NAME: lowest_numerical_precision_in_comm
160+
REQ: OPTIONAL
161+
CHECK: " v['value'] in ['fp64', 'fp32', 'tf32', 'fp16', 'fp8', 'nvfp4', 'mxfp4', 'bfloat16', 'Graphcore FLOAT 16.16', 'int8', 'uint8', 'int4', 'uint4'] "
162+
148163
- KEY:
149164
NAME: tensor_parallelism
150165
REQ: OPTIONAL

0 commit comments

Comments
 (0)