fix: Mark FP8 scale to have the same batch size as input#163

ani300 merged 2 commits into

foundation-model-stack:mainfoundation-model-stack/fms-model-optimizer:mainfrom

ani300:mark-dynamic-fp8ani300/fms-model-optimizer:mark-dynamic-fp8Copy head branch name to clipboard