numa support for inference.py#158

mserranos wants to merge 2 commits into

foundation-model-stack:mainfoundation-model-stack/aiu-fms-testing-utils:mainfrom

mserranos:numamserranos/aiu-fms-testing-utils:numaCopy head branch name to clipboard