[Common] Comm+GEMM overlap API updated to support cuBlasMp backend (incl. framework API)#2443

denera merged 86 commits into

NVIDIA:mainNVIDIA/TransformerEngine:mainfrom

denera:common/tp-overlap-cublasmpdenera/TransformerEngine:common/tp-overlap-cublasmpCopy head branch name to clipboard