feat: improve cuda shared memory tensor handling.#1222

RobbieLeung merged 1 commit intojd-opensource:mainjd-opensource/xllm:mainfrom

RobbieLeung:feat/cuda_shmRobbieLeung/xllm:feat/cuda_shmCopy head branch name to clipboard