Add TurboMind ViT support for InternVL and Qwen VL models#4719

irexyc wants to merge 7 commits into

InternLM:mainInternLM/lmdeploy:mainfrom

irexyc:extend_vitirexyc/lmdeploy:extend_vitCopy head branch name to clipboard