感謝你們推出v2的版本
我在推論上出現效能不足的問題
想問一下執行app.py後推論使用的記憶體會超過24GB嗎？
我在4090上會導致記憶體不足
ERROR: CUDA out of memory. Tried to allocate 26.00 MiB (GPU 0; 23.49 GiB total capacity; 20.92 GiB already allocated; 70.44 MiB free; 21.28 GiB reserved in total by PyTorch) If reserved memory is >> allocated memory try setting max_split_size_mb to avoid fragmentation. See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF
感謝你們推出v2的版本
我在推論上出現效能不足的問題
想問一下執行app.py後推論使用的記憶體會超過24GB嗎？
我在4090上會導致記憶體不足
ERROR: CUDA out of memory. Tried to allocate 26.00 MiB (GPU 0; 23.49 GiB total capacity; 20.92 GiB already allocated; 70.44 MiB free; 21.28 GiB reserved in total by PyTorch) If reserved memory is >> allocated memory try setting max_split_size_mb to avoid fragmentation. See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF