You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
First install paddlepaddle-gpu. For detailed instructions, refer to [PaddlePaddle Installation](https://www.paddlepaddle.org.cn/en/install/quick?docurl=/documentation/docs/en/develop/install/pip/linux-pip_en.html)
Then install fastdeploy. **Do not install from PyPI**. Use the following methods instead (supports SM80/86/89/90 GPU architectures).
42
42
43
43
**Note**: Stable FastDeploy release pairs with stable PaddlePaddle; Nightly Build FastDeploy pairs with Nightly Build PaddlePaddle. The `--extra-index-url` is only used for downloading fastdeploy-gpu's dependencies; fastdeploy-gpu itself must be installed from the Paddle source specified by `-i`.
> Note: `dockerfiles/Dockerfile.gpu` currently supports CUDA 12.6 only, targeting SM 80/86/89/90 architectures. To support other architectures, modify ```bash build.sh 1 python false [80,90]``` in the Dockerfile. It's recommended to specify no more than 2 architectures.
60
+
> Note: `dockerfiles/Dockerfile.gpu` currently supports CUDA 12.6 only, targeting SM 80/86/89/90 architectures, and requires Python 3.10. To support other architectures, modify ```bash build.sh 1 python false [80,90]``` in the Dockerfile. It's recommended to specify no more than 2 architectures.
@@ -86,7 +86,7 @@ The built packages will be in the ```FastDeploy/dist``` directory.
86
86
87
87
## 5. Precompiled Operator Wheel Packages
88
88
89
-
FastDeploy provides precompiled GPU operator wheel packages for quick setup without building the entire source code.This method currently supports SM80/90 architecture (e.g., A100/H100) and CUDA 12.6 environments only.
89
+
FastDeploy provides precompiled GPU operator wheel packages for quick setup without building the entire source code.This method currently supports **SM80/90 architecture (e.g., A100/H100)****CUDA 12.6** and **Python 3.10** environments only.
90
90
91
91
> By default, `build.sh` compiles all custom operators from source.To use the precompiled package, enable it with the `FD_USE_PRECOMPILED` parameter.
92
92
> If the precompiled package cannot be downloaded or does not match the current environment, the system will automatically fall back to `4. Build Wheel from Source`.
@@ -124,7 +124,7 @@ After the build completes, the operator binaries can be found in `FastDeploy/fas
124
124
> **Notes:**
125
125
>
126
126
> - This mode prioritizes downloading precompiled GPU operator wheels to reduce build time.
127
-
> -Supports **GPU, SM80/86/89/90.
127
+
> -Currently supports **GPU, SM80/90, CUDA 12.6, Python3.10** only.
128
128
> - For custom architectures or modified operator logic, please use **source compilation (Section 4)**.
129
129
> - You can check whether the precompiled wheel for a specific commit has been successfully built on the [FastDeploy CI Build Status Page](https://github.com/PaddlePaddle/FastDeploy/actions/workflows/ce_job.yml).
0 commit comments