Skip to content

Commit 27200d4

Browse files
XieYunshenXieYunshen
committed
fix ci test error
2 parents 4299774 + f74155f commit 27200d4

34 files changed

Lines changed: 499 additions & 17 deletions

‎.github/workflows/model-unittest-gpu-ce-develop.yml‎

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -211,6 +211,7 @@ jobs:
211211
echo "Change python version to $python_version"
212212
set -e
213213
cp ${work_dir}/../../../Miniforge3-latest-Linux-x86_64.sh /tmp/miniforge.sh
214+
source ${work_dir}/../../../proxy_huggingface
214215
bash /tmp/miniforge.sh -b -p /opt/conda
215216
/opt/conda/bin/conda create -n py_\$python_version python=\$python_version -y \
216217
--override-channels \

‎.github/workflows/model-unittest-gpu-ce-release.yml‎

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -229,6 +229,7 @@ jobs:
229229
echo "Change python version to $python_version"
230230
set -e
231231
cp ${work_dir}/../../../Miniforge3-latest-Linux-x86_64.sh /tmp/miniforge.sh
232+
source ${work_dir}/../../../proxy_huggingface
232233
bash /tmp/miniforge.sh -b -p /opt/conda
233234
/opt/conda/bin/conda create -n py_\$python_version python=\$python_version -y \
234235
--override-channels \

‎README.md‎

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -208,6 +208,7 @@ PaddleFormers 是基于百度深度学习框架 PaddlePaddle 搭建的 Transform
208208
* [昆仑芯安装说明文档](./docs/zh/XPU_installation_guide.md)
209209
* [天数智芯安装说明文档](./docs/zh/ILUVATAR-GPU_installation_guide.md)
210210
* [沐曦安装说明文档](./docs/zh/Metax-GPU_installation_guide.md)
211+
* [摩尔线程安装说明文档](./docs/zh/MUSA-GPU_installation_guide.md)
211212
212213
# ⚡快速体验
213214
@@ -262,6 +263,7 @@ paddleformers-cli train ./examples/config/sft/full.yaml
262263
* [昆仑芯使用说明文档](./docs/zh/XPU_usage_guide.md)
263264
* [天数智芯使用说明文档](./docs/zh/ILUVATAR-GPU_usage_guide.md)
264265
* [沐曦使用说明文档](./docs/zh/Metax-GPU_usage_guide.md)
266+
* [摩尔线程使用说明文档](./docs/zh/MUSA-GPU_usage_guide.md)
265267

266268
## 🔍最佳实践
267269
* [基于 DeepSeekv3的高效预训练](./examples/best_practices/DeepSeek-V3/)

‎docs/zh/MUSA-GPU_installation_guide.md‎

Lines changed: 115 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,115 @@
1+
# 1. 安装
2+
3+
**环境依赖**
4+
5+
|Chip type|Driver version|
6+
|-|-|
7+
|MUSA S5000|5.1.0-server|
8+
9+
* **机器：** MUSA S5000 80GB 8-card machine
10+
* **GCC path：** /usr/bin/gcc (12.3.0)
11+
* **python version：** 3.10
12+
13+
要验证 MUSA GPU 是否正常，可以使用`mthreads-gmi`命令
14+
15+
```shell
16+
mthreads-gmi
17+
#example：$ mthreads-gmi
18+
19+
Tue Jun 23 17:48:04 2026
20+
---------------------------------------------------------------------
21+
mthreads-gmi:2.4.1 Driver Version:5.1.0-server
22+
---------------------------------------------------------------------
23+
ID Name |PCIe |%GPU Mem
24+
Device Type Perf |Pcie Lane Width |Temp MPC Capable
25+
| ECC Mode
26+
+-------------------------------------------------------------------+
27+
0 MTT S5000 |00000000:18:00.0 |0% 0MiB(81920MiB)
28+
Physical P0 |16x(16x) |48C YES
29+
| On-die, EDC
30+
+-------------------------------------------------------------------+
31+
1 MTT S5000 |00000000:3a:00.0 |0% 0MiB(81920MiB)
32+
Physical P0 |16x(16x) |48C YES
33+
| On-die, EDC
34+
+-------------------------------------------------------------------+
35+
2 MTT S5000 |00000000:4b:00.0 |0% 0MiB(81920MiB)
36+
Physical P0 |16x(16x) |49C YES
37+
| On-die, EDC
38+
+-------------------------------------------------------------------+
39+
3 MTT S5000 |00000000:5c:00.0 |0% 0MiB(81920MiB)
40+
Physical P0 |16x(16x) |48C YES
41+
| On-die, EDC
42+
+-------------------------------------------------------------------+
43+
4 MTT S5000 |00000000:9a:00.0 |0% 0MiB(81920MiB)
44+
Physical P0 |16x(16x) |48C YES
45+
| On-die, EDC
46+
+-------------------------------------------------------------------+
47+
5 MTT S5000 |00000000:ba:00.0 |0% 0MiB(81920MiB)
48+
Physical P0 |16x(16x) |50C YES
49+
| On-die, EDC
50+
+-------------------------------------------------------------------+
51+
6 MTT S5000 |00000000:ca:00.0 |0% 0MiB(81920MiB)
52+
Physical P0 |16x(16x) |48C YES
53+
| On-die, EDC
54+
+-------------------------------------------------------------------+
55+
7 MTT S5000 |00000000:da:00.0 |0% 0MiB(81920MiB)
56+
Physical P0 |16x(16x) |49C YES
57+
| On-die, EDC
58+
---------------------------------------------------------------------
59+
60+
---------------------------------------------------------------------
61+
Processes:
62+
ID PID Process name GPU Memory
63+
Usage
64+
+-------------------------------------------------------------------+
65+
No running processes found
66+
---------------------------------------------------------------------
67+
```
68+
**安装依赖**
69+
70+
1. 拉取镜像
71+
72+
```shell
73+
docker pull registry.mthreads.com/public/paddle_musa:musa-5.1.0-py310-ubuntu22.04
74+
```
75+
76+
2. 启动 docker
77+
78+
```shell
79+
docker run \
80+
-it \
81+
--network=host \
82+
--privileged \
83+
--env MTHREADS_VISIBLE_DEVICES=all \
84+
--shm-size=80g \
85+
--name <container_name> \
86+
-v <mnt>:<mnt> \
87+
registry.mthreads.com/public/paddle_musa:musa-5.1.0-py310-ubuntu22.04 \
88+
/bin/bash
89+
```
90+
91+
3. 进入容器运行环境
92+
93+
```shell
94+
docker exec -it <container_name>
95+
```
96+
97+
4. 拉取代码分支
98+
99+
```shell
100+
git clone https://github.com/PaddlePaddle/PaddleFormers.git
101+
cd PaddleFormers
102+
python -m pip install -e .
103+
```
104+
105+
106+
# 2. 开始训练
107+
108+
所有示例脚本都位于 examples/config/musa 下。
109+
下面以 ERNIE-4.5-21B-A3B-PT 的 SFT 为例，可以参考 examples/best_practices/ERNIE-4.5/README.md 进行数据和模型准备。
110+
111+
如果需要对 ERNIE-4.5-21B-A3B-PT 进行全参数 SFT：
112+
113+
```shell
114+
bash ./examples/config/musa/ERNIE-4.5-21B-A3B/sft/run_sft.sh
115+
```

‎docs/zh/MUSA-GPU_usage_guide.md‎

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,6 @@
1+
# 模型列表和使用说明
2+
3+
|Model Name|Training Method|Context Length|Quantization|MUSA-GPUs Required|Deployment Commands|Applicable Version|
4+
|-|-|-|-|-|-|-|
5+
|ERNIE-4.5-21B-A3B|SFT-Full|8K|BF16|8|bash ./examples/config/musa/ERNIE-4.5-21B-A3B/sft/run_sft.sh|1.0|
6+
|PaddleOCR-VL|SFT-Full|16K|BF16|8|bash ./examples/config/musa/PaddleOCR-VL/sft/run_sft.sh|1.0|

‎docs/zh/model_capability.md‎

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -35,8 +35,8 @@
3535
|Qwen3-VL|x|x|✓|x|✓|✓|
3636

3737
# 多硬件训练支持
38-
|模型|昆仑芯 P800|天数智芯天垓150|沐曦 C550|
39-
|-|-|-|-|
40-
|🏛️PaddleOCR-VL|✓|✓|x|
41-
|🏛️ERNIE-4.5|✓|✓|✓|
42-
|DeepSeekv3|✓|x|x|
38+
|模型|昆仑芯 P800|天数智芯天垓150|沐曦 C550|摩尔线程 S5000|
39+
|-|-|-|-|-|
40+
|🏛️PaddleOCR-VL|✓|✓|x|✓|
41+
|🏛️ERNIE-4.5|✓|✓|✓|✓|
42+
|DeepSeekv3|✓|x|x|x|

‎examples/config/musa/ERNIE-4.5-21B-A3B/sft/run_sft.sh‎

Lines changed: 15 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,15 @@
1+
# Copyright (c) 2026 PaddlePaddle Authors. All Rights Reserved.
2+
#
3+
# Licensed under the Apache License, Version 2.0 (the "License");
4+
# you may not use this file except in compliance with the License.
5+
# You may obtain a copy of the License at
6+
#
7+
# http://www.apache.org/licenses/LICENSE-2.0
8+
#
9+
# Unless required by applicable law or agreed to in writing, software
10+
# distributed under the License is distributed on an "AS IS" BASIS,
11+
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
12+
# See the License for the specific language governing permissions and
13+
# limitations under the License.
14+
15+
PADDLE_XCCL_BACKEND=musa MUSA_VISIBLE_DEVICES=0,1,2,3,4,5,6,7 paddleformers-cli train examples/config/musa/ERNIE-4.5-21B-A3B/sft/sft.yaml

examples/config/musa/ERNIE-4.5-21B-A3B/sft/21b_8_gpus.yaml renamed to examples/config/musa/ERNIE-4.5-21B-A3B/sft/sft.yaml

File renamed without changes.

‎examples/config/musa/PaddleOCR-VL/sft/run_sft.sh‎

Lines changed: 15 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,15 @@
1+
# Copyright (c) 2026 PaddlePaddle Authors. All Rights Reserved.
2+
#
3+
# Licensed under the Apache License, Version 2.0 (the "License");
4+
# you may not use this file except in compliance with the License.
5+
# You may obtain a copy of the License at
6+
#
7+
# http://www.apache.org/licenses/LICENSE-2.0
8+
#
9+
# Unless required by applicable law or agreed to in writing, software
10+
# distributed under the License is distributed on an "AS IS" BASIS,
11+
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
12+
# See the License for the specific language governing permissions and
13+
# limitations under the License.
14+
15+
PADDLE_XCCL_BACKEND=musa MUSA_VISIBLE_DEVICES=0,1,2,3,4,5,6,7 paddleformers-cli train examples/config/musa/PaddleOCR-VL/sft/paddleocr-vl_full_16k_config.yaml

0 commit comments

Comments
 (0)