Skip to content

Commit dc57f3a

Browse files
committed
ERNIE MoE model on Armv9 update picture
1 parent e51187a commit dc57f3a

3 files changed

Lines changed: 10 additions & 4 deletions

File tree

content/learning-paths/cross-platform/ernie_moe_v9/2_llamacpp_installation.md

Lines changed: 6 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -112,11 +112,13 @@ print_info: general.name = Ernie-4.5-21B-A3B-Thinking
112112
```
113113

114114
Once inference is complete, the expected output will look like this (in Chinese):
115-
```
116-
用户让我介绍“混合专家”(Mixture of Experts)在中文里的内容。首先,我需要明确Mixture of Experts的基本概念,然后考虑在中文语境下的特殊表达或常见翻译。首先,Mixture of Experts是一种机器学习模型,结合了多个专家模型,通过门控机制(gating network)来动态选择最佳专家,通常用于提升模型性能,尤其是在处理复杂数据时,不同专家处理不同的特征或子空间。
117-
```
118115

119-
This confirms that the model router is functioning correctly (though not yet directly observable).
116+
![img1 alt-text#center](meo_result.png "Introduce Mixture of Experts in Chinese")
117+
118+
This answer demonstrates the model’s multilingual and structured reasoning ability. It begins with a narrative explanation introducing the concept of Mixture of Experts (MoE), followed by a well-organized markdown-style summary with section headers and bullet points:
119+
- Concept breakdown: It describes MoE as a model combining multiple specialized sub-models (experts) and a routing mechanism (gateway) to activate only a few experts per input.
120+
- Workflow explanation: It explains how routing selects top experts based on input features and how the system reduces computation by only activating a small number of experts per token.
121+
- Chinese NLP examples: It gives examples such as word segmentation and translation, explaining how different experts may focus on distinct subtasks.
120122

121123
This confirms:
122124
- The GGUF model is successfully loaded.

content/learning-paths/cross-platform/ernie_moe_v9/4_v9_optimization.md

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -85,6 +85,10 @@ cmake \
8585
make -j$(nproc)
8686
```
8787

88+
{{% notice Note %}}
89+
We disable GPU and other backend support to focus exclusively on CPU performance and optimization for this learning path.
90+
{{% /notice %}}
91+
8892
Then re-run benchmark in `build_v9_on` directory.
8993

9094
```bash
372 KB
Loading

0 commit comments

Comments
 (0)