Skip to content

Commit 6f78d0d

Browse files
Merge pull request #3051 from madeline-underwood/erie
Update documentation for ERNIE-4.5 setup: refine image alt text and e…
2 parents 3c67c38 + 5fbc490 commit 6f78d0d

2 files changed

Lines changed: 3 additions & 1 deletion

File tree

content/learning-paths/cross-platform/ernie_moe_v9/2_llamacpp_installation.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -113,7 +113,7 @@ print_info: general.name = Ernie-4.5-21B-A3B-Thinking
113113

114114
Once inference is complete, the expected output looks like this (in Chinese):
115115

116-
![Terminal output showing ERNIE-4.5 model response in Chinese with structured markdown formatting explaining Mixture of Experts concept alt-txt#center](meo_result.png "Introducing Mixture of Experts in Chinese")
116+
![Terminal output showing ERNIE-4.5 model response in Chinese with structured markdown formatting explaining Mixture of Experts concept#center](meo_result.png "Introducing Mixture of Experts in Chinese")
117117

118118
This answer demonstrates the model's multilingual and structured reasoning ability. It begins with a narrative explanation introducing the concept of Mixture of Experts (MoE), followed by a well-organized markdown-style summary with section headers and bullet points. The response describes MoE as a model combining multiple specialized sub-models (experts) and a routing mechanism (gateway) to activate only a few experts per input. It explains how routing selects top experts based on input features and how the system reduces computation by activating only a small number of experts per token. The answer also gives examples such as word segmentation and translation, explaining how different experts might focus on distinct subtasks in Chinese NLP applications.
119119

content/learning-paths/cross-platform/ernie_moe_v9/_index.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -5,6 +5,8 @@ minutes_to_complete: 60
55

66
who_is_this_for: This is an advanced topic for developers and engineers who want to deploy Mixture of Experts (MoE) models, such as ERNIE 4.5, on edge devices. MoE architectures allow large LLMs with 21 billion or more parameters to run with only a fraction of their weights active per inference, making them ideal for resource constrained environments.
77

8+
description: Learn how to deploy ERNIE-4.5 Mixture of Experts models on Armv9 devices using llama.cpp, compare PT and Thinking variants, and measure Armv9-specific hardware optimization impact.
9+
810
learning_objectives:
911
- Deploy MoE models like ERNIE-4.5 on edge devices using llama.cpp
1012
- Compare inference behavior between ERNIE-4.5 PT and Thinking versions

0 commit comments

Comments
 (0)