Skip to content

feat: add foundational RISC-V and RVV support infrastructure#311

Open
ihb2032 wants to merge 4 commits intoalibaba:mainfrom
ihb2032:feat/riscv-platform-init
Open

feat: add foundational RISC-V and RVV support infrastructure#311
ihb2032 wants to merge 4 commits intoalibaba:mainfrom
ihb2032:feat/riscv-platform-init

Conversation

@ihb2032
Copy link
Copy Markdown

@ihb2032 ihb2032 commented Apr 3, 2026

Motivation & Context

This PR introduces the fundamental infrastructure required to support the RISC-V 64-bit architecture and the RISC-V Vector Extension.

Adding this underlying scaffolding paves the way for significant performance optimizations. Preliminary downstream testing with RVV intrinsics has already demonstrated massive potential, including nearly 9x QPS improvements in int8 workloads without any drop in recall. This PR is the necessary first step to upstream those gains safely and cleanly.

Performance Context:

  • Hardware Platform: Muse Pi Pro (16GB RAM + 128GB Storage)
  • Dataset: Cohere 1M
  • Note: The specific algorithmic optimizations and detailed benchmark reports will be provided in subsequent PRs relying on this foundation.

What's Next?

This is part 1 of a planned series of PRs. Once this foundational PR is merged, follow-up PRs will introduce the actual algorithmic optimizations that utilize these new cpu_features APIs.

Testing Performed

  • Successfully compiled and linked natively in a RISC-V environment.
  • Verified basic runtime detection and execution stability on the Muse Pi Pro platform.

ihb2032 added 3 commits April 3, 2026 14:12
Signed-off-by: ihb2032 <hebome@foxmail.com>
Signed-off-by: ihb2032 <hebome@foxmail.com>
Signed-off-by: ihb2032 <hebome@foxmail.com>
Copy link
Copy Markdown
Contributor

@greptile-apps greptile-apps bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Your free trial has ended. If you'd like to continue receiving code reviews, you can add a payment method here.

@ihb2032 ihb2032 removed their assignment Apr 3, 2026
Signed-off-by: ihb2032 <hebome@foxmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants