Does this support flash-moe for MoE model? #123

Open

Labels

opened

Offload model to RAM and run expert and dflash model in the GPU

Metadata

Assignees

No one assigned

Labels

Type

No type

Fields

No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests