Skip to content
MLX

Add W4A8 INT8 activation kernels for batched MoE prefill #655

Sign in to view logs

Add W4A8 INT8 activation kernels for batched MoE prefill

Add W4A8 INT8 activation kernels for batched MoE prefill #655

Run time

Learn about OS pricing on GitHub Actions
Job Run time
test-mlx / test-mlx
13m 25s
test-mlx-qwen35-moe / test-mlx-qwen35-moe
9m 27s
test-mlx-voxtral / test-mlx-voxtral
43m 3s
test-mlx-whisper / test-mlx-whisper
9m 53s
test-mlx-voxtral-realtime / test-mlx-voxtral-realtime
33m 36s
test-mlx-parakeet / test-mlx-parakeet
9m 13s
test-mlx-stories110m / test-mlx-stories110m
33m 0s
backend-tester (models) / test-mlx-backend-models
12m 11s
backend-tester (operators) / test-mlx-backend-operators
10m 21s
test-mlx-llm (unsloth/gemma-3-1b-it, gemma3-1b, true, 4w) / test-mlx-llm-gemma3-1b-custom-4w
10m 58s
test-mlx-llm (unsloth/Llama-3.2-1B-Instruct, llama-1b, false, nvfp4) / test-mlx-llm-llama-1b-nvfp4
12m 20s
test-mlx-llm (unsloth/Llama-3.2-1B-Instruct, llama-1b, true, nvfp4) / test-mlx-llm-llama-1b-custom-nvfp4
10m 13s
test-mlx-llm (unsloth/gemma-3-1b-it, gemma3-1b, true, nvfp4) / test-mlx-llm-gemma3-1b-custom-nvfp4
10m 58s
test-mlx-llm (unsloth/Llama-3.2-1B-Instruct, llama-1b, true, 4w) / test-mlx-llm-llama-1b-custom-4w
10m 43s
test-mlx-llm (unsloth/Qwen3-0.6B, qwen3-0.6b, false, 4w) / test-mlx-llm-qwen3-0.6b-4w
10m 18s
test-mlx-llm (unsloth/Qwen3-0.6B, qwen3-0.6b, false, nvfp4) / test-mlx-llm-qwen3-0.6b-nvfp4
9m 56s
test-mlx-llm (unsloth/Qwen3-0.6B, qwen3-0.6b, true, 4w) / test-mlx-llm-qwen3-0.6b-custom-4w
10m 17s
test-mlx-llm (unsloth/Llama-3.2-1B-Instruct, llama-1b, false, 4w) / test-mlx-llm-llama-1b-4w
11m 28s
test-mlx-llm (unsloth/gemma-3-1b-it, gemma3-1b, false, nvfp4) / test-mlx-llm-gemma3-1b-nvfp4
11m 56s
test-mlx-llm (unsloth/Qwen3-0.6B, qwen3-0.6b, true, nvfp4) / test-mlx-llm-qwen3-0.6b-custom-nvfp4
9m 57s
test-mlx-llm (unsloth/gemma-3-1b-it, gemma3-1b, false, 4w) / test-mlx-llm-gemma3-1b-4w
11m 8s
5h 4m 21s