apple-perf (private devices) #1160
Triggered via schedule
November 9, 2025 20:16
keyprocedure
Status
Cancelled
Total duration
2d 5h 4m 44s
Artifacts
–
apple-perf-private-device-experiment.yml
on: schedule
apple
/
set-parameters
8s
Matrix: apple / export-models
Matrix: apple / prepare-test-specs
Matrix: apple / benchmark-on-device
apple
/
upload-benchmark-results
0s
Deploying to
upload-benchmark-results
Annotations
40 errors
|
apple / build-benchmark-app / macos-job
The job was not started because recent account payments have failed or your spending limit needs to be increased. Please check the 'Billing & plans' section in your settings
|
|
apple / export-models (Qwen/Qwen3-0.6B, et_xnnpack_custom_spda_kv_cache_8da4w, apple_iphone_15, pro_priva... / macos-job
Canceling since a higher priority waiting request for apple-perf-private-devices-main-5a1c1172ade2b12c0684945e78341f7ba1babcb8-false-true exists
|
|
apple / prepare-test-specs (Qwen/Qwen3-0.6B, hf_xnnpack_custom_spda_kv_cache_8da4w, apple_iphone_15, pro_...
Canceling since a higher priority waiting request for apple-perf-private-devices-main-5a1c1172ade2b12c0684945e78341f7ba1babcb8-false-true exists
|
|
apple / prepare-test-specs (Qwen/Qwen3-0.6B, et_xnnpack_custom_spda_kv_cache_8da4w, apple_iphone_15, pro_...
Canceling since a higher priority waiting request for apple-perf-private-devices-main-5a1c1172ade2b12c0684945e78341f7ba1babcb8-false-true exists
|
|
apple / prepare-test-specs (meta-llama/Llama-3.2-1B, hf_xnnpack_custom_spda_kv_cache_8da4w, apple_iphone_...
Canceling since a higher priority waiting request for apple-perf-private-devices-main-5a1c1172ade2b12c0684945e78341f7ba1babcb8-false-true exists
|
|
apple / prepare-test-specs (HuggingFaceTB/SmolLM2-135M, hf_xnnpack_custom_spda_kv_cache_8da4w, apple_ipho...
Canceling since a higher priority waiting request for apple-perf-private-devices-main-5a1c1172ade2b12c0684945e78341f7ba1babcb8-false-true exists
|
|
apple / export-models (Qwen/Qwen3-0.6B, hf_xnnpack_custom_spda_kv_cache_8da4w, apple_iphone_15, pro_priva... / macos-job
Canceling since a higher priority waiting request for apple-perf-private-devices-main-5a1c1172ade2b12c0684945e78341f7ba1babcb8-false-true exists
|
|
apple / export-models (HuggingFaceTB/SmolLM2-135M, hf_xnnpack_custom_spda_kv_cache_8da4w, apple_iphone_15... / macos-job
Canceling since a higher priority waiting request for apple-perf-private-devices-main-5a1c1172ade2b12c0684945e78341f7ba1babcb8-false-true exists
|
|
apple / export-models (meta-llama/Llama-3.2-1B, llama3_fb16, apple_iphone_15, pro_private, arn:aws:device... / macos-job
Canceling since a higher priority waiting request for apple-perf-private-devices-main-5a1c1172ade2b12c0684945e78341f7ba1babcb8-false-true exists
|
|
apple / prepare-test-specs (meta-llama/Llama-3.2-1B, et_xnnpack_custom_spda_kv_cache_8da4w, apple_iphone_...
Canceling since a higher priority waiting request for apple-perf-private-devices-main-5a1c1172ade2b12c0684945e78341f7ba1babcb8-false-true exists
|
|
apple / prepare-test-specs (meta-llama/Llama-3.2-1B, llama3_coreml_ane, apple_iphone_15, ios_18_public, a...
Canceling since a higher priority waiting request for apple-perf-private-devices-main-5a1c1172ade2b12c0684945e78341f7ba1babcb8-false-true exists
|
|
apple / export-models (allenai/OLMo-1B-hf, hf_xnnpack_custom_spda_kv_cache_8da4w, apple_iphone_15, pro_pr... / macos-job
Canceling since a higher priority waiting request for apple-perf-private-devices-main-5a1c1172ade2b12c0684945e78341f7ba1babcb8-false-true exists
|
|
apple / export-models (meta-llama/Llama-3.2-1B, hf_xnnpack_custom_spda_kv_cache_8da4w, apple_iphone_15, p... / macos-job
Canceling since a higher priority waiting request for apple-perf-private-devices-main-5a1c1172ade2b12c0684945e78341f7ba1babcb8-false-true exists
|
|
apple / prepare-test-specs (meta-llama/Llama-3.2-1B, llama3_fb16, apple_iphone_15, pro_private, arn:aws:d...
Canceling since a higher priority waiting request for apple-perf-private-devices-main-5a1c1172ade2b12c0684945e78341f7ba1babcb8-false-true exists
|
|
apple / prepare-test-specs (allenai/OLMo-1B-hf, hf_xnnpack_custom_spda_kv_cache_8da4w, apple_iphone_15, p...
Canceling since a higher priority waiting request for apple-perf-private-devices-main-5a1c1172ade2b12c0684945e78341f7ba1babcb8-false-true exists
|
|
apple / export-models (meta-llama/Llama-3.2-1B, llama3_coreml_ane, apple_iphone_15, ios_18_public, arn:aw... / macos-job
Canceling since a higher priority waiting request for apple-perf-private-devices-main-5a1c1172ade2b12c0684945e78341f7ba1babcb8-false-true exists
|
|
apple / export-models (meta-llama/Llama-3.2-1B, et_xnnpack_custom_spda_kv_cache_8da4w, apple_iphone_15, p... / macos-job
Canceling since a higher priority waiting request for apple-perf-private-devices-main-5a1c1172ade2b12c0684945e78341f7ba1babcb8-false-true exists
|
|
apple / prepare-test-specs (google/gemma-3-1b-it, hf_xnnpack_custom_spda_kv_cache_8da4w, apple_iphone_15,...
Canceling since a higher priority waiting request for apple-perf-private-devices-main-5a1c1172ade2b12c0684945e78341f7ba1babcb8-false-true exists
|
|
apple / export-models (google/gemma-3-1b-it, hf_xnnpack_custom_spda_kv_cache_8da4w, apple_iphone_15, pro_... / macos-job
Canceling since a higher priority waiting request for apple-perf-private-devices-main-5a1c1172ade2b12c0684945e78341f7ba1babcb8-false-true exists
|
|
apple / benchmark-on-device (meta-llama/Llama-3.2-1B, llama3_fb16, apple_iphone_15, pro_private, arn:aws:... / mobile-job (ios)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
|
|
apple / benchmark-on-device (meta-llama/Llama-3.2-1B, llama3_coreml_ane, apple_iphone_15, ios_18_public, ... / mobile-job (ios)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
|
|
apple / benchmark-on-device (Qwen/Qwen3-0.6B, hf_xnnpack_custom_spda_kv_cache_8da4w, apple_iphone_15, pro... / mobile-job (ios)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
|
|
apple / benchmark-on-device (meta-llama/Llama-3.2-1B, hf_xnnpack_custom_spda_kv_cache_8da4w, apple_iphone... / mobile-job (ios)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
|
|
apple / benchmark-on-device (Qwen/Qwen3-0.6B, et_xnnpack_custom_spda_kv_cache_8da4w, apple_iphone_15, pro... / mobile-job (ios)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
|
|
apple / benchmark-on-device (allenai/OLMo-1B-hf, hf_xnnpack_custom_spda_kv_cache_8da4w, apple_iphone_15, ... / mobile-job (ios)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
|
|
apple / benchmark-on-device (meta-llama/Llama-3.2-1B, et_xnnpack_custom_spda_kv_cache_8da4w, apple_iphone... / mobile-job (ios)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
|
|
apple / benchmark-on-device (google/gemma-3-1b-it, hf_xnnpack_custom_spda_kv_cache_8da4w, apple_iphone_15... / mobile-job (ios)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
|
|
apple / benchmark-on-device (HuggingFaceTB/SmolLM2-135M, hf_xnnpack_custom_spda_kv_cache_8da4w, apple_iph... / mobile-job (ios)
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
|
|
apple-perf (private devices)
Canceling since a higher priority waiting request for apple-perf-private-devices-main-5a1c1172ade2b12c0684945e78341f7ba1babcb8-false-true exists
|
|
apple / upload-benchmark-results
The job has exceeded the maximum execution time while awaiting a runner for 24h0m0s
|
|
apple-perf (private devices)
Canceling since a higher priority waiting request for apple-perf-private-devices-main-5a1c1172ade2b12c0684945e78341f7ba1babcb8-false-true exists
|
|
apple-perf (private devices)
Canceling since a higher priority waiting request for apple-perf-private-devices-main-5a1c1172ade2b12c0684945e78341f7ba1babcb8-false-true exists
|
|
apple-perf (private devices)
Canceling since a higher priority waiting request for apple-perf-private-devices-main-5a1c1172ade2b12c0684945e78341f7ba1babcb8-false-true exists
|
|
apple-perf (private devices)
Canceling since a higher priority waiting request for apple-perf-private-devices-main-5a1c1172ade2b12c0684945e78341f7ba1babcb8-false-true exists
|
|
apple-perf (private devices)
Canceling since a higher priority waiting request for apple-perf-private-devices-main-5a1c1172ade2b12c0684945e78341f7ba1babcb8-false-true exists
|
|
apple-perf (private devices)
Canceling since a higher priority waiting request for apple-perf-private-devices-main-5a1c1172ade2b12c0684945e78341f7ba1babcb8-false-true exists
|
|
apple-perf (private devices)
Canceling since a higher priority waiting request for apple-perf-private-devices-main-5a1c1172ade2b12c0684945e78341f7ba1babcb8-false-true exists
|
|
apple-perf (private devices)
Canceling since a higher priority waiting request for apple-perf-private-devices-main-5a1c1172ade2b12c0684945e78341f7ba1babcb8-false-true exists
|
|
apple-perf (private devices)
Canceling since a higher priority waiting request for apple-perf-private-devices-main-5a1c1172ade2b12c0684945e78341f7ba1babcb8-false-true exists
|
|
apple-perf (private devices)
Canceling since a higher priority waiting request for apple-perf-private-devices-main-5a1c1172ade2b12c0684945e78341f7ba1babcb8-false-true exists
|