Skip to content

feat: automatic checkpoints for models that need it #1054

feat: automatic checkpoints for models that need it

feat: automatic checkpoints for models that need it #1054

Triggered via pull request March 12, 2026 09:55
@giladgdgiladgd
synchronize #573
gilad/qwen3.5
Status Failure
Total duration 1h 43m 44s
Artifacts 9

build.yml

on: pull_request
Resolve next release
0s
Resolve next release
Matrix: build-binaries
Standalone tests
4m 28s
Standalone tests
Model dependent tests
59m 10s
Model dependent tests
Update documentation website - no version release
0s
Update documentation website - no version release
Release
Release
Update documentation website
0s
Update documentation website
Auto-approve documentation website deployment
0s
Auto-approve documentation website deployment
Matrix: build-electron-example
Fit to window
Zoom out
Zoom in

Annotations

10 errors and 18 warnings
Standalone tests
Process completed with exit code 1.
test/standalone/chatWrappers/utils/resolveChatWrapper.test.ts > resolveChatWrapper > should resolve to specialized QwenChatWrapper 2 - Qwen 3: test/standalone/chatWrappers/utils/resolveChatWrapper.test.ts#L880
AssertionError: expected JinjaTemplateChatWrapper{ …(17) } to be an instance of QwenChatWrapper ❯ test/standalone/chatWrappers/utils/resolveChatWrapper.test.ts:880:35
test/standalone/chatWrappers/utils/resolveChatWrapper.test.ts > resolveChatWrapper > should resolve to specialized QwenChatWrapper - QwQ: test/standalone/chatWrappers/utils/resolveChatWrapper.test.ts#L868
AssertionError: expected JinjaTemplateChatWrapper{ …(17) } to be an instance of QwenChatWrapper ❯ test/standalone/chatWrappers/utils/resolveChatWrapper.test.ts:868:35
test/standalone/chatWrappers/QwenChatWrapper.test.ts > QwenChatWrapper > should generate valid context text for 2 sequential function calls: test/standalone/chatWrappers/QwenChatWrapper.test.ts#L264
Error: Snapshot `QwenChatWrapper > should generate valid context text for 2 sequential function calls 1` mismatched - Expected + Received @@ -42,22 +42,30 @@ "What is the time?", new SpecialTokensText("<|im_end|> <|im_start|>assistant "), "I'll fetch some information for you", - new SpecialTokensText("<tool_call>"), - " - {"name": "getTime", "arguments": {"hours": "24", "seconds": true}} - ", + new SpecialTokensText("<tool_call> + <function="), + "getTime> + <parameter=params> + {"hours": "24", "seconds": true}", - new SpecialTokensText("</tool_call>"), + new SpecialTokensText(" + </parameter> + </function> + </tool_call>"), " ", - new SpecialTokensText("<tool_call>"), - " - {"name": "getDate", "arguments": {"timezone": 0}} - ", + new SpecialTokensText("<tool_call> + <function="), + "getDate> + <parameter=params> + {"timezone": 0}", - new SpecialTokensText("</tool_call><|im_end|> + new SpecialTokensText(" + </parameter> + </function> + </tool_call><|im_end|> <|im_start|>user <tool_response> "), ""22:00:00"", new SpecialTokensText(" ❯ test/standalone/chatWrappers/QwenChatWrapper.test.ts:264:29
test/standalone/chatWrappers/QwenChatWrapper.test.ts > QwenChatWrapper > should generate valid context text: test/standalone/chatWrappers/QwenChatWrapper.test.ts#L146
Error: Snapshot `QwenChatWrapper > should generate valid context text 2` mismatched - Expected + Received @@ -39,15 +39,19 @@ <|im_start|>user "), "What is the time?", new SpecialTokensText("<|im_end|> <|im_start|>assistant - <tool_call>"), - " - {"name": "getTime", "arguments": {"hours": "24", "seconds": true}} - ", + <tool_call> + <function="), + "getTime> + <parameter=params> + {"hours": "24", "seconds": true}", - new SpecialTokensText("</tool_call><|im_end|> + new SpecialTokensText(" + </parameter> + </function> + </tool_call><|im_end|> <|im_start|>user <tool_response> "), ""22:00:00"", new SpecialTokensText(" ❯ test/standalone/chatWrappers/QwenChatWrapper.test.ts:146:30
Model dependent tests
Process completed with exit code 1.
test/modelDependent/qwen3.5-0.8b/functions.test.ts > qwen3.5 0.8b > functions > use checkpoints: test/modelDependent/qwen3.5-0.8b/functions.test.ts#L62
Error: Snapshot `qwen3.5 0.8b > functions > use checkpoints 5` mismatched - Expected + Received " - The word "secret" means something that is hidden or kept from others. It can also refer to a secret knowledge, a secret weapon, or a secret place." + The word "secret" means something that is hidden or not known to others. It can also refer to a secret, a secret code, or a secret relationship." ❯ test/modelDependent/qwen3.5-0.8b/functions.test.ts:62:29
test/modelDependent/qwen3-0.6b/reasoningBudget.test.ts > qwen3 0.6b > reasoning budget > doesn't exceed reasoning budget: test/modelDependent/qwen3-0.6b/reasoningBudget.test.ts#L63
AssertionError: expected +0 to be above 1 - Expected + Received - 1 + 0 ❯ test/modelDependent/qwen3-0.6b/reasoningBudget.test.ts:63:46
test/modelDependent/qwen3-0.6b/functions.test.ts > qwen3 0.6b > functions > $defs and $ref with recursion: test/modelDependent/qwen3-0.6b/functions.test.ts#L136
AssertionError: expected JinjaTemplateChatWrapper{ …(17) } to be an instance of QwenChatWrapper ❯ test/modelDependent/qwen3-0.6b/functions.test.ts:136:51
test/modelDependent/qwen3-0.6b/functions.test.ts > qwen3 0.6b > functions > get n-th word: test/modelDependent/qwen3-0.6b/functions.test.ts#L23
AssertionError: expected JinjaTemplateChatWrapper{ …(17) } to be an instance of QwenChatWrapper ❯ test/modelDependent/qwen3-0.6b/functions.test.ts:23:51
Build
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/setup-node@v4, actions/upload-artifact@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Build binaries - macOS x64
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/download-artifact@v4, actions/setup-node@v4, actions/upload-artifact@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Build binaries - macOS x64
ninja 1.13.2 is already installed and up-to-date. To reinstall 1.13.2, run: brew reinstall ninja
Build binaries - macOS x64
cmake 4.2.3 is already installed and up-to-date. To reinstall 4.2.3, run: brew reinstall cmake
Standalone tests
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/download-artifact@v4, actions/setup-node@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Build binaries - macOS arm64
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/download-artifact@v4, actions/setup-node@v4, actions/upload-artifact@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Build binaries - macOS arm64
ninja 1.13.2 is already installed and up-to-date. To reinstall 1.13.2, run: brew reinstall ninja
Build binaries - macOS arm64
cmake 4.2.3 is already installed and up-to-date. To reinstall 4.2.3, run: brew reinstall cmake
Model dependent tests
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/cache/restore@v4, actions/cache/save@v4, actions/checkout@v4, actions/download-artifact@v4, actions/setup-node@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Model dependent tests
Cache save failed.
Model dependent tests
ninja 1.13.2 is already installed and up-to-date. To reinstall 1.13.2, run: brew reinstall ninja
Model dependent tests
cmake 4.2.3 is already installed and up-to-date. To reinstall 4.2.3, run: brew reinstall cmake
Build binaries - Ubuntu (2)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/download-artifact@v4, actions/setup-node@v4, actions/upload-artifact@v4, Jimver/cuda-toolkit@v0.2.15. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Build binaries - Windows (2)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/download-artifact@v4, actions/setup-node@v4, actions/upload-artifact@v4, Jimver/cuda-toolkit@v0.2.15. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Build binaries - Windows (2)
Failed to save: <h2>Our services aren't available right now</h2><p>We're working to restore all services as soon as possible. Please check back soon.</p>01I6yaQAAAAABOHUqeV5hTpcb4500F5nMRE0yRURHRTA4MDgARWRnZQ==
Build binaries - Windows (2)
Failed to restore: Cache service responded with 400
Build binaries - Ubuntu (1)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/download-artifact@v4, actions/setup-node@v4, actions/upload-artifact@v4, Jimver/cuda-toolkit@v0.2.30. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Build binaries - Windows (1)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/download-artifact@v4, actions/setup-node@v4, actions/upload-artifact@v4, Jimver/cuda-toolkit@v0.2.30. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/

Artifacts

Produced during runtime
Name Size Digest
bins-linux-1
154 MB
sha256:deafac9e03e80d939221d6a5091d3353cd0e1a6e57f7d72f2f1e68ed04f83a1d
bins-linux-2
194 MB
sha256:061392baaece12e223c7b196f892d516ac5a4aa33a4419aac65c666102e24787
bins-mac-arm64
1.81 MB
sha256:5db6eabc3ec02581f7c3c474e48e83626806dd7f2f984aa3ddf06df3eff42ed1
bins-mac-x64
7.91 MB
sha256:4578b086b11a6f88b7182f801f33161cb7d5670696abcbe1c28ea6825c105335
bins-win-1
147 MB
sha256:56ff55224256614dc76511e91632711910313fb00e0479e7b1494ca641472894
bins-win-2
192 MB
sha256:f1880799e6415a6c5aa69a07c87beb711fc80ca3a194e7f21d3630b29837d97b
build
868 KB
sha256:df1a5044b520b175c787f34090526d444c8561716975c0412839853322346418
build-templates
32.6 KB
sha256:355815f0bb295c8acf9d005dc41c6a41d3fa1b5f98c8aa30964fc12c641297a0
llama.cpp
263 MB
sha256:8ddcbff761d02dfe476e4fe538c459cc074609429b796df2733de9b37af33cd8