feat: automatic checkpoints for models that need it #1054
Triggered via pull request
March 12, 2026 09:55
Status
Failure
Total duration
1h 43m 44s
Artifacts
9
build.yml
on: pull_request
Build
3m 38s
Matrix: build-binaries
Update documentation website - no version release
0s
Update documentation website
0s
Auto-approve documentation website deployment
0s
Matrix: build-electron-example
Annotations
10 errors and 18 warnings
|
Standalone tests
Process completed with exit code 1.
|
|
test/standalone/chatWrappers/utils/resolveChatWrapper.test.ts > resolveChatWrapper > should resolve to specialized QwenChatWrapper 2 - Qwen 3:
test/standalone/chatWrappers/utils/resolveChatWrapper.test.ts#L880
AssertionError: expected JinjaTemplateChatWrapper{ …(17) } to be an instance of QwenChatWrapper
❯ test/standalone/chatWrappers/utils/resolveChatWrapper.test.ts:880:35
|
|
test/standalone/chatWrappers/utils/resolveChatWrapper.test.ts > resolveChatWrapper > should resolve to specialized QwenChatWrapper - QwQ:
test/standalone/chatWrappers/utils/resolveChatWrapper.test.ts#L868
AssertionError: expected JinjaTemplateChatWrapper{ …(17) } to be an instance of QwenChatWrapper
❯ test/standalone/chatWrappers/utils/resolveChatWrapper.test.ts:868:35
|
|
test/standalone/chatWrappers/QwenChatWrapper.test.ts > QwenChatWrapper > should generate valid context text for 2 sequential function calls:
test/standalone/chatWrappers/QwenChatWrapper.test.ts#L264
Error: Snapshot `QwenChatWrapper > should generate valid context text for 2 sequential function calls 1` mismatched
- Expected
+ Received
@@ -42,22 +42,30 @@
"What is the time?",
new SpecialTokensText("<|im_end|>
<|im_start|>assistant
"),
"I'll fetch some information for you",
- new SpecialTokensText("<tool_call>"),
- "
- {"name": "getTime", "arguments": {"hours": "24", "seconds": true}}
- ",
+ new SpecialTokensText("<tool_call>
+ <function="),
+ "getTime>
+ <parameter=params>
+ {"hours": "24", "seconds": true}",
- new SpecialTokensText("</tool_call>"),
+ new SpecialTokensText("
+ </parameter>
+ </function>
+ </tool_call>"),
"
",
- new SpecialTokensText("<tool_call>"),
- "
- {"name": "getDate", "arguments": {"timezone": 0}}
- ",
+ new SpecialTokensText("<tool_call>
+ <function="),
+ "getDate>
+ <parameter=params>
+ {"timezone": 0}",
- new SpecialTokensText("</tool_call><|im_end|>
+ new SpecialTokensText("
+ </parameter>
+ </function>
+ </tool_call><|im_end|>
<|im_start|>user
<tool_response>
"),
""22:00:00"",
new SpecialTokensText("
❯ test/standalone/chatWrappers/QwenChatWrapper.test.ts:264:29
|
|
test/standalone/chatWrappers/QwenChatWrapper.test.ts > QwenChatWrapper > should generate valid context text:
test/standalone/chatWrappers/QwenChatWrapper.test.ts#L146
Error: Snapshot `QwenChatWrapper > should generate valid context text 2` mismatched
- Expected
+ Received
@@ -39,15 +39,19 @@
<|im_start|>user
"),
"What is the time?",
new SpecialTokensText("<|im_end|>
<|im_start|>assistant
- <tool_call>"),
- "
- {"name": "getTime", "arguments": {"hours": "24", "seconds": true}}
- ",
+ <tool_call>
+ <function="),
+ "getTime>
+ <parameter=params>
+ {"hours": "24", "seconds": true}",
- new SpecialTokensText("</tool_call><|im_end|>
+ new SpecialTokensText("
+ </parameter>
+ </function>
+ </tool_call><|im_end|>
<|im_start|>user
<tool_response>
"),
""22:00:00"",
new SpecialTokensText("
❯ test/standalone/chatWrappers/QwenChatWrapper.test.ts:146:30
|
|
Model dependent tests
Process completed with exit code 1.
|
|
test/modelDependent/qwen3.5-0.8b/functions.test.ts > qwen3.5 0.8b > functions > use checkpoints:
test/modelDependent/qwen3.5-0.8b/functions.test.ts#L62
Error: Snapshot `qwen3.5 0.8b > functions > use checkpoints 5` mismatched
- Expected
+ Received
"
- The word "secret" means something that is hidden or kept from others. It can also refer to a secret knowledge, a secret weapon, or a secret place."
+ The word "secret" means something that is hidden or not known to others. It can also refer to a secret, a secret code, or a secret relationship."
❯ test/modelDependent/qwen3.5-0.8b/functions.test.ts:62:29
|
|
test/modelDependent/qwen3-0.6b/reasoningBudget.test.ts > qwen3 0.6b > reasoning budget > doesn't exceed reasoning budget:
test/modelDependent/qwen3-0.6b/reasoningBudget.test.ts#L63
AssertionError: expected +0 to be above 1
- Expected
+ Received
- 1
+ 0
❯ test/modelDependent/qwen3-0.6b/reasoningBudget.test.ts:63:46
|
|
test/modelDependent/qwen3-0.6b/functions.test.ts > qwen3 0.6b > functions > $defs and $ref with recursion:
test/modelDependent/qwen3-0.6b/functions.test.ts#L136
AssertionError: expected JinjaTemplateChatWrapper{ …(17) } to be an instance of QwenChatWrapper
❯ test/modelDependent/qwen3-0.6b/functions.test.ts:136:51
|
|
test/modelDependent/qwen3-0.6b/functions.test.ts > qwen3 0.6b > functions > get n-th word:
test/modelDependent/qwen3-0.6b/functions.test.ts#L23
AssertionError: expected JinjaTemplateChatWrapper{ …(17) } to be an instance of QwenChatWrapper
❯ test/modelDependent/qwen3-0.6b/functions.test.ts:23:51
|
|
Build
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/setup-node@v4, actions/upload-artifact@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Build binaries - macOS x64
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/download-artifact@v4, actions/setup-node@v4, actions/upload-artifact@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Build binaries - macOS x64
ninja 1.13.2 is already installed and up-to-date.
To reinstall 1.13.2, run:
brew reinstall ninja
|
|
Build binaries - macOS x64
cmake 4.2.3 is already installed and up-to-date.
To reinstall 4.2.3, run:
brew reinstall cmake
|
|
Standalone tests
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/download-artifact@v4, actions/setup-node@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Build binaries - macOS arm64
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/download-artifact@v4, actions/setup-node@v4, actions/upload-artifact@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Build binaries - macOS arm64
ninja 1.13.2 is already installed and up-to-date.
To reinstall 1.13.2, run:
brew reinstall ninja
|
|
Build binaries - macOS arm64
cmake 4.2.3 is already installed and up-to-date.
To reinstall 4.2.3, run:
brew reinstall cmake
|
|
Model dependent tests
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/cache/restore@v4, actions/cache/save@v4, actions/checkout@v4, actions/download-artifact@v4, actions/setup-node@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Model dependent tests
Cache save failed.
|
|
Model dependent tests
ninja 1.13.2 is already installed and up-to-date.
To reinstall 1.13.2, run:
brew reinstall ninja
|
|
Model dependent tests
cmake 4.2.3 is already installed and up-to-date.
To reinstall 4.2.3, run:
brew reinstall cmake
|
|
Build binaries - Ubuntu (2)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/download-artifact@v4, actions/setup-node@v4, actions/upload-artifact@v4, Jimver/cuda-toolkit@v0.2.15. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Build binaries - Windows (2)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/download-artifact@v4, actions/setup-node@v4, actions/upload-artifact@v4, Jimver/cuda-toolkit@v0.2.15. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Build binaries - Windows (2)
Failed to save: <h2>Our services aren't available right now</h2><p>We're working to restore all services as soon as possible. Please check back soon.</p>01I6yaQAAAAABOHUqeV5hTpcb4500F5nMRE0yRURHRTA4MDgARWRnZQ==
|
|
Build binaries - Windows (2)
Failed to restore: Cache service responded with 400
|
|
Build binaries - Ubuntu (1)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/download-artifact@v4, actions/setup-node@v4, actions/upload-artifact@v4, Jimver/cuda-toolkit@v0.2.30. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Build binaries - Windows (1)
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/download-artifact@v4, actions/setup-node@v4, actions/upload-artifact@v4, Jimver/cuda-toolkit@v0.2.30. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
Artifacts
Produced during runtime
| Name | Size | Digest | |
|---|---|---|---|
|
bins-linux-1
|
154 MB |
sha256:deafac9e03e80d939221d6a5091d3353cd0e1a6e57f7d72f2f1e68ed04f83a1d
|
|
|
bins-linux-2
|
194 MB |
sha256:061392baaece12e223c7b196f892d516ac5a4aa33a4419aac65c666102e24787
|
|
|
bins-mac-arm64
|
1.81 MB |
sha256:5db6eabc3ec02581f7c3c474e48e83626806dd7f2f984aa3ddf06df3eff42ed1
|
|
|
bins-mac-x64
|
7.91 MB |
sha256:4578b086b11a6f88b7182f801f33161cb7d5670696abcbe1c28ea6825c105335
|
|
|
bins-win-1
|
147 MB |
sha256:56ff55224256614dc76511e91632711910313fb00e0479e7b1494ca641472894
|
|
|
bins-win-2
|
192 MB |
sha256:f1880799e6415a6c5aa69a07c87beb711fc80ca3a194e7f21d3630b29837d97b
|
|
|
build
|
868 KB |
sha256:df1a5044b520b175c787f34090526d444c8561716975c0412839853322346418
|
|
|
build-templates
|
32.6 KB |
sha256:355815f0bb295c8acf9d005dc41c6a41d3fa1b5f98c8aa30964fc12c641297a0
|
|
|
llama.cpp
|
263 MB |
sha256:8ddcbff761d02dfe476e4fe538c459cc074609429b796df2733de9b37af33cd8
|
|