Skip to content

Commit dd88a2d

Browse files
chore(deps-dev): bump @huggingface/transformers from 3.8.1 to 4.0.1 (#831)
* chore(deps-dev): bump @huggingface/transformers from 3.8.1 to 4.0.1 Bumps [@huggingface/transformers](https://github.com/huggingface/transformers.js) from 3.8.1 to 4.0.1. - [Release notes](https://github.com/huggingface/transformers.js/releases) - [Commits](https://github.com/huggingface/transformers.js/commits) --- updated-dependencies: - dependency-name: "@huggingface/transformers" dependency-version: 4.0.1 dependency-type: direct:development update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> * fix: replace deprecated quantized option with dtype for transformers v4 The quantized pipeline option was removed in @huggingface/transformers v4. Without this fix, the minilm model loads in fp32 precision (~92MB) instead of q8 (~23MB), quadrupling memory usage. --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: carlos-alm <127798846+carlos-alm@users.noreply.github.com>
1 parent c99c507 commit dd88a2d

3 files changed

Lines changed: 48 additions & 103 deletions

File tree

package-lock.json

Lines changed: 45 additions & 100 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

package.json

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -122,7 +122,7 @@
122122
"web-tree-sitter": "^0.26.5"
123123
},
124124
"peerDependencies": {
125-
"@huggingface/transformers": "^3.8.1"
125+
"@huggingface/transformers": "^4.0.1"
126126
},
127127
"peerDependenciesMeta": {
128128
"@huggingface/transformers": {
@@ -143,7 +143,7 @@
143143
"@commitlint/cli": "^20.4",
144144
"@commitlint/config-conventional": "^20.0",
145145
"@eagleoutice/tree-sitter-r": "^1.1.2",
146-
"@huggingface/transformers": "^3.8.1",
146+
"@huggingface/transformers": "^4.0.1",
147147
"@tree-sitter-grammars/tree-sitter-hcl": "^1.2.0",
148148
"@tree-sitter-grammars/tree-sitter-lua": "^0.4.1",
149149
"@tree-sitter-grammars/tree-sitter-zig": "^1.1.2",

src/domain/search/models.ts

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -194,7 +194,7 @@ async function loadModel(modelKey?: string): Promise<{ extractor: unknown; confi
194194
pipeline = transformers.pipeline;
195195

196196
info(`Loading embedding model: ${config.name} (${config.dim}d)...`);
197-
const pipelineOpts = config.quantized ? { quantized: true } : {};
197+
const pipelineOpts = config.quantized ? { dtype: 'q8' } : {};
198198
try {
199199
extractor =
200200
await // biome-ignore lint/complexity/noBannedTypes: dynamically loaded transformers pipeline is untyped

0 commit comments

Comments
 (0)