Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
20 changes: 20 additions & 0 deletions swagger/docs.go
Original file line number Diff line number Diff line change
Expand Up @@ -3789,6 +3789,15 @@ const docTemplate = `{
}
}
},
"gallery.Variant": {
"type": "object",
"properties": {
"model": {
"description": "Model is the name of a gallery entry that declares no variants of its own.",
"type": "string"
}
}
},
"galleryop.NodeProgress": {
"type": "object",
"properties": {
Expand Down Expand Up @@ -4008,6 +4017,17 @@ const docTemplate = `{
"items": {
"type": "string"
}
},
"variant": {
"description": "Variant installs one specific build of an entry that declares variants,\nnamed as it appears in the entry's ` + "`" + `variants` + "`" + ` list (see the ` + "`" + `variants` + "`" + `\nand ` + "`" + `auto_variant` + "`" + ` fields of the gallery listing). Leave it empty to let\nLocalAI auto-select the largest build this host can actually run.",
"type": "string"
},
"variants": {
"description": "Variants is an optional, UNORDERED list of alternative builds of the same\nmodel (other backends such as MLX or vLLM, other quantizations) that the\ninstaller may pick instead of this entry's own payload. Authoring is\ndeliberately dumb: name the models, and the selector works out which one\nthis host should get.\n\nThe entry itself is always the last resort, so an entry carrying variants\nstays a complete, installable entry and older LocalAI releases, which drop\nthis key, install it exactly as before.",
"type": "array",
"items": {
"$ref": "#/definitions/gallery.Variant"
}
}
}
},
Expand Down
20 changes: 20 additions & 0 deletions swagger/swagger.json
Original file line number Diff line number Diff line change
Expand Up @@ -3786,6 +3786,15 @@
}
}
},
"gallery.Variant": {
"type": "object",
"properties": {
"model": {
"description": "Model is the name of a gallery entry that declares no variants of its own.",
"type": "string"
}
}
},
"galleryop.NodeProgress": {
"type": "object",
"properties": {
Expand Down Expand Up @@ -4005,6 +4014,17 @@
"items": {
"type": "string"
}
},
"variant": {
"description": "Variant installs one specific build of an entry that declares variants,\nnamed as it appears in the entry's `variants` list (see the `variants`\nand `auto_variant` fields of the gallery listing). Leave it empty to let\nLocalAI auto-select the largest build this host can actually run.",
"type": "string"
},
"variants": {
"description": "Variants is an optional, UNORDERED list of alternative builds of the same\nmodel (other backends such as MLX or vLLM, other quantizations) that the\ninstaller may pick instead of this entry's own payload. Authoring is\ndeliberately dumb: name the models, and the selector works out which one\nthis host should get.\n\nThe entry itself is always the last resort, so an entry carrying variants\nstays a complete, installable entry and older LocalAI releases, which drop\nthis key, install it exactly as before.",
"type": "array",
"items": {
"$ref": "#/definitions/gallery.Variant"
}
}
}
},
Expand Down
28 changes: 28 additions & 0 deletions swagger/swagger.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -210,6 +210,13 @@ definitions:
$ref: '#/definitions/gallery.NodeDriftInfo'
type: array
type: object
gallery.Variant:
properties:
model:
description: Model is the name of a gallery entry that declares no variants
of its own.
type: string
type: object
galleryop.NodeProgress:
properties:
current:
Expand Down Expand Up @@ -372,6 +379,27 @@ definitions:
items:
type: string
type: array
variant:
description: |-
Variant installs one specific build of an entry that declares variants,
named as it appears in the entry's `variants` list (see the `variants`
and `auto_variant` fields of the gallery listing). Leave it empty to let
LocalAI auto-select the largest build this host can actually run.
type: string
variants:
description: |-
Variants is an optional, UNORDERED list of alternative builds of the same
model (other backends such as MLX or vLLM, other quantizations) that the
installer may pick instead of this entry's own payload. Authoring is
deliberately dumb: name the models, and the selector works out which one
this host should get.

The entry itself is always the last resort, so an entry carrying variants
stays a complete, installable entry and older LocalAI releases, which drop
this key, install it exactly as before.
items:
$ref: '#/definitions/gallery.Variant'
type: array
type: object
localai.ModelResponse:
properties:
Expand Down
Loading