Skip to content

Commit 49dfd71

Browse files
yujclaude
andcommitted
fix: include user-defined LLM families in _resolve_architectures
The _resolve_architectures method only looked up architectures from BUILTIN_LLM_FAMILIES, which caused custom-registered models with a model_family pointing to a user-defined model to fail architecture resolution. Now combines both builtin and user-defined families. Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
1 parent 478f5a6 commit 49dfd71

1 file changed

Lines changed: 7 additions & 3 deletions

File tree

xinference/model/llm/llm_family.py

Lines changed: 7 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -168,9 +168,13 @@ def _resolve_architectures(self) -> Optional[List[str]]:
168168
return self.architectures
169169
if not self.model_family:
170170
return None
171-
for family in BUILTIN_LLM_FAMILIES:
172-
if family.model_name == self.model_family:
173-
return family.architectures
171+
from .custom import get_user_defined_llm_families
172+
173+
user_defined = {f.model_name: f for f in get_user_defined_llm_families()}
174+
all_families = {f.model_name: f for f in BUILTIN_LLM_FAMILIES}
175+
all_families.update(user_defined)
176+
if self.model_family in all_families:
177+
return all_families[self.model_family].architectures
174178
return None
175179

176180
def has_architecture(self, *architectures: str) -> bool:

0 commit comments

Comments
 (0)