Skip to content

Commit 58e9533

Browse files
yujclaude
andcommitted
fix: include user-defined LLM families in _resolve_architectures
The _resolve_architectures method only looked up architectures from BUILTIN_LLM_FAMILIES, which caused custom-registered models with a model_family pointing to a user-defined model to fail architecture resolution. Now combines both builtin and user-defined families. Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
1 parent 7f439bd commit 58e9533

1 file changed

Lines changed: 7 additions & 3 deletions

File tree

xinference/model/llm/llm_family.py

Lines changed: 7 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -165,9 +165,13 @@ def _resolve_architectures(self) -> Optional[List[str]]:
165165
return self.architectures
166166
if not self.model_family:
167167
return None
168-
for family in BUILTIN_LLM_FAMILIES:
169-
if family.model_name == self.model_family:
170-
return family.architectures
168+
from .custom import get_user_defined_llm_families
169+
170+
user_defined = {f.model_name: f for f in get_user_defined_llm_families()}
171+
all_families = {f.model_name: f for f in BUILTIN_LLM_FAMILIES}
172+
all_families.update(user_defined)
173+
if self.model_family in all_families:
174+
return all_families[self.model_family].architectures
171175
return None
172176

173177
def has_architecture(self, *architectures: str) -> bool:

0 commit comments

Comments
 (0)