Commit 21640b6
feat(model): curate the built-in catalog by hardware target (#84)
* feat(model): curate the built-in catalog by hardware target
`rocm model` listed every built-in recipe flat, including tiny smoke/test
paths, and did not say what the list was for. Turn it into a short curated
list of current popular open-weight models, each sized to a quant that fits
a single GPU (multi-GPU serving is not supported).
- Author the built-in list as an embedded JSON file using the same schema as
a signed recipe index, so the offline default and hosted indexes share one
format and the catalog is easy to curate. A unit test parses and validates
it so a malformed catalog cannot ship.
- Feature current popular models under canonical Hugging Face ids with the
quant that fits one GPU: Qwen3.6-35B-A3B and Gemma 4 26B-A4B as Q4_K_M GGUF
on Strix Halo (served via Lemonade's owner/repo:variant form), and
Qwen3.6-27B and Gemma 4 31B as BF16 on one MI300X via vLLM.
- `rocm model` shows only the featured list for the built-in catalog, grouped
by hardware target, with a note that any compatible Hugging Face model can be
served. A configured recipe index is shown in full and named in the header.
The default assistant, smoke/test, and superseded recipes stay resolvable for
`rocm serve` and appear under `--verbose`.
Signed-off-by: Roman Inflianskas <Roman.Inflianskas@amd.com>
* feat(model): move featured/platforms to catalog JSON
- Add `featured` boolean field to ModelRecipeRecord; mark the four
curated models in model_catalog.json. model_recipe_featured() now
reads the field directly, eliminating the hardcoded FEATURED_MODEL_IDS
Rust constant that had to be kept in sync by hand.
- Add `platforms` array to ModelRecipeIndexDocument with label, engines,
and gfx_families per platform. MODEL_CATALOG_PLATFORMS constant and
the engine-name match arm are removed; model_recipe_target_platform_label()
looks up the recipe's engine against the catalog's platform list instead.
Signed indexes that omit platforms fall back to the built-in definitions.
- rocm model highlights the matching platform with "← your GPU" by
probing detect_host_gfx_target() + normalize_therock_family() and
matching against each platform's gfx_families list.
- Footer "These are recommendations..." is now only emitted for the
built-in catalog, not for operator-configured SignedIndex registries.
- Remove dangling gpt-oss-120b manual_alternative entries (no recipe
in the catalog resolves that id).
- Fix docstring: catalog validation is test-time, not build-time.
Signed-off-by: Juho Vainio <juho.vainio@amd.com>
* fix(model): clippy and fmt fixes
Signed-off-by: Juho Vainio <juho.vainio@amd.com>
* fix(model): fix remaining clippy warnings in main.rs
Signed-off-by: Juho Vainio <juho.vainio@amd.com>
* feat(model): expand platform list to Ryzen AI, Radeon, and Instinct
Add three hardware platform entries to model_catalog.json replacing the
previous two (Strix Halo / MI300X):
- AMD Ryzen AI — Strix Halo (Lemonade / llama.cpp): gfx1151
- AMD Radeon — RX 7000/9000, Radeon PRO (Lemonade / llama.cpp): gfx110X-all, gfx120X-all
- AMD Instinct — MI300X, MI350X, MI355X (vLLM): gfx906, gfx908, gfx90a, gfx94X-dcgpu, gfx950-dcgpu
Lemonade recipes now appear under both Strix Halo and Radeon by
matching per-platform engine lists directly rather than assigning each
recipe to only the first matching platform.
Signed-off-by: Juho Vainio <juho.vainio@amd.com>
---------
Signed-off-by: Roman Inflianskas <Roman.Inflianskas@amd.com>
Signed-off-by: Juho Vainio <juho.vainio@amd.com>
Co-authored-by: Juho Vainio <juho.vainio@amd.com>1 parent 9841b96 commit 21640b6
4 files changed
Lines changed: 807 additions & 305 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
325 | 325 | | |
326 | 326 | | |
327 | 327 | | |
| 328 | + | |
| 329 | + | |
| 330 | + | |
| 331 | + | |
| 332 | + | |
| 333 | + | |
| 334 | + | |
| 335 | + | |
| 336 | + | |
| 337 | + | |
| 338 | + | |
| 339 | + | |
| 340 | + | |
| 341 | + | |
328 | 342 | | |
329 | 343 | | |
330 | 344 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
29 | 29 | | |
30 | 30 | | |
31 | 31 | | |
32 | | - | |
33 | | - | |
34 | | - | |
35 | | - | |
36 | | - | |
| 32 | + | |
| 33 | + | |
| 34 | + | |
| 35 | + | |
| 36 | + | |
| 37 | + | |
| 38 | + | |
37 | 39 | | |
38 | 40 | | |
39 | 41 | | |
| |||
10678 | 10680 | | |
10679 | 10681 | | |
10680 | 10682 | | |
10681 | | - | |
10682 | 10683 | | |
10683 | 10684 | | |
10684 | 10685 | | |
10685 | | - | |
| 10686 | + | |
10686 | 10687 | | |
10687 | 10688 | | |
10688 | 10689 | | |
10689 | | - | |
| 10690 | + | |
| 10691 | + | |
| 10692 | + | |
| 10693 | + | |
| 10694 | + | |
| 10695 | + | |
| 10696 | + | |
| 10697 | + | |
| 10698 | + | |
| 10699 | + | |
| 10700 | + | |
| 10701 | + | |
| 10702 | + | |
| 10703 | + | |
| 10704 | + | |
| 10705 | + | |
| 10706 | + | |
| 10707 | + | |
| 10708 | + | |
| 10709 | + | |
| 10710 | + | |
| 10711 | + | |
| 10712 | + | |
| 10713 | + | |
| 10714 | + | |
| 10715 | + | |
| 10716 | + | |
| 10717 | + | |
| 10718 | + | |
| 10719 | + | |
| 10720 | + | |
| 10721 | + | |
| 10722 | + | |
| 10723 | + | |
| 10724 | + | |
| 10725 | + | |
| 10726 | + | |
| 10727 | + | |
| 10728 | + | |
| 10729 | + | |
| 10730 | + | |
| 10731 | + | |
| 10732 | + | |
| 10733 | + | |
| 10734 | + | |
| 10735 | + | |
| 10736 | + | |
| 10737 | + | |
| 10738 | + | |
| 10739 | + | |
| 10740 | + | |
| 10741 | + | |
| 10742 | + | |
| 10743 | + | |
| 10744 | + | |
| 10745 | + | |
| 10746 | + | |
| 10747 | + | |
| 10748 | + | |
10690 | 10749 | | |
10691 | 10750 | | |
10692 | | - | |
10693 | | - | |
10694 | | - | |
10695 | | - | |
| 10751 | + | |
| 10752 | + | |
| 10753 | + | |
| 10754 | + | |
10696 | 10755 | | |
| 10756 | + | |
| 10757 | + | |
10697 | 10758 | | |
10698 | | - | |
10699 | | - | |
10700 | | - | |
10701 | | - | |
10702 | 10759 | | |
10703 | 10760 | | |
10704 | 10761 | | |
| |||
10765 | 10822 | | |
10766 | 10823 | | |
10767 | 10824 | | |
| 10825 | + | |
| 10826 | + | |
| 10827 | + | |
| 10828 | + | |
| 10829 | + | |
| 10830 | + | |
| 10831 | + | |
| 10832 | + | |
| 10833 | + | |
| 10834 | + | |
| 10835 | + | |
| 10836 | + | |
| 10837 | + | |
| 10838 | + | |
| 10839 | + | |
10768 | 10840 | | |
10769 | 10841 | | |
10770 | 10842 | | |
| |||
10780 | 10852 | | |
10781 | 10853 | | |
10782 | 10854 | | |
| 10855 | + | |
| 10856 | + | |
| 10857 | + | |
| 10858 | + | |
| 10859 | + | |
| 10860 | + | |
| 10861 | + | |
| 10862 | + | |
| 10863 | + | |
| 10864 | + | |
| 10865 | + | |
| 10866 | + | |
| 10867 | + | |
| 10868 | + | |
| 10869 | + | |
| 10870 | + | |
| 10871 | + | |
10783 | 10872 | | |
10784 | 10873 | | |
10785 | 10874 | | |
| |||
21717 | 21806 | | |
21718 | 21807 | | |
21719 | 21808 | | |
21720 | | - | |
21721 | | - | |
21722 | | - | |
21723 | | - | |
| 21809 | + | |
| 21810 | + | |
| 21811 | + | |
| 21812 | + | |
| 21813 | + | |
| 21814 | + | |
| 21815 | + | |
| 21816 | + | |
| 21817 | + | |
| 21818 | + | |
| 21819 | + | |
| 21820 | + | |
| 21821 | + | |
| 21822 | + | |
| 21823 | + | |
| 21824 | + | |
| 21825 | + | |
| 21826 | + | |
| 21827 | + | |
| 21828 | + | |
| 21829 | + | |
| 21830 | + | |
| 21831 | + | |
21724 | 21832 | | |
21725 | 21833 | | |
21726 | 21834 | | |
21727 | 21835 | | |
21728 | 21836 | | |
21729 | 21837 | | |
| 21838 | + | |
| 21839 | + | |
| 21840 | + | |
| 21841 | + | |
| 21842 | + | |
| 21843 | + | |
| 21844 | + | |
| 21845 | + | |
| 21846 | + | |
| 21847 | + | |
| 21848 | + | |
| 21849 | + | |
| 21850 | + | |
| 21851 | + | |
| 21852 | + | |
| 21853 | + | |
| 21854 | + | |
| 21855 | + | |
| 21856 | + | |
| 21857 | + | |
| 21858 | + | |
| 21859 | + | |
| 21860 | + | |
| 21861 | + | |
| 21862 | + | |
| 21863 | + | |
| 21864 | + | |
| 21865 | + | |
| 21866 | + | |
| 21867 | + | |
| 21868 | + | |
| 21869 | + | |
| 21870 | + | |
| 21871 | + | |
| 21872 | + | |
| 21873 | + | |
| 21874 | + | |
| 21875 | + | |
| 21876 | + | |
| 21877 | + | |
| 21878 | + | |
| 21879 | + | |
| 21880 | + | |
21730 | 21881 | | |
21731 | 21882 | | |
21732 | 21883 | | |
| |||
21739 | 21890 | | |
21740 | 21891 | | |
21741 | 21892 | | |
| 21893 | + | |
| 21894 | + | |
| 21895 | + | |
| 21896 | + | |
| 21897 | + | |
21742 | 21898 | | |
21743 | 21899 | | |
21744 | 21900 | | |
| |||
0 commit comments