Commit 08d8b3c
committed
NPUW: Serialize the rerank flag in LLMCompiledModel blobs
m_is_rerank was set at compile time from NPUW_TEXT_RERANK but not
included in serialize()/deserialize(), so a rerank model exported and
re-imported (e.g. via ov::cache_dir) lost the flag and skipped the
batched-scoring wrapper in create_sync_infer_request(). Serialize it
alongside m_is_embedding and bump NPUW_SERIALIZATION_VERSION since the
blob layout changed.1 parent d8803ab commit 08d8b3c
2 files changed
Lines changed: 3 additions & 3 deletions
Lines changed: 2 additions & 2 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1319 | 1319 | | |
1320 | 1320 | | |
1321 | 1321 | | |
1322 | | - | |
| 1322 | + | |
1323 | 1323 | | |
1324 | 1324 | | |
1325 | 1325 | | |
| |||
1539 | 1539 | | |
1540 | 1540 | | |
1541 | 1541 | | |
1542 | | - | |
| 1542 | + | |
1543 | 1543 | | |
1544 | 1544 | | |
1545 | 1545 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
48 | 48 | | |
49 | 49 | | |
50 | 50 | | |
51 | | - | |
| 51 | + | |
52 | 52 | | |
53 | 53 | | |
54 | 54 | | |
| |||
0 commit comments