Commit 1187589
committed
test(v5-g13): tighten V4-3 — strict data_source=parquet_tokenized + tokenizer_used basename
Closes V5-G13 / cppmega-mlx-ay6. V4-3 accepted data_source ∈
{parquet, parquet_tokenized} — let backend silently fall back to
V3-2 raw-int path and still pass. Matrix fixtures have an
'original_text' column so V4-2's tokenize path MUST activate; assert
strictly. Also assert extras.tokenizer_used contains '.json'.
1/1 e2e green.1 parent 67ee407 commit 1187589
1 file changed
Lines changed: 9 additions & 4 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
46 | 46 | | |
47 | 47 | | |
48 | 48 | | |
49 | | - | |
50 | | - | |
51 | | - | |
| 49 | + | |
| 50 | + | |
| 51 | + | |
| 52 | + | |
52 | 53 | | |
53 | 54 | | |
54 | | - | |
| 55 | + | |
| 56 | + | |
| 57 | + | |
| 58 | + | |
| 59 | + | |
55 | 60 | | |
56 | 61 | | |
57 | 62 | | |
0 commit comments