Commit da9158b
authored
Add shim_et nlohmann-json shim for OSS buck2 build (#20505)
The tokenizers submodule bump moved the
fbsource//third-party/nlohmann-json dependency onto the tokenizers
:headers target, which is reachable from the OSS buck2 CI build
(multimodal_runner_lib -> text_token_generator -> tokenizers:headers).
Since fbsource aliases to shim_et, this requires a
shim_et//third-party/nlohmann-json package, which did not exist (only
re2 had one).
Add the shim, mirroring shim_et//third-party/re2, aliasing nlohmann-json
to the header-only nlohmann_json target added to the tokenizers
submodule (meta-pytorch/tokenizers#201), and bump the submodule pin to
include it.1 parent e03f777 commit da9158b
4 files changed
Lines changed: 15 additions & 2 deletions
File tree
- extension/llm
- shim_et
- third-party/nlohmann-json
- xplat/executorch/build
Submodule tokenizers updated 1 file
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
| 2 | + | |
| 3 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
| 2 | + | |
| 3 | + | |
| 4 | + | |
| 5 | + | |
| 6 | + | |
| 7 | + | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
45 | 45 | | |
46 | 46 | | |
47 | 47 | | |
48 | | - | |
| 48 | + | |
49 | 49 | | |
50 | 50 | | |
51 | 51 | | |
| |||
0 commit comments