Skip to content

Commit 49bfcfb

Browse files
committed
feat: add generic inference side-channel adapters
1 parent 918415c commit 49bfcfb

3 files changed

Lines changed: 516 additions & 55 deletions

File tree

cppmega_mlx/inference/__init__.py

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -45,10 +45,13 @@
4545
AdapterCapabilities,
4646
ClangCodeMetadataAdapter,
4747
CodeMetadataAdapter,
48+
GoCodeMetadataAdapter,
4849
InferenceFailPolicy,
4950
InferenceSideChannelBuilder,
5051
InferenceSideChannelCacheComponents,
5152
InferenceSideChannelResult,
53+
PythonCodeMetadataAdapter,
54+
RustCodeMetadataAdapter,
5255
TokenMetadata,
5356
UnavailableCodeMetadataAdapter,
5457
builtin_code_metadata_adapters,
@@ -76,10 +79,13 @@
7679
"InferenceSideChannelBuilder",
7780
"InferenceSideChannelCacheComponents",
7881
"InferenceSideChannelResult",
82+
"GoCodeMetadataAdapter",
7983
"PAGED_ATTENTION_NOT_INTEGRATED_MESSAGE",
8084
"PagedKVBlockManager",
8185
"PagedKVBlockManagerConfig",
86+
"PythonCodeMetadataAdapter",
8287
"PromptCacheEntry",
88+
"RustCodeMetadataAdapter",
8389
"SchedulerOutput",
8490
"SequenceRequest",
8591
"TokenMetadata",

0 commit comments

Comments
 (0)