Skip to content

Commit fd10d51

Browse files
MechaCritterjulian-rischclaude
authored
feat: added PythonCodeSplitter (deepset-ai#11380)
Co-authored-by: Julian Risch <julian.risch@deepset.ai> Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
1 parent f99fc7d commit fd10d51

4 files changed

Lines changed: 1496 additions & 0 deletions

File tree

haystack/components/preprocessors/__init__.py

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -16,6 +16,7 @@
1616
"embedding_based_document_splitter": ["EmbeddingBasedDocumentSplitter"],
1717
"hierarchical_document_splitter": ["HierarchicalDocumentSplitter"],
1818
"markdown_header_splitter": ["MarkdownHeaderSplitter"],
19+
"python_code_splitter": ["PythonCodeSplitter"],
1920
"recursive_splitter": ["RecursiveDocumentSplitter"],
2021
"text_cleaner": ["TextCleaner"],
2122
}
@@ -29,6 +30,7 @@
2930
from .embedding_based_document_splitter import EmbeddingBasedDocumentSplitter as EmbeddingBasedDocumentSplitter
3031
from .hierarchical_document_splitter import HierarchicalDocumentSplitter as HierarchicalDocumentSplitter
3132
from .markdown_header_splitter import MarkdownHeaderSplitter as MarkdownHeaderSplitter
33+
from .python_code_splitter import PythonCodeSplitter as PythonCodeSplitter
3234
from .recursive_splitter import RecursiveDocumentSplitter as RecursiveDocumentSplitter
3335
from .text_cleaner import TextCleaner as TextCleaner
3436

0 commit comments

Comments
 (0)