Skip to content

Commit 6f9e4d9

Browse files
HaystackBotsjrl
andauthored
docs: sync Haystack API reference on Docusaurus (#12175)
Co-authored-by: sjrl <10526848+sjrl@users.noreply.github.com>
1 parent 6d4b437 commit 6f9e4d9

1 file changed

Lines changed: 6 additions & 5 deletions

File tree

docs-website/reference/haystack-api/preprocessors_api.md

Lines changed: 6 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -891,7 +891,7 @@ Example:
891891
from haystack import Document
892892
from haystack.components.preprocessors import RecursiveDocumentSplitter
893893

894-
chunker = RecursiveDocumentSplitter(split_length=260, split_overlap=0, separators=["\n\n", "\n", ".", " "])
894+
chunker = RecursiveDocumentSplitter(split_length=15, split_overlap=0, separators=["\n\n", "\n", ".", " "])
895895
text = ('''Artificial intelligence (AI) - Introduction
896896
897897
AI, in its broadest sense, is intelligence exhibited by machines, particularly computer systems.
@@ -900,10 +900,11 @@ doc = Document(content=text)
900900
doc_chunks = chunker.run([doc])
901901
print(doc_chunks["documents"])
902902
# [
903-
# Document(id=..., content: 'Artificial intelligence (AI) - Introduction\n\n', meta: {'original_id': '...', 'split_id': 0, 'split_idx_start': 0, '_split_overlap': []})
904-
# Document(id=..., content: 'AI, in its broadest sense, is intelligence exhibited by machines, particularly computer systems.\n', meta: {'original_id': '...', 'split_id': 1, 'split_idx_start': 45, '_split_overlap': []})
905-
# Document(id=..., content: 'AI technology is widely used throughout industry, government, and science.', meta: {'original_id': '...', 'split_id': 2, 'split_idx_start': 142, '_split_overlap': []})
906-
# Document(id=..., content: ' Some high-profile applications include advanced web search engines; recommendation systems; interac...', meta: {'original_id': '...', 'split_id': 3, 'split_idx_start': 216, '_split_overlap': []})
903+
# Document(id=..., content: 'Artificial intelligence (AI) - Introduction\n\n', meta: {'source_id': '...', 'parent_id': '...', 'split_id': 0, 'split_idx_start': 0, '_split_overlap': None, 'page_number': 1})
904+
# Document(id=..., content: 'AI, in its broadest sense, is intelligence exhibited by machines, particularly computer systems.\n', meta: {'source_id': '...', 'parent_id': '...', 'split_id': 1, 'split_idx_start': 45, '_split_overlap': None, 'page_number': 1})
905+
# Document(id=..., content: 'AI technology is widely used throughout industry, government, and science.', meta: {'source_id': '...', 'parent_id': '...', 'split_id': 2, 'split_idx_start': 142, '_split_overlap': None, 'page_number': 1})
906+
# Document(id=..., content: ' Some high-profile applications include advanced web search engines; recommendation systems; interac...', meta: {'source_id': '...', 'parent_id': '...', 'split_id': 3, 'split_idx_start': 216, '_split_overlap': None, 'page_number': 1})
907+
# Document(id=..., content: 'vehicles; generative and creative tools; and superhuman play and analysis in strategy games.', meta: {'source_id': '...', 'parent_id': '...', 'split_id': 4, 'split_idx_start': 350, '_split_overlap': None, 'page_number': 1})
907908
# ]
908909
```
909910

0 commit comments

Comments
 (0)