Update tests/core/test_tokenize.py

bact · web-flow · commit 628bb2872d4b · 2026-05-01T07:24:56.000+01:00
diff --git a/tests/core/test_tokenize.py b/tests/core/test_tokenize.py
@@ -340,7 +340,7 @@ def test_sent_tokenize(self):
             [],
         )
         self.assertEqual(
-            sent_tokenize(["สวัสดี", None], engine="whitespace+newline"),
+            sent_tokenize(["สวัสดี", None], engine="whitespace+newline"),  # type: ignore
             [],
         )
 

Original file line number	Diff line number	Diff line change
`@@ -340,7 +340,7 @@ def test_sent_tokenize(self):`
`340`	`340`	`[],`
`341`	`341`	`)`
`342`	`342`	`self.assertEqual(`
`343`		`- sent_tokenize(["สวัสดี", None], engine="whitespace+newline"),`
	`343`	`+ sent_tokenize(["สวัสดี", None], engine="whitespace+newline"), # type: ignore`
`344`	`344`	`[],`
`345`	`345`	`)`
`346`	`346`