Convert Arrow Column objects to Python lists to prevent ValueError in…#1217

Open

anmol52490 wants to merge 1 commit into

huggingface:mainfrom

anmol52490:main

Commits on Apr 2, 2026

Convert Arrow Column objects to Python lists to prevent ValueError in tokenizer. Matches the fix implemented in the zh-TW version.
anmol52490
authored