Add multilingual conformance tests for byte-identical Python parity#357

john-rocky wants to merge 1 commit into

huggingface:mainhuggingface/swift-transformers:mainfrom

john-rocky:test/multilingual-tokenizer-conformancejohn-rocky/swift-transformers:test/multilingual-tokenizer-conformanceCopy head branch name to clipboard