Skip to content

special token in xlnet fine_tuning #3

@lytum

Description

@lytum

hallo,

thanks for your information and share.may i ask you one question about the special tokens of XLNet. we all know the special tokens of 'BERT' are '[CLS]' and '[SEP]'. i noticed in the official documents of XLNet, the corresponding special tokens are '' and ''. however, many people still use '[CLS]' and '[SEP]' to tokenize. do you notice that? and thanks advance for your reply.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions