Fix the problem that the sequence length is still limited when using relative positions#111

Open

momo-journey wants to merge 1 commit intohuawei-noah:masterfrom

momo-journey:master

Commits on Apr 8, 2021

The original relative_position_embeddings were created while a fixed matrix of relative_position_ids was preset to look up the table (i.e., the relative_position_ids matrix for sequences of length …
momo-journey
committed