The $\text{Pre}^3$ branch (https://github.com/ModelTC/LightLLM/tree/pre3-integrated) requires package lightllm_constraint_decode_kernel to run. However, I cannot find this package from the repositories in this organization. Is there any open-source implementation of $\text{Pre}^3$ that is ready for anyone to reproduce the results in the paper? Thanks!
The$\text{Pre}^3$ branch (https://github.com/ModelTC/LightLLM/tree/pre3-integrated) requires package $\text{Pre}^3$ that is ready for anyone to reproduce the results in the paper? Thanks!
lightllm_constraint_decode_kernelto run. However, I cannot find this package from the repositories in this organization. Is there any open-source implementation of