Not sure if this is original llama3 issue or a issue caused by INT4 AWQ. When I type in "exit", it keeps generating without ending the sentence: <img width="759" alt="Screenshot 2024-06-19 at 10 51 21 AM" src="https://github.com/mit-han-lab/TinyChatEngine/assets/16040099/6c137e71-33b7-4bb9-8070-43cb41c8b389">
Not sure if this is original llama3 issue or a issue caused by INT4 AWQ.
When I type in "exit", it keeps generating without ending the sentence: