Fp8 deepseek#975

Open

blueswhen wants to merge 9 commits into

mainfrom

Commits on Sep 2, 2025

feat: move init_req_to_token_indexes and copy_kv_index_to_req to alloc fun
niushengxiao
committed
feat: add page_size_variable mode for fa3 backend
niushengxiao
committed
feat: support page size variable for flashinfer
niushengxiao
committed
feat: support page size variable for deepseek2
niushengxiao
committed
fix: fix the page not enough bug
niushengxiao
committed
feat: add alloc_paged_token_indices function in req_manager
niushengxiao
committed

Commits on Sep 3, 2025

feat: replace page idxs with token idxs in paged_mem_manager
niushengxiao
committed

Commits on Sep 4, 2025

feat: remove page_size_variable mode
niushengxiao
committed
feat: add b_last_mem_indx in the InferReq
niushengxiao
committed