[Cherry-Pick][Optimization] Reduce logprob processing overhead by using actual topk instead of fixed K+1 (#7860)#7861

Sunny-bot1 merged 3 commits into

PaddlePaddle:release/2.6PaddlePaddle/FastDeploy:release/2.6from

Sunny-bot1:opt_logprob_process_26Sunny-bot1/FastDeploy:opt_logprob_process_26Copy head branch name to clipboard