Skip to content

[Bug] The values for completion_tokens and prompt_tokens appear to be reversed, differing from those returned in vllm. #4403

Description

@fit2cloud-mahaoyu

Contact Information

haoyu.ma@fit2cloud.com

MaxKB Version

v2.1.0 pro

Problem Description

Request VLLM, set max tokens to 1000:

Image

Request maxkb, set max token to 1000:

Image

Steps to Reproduce

Interfacing with VLLM, Q&A

The expected correct result

No response

Related log output

Additional Information

No response

Metadata

Metadata

Assignees

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions