Skip to content

ValueError: Unsupported model type qwen3 #566

@dgzxx-2000

Description

@dgzxx-2000

import mii
import os
os.environ["MASTER_ADDR"] = "localhost"
os.environ["MASTER_PORT"] = "29505" # Your chosen port

model_config = {
"torch_dist_port": 29505, # Your custom port
# Other configs if needed...
}

pipe = mii.pipeline("/data/home/zengxiangxi/hf_model/qwen3-0.6b",model_config=model_config,)
response = pipe(["DeepSpeed is", "Seattle is"], max_new_tokens=64)
print(response)

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions