Commit b662eb3

committed

feat(speculative): support extract hidden states with vllm backend

1 parent 028f7ab commit b662eb3Copy full SHA for b662eb3

2 files changed

angelslim/compressor/speculative/train/models/target
- target_model_wrapper.py
tools
- generate_hidden_for_draft_model.py

Comments

(0)