Initial support#1
Conversation
|
I can't wait to try this out, I want to run https://huggingface.co/microsoft/Phi-3-mini-128k-instruct-onnx on my Mac! |
|
Just curious, why not use this one https://huggingface.co/microsoft/Phi-3-mini-128k-instruct with MLX LM? That should already work quite well. |
|
1 month has passed. Is there any update? |
|
Can you say more about your use case for this @csukuangfj ? |
|
I want to create But the first obstacle is how to convert models from onnx to mlx. sherpa-onnx supports different types of models, e.g.
If we can convert models from onnx to mlx, then it should be straightforward to create |
|
Makes sense, thanks! This PR needs a bit of work before we can land it. I don't have an ETA yet. But its good to know of your use case to help prioritize. |
|
Almost two months have passed. Is there any update? |
|
No update here yet, sorry 😔 |
No description provided.