How to use Litellm to integrate with locally deployed large models, is there a configuration guide

[ccly1996]

How to use Litellm to integrate with locally deployed large models, is there a configuration guide

[mczhuge]

I think Ollama is the commonly used local LLM provider. We have not experimented yet, but suggest reading AutoGen's solution: https://microsoft.github.io/autogen/0.2/docs/topics/non-openai-models/local-litellm-ollama/?utm_source=chatgpt.com