Bug + solution: openrouter models are not continuously updated

[thiswillbeyourgithub]

Hi,

It seems that the openrouter prices are not automatically updated even though could be updated automatically using their API.

I went in depth in code example to do this very simply in the following issue: k-zehnder/gophersignal#418

[thiswillbeyourgithub]

Is this planned?

[areibman]

LiteLLM is a superset of the openrouter models, so it's safer to rely on those

[thiswillbeyourgithub]

I'm not sure I understand. How can it be safer to rely on litellm for openrouter models instead of relying on openrouter itself for its own costs?

[areibman]

@dot-agi can explain in more detail, but essentially they have an action that runs every day that fetches openrouter prices and updates their superset dictionary

[thiswillbeyourgithub]

Thanks I didn't know. But still, that means that one of the github branch is at most 24h late. Then you have to wait litellm to release. Then you have to yourself bump the litellm version. Then the user has to bump the version.

Unless you fetch the latest data automatically when your code starts? I assumed it was hardcoded but indeed that might be stupid of me.

[dot-agi]

We simply wait for litellm to update their dictionary, and it gets updated here automatically. We almost always get the data within 24 hours.