GitHub API Rate Limit

[yilinxia]

Hi @matthewturk @cindytsai
For the following topics,

Error fetching repositories for tag 'large-language-models': 422
Error fetching repositories for tag 'llm': 422
Error fetching repositories for tag 'llms': 422
Error fetching repositories for tag 'generative-ai': 422
Error fetching repositories for tag 'gpt': 422
Error fetching repositories for tag 'openai': 422
Error fetching repositories for tag 'chatgpt': 422
Error fetching repositories for tag 'generative-ai': 422

It seems like GitHub isn't returning the expected results. Do you know of any workarounds to fix this?

PS: I want to extract all repos for the tags

[matthewturk]

Are those the only tags it fails on?

Also, be careful not to abuse the rate limit. Let's really tread carefully on that.

[yilinxia]

Yeah, I send a group of topics but these topics failed. I checked the linked repos - a lot ! I guess thats the reason it failed...

[yilinxia]

Now, we can use the Google BigQuery + Githubarchive to get the most up-to-date information