Skip to content

chore: Remove least useful integration tests to prevent CI causing rate limiting#2670

Closed
vblagoje wants to merge 2 commits into
mainfrom
fix_meta_llama_rate_limiting
Closed

chore: Remove least useful integration tests to prevent CI causing rate limiting#2670
vblagoje wants to merge 2 commits into
mainfrom
fix_meta_llama_rate_limiting

Conversation

@vblagoje
Copy link
Copy Markdown
Member

@vblagoje vblagoje commented Jan 8, 2026

  • trimming two more integration tests in meta llama integration

Hopefully we'll now avoid rate limiting issues on CI often causing false flag failures

@vblagoje vblagoje requested a review from a team as a code owner January 8, 2026 09:37
@vblagoje vblagoje requested review from sjrl and removed request for a team January 8, 2026 09:37
@github-actions github-actions Bot added integration:meta-llama type:documentation Improvements or additions to documentation labels Jan 8, 2026
reason="Export an env var called LLAMA_API_KEY containing the OpenAI API key to run this test.",
)
@pytest.mark.integration
def test_live_run_with_tools_streaming(self, tools):
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think I'd prefer dropping the test_live_run_streaming test since this one tests regular streaming + tool streaming.

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, make sense

@vblagoje
Copy link
Copy Markdown
Member Author

vblagoje commented Jan 8, 2026

It seems like this is not going to work, rate limiting failures are still there. We need to either get a better plan for meta or cut down test matrix for it - cc @sjrl @anakin87

@vblagoje
Copy link
Copy Markdown
Member Author

vblagoje commented Jan 8, 2026

Closing this PR, we need to find another solution and stop further trimming of the tests

@vblagoje vblagoje closed this Jan 8, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

integration:meta-llama type:documentation Improvements or additions to documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants