inference-compute

Here are 2 public repositories matching this topic...

RylanSchaeffer / KoyejoLab-Large-How-Do-Language-Monkey-Power-Get-Their-Power

Code for ICML 2025 How Do Large Language Monkeys Get Their Power (Laws)?

natural-language-processing evaluations language-models scaling-laws test-time-compute inference-compute scaling-inference-compute scaling-test-time-compute scaling-predictable-evaluations

Updated Jul 20, 2025
Python

yutoTachibana / depth-lens

Star

Cost-vs-accuracy CI for LLM ops. Pick the cheapest API tier, compare self-hosted vLLM vs cloud APIs on one Pareto, and grade free-form output with an LLM-as-judge - all on your own data with Wilson 95% CIs.

python benchmark evaluation-framework model-comparison cost-optimization gemini-api openai-api llm vllm llm-evaluation llm-as-judge anthropic-api inference-compute looped-transformer production-ci

Updated May 18, 2026
Python

Improve this page

Add a description, image, and links to the inference-compute topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the inference-compute topic, visit your repo's landing page and select "manage topics."

Learn more

Provide feedback

Saved searches

Use saved searches to filter your results more quickly