Skip to content

comprehensive.md

Latest commit

 

History

History
41 lines (29 loc) · 3.34 KB

comprehensive.md

File metadata and controls

41 lines (29 loc) · 3.34 KB

Applications, Scripts, and Frameworks compatible with llm-env

Many tools, libraries, and frameworks have adopted the OPENAI_API_KEY and OPENAI_API_BASE environment variables as a standard for interoperability, making them ideal for use with the llm-env manager.

Native Anthropic Support

As of v1.2.0, llm-env supports the native Anthropic protocol. This means you can use it with tools that specifically expect ANTHROPIC_API_KEY and related variables, not just OpenAI-compatible ones.

Python Ecosystem

  • LangChain: A powerful framework for building applications with large language models.
  • LlamaIndex: A data framework for LLM applications that helps with data ingestion, structuring, and retrieval.
  • LiteLLM: A library that provides a single, unified completion() function for all LLM APIs, configured via environment variables.
  • Haystack: An open-source framework for building applications like question-answering and semantic search.
  • Griptape: A framework for building, deploying, and managing LLM-powered applications.
  • OpenAI Python Library: The core library that automatically loads API keys and other variables from your environment.
  • Aider: An AI pair programming tool that works with any OpenAI-compatible API.

JavaScript / TypeScript Ecosystem

  • AI SDK: A comprehensive library by Vercel for building AI applications that defaults to using OPENAI_API_KEY.
  • OpenAI Node.js Library: The official client that automatically loads API keys from process.env.
  • LobeChat: An open-source, high-performance UI that uses the OpenAI API format for its backend.
  • Anything LLM: A full-stack application for creating private chatbots.

Command-Line Interface (CLI) Tools

  • llm by Simon Willison: A popular CLI tool for interacting with LLMs.
  • promptfoo: A CLI tool for testing and evaluating LLM prompts across different providers.
  • OpenAI Codex CLI: A tool that brings the power of OpenAI's models to your terminal.
  • ask-cli: A simple, generic CLI tool for asking questions to an LLM.

Frameworks & Server-Side Tools

  • Vercel AI Gateway: A proxy that provides an OpenAI-compatible API endpoint for various providers.
  • Together.ai API: An API designed to be fully compatible with the OpenAI API, allowing for a simple OPENAI_API_BASE and key switch.
  • Runpod vLLM Serverless: A platform for LLMs that implements an OpenAI-compatible API.
  • Open WebUI: A self-hostable, multi-user, and multi-model web UI that works with various backends.