litellm
litellm: The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI,…. It is ranked #25 on the Stars Radar, in Models & inference. Agentik OS starred it 46 days ago, and it has 62.9k GitHub stars.
Alternatives to litellm
- heretic — Fully automatic censorship removal for language models
- Edge0 — Run 35B MoE models in ~2.5 GB of RAM. Weights stream from SSD; a trained router predicts loads a step ahead. Mac,…
- Sana — SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformer
- BitNet — Official inference framework for 1-bit LLMs
- PowerInfer — High-speed Large Language Model Serving for Local Deployment
- whisper.cpp — Port of OpenAI's Whisper model in C/C++
litellm in numbers
- Rank on the Stars Radar: #25 of 315
- 62.9k GitHub stars
- Starred by Agentik OS 46 days ago, last push 3 min ago
- Owner: BerriAI on GitHub
- Market: Models & inference
FAQ
What is litellm?
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI,… Agentik OS starred it on GitHub 46 days ago; it is ranked #25 on the Stars Radar.
Is litellm free?
It is an open-source repository on GitHub; check its license before use.
Who makes litellm?
The GitHub account BerriAI. The repository has 62.9k GitHub stars.
Every repository Agentik OS stars on GitHub is read and classified by AGK Intelligence: what it is, which market it belongs to, how useful and how mature. 315 repositories, 10 markets. The stars are read every 5 minutes — last update 2026-11-07 21:35 UTC. Full method.