litellm
litellm is The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI,…. It is ranked #2 on the Stars Radar, in Models & inference, first seen 22 h ago and shared in 1 post (59.5k views).
Alternatives to litellm
- laya-mlx — Native MLX runtime for Laya typed decision models — 7–14 ms short decisions on M3 Max. No text generation, PyTorch, or…
- colibri — Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine,…
- models.dev — An open-source database of AI models.
- VoxCPM — VoxCPM2: Tokenizer-Free TTS for Multilingual Speech Generation, Creative Voice Design, and True-to-Life Cloning
- parakeet — OpenAI Whisper-compatible ASR server using NVIDIA Parakeet TDT 0.6B (ONNX). Super fast CPU/GPU transcriptions
- whisper.cpp — Port of OpenAI's Whisper model in C/C++
litellm in numbers
- Rank on the Stars Radar: #2 of 228
- Shared in 1 post by 1 account: @BerriAI
- 59.5k views on those posts
- First seen 22 h ago, last shared 4 min ago
- Pricing seen by Jev: open source
- Market: Models & inference
FAQ
What is litellm?
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI,… It was first shared on X 22 h ago and is ranked #2 on the Stars Radar.
Is litellm free?
It is open source.
Who shared litellm?
1 account on X, including @BerriAI, in 1 post totalling 59.5k views.
Every post is read and classified by Jev (TypeSafe): what it is, which market it belongs to, and whether the link is a real tool. 228 posts from 1 X accounts over the last 365 days, 228 tools, 10 markets. Collected every 5 minutes, fully re-ranked every hour — last update 2026-09-23 14:44 UTC. Full method.