BerriAI/litellm — The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+…
This is a stars post classified by Jev as Models & inference (a tool drop), kept by the Stars Radar because it carries real work, not commentary.
BerriAI/litellm — The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
Posted by BerriAI (0 followers) 22 h ago · 59.5k likes · 59.5k views · view the original post on X. Kept by the Stars Radar as Models & inference. Tools mentioned: litellm.
More stars work like this
- mizorewww/laya-mlx — Native MLX runtime for Laya typed decision models — 7–14 ms short… — @mizorewww
- anomalyco/models.dev — An open-source database of AI models. — @anomalyco
- JustVugg/colibri — Run frontier MoE models on hardware you already own — pure C, zero… — @JustVugg
- OpenBMB/VoxCPM — VoxCPM2: Tokenizer-Free TTS for Multilingual Speech Generation,… — @OpenBMB
- achetronic/parakeet — OpenAI Whisper-compatible ASR server using NVIDIA Parakeet TDT… — @achetronic
- k2-fsa/OmniVoice — High-Quality Voice Cloning TTS for 600+ Languages — @k2-fsa
- magnitudedev/magnitude — Open source inference engine for the hardware you already own.… — @magnitudedev
- microsoft/VibeVoice — Open-Source Frontier Voice AI — @microsoft
Every post is read and classified by Jev (TypeSafe): what it is, which market it belongs to, and whether the link is a real tool. 228 posts from 1 X accounts over the last 365 days, 228 tools, 10 markets. Collected every 5 minutes, fully re-ranked every hour — last update 2026-09-23 14:44 UTC. Full method.