BerriAI/litellm — The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+…
A GitHub repository starred by Agentik OS and classified by AGK Intelligence as Models & inference.
BerriAI/litellm — The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
By BerriAI on GitHub · starred 46 days ago · 62.9k GitHub stars · 13.1k forks · view the repository on GitHub. Repository page: litellm.
More Models & inference repositories
- p-e-w/heretic — Training-free language model modification: Remove censorship, suppress…
- Edge0-AI/Edge0 — Run 35B MoE models in ~2.5 GB of RAM. Weights stream from SSD; a…
- NVlabs/Sana — SANA & Sol: Efficient Generative Models and Full-Stack Training &…
- microsoft/BitNet — Official inference framework for 1-bit LLMs
- Tiiny-AI/PowerInfer — High-speed Large Language Model Serving for Local Deployment
- xinyao27/jevonian — One local endpoint. The right model for every turn — enforced in…
- muellerberndt/cadence — A brain that learns from live experience. System 1 by default:…
- mizorewww/laya-mlx — Native MLX runtime for Laya typed decision models — 7–14 ms short…
Every repository Agentik OS stars on GitHub is read and classified by AGK Intelligence: what it is, which market it belongs to, how useful and how mature. 315 repositories, 10 markets. The stars are read every 5 minutes — last update 2026-11-07 21:35 UTC. Full method.