JustVugg/colibri — A hierarchical inference engine for frontier MoE models: hot experts…

A GitHub repository starred by Agentik OS and classified by AGK Intelligence as Models & inference.

JustVugg/colibri — A hierarchical inference engine for frontier MoE models: hot experts on the GPU (CUDA, Vulkan), warm ones in RAM, cold ones streamed from NVMe. Written in C, runs on the hardware you already own.

By JustVugg on GitHub · starred 50 days ago · 48.4k GitHub stars · 5.6k forks · view the repository on GitHub. Repository page: colibri.

More Models & inference repositories

• p-e-w/heretic — Training-free language model modification: Remove censorship, suppress…
• Edge0-AI/Edge0 — Run 35B MoE models in ~2.5 GB of RAM. Weights stream from SSD; a…
• NVlabs/Sana — SANA & Sol: Efficient Generative Models and Full-Stack Training &…
• microsoft/BitNet — Official inference framework for 1-bit LLMs
• Tiiny-AI/PowerInfer — High-speed Large Language Model Serving for Local Deployment
• xinyao27/jevonian — One local endpoint. The right model for every turn — enforced in…
• muellerberndt/cadence — A brain that learns from live experience. System 1 by default:…
• BerriAI/litellm — The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+…

Every repository Agentik OS stars on GitHub is read and classified by AGK Intelligence: what it is, which market it belongs to, how useful and how mature. 314 repositories, 10 markets. The stars are read every 5 minutes — last update 2026-11-06 16:55 UTC. Full method.